Personalized Robot-Assisted Dressing
Robotic solutions to dressing assistance have the potential to provide tremendous support for elderly and disabled people. However, unexpected user movements may lead to dressing failures or even pose a risk to the user. Tracking such user movements with vision sensors is challenging due to severe visual occlusions created by the robot and clothes. We propose a probabilistic tracking method using Bayesian networks in latent spaces, which fuses robot end-effector positions and force information to enable camera-less and real-time estimation of the user postures during dressing. The latent spaces are created before dressing by modeling the user movements with a Gaussian Process Latent Variable Model, taking the user's movement limitations into account. We introduce a robot-assisted dressing system that combines our tracking method with hierarchical multi-task control to minimize the force between the user and the robot. The experimental results demonstrate the robustness and accuracy of our tracking method. The proposed method enables the Baxter robot to provide personalized dressing assistance in putting on a sleeveless jacket for users with (simulated) upper-body impairments.
If you want to learn more about our real-time user posture tracking for robot-assisted dressing, we now have a recorded talk at IET event Human Motion Analysis for Healthcare Applications.
- Zhang F, Cully A, Demiris Y (2019). Probabilistic Real-Time User Posture Tracking for Personalized Robot-Assisted Dressing. IEEE Transactions on Robotics.
- Zhang F, Cully A, Demiris Y (2017). Personalized Robot-assisted Dressing using User Modeling in Latent Spaces. International Conference on Intelligent Robots and Systems (IROS 2017), pp: 3603-3610.
- Gao Y, Chang HJ, Demiris Y, (2016). Iterative Path Optimisation for Personalised Dressing Assistance using Vision and Force Information, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2016), pp: 4398-4403.
- Gao Y, Chang HJ, Demiris Y (2015), User Modelling for Personalised Dressing Assistance by Humanoid Robots, IEEE International Conference on Intelligent Robots and Systems (IROS 2015), pp:1840-1845.