Imperial College London
Portrait Picture

Dr Dandan Zhang

Faculty of Engineering, Department of Bioengineering

Lecturer in Artificial Intelligence & Machine Learning
 
 
 
//

Contact

 

d.zhang17 Website

 
 
//

Location

 

402Sir Michael Uren HubWhite City Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Fan:2023:10.1109/LRA.2023.3325784,
author = {Fan, W and Guo, X and Feng, E and Lin, J and Wang, Y and Liang, J and Garrad, M and Rossiter, J and Zhang, Z and Lepora, N and Wei, L and Zhang, D},
doi = {10.1109/LRA.2023.3325784},
journal = {IEEE Robotics and Automation Letters},
pages = {8494--8501},
title = {Digital Twin-Driven Mixed Reality Framework for Immersive Teleoperation With Haptic Rendering},
url = {http://dx.doi.org/10.1109/LRA.2023.3325784},
volume = {8},
year = {2023}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - Teleoperation has widely contributed to many applications. Consequently, the design of intuitive and ergonomic control interfaces for teleoperation has become crucial. The rapid advancement of Mixed Reality (MR) has yielded tangible benefits in human-robot interaction. MR provides an immersive environment for interacting with robots, effectively reducing the mental and physical workload of operators during teleoperation. Additionally, the incorporation of haptic rendering, including kinaesthetic and tactile rendering, could further amplify the intuitiveness and efficiency of MR-based immersive teleoperation. In this study, we developed an immersive, bilateral teleoperation system, integrating Digital Twin-driven Mixed Reality (DTMR) manipulation with haptic rendering. This system comprises a commercial remote controller with a kinaesthetic rendering feature and a wearable cost-effective tactile rendering interface, called the Soft Pneumatic Tactile Array (SPTA). We carried out two user studies to assess the system's effectiveness, including a performance evaluation of key components within DTMR and a quantitative assessment of the newly developed SPTA. The results demonstrate an enhancement in both the human-robot interaction experience and teleoperation performance.
AU  - Fan,W
AU  - Guo,X
AU  - Feng,E
AU  - Lin,J
AU  - Wang,Y
AU  - Liang,J
AU  - Garrad,M
AU  - Rossiter,J
AU  - Zhang,Z
AU  - Lepora,N
AU  - Wei,L
AU  - Zhang,D
DO  - 10.1109/LRA.2023.3325784
EP  - 8501
PY  - 2023///
SP  - 8494
TI  - Digital Twin-Driven Mixed Reality Framework for Immersive Teleoperation With Haptic Rendering
T2  - IEEE Robotics and Automation Letters
UR  - http://dx.doi.org/10.1109/LRA.2023.3325784
VL  - 8
ER  -
Download