Imperial College London

Professor Yiannis Demiris

Faculty of EngineeringDepartment of Electrical and Electronic Engineering

Professor of Human-Centred Robotics, Head of ISN



+44 (0)20 7594 6300y.demiris Website




1011Electrical EngineeringSouth Kensington Campus






BibTex format

author = {Petit, M and Lallée, S and Boucher, J-D and Pointeau, G and Cheminade, P and Ognibene, D and Chinellato, E and Pattacini, U and Gori, I and Martinez-Hernandez, U and Barron-Gonzalez, H and Inderbitzin, M and Luvizotto, A and Vouloutsi, V and Demiris, Y and Metta, G and Dominey, PF},
doi = {10.1109/TAMD.2012.2209880},
journal = {IEEE Transactions on Autonomous Mental Development},
pages = {3--17},
title = {The Coordinating Role of Language in Real-Time Multi-Modal Learning of Cooperative Tasks},
url = {},
volume = {5},
year = {2013}

RIS format (EndNote, RefMan)

AB - One of the defining characteristics of human cognition is our outstanding capacity to cooperate. A central requirement for cooperation is the ability to establish a “shared plan”-which defines the interlaced actions of the two cooperating agents-in real time, and even to negotiate this shared plan during its execution. In the current research we identify the requirements for cooperation, extending our earlier work in this area. These requirements include the ability to negotiate a shared plan using spoken language, to learn new component actions within that plan, based on visual observation and kinesthetic demonstration, and finally to coordinate all of these functions in real time. We present a cognitive system that implements these requirements, and demonstrate the system's ability to allow a Nao humanoid robot to learn a nontrivial cooperative task in real-time. We further provide a concrete demonstration of how the real-time learning capability can be easily deployed on a different platform, in this case the iCub humanoid. The results are considered in the context of how the development of language in the human infant provides a powerful lever in the development of cooperative plans from lower-level sensorimotor capabilities.
AU - Petit,M
AU - Lallée,S
AU - Boucher,J-D
AU - Pointeau,G
AU - Cheminade,P
AU - Ognibene,D
AU - Chinellato,E
AU - Pattacini,U
AU - Gori,I
AU - Martinez-Hernandez,U
AU - Barron-Gonzalez,H
AU - Inderbitzin,M
AU - Luvizotto,A
AU - Vouloutsi,V
AU - Demiris,Y
AU - Metta,G
AU - Dominey,PF
DO - 10.1109/TAMD.2012.2209880
EP - 17
PY - 2013///
SN - 1943-0604
SP - 3
TI - The Coordinating Role of Language in Real-Time Multi-Modal Learning of Cooperative Tasks
T2 - IEEE Transactions on Autonomous Mental Development
UR -
UR -
VL - 5
ER -