Imperial College London

Professor Yiannis Demiris

Faculty of EngineeringDepartment of Electrical and Electronic Engineering

Professor of Human-Centred Robotics, Head of ISN



+44 (0)20 7594 6300y.demiris Website




1011Electrical EngineeringSouth Kensington Campus






BibTex format

author = {Wu, Y and Demiris, Y},
doi = {10.1109/ROBIO.2011.6181707},
pages = {2664--2669},
publisher = {IEEE},
title = {Learning Dynamical Representations of Tools for Tool-Use Recognition},
url = {},
year = {2011}

RIS format (EndNote, RefMan)

AB - We consider the problem of representing and recognising tools, a subset of objects that have special functionality and action patterns. Our proposed framework is based on the biological evidence of hierarchical representation of tools in the region of the human cortex that generates action semantics. It addresses the shortfalls of traditional learning models of object representation applied on tools. To showcase its merits, this framework is implemented as a hybrid model between the Hierarchical Attentive Multiple Models for Execution and Recognition of Actions Architecture (HAMMER) and Hidden Markov Model (HMM) to recognise and describe tools as dynamic patterns at symbolic level. The implemented model is tested and validated on two sets of experiments of 50 human demonstrations each on using 5 different tools. In the experiment with precise and accurate input data, the cross-validation statistics suggest very robust identification of the learned tools. In the experiment with unstructured environment, all errors can be explained systematically.
AU - Wu,Y
AU - Demiris,Y
DO - 10.1109/ROBIO.2011.6181707
EP - 2669
PY - 2011///
SP - 2664
TI - Learning Dynamical Representations of Tools for Tool-Use Recognition
UR -
UR -
ER -