Imperial College London


Faculty of EngineeringDepartment of Electrical and Electronic Engineering

Senior Lecturer



+44 (0)20 7594 Website




1017Electrical EngineeringSouth Kensington Campus






BibTex format

author = {Chang, HJ and Garcia-Hernando, G and Tang, D and Kim, T-K},
doi = {10.1016/j.cviu.2016.01.010},
journal = {Computer Vision and Image Understanding},
pages = {87--96},
title = {Spatio-Temporal Hough Forest for efficient detection-localisation-recognition of fingerwriting in egocentric camera},
url = {},
volume = {148},
year = {2016}

RIS format (EndNote, RefMan)

AB - Recognising fingerwriting in mid-air is a useful input tool for wearable egocentric camera. In this paper we propose a novel framework to this purpose. Specifically, our method first detects a writing hand posture and locates the position of index fingertip in each frame. From the trajectory of the fingertip, the written character is localised and recognised simultaneously. To achieve this challenging task, we first present a contour-based view independent hand posture descriptor extracted with a novel signature function. The proposed descriptor serves both posture recognition and fingertip detection. As to recognising characters from trajectories, we propose Spatio-Temporal Hough Forest that takes sequential data as input and perform regression on both spatial and temporal domain. Therefore our method can perform character recognition and localisation simultaneously. To establish our contributions, a new handwriting-in-mid-air dataset with labels for postures, fingertips and character locations is proposed. We design and conduct experiments of posture estimation, fingertip detection, character recognition and localisation. In all experiments our method demonstrates superior accuracy and robustness compared to prior arts.
AU - Chang,HJ
AU - Garcia-Hernando,G
AU - Tang,D
AU - Kim,T-K
DO - 10.1016/j.cviu.2016.01.010
EP - 96
PY - 2016///
SN - 1090-235X
SP - 87
TI - Spatio-Temporal Hough Forest for efficient detection-localisation-recognition of fingerwriting in egocentric camera
T2 - Computer Vision and Image Understanding
UR -
VL - 148
ER -