Imperial College London

STEFANOS ZAFEIRIOU, PhD

Faculty of EngineeringDepartment of Computing

Reader in Machine Learning and Computer Vision
 
 
 
//

Contact

 

+44 (0)20 7594 8461s.zafeiriou Website CV

 
 
//

Location

 

375Huxley BuildingSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Deng:2018:10.1007/s11263-018-1134-y,
author = {Deng, J and Roussos, A and Chrysos, G and Ververas, E and Kotsia, I and Shen, J and Zafeiriou, S},
doi = {10.1007/s11263-018-1134-y},
journal = {International Journal of Computer Vision},
title = {The Menpo benchmark for multi-pose 2D and 3D facial landmark localisation and tracking},
url = {http://dx.doi.org/10.1007/s11263-018-1134-y},
year = {2018}
}

RIS format (EndNote, RefMan)

TY  - JOUR
AB - In this article, we present the Menpo 2D and Menpo 3D benchmarks, two new datasets for multi-pose 2D and 3D facial landmark localisation and tracking. In contrast to the previous benchmarks such as 300W and 300VW, the proposed benchmarks contain facial images in both semi-frontal and profile pose. We introduce an elaborate semi-automatic methodology for providing high-quality annotations for both the Menpo 2D and Menpo 3D benchmarks. In Menpo 2D benchmark, different visible landmark configurations are designed for semi-frontal and profile faces, thus making the 2D face alignment full-pose. In Menpo 3D benchmark, a united landmark configuration is designed for both semi-frontal and profile faces based on the correspondence with a 3D face model, thus making face alignment not only full-pose but also corresponding to the real-world 3D space. Based on the considerable number of annotated images, we organised Menpo 2D Challenge and Menpo 3D Challenge for face alignment under large pose variations in conjunction with CVPR 2017 and ICCV 2017, respectively. The results of these challenges demonstrate that recent deep learning architectures, when trained with the abundant data, lead to excellent results. We also provide a very simple, yet effective solution, named Cascade Multi-view Hourglass Model, to 2D and 3D face alignment. In our method, we take advantage of all 2D and 3D facial landmark annotations in a joint way. We not only capitalise on the correspondences between the semi-frontal and profile 2D facial landmarks but also employ joint supervision from both 2D and 3D facial landmarks. Finally, we discuss future directions on the topic of face alignment.
AU - Deng,J
AU - Roussos,A
AU - Chrysos,G
AU - Ververas,E
AU - Kotsia,I
AU - Shen,J
AU - Zafeiriou,S
DO - 10.1007/s11263-018-1134-y
PY - 2018///
SN - 0920-5691
TI - The Menpo benchmark for multi-pose 2D and 3D facial landmark localisation and tracking
T2 - International Journal of Computer Vision
UR - http://dx.doi.org/10.1007/s11263-018-1134-y
UR - http://hdl.handle.net/10044/1/69752
ER -