Imperial College London
Alternate

ProfessorAbhijeetGhosh

Faculty of Engineering, Department of Computing

Professor of Graphics and Imaging
 
 
 
//

Contact

 

+44 (0)20 7594 8351abhijeet.ghosh Website

 
 
//

Location

 

376Huxley BuildingSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Gotardo:2018:10.1145/3272127.3275073,
author = {Gotardo, P and Riviere, J and Bradley, D and Ghosh, A and Beeler, T},
doi = {10.1145/3272127.3275073},
journal = {ACM Transactions on Graphics},
title = {Practical dynamic facial appearance modeling and acquisition},
url = {http://dx.doi.org/10.1145/3272127.3275073},
volume = {37},
year = {2018}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - We present a method to acquire dynamic properties of facial skin appearance, including dynamic diffuse albedo encoding blood flow, dynamic specular intensity, and per-frame high resolution normal maps for a facial performance sequence. The method reconstructs these maps from a purely passive multi-camera setup, without the need for polarization or requiring temporally multiplexed illumination. Hence, it is very well suited for integration with existing passive systems for facial performance capture. To solve this seemingly underconstrained problem, we demonstrate that albedo dynamics during a facial performance can be modeled as a combination of: (1) a static, high-resolution base albedo map, modeling full skin pigmentation; and (2) a dynamic, one-dimensional component in the CIE Lab color space, which explains changes in hemoglobin concentration due to blood flow. We leverage this albedo subspace and additional constraints on appearance and surface geometry to also estimate specular reflection parameters and resolve high-resolution normal maps with unprecedented detail in a passive capture system. These constraints are built into an inverse rendering framework that minimizes the difference of the rendered face to the captured images, incorporating constraints from multiple views for every texel on the face. The presented method is the first system capable of capturing high-quality dynamic appearance maps at full resolution and video framerates, providing a major step forward in the area of facial appearance acquisition.
AU  - Gotardo,P
AU  - Riviere,J
AU  - Bradley,D
AU  - Ghosh,A
AU  - Beeler,T
DO  - 10.1145/3272127.3275073
PY  - 2018///
SN  - 0730-0301
TI  - Practical dynamic facial appearance modeling and acquisition
T2  - ACM Transactions on Graphics
UR  - http://dx.doi.org/10.1145/3272127.3275073
UR  - http://hdl.handle.net/10044/1/66899
VL  - 37
ER  -
Download