A 3D Morphable Eye Region Model for Gaze Estimation
Erroll Wood, Tadas Baltrušaitis, Louis-Philippe Morency, Peter Robinson, Andreas Bulling
Proc. European Conference on Computer Vision (ECCV), pp. 297-313, 2016.
Abstract
Morphable face models are a powerful tool, but have previ- ously failed to model the eye accurately due to complexities in its material and motion. We present a new multi-part model of the eye that includes a morphable model of the facial eye region, as well as an anatomy-based eyeball model. It is the first morphable model that accurately captures eye region shape, since it was built from high-quality head scans. It is also the first to allow independent eyeball movement, since we treat it as a separate part. To showcase our model we present a new method for illumination- and head-pose–invariant gaze estimation from a single RGB image. We fit our model to an image through analysis-by-synthesis, solving for eye region shape, texture, eyeball pose, and illumination simul- taneously. The fitted eyeball pose parameters are then used to estimate gaze direction. Through evaluation on two standard datasets we show that our method generalizes to both webcam and high-quality camera images, and outperforms a state-of-the-art CNN method achieving a gaze estimation accuracy of 9.44° in a challenging user-independent scenario.Links
doi: 10.1007/978-3-319-46448-0_18
Paper: wood16_eccv.pdf
BibTeX
@inproceedings{wood16_eccv,
author = {Wood, Erroll and Baltru{\v{s}}aitis, Tadas and Morency, Louis-Philippe and Robinson, Peter and Bulling, Andreas},
title = {A 3D Morphable Eye Region Model for Gaze Estimation},
booktitle = {Proc. European Conference on Computer Vision (ECCV)},
year = {2016},
pages = {297-313},
doi = {10.1007/978-3-319-46448-0_18}
}