Realtime Dynamic 3D Facial Reconstruction for Monocular Video In-the-Wild

Authors: Liu, S., Wang, Z., Yang, X. and Zhang, J.

Journal: Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017

Volume: 2018-January

Pages: 777-785

DOI: 10.1109/ICCVW.2017.97

Abstract:

With the increasing amount of videos recorded using 2D mobile cameras, the technique for recovering the 3D dynamic facial models from these monocular videos has become a necessity for many image and video editing applications. While methods based parametric 3D facial models can reconstruct the 3D shape in dynamic environment, large structural changes are ignored. Structure-from-motion methods can reconstruct these changes but assume the object to be static. To address this problem we present a novel method for realtime dynamic 3D facial tracking and reconstruction from videos captured in uncontrolled environments. Our method can track the deforming facial geometry and reconstruct external objects that protrude from the face such as glasses and hair. It also allows users to move around, perform facial expressions freely without degrading the reconstruction quality.

https://eprints.bournemouth.ac.uk/30711/

Source: Scopus

Realtime Dynamic 3D Facial Reconstruction for Monocular Video In-the-Wild

Authors: Liu, S., Wang, Z., Yang, X. and Zhang, J.

Journal: 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017)

Pages: 777-785

ISSN: 2473-9936

DOI: 10.1109/ICCVW.2017.97

https://eprints.bournemouth.ac.uk/30711/

Source: Web of Science (Lite)

Realtime Dynamic 3D Facial Reconstruction for Monocular Video In-the-Wild

Authors: Liu, S., Wang, Z., Yang, X. and Zhang, J.J.

Conference: IEEE International Conference on Computer Vision Workshop (ICCVW), 2017

Pages: 777-785

ISBN: 9781538610343

Abstract:

With the increasing amount of videos recorded using 2D mobile cameras, the technique for recovering the 3D dynamic facial models from these monocular videos has become a necessity for many image and video editing applications. While methods based parametric 3D facial models can reconstruct the 3D shape in dynamic environment, large structural changes are ignored. Structure-from-motion methods can reconstruct these changes but assume the object to be static. To address this problem we present a novel method for realtime dynamic 3D facial tracking and reconstruction from videos captured in uncontrolled environments. Our method can track the deforming facial geometry and reconstruct external objects that protrude from the face such as glasses and hair. It also allows users to move around, perform facial expressions freely without degrading the reconstruction quality.

https://eprints.bournemouth.ac.uk/30711/

Source: BURO EPrints