Facial tracking and animation for digital social system
Authors: Huang, D., Yao, Y., Tang, W. and Ding, Y.
Journal: Proceedings - VRCAI 2018: 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
ISBN: 9781450360876
DOI: 10.1145/3284398.3284413
Abstract:Avatar expression appearing in the virtual social space is one of the key technologies to convey people's emotions and facilitate the social interactions effectively via the virtual social system. Aiming at lack of feasible solutions for synchronized facial expressions in current commercial virtual social systems, this paper presented a virtual social system with the focus on real-time avatar facial expressions. Firstly, cascaded pose regression was adopted to train a dynamic expression model to infer the expression coefficients from 2D video frames, and the facial landmarks in regression were extracted by supervised descent method instead of 2D cascaded pose regression to achieve better robustness and fault tolerance in facial tracking and animation. Secondly, we proposed a multi-scale adaptive expression coding technology for expression-voice data synchronization and striking balance between real-time and richness of facial expressions in varied complex network situations. The experimental results showthat the proposed facial tracking and animation system is practical and feasible, and could produce a high degree of realistic emotional cues in virtual social system.
Source: Scopus
Facial tracking and animation for digital social system
Authors: Huang, D., Yao, Y., Tang, W. and Ding, Y.
Conference: VRCAI 2018: 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Dates: 2-3 December 2018
Source: Manual