Real-time facial expression transfer with single video camera

Authors: Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J.

Journal: Computer Animation and Virtual Worlds

Volume: 27

Issue: 3-4

Pages: 301-310

eISSN: 1546-427X

ISSN: 1546-4261

DOI: 10.1002/cav.1697

Abstract:

Facial expression transfer has been actively researched in the past few years. Existing methods either suffer from depth ambiguity or require special hardware. We present a novel marker-less, real-time facial transfer method that requires only a single video camera. We develop a robust model, which is adaptive to user-specific facial data. It computes expression variances in real time and rapidly transfers them onto a target character either from images or videos. Our method can be applied to videos without prior camera calibration and focal adjustment. It enables realistic online facial expression editing and performance transferring in many scenarios such as video conference, news broadcasting, lip-syncing for song performances and so on. With low computational cost and hardware requirement, our method tracks a single user at an average of 38fps and runs smoothly even in web browsers. We present a novel marker-less, real time facial transfer method that requires only a single video camera. We develop a robust model, which is adaptive to user-specific facial data. It computes expression variances in real time and rapidly transfers them onto a target character either from images or videos.

https://eprints.bournemouth.ac.uk/23414/

Source: Scopus

Real-time facial expression transfer with single video camera

Authors: Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J.

Journal: COMPUTER ANIMATION AND VIRTUAL WORLDS

Volume: 27

Issue: 3-4

Pages: 301-310

eISSN: 1546-427X

ISSN: 1546-4261

DOI: 10.1002/cav.1697

https://eprints.bournemouth.ac.uk/23414/

Source: Web of Science (Lite)

Real Time Facial Expression Transfer with Single Video Camera

Authors: Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J.

Journal: Computer Animation and Virtual Worlds

Volume: 27

Pages: 301-310

Publisher: Wiley: 12 months

ISSN: 1546-427X

DOI: 10.1002/cav.1697

https://eprints.bournemouth.ac.uk/23414/

Source: Manual

Real-Time Facial Expression Transfer with Single Video Camera

Authors: Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J.J.

Journal: Computer Animation and Virtual Worlds

Volume: 27

Issue: 3-4

Pages: 301-310

ISSN: 1546-4261

Abstract:

Facial expression transfer is currently an active research field. However, 2D image wrapping based methods suffer from depth ambiguity and specific hardware is required for depth-based methods to work. We present a novel markerless, real time online facial transfer method that requires only a single video camera. Our method adapts a model to user specific facial data, computes expression variances in real time and rapidly transfers them to another target. Our method can be applied to videos without prior camera calibration and focal adjustment. It enables realistic online facial expression editing and performance transferring in many scenarios, such as: video conference; news broadcasting; lip-syncing for song performances; etc. With a low computational demand and hardware requirement, our method tracks a single user at an average of 38 fps. Our tracking method runs smoothly in web browsers despite their slower execution speed.

https://eprints.bournemouth.ac.uk/23414/

Source: BURO EPrints