arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Vision and Pattern Recognition

An integrated framework for face modeling, facial motion analysis and synthesis

Pengyu Hong, Zhen Wen, Thomas S. Huang

See on the map

Abstract

This dissertation presents an integrated framework for face modeling, facial motion analysis, and facial motion synthesis. This framework systematically addresses three closely related research issues: (1) selecting a quantitative representation of facial deformation for face modeling and animation; (2) automatic facial motion analysis based on the same visual representation; and (3) speech-to-facial-coarticulation modeling. The framework provides a guideline for methodically building a face modeling and animation system. The systematicness of the framework is reflected by the links among its components, whose details are presented. Based on this framework, a face modeling and animation system, called the iFACE system, is developed. The system provides functionalities for customizing a generic face model for an individual, text-driven face animation, offline speech-driven face animation, and real-time speech-driven face animation.

More like this