arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Pif Edwards

1 paper · 2016–2016

2016: 1
2016peak 1 in 20162016

Frequent co-authors

Papers

showing 1–1 of 1 RSS

JALI

Pif Edwards, Chris Landreth, Eugene Fiume +1 more

Computer Vision and Pattern Recognition · ACM Transactions on Graphics · · cited 174× · DOI ↗ · more like this ·

The rich signals we extract from facial expressions imposes high expectations for the science and art of facial animation. While the advent of high-resolution performance capture has greatly improved realism, the utility of procedural animation warrants a prominent place in facial animation workflow. We present a system that, given an input audio soundtrack and speech transcript, automatically generates expressive lip-synchronized facial animation that is amenable to further artistic refinement, and that is comparable with both performance capture and professional animator output. Because of the diversity of ways we produce sound, the mapping from phonemes to visual depictions as visemes is many-valued. We draw from psycholinguistics to capture this variation using two visually distinct anatomical actions: Ja w and L ip, wheresound is primarily controlled by jaw articulation and…