arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Vision and Pattern Recognition

Face swapping: Automatically replacing faces in photographs

Dmitri Bitouk, Neeraj Kumar, Samreen Dhillon, Peter Belhumeur, Shree K. Nayar

See on the map

Abstract

(b) After automatic face replacement Figure 1: We have developed a system that automatically replaces faces in an input image with ones selected from a large collection of face images, obtained by applying face detection to publicly available photographs on the internet. In this example, the faces of (a) two people are shown after (b) automatic replacement with the top three ranked candidates. Our system for face replacement can be used for face de-identification, personalized face replacement, and creating an appealing group photograph from a set of “burst ” mode images. Original images in (a) used with permission from Retna Ltd. (top) and Getty Images Inc. (bottom). In this paper, we present a complete system for automatic face replacement in images. Our system uses a large library of face images created automatically by downloading images from the internet, extracting faces using face detection software, and aligning each extracted face to a common coordinate system. This library is constructed off-line, once, and can be efficiently accessed during face replacement. Our replacement algorithm has three main stages. First, given an input image, we detect all faces that are present,

More like this