arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Vision and Pattern Recognition

Reference-based Video Colorization with AB Chrominance Point and Temporal Propagation

Yizhang Yang, Jianxiu Jin, Ying Huang, Kailing Guo, Xiangmin Xu

See on the map

Abstract

Deep learning has achieved remarkable success in video colorization problems. Reference-based video coloring problem is an important topic. In this paper, we propose a reference-based video colorization model that distinguishes itself from conventional colorization approaches. Unlike exemplar-based colorization methods that focus on leveraging color information from the reference frame, our model addresses the inherent limitation of the reference frame potentially lacking essential color details. To tackle this issue, we introduce the AB chrominance point to supplement the missing color information in the reference frame, yielding more precise colorization results. While traditional models often employ one-way or simple bidirectional optical flow, we use a bidirectional optical flow propagation network to make full use of the information from the warping images and increase the temporal consistency. Experimental results substantiate the efficacy of our approach, showcasing superior performance compared to state-of-the-art methods on benchmark datasets.

More like this