Sparse Representation for Thermal to Visible Face Recognition under Temporal Variation

Abstract

Thermal face recognition has been well researched but still its performance is narrowed by varying illumination conditions. Illumination conditions are major source of the uncertainty in face recognition systems performance when it is used in outdoor setting. In order to augment the performance of visible light face recognition system's performance, infrared facial images as a new modality has been used in the literature. The other intriguing factor in using the infrared, especially thermal infrared imaging for facial recognition is the night time surveillance with little or no light to illuminate the faces. The problems produced by temporal variations of infrared face images when used in face recognition. Heterogeneous face recognition (HFR) has a prominent importance in sophisticated face recognition systems. Thermal to visible scenario, where the gallery and the probe images are respectively captured in visible and long wavelength infrared(LWIR) band, is one of the most challenging and interesting HFR scenarios. The temporal variations present in thermal face images are mainly due to different environment conditions. It is mostly immune to temporal variations, which is noticeable when the face images have been acquired with a time lapse, while the rest of the methods are clearly affected and are not suitable for practical infrared face recognition.