arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Meiling Fang

37 papers · 2016–2024

2016: 12017: 02018: 02019: 12020: 42021: 122022: 82023: 102024: 1
2016peak 12 in 20212024

Frequent co-authors

Papers

showing 1–25 of 37 RSS

CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability

Fadi Boutros, Meiling Fang, Marcel Klemt +2 more

cs.CV · · cited 135× · arXiv ↗ · more like this ·

The quality of face images significantly influences the performance of underlying face recognition algorithms. Face image quality assessment (FIQA) estimates the utility of the captured image in achieving reliable and accurate recognition performance. In this work, we propose a novel learning paradigm that learns internal network observations during the training process. Based on that, our proposed CR-FIQA uses this paradigm to estimate the face image quality of a sample by predicting its relative classifiability. This classifiability is measured based on the allocation of the training sample feature representation in angular space with respect to its class center and the nearest negative class center. We experimentally illustrate the correlation between the face image quality and the sample relative classifiability. As such property is only observable for the training dataset, we…

MixFaceNets: Extremely Efficient Face Recognition Networks

Fadi Boutros, Naser Damer, Meiling Fang +2 more

cs.CV · · cited 77× · arXiv ↗ · more like this ·

In this paper, we present a set of extremely efficient and high throughput models for accurate face verification, MixFaceNets which are inspired by Mixed Depthwise Convolutional Kernels. Extensive experiment evaluations on Label Face in the Wild (LFW), Age-DB, MegaFace, and IARPA Janus Benchmarks IJB-B and IJB-C datasets have shown the effectiveness of our MixFaceNets for applications requiring extremely low computational complexity. Under the same level of computation complexity (< 500M FLOPs), our MixFaceNets outperform MobileFaceNets on all the evaluated datasets, achieving 99.60% accuracy on LFW, 97.05% accuracy on AgeDB-30, 93.60 TAR (at FAR1e-6) on MegaFace, 90.94 TAR (at FAR1e-4) on IJB-B and 93.08 TAR (at FAR1e-4) on IJB-C. With computational complexity between 500M and 1G FLOPs, our MixFaceNets achieved results comparable to the top-ranked models, while using significantly…

MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoders

Naser Damer, Meiling Fang, Patrick Siebke +3 more

cs.CV · · cited 67× · arXiv ↗ · more like this ·

Investigating new methods of creating face morphing attacks is essential to foresee novel attacks and help mitigate them. Creating morphing attacks is commonly either performed on the image-level or on the representation-level. The representation-level morphing has been performed so far based on generative adversarial networks (GAN) where the encoded images are interpolated in the latent space to produce a morphed image based on the interpolated vector. Such a process was constrained by the limited reconstruction fidelity of GAN architectures. Recent advances in the diffusion autoencoder models have overcome the GAN limitations, leading to high reconstruction fidelity. This theoretically makes them a perfect candidate to perform representation-level face morphing. This work investigates using diffusion autoencoders to create face morphing attacks by comparing them to a wide range of…

Unsupervised Face Recognition using Unlabeled Synthetic Data

Fadi Boutros, Marcel Klemt, Meiling Fang +2 more

cs.CV · · cited 42× · arXiv ↗ · more like this ·

Over the past years, the main research innovations in face recognition focused on training deep neural networks on large-scale identity-labeled datasets using variations of multi-class classification losses. However, many of these datasets are retreated by their creators due to increased privacy and ethical concerns. Very recently, privacy-friendly synthetic data has been proposed as an alternative to privacy-sensitive authentic data to comply with privacy regulations and to ensure the continuity of face recognition research. In this paper, we propose an unsupervised face recognition model based on unlabeled synthetic data (USynthFace). Our proposed USynthFace learns to maximize the similarity between two augmented images of the same synthetic instance. We enable this by a large set of geometric and color transformations in addition to GAN-based augmentation that contributes to the…

Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detection

Meiling Fang, Naser Damer, Florian Kirchbuchner +1 more

cs.CV · · cited 42× · arXiv ↗ · more like this ·

With the increased deployment of face recognition systems in our daily lives, face presentation attack detection (PAD) is attracting much attention and playing a key role in securing face recognition systems. Despite the great performance achieved by the hand-crafted and deep-learning-based methods in intra-dataset evaluations, the performance drops when dealing with unseen scenarios. In this work, we propose a dual-stream convolution neural networks (CNNs) framework. One stream adapts four learnable frequency filters to learn features in the frequency domain, which are less influenced by variations in sensors/illuminations. The other stream leverages the RGB images to complement the features of the frequency domain. Moreover, we propose a hierarchical attention module integration to join the information from the two streams at different stages by considering the nature of deep features…

SynthASpoof: Developing Face Presentation Attack Detection Based on Privacy-friendly Synthetic Data

Meiling Fang, Marco Huber, Naser Damer

cs.CV · · cited 38× · arXiv ↗ · more like this ·

Recently, significant progress has been made in face presentation attack detection (PAD), which aims to secure face recognition systems against presentation attacks, owing to the availability of several face PAD datasets. However, all available datasets are based on privacy and legally-sensitive authentic biometric data with a limited number of subjects. To target these legal and technical challenges, this work presents the first synthetic-based face PAD dataset, named SynthASpoof, as a large-scale PAD development dataset. The bona fide samples in SynthASpoof are synthetically generated and the attack samples are collected by presenting such synthetic data to capture systems in a real attack scenario. The experimental results demonstrate the feasibility of using SynthASpoof for the development of face PAD. Moreover, we boost the performance of such a solution by incorporating the domain…

Demographic Bias in Presentation Attack Detection of Iris Recognition Systems

Meiling Fang, Naser Damer, Florian Kirchbuchner +1 more

cs.CV · · cited 38× · arXiv ↗ · more like this ·

With the widespread use of biometric systems, the demographic bias problem raises more attention. Although many studies addressed bias issues in biometric verification, there are no works that analyze the bias in presentation attack detection (PAD) decisions. Hence, we investigate and analyze the demographic bias in iris PAD algorithms in this paper. To enable a clear discussion, we adapt the notions of differential performance and differential outcome to the PAD problem. We study the bias in iris PAD using three baselines (hand-crafted, transfer-learning, and training from scratch) using the NDCLD-2013 database. The experimental results point out that female users will be significantly less protected by the PAD, in comparison to males.

Iris Presentation Attack Detection by Attention-based and Deep Pixel-wise Binary Supervision Network

Meiling Fang, Naser Damer, Fadi Boutros +2 more

cs.CV · · cited 35× · arXiv ↗ · more like this ·

Iris presentation attack detection (PAD) plays a vital role in iris recognition systems. Most existing CNN-based iris PAD solutions 1) perform only binary label supervision during the training of CNNs, serving global information learning but weakening the capture of local discriminative features, 2) prefer the stacked deeper convolutions or expert-designed networks, raising the risk of overfitting, 3) fuse multiple PAD systems or various types of features, increasing difficulty for deployment on mobile devices. Hence, we propose a novel attention-based deep pixel-wise binary supervision (A-PBS) method. Pixel-wise supervision is first able to capture the fine-grained pixel/patch-level cues. Then, the attention mechanism guides the network to automatically find regions that most contribute to an accurate PAD decision. Extensive experiments are performed on LivDet-Iris 2017 and three other…

ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generation

Fadi Boutros, Marcel Klemt, Meiling Fang +2 more

cs.CV · · cited 34× · arXiv ↗ · more like this ·

Deep generative models have recently presented impressive results in generating realistic face images of random synthetic identities. To generate multiple samples of a certain synthetic identity, previous works proposed to disentangle the latent space of GANs by incorporating additional supervision or regularization, enabling the manipulation of certain attributes. Others proposed to disentangle specific factors in unconditional pretrained GANs latent spaces to control their output, which also requires supervision by attribute classifiers. Moreover, these attributes are entangled in GAN's latent space, making it difficult to manipulate them without affecting the identity information. We propose in this work a framework, ExFaceGAN, to disentangle identity information in pretrained GANs latent spaces, enabling the generation of multiple samples of any synthetic identity. Given a reference…

Unsupervised Face Morphing Attack Detection via Self-paced Anomaly Detection

Meiling Fang, Fadi Boutros, Naser Damer

cs.CV · · cited 26× · arXiv ↗ · more like this ·

The supervised-learning-based morphing attack detection (MAD) solutions achieve outstanding success in dealing with attacks from known morphing techniques and known data sources. However, given variations in the morphing attacks, the performance of supervised MAD solutions drops significantly due to the insufficient diversity and quantity of the existing MAD datasets. To address this concern, we propose a completely unsupervised MAD solution via self-paced anomaly detection (SPL-MAD) by leveraging the existing large-scale face recognition (FR) datasets and the unsupervised nature of convolutional autoencoders. Using general FR datasets that might contain unintentionally and unlabeled manipulated samples to train an autoencoder can lead to a diverse reconstruction behavior of attack and bona fide samples. We analyze this behavior empirically to provide a solid theoretical ground for…

Face Liveness Detection Competition (LivDet-Face) - 2021

Sandip Purnapatra, Nic Smalt, Keivan Bahmani +9 more

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 26× · DOI ↗ · more like this ·

Liveness Detection (LivDet)-Face is an international competition series open to academia and industry. The competition’s objective is to assess and report state-of-the-art in liveness / Presentation Attack Detection (PAD) for face recognition. Impersonation and presentation of false samples to the sensors can be classified as presentation attacks and the ability for the sensors to detect such attempts is known as PAD. LivDet-Face 2021 * will be the first edition of the face liveness competition. This competition serves as an important benchmark in face presentation attack detection, offering (a) an independent assessment of the current state of the art in face PAD, and (b) a common evaluation protocol, availability of Presentation Attack Instruments (PAI) and live face image dataset through the Biometric Evaluation and Testing (BEAT) platform. The competition can be easily followed by…

Deep Learning Multi-layer Fusion for an Accurate Iris Presentation Attack Detection

Meiling Fang, Naser Damer, Fadi Boutros +2 more

Signal Processing · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · · cited 26× · DOI ↗ · more like this ·

Iris presentation attack detection (PAD) algorithms are developed to address the vulnerability of iris recognition systems to presentation attacks. Taking into account that the deep features successfully improved computer vision performance in various fields including iris recognition, it is natural to use features extracted from deep neural networks for iris PAD. Each layer in a deep learning network carries features of different level of abstraction. The features extracted from the first layer to the higher layers become more complex and more abstract. This might point our complementary information in these features that can collaborate towards an accurate PAD decision. Therefore, we propose an iris PAD solution based on multi-layer fusion. The information extracted from the last several convolutional layers are fused on two levels, feature-level and score-level. We demonstrated…

Iris Liveness Detection Competition (LivDet-Iris) -- The 2023 Edition

Patrick Tinsley, Sandip Purnapatra, Mahsa Mitcheff +18 more

cs.CV · · cited 19× · arXiv ↗ · more like this ·

This paper describes the results of the 2023 edition of the ''LivDet'' series of iris presentation attack detection (PAD) competitions. New elements in this fifth competition include (1) GAN-generated iris images as a category of presentation attack instruments (PAI), and (2) an evaluation of human accuracy at detecting PAI as a reference benchmark. Clarkson University and the University of Notre Dame contributed image datasets for the competition, composed of samples representing seven different PAI categories, as well as baseline PAD algorithms. Fraunhofer IGD, Beijing University of Civil Engineering and Architecture, and Hochschule Darmstadt contributed results for a total of eight PAD algorithms to the competition. Accuracy results are analyzed by different PAI types, and compared to human accuracy. Overall, the Fraunhofer IGD algorithm, using an attention-based pixel-wise binary…

Partial Attack Supervision and Regional Weighted Inference for Masked Face Presentation Attack Detection

Meiling Fang, Fadi Boutros, Arjan Kuijper +1 more

cs.CV · · cited 19× · arXiv ↗ · more like this ·

Wearing a mask has proven to be one of the most effective ways to prevent the transmission of SARS-CoV-2 coronavirus. However, wearing a mask poses challenges for different face recognition tasks and raises concerns about the performance of masked face presentation detection (PAD). The main issues facing the mask face PAD are the wrongly classified bona fide masked faces and the wrongly classified partial attacks (covered by real masks). This work addresses these issues by proposing a method that considers partial attack labels to supervise the PAD model training, as well as regional weighted inference to further improve the PAD performance by varying the focus on different facial areas. Our proposed method is not directly linked to specific network architecture and thus can be directly incorporated into any common or custom-designed network. In our work, two neural networks (DeepPixBis…

Masked face recognition: Human versus machine

Naser Damer, Fadi Boutros, Marius Süßmilch +3 more

Computer Vision and Pattern Recognition · IET Biometrics · · cited 18× · DOI ↗ · more like this ·

Abstract The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. However, the pandemic led to the wide use of face masks, essential to keep the pandemic under control. The effect of wearing a mask on face recognition (FR) in a collaborative environment is a currently sensitive yet understudied issue. Recent reports have tackled this by evaluating the masked probe effect on the performance of automatic FR solutions. However, such solutions can fail in certain processes, leading to the verification task being performed by a human expert. This work provides a joint evaluation and in‐depth analyses of the face verification performance of human experts in comparison to state‐of‐the‐art automatic FR solutions. This involves an extensive evaluation by human experts and 4 automatic recognition solutions. The study concludes with a set of…

SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data

Meiling Fang, Marco Huber, Julian Fierrez +21 more

cs.CV · · cited 14× · arXiv ↗ · more like this ·

This paper presents a summary of the Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data (SynFacePAD 2023) held at the 2023 International Joint Conference on Biometrics (IJCB 2023). The competition attracted a total of 8 participating teams with valid submissions from academia and industry. The competition aimed to motivate and attract solutions that target detecting face presentation attacks while considering synthetic-based training data motivated by privacy, legal and ethical concerns associated with personal data. To achieve that, the training data used by the participants was limited to synthetic data provided by the organizers. The submitted solutions presented innovations and novel approaches that led to outperforming the considered baseline in the investigated benchmarks.

Liveness Detection Competition -- Noncontact-based Fingerprint Algorithms and Systems (LivDet-2023 Noncontact Fingerprint)

Sandip Purnapatra, Humaira Rezaie, Bhavin Jawade +19 more

cs.CV · · cited 14× · arXiv ↗ · more like this ·

Liveness Detection (LivDet) is an international competition series open to academia and industry with the objec-tive to assess and report state-of-the-art in Presentation Attack Detection (PAD). LivDet-2023 Noncontact Fingerprint is the first edition of the noncontact fingerprint-based PAD competition for algorithms and systems. The competition serves as an important benchmark in noncontact-based fingerprint PAD, offering (a) independent assessment of the state-of-the-art in noncontact-based fingerprint PAD for algorithms and systems, and (b) common evaluation protocol, which includes finger photos of a variety of Presentation Attack Instruments (PAIs) and live fingers to the biometric research community (c) provides standard algorithm and system evaluation protocols, along with the comparative analysis of state-of-the-art algorithms from academia and industry with both old and new…

The overlapping effect and fusion protocols of data augmentation techniques in iris PAD

Meiling Fang, Naser Damer, Fadi Boutros +2 more

Signal Processing · Machine Vision and Applications · · cited 13× · DOI ↗ · more like this ·

Abstract Iris Presentation Attack Detection (PAD) algorithms address the vulnerability of iris recognition systems to presentation attacks. With the great success of deep learning methods in various computer vision fields, neural network-based iris PAD algorithms emerged. However, most PAD networks suffer from overfitting due to insufficient iris data variability. Therefore, we explore the impact of various data augmentation techniques on performance and the generalizability of iris PAD. We apply several data augmentation methods to generate variability, such as shift, rotation, and brightness. We provide in-depth analyses of the overlapping effect of these methods on performance. In addition to these widely used augmentation techniques, we also propose an augmentation selection protocol based on the assumption that various augmentation techniques contribute differently to the PAD…

Mobile Contactless Fingerprint Presentation Attack Detection: Generalizability and Explainability

Jannis Priesnitz, Roberto Casula, Jascha Kolberg +6 more

Signal Processing · IEEE Transactions on Biometrics Behavior and Identity Science · · cited 11× · DOI ↗ · more like this ·

Contactless fingerprint recognition is an emerging biometric technology that has several advantages over contact-based schemes, such as improved user acceptance and fewer hygienic concerns. Like for most other biometrics, Presentation Attack Detection (PAD) is crucial to preserving the trustworthiness of contactless fingerprint recognition methods. For many contactless biometric characteristics, Convolutional Neural Networks (CNNs) represent the state-of-the-art of PAD algorithms. For CNNs, the ability to accurately classify samples that are not included in the training is of particular interest, since these generalization capabilities indicate robustness in real-world scenarios. In this work, we focus on the generalizability and explainability aspects of CNN-based contactless fingerprint PAD methods. Based on previously obtained findings, we selected four CNN-based methods for…

Low-resolution Iris Recognition via Knowledge Transfer

Fadi Boutros, Olga Kaehm, Meiling Fang +3 more

Signal Processing · Fraunhofer-Publica (Fraunhofer-Gesellschaft) · · cited 10× · DOI ↗ · more like this ·

This work introduces a novel approach for extremely low-resolution iris recognition based on deep knowledge transfer. This work starts by adapting the penalty margin loss to the iris recognition problem. This included novel analyses on the appropriate penalty margin for iris recognition. Additionally, this work presents analyses toward finding the optimal deeply learned representation dimension for the identity information embedded in the iris capture. Most importantly, this work proposes a training framework that aims at producing iris deep representations from extremely low-resolution that are similar to those of high resolution. This was realized by the controllable knowledge transfer of an iris recognition model trained for high-resolution images into a model that is specifically trained for extremely low-resolution irises. The presented approach leads to the reduction of the…

Uncovering the essential links in online commercial networks

Wei Zeng, Meiling Fang, Junming Shao +1 more

Information Systems · Scientific Reports · · cited 10× · DOI ↗ · more like this ·

Recommender systems are designed to effectively support individuals' decision-making process on various web sites. It can be naturally represented by a user-object bipartite network, where a link indicates that a user has collected an object. Recently, research on the information backbone has attracted researchers' interests, which is a sub-network with fewer nodes and links but carrying most of the relevant information. With the backbone, a system can generate satisfactory recommenda- tions while saving much computing resource. In this paper, we propose an enhanced topology-aware method to extract the information backbone in the bipartite network mainly based on the information of neighboring users and objects. Our backbone extraction method enables the recommender systems achieve more than 90% of the accuracy of the top-L recommendation, however, consuming only 20% links. The…

Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statistics

Meiling Fang, Naser Damer

cs.CV · · cited 9× · arXiv ↗ · more like this ·

Recent face presentation attack detection (PAD) leverages domain adaptation (DA) and domain generalization (DG) techniques to address performance degradation on unknown domains. However, DA-based PAD methods require access to unlabeled target data, while most DG-based PAD solutions rely on a priori, i.e., known domain labels. Moreover, most DA-/DG-based methods are computationally intensive, demanding complex model architectures and/or multi-stage training processes. This paper proposes to model face PAD as a compound DG task from a causal perspective, linking it to model optimization. We excavate the causal factors hidden in the high-level representation via counterfactual intervention. Moreover, we introduce a class-guided MixStyle to enrich feature-level data distribution within classes instead of focusing on domain information. Both class-guided MixStyle and counterfactual…

Merge-SfM: Merging Partial Reconstructions.

Meiling Fang, Thomas Pollok, Chengchao Qu

Computational Theory and Mathematics · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · · cited 9× · OpenAlex ↗ · more like this ·

Recovering a 3D scene from unordered photo collections is a long-studied topic in computer vision. Existing reconstruction pipelines, both incremental and global, have already achieved remarkable results. This paper addresses the problem of fusing multiple existing partial 3D reconstructions, in particular finding the overlapping regions and transformations (7 DOF) between partial reconstructions. Unlike the previous methods which have to take the entire epipolar geometry (EG) graph as the input and reconstruct the scene, we propose an approach that reuses the existing reconstructed 3D models as input and merges them by utilizing all the internal information to avoid repeated work. This approach is divided into two steps. The first is to find overlapping areas between partial reconstructions based on Fisher similarity lists. Then, based on those overlaps, pairwise rotation between…

Depth-guided Robust Face Morphing Attack Detection

Harsh Rachalwar, Meiling Fang, Naser Damer +1 more

Computer Vision and Pattern Recognition · Fraunhofer-Publica (Fraunhofer-Gesellschaft) · · cited 7× · DOI ↗ · more like this ·

Recently, morphing attack detection (MAD) solutions have achieved remarkable success with the aid of deep learning techniques. Despite the good performance achieved by binary label or binary pixel-wise supervised MAD models, the robustness of such models drops when facing variations in morphing attacks. In this work, we propose a novel process that leverages facial depth information to build a robust and generalized MAD. The depth map, representing the 3D shape of the face in a 2D image, is more informative compared to binary and binary pixel-wise map labels. To validate the idea we synthetically generated 3D depth map ground truth. Furthermore, we introduce a novel MAD architecture designed to capture subtle information from the 3D depth data. In addition, we analyze the training loss formulation to further enhance the MAD performance. Driven by the need for developing MAD solutions…

Are Explainability Tools Gender Biased? A Case Study on Face Presentation Attack Detection

Marco Huber, Meiling Fang, Fadi Boutros +1 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Face recognition (FR) systems continue to spread in our daily lives with an increasing demand for higher explainability and interpretability of FR systems that are mainly based on deep learning. While bias across demographic groups in FR systems has already been studied, the bias of explainability tools has not yet been investigated. As such tools aim at steering further development and enabling a better understanding of computer vision problems, the possible existence of bias in their outcome can lead to a chain of biased decisions. In this paper, we explore the existence of bias in the outcome of explainability tools by investigating the use case of face presentation attack detection. By utilizing two different explainability tools on models with different levels of bias, we investigate the bias in the outcome of such tools. Our study shows that these tools show clear signs of gender…