arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Linjun Sun

34 papers · 2015–2025

2015: 12016: 02017: 22018: 02019: 42020: 102021: 82022: 22023: 42024: 22025: 1
2015peak 10 in 20202025

Frequent co-authors

Papers

showing 1–25 of 34 RSS

Adaptive Learning Gabor Filter for Finger-Vein Recognition

Yakun Zhang, Weijun Li, Liping Zhang +3 more

Signal Processing · IEEE Access · · cited 82× · DOI ↗ · more like this ·

Presently, finger-vein recognition is a new research direction in the field of biometric recognition. The Gabor filter has been extensively used for finger-vein recognition; however, its parameters are difficult to adjust. To solve this problem, an adaptive-learning Gabor filter is presented herein. We combine convolutional neural networks with a Gabor filter to calculate the gradient of the Gabor-filter parameters, based on the objective function, and to then optimize its parameters via back-propagation. The parameter θ of Gabor filter can be trained to the same angle as the vein texture of finger vein image. The parameter σ of Gabor filter has a certain relation with λ, and the parameter λ of Gabor filter can converge to the optimal value well. Using this method, we not only select appropriate and effective Gabor filter parameters to design the filter banks, we also consider the…

Finger vein recognition based on deep learning

Wenjie Liu, Weijun Li, Linjun Sun +2 more

Signal Processing · · cited 77× · DOI ↗ · more like this ·

As a new biometric technology, finger vein recognition has received much attention in recent years. Since deep learning is an end-to-end system, and has achieved very good results in such fields as face recognition and target detection, we try to apply it to finger vein recognition. In this paper, we adopt seven layers of CNN which include 5 convolution layers and 2 fully-connected layers. This network obtains a recognition rate of 99.53%, which proves to be better performing than traditional algorithm.

ARFace: Attention-Aware and Regularization for Face Recognition With Reinforcement Learning

Liping Zhang, Linjun Sun, Lina Yu +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Biometrics Behavior and Identity Science · · cited 66× · DOI ↗ · more like this ·

Different face regions have different contributions to recognition. Especially in the wild environment, the difference of contributions will be further amplified due to a lot of interference. Based on this, this paper proposes an attention-aware face recognition method based on a deep convolutional neural network and reinforcement learning. The proposed method composes of an Attention-Net and a Feature-net. The Attention-Net is used to select patches in the input face image according to the facial landmarks and trained with reinforcement learning to maximize the recognition accuracy. The Feature-net is used for extracting discriminative embedding features. In addition, a regularization method has also been introduced. The mask of the input layer is also applied to the intermediate feature maps, which is an approximation to train a series of models for different face patches and provide…

A Joint Bayesian Framework Based on Partial Least Squares Discriminant Analysis for Finger Vein Recognition

Liping Zhang, Linjun Sun, Weijun Li +4 more

Signal Processing · IEEE Sensors Journal · · cited 51× · DOI ↗ · more like this ·

Finger vein recognition has attracted considerable attention from the biometric identification technology community owing to its convenience and security. Unlike most previous works only pay attention to one part of finger vein recognition, we propose a joint Bayesian framework in this paper, which is based on partial least squares discriminant analysis (PLS-DA). It involves three major stages: 1) robust feature description, 2) discriminative feature mapping, and 3) separative verification. In stage 1), we extract line responses and orientation of finger veins using a bank of Gabor filter, and histograms are constructed in local patches as primitive features. Subsequently, in stage 2), a discriminant feature mapping based the PLS-DA (PLS-DA-FM) method is proposed to project these primitive features into low-dimensional forms in a supervised manner. Thus, highly compact and…

AGCNN: Adaptive Gabor Convolutional Neural Networks with Receptive Fields for Vein Biometric Recognition

Yakun Zhang, Weijun Li, Liping Zhang +3 more

Signal Processing · Concurrency and Computation Practice and Experience · · cited 49× · DOI ↗ · more like this ·

Summary In recent years, finger vein recognition has attracted more attention and research as a secure method of identification. Convolutional neural networks have achieved great success in the field of finger vein recognition, yet they suffer from high computational complexity, large parameters, and other challenges. To solve these problems, we propose a Gabor convolutional neural network with receptive fields. We use Gabor filters with receptive field properties to design Gabor convolutional layers. Then we replace the conventional convolutional layer with the Gabor convolutional layer; analyze the influence of different loss functions, convolution kernel size, and feature size on the network model; and choose the most suitable model parameters and loss function. Finally, we systematically investigate comparative performance using AGCNN and CNNs in different finger vein databases.…

Finger Vein Image Enhancement Based on Guided Tri-Gaussian Filters

Liping Zhang, Xinran Wang, Xiaoli Dong +3 more

Signal Processing · ASP Transactions on Pattern Recognition and Intelligent Systems · · cited 42× · DOI ↗ · more like this ·

In the process of image acquisition, the contrast between veins and non-veins in finger vein images is not high due to the influence of the fuzzy light source, skin scattering and finger movement. To solve this problem, a finger vein image enhancement method is proposed (GTGFs), which enhances finger vein patterns by setting guided image as input image firstly. On this basis, the tri-Gaussian model is based on disinhibitory properties of the concentric receptive field used to locally enhancing the image. The parameters of the tri-Gaussian model are determined based on the finger vein width information. The experiment results show that the proposed enhancement method can significantly enhance the finger vein patterns and improve the recognition effect of the methods based on vein pattern segmentation.

Gradient-Enhanced Softmax for Face Recognition

Linjun Sun, Weijun Li, Xin Ning +3 more

Computer Vision and Pattern Recognition · IEICE Transactions on Information and Systems · · cited 34× · DOI ↗ · more like this ·

This letter proposes a gradient-enhanced softmax supervisor for face recognition (FR) based on a deep convolutional neural network (DCNN). The proposed supervisor conducts the constant-normalized cosine to obtain the score for each class using a combination of the intra-class score and the soft maximum of the inter-class scores as the objective function. This mitigates the vanishing gradient problem in the conventional softmax classifier. The experiments on the public Labeled Faces in the Wild (LFW) database denote that the proposed supervisor achieves better results when compared with those achieved using the current state-of-the-art softmax-based approaches for FR.

Technology investigation on time series classification and prediction

Yuerong Tong, Jingyi Liu, Lina Yu +7 more

Signal Processing · PeerJ Computer Science · · cited 27× · DOI ↗ · more like this ·

Time series appear in many scientific fields and are an important type of data. The use of time series analysis techniques is an essential means of discovering the knowledge hidden in this type of data. In recent years, many scholars have achieved fruitful results in the study of time series. A statistical analysis of 120,000 literatures published between 2017 and 2021 reveals that the topical research about time series is mostly focused on their classification and prediction. Therefore, in this study, we focus on analyzing the technical development routes of time series classification and prediction algorithms. 87 literatures with high relevance and high citation are selected for analysis, aiming to provide a more comprehensive reference base for interested researchers. For time series classification, it is divided into supervised methods, semi-supervised methods, and early…

Blind image quality assessment based on the multiscale and dual‐domains features fusion

Yaxuan Lu, Weijun Li, Xin Ning +4 more

Computer Vision and Pattern Recognition · Concurrency and Computation Practice and Experience · · cited 26× · DOI ↗ · more like this ·

Abstract Image quality assessment is to simulate subjective human visual perception and realize image quality inference automatically. Although deep neural networks have achieved great success, the majority of them do not fully consider perception characteristics. Therefore, according to the human visual scale characteristics, we proposed an image quality assessment algorithm based on multiscale and dual domains fusion. Firstly, the original image and its phase congruency respectively input into two branches, feature pyramid and channel attention mechanism are adopted to extract multiscale features. After that, bilinear pool is used to aggregate the spatial and frequency domain characteristics of the corresponding scales, and allows arbitrary scale input to ensure that the features are extracted from the inherent quality images. Finally, the single quality score is obtained through…

LGCN: Learnable Gabor Convolution Network for Human Gender Recognition in the Wild

Peng Chen, Weijun Li, Linjun Sun +3 more

Computer Vision and Pattern Recognition · IEICE Transactions on Information and Systems · · cited 21× · DOI ↗ · more like this ·

Human gender recognition in the wild is a challenging task due to complex face variations, such as poses, lighting, occlusions, etc. In this letter, learnable Gabor convolutional network (LGCN), a new neural network computing framework for gender recognition was proposed. In LGCN, a learnable Gabor filter (LGF) is introduced and combined with the convolutional neural network (CNN). Specifically, the proposed framework is constructed by replacing some first layer convolutional kernels of a standard CNN with LGFs. Here, LGFs learn intrinsic parameters by using standard back propagation method, so that the values of those parameters are no longer fixed by experience as traditional methods, but can be modified by self-learning automatically. In addition, the performance of LGCN in gender recognition is further improved by applying a proposed feature combination strategy. The experimental…

Harnessing semantic segmentation masks for accurate facial attribute editing

Peng Chen, Qi Xiao, Jian Xu +6 more

Computer Vision and Pattern Recognition · Concurrency and Computation Practice and Experience · · cited 20× · DOI ↗ · more like this ·

Summary In recent years, with the rapid development of adversarial learning technology, facial attribute editing has made great success in a number of areas. Realistic visual effect, invariant identity information, and accurate editing area are the three key issues of facial attribute editing. Unfortunately, most researches focus on the former two problems. However, lack of awareness of the accurate editing area in the task is the main reason for damaging attribute‐irrelevant details. To address this issue, this article proposes a novel facial attribute editing algorithm—a generative adversarial network (GAN) with semantic masks—from the perspective of editing location accuracy. By generating the mask with respect to attribute‐related areas, the semantic segmentation network can only constrain the manipulation in the target region while not harming any attribute‐irrelevant details. The…

An efficient sparse pruning method for human pose estimation

Mingyang Wang, Tianyi Sun, Kang Song +3 more

Computer Vision and Pattern Recognition · Connection Science · · cited 18× · DOI ↗ · more like this ·

Human pose estimation (HPE) is crucial for computer vision (CV). Moreover, it’s a vital step for computers to understand human actions and behaviours. However, the huge number of parameters and calculations in the HPE model have brought big challenges to deploy to resource-constrained mobile devices. Aiming to overcome the challenge, we propose a sparse pruning method (SPM) for the HPE model. First, L1 regularisation is added in the training phase of the original model, and network parameters of the convolution layers (CLs) and batch normalisation layers (BNLs) are sparsely trained to obtain a network structure with sparse weights. We then combine the sparse weights of filters with the scaling parameters of the BNLs to determine their importance. Finally, the structured pruning method is used to prune the sparse filters and corresponding channels. SPM can reduce the number of model…

BDARS_CapsNet: Bi-Directional Attention Routing Sausage Capsule Network

Xin Ning, Weijuan Tian, Weijun Li +4 more

Computer Vision and Pattern Recognition · IEEE Access · · cited 18× · DOI ↗ · more like this ·

In order to improve the accuracy of capsule network in disentangled representation, and further expand its application in computer vision, a novel BDARS_CapsNet (bi-directional attention routing sausage capsule network) architecture is proposed in this paper. Firstly, the bi-directional routing, namely bottom-up and top-down attention is used to achieve information feed-forward and feedback mechanism, which contributes to describing the attributes of object entity more accurately and completely. Secondly, inspired by the concept of covering learning, the sausage measure model is introduced into the network. The sausage model measures both the similarities and differences of the capsules and projects them into a more complex curved surface, which makes it possible to approximate any nonlinear function with arbitrary precision and preserving the local responsiveness of capsule entity to…

Multi-distribution noise quantisation: an extreme compression scheme for transformer according to parameter distribution

Zaiyang Yu, Shuang Li, Linjun Sun +2 more

Computer Vision and Pattern Recognition · Connection Science · · cited 14× · DOI ↗ · more like this ·

With the development of deep learning, neural networks are widely used in various fields, and the improved model performance also introduces a considerable number of parameters and computations. Model quantisation is a technique that turns floating-point computing into low-specific-point computing, which can effectively reduce model computation strength, parameter size, and memory consumption but often bring a considerable loss of accuracy. This paper mainly addresses the problem where the distribution of parameters is too concentrated during quantisation aware training (QAT). In the QAT process, we use a piecewise function to statistics the parameter distributions and simulate the effect of quantisation noise in each round of training, based on the statistical results. Experimental results show that by quantising the Transformer network, we lose less precision and significantly reduce…

Head Pose Classification Based on Line Portrait

Shuang Li, Linjun Sun, Xin Ning +2 more

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

Head pose classification has great significance in the field of biometrics. But most of the head pose classification methods depend on facial landmark detection, which results in that the performance relies not only on the pose classification. To this end, this paper proposes a head pose classification method based on the algorithm of line portrait generation and convolutional neural network (CNN). Experiments on the Color FERET and BIWI database show that the proposed algorithm achieves better results than the algorithm of head pose classification depend on facial landmark detection and has strong robustness.

Discovering Mathematical Expressions Through DeepSymNet: A Classification-Based Symbolic Regression Framework

Min Wu, Weijun Li, Lina Yu +3 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 6× · DOI ↗ · more like this ·

Symbolic regression (SR) is the process of finding an unknown mathematical expression given the input and output and has important applications in interpretable machine learning and knowledge discovery. The major difficulty of SR is that finding the expression structure is an NP-hard problem, which makes the entire process time-consuming. In this study, the solution of expression structures was regarded as a classification problem and solved by supervised learning such that SR can be solved quickly by using the solving experience. Techniques for classification tasks, such as equivalent label merging and sample balance, were used to enhance the robustness of the algorithm. We proposed a symbolic network called DeepSymNet to represent symbolic expressions to improve the performance of the algorithm. DeepSymNet has been proven to have a strong representation ability with a shorter label…

Image Quality Assessment based on Dual Domains Fusion

Yaxuan Lu, Weijun Li, Xin Ning +3 more

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

Image quality assessment is an important and necessary task in the field of image processing. It can simulate human visual perception accurately and effectively to ensure the credibility of information. Although the existing IQA algorithm based on CNN has achieved excellent success, the generalization and robustness of the algorithm are limited due to the loss of image information during feature extraction. The research shows that the phase and amplitude of image frequency domain will change with the quality, so we proposes an image quality assessment algorithm based on dual domains fusion (DualD-IQA). Using the frequency domain and spatial domain as multiple inputs of convolutional neural network, we can complement each other to represent image quality related information. Moreover, the input of any scale can be accepted by adding bilinear pooling, so as to ensure the reliability and…

Multi‐angle head pose classification with masks based on color texture analysis and stack generalization

Shuang Li, Xiaoli Dong, Yuan Shi +3 more

Computer Vision and Pattern Recognition · Concurrency and Computation Practice and Experience · · cited 5× · DOI ↗ · more like this ·

Head pose classification is an important part of the preprocessing process of face recognition, which can independently solve application problems related to multi-angle. But, due to the impact of the COVID-19 coronavirus pandemic, more and more people wear masks to protect themselves, which covering most areas of the face. This greatly affects the performance of head pose classification. Therefore, this article proposes a method to classify the head pose with wearing a mask. This method focuses on the information that is helpful for head pose classification. First, the H-channel image of the HSV color space is extracted through the conversion of the color space. Then use the line portrait to extract the contour lines of the face, and train the convolutional neural networks to extract features in combination with the grayscale image. Finally, stacked generalization technology is used to…

Emotiongan: Facial Expression Synthesis Based on Pre-Trained Generator

Xin Ning, Shaohui Xu, Yixin Zong +3 more

Computer Vision and Pattern Recognition · Journal of Physics Conference Series · · cited 5× · DOI ↗ · more like this ·

Abstract Since the Generative Adversarial Networks (GANs) was proposed, researches on image generation attract many scholars’ general attention and good graces. Traditional GANs generate a sample by playing a minimax game between generator and discriminator. In this paper, we propose a new method called EmotionGAN for generating facial expression. Specifically, the inverse of the generator is firstly utilized to establish the mapping between the input and feature vector. Then the Generalized Linear Model (GLM) is used to fit the changing direction of different expressions in the feature space, which provide a linear guidance to the feature vector along the expression axis, and thus spatial distribution consistence with the target feature vector is assured. Finally the generator is applied to reconstruct the facial image of the expression. By controlling the intensity of the feature…

Facial Attribute Editing using Semantic Segmentation

Peng Chen, Qi Xiao, Jian Xu +2 more

Computer Vision and Pattern Recognition · · cited 5× · DOI ↗ · more like this ·

Recently, great success has been made in facial attribute editing by using adversarial learning. However, most existing studies focus on how to generate an image with high fidelity while ignore where to manipulate. Hence, in this paper, generative adversarial network with semantic masks (SM-GAN), a new framework for accurate facial attribute editing is proposed. Specifically, the proposed framework is constructed by combining GAN with semantic segmentation network. Here, the semantic segmentation network provides the mask with respect to attribute-related region so that the editing only occurs in expected areas. Qualitative and quantitative experiments on public dataset CelebA demonstrate that the proposed approach can not only generate realistic attribute editing results, but also preserve attribute-irrelevant areas unchanged.

GmFace: A Mathematical Model for Face Image Representation Using Multi-Gaussian

Liping Zhang, Weijun Li, Lina Yu +5 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

Establishing mathematical models is a ubiquitous and effective method to understand the objective world. Due to complex physiological structures and dynamic behaviors, mathematical representation of the human face is an especially challenging task. A mathematical model for face image representation called GmFace is proposed in the form of a multi-Gaussian function in this paper. The model utilizes the advantages of two-dimensional Gaussian function which provides a symmetric bell surface with a shape that can be controlled by parameters. The GmNet is then designed using Gaussian functions as neurons, with parameters that correspond to each of the parameters of GmFace in order to transform the problem of GmFace parameter solving into a network optimization problem of GmNet. The face modeling process can be described by the following steps: (1) GmNet initialization; (2) feeding GmNet with…

A Modeling Method for Face Image Deblurring

Hao Tian, Linjun Sun, Xiaoli Dong +4 more

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

This paper aims to learn a face representation that can accurately reconstruct a clear face from a blurred face image. To this end, we propose an explicit model (ID-Face) to represent the human face as a concise expression, which is the sum of a series of analytic function units. And we also design a network, which we named it ID-Net, to train the model. ID-Net consists of two sub-networks with encoder-decoder structure: the encoder of one of the sub-networks learns a set of implicit variables, and the corresponding decoder decodes the implicit variables into the representation’s parameters, which are used to reconstruct the main structure and texture features of the face image. The other sub-network is a general autoencoder to restore the facial details and high frequency parts of the blurred image. Experiments on two kinds of blurred face images show that our method can effectively…

Age Estimation Method Based on Generative Adversarial Networks

Xin Ning, Weijun Li, Linjun Sun

Computer Vision and Pattern Recognition · DEStech Transactions on Computer Science and Engineering · · cited 2× · DOI ↗ · more like this ·

Face age estimation has become a hot issue in the field of computer vision and man-machine interaction. To solve the unbalanced distribution of different types in age database, we adopted generative adversarial networks to study distribution of human face images to generate a great number of human face data of different ages. Then, we established age estimation model based on convolution neural network. Finally, in order to realize a better model performance, we adopted the training mode which was featured with knowledge transfer to improve performance of network models. The experimental results demonstrated that the proposed age estimation method has higher classification accuracy and a smaller age error.

Learning to represent 2D human face with mathematical model

Liping Zhang, Weijun Li, Linjun Sun +3 more

Computer Vision and Pattern Recognition · CAAI Transactions on Intelligence Technology · · cited 1× · DOI ↗ · more like this ·

Abstract How to represent a human face pattern? While it is presented in a continuous way in human visual system, computers often store and process it in a discrete manner with 2D arrays of pixels. The authors attempt to learn a continuous surface representation for face image with explicit function. First, an explicit model (EmFace) for human face representation is proposed in the form of a finite sum of mathematical terms, where each term is an analytic function element. Further, to estimate the unknown parameters of EmFace, a novel neural network, EmNet, is designed with an encoder‐decoder structure and trained from massive face images, where the encoder is defined by a deep convolutional neural network and the decoder is an explicit mathematical expression of EmFace. The authors demonstrate that our EmFace represents face image more accurate than the comparison method, with an…

Learning Continuous Face Representation with Explicit Functions

Liping Zhang, Weijun Li, Linjun Sun +5 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

How to represent a face pattern? While it is presented in a continuous way in our visual system, computers often store and process the face image in a discrete manner with 2D arrays of pixels. In this study, we attempt to learn a continuous representation for face images with explicit functions. First, we propose an explicit model (EmFace) for human face representation in the form of a finite sum of mathematical terms, where each term is an analytic function element. Further, to estimate the unknown parameters of EmFace, a novel neural network, EmNet, is designed with an encoder-decoder structure and trained using the backpropagation algorithm, where the encoder is defined by a deep convolutional neural network and the decoder is an explicit mathematical expression of EmFace. Experimental results show that EmFace has a higher representation performance on faces with various expressions…