Author

Yueming Wang

93 papers · 2005–2026

2005peak 12 in 20262026

Frequent co-authors

Papers

showing 1–25 of 93 RSS

Robust 3D Face Recognition by Local Shape Difference Boosting

Yueming Wang, Jianzhuang Liu, Xiaoou Tang

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · 12 Jan 2010 · cited 179× · DOI ↗ · more like this ·

This paper proposes a new 3D face recognition approach, Collective Shape Difference Classifier (CSDC), to meet practical application requirements, i.e., high recognition performance, high computational efficiency, and easy implementation. We first present a fast posture alignment method which is self-dependent and avoids the registration between an input face against every face in the gallery. Then, a Signed Shape Difference Map (SSDM) is computed between two aligned 3D faces as a mediate representation for the shape comparison. Based on the SSDMs, three kinds of features are used to encode both the local similarity and the change characteristics between facial shapes. The most discriminative local features are selected optimally by boosting and trained as weak classifiers for assembling three collective strong classifiers, namely, CSDCs with respect to the three kinds of features.…

Automatic facial expression recognition on a single 3D face by exploring shape deformation

Boqing Gong, Yueming Wang, Jianzhuang Liu +1 more

Computer Vision and Pattern Recognition · 19 Oct 2009 · cited 119× · DOI ↗ · more like this ·

Facial expression recognition has many applications in multimedia processing and the development of 3D data acquisition techniques makes it possible to identify expressions using 3D shape information. In this paper, we propose an automatic facial expression recognition approach based on a single 3D face. The shape of an expressional 3D face is approximated as the sum of two parts, a basic facial shape component (BFSC) and an expressional shape component (ESC). The BFSC represents the basic face structure and neutral-style shape and the ESC contains shape changes caused by facial expressions. To separate the BFSC and ESC, our method firstly builds a reference face for each input 3D non-neutral face by a learning method, which well represents the basic facial shape. Then, based on the BFSC and the original expressional face, a facial expression descriptor is designed. The surface depth…

Robust feature learning by stacked autoencoder with maximum correntropy criterion

Yu Qi, Yueming Wang, Xiaoxiang Zheng +1 more

Signal Processing · May 2014 · cited 88× · DOI ↗ · more like this ·

Unsupervised feature learning with deep networks has been widely studied in the recent years. Despite the progress, most existing models would be fragile to non-Gaussian noises and outliers due to the criterion of mean square error (MSE). In this paper, we propose a robust stacked autoencoder (R-SAE) based on maximum correntropy criterion (MCC) to deal with the data containing non-Gaussian noises and outliers. By replacing MSE with MCC, the anti-noise ability of stacked autoencoder is improved. The proposed method is evaluated using the MNIST benchmark dataset. Experimental results show that, compared with the ordinary stacked autoencoder, the R-SAE improves classification accuracy by 14% and reduces the reconstruction error by 39%, which demonstrates that R-SAE is capable of learning robust features on noisy data.

3D Face Recognition using Mapped Depth Images

Gang Pan, Han Shi, Zhaohui Wu +1 more

Computer Vision and Pattern Recognition · 2005 · cited 83× · DOI ↗ · more like this ·

This paper addresses 3D face recognition from facial shape. Firstly, we present an effective method to automatically extract ROI of facial surface, which mainly depends on automatic detection of facial bilateral symmetry plane and localization of nose tip. Then we build a reference plane through the nose tip for calculating the relative depth values. Considering the non-rigid property of facial surface, the ROI is triangulated and parameterized into an isomorphic 2D planar circle, attempting to preserve the intrinsic geometric properties. At the same time the relative depth values are also mapped. Finally we perform eigenface on the mapped relative depth image. The entire scheme is insensitive to pose variance. The experiment using FRGC database v1.0 obtains the rank-1 identification score of 95%, which outperforms the result of the PCA base-line method by 4%, which demonstrates the…

Image Segmentation by MAP-ML Estimations

Shifeng Chen, Liangliang Cao, Yueming Wang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 5 Apr 2010 · cited 68× · DOI ↗ · more like this ·

Image segmentation plays an important role in computer vision and image analysis. In this paper, image segmentation is formulated as a labeling problem under a probability maximization framework. To estimate the label configuration, an iterative optimization scheme is proposed to alternately carry out the maximum a posteriori (MAP) estimation and the maximum likelihood (ML) estimation. The MAP estimation problem is modeled with Markov random fields (MRFs) and a graph cut algorithm is used to find the solution to the MAP estimation. The ML estimation is achieved by computing the means of region features in a Gaussian model. Our algorithm can automatically segment an image into regions with relevant textures or colors without the need to know the number of regions in advance. Its results match image edges very well and are consistent with human perception. Comparing to six…

Deep Attention Network for Egocentric Action Recognition

Minlong Lu, Ze-Nian Li, Yueming Wang +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 26 Feb 2019 · cited 62× · DOI ↗ · more like this ·

Recognizing a camera wearer's actions from videos captured by an egocentric camera is a challenging task. In this paper, we employ a two-stream deep neural network composed of an appearance-based stream and a motion-based stream to recognize egocentric actions. Based on the insight that human action and gaze behavior are highly coordinated in object manipulation tasks, we propose a spatial attention network to predict human gaze in the form of attention map. The attention map helps each of the two streams to focus on the most relevant spatial region of the video frames to predict actions. To better model the temporal structure of the videos, a temporal network is proposed. The temporal network incorporates bi-directional long short-term memory to model the long-range dependencies to recognize egocentric actions. The experimental results demonstrate that our method is able to predict…

3d face recognition using local shape map

Zhaohui Wu, Yueming Wang, Gang Pan

Computer Vision and Pattern Recognition · 19 Apr 2005 · cited 39× · DOI ↗ · more like this ·

This paper firstly proposes a new scheme for description of 3D local shape, termed local shape map (LSM). The LSM for a point on the surface is a 2D histogram constructed from mapping 3D coordinates of surface's points within a sphere centralized at this point into a 2D space. The similarity metric for LSM is given. Secondly, application of LSM to 3D face recognition is presented, which is performed by incorporating LSM into an ad-hoc voting method. It does not require registering two face models. With a dataset of 31 facial range images for six subjects, in presence of significant change in pose and slight variation in expression, the equal error rate of 2.98% is obtained. The experimental results also demonstrate the performance of 3D face recognition using LSM outperforms that using spin image.

3D Face Recognition in the Presence of Expression: A Guidance-based Constraint Deformation Approach

Yueming Wang, Gang Pan, Zhaohui Wu

Computer Vision and Pattern Recognition · June 2007 · cited 34× · DOI ↗ · more like this ·

Three-dimensional human face recognition in the presence of expression is a big challenge, since the shape distortion caused by facial expression greatly weakens the rigid matching. This paper proposes a guidance-based constraint deformation(GCD) model to cope with the shape distortion by expression. The basic idea is that, the face model with non-neutral expression is deformed toward its neutral one under certain constraint so that the distortion is reduced while inter-class discriminative information is preserved. The GCD model exploits the neutral 3D face shape to guide the deformation, meanwhile applies a rigid constraint on it. Both steps are smoothly unified in the Poisson equation framework. The GCD approach only needs one neutral model for each person in the gallery. The experimental results, carried out on the large 3D face databases-FRGC v2.0, demonstrate that our method…

Establishing Point Correspondence of 3D Faces Via Sparse Facial Deformable Model

Gang Pan, Xiaobo Zhang, Yueming Wang +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 26 Jun 2013 · cited 27× · DOI ↗ · more like this ·

Establishing a dense vertex-to-vertex anthropometric correspondence between 3D faces is an important and fundamental problem in 3D face research, which can contribute to most applications of 3D faces. This paper proposes a sparse facial deformable model to automatically achieve this task. For an input 3D face, the basic idea is to generate a new 3D face that has the same mesh topology as a reference face and the highly similar shape to the input face, and whose vertices correspond to those of the reference face in an anthropometric sense. Two constraints: 1) the shape constraint and 2) correspondence constraint are modeled in our method to satisfy the three requirements. The shape constraint is solved by a novel face deformation approach in which a normal-ray scheme is integrated to the closest-vertex scheme to keep high-curvature shapes in deformation. The correspondence constraint is…

Revisiting Neural Retrieval on Accelerators

Jiaqi Zhai, Zhaojie Gong, Yueming Wang +4 more

cs.LG · 6 Jun 2023 · cited 26× · arXiv ↗ · more like this ·

Retrieval finds a small number of relevant candidates from a large corpus for information retrieval and recommendation applications. A key component of retrieval is to model (user, item) similarity, which is commonly represented as the dot product of two learned embeddings. This formulation permits efficient inference, commonly known as Maximum Inner Product Search (MIPS). Despite its popularity, dot products cannot capture complex user-item interactions, which are multifaceted and likely high rank. We hence examine non-dot-product retrieval settings on accelerators, and propose \textit{mixture of logits} (MoL), which models (user, item) similarity as an adaptive composition of elementary similarity functions. This new formulation is expressive, capable of modeling high rank (user, item) interactions, and further generalizes to the long tail. When combined with a hierarchical retrieval…

New generation VNIR/SWIR/TIR airborne imaging spectrometer

Yueming Wang, Liqin Wei, Liyin Yuan +6 more

Artificial Intelligence · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 25 Oct 2016 · cited 23× · DOI ↗ · more like this ·

Imaging spectrometer plays an important role in the remote sensing application. Imaging spectrometer can collects and provides a unique spectral signature of many materials. The spectral signature may be absorbing, reflecting, and emitting. Generally, optical spectral bands for earth observing consist of VNIR, SWIR, TIR/LWIR. VNIR band imaging spectrometer is well-known in vegetation remote sensing and ocean detection. SWIR band imaging spectrometer is widely applied in mineralogy investigation. For its uniquely capability of spectral radiance measurement, TIR/LWIR imaging spectrometer attracts much attention these years. This paper will present a new generation VNIR/SWIR/TIR imaging spectrometer. The preliminary result of its first flight will also be shared. The spectral sampling intervals of VNIR/SWIR/TIR are 2.4nm/3nm/30nm, respectively. The spatial pixel numbers are…

Generating fluent tubes in video synopsis

Minlong Lu, Yueming Wang, Gang Pan

Computer Vision and Pattern Recognition · May 2013 · cited 21× · DOI ↗ · more like this ·

Video synopsis is one of the effective techniques to build a short video representation preserving the essential activities for a long video. Existing methods usually have the problem that a continuous activity (tube) from a single moving object is separated to a few small pieces. In this paper, two schemes are proposed to generate fluent tubes for video synopsis. The Gaussian mixture model and a texture method are combined to detect more compact foreground with shadow removed. The foreground constitutes a set of initial trajectories. A particle filter tracker is used to concatenate two trajectories if they belong to the same foreground activity, which generates more fluent tubes for video synopsis. Experimental results on 4 videos show that our method produces better accuracies and visual effects in video synopsis.

Wide Swath and High Resolution Airborne HyperSpectral Imaging System and Flight Validation

Dong Zhang, Liyin Yuan, Shengwei Wang +6 more

Artificial Intelligence · Sensors · 8 Apr 2019 · cited 20× · DOI ↗ · more like this ·

Wide Swath and High Resolution Airborne Pushbroom Hyperspectral Imager (WiSHiRaPHI) is the new-generation airborne hyperspectral imager instrument of China, aimed at acquiring accurate spectral curve of target on the ground with both high spatial resolution and high spectral resolution. The spectral sampling interval of WiSHiRaPHI is 2.4 nm and the spectral resolution is 3.5 nm (FWHM), integrating 256 channels coving from 400 nm to 1000 nm. The instrument has a 40-degree field of view (FOV), 0.125 mrad instantaneous field of view (IFOV) and can work in high spectral resolution mode, high spatial resolution mode and high sensitivity mode for different applications, which can adapt to the Velocity to Height Ratio (VHR) lower than 0.04. The integration has been finished, and several airborne flight validation experiments have been conducted. The results showed the system's excellent…

An Overview of Panoramic Video Projection Schemes in the IEEE 1857.9 Standard for Immersive Visual Content Coding

Yangang Cai, Xufeng Li, Yueming Wang +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · 8 Apr 2022 · cited 19× · DOI ↗ · more like this ·

Panoramic video contains 360-degree video content and it is convenient to draw the content that the user wants to watch on the head-Mount display (HMD) of the virtual reality display device. However, few encoders code panoramic video directly. Panoramic video content needs to be projected to a compression-friendly rectangular plane first. Then the existing video coding standards such as AVC, HEVC, VVC, AVS are used to code the panoramic video content. In order to improve the panoramic video coding efficiency, IEEE 1857.9 immersive video content coding working group was established to develop efficient immersive video projection and coding methods. This paper presents an overview of the panoramic video projection schemes in Immersive Visual Content Coding Standard IEEE 1857.9.

Computational Simulation of HIV Protease Inhibitors to the Main Protease (Mpro) of SARS-CoV-2: Implications for COVID-19 Drugs Design

Wei Yu, Xiaomin Wu, Yizhen Zhao +9 more

Computational Theory and Mathematics · Molecules · 5 Dec 2021 · cited 19× · DOI ↗ · more like this ·

SARS-CoV-2 is highly homologous to SARS-CoV. To date, the main protease (Mpro) of SARS-CoV-2 is regarded as an important drug target for the treatment of Coronavirus Disease 2019 (COVID-19). Some experiments confirmed that several HIV protease inhibitors present the inhibitory effects on the replication of SARS-CoV-2 by inhibiting Mpro. However, the mechanism of action has still not been studied very clearly. In this work, the interaction mechanism of four HIV protease inhibitors Darunavir (DRV), Lopinavir (LPV), Nelfinavir (NFV), and Ritonavire (RTV) targeting SARS-CoV-2 Mpro was explored by applying docking, molecular dynamics (MD) simulations, and MM-GBSA methods using the broad-spectrum antiviral drug Ribavirin (RBV) as the negative and nonspecific control. Our results revealed that LPV, RTV, and NFV have higher binding affinities with Mpro, and they all interact with catalytic…

Finding Symmetry Plane of 3D Face Shape

Gang Pan, Yueming Wang, Yu Qi +1 more

Computer Vision and Pattern Recognition · 2006 · cited 18× · DOI ↗ · more like this ·

The symmetry plane detection from 3D face shape is much helpful for pose estimation and feature extraction for a wide range of applications, e.g. 3D face recognition. This paper proposes a robust symmetry plane detection method for 3D face models, which is an extension of EGI-based approach. The experiments using two data sets, USF HumanID 3D face database and 3DFED database covering significant variation in facial expression, demonstrate the effectiveness.

An Iterative Approach for EEG-Based Rapid Face Search: A Refined Retrieval by Brain Computer Interfaces

Yiwen Wang, Lei Jiang, Yun Wang +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Autonomous Mental Development · 17 Jun 2015 · cited 14× · DOI ↗ · more like this ·

Recent face recognition techniques have achieved remarkable successes in fast face retrieval on huge image datasets. But the performance is still limited when large illumination, pose, and facial expression variations are presented. In contrast, the human brain has powerful cognitive capability to recognize faces and demonstrates robustness across viewpoints, lighting conditions, even in the presence of partial occlusion. This paper proposes a closed-loop face retrieval system that combines the state-of-the-art face recognition method with the powerful cognitive function of the human brain illustrated in electroencephalography signals. The system starts with a random face image and outputs the ranking of all of the images in the database according to their similarity to the target individual. At each iteration, the single trial event related potentials (ERP) detector scores the user's…

Liveness iris detection method based on the eye's optical features

Yuqing He, Yushi Hou, Ying-jiao Li +1 more

Signal Processing · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 30 Sep 2010 · cited 12× · DOI ↗ · more like this ·

Iris recognition is the most reliable method in personal identification. With the increase of real applications based on iris recognition, liveness detection is becoming more and more important. Here we proposed a liveness iris detection method based on the eye's optical features. With the help of designing special imaging and infrared illumination module and image analysis, we can implement the detection. The methods include finding the change of iris texture and light spot under different waveband and position of the infrared illumination, calculating the difference of the reflection property in different iris parts. We combine the methods and get the fusion results as the criteria. Experimental results show that this method can help the system distinguish the real iris and traditional kinds of fake irises since it combines the optical features of the real iris.

MTHM: Self-Supervised Multitask Anomaly Detection With Hard Example Mining

Chenkai Zhang, Yueming Wang, Wenming Tan

Artificial Intelligence · IEEE Transactions on Instrumentation and Measurement · 2023 · cited 11× · DOI ↗ · more like this ·

It is still challenging to detect and locate anomalies by models trained only with normal samples. Methods using image reconstruction as a pretext task can provide precise localization but suffer from harnessing the reconstruction capability on unseen anomalies. This paper proposes a new framework of Multi-Task and Hard example Mining (MTHM) for anomaly detection and localization. The self-supervised multi-task setting creatively takes advantage of the competition among different tasks to learn more compact and efficient representations for detection tasks. Moreover, introducing other semantic tasks allows the shared encoder to learn beyond the pixel-to-pixel mapping of only a single image reconstruction task. Subsequent analysis experiments demonstrate that the proposed method can achieve a more suppressive reconstruction capability for anomalies. During the test process, the outputs…

COMBINING VELOCITY AND LOCATION-SPECIFIC SPATIAL CLUES IN TRAJECTORIES FOR COUNTING CROWDED MOVING OBJECTS

Mahdi Hashemzadeh, Gang Pan, Yueming Wang +2 more

Computer Vision and Pattern Recognition · International Journal of Pattern Recognition and Artificial Intelligence · 5 Feb 2013 · cited 11× · DOI ↗ · more like this ·

Trajectory-clustering-based methods have shown a good performance in counting moving objects in densely crowded scenes. However, they still fall into trouble in complex scenes, such as with the close proximity of moving objects, freely moving parts of objects, and different object size in different locations of the scene. This paper proposes a new method combining velocity and location-specific spatial clues in trajectories to deal with these problems. We first extract the velocities of a trajectory over its life-time. To alleviate confusion around the boundary regions between close objects, extracted velocity information is utilized to eliminate unreal-world feature points on objects' boundaries. Then, a function is introduced to measure the similarity of the trajectories integrating both of the spatial and the velocity clues. This function is employed in the Mean-Shift clustering…

Recognizing Scoring in Basketball Game from AER Sequence by Spiking Neural Networks

Jiangrong Shen, Yu Zhao, Jian K. Liu +1 more

Artificial Intelligence · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · July 2020 · cited 9× · DOI ↗ · more like this ·

The automatic score detection and recognition in basketball game has important application potentials, for examples, basketball technique analysis and 24 second control in the game. Although existing studies have been conducted on broadcast videos, most of them usually learned a machine learning algorithm on long videos recorded by traditional cameras. Address Event Representation (AER) sensor provides a possibility to deal with the problem by a human sensing manner. It represents the visual information as a series of spike-based events and records event sequences. Compared to traditional videos, AER events can fully utilize their addresses and timestamp information, forming precise spatio-temporal features with significantly less storage cost. More importantly, it issues spikes which can be naturally processed by human-style spiking neural networks (SNNs). In this paper, we propose to…

Bridging the Semantic Latent Space between Brain and Machine: Similarity Is All You Need

Jiaxuan Chen, Yu Qi, Yueming Wang +1 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · 24 Mar 2024 · cited 8× · DOI ↗ · more like this ·

How our brain encodes complex concepts has been a longstanding mystery in neuroscience. The answer to this problem can lead to new understandings about how the brain retrieves information in large-scale data with high efficiency and robustness. Neuroscience studies suggest the brain represents concepts in a locality-sensitive hashing (LSH) strategy, i.e., similar concepts will be represented by similar responses. This finding has inspired the design of similarity-based algorithms, especially in contrastive learning. Here, we hypothesize that the brain and large neural network models, both using similarity-based learning rules, could contain a similar semantic embedding space. To verify that, this paper proposes a functional Magnetic Resonance Imaging (fMRI) semantic learning network named BrainSem, aimed at seeking a joint semantic latent space that bridges the brain and a Contrastive…

Polar square projection for panoramic video

Yueming Wang, Ronggang Wang, Zhenyu Wang +4 more

Computer Vision and Pattern Recognition · December 2017 · cited 7× · DOI ↗ · more like this ·

Panoramic video provides an immersive experience by presenting a 360° spherical video content. Due to the limitations of coding and storage technology, the spherical panoramic video needs to be projected onto the two-dimensional plane for storage and encoding. In this paper, we propose a polar square projection scheme. We project the area near the poles of the sphere into two square planes and a latitude circle on sphere is projected to a square circle on squares plane, in addition, the rest of area on sphere is projected into a rectangle by means of equal area projection. Experimental results show our proposed projection can obtain a gain of 11.63% BD-rate compared to the equirectangular projection.

Asymmetric circular projection for dynamic virtual reality video stream switching

Yueming Wang, Ronggang Wang, Zhenyu Wang +1 more

Computer Vision and Pattern Recognition · September 2017 · cited 7× · DOI ↗ · more like this ·

To provide full panoramic video content, the transmission bandwidth and playing complexity of virtual reality (VR) video are much higher than that of traditional video. Dynamic stream switching is an efficient scheme which stores multiple asymmetric projections of panoramic video in server side, and transmits only one asymmetric projection (with much lower resolution than full panoramic video) according to the direction of user's head. In this paper, we propose an asymmetric circular (ASC) projection method to generate the asymmetric projection of panoramic video. ASC uses equal area projection in the main viewpoint area to ensure the high and uniform quality of this area, and a projection with decreasing sampling density in other areas. Experimental results show that the bit rate and playing complexity of VR video are greatly reduced with the proposed ASC method. ASC is superior to…

A Novel Stitching Method for High-Precision Low-Overlap Thermal Infrared Array Sweeping Images

Xiangbo Jin, Chongru Wang, Guicheng Han +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 27 Nov 2023 · cited 6× · DOI ↗ · more like this ·

Automatic image stitching and high-precision photogrammetry have been active research fields. This article proposes a novel stitching method for high-precision, low-overlap thermal infrared array scanning (TIRAS) images. The approach corrects the TIRAS camera’s internal parameters, external orientation (EO) elements, and planar projection errors by calculating three homography matrices. First, we establish collinearity equations using the calibrated internal parameters and EO elements with errors and further compute the direct projection transformation model of the original image. Then, we propose a global error optimization model based on a fixed framework according to the midpoints of the alignment point pairs of the correcting image and neighboring images. The homography matrix calculated by this model can relatively correct the EO element errors in the directly projected image.…