arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Yandong Tang

146 papers · 2001–2026

2001: 12002: 02003: 02004: 02005: 02006: 22007: 12008: 52009: 62010: 42011: 22012: 92013: 32014: 42015: 42016: 72017: 122018: 82019: 42020: 132021: 92022: 92023: 112024: 152025: 132026: 4
2001peak 15 in 20242026

Frequent co-authors

Papers

showing 1–25 of 146 RSS

RGBD Salient Object Detection via Deep Fusion

Liangqiong Qu, Shengfeng He, Jiawei Zhang +3 more

cs.CV · · cited 373× · arXiv ↗ · more like this ·

Numerous efforts have been made to design different low level saliency cues for the RGBD saliency detection, such as color or depth contrast features, background and color compactness priors. However, how these saliency cues interact with each other and how to incorporate these low level saliency cues effectively to generate a master saliency map remain a challenging problem. In this paper, we design a new convolutional neural network (CNN) to fuse different low level saliency cues into hierarchical features for automatically detecting salient objects in RGBD images. In contrast to the existing works that directly feed raw image pixels to the CNN, the proposed method takes advantage of the knowledge in traditional saliency detection by adopting various meaningful and well-designed saliency feature vectors as input. This can guide the training of CNN towards detecting salient object more…

DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal

Liangqiong Qu, Jiandong Tian, Shengfeng He +2 more

Computer Vision and Pattern Recognition · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · · cited 317× · DOI ↗ · more like this ·

Shadow removal is a challenging task as it requires the detection/annotation of shadows as well as semantic understanding of the scene. In this paper, we propose an automatic and end-to-end deep neural network (DeshadowNet) to tackle these problems in a unified manner. DeshadowNet is designed with a multi-context architecture, where the output shadow matte is predicted by embedding information from three different perspectives. The first global network extracts shadow features from a global view. Two levels of features are derived from the global network and transferred to two parallel networks. While one extracts the appearance of the input image, the other one involves semantic understanding for final prediction. These two complementary networks generate multi-context features to obtain the shadow matte with fine local details. To evaluate the performance of the proposed method, we…

Video Desnowing and Deraining Based on Matrix Decomposition

Weihong Ren, Jiandong Tian, Zhi Han +2 more

Computer Vision and Pattern Recognition · · cited 190× · DOI ↗ · more like this ·

The existing snow/rain removal methods often fail for heavy snow/rain and dynamic scene. One reason for the failure is due to the assumption that all the snowflakes/rain streaks are sparse in snow/rain scenes. The other is that the existing methods often can not differentiate moving objects and snowflakes/rain streaks. In this paper, we propose a model based on matrix decomposition for video desnowing and deraining to solve the problems mentioned above. We divide snowflakes/rain streaks into two categories: sparse ones and dense ones. With background fluctuations and optical flow information, the detection of moving objects and sparse snowflakes/rain streaks is formulated as a multi-label Markov Random Fields (MRFs). As for dense snowflakes/rain streaks, they are considered to obey Gaussian distribution. The snowflakes/rain streaks, including sparse ones and dense ones, in scene…

Residual Denoising Diffusion Models

Jiawei Liu, Qiang Wang, Huijie Fan +3 more

cs.CV · · cited 153× · arXiv ↗ · more like this ·

We propose residual denoising diffusion models (RDDM), a novel dual diffusion process that decouples the traditional single denoising diffusion process into residual diffusion and noise diffusion. This dual diffusion framework expands the denoising-based diffusion models, initially uninterpretable for image restoration, into a unified and interpretable model for both image generation and restoration by introducing residuals. Specifically, our residual diffusion represents directional diffusion from the target image to the degraded input image and explicitly guides the reverse generation process for image restoration, while noise diffusion represents random perturbations in the diffusion process. The residual prioritizes certainty, while the noise emphasizes diversity, enabling RDDM to effectively unify tasks with varying certainty or diversity requirements, such as image generation and…

Adaptive Learning Attention Network for Underwater Image Enhancement

Shiben Liu, Huijie Fan, Sen Lin +3 more

Computer Vision and Pattern Recognition · IEEE Robotics and Automation Letters · · cited 139× · DOI ↗ · more like this ·

Underwater images suffer from color casts and low illumination due to the scattering and absorption of light as it propagates in water. These problems can interfere with underwater vision tasks, such as recognition and detection. We propose an adaptive learning attention network for underwater image enhancement based on supervised learning, named LANet, to solve these degradation issues. First, a multiscale fusion module is proposed to combine different spatial information. Second, we design a novel parallel attention module(PAM) to focus on the illuminated features and more significant color information coupled with the pixel and channel attention. Then, an adaptive learning module(ALM) can retain the shallow information and adaptively learn important feature information. Further, we utilize a multinomial loss function that is formed by mean absolute error and perceptual loss. Finally…

Video Anomaly Search in Crowded Scenes via Spatio-Temporal Motion Context

Yang Cong, Junsong Yuan, Yandong Tang

Artificial Intelligence · IEEE Transactions on Information Forensics and Security · · cited 134× · DOI ↗ · more like this ·

Video anomaly detection plays a critical role for intelligent video surveillance. We present an abnormal video event detection system that considers both spatial and temporal contexts. To characterize the video, we first perform the spatio-temporal video segmentation and then propose a new region-based descriptor called “Motion Context,” to describe both motion and appearance information of the spatio-temporal segment. For anomaly measurements, we formulate the abnormal event detection as a matching problem, which is more robust than statistic model-based methods, especially when the training dataset is of limited size. For each testing spatio-temporal segment, we search for its best match in the training dataset, and determine how normal it is using a dynamic threshold. To speed up the search process, compact random projections are also adopted. Experiments on the benchmark dataset and…

Deep Retinex Network for Single Image Dehazing

Pengyue Li, Jiandong Tian, Yandong Tang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 102× · DOI ↗ · more like this ·

In this paper, we propose a retinex-based decomposition model for a hazy image and a novel end-to-end image dehazing network. In the model, the illumination of the hazy image is decomposed into natural illumination for the haze-free image and residual illumination caused by haze. Based on this model, we design a deep retinex dehazing network (RDN) to jointly estimate the residual illumination map and the haze-free image. Our RDN consists of a multiscale residual dense network for estimating the residual illumination map and a U-Net with channel and spatial attention mechanisms for image dehazing. The multiscale residual dense network can simultaneously capture global contextual information from small-scale receptive fields and local detailed information from large-scale receptive fields to precisely estimate the residual illumination map caused by haze. In the dehazing U-Net, we apply…

Review of palm vein recognition

Wei Wu, Stephen J. Elliott, Sen Lin +2 more

Signal Processing · IET Biometrics · · cited 102× · DOI ↗ · more like this ·

As a new research focus in biometrics, palm vein recognition has attracted people's attention because of high security, liveness‐detection, user acceptability and convenience. Palm vein recognition exhibits high security, as it uses the network of blood vessels underneath palm skin for recognition. As palm vein is interior biological information of the body, vein patterns are much harder for intruders to copy compared to other biometric features. Palm vein is mostly invisible to the human eyes; they are commonly captured under near‐infrared light. Under its natural state, the veins of the palm are concealed naturally and, for most of time people's hands are in the gesture of half fist. This study presents a comprehensive overview of recent research progress of palm vein recognition, from the basic background knowledge to data acquisition, public database, preprocessing, feature…

Flow mosaicking: Real-time pedestrian counting without scene-specific learning

Yang Cong, Haifeng Gong, Song‐Chun Zhu +1 more

Computer Vision and Pattern Recognition · 2009 IEEE Conference on Computer Vision and Pattern Recognition · · cited 98× · DOI ↗ · more like this ·

In this paper, we present a novel algorithm based on flow velocity field estimation to count the number of pedestrians across a detection line or inside a specified region. We regard pedestrians across the line as fluid flow, and design a novel model to estimate the flow velocity field. By integrating over time, the dynamic mosaics are constructed to count the number of pixels and edges passed through the line. Consequentially, the number of pedestrians can be estimated by quadratic regression, with the number of weighted pixels and edges as input. The regressors are learned off line from several camera tilt angles, and have taken the calibration information into account.We use tilt-angle-specific learning to ensure direct deployment and avoid overfitting while the commonly used scene-specific learning scheme needs on-site annotation and always trends to overfitting. Experiments on a…

Tricolor Attenuation Model for Shadow Detection

Jiandong Tian, Jing Sun, Yandong Tang

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 88× · DOI ↗ · more like this ·

Shadows, the common phenomena in most outdoor scenes, bring many problems in image processing and computer vision. In this paper, we present a novel method focusing on extracting shadows from a single outdoor image. The proposed tricolor attenuation model (TAM) that describe the attenuation relationship between shadow and its nonshadow background is derived based on image formation theory. The parameters of the TAM are fixed by using the spectral power distribution (SPD) of daylight and skylight, which are estimated according to Planck's blackbody irradiance law. Based on the TAM, a multistep shadow detection algorithm is proposed to extract shadows. Compared with previous methods, the algorithm can be applied to process single images gotten in real complex scenes without prior knowledge. The experimental results validate the performance of the model.

Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets

Weihong Ren, Xinchao Wang, Jiandong Tian +2 more

cs.CV · · cited 80× · arXiv ↗ · more like this ·

State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, detectors often fail to obtain accurate detections due to heavy occlusions and high crowd density. In this paper, we propose a new MOT paradigm, tracking-by-counting, tailored for crowded scenes. Using crowd density maps, we jointly model detection, counting, and tracking of multiple targets as a network flow program, which simultaneously finds the global optimal detections and trajectories of multiple targets over the whole video. This is in contrast to prior MOT methods that either ignore the crowd density and thus are prone to errors in crowded scenes, or rely on a suboptimal two-step process using heuristic density-aware point-tracks for matching targets.Our approach…

A Generalized Model for Robust Tensor Factorization With Noise Modeling by Mixture of Gaussians

Xi’ai Chen, Zhi Han, Yao Wang +4 more

Computational Mathematics · IEEE Transactions on Neural Networks and Learning Systems · · cited 63× · DOI ↗ · more like this ·

The low-rank tensor factorization (LRTF) technique has received increasing attention in many computer vision applications. Compared with the traditional matrix factorization technique, it can better preserve the intrinsic structure information and thus has a better low-dimensional subspace recovery performance. Basically, the desired low-rank tensor is recovered by minimizing the least square loss between the input data and its factorized representation. Since the least square loss is most optimal when the noise follows a Gaussian distribution, -norm-based methods are designed to deal with outliers. Unfortunately, they may lose their effectiveness when dealing with real data, which are often contaminated by complex noise. In this paper, we consider integrating the noise modeling technique into a generalized weighted LRTF (GWLRTF) procedure. This procedure treats the original issue as an…

A Stairway Detection Algorithm based on Vision for UGV Stair Climbing

Yang Cong, Xiaomao Li, Ji Liu +1 more

Computer Vision and Pattern Recognition · · cited 60× · DOI ↗ · more like this ·

In the paper, we present a vision based algorithm used to guide the unmanned ground vehicles (UGV) for autonomous stairways climbing and implement it on UGV successfully. The reliability of guiding UGV to climb stairs requires evaluating two offset parameters: the position of vehicle on stairs and the orientation angle to stairs. The intention of our algorithm is to estimate these two parameters through extracting the stair edges robustly. To achieve this goal, we apply the Gabor filter to eliminate the influence of the illumination and keep edges, and propose a fast method to remove small lines. Finally we link stair edges, and estimate the offset parameters used to steer the vehicle by RANSAC algorithm. Experiments on various stairways including indoor and outdoor are given in various light conditions. The results validate our algorithm.

A Method of Insulator Detection from Video Sequence

Bingfeng Li, Denglu Wu, Yang Cong +2 more

Computer Vision and Pattern Recognition · · cited 51× · DOI ↗ · more like this ·

We present a very efficient approach for insulators detection. Unlike previous texture-based approach, we directly search insulators location in the images by using Profile projection. For overcoming the negative effect of image noise on object detection, we preprocess insulators image by thresholding method. To make insulators detection more effective and efficient, we design a tilt correction method based on principal component analysis. The correction enables our method to derive accurate feature extraction curve from insulators image, then we extract five features from the feature curve, which are related to the number of binary sequence and the normalized variance of the binary sequence length. After obtaining the insulators feature from an image, we apply SVM to identify insulators with the five features. Some experiments on video frame images show that our approach significantly…

Recurrent Generative Adversarial Network for Face Completion

Qiang Wang, Huijie Fan, Gan Sun +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 46× · DOI ↗ · more like this ·

Most recently-proposed face completion algorithms use high-level features extracted from convolutional neural networks (CNNs) to recover semantic texture content. Although the completed face is natural-looking, the synthesized content still lacks lots of high-frequency details, since the high-level features cannot supply sufficient spatial information for details recovery. To tackle this limitation, in this paper, we propose a <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">R</u> ecurrent <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">G</u> enerative <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A</u> dversarial <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">N</u> etwork…

Compensation Atmospheric Scattering Model and Two-Branch Network for Single Image Dehazing

Xudong Wang, Xi’ai Chen, Weihong Ren +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Emerging Topics in Computational Intelligence · · cited 42× · DOI ↗ · more like this ·

Most existing dehazing networks rely on synthetic hazy-clear image pairs for training, and thus fail to work well in real-world scenes. In this paper, we deduce a reformulated atmospheric scattering model for a hazy image and propose a novel lightweight two-branch dehazing network. In the model, we use a Transformation Map to represent the dehazing transformation and use a Compensation Map to represent variable illumination compensation. Based on this model, we design a <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</u> wo- <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">B</u> ranch <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">N</u> etwork (TBN) to jointly estimate the Transformation Map and Compensation Map. Our TBN is…

Skip Connection Aggregation Transformer for Occluded Person Reidentification

Huijie Fan, Xiaotong Wang, Qiang Wang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Industrial Informatics · · cited 41× · DOI ↗ · more like this ·

The occlusion problem is a significant challenge for person reidentification. Recently, transformer-based methods have been introduced to solve the occlusion problem and achieve performance improvements. However, the existing methods only apply the features of the last transformer layer and fail to consider the alignment of visible body parts. They also ignore fine-grained local features. Thus, they usually suffer from misalignment in occluded image matching. We observe that features from the high layers of the transformer focus on classification information and global features, while those from the middle layers pay more attention to pedestrians. We think that making full use of the features of different layers will facilitate alignment and then will promote reidentification accuracy. Therefore, we propose a novel skip connection aggregation transformer (SCAT) network by utilizing…

A Decoupled Multi-Task Network for Shadow Removal

Jiawei Liu, Qiang Wang, Huijie Fan +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 37× · DOI ↗ · more like this ·

Shadow removal, which aims to restore the illumination in shadow regions, is challenging due to the diversity of shadows in terms of location, intensity, shape, and size. Different from most multi-task methods, which design elaborate multi-branch or multi-stage structures for better shadow removal, we introduce feature decomposition to learn better feature representations. Specifically, we propose a single-stage and decoupled multi-task network (DMTN) to explicitly learn the decomposed features for shadow removal, shadow matte estimation, and shadow image reconstruction. First, we propose several coarse-to-fine semi-convolution (SMC) modules to capture features sufficient for joint learning of these three tasks. Second, we design a theoretically supported feature decoupling layer to explicitly decouple the learned features into shadow image features and shadow matte features via weight…

A Shadow Imaging Bilinear Model and Three-Branch Residual Network for Shadow Removal

Jiawei Liu, Qiang Wang, Huijie Fan +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks and Learning Systems · · cited 34× · DOI ↗ · more like this ·

The current shadow removal pipeline relies on the detected shadow masks, which have limitations for penumbras and tiny shadows, and results in an excessively long pipeline. To address these issues, we propose a shadow imaging bilinear model and design a novel three-branch residual (TBR) network for shadow removal. Our bilinear model reveals the single-image shadow removal process and can explain why simply increasing the brightness of shadow areas cannot remove shadows without artifacts. We considerably shorten the shadow removal pipeline by modeling illumination compensation and developing a single-stage shadow removal network without additional detection and refinement networks. Specifically, our network consists of three task branches, i.e., shadow image reconstruction, shadow matte estimation, and shadow removal. To merge these three branches and enhance the shadow removal branch…

QueryTrack: Joint-Modality Query Fusion Network for RGBT Tracking

Huijie Fan, Zhencheng Yu, Qiang Wang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 32× · DOI ↗ · more like this ·

Existing RGB-Thermal trackers usually treat intra-modal feature extraction and inter-modal feature fusion as two separate processes, therefore the mutual promotion of extraction and fusion is neglected. Then, the complementary advantages of RGB-T fusion are not fully exploited, and the independent feature extraction is not adaptive to modal quality fluctuation during tracking. To address the limitations, we design a joint-modality query fusion network, in which the intra-modal feature extraction and the inter-modal fusion are coupled together and promote each other via joint-modality queries. The queries are initialized based on the multimodal features of the current frame, making the subsequent fusion adaptive to modal quality fluctuation during tracking. Then the joint-modality query fusion (JQF) utilizes the queries to interact with RGB-T features, allowing the intra-modal…

Effective Tensor Completion via Element-wise Weighted Low-rank Tensor Train with Overlapping Ket Augmentation

Yang Zhang, Yao Wang, Zhi Han +2 more

cs.CV · · cited 31× · arXiv ↗ · more like this ·

In recent years, there have been an increasing number of applications of tensor completion based on the tensor train (TT) format because of its efficiency and effectiveness in dealing with higher-order tensor data. However, existing tensor completion methods using TT decomposition have two obvious drawbacks. One is that they only consider mode weights according to the degree of mode balance, even though some elements are recovered better in an unbalanced mode. The other is that serious blocking artifacts appear when the missing element rate is relatively large. To remedy such two issues, in this work, we propose a novel tensor completion approach via the element-wise weighted technique. Accordingly, a novel formulation for tensor completion and an effective optimization algorithm, called as tensor completion by parallel weighted matrix factorization via tensor train (TWMac-TT), is…

Deeply Supervised Face Completion With Multi-Context Generative Adversarial Network

Qiang Wang, Huijie Fan, Linlin Zhu +1 more

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · · cited 30× · DOI ↗ · more like this ·

Recent face completion works have achieved significant improvement using generative adversarial networks (GANs). There are still two important issues in this challenging task: first, semantic understanding; and second, high-frequency details prediction. In this letter, we propose a unified model by introducing multi-context structures within GANs. Our model, named multi-context generative adversarial networks (MCGAN), automatically learns the hierarchical appearances of a corrupted image and predicted the missing regions from different perspectives. In this model, semantic understanding and high-frequency details are both taken into account and modeled with two parallel networks, respectively. While one learns the semantic understanding of the input face image at a high level, the other extracts low-level features for high-frequency details prediction. Our MCGAN takes full advantage of…

Single image dehazing by latent region‐segmentation based transmission estimation and weighted <i>L</i> <sub>1</sub> ‐norm regularisation

Tong Cui, Jiandong Tian, Ende Wang +1 more

Computer Vision and Pattern Recognition · IET Image Processing · · cited 30× · DOI ↗ · more like this ·

Image dehazing is a useful technique which can eliminate the bad effect of haze on images and enhance the performances of image/video processing algorithms in the hazy weather. In this study, a single image dehazing method is proposed. The authors estimate the initial transmission properly based on latent region‐segmentation and refine the estimated initial transmission by an objective function with a novel weighted L 1 ‐norm regularisation term. The half‐quadratic splitting minimisation method is employed to solve this optimisation problem. They also define an evaluation function to estimate the reliable global atmospheric light. With the refined transmission map and atmospheric light they recover the haze‐free image by the haze imaging model. The authors’ method is compared with three state‐of‐the‐art methods and is also validated by two image quality assessment methods. The…

Unsupervised person re‐identification based on adaptive information supplementation and foreground enhancement

Qiang Wang, Zhihong Huang, Huijie Fan +2 more

Computer Vision and Pattern Recognition · IET Image Processing · · cited 29× · DOI ↗ · more like this ·

Abstract Unsupervised person re‐identification has attracted vital interest because of its ability to protect privacy, significantly lower the expense of manual annotation, and eliminate the need for data labels. General unsupervised methods train the network only through global features, which causes the fine‐grained information contained in local features to be ignored in the recognition process, resulting in large amounts of label noise and affecting the recognition accuracy. Moreover, more robust pedestrian features can also improve the accuracy of clustering and enable unsupervised person re‐identification to obtain better results. To address these issues, first, a dual‐branch structure was proposed, which separately obtains the global features of the pedestrian and the local features by dividing the global features into a few equal sections. Then, an adaptive information…

FMambaIR: A Hybrid State-Space Model and Frequency Domain for Image Restoration

Xin Luan, Huijie Fan, Qiang Wang +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · · cited 28× · DOI ↗ · more like this ·

With the development of deep learning, impressive progress has been made in the field of image restoration. The existing methods mainly rely on CNN and Transformer to obtain multi-scale feature information. However, these methods rarely integrate frequency domain information effectively during feature extraction, limiting their performance in image restoration. Additionally, few have combined Mamba with the Fourier domain for image restoration, which limits Mamba’s ability to perceive global degradation in the frequency domain. Therefore, we propose a new image restoration model called FMambaIR, which utilizes the complementarity between frequency and Mamba for image restoration. The core of FMambaIR is the F-Mamba block, which combines Fourier transform and Mamba for global degradation perception modeling. Specifically, F-Mamba adopts a dual branch complementary structure, including…