arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Guangling Sun

40 papers · 2004–2025

2004: 12005: 02006: 02007: 02008: 32009: 12010: 22011: 12012: 52013: 22014: 32015: 12016: 32017: 12018: 02019: 32020: 22021: 22022: 22023: 22024: 42025: 2
2004peak 5 in 20122025

Frequent co-authors

Papers

showing 1–25 of 40 RSS

Depth-Aware Salient Object Detection and Segmentation via Multiscale Discriminative Saliency Fusion and Bootstrap Learning

Hangke Song, Zhi Liu, Huan Du +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 251× · DOI ↗ · more like this ·

This paper proposes a novel depth-aware salient object detection and segmentation framework via multiscale discriminative saliency fusion (MDSF) and bootstrap learning for RGBD images (RGB color images with corresponding Depth maps) and stereoscopic images. By exploiting low-level feature contrasts, mid-level feature weighted factors and high-level location priors, various saliency measures on four classes of features are calculated based on multiscale region segmentation. A random forest regressor is learned to perform the discriminative saliency fusion (DSF) and generate the DSF saliency map at each scale, and DSF saliency maps across multiple scales are combined to produce the MDSF saliency map. Furthermore, we propose an effective bootstrap learning-based salient object segmentation method, which is bootstrapped with samples based on the MDSF saliency map and learns multiple kernel…

Saliency Detection for Unconstrained Videos Using Superpixel-Level Graph and Spatiotemporal Propagation

Zhi Liu, Junhao Li, Linwei Ye +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 180× · DOI ↗ · more like this ·

This paper proposes an effective spatiotemporal saliency model for unconstrained videos with complicated motion and complex scenes. First, superpixel-level motion and color histograms as well as global motion histogram are extracted as the features for saliency measurement. Then a superpixel-level graph with the addition of a virtual background node representing the global motion is constructed, and an iterative motion saliency (MS) measurement method that utilizes the shortest path algorithm on the graph is exploited to reasonably generate MS maps. Temporal propagation of saliency in both forward and backward directions is performed using efficient operations on inter-frame similarity matrices to obtain the integrated temporal saliency maps with the better coherence. Finally, spatial propagation of saliency both locally and globally is performed via the use of intra-frame similarity…

Salient region detection for stereoscopic images

Xing‐Xing Fan, Zhi Liu, Guangling Sun

Computer Vision and Pattern Recognition · · cited 82× · DOI ↗ · more like this ·

In this paper, we propose an effective saliency model, which combines region-level depth, color and spatial information, to detect salient regions in stereoscopic images. Based on region segmentation results of stereoscopic images, depth contrast, depth weighted color contrast, and spatial compactness of color distribution are measured for each region, and combined to generate the region-level saliency map. Experimental results on a public stereoscopic image dataset with ground truths of salient objects demonstrate that the proposed saliency model outperforms the state-of-the-art saliency models.

Improving Saliency Detection Via Multiple Kernel Boosting and Adaptive Fusion

Xiaofei Zhou, Zhi Liu, Guangling Sun +2 more

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · · cited 45× · DOI ↗ · more like this ·

This letter proposes a novel framework to improve the saliency detection performance of an existing saliency model, which is used to generate the initial saliency map. First, a novel regional descriptor consisting of regional self-information, regional variance, and regional contrast on a number of features with local, global, and border context is proposed to describe the segmented regions at multiple scales. Then, regarding saliency computation as a regression problem, a multiple kernel boosting method based on support vector regression (MKB-SVR) is proposed to generate the complementary saliency map. Finally, an adaptive fusion method via learning a quality prediction model for saliency maps is proposed to effectively fuse the initial saliency map with the complementary saliency map and obtain the final saliency map with improvement on saliency detection performance. Experimental…

Inheritance Attention Matrix-Based Universal Adversarial Perturbations on Vision Transformers

Haoqi Hu, Xiaofeng Lu, Xinpeng Zhang +2 more

Artificial Intelligence · IEEE Signal Processing Letters · · cited 19× · DOI ↗ · more like this ·

Universal Adversarial Perturbations (UAPs), which is type of image-agnostic adversarial attack, has been deeply investigated for Convolutional Neural Networks due to its high efficiency. On the other hand, as an architecture based on self-attention mechanism, Vision Transformers (ViTs) have boomed and been widely applied to solve various computer vision problems since most recent years. In this letter, we delve into the robustness of ViTs against universal adversarial attack and propose an inheritance attention matrix-based UAPs (IAM-UAP). Specifically, we introduce the inheritance attention weight matrix (IAM), which represents the integration of global information of the input patch sequence. Further, we propose a perturbation optimization objective based on IAM to confuse the global information integration of ViTs. The empirical results confirm the attacking capability of IAM-UAP on…

A dynamic traffic signal scheduling system based on improved greedy algorithm

Guangling Sun, Rui Qi, Yulong Liu +1 more

Transportation · PLoS ONE · · cited 17× · DOI ↗ · more like this ·

Urbanization has led to accelerated traffic congestion, posing a significant obstacle to urban development. Traditional traffic signal scheduling methods are often inefficient and cumbersome, resulting in unnecessary waiting times for vehicles and pedestrians, exacerbating the traffic situation. To address this issue, this article proposes a dynamic traffic signal scheduling system based on an improved greedy algorithm. Unlike conventional approaches, we introduce a reward function and a cost model to ensure fair scheduling plans. A constraint function is also established, and the traffic signal scheduling is iterated through the feasible matrix using the greedy algorithm to simplify the decision-making process and enhance solution efficiency. Moreover, an emergency module is integrated to prioritize special emergency vehicles, reducing their response time during emergencies. To…

Depth-aware saliency detection using discriminative saliency fusion

Hangke Song, Zhi Liu, Huan Du +1 more

Computer Vision and Pattern Recognition · IEEE Conference Proceedings · · cited 17× · DOI ↗ · more like this ·

In this paper, we propose a multi-stage depth-aware saliency model for salient region detection. We evaluate saliency on different features at low, mid and high levels, by taking account of primary depth and appearance contrasts, different feature weighted factors and location priors, respectively. Unlike most existing depth-aware saliency models that use a linear or experiential fusion formula to combine saliency maps from different features, we calculate saliency of each feature individually at each level and learn a discriminative saliency fusion (DSF) regressor based on random forest to estimate the saliency measures of regions. Both subjective and objective evaluations on two public datasets designed for depth-aware saliency detection demonstrate that the proposed saliency model consistently outperforms the state-of-the-art saliency models on saliency detection performance.

Complete Defense Framework to Protect Deep Neural Networks against Adversarial Examples

Guangling Sun, Yuying Su, Chuan Qin +3 more

Artificial Intelligence · Mathematical Problems in Engineering · · cited 15× · DOI ↗ · more like this ·

Although Deep Neural Networks (DNNs) have achieved great success on various applications, investigations have increasingly shown DNNs to be highly vulnerable when adversarial examples are used as input. Here, we present a comprehensive defense framework to protect DNNs against adversarial examples. First, we present statistical and minor alteration detectors to filter out adversarial examples contaminated by noticeable and unnoticeable perturbations, respectively. Then, we ensemble the detectors, a deep Residual Generative Network (ResGN), and an adversarially trained targeted network, to construct a complete defense framework. In this framework, the ResGN is our previously proposed network which is used to remove adversarial perturbations, and the adversarially trained targeted network is a network that is learned through adversarial training. Specifically, once the detectors determine…

Saliency detection for RGBD images

Hangke Song, Zhi Liu, Huan Du +2 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

Additional depth information from RGBD images is one of characteristics different from conventional 2D images. In this paper, we propose an effective saliency model to detect salient regions in RGBD images. Color contrast and depth contrast are first enhanced with the weighting of depth-based object probability. Then the region merging based saliency refinement is exploited to obtain the color saliency map and depth saliency map, respectively. Finally, a location prior of salient objects is integrated with color saliency and depth saliency to obtain the regional saliency map. Both subjective and objective evaluations on a public RGBD image dataset demonstrate that the proposed saliency model outperforms the state-of-the-art saliency models.

Co-Saliency Detection Using Collaborative Feature Extraction And High-To-Low Feature Integration

Jingru Ren, Zhi Liu, Gongyang Li +3 more

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

Co-saliency detection, as a developing research branch of saliency detection, devotes to identify the common salient objects in a group of related images. The major challenge of co-saliency detection is how to effectively represent features considering both intra-image and inter-image information. In this paper, we propose a co-saliency detection model using collaborative feature extraction and high-to-low feature integration. We first feed the target image and its co-images into the Individual Feature Extraction Module (IFEM) to produce multi-level individual features. Then, to capture the collaborative inter-image information, the Collaborative Feature Extraction Module (CFEM) is applied to all highest-level individual features, generating the collaborative feature. Finally, we build a High-to-low Feature Integration Module (HFIM), which integrates the collaborative feature and…

Cleaning Adversarial Perturbations via Residual Generative Network for Face Verification

Yuying Su, Guangling Sun, Weiqi Fan +2 more

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

Deep neural networks (DNNs) have recently achieved impressive performances on various applications. However, recent researches show that DNNs are vulnerable to adversarial perturbations injected into input samples. In this paper, we investigate a defense method for face verification: a deep residual generative network (ResGN) is learned to clean adversarial perturbations. We propose a novel training framework composed of ResGN, pre-trained VGG-Face network and FaceNet network. The parameters of ResGN are optimized by minimizing a joint loss consisting of a pixel loss, a texture loss and a verification loss, in which they measure content errors, subjective visual perception errors and verification task errors between cleaned image and legitimate image respectively. Specially, the latter two are provided by VGG-Face and FaceNet respectively and have essential contributions for improving…

AWEncoder: Adversarial Watermarking Pre-trained Encoders in Contrastive Learning

Tianxing Zhang, Hanzhou Wu, Xiaofeng Lu +1 more

cs.CV · · cited 5× · arXiv ↗ · more like this ·

As a self-supervised learning paradigm, contrastive learning has been widely used to pre-train a powerful encoder as an effective feature extractor for various downstream tasks. This process requires numerous unlabeled training data and computational resources, which makes the pre-trained encoder become valuable intellectual property of the owner. However, the lack of a priori knowledge of downstream tasks makes it non-trivial to protect the intellectual property of the pre-trained encoder by applying conventional watermarking methods. To deal with this problem, in this paper, we introduce AWEncoder, an adversarial method for watermarking the pre-trained encoder in contrastive learning. First, as an adversarial perturbation, the watermark is generated by enforcing the training samples to be marked to deviate respective location and surround a randomly selected key image in the embedding…

Hybrid Defense for Deep Neural Networks: An Integration of Detecting and Cleaning Adversarial Perturbations

Weiqi Fan, Guangling Sun, Yuying Su +2 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Nowadays, deep neural networks (DNN) have achieved significant success in computer vision. However, recent investigations have shown that DNN models are highly vulnerable to an input adversarial example. How to defense against adversarial examples is an essential issue to improve the robustness of DNN models. In this paper, we present a hybrid defense framework that integrates detecting and cleaning adversarial perturbations to protect DNN. Specifically, the detecting part consists of statistical detector and Gaussian noise injection detector which are adaptive to perturbation characteristics to inspect adversarial examples, and the cleaning part is a deep residual generative network (ResGN) for removing or mitigating the adversarial perturbations. The parameters of ResGN are optimized by minimizing a joint loss including a pixel loss, a texture loss and a task loss. In the experiments…

TraceGuard: Fine-Tuning Pre-Trained Model by Using Stego Images to Trace Its User

Limengnan Zhou, Xingdong Ren, Cheng Qian +1 more

Computer Vision and Pattern Recognition · Mathematics · · cited 3× · DOI ↗ · more like this ·

Currently, a significant number of pre-trained models are published online to provide services to users owing to the rapid maturation and popularization of machine learning as a service (MLaaS). Some malicious users have pre-trained models illegally to redeploy them and earn money. However, most of the current methods focus on verifying the copyright of the model rather than tracing responsibility for the suspect model. In this study, TraceGuard is proposed, the first framework based on steganography for tracing a suspect self-supervised learning (SSL) pre-trained model, to ascertain which authorized user illegally released the suspect model or if the suspect model is independent. Concretely, the framework contains an encoder and decoder pair and the SSL pre-trained model. Initially, the base pre-trained model is frozen, and the encoder and decoder are jointly learned to ensure the two…

Adaptive multi-strategy for multi-vehicle with mutual occlusion tracking

Jie Yin, Guangling Sun

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Multi-vehicle with mutual occlusion tracking is a great challenging task. In this paper, we present a novel scheme based on adaptive multi-strategy to cope with this problem. First, a rule that determines the relation and degree of occlusion among different vehicles is proposed. The rule will output three cases: the first is severely occluded vehicle, the second is partially occluded vehicle and the third is non-occluded vehicle. And then, for the three cases, different tracking approaches are adopted: for the first case, a trace prediction based method using motion features is employed. For the latter two cases, dictionary and l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sub> regularized collaborative representation based method is employed. During tracking, only background dictionary is updated. The experimental results have…

Leveraging Universal Adversarial Perturbation and Frequency Band Filters Against Face Recognition

Limengnan Zhou, Bufan He, Xi Jin +1 more

Artificial Intelligence · Mathematics · · cited 2× · DOI ↗ · more like this ·

Universal adversarial perturbation (UAP) exhibits universality as it is independent of specific images. Although previous investigations have shown that the classification of natural images is susceptible to universal adversarial attacks, the impact of UAP on face recognition has not been fully investigated. Thus, in this paper we assess the vulnerability of face recognition for UAP. We propose FaUAP-FBF, which exploits the frequency domain by learning high, middle, and low band filters as an additional dimension of refining facial UAP. The facial UAP and filters are alternately and repeatedly learned from a training set. Furthermore, we convert non-target attacks to target attacks by customizing a target example, which is an out-of-distribution sample for a training set. Accordingly, non-target and target attacks form a uniform target attack. Finally, the variance of cosine similarity…

Insulator detection of Yolov5 fused with GBAM and α-IOU

Xin Luo, Junsun Chen, Guangling Sun +1 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Insulator fault of power line is easy to lead to transmission system fault, so insulator detection system is widely used. Based on this, an improved detection method for Yolov5 is proposed, this method constructs a new network framework through Yolov5. First, the Yolov5 loss function CIoU is improved, and the generalized power transformation is introduced into the existing CIoU loss to optimize the boundary frame regression and improve the accuracy of the boundary frame regression. Then, GBAM attention mechanisms are introduced in each C3 module of the Yolov5 backbone to reduce information dispersion and amplify global interaction features. Finally, create a custom damaged insulator data set. The results show that the network is more accurate and faster than the control group, with an accuracy of 97.42% for insulator defect detection and 4.01 images per second, which is good efficiency…

RGN-Defense: erasing adversarial perturbations using deep residual generative network

Weiqi Fan, Guangling Sun, Xiaobao Deng

Artificial Intelligence · Journal of Electronic Imaging · · cited 2× · DOI ↗ · more like this ·

In recent years, deep neural networks have achieved great success in various fields, especially in computer vision. However, recent investigations have shown that current state-of-the-art classification models are highly vulnerable to adversarial perturbations contained in the input examples. Therefore, we propose a defense methodology against the adversarial perturbations. Prior to a targeted network, adversarial perturbations are erased or mitigated via a deep residual generative network (RGN). Through adopting an auxiliary network VGG-19, the RGN is trained toward optimization of a joint loss, including low-level pixel loss, middle-level texture loss, and high-level task loss, thereby the restored examples are highly consistent with the original legitimate examples. We call our proposed defense based on RGN as RGN-Defense. It is an independent defense module that can be flexibly…

Robust blurred face recognition using sample-wise kernel estimation and random compressed multi-scale local binary pattern histograms

Guangling Sun, Zhi Liu

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Robust face recognition from blurred images is an important and challenging problem. We propose sample-wise kernel estimation (SWKE). For each sharp gallery sample, an optimal blur kernel making the distance between probe and corresponding blurred sample minimum is estimated. Then, the kernel is applied to blur the sharp gallery sample. All such blurred samples compose the adaptive blurred sample set acting as references during recognition. Next, we present random compressed multi-scale local binary pattern histograms (RCMSLBPH). Due to the sparseness of the histogram of each sub-region and each feature image, it is possible to accomplish large-margin dimensionality reduced without impairing great information loss by using random Gaussian projection matrix. Finally, we design two stage framework involving coarse recognition and fine recognition to obtain an optimized…

Blurred Image Classification based on Adaptive Dictionary

Guangling Sun, Guoqing Li, Jie Yin

cs.CV · · cited 2× · arXiv ↗ · more like this ·

Two types of framework for blurred image classification based on adaptive dictionary are proposed. Given a blurred image, instead of image deblurring, the semantic category of the image is determined by blur insensitive sparse coefficients calculated depending on an adaptive dictionary. The dictionary is adaptive to the Point Spread Function (PSF) estimated from input blurred image. The PSF is assumed to be space invariant and inferred separately in one framework or updated combining with sparse coefficients calculation in an alternative and iterative algorithm in the other framework. The experiment has evaluated three types of blur, naming defocus blur, simple motion blur and camera shake blur. The experiment results confirm the effectiveness of the proposed frameworks.

Single Image Super-Resolution via Sparse Representation in Gradient Domain

Guangling Sun, Chuan Qin

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Image super-resolution (SR) reconstruction is one of the most popular research topics in image processing for decades. This paper presents a novel approach to deal with single image SR problem. We search a mapping between a pair of low-resolution and high-resolution image patch in gradient domain by learning a generic image database and the input image itself. Given low-resolution image, the high-resolution image is reconstructed using sparse representation in gradient domain and solving Poisson equation. Experiments demonstrate that the state-of-the-art results have been achieved compared to other SR methods in terms of both PSNR and visual perception.

Vector Polygon Blind Watermarking Based on Canonical Correlation Analysis

Guangling Sun, Zhoubiao Shen, Huan Chen

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

A vector polygon blind watermarking algorithm based on canonical correlation analysis (CCA) is proposed for protecting the copyright of vector polygon. In embedding, vertices of a polygon are separated into two groups according to odd-even properties of their indexes. CCA is carried out on the two vertex groups to get canonical variables. The absolute value of canonical variables is proved to be affine invariant so that it is called affine invariant descriptor. The watermark is embedded into the magnitude of Fourier descriptors of affine invariant descriptors. In detection, affine invariant descriptors are obtained through a same process as embedding. The correlation between magnitude of the Fourier descriptors of affine invariant descriptors and the watermark is calculated. The watermark can be detected by comparing the correlation to a pre-selected threshold. The algorithm is blind as…

KRT-FUAP: Key Regions Tuned via Flow Field for Facial Universal Adversarial Perturbation

Xi Jin, Yong Liu, Guangling Sun +3 more

Artificial Intelligence · Applied Sciences · · cited 1× · DOI ↗ · more like this ·

It has been established that convolutional neural networks are susceptible to elaborate tiny universal adversarial perturbations (UAPs) in natural image classification tasks. However, UAP attacks against face recognition systems have not been fully explored. This paper proposes a spatial perturbation method that generates UAPs with local stealthiness by learning variable flow field to fine-tune facial key regions (KRT-FUAP). We ensure that the generated adversarial perturbations are positioned within reasonable regions of the face by designing a mask specifically tailored to facial key regions. In addition, we pay special attention to improving the effectiveness of the attack while maintaining the stealthiness of the perturbation and achieve the dual optimization of aggressiveness and stealthiness by accurately controlling the balance between adversarial loss and stealthiness loss.…

Increasing depth, distribution distillation, and model soup: erasing backdoor triggers for deep neural networks

Yijian Zhang, Tianxing Zhang, Qi Liu +2 more

Artificial Intelligence · Journal of Electronic Imaging · · cited 1× · DOI ↗ · more like this ·

Deep neural networks are vulnerable to backdoor attacks, in which the adversary injects a trigger embedded set into the training process. Inputs marked with the trigger provide incorrect predictions, whereas clean inputs remain unaffected. To erase the latent triggers in models, increasing depth, distribution distillation, and model soup (ID3MS), a defensive solution that operates without prior knowledge of triggers and relies on a small clean set is introduced. The depth of the backdoor model is increased by adding fully connected layer(s) at the penultimate layer. Without a classification layer, the original backdoor and increased depth models are considered as teacher and student, respectively. The student model applies distribution distillation to refit the distribution of the clean set and erase the backdoor triggers. The distilled student model is then recovered with the…

Robust degraded face recognition with novel face representation and multiscale fusion

Guangling Sun, Xinpeng Zhang, Guoqing Li +1 more

Computer Vision and Pattern Recognition · Optical Engineering · · cited 1× · DOI ↗ · more like this ·

Recognizing degraded faces from low-resolution and blurry images is a common yet challenging task. We propose appealing solutions to this problem without any image reconstruction, without any limitation to blur type, and only using high-quality samples to design a classifier. Short-term Fourier transform (STFT) is an effective and concise transform for face recognition, yet its effectiveness depends on two important issues: one is face representation construction from STFT; the other is a scale-named window size of STFT. To deal with the first issue, we explore the increased discrimination brought by joint coding and using multiple frequency combinations. Specifically, we propose a novel local descriptor in which information of a pixel coming from two frequencies is jointly encoded and multiple two-frequency combinations are jointly utilized so as to construct a more descriptive and…