Author

Shuangming Yu

10 papers · 2020–2025

2020peak 4 in 20212025

Frequent co-authors

Papers

showing 1–10 of 10 RSS

Exploring Structural Sparsity in CNN via Selective Penalty

Mingxin Zhao, Junbo Peng, Shuangming Yu +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · 7 Apr 2021 · cited 27× · DOI ↗ · more like this ·

Although massive pruning methods are emerging for achieving structural sparsity in convolutional neural networks (CNN), most of them target structures such as ResNet. Meanwhile, previous works take more interest in pruning filters inside a residual block and keep the shortcut connection intact, leading to an imbalanced network structure. In this paper, we focus on the penalty-based method to prune already compact networks. In contrast to the broadly used <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$L_{1}$ </tex-math></inline-formula> constraint, which shrinks the parameters uniformly, we propose a novel penalty term that is similar in shape to an upside-down Laplace distribution. The penalty allows us to impose more pressure on potential weak channels but protects others during training to avoid…

A Compact High-Quality Image Demosaicking Neural Network for Edge-Computing Devices

Shuyu Wang, Mingxin Zhao, Runjiang Dou +3 more

Computer Vision and Pattern Recognition · Sensors · 8 May 2021 · cited 20× · DOI ↗ · more like this ·

Image demosaicking has been an essential and challenging problem among the most crucial steps of image processing behind image sensors. Due to the rapid development of intelligent processors based on deep learning, several demosaicking methods based on a convolutional neural network (CNN) have been proposed. However, it is difficult for their networks to run in real-time on edge computing devices with a large number of model parameters. This paper presents a compact demosaicking neural network based on the UNet++ structure. The network inserts densely connected layer blocks and adopts Gaussian smoothing layers instead of down-sampling operations before the backbone network. The densely connected blocks can extract mosaic image features efficiently by utilizing the correlation between feature maps. Furthermore, the block adopts depthwise separable convolutions to reduce the model…

Quantizing Oriented Object Detection Network via Outlier-Aware Quantization and IoU Approximation

Mingxin Zhao, Ke Ning, Shuangming Yu +2 more

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · 2020 · cited 16× · DOI ↗ · more like this ·

In recent years, a large number of quantization schemes have been proposed for compressing convolutional neural networks (CNN). However, most of them have the following problems: 1) when there are outliers in the weight, post-training quantization cannot obtain the ideal effect, and the accuracy loss is unavoidable; 2) quantizing the non-maximum suppression (NMS) stage of oriented object detection networks is non-trivial so that such networks are difficult to deploy on edge computing devices that only support integer operations. In this letter, we propose the outlier-aware quantization (OAQ) to boost the robustness of the post-training quantization method. Besides, we design a multilayer perceptron network to approximate the intersection-over-union (IoU) of rotated boxes, making the NMS stage can be deployed on integer-arithmetic-only devices. The experiment results demonstrate that our…

A High-Speed NMS Coprocessor for Lightweight Ship Detection Algorithm

Ke Ning, Mingxin Zhao, Chunhe Yao +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits & Systems II Express Briefs · 4 Nov 2021 · cited 9× · DOI ↗ · more like this ·

With the development of artificial intelligence research, the convolutional neural networks (CNN) triumphantly continue to conquer diverse visual tasks, with lots of technical and practical problems emerging. When the detection networks need to meet the high-speed processing requirement and the low power consumption constraint in edge computing, dedicated circuits and algorithm optimization are necessary. In this brief, we propose a non-maximum suppression (NMS) coprocessor that cooperated with a Vision Processor (VP) to speed up the detection. It contains a parallel process unit and dynamic memory management to accelerate NMS processing. Meanwhile, the software workflow provides a comprehensive method to convert the one-stage detection network to our processor in a post-training manner. The experimental results show that our co-design solution reaches 166 FPS to run a MobileNet-SSD…

SiamMixer: A Lightweight and Hardware-Friendly Visual Object-Tracking Network

Cheng Li, Xuemin Zheng, Mingxin Zhao +4 more

Computer Vision and Pattern Recognition · Sensors · 18 Feb 2022 · cited 6× · DOI ↗ · more like this ·

Siamese networks have been extensively studied in recent years. Most of the previous research focuses on improving accuracy, while merely a few recognize the necessity of reducing parameter redundancy and computation load. Even less work has been done to optimize the runtime memory cost when designing networks, making the Siamese-network-based tracker difficult to deploy on edge devices. In this paper, we present SiamMixer, a lightweight and hardware-friendly visual object-tracking network. It uses patch-by-patch inference to reduce memory use in shallow layers, where each small image region is processed individually. It merges and globally encodes feature maps in deep layers to enhance accuracy. Benefiting from these techniques, SiamMixer demonstrates a comparable accuracy to other large trackers with only 286 kB parameters and 196 kB extra memory use for feature maps. Additionally, we…

Rounding Shift Channel Post- Training Quantization using Layer Search

Mengmeng Xu, Mingxin Zhao, Shuangming Yu +3 more

Computer Vision and Pattern Recognition · 28 May 2021 · cited 3× · DOI ↗ · more like this ·

Quantization inference has been ubiquitously utilized in edge computing devices, enabling numerous neural networks' efficient deployment. However, the existing methods generally concentrate on classical network structures like VGG-16 and ResNet, ignoring the emerging compact networks such as MobileNets. Specifically, these networks with lightweight architectures have fewer parameters; thereby, less redundancy can be exploited in the quantization stage, which often incurs intolerable accuracy degradations. To handle these problems, we propose a novel Rounding Shift Channel (RSC) post-training quantization method using layer search. We alleviate the accuracy degradation via channel-wise scaling by minimizing a layer-wise reconstruction quantization error. Furthermore, we design a rounding-shift operation to correct biased inference, which has not been explored in previous…

ISQ: Intermediate-Value Slip Quantization for Accumulator-Aware Training

Chi Zhang, Xu Yang, Shuangming Yu +2 more

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · 2025 · cited 2× · DOI ↗ · more like this ·

The development of lightweight technologies has made deploying convolutional neural networks on edge devices popular. However, the overflow caused by low-bit accumulators significantly degrades the accuracy of the model. Therefore, there is a challenge in balancing accuracy and low-bit accumulators. In this letter, we propose a novel method applying for training low-bit quantized neural network named Intermediate-Value Slip Quantization (ISQ). ISQ is used to constrain weights to decrease the risk of accumulator's overflow. Besides, we also set a criterion for ISQ to be aware of the bit width of the accumulator. In addition, we propose a method to integrate bias and Batch Normalization (BN) into the ISQ. This allows the computations to be shifted from the floating-point domain to the fixed-point. The experiment results demonstrate that ISQ effectively suppresses the overflow. The model…

RSDB-Net: A Novel Rotation-Sensitive Dual-Branch Network with Enhanced Local Features for Remote Sensing Ship Detection

Danshu Zhou, Y. Xiong, Shuangming Yu +5 more

Computer Vision and Pattern Recognition · Remote Sensing · 4 Dec 2025 · cited 1× · DOI ↗ · more like this ·

Ship detection in remote sensing imagery is hindered by cluttered backgrounds, large variations in scale, and random orientations, limiting the performance of detectors designed for natural images. We propose RSDB-Net, a Rotation-Sensitive Dual-Branch Detection Network that introduces innovations in feature extraction, fusion, and detection. The Swin Transformer–CNN Backbone (STCBackbone) combines a Swin Transformer for global semantics with a CNN branch for local spatial detail, while the Feature Conversion and Coupling Module (FCCM) aligns and fuses heterogeneous features to handle multi-scale objects, and a Rotation-sensitive Cross-branch Fusion Head (RCFHead) enables bidirectional interaction between classification and localization, improving detection of randomly oriented targets. Additionally, an enhanced Feature Pyramid Network (eFPN) with learnable transposed convolutions…

A High-Speed Parallel FPGA Implementation of Harris Corner Detection

Hongtao Zhou, Runjiang Dou, Shuangming Yu +4 more

Computer Vision and Pattern Recognition · 23 Nov 2020 · cited 1× · DOI ↗ · more like this ·

Harris corner detection is a common operation in the field of image processing, but suffering from computation complexity in embedded system. The current method of corner detection is to process one pixel in one clock cycle. With the improvement of image acquisition method in modern society, higher processing speed requirements have been proposed for the implementation of corner detection. This paper presents a new pixel-level parallelism FPGA implementation for Harris corner detection, which double the processing speed or more with almost no decreasing in accuracy. It is implemented on FPGA in the high-speed camera, and the experimental results show that the implementation is suitable for real-time applications.

A Conv‐GEMM reconfigurable accelerator with WS‐RS dataflow for high throughput processing

Feihu Wang, Chi Zhang, Yong-Chao Deng +5 more

Computer Vision and Pattern Recognition · Electronics Letters · February 2024 · cited 0× · DOI ↗ · more like this ·

Abstract Convolution and matrix operations are both important computations in Deep Neural Networks (DNNs). However, the significant differences between convolution and matrix computation patterns have posed a challenge in efficiently supporting both convolution (Conv) and general matrix multiplication (GEMM) on hardware design. This paper proposes a Conv‐GEMM reconfigurable accelerator architecture for high throughput edge processing. A weight stationary‐row streaming (WS‐RS) dataflow scheme is proposed, which maximizes data reuse through hierarchical memory structures and flexible PE connections, and supports high throughput edge‐based deep learning algorithms. Based on the proposed dataflow, multi‐scale memory access network (MMAN), reconfigurable accumulator array (RAA), and configurable instruction set architecture (ISA) are designed to optimize computation throughput and energy…