arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Baoping Cheng

25 papers · 2019–2026

2019: 12020: 02021: 02022: 32023: 52024: 72025: 42026: 5
2019peak 7 in 20242026

Frequent co-authors

Papers

showing 1–25 of 25 RSS

Skeleton Based Fall Detection with Convolutional Neural Network

Jun Wu, Ke Wang, Baoping Cheng +3 more

Computer Vision and Pattern Recognition · · cited 11× · DOI ↗ · more like this ·

There are more and more elderly people living alone in the society today, and the supervision of the elderly has become a social problem. In order to enable elderly people living alone to be found at home when they fall, minimize the damage to them. We propose a skeleton-based real-time fall detection system. Firstly, we encode the sequence of motions into an RGB image and retain the original spatial structure information and temporal dynamic information. Then, we designed a lightweight convolutional neural network (CNN) to recognize the encoded image. We collected a fall dataset and merged it with the MSRDaily Activity3D dataset. We use two data enhancement methods to extend the dataset. The results of our model on the test set show that the recall is 93.9% and the accuracy is 93.75%. Finally, we also propose an online detection algorithm. The experimental results show that the recall…

Learn2Talk: 3D Talking Face Learns from 2D Talking Face

Yixiang Zhuang, Baoping Cheng, Yao Cheng +6 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Speech-driven facial animation methods usually contain two main classes, 3D and 2D talking face, both of which attract considerable research attention in recent years. However, to the best of our knowledge, the research on 3D talking face does not go deeper as 2D talking face, in the aspect of lip-synchronization (lip-sync) and speech perception. To mind the gap between the two sub-fields, we propose a learning framework named Learn2Talk, which can construct a better 3D talking face network by exploiting two expertise points from the field of 2D talking face. Firstly, inspired by the audio-video sync network, a 3D sync-lip expert model is devised for the pursuit of lip-sync between audio and 3D facial motion. Secondly, a teacher model selected from 2D talking face methods is used to guide the training of the audio-to-3D motions regression network to yield more 3D vertex accuracy.…

Fast Versatile Video Coding (VVC) Intra Coding for Power-Constrained Applications

Lei Chen, Baoping Cheng, Haotian Zhu +3 more

Signal Processing · Electronics · · cited 6× · DOI ↗ · more like this ·

Versatile Video Coding (VVC) achieves impressive coding gain improvement (about 40%+) over the preceding High-Efficiency Video Coding (HEVC) technology at the cost of extremely high computational complexity. Such an extremely high complexity increase is a great challenge for power-constrained applications, such as Internet of video things. In the case of intra coding, VVC utilizes the brute-force recursive search for both the partition structure of the coding unit (CU), which is based on the quadtree with nested multi-type tree (QTMT), and 67 intra prediction modes, compared to 35 in HEVC. As a result, we offer optimization strategies for CU partition decision and intra coding modes to lessen the computational overhead. Regarding the high complexity of the CU partition process, first, CUs are categorized as simple, fuzzy, and complex based on their texture characteristics. Then, we…

MIMO-Uformer: A Transformer-Based Image Deblurring Network for Vehicle Surveillance Scenarios

Jian Zhang, Baoping Cheng, Tengying Zhang +4 more

Computer Vision and Pattern Recognition · Journal of Imaging · · cited 4× · DOI ↗ · more like this ·

Motion blur is a common problem in the field of surveillance scenarios, and it obstructs the acquisition of valuable information. Thanks to the success of deep learning, a sequence of CNN-based architecture has been designed for image deblurring and has made great progress. As another type of neural network, transformers have exhibited powerful deep representation learning and impressive performance based on high-level vision tasks. Transformer-based networks leverage self-attention to capture the long-range dependencies in the data, yet the computational complexity is quadratic to the spatial resolution, which makes transformers infeasible for the restoration of high-resolution images. In this article, we propose an efficient transformer-based deblurring network, named MIMO-Uformer, for vehicle-surveillance scenarios. The distinct feature of the MIMO-Uformer is that the…

Image Deblurring based on a U-shaped Network for Vehicle Surveillance Scenarios

Jian Zhang, Baoping Cheng, Jun Lei +4 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Motion blur is a common problem in the field of surveillance scenarios, and obstructs the acquisition of valuable information. With the development of deep learning (DL) technologies, a series of CNN-based methods have been developed for image deblurring and achieved significant improvement. However, most existing deblurring methods aim to handle the global blur while in practical local blur is more common. For example, the motion blur is caused by local moving vehicles and the performances of the current methods are poor in the vehicle surveillance scenarios. Based on this observation, this paper proposes a deblurring method, called DeVeh, for the vehicle surveillance scenarios. The architecture of the proposed method is mainly based on a U-shaped network (UNet), and applies an Intersection over Patch (IoP) factor and a supervised morphological loss to improve the performance on the…

Few-shot Semantic Encoding and Decoding for Video Surveillance

Baoping Cheng, Yukun Zhang, Liming Wang +4 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

With the continuous increase in the number and resolution of video surveillance cameras, the burden of transmitting and storing surveillance video is growing. Traditional communication methods based on Shannon's theory are facing optimization bottlenecks. Semantic communication, as an emerging communication method, is expected to break through this bottleneck and reduce the storage and transmission consumption of video. Existing semantic decoding methods often require many samples to train the neural network for each scene, which is time-consuming and labor-intensive. In this study, a semantic encoding and decoding method for surveillance video is proposed. First, the sketch was extracted as semantic information, and a sketch compression method was proposed to reduce the bit rate of semantic information. Then, an image translation network was proposed to translate the sketch into a…

Joint Optimization of Buffer Delay and HARQ for Video Communications

Baoping Cheng, Peng Lei, Xiaoyan Xie +3 more

cs.MM · · cited 1× · arXiv ↗ · more like this ·

To improve the quality of experience (QoE) in video communication over lossy networks, this paper presents a transmission method that jointly optimizes buffer delay and Hybrid Automatic Repeat request (HARQ), referred to as BD-HARQ. This method operates on packet group and employs dynamic buffer delay combined with HARQ strategy for transmission. By defining the QoE based on metrics such as buffer delay, Forward Error Correction (FEC) redundancy, and data recovery rate, the proposed method derives its closed-form expression through rigorous mathematical modeling and analysis. The optimal transmission parameters, i.e., the buffer delay and the FEC redundancy, are then determined and implemented, guaranteeing the real-time performance, transmission efficiency, and data recovery rate of video communication. Experimental results demonstrate that the proposed method aligns well with its…

A Simple Fusion of Self-Attention and BERT for Aspect-Level Sentiment Classification

Shaoshuai Lu, Junjie Zhao, Xinxing Cao +2 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Aspect-level sentiment classification is aimed to identify the sentiment polarity of a user with respect to certain aspects (features) of a product, and fine-grained sentiment judgements can provide more accurate recommendation results for a wide range of users. Existing deep learning methods have achieved good performance on aspect-level sentiment classification tasks. However, some approaches ignore the modelling of comment semantics or key aspect terms, resulting in ineffective integration of the overall semantics of user comments and the specific sentiment attributes of aspect terms. In this paper, we propose a novel aspect-level sentiment classification approach which uses the pre-trained model to learn high-level semantic features of the input text, employing the self-attention mechanism to capture aspect word feature representations of text sequences. Meanwhile, we introduce…

Prompt Learning for Subjective and Objective Recognition of Text

Baoping Cheng, Shaoshuai Lu, Yiping Duan +2 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Subjective expressions generally contain the user's emotional opinions and thus can better represent the sentiment information of the originating text reviews, while objective descriptions usually appear in declarative sentences that do not reflect the sentiment polarity of the comment text. Therefore, subjective and objective recognition techniques for text are necessary for natural language processing tasks (e.g. opinion mining, sentiment analysis). However, most existing deep learning-based methods need large human-annotated data, but labeling large amounts of high-quality emotional texts is labor-intensive. The lack of labeled data has become a bottleneck restricting the deep algorithm. To cope with the shortage of labeled data, we employ Prompt Learning strategy in Subjective and Objective recognition task of text, thus proposing a simple PLSO method. PLSO can effectively inherit…

A multi-object tracking algorithm based on YOLOv5-concise network

Baoping Cheng, Yan Huang, Xiaoyan Xie +1 more

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

As the basis of pedestrian and traffic statistics, multi-object tracking (MOT) is widely used in smart cities and smart shops. Due to the high cost of cloud analysis, MOT algorithm is mainly deployed on the end-side device. However, limited by computing resources and capital cost, it is difficult to deploy large models in end-side device. As tracking based on detection has become the most effective MOT method, a lightweight detection network model YOLOv5- Concise with only 0.302M parameters is proposed for end-side deployment in this paper. Then, the application of knowledge distillation technology based on outputs and feature relation in object detection is studied. By knowledge distillation, the YOLOv5-Concise model's detection precision mAP0.5 is increased by 7.26%, mAP0.5:0.95 is increased by 16%, and the detection speed remained unchanged. Finally, on the camera equipped with T40…

Interference Identification Based on China Mobile Current Network Data

Bingrui Geng, Baoping Cheng, Lei Zhang +4 more

Artificial Intelligence · 2022 IEEE 96th Vehicular Technology Conference (VTC2022-Fall) · · cited 1× · DOI ↗ · more like this ·

Since the 4G standard TD-LTE commercialization, TD-LTE network has entered a stage of steady development, with huge network scale and complex system deployment. Therefore, the network interference problem faced by the system becomes more and more serious, which seriously affects the objective quality of the network and the quality of service to users. The common inter-network interference includes stray interference, blocking interference, jammer interference and intermodulation interference. In addition, the communication base station and terminal in the system may cause serious intra-network interference problems including ultra-distant interference, clock out-of-synchronization interference, signal amplifier/repeater interference and physical uplink control channel interference and physical uplink shared channel. Interference type identification is an important task in network…

Mobile Embodied Agent Network (MEAN): Integrated Framework, Enabling Technologies, and Task-Driven Deployment

Zhaoyang Zhang, Lingxiao Sun, Weijie Zhou +8 more

cs.NI · · cited 0× · arXiv ↗ · more like this ·

Mobile networks are evolving from human-centered, data-oriented communication infrastructures toward machine- and/or agent-dominant, task-oriented platforms that are to serve the rapidly increasing networked machines and embodied agents. In order to fulfill the newly arose complex task objectives, the framework of future mobile network is to be innovated to reflect and facilitate the intrinsic interplay and integration of the underlying processes of perception, communication, computation, decision, action, and feedback, etc. This survey establishes the mobile embodied agent network (MEAN) as a task-oriented networking paradigm in which networking and distributed intelligence are jointly organized around closed-loop embodied task execution. We first establish a unified MEAN framework that explains how network resources and intelligent functions jointly support embodied task execution…

Online Evolution Strategy for Flow-Matching VLA Policies via Self-Supervised Trajectory Distribution Optimization

Gongxin Yao, Yongsheng Zhao, Jiayin Deng +4 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Vision-Language-Action (VLA) models based on generative frameworks, such as Flow Matching, have recently achieved impressive performance in robotic manipulation. Unlike deterministic policies, Flow Matching enables VLA models to learn conditional action trajectory distributions, where latent noise vectors induce different actions under the same task scenario. However, we observe that these distributions are often ill-formed, with successful and failed behaviors coexisting while considerable probability mass remains in unfavorable regions. To this end, we propose Online-ES, an online adaptation framework for Flow Matching VLAs based on Evolution Strategy (ES), which refines the learned action trajectory distribution through interaction feedback. Instead of pruning the latent noise space, our method performs evolutionary exploration directly in the action trajectory space, where diverse…

TAO-DA: Towards Autonomous Operation--A Dual-Arm Vision-Language-Action Model for Coordinated Manipulation

Yongsheng Zhao, Han Gao, Baoping Cheng +7 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Vision-Language-Action (VLA) models provide a unified framework for grounding high-level semantic information into low-level robot actions, enabling scalable robotic manipulation across diverse tasks. However, existing VLA models lack explicit mechanisms to disentangle the states and intents of the two arms, leading to unintended cross-arm interference that degrades task execution success. To address this issue, we propose a symmetric Dual-Arm Expert (DAE) architecture built upon a shared Vision-Language Model (VLM) backbone with decoupled, arm-specific expert towers. Expert selection is carried out through a two-stage dual-arm intent routing scheme, in which experts are routed either by explicit language instructions in the first stage or by implicit visual semantics in the second stage. Moreover, we introduce a lightweight task progress prediction module that leverages cross-attention…

TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulation

Bohan Gan, Xuanzhang Wen, Yongsheng Zhao +8 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Vision-Language-Action (VLA) models have demonstrated strong performance across diverse robotic manipulation tasks, yet their predominantly vision-centric perception and position-controlled execution remain insufficient for contact-rich manipulation. Visual observations alone often provide limited evidence of contact onset and interaction magnitude, while position-control policies cannot respond compliantly to rapidly changing contact dynamics. To bridge both the perception and control gaps, we propose TAO-Force, a force-conditioned VLA framework that combines force-aware policy learning with contact-regulated execution. For force-aware perception, TAO-Force introduces Force-conditioned Feature-wise Linear Modulation (F-FiLM) to inject encoded force feedback into the representations of a frozen pretrained visual-language backbone while preserving its semantic priors. For responsive…

FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer

Chengyang Li, Baoping Cheng, Yao Cheng +5 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Recent facial texture generation methods prefer to use deep networks to synthesize image content and then fill in the UV map, thus generating a compelling full texture from a single image. Nevertheless, the synthesized texture UV map usually comes from a space constructed by the training data or the 2D face generator, which limits the methods' generalization ability for in-the-wild input images. Consequently, their facial details, structures and identity may not be consistent with the input. In this paper, we address this issue by proposing a style transfer-based facial texture refinement method named FaceRefiner. FaceRefiner treats the 3D sampled texture as style and the output of a texture generation method as content. The photo-realistic style is then expected to be transferred from the style image to the content image. Different from current style transfer methods that only transfer…

Robust prototype-based semantic segmentation with weak supervision

Hongchun Sun, Baoping Cheng

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Weakly supervised semantic segmentation (WSSS) faces challenges in generating reliable pseudo masks from image-level labels due to limited spatial supervision. While prototype-based contrastive learning (PCL) improves class activation maps (CAMs), existing methods struggle with background-foreground ambiguity and incomplete object activation. We propose EPCL, which addresses these issues through two key innovations: (1) a class-background(CB)contrast to better discriminate hard background semantics, and (2) an inter-class (IC) contrast sampling strategy that enhances object region activation. EPCL is architecture-agnostic and integrates into various WSSS baselines. Experiments on two segmentation benchmarks show EPCL outperforms existing methods across different WSSS settings.

Priority-Aware Multi-Layer Transmission in Video Semantic Communications

Peng Lei, Baoping Cheng, Tao Fu +5 more

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

This paper proposes a priority-aware multi-layer transmission framework to enhance the Quality of Experience (QoE) for video semantic communications over lossy networks. Specifically, the framework employs a dynamic resource allocation strategy that prioritizes video data according to their semantic importance and jointly optimizes redundancy and buffer delay across multiple priority layers. The key contributions are twofold: (1) a novel QoE model that accurately quantifies the differential impacts of semantic data at multiple priority levels on perceptual quality, enabling a more nuanced evaluation of user experience; (2) a cross-layer optimization approach that systematically derives optimal transmission parameters tailored for each semantic priority, thus significantly improving overall system performance. Theoretical analysis demonstrates that the proposed multi-layer framework…

Semantic Encoding and Decoding for Talking Head Transmission

Baoping Cheng, Yukun Zhang, Yu He +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Semantic communication focuses on transmitting only information of interest instead of raw data. It holds the potential to overcome the limitations of traditional communication methods. A critical aspect of semantic communication is semantic encoding and decoding, which deals with information compression and reconstruction. Existing key point-based talking head encoding and decoding methods encounter challenges when dealing with large changes in the pose of a human face. In this study, a semantic encoding and decoding method was proposed. Firstly, a sketch-based semantic decoding method based on generative adversarial networks was proposed. Secondly, a structure similarity loss was proposed to further enhance the performance of the sketch decoding performance. Finally, two pose adaptive semantic encoding and decoding methods were proposed to adaptively combine two modalities of semantic…

Perceptual point cloud quality assessment for immersive metaverse experience

Baoping Cheng, Lei Luo, Ziyang He +2 more

Human-Computer Interaction · Digital Communications and Networks · · cited 0× · DOI ↗ · more like this ·

Perceptual quality assessment for point cloud is critical for immersive metaverse experience and is a challenging task. Firstly, because point cloud is formed by unstructured 3D points that makes the topology more complex. Second, the quality impairment generally involves both geometric attributes and color properties, where the measurement of the geometric distortion becomes more complex. We proposed a perceptual point cloud quality assessment model that follows the perceptual features of Human Visual System (HVS) and the intrinsic characteristics of the point cloud. The point cloud is first pre-processed to extract the geometric skeleton keypoints with graph filtering-based re-sampling, and local neighboring regions around the geometric skeleton keypoints are constructed by K-Nearest Neighbors (KNN) clustering. For geometric distortion, the Point Feature Histogram (PFH) is extracted…

DNPM: A Neural Parametric Model for the Synthesis of Facial Geometric Details

Haitao Cao, Baoping Cheng, Qiran Pu +6 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Parametric 3D models have enabled a wide variety of computer vision and graphics tasks, such as modeling human faces, bodies and hands. In 3D face modeling, 3DMM is the most widely used parametric model, but can't generate fine geometric details solely from identity and expression inputs. To tackle this limitation, we propose a neural parametric model named DNPM for the facial geometric details, which utilizes deep neural network to extract latent codes from facial displacement maps encoding details and wrinkles. Built upon DNPM, a novel 3DMM named Detailed3DMM is proposed, which augments traditional 3DMMs by including the synthesis of facial details only from the identity and expression inputs. Moreover, we show that DNPM and Detailed3DMM can facilitate two downstream applications: speech-driven detailed 3D facial animation and 3D face reconstruction from a degraded image. Extensive…

An Efficient Phone Number Multiplexing Method Based on IMS

Baoping Cheng, Jiaying Chen, Yemeng Zhang +4 more

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

IMS(IP Multimedia Subsystem) has been established and applied to 4G mobile communication for more than 10 years. With the rapid development of 5G and intelligent terminal industries, IMS gets new opportunities. However, limited phone number resources are difficult to meet the needs of massive devices. Due to the complexity of the call network, simple multiplexing of phone number may result in potential call loss. In this paper, a dynamic allocation method of phone number that reduces loss probability is proposed. It simulates the real scenario to establish a call model, and minimizes the loss probability under limited phone numbers, which accelerates the development of IMS in the Internet of Things(IoT).

Research on Real-Time Pedestrian Detection Based on Infrared-Visible Image Fusion

Ziqin Shang, Baoping Cheng, Xiaoyan Xie +2 more

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

With the advancement of AI technology and hardware, intelligent surveillance systems are becoming increasingly widespread, bringing more and more complex application scenes. Pedestrian detection, as one of the tasks within such systems, faces more challenges consequently. Current pedestrian detection methods primarily rely on visiblelight modality, limiting their performance and robustness. Introducing an additional modality, such as infrared, to improve performance imposes higher demands on platforms and resources. Therefore, multi-spectral image fusion emerges as a promising technique to enhance pedestrian detection. This paper proposes a pedestrian detection framework based on infrared-visible light image fusion. Additionally, three fusion methods are employed and compared against single-spectral results using existing detection models, which validate the potential for improving…

A Hybrid-ARQ Method with Adaptive Receiving Buffer Duration in Real Time Video Streaming

Baoping Cheng, Xiaoming Tao, Peng Lei +3 more

Computer Vision and Pattern Recognition · Journal of Physics Conference Series · · cited 0× · DOI ↗ · more like this ·

Abstract To decrease end-to-end delay for streaming media over internet, the transmission method based on best-effort model is always employed in Real Time Communication (RTC) system. However, the packet-loss, jitter and congestion occur frequently because the quality of transmission cannot be guaranteed, which causes lag and splash of video. Therefore, an optimized hybrid Automatic Repeat Query (ARQ) solution with adaptive receiving buffer duration is proposed to guarantee the quality of video transmission. In the method, the loss rate was used to adjust the buffer duration and calculate the redundancy for Forward Error Correction (FEC). The results show that the method in this paper gains lower end-to-end delay and better Mean Opinion Score (MOS) values while ensuring higher fluency in weak network scenarios.

VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robots

Yongsheng Zhao, Lei Zhao, Baoping Cheng +3 more

cs.RO · · arXiv ↗ · more like this ·

Vision-Language-Action (VLA) models have achieved remarkable breakthroughs in robotics, with the action chunk playing a dominant role in these advances. Given the real-time and continuous nature of robotic motion control, the strategies for fusing a queue of successive action chunks have a profound impact on the overall performance of VLA models. Existing methods suffer from jitter, stalling, or even pauses in robotic action execution, which not only limits the achievable execution speed but also reduces the overall success rate of task completion. This paper introduces VLA-RAIL (A Real-Time Asynchronous Inference Linker), a novel framework designed to address these issues by conducting model inference and robot motion control asynchronously and guaranteeing smooth, continuous, and high-speed action execution. The core contributions of the paper are two fold: a Trajectory Smoother that…