arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Runwei Guan

60 papers · 2021–2026

2021: 12022: 12023: 102024: 92025: 192026: 20
2021peak 20 in 20262026

Frequent co-authors

Papers

showing 1–25 of 60 RSS

Mask-VRDet: A robust riverway panoptic perception model based on dual graph fusion of vision and 4D mmWave radar

Runwei Guan, Shanliang Yao, Lulu Liu +8 more

Computer Vision and Pattern Recognition · Robotics and Autonomous Systems · · cited 18× · DOI ↗ · more like this ·

With the development of Unmanned Surface Vehicles (USVs), the perception of inland waterways has become significant to autonomous navigation . RGB cameras can capture images with rich semantic features, but they would fail in adverse weather and at night. As a perception sensor that has initially emerged in recent years, 4D millimeter-wave radar (4D mmWave radar) can work in all weather and has more abundant point-cloud features than ordinary radar, but it also suffers from water-surface clutter seriously. Furthermore, the shape and outline of dense point cloud captured by 4D mmWave radar are irregular. CNN-based neural networks treat features as 2D rectangle grids, which excessively favor image modality and are unfriendly to radar modality. Therefore, we transform both features of image and radar into non-Euclidean space as graph structures. In this paper, we focus on robust panoptic…

ASY-VRNet: Waterway Panoptic Driving Perception Model based on Asymmetric Fair Fusion of Vision and 4D mmWave Radar

Runwei Guan, Shanliang Yao, Xiaohui Zhu +5 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Panoptic Driving Perception (PDP) is critical for the autonomous navigation of Unmanned Surface Vehicles (USVs). A PDP model typically integrates multiple tasks, necessitating the simultaneous and robust execution of various perception tasks to facilitate downstream path planning. The fusion of visual and radar sensors is currently acknowledged as a robust and cost-effective approach. However, most existing research has primarily focused on fusing visual and radar features dedicated to object detection or utilizing a shared feature space for multiple tasks, neglecting the individual representation differences between various tasks. To address this gap, we propose a pair of Asymmetric Fair Fusion (AFF) modules with favorable explainability designed to efficiently interact with independent features from both visual and radar modalities, tailored to the specific requirements of object…

FindVehicle and VehicleFinder: A NER dataset for natural language-based vehicle retrieval and a keyword-based cross-modal vehicle retrieval system

Runwei Guan, Ka Lok Man, Feifan Chen +6 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

Natural language (NL) based vehicle retrieval is a task aiming to retrieve a vehicle that is most consistent with a given NL query from among all candidate vehicles. Because NL query can be easily obtained, such a task has a promising prospect in building an interactive intelligent traffic system (ITS). Current solutions mainly focus on extracting both text and image features and mapping them to the same latent space to compare the similarity. However, existing methods usually use dependency analysis or semantic role-labelling techniques to find keywords related to vehicle attributes. These techniques may require a lot of pre-processing and post-processing work, and also suffer from extracting the wrong keyword when the NL query is complex. To tackle these problems and simplify, we borrow the idea from named entity recognition (NER) and construct FindVehicle, a NER dataset in the…

WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfaces

Shanliang Yao, Runwei Guan, Zhaodong Wu +11 more

cs.CV · · cited 5× · arXiv ↗ · more like this ·

Autonomous driving on water surfaces plays an essential role in executing hazardous and time-consuming missions, such as maritime surveillance, survivors rescue, environmental monitoring, hydrography mapping and waste cleaning. This work presents WaterScenes, the first multi-task 4D radar-camera fusion dataset for autonomous driving on water surfaces. Equipped with a 4D radar and a monocular camera, our Unmanned Surface Vehicle (USV) proffers all-weather solutions for discerning object-related information, including color, shape, texture, range, velocity, azimuth, and elevation. Focusing on typical static and dynamic objects on water surfaces, we label the camera images and radar point clouds at pixel-level and point-level, respectively. In addition to basic perception tasks, such as object detection, instance segmentation and semantic segmentation, we also provide annotations for…

PEPL: Precision-Enhanced Pseudo-Labeling for Fine-Grained Image Classification in Semi-Supervised Learning

Bowen Tian, Songning Lai, Lujundong Li +4 more

cs.CV · · cited 3× · arXiv ↗ · more like this ·

Fine-grained image classification has witnessed significant advancements with the advent of deep learning and computer vision technologies. However, the scarcity of detailed annotations remains a major challenge, especially in scenarios where obtaining high-quality labeled data is costly or time-consuming. To address this limitation, we introduce Precision-Enhanced Pseudo-Labeling(PEPL) approach specifically designed for fine-grained image classification within a semi-supervised learning framework. Our method leverages the abundance of unlabeled data by generating high-quality pseudo-labels that are progressively refined through two key phases: initial pseudo-label generation and semantic-mixed pseudo-label generation. These phases utilize Class Activation Maps (CAMs) to accurately estimate the semantic content and generate refined labels that capture the essential details necessary for…

Image Edge-Based CNN Architecture for Detecting Mosaic Augmentation in Datasets: A Novel Approach for Assuring Data Quality

Linxuan Biao, Runwei Guan, Jie Zhang +4 more

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

This research uncovers a pioneering method for distinguishing mosaic augmentation in datasets, an area yet to be thoroughly investigated. Utilizing conventional visual preprocessing tactics, such as Gaussian blurring and Canny Edge Detection, together with a Convolutional Neural Network (CNN), we develop a strategy for detecting mosaic enhancements in datasets. This methodology achieved an remarkable accuracy rate. A custom-created dataset was used to verify our proposed model, which exhibited outstanding precision in classification tasks, therefore showcasing its capacity to assess whether a dataset has been subjected to mosaic augmentation. Our technique offers substantial enhancements to dataset validation procedures, enhancing the accuracy and trustworthiness of ensuing data-centric models or systems. The paper elucidates our methodological underpinnings, detailing the…

Radarnext: lightweight and real-time 3D object detector based on 4D mmWave imaging radar

Liye Jia, Runwei Guan, Haocheng Zhao +5 more

Computer Vision and Pattern Recognition · EURASIP Journal on Advances in Signal Processing · · cited 2× · DOI ↗ · more like this ·

Three-dimensional (3D) object detection is essential for autonomous driving (AD) and advanced driver assistance systems (ADAS). However, most existing 3D object detection works primarily focus more on the detection accuracy than on the detection efficiency, although the latter is also a critical metric for practical applications. In this paper, we propose RadarNeXt, a lightweight and real-time 3D object detector based on 4D millimeter-wave (mmWave) radar point clouds. We introduce a re-parameterization mechanism in the feature extraction process to enhance inference efficiency while maintaining the multi-branch architecture’s capability to construct multi-scale features. Moreover, to emphasize the irregular foreground features of radar point clouds, and to suppress background clutter, we present a Multi-path Deformable Foreground Enhancement Network (MDFEN), ensuring high detection…

RoadSceneVQA: Benchmarking Visual Question Answering in Roadside Perception Systems for Intelligent Transportation System

Runwei Guan, Rongsheng Hu, Shangshu Chen +10 more

cs.CV · · cited 2× · arXiv ↗ · more like this ·

Current roadside perception systems mainly focus on instance-level perception, which fall short in enabling interaction via natural language and reasoning about traffic behaviors in context. To bridge this gap, we introduce RoadSceneVQA, a large-scale and richly annotated visual question answering (VQA) dataset specifically tailored for roadside scenarios. The dataset comprises 34,736 diverse QA pairs collected under varying weather, illumination, and traffic conditions, targeting not only object attributes but also the intent, legality, and interaction patterns of traffic participants. RoadSceneVQA challenges models to perform both explicit recognition and implicit commonsense reasoning, grounded in real-world traffic rules and contextual dependencies. To fully exploit the reasoning potential of Multi-modal Large Language Models (MLLMs), we further propose CogniAnchor Fusion (CAF), a…

Imperceptible Transfer Attack on Large Vision-Language Models

Xiaowen Cai, Daizong Liu, Runwei Guan +1 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

In spite of achieving significant progress in recent years, Large Vision-Language Models (LVLMs) are proven to be vulnerable to adversarial examples. Therefore, there is an urgent need for an effective adversarial attack to identify the deficiencies of LVLMs in security-sensitive applications. However, existing LVLM attackers generally optimize adversarial samples against a specific textual prompt with a certain LVLM model, tending to overfit the target prompt/network and hardly remain malicious once they are transferred to attack a different prompt/model. To this end, in this paper, we propose a novel Imperceptible Transfer Attack (ITA) against LVLMs to generate prompt/model-agnostic adversarial samples to enhance such adversarial transferability while further improving the imperceptibility. Specifically, we learn to apply appropriate visual transformations on image inputs to create…

OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filtering

Guanhua Ding, Yuxuan Xia, Runwei Guan +5 more

cs.CV · · cited 2× · arXiv ↗ · more like this ·

Accurate 3D multi-object tracking (MOT) is crucial for autonomous driving, as it enables robust perception, navigation, and planning in complex environments. While deep learning-based solutions have demonstrated impressive 3D MOT performance, model-based approaches remain appealing for their simplicity, interpretability, and data efficiency. Conventional model-based trackers typically rely on random vector-based Bayesian filters within the tracking-by-detection (TBD) framework but face limitations due to heuristic data association and track management schemes. In contrast, random finite set (RFS)-based Bayesian filtering handles object birth, survival, and death in a theoretically sound manner, facilitating interpretability and parameter tuning. In this paper, we present OptiPMB, a novel RFS-based 3D MOT method that employs an optimized Poisson multi-Bernoulli (PMB) filter while…

Da Yu: Towards USV-Based Image Captioning for Waterway Surveillance and Scene Understanding

Runwei Guan, Ningwei Ouyang, Tianhao Xu +10 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Automated waterway environment perception is crucial for enabling unmanned surface vessels (USVs) to understand their surroundings and make informed decisions. Most existing waterway perception models primarily focus on instance-level object perception paradigms (e.g., detection, segmentation). However, due to the complexity of waterway environments, current perception datasets and models fail to achieve global semantic understanding of waterways, limiting large-scale monitoring and structured log generation. With the advancement of vision-language models (VLMs), we leverage image captioning to introduce WaterCaption, the first captioning dataset specifically designed for waterway environments. WaterCaption focuses on fine-grained, multi-region long-text descriptions, providing a new research direction for visual geo-understanding and spatial scene cognition. Exactly, it includes 20.2k…

Dynamic Compact Consensus Tracking for Aerial Robots

Xiaolou Sun, Zhibin Quan, Feng Zhang +8 more

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

Existing one-stream trackers have attracted widespread attention. However, they are not applicable in real-time aerial robot tracking systems due to substantial computational overhead, especially when dynamic templates are introduced. To address this issue, we propose a novel Dynamic Compact Consensus Tracker (DC<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup>T), constructed by stacking blocks that each consists of a Compact Token Encoder (CTE) and Dynamic Consensus Attention (DCA). Unlike traditional methods that convert images into a large number of tokens, the CTE, inspired by “superpixel”, extracts a compact set of representative tokens from both initial and dynamic templates, eliminating the need for a large token set. This strategic reduction in the number of compact tokens markedly decreases the computational load of CTE…

DRIVE: Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Driving

Songning Lai, Tianlang Xue, Hongru Xiao +7 more

cs.RO · · cited 1× · arXiv ↗ · more like this ·

Recent advancements in autonomous driving have seen a paradigm shift towards end-to-end learning paradigms, which map sensory inputs directly to driving actions, thereby enhancing the robustness and adaptability of autonomous vehicles. However, these models often sacrifice interpretability, posing significant challenges to trust, safety, and regulatory compliance. To address these issues, we introduce DRIVE -- Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Driving, a comprehensive framework designed to improve the dependability and stability of explanations in end-to-end unsupervised autonomous driving models. Our work specifically targets the inherent instability problems observed in the Driving through the Concept Gridlock (DCG) model, which undermine the trustworthiness of its explanations and decision-making processes. We define four key attributes of…

Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar

Runwei Guan, Shanliang Yao, Xiaohui Zhu +5 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Current perception models for different tasks usually exist in modular forms on Unmanned Surface Vehicles (USVs), which infer extremely slowly in parallel on edge devices, causing the asynchrony between perception results and USV position, and leading to error decisions of autonomous navigation. Compared with Unmanned Ground Vehicles (UGVs), the robust perception of USVs develops relatively slowly. Moreover, most current multi-task perception models are huge in parameters, slow in inference and not scalable. Oriented on this, we propose Achelous, a low-cost and fast unified panoptic perception framework for water-surface perception based on the fusion of a monocular camera and 4D mmWave radar. Achelous can simultaneously perform five tasks, detection and segmentation of visual targets, drivable-area segmentation, waterline segmentation and radar point cloud segmentation. Besides, models…

Answer with Evidence: Consistency-Aware Grounded Visual Question Answering for Roadside Traffic Scenes

Runwei Guan, Rongsheng Hu, Shangshu Chen +10 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Roadside traffic reasoning requires every free-form textual claim to be backed by visual evidence. Existing grounded multimodal large language models (MLLMs) frequently exhibit say-point mismatch, in which the textual answer contradicts the bounding boxes the model localizes. Evaluation metrics that score answers and boxes separately leave this failure unpenalized. We trace the mismatch to the conventional answer-then-ground factorization, which commits to a numerical claim before any object is enumerated. To measure it, we build RoadSceneVQA-G, a benchmark of 34.7K question-answer pairs in which every free-form answer is linked to the set of boxes that witnesses it, and we propose the Answer-Grounding Consistency (AGC) evaluation suite. To address it, we introduce Enumerate-then-Answer (EtA), which reverses the generation order so that answer-evidence agreement becomes a property of…

RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving

Lianqing Zheng, Xiaokai Bai, Yixuan Luo +6 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

4D radar provides geometric and motion cues that complement visual semantics, but integrating it into vision-language-action (VLA) models requires both radar--language alignment for semantic reasoning and explicit use of radar measurements for trajectory refinement and selection. To support these capabilities, we construct Cap4DR with 86,016 radar-image-text samples for alignment pretraining and OmniHD-QA with 520,161 question-answer pairs for instruction tuning across scene description, key-object reasoning, occupancy understanding, and trajectory planning. Building on these datasets, we propose RCVLA, a radar-camera VLA framework consisting of a radar-grounded semantic reasoning stage (RCVLA-Sem) and a trajectory arbitration stage (RCVLA-Phys). RCVLA-Sem performs gated bidirectional interaction between camera and radar tokens for driving question answering and reference trajectory…

Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain

Daizong Liu, Junhao Dong, Zhiyuan Ma +6 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Multimodal large language models (MLLMs) have extended the capability of large language models (LLMs) to process more contextual multimodal information, showing remarkable progress in diverse realistic multimodal applications. Despite their strong perception and reasoning abilities, recent studies reveal that MLLMs remain highly vulnerable to adversarial inputs, especially those targeting visual components. However, existing attacks mainly focus on global perturbations, lacking an understanding of how MLLMs internally interpret visual structures. In this paper, we make the attempt to investigate the intrinsic focus of MLLMs in the frequency domain and discover that their predictions are particularly sensitive to phase information, which encodes essential structural and semantic cues. Based on this observation, we propose a novel phase-aware adversarial attack framework that explicitly…

When Efficiency Becomes Fragility: Exploiting Dynamic Routing Vulnerabilities in Adaptive UAV Tracking

Shaofeng Liang, Runwei Guan, Wenshuo Chen +7 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Resource constraints on UAV platforms have driven a paradigm shift in aerial tracking, from pursuing performance toward balancing accuracy with efficiency. Adaptive Transformer Trackers, which leverage an input-dependent dynamic routing architecture, have emerged as a representative solution to this challenge. However, we reveal that behind this computation-on-demand flexibility hides a critical structural flaw: the Lipschitz singularity of computational path decisions, which has an unbounded local Lipschitz constant at discrete layer-skipping decision boundaries. This mathematical discontinuity renders adaptive tracking networks inherently unstable: tiny input perturbations can be amplified at the gating modules, causing dramatic changes in the inference topology. We formally characterize this singularity in the context of adaptive tracking architectures and, for the first time…

Talk2Sensors: 3D Visual Grounding in Autonomous Driving via Sensor-Adaptive Physical Cue Matching

Runwei Guan, Di Tian, Ningwei Ouyang +9 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

As a key capability for embodied intelligence, 3D visual grounding (3DVG) has been predominantly studied in indoor scenes with RGB-D or point-cloud inputs, while existing outdoor extensions largely rely on monocular images alone. Both settings fall short of real-world outdoor perception, where heterogeneous sensors capture complementary yet distinct physical properties, such as visual texture, 3D geometry, and object kinematics, that are indispensable for flexible and robust query-adaptive grounding but remain under-exploited. To bridge this gap, we introduce Talk2Sensors, the first multi-sensor 3D visual grounding dataset built upon camera, LiDAR, and 4D radar. It contains 8,682 language instructions and 20,558 referred objects, with diverse prompts explicitly aligned with sensor-specific physical cues. Furthermore, we propose TSFormer, a unified Transformer-based framework for…

VQA-G Annotator: A Self-Improving Agentic Framework for High-Fidelity Grounded Dataset Synthesis

Rongsheng Hu, Yuan Liu, Runwei Guan +8 more

Computer Vision and Pattern Recognition · Tsinghua Science & Technology · · cited 0× · DOI ↗ · more like this ·

Abstract As artificial intelligence systems increasingly rely on multi-source perception and cross-modal learning for human-like visual understanding, their outputs should be both semantically valid and spatially grounded. However, large-scale vision-language benchmarks with precise grounding remain costly to construct, while existing synthetic pipelines often suffer from distribution drift, error propagation, and weak spatial verification. We introduce VQA-G Annotator, a self-improving agentic framework that combines distribution-aware planning, multi-agent orchestration, and spatial reasoning verification in a closed-loop generation, evaluation, and refinement process. Experiments across four benchmark sources show that VQA-G Annotator achieves an average VQAScore of 0.88 for semantic alignment and an Acc@0.5 of 0.57 for spatial grounding, comparing favorably with strong automatic…

Flexible Targeted Adversarial Alignment with Frequency-based Visual Focus for Attacking Large Vision-Language Models

Daizong Liu, Tianyao Luo, Junhao Dong +8 more

Artificial Intelligence · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 0× · DOI ↗ · more like this ·

Although Large Vision-Language Models (LVLMs) have shown great capabilities across various downstream tasks, they are proven to be vulnerable to adversarial examples, thus resulting in critical safety issues. Existing adversarial attacks against LVLMs predominantly rely on uniform, image-wise perturbations, while largely overlooking how these models internally perceive and prioritize visual structures during multimodal alignment. Moreover, most prior LVLM attack methods are designed for either white-box or black-box settings, heavily depending on full-model gradients or sophisticated transfer heuristics, which incur substantial computational and resource costs and limit their practical scalability. In this paper, we propose a novel and efficient gray-box attack framework for LVLMs that only accesses the visual encoder and explicitly exploits the frequency sensitive visual focus…

Real-Time 3D Scene Perception in Dynamic Urban Environments via Street Detection Gaussians

Yu Du, Runwei Guan, Ho-Pun Lam +4 more

Computer Vision and Pattern Recognition · Computers, materials & continua/Computers, materials & continua (Print) · · cited 0× · DOI ↗ · more like this ·

As a cornerstone for applications such as autonomous driving, 3D urban perception is a burgeoning field of study. Enhancing the performance and robustness of these perception systems is crucial for ensuring the safety of next-generation autonomous vehicles. In this work, we introduce a novel neural scene representation called Street Detection Gaussians (SDGs), which redefines urban 3D perception through an integrated architecture unifying reconstruction and detection. At its core lies the dynamic Gaussian representation, where time-conditioned parameterization enables simultaneous modeling of static environments and dynamic objects through physically constrained Gaussian evolution. The framework’s radar-enhanced perception module learns cross-modal correlations between sparse radar data and dense visual features, resulting in a 22% reduction in occlusion errors compared to vision-only…

AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios

Chenglizhao Chen, Shaofeng Liang, Runwei Guan +6 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Referring Multi-Object Tracking (RMOT) aims to achieve precise object detection and tracking through natural language instructions, representing a fundamental capability for intelligent robotic systems. However, current RMOT research remains mostly confined to ground-level scenarios, which constrains their ability to capture broad-scale scene contexts and perform comprehensive tracking and path planning. In contrast, Unmanned Aerial Vehicles (UAVs) leverage their expansive aerial perspectives and superior maneuverability to enable wide-area surveillance. Moreover, UAVs have emerged as critical platforms for Embodied Intelligence, which has given rise to an unprecedented demand for intelligent aerial systems capable of natural language interaction. To this end, we introduce AerialMind, the first large-scale RMOT benchmark in UAV scenarios, which aims to bridge this research gap. To…

Multi-Modal Structured Pruning for USV-Based Waterway Detection Based on Radar-Vision Fusion

Haocheng Zhao, Runwei Guan, Liye Jia +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Radar-vision fusion, with more reliable performance at lower cost, has been widely used in autonomous vehicles. In the waterways, the perception of unmanned surface vessels is essential for autonomous navigation. However, the large amount of computation increases the demand for high-performance computing devices and causes severe power consumption. To reduce the computational cost and ensure reliable perception performance, we need lightweight solutions for such models. In this paper, we design a novel structured pruning framework for multi-modal perception networks. Moreover, we proposed a novel structured pruning algorithm Heterogeneous Aware SynFlow (HA-SynFlow), which prunes each modality based on its SynFlow [1] score. We prune the water surface radar-vision fusion model Achelous [2], and results show 24.0% and 7.2% improvement in Frame Per Second (FPS) on GTX1650 and Jetson Orin…

Cognitive Disentanglement for Referring Multi-Object Tracking

Shaofeng Liang, Runwei Guan, Wangwang Lian +6 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

As a significant application of multi-source information fusion in intelligent transportation perception systems, Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video sequences based on language references. However, existing RMOT approaches often treat language descriptions as holistic embeddings and struggle to effectively integrate the rich semantic information contained in language expressions with visual features. This limitation is especially apparent in complex scenes requiring comprehensive understanding of both static object attributes and spatial motion information. In this paper, we propose a Cognitive Disentanglement for Referring Multi-Object Tracking (CDRMT) framework that addresses these challenges. It adapts the "what" and "where" pathways from the human visual processing system to RMOT tasks. Specifically, our framework first…