arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Baichen Liu

16 papers · 2022–2026

2022: 22023: 32024: 42025: 12026: 6
2022peak 6 in 20262026

Frequent co-authors

Papers

showing 1–16 of 16 RSS

Deep Convolutional Neural Networks with Zero-Padding: Feature Extraction and Learning

Zhi Han, Baichen Liu, Shao-Bo Lin +1 more

cs.LG · · cited 5× · arXiv ↗ · more like this ·

This paper studies the performance of deep convolutional neural networks (DCNNs) with zero-padding in feature extraction and learning. After verifying the roles of zero-padding in enabling translation-equivalence, and pooling in its translation-invariance driven nature, we show that with similar number of free parameters, any deep fully connected networks (DFCNs) can be represented by DCNNs with zero-padding. This demonstrates that DCNNs with zero-padding is essentially better than DFCNs in feature extraction. Consequently, we derive universal consistency of DCNNs with zero-padding and show its translation-invariance in the learning process. All our theoretical results are verified by numerical experiments including both toy simulations and real-data running.

Nonconvex Nonlocal Tucker Decomposition for 3D Medical Image Super-Resolution

Huidi Jia, Xi’ai Chen, Zhi Han +3 more

Computer Vision and Pattern Recognition · Frontiers in Neuroinformatics · · cited 5× · DOI ↗ · more like this ·

Limited by hardware conditions, imaging devices, transmission efficiency, and other factors, high-resolution (HR) images cannot be obtained directly in clinical settings. It is expected to obtain HR images from low-resolution (LR) images for more detailed information. In this article, we propose a novel super-resolution model for single 3D medical images. In our model, nonlocal low-rank tensor Tucker decomposition is applied to exploit the nonlocal self-similarity prior knowledge of data. Different from the existing methods that use a convex optimization for tensor Tucker decomposition, we use a tensor folded-concave penalty to approximate a nonlocal low-rank tensor. Weighted 3D total variation (TV) is used to maintain the local smoothness across different dimensions. Extensive experiments show that our method outperforms some state-of-the-art (SOTA) methods on different kinds of…

Towards Super Compressed Neural Networks for Object Identification: Quantized Low-Rank Tensor Decomposition with Self-Attention

Baichen Liu, Dongwei Wang, Qi Lv +2 more

Computational Mathematics · Electronics · · cited 2× · DOI ↗ · more like this ·

Deep convolutional neural networks have a large number of parameters and require a significant number of floating-point operations during computation, which limits their deployment in situations where the storage space is limited and computational resources are insufficient, such as in mobile phones and small robots. Many network compression methods have been proposed to address the aforementioned issues, including pruning, low-rank decomposition, quantization, etc. However, these methods typically fail to achieve a significant compression ratio in terms of the parameter count. Even when high compression rates are achieved, the network’s performance is often significantly deteriorated, making it difficult to perform tasks effectively. In this study, we propose a more compact representation for neural networks, named Quantized Low-Rank Tensor Decomposition (QLTD), to super compress deep…

Learning Skills from Historical Action Trajectories: Action Experience Dictionary for World Action Models

Qi Lyu, Jiahua Dong, Hao Shen +9 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

World Action Models (WAMs) couple visual dynamics prediction with action generation, yet they do not explicitly support the reuse of action experience across manipulation tasks. Furthermore, existing WAMs struggle to capture underlying cross-task semantic relationships that could guide target action prediction, as redundant background elements interfere with the extraction of key visual information. To address these challenges, we develop a novel Action Experience Dictionary (AED) that encodes historical physical action trajectories into shared action embeddings to support skill reuse and model cross-task relationships. Specifically, we first aggregate historical actions to align with visual observations and retrieve action embeddings from the AED using a pretrained action tokenizer. Subsequently, we visually condition the pooled embeddings through cross-attention and prepend them to…

SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planning

Zebin Han, Xudong Wang, Baichen Liu +5 more

cs.RO · · cited 0× · arXiv ↗ · more like this ·

Sequential-Horizon Vision-and-Language Navigation (SH-VLN) presents a challenging scenario where agents should sequentially execute multi-task navigation guided by complex, long-horizon language instructions. Current vision-and-language navigation models exhibit significant performance degradation with such multi-task instructions, as information overload impairs the agent's ability to attend to observationally relevant details. To address this problem, we propose SeqWalker, a navigation model built on a hierarchical planning framework. Our SeqWalker features: i) A High-Level Planner that dynamically selects global instructions into contextually relevant sub-instructions based on the agent's current visual observations, thus reducing cognitive load; ii) A Low-Level Planner incorporating an Exploration-Verification strategy that leverages the inherent logical structure of instructions…

ReasonWalker: Reasoning Iterative Vision-and-Language Navigation With Implicit Instructions

Xudong Wang, Baichen Liu, Jiahua Dong +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Cybernetics · · cited 0× · DOI ↗ · more like this ·

Existing vision-and-language navigation (VLN) agents typically cannot infer users' implicit intentions. They are unable to leverage past experiences in persistent environments. In this article, we propose ReasonWalker, a novel navigation model designed to enable reasoning-based navigation using implicit instructions over time. To ensure persistent and efficient operation, ReasonWalker constructs and stores explicit scene maps, allowing it to learn scene associations for improved renavigation in subsequent episodes. To facilitate comprehension and reasoning over implicit instructions, ReasonWalker leverages a large language model (LLM) to jointly process user instructions, agent observations, and scene maps, generating semantic navigation tokens that guide action prediction. To train ReasonWalker, we propose a new hierarchical learning paradigm, where the model first learns navigation…

CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation

Baichen Liu, Qi Lyu, Xudong Wang +3 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Continual video instance segmentation demands both the plasticity to absorb new object categories and the stability to retain previously learned ones, all while preserving temporal consistency across frames. In this work, we introduce Contrastive Residual Injection and Semantic Prompting (CRISP), an earlier attempt tailored to address the instance-wise, category-wise, and task-wise confusion in continual video instance segmentation. For instance-wise learning, we model instance tracking and construct instance correlation loss, which emphasizes the correlation with the prior query space while strengthening the specificity of the current task query. For category-wise learning, we build an adaptive residual semantic prompt (ARSP) learning framework, which constructs a learnable semantic residual prompt pool generated by category text and uses an adjustive query-prompt matching mechanism to…

Privacy Protection Knowledge Distillation with Parameter Adaptation

Yanmei Wang, Baichen Liu, Zhenduo Shang +1 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Knowledge distillation(KD), as an implementation of network compression, transfers knowledge from sophisticated networks teacher to lightweight networks student. Due to privacy issues, few-shot and zero-shot KD comes into being. The existing zero-shot or data-free KD methods mostly use the teacher network to synthesize pseudo samples or data impressions to train student networks. However, the generation of pseudo samples is extremely time-consuming, and student network training with pseudo samples does not easily converge, which is usually achieved with a small learning rate over several thousand iterations to realize a satisfactory result. A variety of difficulties raised by zero-shot KD lead us to reconsider the need to use generated datasets to preserve user privacy. In this paper, drawing on the knowledge of privacy protection, we cut off the mapping between images and labels for…

Siamese Visual Tracking with Feature Enhancement Fusion

Zhixi Wu, Baichen Liu, Shunzhi Zhu

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

In object tracking tasks, the use of a Siamese-based approach to construct trackers inevitably involves a crucial step - cross-correlation operations, which are employed to assess the similarity relationship between the template and the search area. However, this method is limited to obtaining only local information, lacking in global contextual understanding. Inspired by the Transformer’s capability to capture long-term dependencies, we propose a novel Siamese visual target tracking method with an attention mechanism, named SiamTr. Specifically, we design a feature enhancement fusion network to replace the cross-correlation computation, composed of a Hybrid Attention Module and a Cross-Attention Fusion Module. Additionally, we incorporate an Attention Feature Fusion(AFF) to merge shallow and deep features, thus acquiring diverse information. Experiments demonstrate that our proposed…

DILS: depth incremental learning strategy

Yanmei Wang, Zhi Han, Siquan Yu +3 more

Artificial Intelligence · Frontiers in Neurorobotics · · cited 0× · DOI ↗ · more like this ·

There exist various methods for transferring knowledge between neural networks, such as parameter transfer, feature sharing, and knowledge distillation. However, these methods are typically applied when transferring knowledge between networks of equal size or from larger networks to smaller ones. Currently, there is a lack of methods for transferring knowledge from shallower networks to deeper ones, which is crucial in real-world scenarios such as system upgrades where network size increases for better performance. End-to-end training is the commonly used method for network training. However, in this training strategy, the deeper network cannot inherit the knowledge from the existing shallower network. As a result, not only is the flexibility of the network limited but there is also a significant waste of computing power and time. Therefore, it is imperative to develop new methods that…

Review helps learn better: Temporal Supervised Knowledge Distillation

Dongwei Wang, Zhi Han, Yanmei Wang +3 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Reviewing plays an important role when learning knowledge. The knowledge acquisition at a certain time point may be strongly inspired with the help of previous experience. Thus the knowledge growing procedure should show strong relationship along the temporal dimension. In our research, we find that during the network training, the evolution of feature map follows temporal sequence property. A proper temporal supervision may further improve the network training performance. Inspired by this observation, we propose Temporal Supervised Knowledge Distillation (TSKD). Specifically, we extract the spatiotemporal features in the different training phases of student by convolutional Long Short-term memory network (Conv-LSTM). Then, we train the student net through a dynamic target, rather than static teacher network features. This process realizes the refinement of old knowledge in student…

Fully Kernected Neural Networks

Wei Zhang, Zhi Han, Xi’ai Chen +3 more

Computer Vision and Pattern Recognition · Journal of Mathematics · · cited 0× · DOI ↗ · more like this ·

In this paper, we apply kernel methods to deep convolutional neural network (DCNN) to improve its nonlinear ability. DCNNs have achieved significant improvement in many computer vision tasks. For an image classification task, the accuracy comes to saturation when the depth and width of network are enough and appropriate. The saturation accuracy will not rise even by increasing the depth and width. We find that improving nonlinear ability of DCNNs can break through the saturation accuracy. In a DCNN, the former layer is more inclined to extract features and the latter layer is more inclined to classify features. Therefore, we apply kernel methods at the last fully connected layer to implicitly map features to a higher-dimensional space to improve nonlinear ability so that the network achieves better linear separability. Also, we name the network as fully kernected neural networks (fully…

A Novel Lightweight Architecture of Deep Convolutional Neural Networks

Baichen Liu, Xi’ai Chen, Zhi Han +2 more

Computer Vision and Pattern Recognition · 2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER) · · cited 0× · DOI ↗ · more like this ·

Deep convolutional neural networks have achieved much success in many computer vision tasks. However, a network has millions of parameters which limit its inference speed and usage for some situations with limited storage space. Low-rank based methods and pruning methods are verified effective to compress the number of parameters and accelerate inference speed of deep convolutional neural networks. As the price, the performance of the networks decreases. To overcome this problem, in this paper, we design a novel low-rank and sparse architecture of convolutional neural networks. Besides accelerating inference speed and reducing parameters, our approach achieves better performance than baseline networks.

SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models

Qi Lyu, Jiahua Dong, Baichen Liu +7 more

cs.CV · · arXiv ↗ · more like this ·

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal understanding, yet their enormous parameter scale and cross-modal computation incur substantial memory and latency overhead, severely limiting real-world deployment on resource-constrained devices. Binarization offers an attractive solution by drastically reducing storage and computational costs. However, existing binarization methods neglect the varying importance of weights across different layers and modalities. This causes parameters irrelevant to downstream tasks to be unnecessarily retained, whereas modality-critical weights may not be adequately optimized, resulting in significant performance degradation. To address these challenges, we develop a novel \underline{S}ignificance-\underline{A}ware \underline{B}inarization for \underline{L}arge \underline{V}ision-\underline{L}anguage…

Lifelong Embodied Navigation Learning

Xudong Wang, Jiahua Dong, Baichen Liu +3 more

cs.RO · · arXiv ↗ · more like this ·

Embodied navigation agents powered by large language models have shown strong performance on individual tasks but struggle to continually acquire new navigation skills, which suffer from catastrophic forgetting. We formalize this challenge as lifelong embodied navigation learning (LENL), where an agent is required to adapt to a sequence of navigation tasks spanning multiple scenes and diverse user instruction styles, while retaining previously learned knowledge. To tackle this problem, we propose Uni-Walker, a lifelong embodied navigation framework that decouples navigation knowledge into task-shared and task-specific components with Decoder Extension LoRA (DE-LoRA). To learn the shared knowledge, we design a knowledge inheritance strategy and an experts co-activation strategy to facilitate shared knowledge transfer and refinement across multiple navigation tasks. To learn the specific…

Lifelong Language-Conditioned Robotic Manipulation Learning

Xudong Wang, Zebin Han, Zhiyu Liu +5 more

cs.RO · · arXiv ↗ · more like this ·

Traditional language-conditioned manipulation agent sequential adaptation to new manipulation skills leads to catastrophic forgetting of old skills, limiting dynamic scene practical deployment. In this paper, we propose SkillsCrafter, a novel robotic manipulation framework designed to continually learn multiple skills while reducing catastrophic forgetting of old skills. Specifically, we propose a Manipulation Skills Adaptation to retain the old skills knowledge while inheriting the shared knowledge between new and old skills to facilitate learning of new skills. Meanwhile, we perform the singular value decomposition on the diverse skill instructions to obtain common skill semantic subspace projection matrices, thereby recording the essential semantic space of skills. To achieve forget-less and generalization manipulation, we propose a Skills Specialization Aggregation to compute…