arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Zejun Yang

12 papers · 2012–2026

2012: 12013: 02014: 02015: 02016: 02017: 02018: 02019: 02020: 02021: 12022: 12023: 22024: 42025: 12026: 2
2012peak 4 in 20242026

Frequent co-authors

Papers

showing 1–12 of 12 RSS

Text2Reaction : Enabling Reactive Task Planning Using Large Language Models

Zejun Yang, Ning Li, Haitao Wang +7 more

Artificial Intelligence · IEEE Robotics and Automation Letters · · cited 14× · DOI ↗ · more like this ·

To complete tasks in dynamic environments, robots need to timely update their plans to react to environment changes. Traditional stripe-like or learning-based planners struggle to achieve this due to their high reliance on meticulously predefined planning rules or labeled data. Fortunately, recent works find that Large Language Models (LLMs) can be effectively prompted to solve planning problems. Thus, we investigate the strategies for LLMs to master reactive planning problems without complex definitions and extra training. We propose Text2Reaction, an LLM-based framework enabling robots to continuously reason and update plans according to the latest environment changes. Inspired from human's step-by-step re-planning process, we present the Re-planning Prompt, which informs LLMs the basic principles of re-planning and fosters the gradual development of a current plan to a new one in a…

Accurate Bandwidth Prediction for Real-Time Media Streaming with Offline Reinforcement Learning

Q. Tan, Gerui Lv, Xing Fang +4 more

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

In real-time communication (RTC) systems, accurate bandwidth prediction is crucial for encoding and transmission strategies to optimize users' quality of experience (QoE) in various network environments. In this paper, we propose an offline reinforcement learning (RL) method to predict bandwidth for RTC video streaming. We use a representative algorithm, named Implicit Q-Learning (IQL), to train the model. To improve the performance, we carefully preprocess the given dataset and redesign the neural network structure and the reward function. Ablation studies are performed to verify our design choices. Furthermore, compared to a baseline method and six behavior policies, our method reduces the mean squared error (MSE) by 18%-22%, demonstrating high prediction accuracy. Our proposed method won the first prize in ACM MMSys 2024 Grand Challenge on Offline Reinforcement Learning for Bandwidth…

Monocular 3D Hand Mesh Recovery via Dual Noise Estimation

Hanhui Li, Xiaojian Lin, Xuan Huang +3 more

cs.CV · · cited 3× · arXiv ↗ · more like this ·

Current parametric models have made notable progress in 3D hand pose and shape estimation. However, due to the fixed hand topology and complex hand poses, current models are hard to generate meshes that are aligned with the image well. To tackle this issue, we introduce a dual noise estimation method in this paper. Given a single-view image as input, we first adopt a baseline parametric regressor to obtain the coarse hand meshes. We assume the mesh vertices and their image-plane projections are noisy, and can be associated in a unified probabilistic model. We then learn the distributions of noise to refine mesh vertices and their projections. The refined vertices are further utilized to refine camera parameters in a closed-form manner. Consequently, our method obtains well-aligned and high-quality 3D hand meshes. Extensive experiments on the large-scale Interhand2.6M dataset demonstrate…

Fusion of Internal Similarity to Improve the Accuracy of Recommendation Algorithm

Zejun Yang, Denghui Xia, Jin Liu +4 more

Information Systems · Journal on internet of things · · cited 3× · DOI ↗ · more like this ·

Collaborative filtering algorithms (CF) and mass diffusion (MD) algorithms have been successfully applied to recommender systems for years and can solve the problem of information overload. However, both algorithms suffer from data sparsity, and both tend to recommend popular products, which have poor diversity and are not suitable for real life. In this paper, we propose a user internal similarity-based recommendation algorithm (UISRC). UISRC first calculates the item-item similarity matrix and calculates the average similarity between items purchased by each user as the user’s internal similarity. The internal similarity of users is combined to modify the recommendation score to make score predictions and suggestions. Simulation experiments on RYM and Last.FM datasets, the results show that UISRC can obtain better recommendation accuracy and a variety of recommendations than…

RealPortrait: Realistic Portrait Animation with Diffusion Transformers

Zejun Yang, Huawei Wei, Zhisheng Wang

Computer Vision and Pattern Recognition · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

We introduce RealPortrait, a framework based on Diffusion Transformers (DiT), designed to generate highly expressive and visually appealing portrait animations. Given a static portrait image, our method can transfer complex facial expressions and head pose movements extracted from a driving video onto the portrait, transforming it into a lifelike video. Specifically, we exploit the robust spatial-temporal modeling capabilities of DiT, enabling the generation of portrait videos that maintain high-fidelity visual details and ensure temporal coherence. In contrast to conventional image-to-video generation frameworks that necessitate a separate reference network, we incorporate an efficient reference attention within the DiT backbone, thereby obviating the computational overhead and achieving superior reference appearance preservation. Concurrently, we integrate a parallel ControlNet to…

Hierarchical Subgoal Generation from Language Instruction for Robot Task Planning

Zejun Yang, Ning Li, Hao Jiang +1 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

In the field of "Visual-Language Task Planning", how to flexibly process various language inputs determines the accuracy of action prediction. In this paper, we mainly study: what useful information can be obtained from language inputs and how to organize it; how to map instructions to the organized information. For these problems, (1) we organize the "Task-Subgoal-Action" logic structure, to help complete the complex tasks step-by-step, (2) we also propose the hierarchical subgoal generation model, which learns operation knowledge from training data, to generate executable subgoal sequences according to the given instructions. Our model is trained and evaluated with the datasets from “Action Learning From Realistic Environments and Directives ”(ALFRED), the subgoal sequences extracted from predicted texts successfully enable the robot to complete nearly 97% of ALFRED tasks" What’s…

An improved clustering algorithm based on intersecting circle structure

Zejun Yang, Yinglong Wang, Fu-Meng Zhao +1 more

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

A good clustering algorithm can provide the basis for forming a good network topology and target location, improve routing efficiency and greatly reduce energy consumption. For the lack of GAF algorithm, an improved algorithm is putted forward. First of all, the monitored area is divided into many sections according to the intersecting circle structure. Then the nodes which meet specific criteria will be elected as cluster heads. Finally, some nodes in overlapping area of intersecting circles will be elected as the Mid Nodes to achieve multi-hops routing. As is shown in the experiment, the improved algorithm can greatly save energy consumption of nodes, and extend the lifetime of wireless sensor networks.

3D Visibility-aware Generalizable Neural Radiance Fields for Interacting Hands

Xuan Huang, Hanhui Li, Zejun Yang +2 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Neural radiance fields (NeRFs) are promising 3D representations for scenes, objects, and humans. However, most existing methods require multi-view inputs and per-scene training, which limits their real-life applications. Moreover, current methods focus on single-subject cases, leaving scenes of interacting hands that involve severe inter-hand occlusions and challenging view variations remain unsolved. To tackle these issues, this paper proposes a generalizable visibility-aware NeRF (VA-NeRF) framework for interacting hands. Specifically, given an image of interacting hands as input, our VA-NeRF first obtains a mesh-based representation of hands and extracts their corresponding geometric and textural features. Subsequently, a feature fusion module that exploits the visibility of query points and mesh vertices is introduced to adaptively merge features of both hands, enabling the recovery…

Resilience Enhancement of Electricity-Computing Interdependency System against Contingency

Minqiao Zheng, Zejun Yang

math.OC · · arXiv ↗ · more like this ·

Electrical power and computing power are highly interdependent especially due to the AI revolution. This dependency is largely underestimated during normal and recovery operation. To address this issue, an Electricity-Computing Interdependency System (ECIS) is developed in this paper, which first quantifies the interdependencies between ECIS and other critical infrastructures. The data center (DC) is modeled as a facility that transforms electrical power into computing power, and a recovery optimization strategy for ECIS is then proposed considering electrical power constraints, computing power supply, and infrastructure interdependencies. The case study demonstrates that the proposed strategy dynamically adjusts the DC electrical power quota according to system states, improving system resilience by more than 20% during power shortage.

Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection

Zhen Liu, Xinyu Ning, Zhe Hu +8 more

cs.RO · · arXiv ↗ · more like this ·

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle in long-horizon, memory-dependent tasks with partial observability, occlusions, and multi-stage dependencies. Such tasks require not only precise visuomotor control, but also persistent memory, adaptive task decomposition, and explicit recovery from execution failures. To address these limitations, we propose a dual-system framework for long-horizon embodied manipulation. Our framework explicitly separates high-level semantic reasoning from low-level motor execution. A high-level planner, implemented as a VLM-based agentic module, maintains structured task memory and performs goal decomposition, outcome verification, and error-driven correction. A…

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Huawei Wei, Zejun Yang, Zhisheng Wang

cs.CV · · arXiv ↗ · more like this ·

In this study, we propose AniPortrait, a novel framework for generating high-quality animation driven by audio and a reference portrait image. Our methodology is divided into two stages. Initially, we extract 3D intermediate representations from audio and project them into a sequence of 2D facial landmarks. Subsequently, we employ a robust diffusion model, coupled with a motion module, to convert the landmark sequence into photorealistic and temporally consistent portrait animation. Experimental results demonstrate the superiority of AniPortrait in terms of facial naturalness, pose diversity, and visual quality, thereby offering an enhanced perceptual experience. Moreover, our methodology exhibits considerable potential in terms of flexibility and controllability, which can be effectively applied in areas such as facial motion editing or face reenactment. We release code and model…

LongDanceDiff: Long-term Dance Generation with Conditional Diffusion Model

Siqi Yang, Zejun Yang, Zhisheng Wang

cs.CV · · arXiv ↗ · more like this ·

Dancing with music is always an essential human art form to express emotion. Due to the high temporal-spacial complexity, long-term 3D realist dance generation synchronized with music is challenging. Existing methods suffer from the freezing problem when generating long-term dances due to error accumulation and training-inference discrepancy. To address this, we design a conditional diffusion model, LongDanceDiff, for this sequence-to-sequence long-term dance generation, addressing the challenges of temporal coherency and spatial constraint. LongDanceDiff contains a transformer-based diffusion model, where the input is a concatenation of music, past motions, and noised future motions. This partial noising strategy leverages the full-attention mechanism and learns the dependencies among music and past motions. To enhance the diversity of generated dance motions and mitigate the freezing…