arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Haowei Lin

51 papers · 2011–2026

2011: 12012: 12013: 02014: 02015: 02016: 02017: 02018: 02019: 22020: 22021: 02022: 22023: 82024: 82025: 112026: 16
2011peak 16 in 20262026

Frequent co-authors

Papers

showing 1–25 of 51 RSS

Continual Pre-training of Language Models

Zixuan Ke, Yijia Shao, Haowei Lin +3 more

cs.CL · · cited 251× · arXiv ↗ · more like this ·

Language models (LMs) have been instrumental for the rapid advance of natural language processing. This paper studies continual pre-training of LMs, in particular, continual domain-adaptive pre-training (or continual DAP-training). Existing research has shown that further pre-training an LM using a domain corpus to adapt the LM to the domain can improve the end-task performance in the domain. This paper proposes a novel method to continually DAP-train an LM with a sequence of unlabeled domain corpora to adapt the LM to these domains to improve their end-task performances. The key novelty of our method is a soft-masking mechanism that directly controls the update to the LM. A novel proxy is also proposed to preserve the general knowledge in the original LM. Additionally, it contrasts the representations of the previously learned domain knowledge (including the general knowledge in the…

Data-based fault tolerant control for affine nonlinear systems through particle swarm optimized neural networks

Haowei Lin, Bo Zhao, Derong Liu +1 more

Computational Theory and Mathematics · IEEE/CAA Journal of Automatica Sinica · · cited 153× · DOI ↗ · more like this ·

In this paper, a data-based fault tolerant control (FTC) scheme is investigated for unknown continuous-time (CT) affine nonlinear systems with actuator faults. First, a neural network (NN) identifier based on particle swarm optimization (PSO) is constructed to model the unknown system dynamics. By utilizing the estimated system states, the particle swarm optimized critic neural network (PSOCNN) is employed to solve the Hamilton-Jacobi-Bellman equation (HJBE) more efficiently. Then, a data-based FTC scheme, which consists of the NN identifier and the fault compensator, is proposed to achieve actuator fault tolerance. The stability of the closed-loop system under actuator faults is guaranteed by the Lyapunov stability theorem. Finally, simulations are provided to demonstrate the effectiveness of the developed method.

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation

Zihao Wang, Anji Liu, Haowei Lin +3 more

cs.CL · · cited 110× · arXiv ↗ · more like this ·

We explore how iterative revising a chain of thoughts with the help of information retrieval significantly improves large language models' reasoning and generation ability in long-horizon generation tasks, while hugely mitigating hallucination. In particular, the proposed method -- *retrieval-augmented thoughts* (RAT) -- revises each thought step one by one with retrieved information relevant to the task query, the current and the past thought steps, after the initial zero-shot CoT is generated. Applying RAT to GPT-3.5, GPT-4, and CodeLLaMA-7b substantially improves their performances on various long-horizon generation tasks; on average of relatively increasing rating scores by 13.63% on code generation, 16.96% on mathematical reasoning, 19.2% on creative writing, and 42.78% on embodied task planning. The demo page can be found at https://craftjarvis.github.io/RAT

Continual Training of Language Models for Few-Shot Learning

Zixuan Ke, Haowei Lin, Yijia Shao +3 more

cs.CL · · cited 48× · arXiv ↗ · more like this ·

Recent work on applying large language models (LMs) achieves impressive performance in many NLP applications. Adapting or posttraining an LM using an unlabeled domain corpus can produce even better performance for end-tasks in the domain. This paper proposes the problem of continually extending an LM by incrementally post-train the LM with a sequence of unlabeled domain corpora to expand its knowledge without forgetting its previous skills. The goal is to improve the few-shot end-task learning in these domains. The resulting system is called CPT (Continual PostTraining), which to our knowledge, is the first continual post-training system. Experimental results verify its effectiveness.

<b>JARVIS</b>-1: Open-World Multi-Task Agents With Memory-Augmented Multimodal Language Models

Zihao Wang, Shaofei Cai, Anji Liu +9 more

Artificial Intelligence · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 21× · DOI ↗ · more like this ·

Achieving human-like planning and control with multimodal observations in an open world is a key milestone for more functional generalist agents. Existing approaches can handle certain long-horizon tasks in an open world. However, they still struggle when the number of open-world tasks could potentially be infinite and lack the capability to progressively enhance task completion as game time progresses. We introduce <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">JARVIS</b>-1, an open-world agent that can perceive multimodal input (visual observations and human instructions), generate sophisticated plans, and perform embodied control, all within the popular yet challenging open-world Minecraft universe. Specifically, we develop <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">JARVIS</b>-1 on…

Dynamic service migration in ultra-dense multi-access edge computing network for high-mobility scenarios

Haowei Lin, Xiaolong Xu, Juan Zhao +1 more

Computer Networks and Communications · EURASIP Journal on Wireless Communications and Networking · · cited 14× · DOI ↗ · more like this ·

Abstract The multi-access edge computing (MEC) has higher computing power and lower latency than user equipment and remote cloud computing, enabling the continuing emergence of new types of services and mobile application. However, the movement of users could induce service migration or interruption in the MEC network. Especially for highly mobile users, they accelerate the frequency of services’ migration and handover, impacting on the stability of the total MEC network. In this paper, we propose a hierarchical multi-access edge computing architecture, setting up the infrastructure for dynamic service migration in the ultra-dense MEC networks. Moreover, we propose a new mechanism for users with high mobility in the ultra-dense MEC network, efficiently arranging service migrations for users with high-mobility and ordinary users together. Then, we propose an algorithm for evaluating…

A Cluster Allocation and Routing Algorithm Based on Node Density for Extending the Lifetime of Wireless Sensor Networks

Bo-Si Lee, Haowei Lin, Wernhuar Tarng

Computer Networks and Communications · · cited 13× · DOI ↗ · more like this ·

The electricity of sensor nodes in wireless sensor networks is very limited, so it is an important research topic to deploy the sensor nodes and cooperate with an efficient routing algorithm for extending the network lifetime. In the related research, LEACH routing algorithm randomly selects cluster heads in each round to form a cluster network, which may cause additional power consumption and inability to maintain the optimal routes for data transmission. The cluster allocation and routing algorithm proposed in this study is based on the cluster architecture of LEACH, and the objective is to produce clusters with more sensor nodes to balance energy consumption of cluster head. For indirect-transmission routing algorithms, the sensor nodes near the base station may consume more energy due to a larger amount of data transmission. Therefore, this study proposed to increase the node…

An Adaptive Flow Table Adjustment Algorithm for SDN

Xiaolong Xu, Liuyun Hu, Haowei Lin +1 more

Computer Networks and Communications · · cited 12× · DOI ↗ · more like this ·

SDN (Software-defined networking) are important for current network systems, such as cloud systems. The characteristics of flow in SDN and the impact of flow table entries and controllers on data packet transmission are analyzed. We propose an adaptive flow table adjustment algorithm for SDN called CFC (Combine flow table and controller). It is important for CFC to monitor the network traffic in real time. According to the proportion of active flow entries in the OpenFlow switch, the value of idle_timeout will be set dynamically based on the characteristics of different data flows. When the switch forwards packets, it will minimize the calculation load of controller, and allocate a reasonable value of idle_timeout to the idle flow table entries. So it can delete discarded flow table entries in time and improve the hit rate of data packets. The experiments show that the utilization rate…

JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models

Zihao Wang, Shaofei Cai, Anji Liu +9 more

cs.AI · · cited 6× · arXiv ↗ · more like this ·

Achieving human-like planning and control with multimodal observations in an open world is a key milestone for more functional generalist agents. Existing approaches can handle certain long-horizon tasks in an open world. However, they still struggle when the number of open-world tasks could potentially be infinite and lack the capability to progressively enhance task completion as game time progresses. We introduce JARVIS-1, an open-world agent that can perceive multimodal input (visual observations and human instructions), generate sophisticated plans, and perform embodied control, all within the popular yet challenging open-world Minecraft universe. Specifically, we develop JARVIS-1 on top of pre-trained multimodal language models, which map visual observations and textual instructions to plans. The plans will be ultimately dispatched to the goal-conditioned controllers. We outfit…

Adapting a Language Model While Preserving its General Knowledge

Zixuan Ke, Yijia Shao, Haowei Lin +3 more

cs.CL · · cited 6× · arXiv ↗ · more like this ·

Domain-adaptive pre-training (or DA-training for short), also known as post-training, aims to train a pre-trained general-purpose language model (LM) using an unlabeled corpus of a particular domain to adapt the LM so that end-tasks in the domain can give improved performances. However, existing DA-training methods are in some sense blind as they do not explicitly identify what knowledge in the LM should be preserved and what should be changed by the domain corpus. This paper shows that the existing methods are suboptimal and proposes a novel method to perform a more informed adaptation of the knowledge in the LM by (1) soft-masking the attention heads based on their importance to best preserve the general knowledge in the LM and (2) contrasting the representations of the general and the full (both general and domain knowledge) to learn an integrated representation with both general and…

Applying Cluster Merging and Dynamic Routing Mechanisms to Extend the Lifetime of Wireless Sensor Networks

Wernhuar Tarng, Kuo-Liang Ou, Kun-Jie Huang +5 more

Computer Networks and Communications · International Journal of Computer Network and Information Security · · cited 6× · OpenAlex ↗ · more like this ·

In recent years, the applications of wireless sens or networks have increased steadily. Sensor nodes are often scattered outdoors and their energy consumption depends heavily on the area of coverage and network topology. Many studies were focused on saving the energy of sensor nodes to maintain their functionality. This work aims at extending the lifetime of a wirel ess sensor network by using cluster merging and dynamic routing mechanisms. Cluster merging can increase the number of sensor nodes in a cluster to balance its energy consumption; dynamic routing prevents the cluster heads from exhausting electric power by forwarding data through detoured routes. The simulation results show that c luster merging followed by dynamic routing is more efficient in ex tending network lifetime. The best combination of the above two mec hanisms is to set the threshold of the remaining energy to 90%…

Fault Tolerant Control for Nonlinear Systems Based on Adaptive Dynamic Programming with Particle Swarm Optimization

Haowei Lin, Qiuye Wu, Derong Liu +2 more

Computational Theory and Mathematics · · cited 4× · DOI ↗ · more like this ·

This paper develops a fault tolerant control (FTC) scheme based on adaptive dynamic programming(ADP) employing the particle swarm optimization (PSO) for nonlinear systems with actuator failures. Using the well-known ADP method, the solution of Hamilton-Jacobi-Bellman equation (HJBE) is approximated by constructing a critic neural network (CNN) which is trained by the PSO algorithm. Compared to the existing gradient descent-trained CNN, the PSO-trained CNN has a higher success rate in solving the HJBE. In order to eliminate the impact of the actuator failure, the ADP-based FTC strategy is developed to guarantee the closed-loop system to be ultimately uniformly bounded (UUB). Finally, a simulation example is provided to demonstrate the effectiveness of the developed method.

Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation

Lin Shi, Haowei Lin, Zixuan Zhu +123 more

cs.AI · · cited 3× · arXiv ↗ · more like this ·

Evaluating agents on the growing number of agentic benchmarks is challenging because they often require complex environments and agent integrations. We introduce Harbor Adapters, a unified evaluation infrastructure for agentic benchmarks. Our work makes three contributions. First, we develop benchmark adapters that port more than 80 benchmarks to evaluate arbitrary agents, and validate them through rigorous code review and parity experiments. Second, we conduct a large-scale evaluation of 8 models spanning capability tiers across 54 benchmarks; every model is run with Terminus-2 and with one of 3 native harnesses. This enables a broader analysis of agent capabilities and failure modes than was previously possible. Third, we introduce Harbor-Index, a curated set of 82 difficult, diverse, and high-quality tasks spanning 29 benchmarks, refined from the adapted suite through difficulty…

FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score

Haowei Lin, Yuntian Gu

cs.LG · · cited 2× · arXiv ↗ · more like this ·

Detecting out-of-distribution (OOD) instances is crucial for NLP models in practical applications. Although numerous OOD detection methods exist, most of them are empirical. Backed by theoretical analysis, this paper advocates for the measurement of the "OOD-ness" of a test case $\boldsymbol{x}$ through the likelihood ratio between out-distribution $\mathcal P_{\textit{out}}$ and in-distribution $\mathcal P_{\textit{in}}$. We argue that the state-of-the-art (SOTA) feature-based OOD detection methods, such as Maha and KNN, are suboptimal since they only estimate in-distribution density $p_{\textit{in}}(\boldsymbol{x})$. To address this issue, we propose FLatS, a principled solution for OOD detection based on likelihood ratio. Moreover, we demonstrate that FLatS can serve as a general framework capable of enhancing other OOD detection methods by incorporating out-distribution density…

IWC-Bench: Evaluating Web Application Generation from a Software Testing Perspective

Chenxu Liu, Zilu Zou, Peizhong Gao +9 more

cs.SE · · cited 1× · arXiv ↗ · more like this ·

Human evaluation provides a direct measure of the quality of LLM-generated web applications. However, fitting human judgments through automated evaluation remains challenging. Static benchmarks can credit functionality that exists in source code but is unreachable at runtime. Interactive benchmarks exercise the application, yet incomplete exploration can cause them to miss implemented functionality and confound application defects with agent execution failures. To address these limitations, we propose IWC-Bench, an interactive benchmark for evaluating web application generation from a software testing perspective. IWC-Bench instruments each generated application and uses code coverage to guide an agent in exploring its functionality through user-simulated interactions. It then abstracts the interaction trace into a state-transition graph and evaluates the application along three…

ADP-Based Fault-Tolerant Control with Stability Guarantee for Nonlinear Systems

Luojia Liu, Jiaqi Lv, Haowei Lin +2 more

Computational Theory and Mathematics · Entropy · · cited 1× · DOI ↗ · more like this ·

This paper develops the stability-guaranteed adaptive dynamic programming (ADP)-based fault tolerant control (FTC) for nonlinear systems with an actuator fault. Firstly, a fault observer is designed to identify the unknown actuator fault. Then, a critic neural network (NN) is built to approximate the optimal control of the nominal system. Meanwhile, a stability-aware weight update mechanism is proposed based on the Lyapunov stability theorem to relax the restriction of the initial admissible control on the system stability. By integrating the nominal optimal control and the fault estimation, the stability-guaranteed ADP-based FTC is developed to eliminate the influence of the actuator fault. Furthermore, the observer errors, critic NN weight estimation errors, and the closed-loop system are all shown to exhibit uniform ultimate boundedness by using Lyapunov's direct method. Finally…

MCU: An Evaluation Framework for Open-Ended Game Agents

Xinyue Zheng, Haowei Lin, Kaichen He +3 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

Developing AI agents capable of interacting with open-world environments to solve diverse tasks is a compelling challenge. However, evaluating such open-ended agents remains difficult, with current benchmarks facing scalability limitations. To address this, we introduce Minecraft Universe (MCU), a comprehensive evaluation framework set within the open-world video game Minecraft. MCU incorporates three key components: (1) an expanding collection of 3,452 composable atomic tasks that encompasses 11 major categories and 41 subcategories of challenges; (2) a task composition mechanism capable of generating infinite diverse tasks with varying difficulty; and (3) a general evaluation framework that achieves 91.5\% alignment with human ratings for open-ended task assessment. Empirical results reveal that even state-of-the-art foundation agents struggle with the increasing diversity and…

Class Incremental Learning via Likelihood Ratio Based Task Prediction

Haowei Lin, Yijia Shao, Weinan Qian +3 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is provided at test time. Predicting the task-id for each test sample is a challenging problem. An emerging theory-guided approach (called TIL+OOD) is to train a task-specific model for each task in a shared network for all tasks based on a task-incremental learning (TIL) method to deal with catastrophic forgetting. The model for each task is an out-of-distribution (OOD) detector rather than a conventional classifier. The OOD detector can perform both within-task (in-distribution (IND)) class prediction and OOD detection. The OOD detection capability is the key to task-id prediction during inference. However, this paper argues that using a traditional OOD…

Distributed Robust Containment Control for Multi-Robot Systems via Adaptive Critic Designs

Yongwei Zhang, Haowei Lin, Bo Zhao +1 more

Computational Theory and Mathematics · · cited 1× · DOI ↗ · more like this ·

This article develops a distributed robust containment control approach for multi-robot systems via adaptive critic designs. To begin with, the distributed robust containment control problem of multi-robot systems with modeling uncertainties is transformed into an optimal containment control problem of its nominal plant by designing discounted value functions for all following robots. Hereafter, the distributed optimal containment control law is derived by solving the coupled Hamilton-Jacobi-Bellman equation of each following robot via the critic-only structure. Moreover, theoretical analysis shows that the developed adaptive critic design-based distributed robust containment control scheme guarantees the containment errors of all following robots to be asymptotically stable. Finally, the effectiveness of the present control approach is verified by simulation studies.

HyInv Technical Report

Haowei Lin, Cai Zhou, Xiangxin Zhou

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Inverse folding designs amino-acid sequences for a given protein backbone, and screening needs many candidates that are both diverse and well folded. We present HyInv, a 1.96-million-parameter backbone-conditioned graph network with an encoder-decoder architecture, trained by Hyra 2.0, the research agent developed by our team: pretrained with random-order autoregressive sequence modeling, followed by structure-reward reinforcement learning. At inference, a grouped draft-and-rewrite sampler that uses separate draft and rewrite temperatures improves refolding TM-score at matched diversity. An optimized implementation with BF16 numerics designs 128 sequences for a 402-residue backbone in 50.6 ms on a single NVIDIA H20 GPU, about 52 times faster than the reference sampler, and an exact FP32 path that returns the reference sequences is 8.7 times faster. Across five benchmark datasets and…

HyPLM Technical Report

Haowei Lin, Cai Zhou, Xiangxin Zhou

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Protein language models (PLMs) are standard tools for variant-effect prediction, protein annotation and design, but the compute needed to train and serve them keeps growing. We present HyPLM-Flash, an efficient and open PLM trained by Hyra 2.0, the research agent developed by our team. HyPLM-Flash is a 650-million-parameter masked language model trained on 726 billion tokens, 0.73 times the data of ESM-2 650M and a fifth to an eighth of the data of E1-600M and ESM C 600M. It runs on an inference engine with fused kernels and INT8 matrix multiplication, embedding about 130,000 residues per second on a single NVIDIA H20 GPU, 1.9 to 2.7 times faster than other 600M-class encoders. In a matched evaluation against 28 public checkpoints on 32 tasks, HyPLM-Flash reaches a ProteinGym zero-shot Spearman correlation of 0.409, statistically tied with ESM-2 650M, ESM C 600M and E1-600M, and the…

Multi-marginal optimal transport on sub-Riemannian manifolds

Haowei Lin

math.DG · · cited 0× · arXiv ↗ · more like this ·

In this paper, we study multi-marginal optimal transport on ideal sub-Riemannian manifolds. We establish a sub-Riemannian barycentric balance condition and prove the existence of a solution to the Monge problem under an additional assumption. We also investigate the absolute continuity of Wasserstein barycenters. Our results extend and improve upon those of Pass, Pinamonti, and Vedovato (Methods Appl. Anal. 28 (2021), 61-76) on the Heisenberg group, answering two open questions raised in their work.

L2G-SR: Learning to Guide LLM-based Symbolic Regression

Letian Huang, Xiangyu Wang, Haowei Lin +1 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Symbolic regression searches for an equation that explains observed data. Numerical error is commonly used to guide the search, but it alone can favor an accurate surrogate over a candidate with the right structure. We propose L2G-SR, a framework for LLM-based symbolic regression that guides search with a learned structural verifier. We construct structural supervision signal using tree edit distance (TED), accounting for commutative operators and alternative expression forms. A verifier first aligns numerical observations with the formulas, then learns to score a candidate's structural similarity to the target formula. At search time, the target formula is hidden and the verifier complements numerical error in parent selection. An analyst then uses verifier feedback and diagnostic tools to propose revisions, which a generator converts into refined expressions. On LLM-SRBench, L2G-SR…

SLDBench v2: Active Scaling Law Discovery

Lingbei Meng, Rui Huang, Zhirong Shen +5 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Scaling laws predict large-model performance from small experiments, but finding a reliable law itself requires costly experiments. SLDBench tests whether language-model agents can discover scaling laws when all experimental results are given upfront. We introduce SLDBench v2 with two extensions. First, we expand the corpus from 8 to 127 scenarios spanning language-model pretraining, downstream performance, and vision-language transfer, and select 30 challenging scenarios on which a reference power-law fit reaches $R^2 \le 0.8$; they represent at least $1.09 \times 10^{23}$ FLOPs of source-reported training compute. Second, we introduce active scaling law discovery: an agent chooses which experiments to run, pays each one's recorded cost (e.g., training FLOPs), and revises its law as outcomes arrive, and is scored on the same hidden extrapolation targets as in the passive setting.…

Test-Time Scaling for Scientific Equation Discovery

Haowei Lin, Hubert Lim, Xiangyu Wang +2 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Test-time scaling (TTS) improves language model reasoning by allocating additional test-time compute, but prior work mainly studies closed-ended tasks such as math and coding. We study TTS for automated equation discovery, an open-ended setting where models search over candidate equations and rely on observed datapoints for feedback. We formulate LLM-driven equation discovery as an iterative search process that unifies Best-of-N, sequential refinement, tree search, and evolution-style methods under a common compute-allocation view. To isolate allocation effects from prompt engineering and other heuristics, we compare minimal parallel controllers under fixed budgets. On LLM-SRBench equation-discovery tasks, we find that search width is the dominant allocation parameter: the best width in our sweep generally increases with the compute budget, while the population--branching split and…