arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Zehao Lin

62 papers · 2018–2026

2018: 12019: 22020: 52021: 52022: 72023: 22024: 122025: 102026: 18
2018peak 18 in 20262026

Frequent co-authors

Papers

showing 1–25 of 62 RSS

Similar Scenes arouse Similar Emotions: Parallel Data Augmentation for Stylized Image Captioning

Guodun Li, Yuchen Zhai, Zehao Lin +1 more

cs.CV · · cited 23× · arXiv ↗ · more like this ·

Stylized image captioning systems aim to generate a caption not only semantically related to a given image but also consistent with a given style description. One of the biggest challenges with this task is the lack of sufficient paired stylized data. Many studies focus on unsupervised approaches, without considering from the perspective of data augmentation. We begin with the observation that people may recall similar emotions when they are in similar scenes, and often express similar emotions with similar style phrases, which underpins our data augmentation idea. In this paper, we propose a novel Extract-Retrieve-Generate data augmentation framework to extract style phrases from small-scale stylized sentences and graft them to large-scale factual captions. First, we design the emotional signal extractor to extract style phrases from small-scale stylized sentences. Second, we construct…

Task-Oriented Conversation Generation Using Heterogeneous Memory Networks

Zehao Lin, Xinjing Huang, Feng Ji +2 more

cs.CL · · cited 20× · arXiv ↗ · more like this ·

How to incorporate external knowledge into a neural dialogue model is critically important for dialogue systems to behave like real humans. To handle this problem, memory networks are usually a great choice and a promising way. However, existing memory networks do not perform well when leveraging heterogeneous information from different sources. In this paper, we propose a novel and versatile external memory networks called Heterogeneous Memory Networks (HMNs), to simultaneously utilize user utterances, dialogue history and background knowledge tuples. In our method, historical sequential dialogues are encoded and stored into the context-aware memory enhanced by gating mechanism while grounding knowledge tuples are encoded and stored into the context-free memory. During decoding, the decoder augmented with HMNs recurrently selects each word in one response utterance from these two…

Teacher-Student Framework Enhanced Multi-domain Dialogue Generation

Shuke Peng, Xinjing Huang, Zehao Lin +3 more

cs.CL · · cited 17× · arXiv ↗ · more like this ·

Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply a state tracker to extract these features. However, the performance of such a system is limited by the error propagation of a state tracker. In this paper, we propose a dialogue generation model that needs no external state trackers and still benefits from human-labeled semantic data. By using a teacher-student framework, several teacher models are firstly trained in their individual domains, learn dialogue policies from labeled states. And then the learned knowledge and experience are merged and transferred to a universal student model, which takes raw utterance as its input. Experiments show that the dialogue system trained under our framework outperforms the one uses…

<scp>XCode</scp> : Towards Cross-Language Code Representation with Large-Scale Pre-Training

Zehao Lin, Guodun Li, Jingfeng Zhang +4 more

Information Systems · ACM Transactions on Software Engineering and Methodology · · cited 15× · DOI ↗ · more like this ·

Source code representation learning is the basis of applying artificial intelligence to many software engineering tasks such as code clone detection, algorithm classification, and code summarization. Recently, many works have tried to improve the performance of source code representation from various perspectives, e.g., introducing the structural information of programs into latent representation. However, when dealing with rapidly expanded unlabeled cross-language source code datasets from the Internet, there are still two issues. Firstly, deep learning models for many code-specific tasks still suffer from the lack of high-quality labels. Secondly, the structural differences among programming languages make it more difficult to process multiple languages in a single neural architecture. To address these issues, in this article, we propose a novel Cross -language Code representation…

MTSS: Learn from Multiple Domain Teachers and Become a Multi-domain Dialogue Expert

Shuke Peng, Feng Ji, Zehao Lin +3 more

cs.CL · · cited 7× · arXiv ↗ · more like this ·

How to build a high-quality multi-domain dialogue system is a challenging work due to its complicated and entangled dialogue state space among each domain, which seriously limits the quality of dialogue policy, and further affects the generated response. In this paper, we propose a novel method to acquire a satisfying policy and subtly circumvent the knotty dialogue state representation problem in the multi-domain setting. Inspired by real school teaching scenarios, our method is composed of multiple domain-specific teachers and a universal student. Each individual teacher only focuses on one specific domain and learns its corresponding domain knowledge and dialogue policy based on a precisely extracted single domain dialogue state representation. Then, these domain-specific teachers impart their domain knowledge and policies to a universal student model and collectively make this…

Memory$^3$: Language Modeling with Explicit Memory

Hongkang Yang, Zehao Lin, Wenjin Wang +9 more

Artificial Intelligence · Journal of Machine Learning · · cited 4× · DOI ↗ · more like this ·

The training and inference of large language models (LLMs) are together a costly process that transports knowledge from raw data to meaningful computation. Inspired by the memory hierarchy of the human brain, we reduce this cost by equipping LLMs with explicit memory, a memory format cheaper than model parameters and text retrieval-augmented generation (RAG). Conceptually, with most of its knowledge externalized to explicit memories, the LLM can enjoy a smaller parameter size, training cost, and inference cost, all proportional to the amount of remaining “abstract knowledge”. As a preliminary proof of concept, we train from scratch a 2.4 B LLM, which achieves better performance than much larger LLMs as well as RAG models, and maintains higher decoding speed than RAG. The model is named ${\rm Memory}^3$, since explicit memory is the third form of memory in LLMs after implicit memory…

MemT-1.0: Towards Memory-Native Evolution

Zhiyu Li, Zeyu Zhang, Linyun Liu +71 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

Memory-native evolution requires making memory an intrinsic capability of foundation models, enabling them to continuously accumulate and utilize information. To this end, we introduce MemT-1.0, a new architecture of memory foundation models that internalize memory as part of model computation. Building on Metis, MemT-1.0 employs Gated DeltaNet-2 with a stable token-level memory update mechanism within each turn. We further introduce Mixture-of-Storage to scale native memory capacity. Following a deliberate backbone preparation, we develop a two-stage training pipeline consisting of continued pre-training and post-training, supported by 34B tokens of training data and efficient training and inference infrastructure. We release a model family comprising MemT-1.0-Nano and MemT-1.0-Flash, and conduct a comprehensive evaluation of memory and general capabilities. The results show that they…

Predict-then-Decide: A Predictive Approach for Wait or Answer Task in Dialogue Systems

Zehao Lin, Shaobo Cui, Guodun Li +6 more

cs.CL · · cited 2× · arXiv ↗ · more like this ·

Different people have different habits of describing their intents in conversations. Some people tend to deliberate their intents in several successive utterances, i.e., they use several consistent messages for readability instead of a long sentence to express their question. This creates a predicament faced by the application of dialogue systems, especially in real-world industry scenarios, in which the dialogue system is unsure whether it should answer the query of user immediately or wait for further supplementary input. Motivated by such an interesting predicament, we define a novel Wait-or-Answer task for dialogue systems. We shed light on a new research topic about how the dialogue system can be more intelligent to behave in this Wait-or-Answer quandary. Further, we propose a predictive approach named Predict-then-Decide (PTD) to tackle this Wait-or-Answer task. More specifically…

The Value of Memory in Language Agents

Zehao Lin, Erenkai Zhu, Helan Hu +6 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

Language agents carry information from past experience into future tasks whose demands may be unknown or change over time. We develop a decision-theoretic account of the capability available in history, retained in storage and realized through use, together with the costs of recovery and revision. Drawing on comparison of statistical experiments, information acquisition and the value of computation, we express these values in units of avoided task loss. Recovery and revision define attainable risk-cost profiles and preservation across uses. A cost-aware simulation condition and five minimal counterexamples establish how information timing, access, computation, feedback and demand shape these comparisons; a pointer with zero answer mutual information can reduce the cost of exact recovery. Allocation and recovery criteria identify when gains pay for estimation, selection and evidence…

MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models

Zhiyu Li, Shichao Song, Hanyu Wang +19 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a unified and structured architecture for handling memory. They primarily rely on parametric memory (knowledge encoded in model weights) and ephemeral activation memory (context-limited runtime states). While emerging methods like Retrieval-Augmented Generation (RAG) incorporate plaintext memory, they lack lifecycle management and multi-modal integration, limiting their capacity for long-term knowledge evolution. To address this, we introduce MemOS, a memory operating system designed for LLMs that, for the first time, elevates memory to a first-class operational resource. It builds unified mechanisms for representation, organization, and governance…

MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object Scenarios

Jiacheng Ruan, Wenzhen Yuan, Zehao Lin +5 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Large visual-language models (LVLMs) have achieved great success in multiple applications. However, they still encounter challenges in complex scenes, especially those involving camouflaged objects. This is primarily due to the lack of samples related to camouflaged scenes in the training dataset. To mitigate this issue, we construct the MM-CamObj dataset for the first time, comprising two subsets: CamObj-Align and CamObj-Instruct. Specifically, CamObj-Align contains 11,363 image-text pairs, and it is designed for VL alignment and injecting rich knowledge of camouflaged scenes into LVLMs. CamObj-Instruct is collected for fine-tuning the LVLMs with improved instruction-following capabilities, and it includes 11,363 images and 68,849 conversations with diverse instructions. Based on the MM-CamObj dataset, we propose the CamObj-Llava, an LVLM specifically designed for addressing tasks in…

$\text{Memory}^3$: Language Modeling with Explicit Memory

Hongkang Yang, Zehao Lin, Wenjin Wang +13 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

The training and inference of large language models (LLMs) are together a costly process that transports knowledge from raw data to meaningful computation. Inspired by the memory hierarchy of the human brain, we reduce this cost by equipping LLMs with explicit memory, a memory format cheaper than model parameters and text retrieval-augmented generation (RAG). Conceptually, with most of its knowledge externalized to explicit memories, the LLM can enjoy a smaller parameter size, training cost, and inference cost, all proportional to the amount of remaining "abstract knowledge". As a preliminary proof of concept, we train from scratch a 2.4B LLM, which achieves better performance than much larger LLMs as well as RAG models, and maintains higher decoding speed than RAG. The model is named $\text{Memory}^3$, since explicit memory is the third form of memory in LLMs after implicit memory…

Dialogue State Tracking with Multi-Level Fusion of Predicted Dialogue States and Conversations

Jingyao Zhou, Haipang Wu, Zehao Lin +2 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot-value pairs. Although the context contains the complete dialogue information, the information is usually indirect and even requires reasoning to obtain. The information in the lastly predicted dialogue states is direct, but when there is a prediction error, the dialogue information from this source will be incomplete or erroneous. In this paper, we propose the Dialogue State Tracking with Multi-Level Fusion of Predicted Dialogue States and Conversations network (FPDSC). This model extracts information of each dialogue turn by modeling interactions among each turn utterance, the corresponding last dialogue states, and dialogue slots. Then the representation of each dialogue turn is aggregated by a hierarchical…

"Wait, I'm Still Talking!" Predicting the Dialogue Interaction Behavior Using Imagine-Then-Arbitrate Model

Zehao Lin, Shaobo Cui, Guodun Li +6 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Producing natural and accurate responses like human beings is the ultimate goal of intelligent dialogue agents. So far, most of the past works concentrate on selecting or generating one pertinent and fluent response according to current query and its context. These models work on a one-to-one environment, making one response to one utterance each round. However, in real human-human conversations, human often sequentially sends several short messages for readability instead of a long message in one turn. Thus messages will not end with an explicit ending signal, which is crucial for agents to decide when to reply. So the first step for an intelligent dialogue agent is not replying but deciding if it should reply at the moment. To address this issue, in this paper, we propose a novel Imagine-then-Arbitrate (ITA) neural dialogue model to help the agent decide whether to wait or to make a…

When Does Better Confidence Improve a Knowledge-Graph Audit?

Zehao Lin, Kai Chen, Xixuan Hao +4 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Confidence estimates guide human review in LLM-built knowledge graphs, but an erroneous shared entity need not be the only reason an incident fact is wrong. We study how this distinction affects budgeted audits, alongside selection headroom and label validity. Modelling non-adaptive auditing as budgeted covering, we characterise the minimal decision-relevant error statistics and bound the regret of scalar-preserving first-order planning by a structural mass $Δ^{\mathrm{cl}}$. We simulate ideal repair against benchmark-aligned labels for five extraction configurations and two cross-document graphs on Re-DocRED, followed by frozen confirmation on test and replication on 500 hash-selected training documents. An error-rate $\times$ fan-out baseline leaves 3.98-4.74 percentage points more errors than joint planning with the same actions. Independent-block planning also avoids this…

Gaia DR3 Reveals the Kinematics of Young Stellar Objects in the Carina Nebula: Peripheral Expansion and Central Rotation

Xinyu Yang, Yuxin He, Chaojie Hao +10 more

astro-ph.GA · · cited 0× · arXiv ↗ · more like this ·

We investigate the kinematics of the Carina Nebula using a sample of young stellar objects (YSOs) cross-matched with Gaia DR3, together with $^{12}\mathrm{CO}\,(1\mbox{--}0)$ molecular gas observations and APOGEE radial-velocity data. The results show that the proper motions of the YSOs in the four peripheral subregions of Carina display a systematic outward expansion, and that the two-dimensional expansion velocities of the subregions are approximately $0.57\mbox{--}4.56~\mathrm{km\,s^{-1}}$. The YSOs in the Central Region exhibit ordered rotation around an axis at a position angle of $86.9\pm1.5^\circ$, with a rotation velocity of $1.75\pm0.03~\mathrm{km\,s^{-1}}$. Further momentum estimates suggest that the current expansion in the peripheral regions may result from the combined effects of feedback from massive OB stars and possible past supernova explosions. These results indicate…

Gaia DR3 Compact Binary Candidates Constrained by Radial Velocity Measurements

Ying-jie Li, Xianjin Shen, Zehao Lin +7 more

astro-ph.SR · · cited 0× · arXiv ↗ · more like this ·

Astrometry enables the most direct determination of the orbital elements and component masses of compact binaries. The potential of the current Gaia data for this purpose has not yet been fully explored. In this work, we combine Gaia astrometric and radial velocity (RV) measurements to perform joint orbital fitting for 1,835 Gaia astrometric binaries with available RV data. Among the 518 systems with at least three effective RV epochs, we identify 171 compact binary candidates, including four with inferred dark companion masses exceeding 2.1 $M_{\odot}$ and 22 between 1.4 and 2.1 $M_{\odot}$. These candidates provide valuable targets for future follow-up observations and Gaia DR4 analyses. We also flag 1,317 additional potential compact binary candidates with effective RV epochs less than three, including 84 with inferred companion masses above 2.1 $M_{\odot}$ and 173 between 1.4 and…

Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

Zehao Lin, Qianfeng Shen, Xixuan Hao +8 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding. Hierarchical RAG is one such setting: at each frontier of a document tree, an LLM commits to $b$ of $k$ sections under an input-dependent action grammar, executed as either failure-prone free-form JSON or reliable but strictly serial grammar-constrained generation. We show that this serialization is unnecessary for bounded-horizon control: the reachable future forms a shallow action-prefix tree, which we compile --- one root prefill plus one tree-causal probe evaluate every prefix-conditioned action distribution with serial decoding's tokens, positions, and causal ancestry. A prefix-state lemma makes compiled control policy-exact in exact arithmetic: the same policy with a two-forward critical path and zero output tokens. One…

High-Priority Compact-Object Candidates in Young Clusters from the \textit{Gaia} DR3 Non-Single-Star Catalog

Dejian Liu, Kangteng Chang, Yao Huang +7 more

astro-ph.GA · · cited 0× · arXiv ↗ · more like this ·

The search for massive compact objects such as black holes (BHs) or neutron stars (NSs) in star clusters is longstanding challenge in astrophysics, yet no definitive identification of such compact objects in young clusters has been reported. In this Letter, we construct a sample of high-priority candidates for follow-up investigation. By cross-matching the cluster catalog with the Gaia Non-Single-Star database and estimating companion masses, we identify 13 systems with companion masses exceeding 1.4~$M_{\odot}$, three of which have masses above 2.1~$M_{\odot}$. Applying our newly developed Astrometric Mass-Ratio Function (AMRF) classification based on cluster-specific isochrones, we identify three systems whose companions cannot readily be explained by a single main-sequence star or an unresolved close binary. These systems have inferred companion masses exceeding 2.1~$M_{\odot}$…

Morphological Statistic of Milky Way-like Galaxies

Zehao Lin, Junye Wei, Ye Xu +5 more

astro-ph.GA · · cited 0× · arXiv ↗ · more like this ·

We analyze the spiral morphology of 1,738 nearby galaxies with similar Hubble type of the Milky Way ($i<60^\circ$, $z<0.048$) using multi-band optical images from the Sloan Digital Sky Survey and Digitized Sky Survey. Multiple-arm systems dominate, comprising $\sim$50-60% of the sample and $\sim$75% of large galaxies ($d_{\rm max} \geqslant 18~\mathrm{kpc}$). In $90\pm3$% of multiple-arm galaxies, two inner arms extend into multiple outer arms; three-arm inner structures occur in $9\pm2$%, and four or more are rare ($<1$%). Morphology and inner-arm counts are consistent across bands at $\sim$80%. Bifurcation points, marking the transition from two inner arms to multiple outer arms, occur in up to $\sim$40% of galaxies, are more prominent in bluer bands tracing younger stellar populations, and cluster within 4-7~kpc of galaxy centers. These statistics suggest that the Milky Way's inner…

First Trigonometric Parallax Measurements with the KVN and VERA Array (KaVA)

Nobuyuki Sakai, Daisuke Sakai, Noriyuki Kawaguchi +26 more

astro-ph.GA · · cited 0× · arXiv ↗ · more like this ·

To demonstrate the astrometric capability of the combined Korean VLBI (Very Long Baseline Interferometry) Network (KVN) and VLBI Exploration of Radio Astrometry (VERA) Array (KaVA), we conducted six-epoch VLBI observations of 22-GHz H$_{2}$O masers associated with the star-forming region W3(OH). Two atmospheric calibration methods, (1) GPS and (2) JMA (Japan Meteorological Agency) mesoscale analysis data, and two phase-reference sources were independently applied to the astrometric analysis. Trigonometric parallaxes of W3(OH) were successfully measured with all calibration strategies, including the first successful parallax measurement using JMA calibration. The combined-fit parallax is 0.497$\pm$0.024 mas, corresponding to a distance of 2.01$^{+0.10}_{-0.09}$ kpc. This value is consistent with the previous Very Long Baseline Array (VLBA) result of 0.489$\pm$0.017 mas. KaVA achieved a…

Star Formation in the H II Region Sh 2-205: 3D Morphology and Kinematics from Young Stars and Molecular Gas

Yiwei Dong, Chaojie Hao, Ye Xu +5 more

astro-ph.GA · · cited 0× · arXiv ↗ · more like this ·

Using Gaia astrometry of young stars combined with CO observations, we present the first systematic three-dimensional (3D) analysis of the structure, kinematics, and evolutionary history of the star-forming regions in the environs of the H II region Sh 2-205 (S205). S205 exhibits a complex morphology and coherent expansion on both global and subregional scales. We identify several O9-B1 stars and a 0.56 Myr old pulsar that are likely associated with the region. A momentum estimate suggests that feedback from these objects may account for the observed overall expansion. Trace-back analysis of the expansion, combined with color-magnitude diagram fitting for young star clusters, indicates at least two episodes of star formation. These results reveal a complex star-formation history of S205 and provide new insights into its 3D evolution.

200 mm Wafer-Scale Monolithic 3D Integration of Atomic Layer-Deposited Oxide Semiconductors

Chang Niu, Linjia Long, Luqi Zheng +9 more

physics.app-ph · · cited 0× · arXiv ↗ · more like this ·

Monolithic 3D (M3D) integration offers a pathway to overcome the scaling limits of conventional silicon complementary metal-oxide-semiconductor (CMOS) technology by extending dense vertical stacking of multifunctional logic and memory devices. Here, we demonstrate wafer-scale M3D integration of three tiers of atomic-layer-deposited (ALD) indium oxide (InOx)-based devices (>100,000 fabricated), including ferroelectric, enhancement-mode, and depletion-mode field-effect transistors, on 200 mm silicon wafers. We achieve threshold voltage standard deviation as low as 0.04 V, average electron mobility up to 91.6 cm2V-1s-1, and fully functional cross-tier circuits. A four-tier 3D computing-in-memory (CIM) accelerator targeting large language model workloads is developed using a custom InOx process design kit, delivering 1.4x to 2.9x speedup and comparable energy-delay product improvements over…

TAdaRAG: Task Adaptive Retrieval-Augmented Generation via On-the-Fly Knowledge Graph Construction

Jie Zhang, Bo Tang, Wanzi Shao +8 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Retrieval-Augmented Generation (RAG) improves large language models by retrieving external knowledge, often truncated into smaller chunks due to the input context window, which leads to information loss, resulting in response hallucinations and broken reasoning chains. Moreover, traditional RAG retrieves unstructured knowledge, introducing irrelevant details that hinder accurate reasoning. To address these issues, we propose TAdaRAG, a novel RAG framework for on-the-fly task-adaptive knowledge graph construction from external sources. Specifically, we design an intent-driven routing mechanism to a domain-specific extraction template, followed by supervised fine-tuning and a reinforcement learning-based implicit extraction mechanism, ensuring concise, coherent, and non-redundant knowledge integration. Evaluations on six public benchmarks and a real-world business benchmark (NowNewsQA)…

Innovator: Scientific Continued Pretraining with Fine-grained MoE Upcycling

Ning Liao, Xiaoxing Wang, Zehao Lin +18 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

A large language model (LLM) with knowledge in both scientific and general tasks is the foundation of science general intelligence. However, directly continued pretraining an LLM using science data usually leads to catastrophic forgetting, which indicates severe degradation in general ability. In this report, we present Innovator, which solves this problem by upcycling a pre-trained dense LLM into a fine-grained Mixtures-of-Experts model during continued pretraining, where different experts are expected to learn science knowledge in different disciplines, and a shared expert is utilized for general tasks. Innovator introduces a four-stage upcycle training paradigm: (1) Scientific Expert Induction on discipline-specific data, (2) Fine-grained Expert Splitting via FFN dimension decomposition, (3) Science-Aware Routing warmup, and (4) Generalist-Scientist Integration training on hybrid…