arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ru Peng

50 papers · 2001–2026

2001: 12002: 02003: 02004: 42005: 12006: 42007: 22008: 12009: 22010: 22011: 32012: 12013: 12014: 12015: 02016: 02017: 02018: 02019: 02020: 02021: 22022: 12023: 22024: 82025: 42026: 10
2001peak 10 in 20262026

Frequent co-authors

Papers

showing 1–25 of 50 RSS

Qwen2 Technical Report

An Yang, Baosong Yang, Binyuan Hui +59 more

cs.CL · · cited 2,519× · arXiv ↗ · more like this ·

This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. We release a comprehensive suite of foundational and instruction-tuned language models, encompassing a parameter range from 0.5 to 72 billion, featuring dense models and a Mixture-of-Experts model. Qwen2 surpasses most prior open-weight models, including its predecessor Qwen1.5, and exhibits competitive performance relative to proprietary models across diverse benchmarks on language understanding, generation, multilingual proficiency, coding, mathematics, and reasoning. The flagship model, Qwen2-72B, showcases remarkable performance: 84.2 on MMLU, 37.9 on GPQA, 64.6 on HumanEval, 89.5 on GSM8K, and 82.4 on BBH as a base language model. The instruction-tuned variant, Qwen2-72B-Instruct, attains 9.1 on MT-Bench, 48.1 on Arena-Hard, and 35.7 on LiveCodeBench. Moreover…

Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation

Ru Peng, Yawen Zeng, Junbo Zhao

cs.CL · · cited 28× · arXiv ↗ · more like this ·

Past works on multimodal machine translation (MMT) elevate bilingual setup by incorporating additional aligned vision information. However, an image-must requirement of the multimodal dataset largely hinders MMT's development -- namely that it demands an aligned form of [image, source text, target text]. This limitation is generally troublesome during the inference phase especially when the aligned image is not provided as in the normal NMT setup. Thus, in this work, we introduce IKD-MMT, a novel MMT framework to support the image-free inference phase via an inversion knowledge distillation scheme. In particular, a multimodal feature generator is executed with a knowledge distillation module, which directly generates the multimodal feature from (only) source texts as the input. While there have been a few prior works entertaining the possibility to support image-free inference for…

An Automatic Exposure Method of Plane Array Remote Sensing Image Based on Two-Dimensional Entropy

Tan Gao, Liangliang Zheng, Wei Xu +4 more

Computer Vision and Pattern Recognition · Sensors · · cited 4× · DOI ↗ · more like this ·

The improper setting of exposure time for the space camera will cause serious image quality degradation (overexposure or underexposure) in the imaging process. In order to solve the problem of insufficient utilization of the camera's dynamic range to obtain high-quality original images, an automatic exposure method for plane array remote sensing images based on two-dimensional entropy is proposed. First, a two-dimensional entropy-based image exposure quality evaluation model is proposed. The two-dimensional entropy matrix of the image is partitioned to distinguish the saturated areas (region of overexposure and underexposure) and the unsaturated areas (region of propitious exposure) from the original image. The ratio of the saturated area is used as an evaluating indicator of image exposure quality, which is more sensitive to the brightness, edges, information volume, and…

DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning

Chengpeng Li, Guanting Dong, Mingfeng Xue +3 more

cs.CL · · cited 3× · arXiv ↗ · more like this ·

Large language models (LLMs) have made impressive progress in handling simple math problems, yet they still struggle with more challenging and complex mathematical tasks. In this paper, we introduce a series of LLMs that employs the Decomposition of thought with code assistance and self-correction for mathematical reasoning, dubbed as DotaMath. DotaMath models tackle complex mathematical tasks by decomposing them into simpler logical subtasks, leveraging code to solve these subtasks, obtaining fine-grained feedback from the code interpreter, and engaging in self-reflection and correction. By annotating diverse interactive tool-use trajectories and employing query evolution on GSM8K and MATH datasets, we generate an instruction fine-tuning dataset called DotaMathQA with 574K query-response pairs. We train a series of base LLMs using imitation learning on DotaMathQA, resulting in DotaMath…

CAME: Contrastive Automated Model Evaluation

Ru Peng, Qiuyang Duan, Haobo Wang +5 more

cs.CV · · cited 3× · arXiv ↗ · more like this ·

The Automated Model Evaluation (AutoEval) framework entertains the possibility of evaluating a trained machine learning model without resorting to a labeled testing set. Despite the promise and some decent results, the existing AutoEval methods heavily rely on computing distribution shifts between the unlabelled testing set and the training set. We believe this reliance on the training set becomes another obstacle in shipping this technology to real-world ML development. In this work, we propose Contrastive Automatic Model Evaluation (CAME), a novel AutoEval framework that is rid of involving training set in the loop. The core idea of CAME bases on a theoretical analysis which bonds the model performance with a contrastive loss. Further, with extensive empirical validation, we manage to set up a predictable relationship between the two, simply by deducing on the unlabeled/unseen testing…

Polynomial Approach for Nonlinear Modeling

Feng Ru-peng

Artificial Intelligence · Jisuanji fangzhen · · cited 3× · OpenAlex ↗ · more like this ·

A simple method of nonlinear modeling was proposed.For a nonlinear system,the input-output data were firstly changed into 0,1 by using topological homeomorphism conversion,then a initial polynomial model was selected.The parameters of polynomial model were estimated by using recursion least squares method.A final polynomial model was obtained by repeatedly estimating parameter and eliminating redundant terms.Several simulation results show the effectiveness of the method.

Improving Sample Efficiency Through Stability Enhancement in Deep-Reinforcement Learning

Ziru Wang, Wanli Jiang, Ru Peng +3 more

Artificial Intelligence · IEEE Transactions on Systems Man and Cybernetics Systems · · cited 2× · DOI ↗ · more like this ·

Prioritizing or reweighting important samples has been recognized as an effective means of improving the efficiency of deep-reinforcement learning (DRL) algorithms. However, many existing techniques encounter stability challenges, limiting efficiency and increasing computational costs and training time. In this study, we aim to improve training efficiency by exploring the intrinsic relationship between sample efficiency and stability. To achieve this, we propose the Stability Contribution Index (SI), which assigns sample priorities based on their impact on stability and employs them to weight the value loss, thereby promoting stable learning and improving efficiency. The effectiveness of our method is validated through comprehensive experiments on two distinct benchmarks: 1) the continuous control domain DMControl and 2) the discrete control environment ProcGen. Compatible with both…

Experience Consistency Distillation Continual Reinforcement Learning for Robotic Manipulation Tasks

Chao Zhao, Jie Xu, Ru Peng +3 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Continual reinforcement learning, which aims to help robots acquire skills without catastrophic forgetting, obviating the need to re-learn all tasks from scratch. In order to enable lifelong acquisition of skills in robots, replay-based continual reinforcement learning has emerged as a promising research direction. These techniques replay data from previous tasks to mitigate forgetting when learning new skills. However, existing replay-based methods store poor representative experience, and the experience utilization of old tasks is inefficient. To address these issues, we propose an experience consistency distillation method for robot continual reinforcement learning to improve the data efficiency of the experience. Specifically, the experience of old tasks are distilled to obtain Markov Decision Process (MDP) data with high compression ratio and information content. To ensure…

A Multiple Grade Proxy Signature Scheme Based on Strong Key-insulated Scheme

Ru Peng

Artificial Intelligence · Information Security and Communications Privacy · · cited 2× · OpenAlex ↗ · more like this ·

Using the idea of key-insulated scheme based on RSA designed by Wang et al. ,we present here a new multiple grade proxy signature scheme,which based on the assumption of Interger Factoration Problem. In this scheme,the first-level proxy signer can delegate the capabilities of the original signer to a new proxy signer who could generate effective signing messages on behalf of the original signer under the agreement.The new scheme based on the new Key-insulated system is more secure,and meets the requirements of the multiple grade proxy signature system.

New Fuzzy Distance Definitions of Fuzzy Numbers

Feng Ru-peng

Information Systems · Mohu xitong yu shuxue · · cited 2× · OpenAlex ↗ · more like this ·

Abstrcat In paper [1]the existing distance definitions and fuzzy distance definitions of fuzzy number are analyzed and their shortcoming is pointed out, and then a new distance definition of fuzzy number is proposed. But this distance definition does not process the character of fuzzy number. So the new (fuzzy) distance definitions are proposed in this paper, and some correlative theorems are given.

MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents

Huanyao Zhang, Jiepeng Zhou, Jiaye Lin +9 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Multimodal deep search is moving from short queries to long-horizon investigations that continually acquire evidence. However, training such agents remains constrained by limited challenging training questions and insufficient process feedback. We introduce MMSearch-OPD, combining controllable data refinement with joint reinforcement learning (RL) and on-policy distillation (OPD). Our Refine pipeline performs targeted expansion of reasoning chains derived from existing simple multimodal questions. Parameterized transformations control search depth and cross-modal evidence requirements while reusing existing image--question pairs. For training, answer rewards and lightweight behavior penalties guide RL, while the reward gap modulates token-level teacher guidance on imperfect student trajectories. An exponentially decaying distillation coefficient reduces teacher dependence as training…

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation

Qin Zhu, Qingyuan Cheng, Runyu Peng +5 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

The training process of large language models (LLMs) often involves varying degrees of test data contamination. Although current LLMs are achieving increasingly better performance on various benchmarks, their performance in practical applications does not always match their benchmark results. Leakage of benchmarks can prevent the accurate assessment of LLMs' true performance. However, constructing new benchmarks is costly, labor-intensive and still carries the risk of leakage. Therefore, in this paper, we ask the question, Can we reuse these leaked benchmarks for LLM evaluation? We propose Inference-Time Decontamination (ITD) to address this issue by detecting and rewriting leaked samples without altering their difficulties. ITD can mitigate performance inflation caused by memorizing leaked benchmarks. Our proof-of-concept experiments demonstrate that ITD reduces inflated accuracy by…

Energy-based Automated Model Evaluation

Ru Peng, Heming Zou, Haobo Wang +3 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

The conventional evaluation protocols on machine learning models rely heavily on a labeled, i.i.d-assumed testing dataset, which is not often present in real world applications. The Automated Model Evaluation (AutoEval) shows an alternative to this traditional workflow, by forming a proximal prediction pipeline of the testing performance without the presence of ground-truth labels. Despite its recent successes, the AutoEval frameworks still suffer from an overconfidence issue, substantial storage and computational cost. In that regard, we propose a novel measure -- Meta-Distribution Energy (MDE) -- that allows the AutoEval framework to be both more efficient and effective. The core of the MDE is to establish a meta-distribution statistic, on the information (energy) associated with individual samples, then offer a smoother representation enabled by energy-based learning. We further…

Deps-SAN: Neural Machine Translation with Dependency-Scaled Self-Attention Network

Ru Peng, Nankai Lin, Yi Fang +4 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Syntax knowledge contributes its powerful strength in Neural machine translation (NMT) tasks. Early NMT works supposed that syntax details can be automatically learned from numerous texts via attention networks. However, succeeding researches pointed out that limited by the uncontrolled nature of attention computation, the NMT model requires an external syntax to capture the deep syntactic awareness. Although existing syntax-aware NMT methods have born great fruits in combining syntax, the additional workloads they introduced render the model heavy and slow. Particularly, these efforts scarcely involve the Transformer-based NMT and modify its core self-attention network (SAN). To this end, we propose a parameter-free, Dependency-scaled Self-Attention Network (Deps-SAN) for syntax-aware Transformer-based NMT. A quantified matrix of dependency closeness between tokens is constructed to…

THE SYSTEM OF THE REAL TIME MARINE DATA TRANSMISSION NETWORK BASED ON XML

Sun Ru-peng

Artificial Intelligence · Marine Forecasts · · cited 1× · OpenAlex ↗ · more like this ·

The necessity to access the ever greater quantities of marine data to support a broad range of marine information products,including ocean disaster prediction and forecast,has been increasing rapidly over the recent years. At the same time,the capability of data integration and the data use utilization in marine information fields have not achieved for such needs. This was mainly caused by the complexity of marine data,the multiformity of data source,the difference of the information platforms and the nonstandard format of data. To overcome these problems,authors proposed a structure of the system of the real time marine data transmission network based on XML combined with Socket interface. The system unified the format of data integration and data exchange,shielded the effect factors of data integration and the data use utilization. Authors commit themselves to apply the XML to the…

From Structural Feedback to Prompt Policies: Learning Faithful Text-to-Image Prompt Editors

Wentao Ye, Yali Ye, Zhiqing Xiao +7 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Prompt optimization should improve the image a user receives without changing the scene the user requested. Yet stylistic rewriting can weaken object attributes and relations even when global text--image similarity remains high. We propose StruPO, a structure-aware prompt editor that uses a calibrated scene graph as a shared representation for policy conditioning and image-grounded supervision. The graph exposes what should be preserved, while deletion, reordering, and insertion provide a token-aligned way to modify the prompt. This turns structural feedback from an external critique into a training signal for a reusable editing policy. Learning from that signal requires handling both uncertain grounding and stochastic image generation. StruPO retains grounding confidence through smooth reward shaping and averages multiple images for each edit before computing group-relative advantages.…

Inter-Slice Representation Outweighs Bounding-Box Supervision Extent in Lightweight 2.5D Pulmonary Nodule Detection: A Whole-Volume Benchmark on LUNA16

Lien-Feng Chou, Bing-Ru Peng, Shou-Wei Chien +1 more

Artificial Intelligence · Diagnostics · · cited 0× · DOI ↗ · more like this ·

Background/Objectives: Lightweight detectors are attractive for high-throughput low-dose CT lung-cancer screening, yet the training-time choices governing their accuracy are usually fixed without justification, as is the protocol used to evaluate them. We benchmarked the inter-slice input representation and the extent of bounding-box supervision for 2.5D pulmonary nodule detection under the official LUNA16 protocol. Methods: Using one YOLO11n backbone we compared a 2D central-slice baseline, thin-slab maximum-intensity projection, and adjacent-slice 2.5D input under loose and core-focused (60% of diameter) supervision. Evaluation followed the official subset0–subset9 ten-fold protocol over all 888 scans and 1186 nodules, with whole-volume inference across 227,225 axial slices, annotations_excluded.csv applied, and paired scan-level bootstrap intervals. Supervision ratio, minimum box…

DataMan: Data Manager for Pre-training Large Language Models

Ru Peng, Kexin Yang, Yawen Zeng +3 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

The performance emergence of large language models (LLMs) driven by data scaling laws makes the selection of pre-training data increasingly important. However, existing methods rely on limited heuristics and human intuition, lacking comprehensive and clear guidelines. To address this, we are inspired by ``reverse thinking'' -- prompting LLMs to self-identify which criteria benefit its performance. As its pre-training capabilities are related to perplexity (PPL), we derive 14 quality criteria from the causes of text perplexity anomalies and introduce 15 common application domains to support domain mixing. In this paper, we train a Data Manager (DataMan) to learn quality ratings and domain recognition from pointwise rating, and use it to annotate a 447B token pre-training corpus with 14 quality ratings and domain type. Our experiments validate our approach, using DataMan to select 30B…

LLM-Enhanced Query Generation and Retrieval Preservation for Task-Oriented Dialogue

Jiale Chen, Xuelian Dong, Wenxiu Xie +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Knowledge retrieval and response generation are fundamental to task-oriented dialogue systems.However, dialogue context frequently contains noisy or irrelevant information, leading to sub-optimal result in knowledge retrieval.One possible approach to retrieving knowledge is to manually annotate standard queries for each dialogue.Yet, this approach is hindered by the challenge of data scarcity, as human annotation is costly.To solve the challenge, we propose an LLM-enhanced model of query-guided knowledge retrieval for task-oriented dialogue.It generates high-quality queries for knowledge retrieval in task-oriented dialogue solely using low-resource annotated queries.To strengthen the performance correlation between response generation and knowledge retrieval, we propose a retrieval preservation mechanism by further selecting the most relevant knowledge from retrieved top-K records and…

Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model

Chenhan Yuan, Fei Huang, Ru Peng +4 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Transformer-based large language models (LLMs) exhibit limitations such as generating unsafe responses, unreliable reasoning, etc. Existing inference intervention approaches attempt to mitigate these issues by finetuning additional models to produce calibration signals (such as rewards) that guide the LLM's decoding process. However, this solution introduces substantial time and space overhead due to the separate models required. This work proposes Non-disruptive parameters insertion (Otter), inserting extra parameters into the transformer architecture to predict calibration signals along with the original LLM output. Otter offers state-of-the-art performance on multiple demanding tasks while saving up to 86.5\% extra space and 98.5\% extra time. Furthermore, Otter seamlessly integrates with existing inference engines, requiring only a one-line code change, and the original model…

Which API is Faster: Mining Fine-grained Performance Opinion from Online Discussions

Yue-Kai Huang, Junjie Wang, Song Wang +2 more

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

Inefficient API usage is one of the main reasons for software performance issues. Current practice of API documentation mainly provides its functionalities, while the performance related information are seldom covered in the official documentation. Meanwhile, the online discussions brings various pieces of information about the efficiency of API, yet buried in massive messages. Existing approaches would derive API opinion with pattern-based techniques, and typically result in inaccurate and coarse-grained result. This paper proposes a relation-aware approach RAMiner for the fine-grained API-related performance opinion mining from online discussions. It leverages pre-trained Large Language Model (LLM), thus can better capture the semantics of the text and API tokens. Besides, it disentangles the task into subtasks to cope with the situation of limited labeled data for fine-tuning the…

Better Sign Language Translation with Monolingual Data

Ru Peng, Yawen Zeng, Junbo Zhao

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Sign language translation (SLT) systems, which are often decomposed into video-to-gloss (V2G) recognition and gloss-to-text (G2T) translation through the pivot gloss, heavily relies on the availability of large-scale parallel G2T pairs. However, the manual annotation of pivot gloss, which is a sequence of transcribed written-language words in the order in which they are signed, further exacerbates the scarcity of data for SLT. To address this issue, this paper proposes a simple and efficient rule transformation method to transcribe the large-scale target monolingual data into its pseudo glosses automatically for enhancing the SLT translation. Empirical results show that the proposed approach can significantly improve the performance of SLT, especially achieving state-of-the-art results on two SLT benchmark datasets PHEONIX-WEATHER 2014T and ASLG-PC12. Our code has been released at…

Estimation of microscale strain fields in a pearlitic steel using DIC and in-situ SEM

Erik Lindfeldt, Johan Ahlström, Magnus Hörnqvist Colliander +1 more

Computer Vision and Pattern Recognition · Chalmers Publication Library (Chalmers University of Technology) · · cited 0× · OpenAlex ↗ · more like this ·

In this contribution the Digital Image Correlation (DIC) technique is used to identify strain fields within a pearlitic microstructure from in-situ obtained SEM images. Typically this is done using a synthetic speckle but in this study the intensity field variations, related to the\nmicrostructure of pearlite, are used as a natural speckle.\n\nAs a means to avoid subsets with inadequate information content (in terms of intensity field variations) a tracebility criterion is introduced. This criterion is based on the eigenvalues of the Hessian of the autocorrelation function. A pertaining algorithm, which can be used to identify high quality subsets (in terms of tracebility) within a certain Region Of Interest (ROI),\nis also presented. By using the obtained irregular subsets grids together with synthetically deformed images the\ndisplacement and deformation gradient errors (both local…

Research of the Distributed Focused Crawler for an Automotive News Push System

Haibo Zhang, Ru Peng Dou, Wen Bin Wang

Information Systems · Applied Mechanics and Materials · · cited 0× · DOI ↗ · more like this ·

With the development of automobile industry, more and more people need automotive information. Meanwhile, there’s a great deal of network information which makes people gather information hard. To make people acquire the automotive information more efficiently, an Automotive News Push System is desperately needed. A distributed focused crawler is proposed for the system to assure that the information is accurate and timely. In this paper, distributed system framework and webpage classification are analyzed. Experimental results show that the frameworkare effective, the accuracy and efficiency of crawling are both improved.

The Integrated Platform of Crop Condition Monitoring Diagnosis

Feng Yu, You Zhao, Su Fen Sun +2 more

Information Systems · Advanced materials research · · cited 0× · DOI ↗ · more like this ·

Crop monitoring play an important role in the management of agricultural production. This paper presents an integrated platform of crop condition monitoring and diagnosis based on internet of things, as well as its structure and function design. The platform adopted the technology of the internet of things; it achieved fine management of seed and cultivates process by the means of agriculture information real-time collection and monitoring. The platform has certain application value in many agriculture activities, such as livestock management, aquaculture and other and so on.