Author

Yu Wan

183 papers · 2000–2026

2000peak 16 in 20232026

Frequent co-authors

Papers

showing 1–25 of 183 RSS

Qwen3 Technical Report

An Yang, Anfeng Li, Baosong Yang +57 more

cs.CL · 14 May 2025 · cited 8,634× · arXiv ↗ · more like this ·

In this work, we present Qwen3, the latest version of the Qwen model family. Qwen3 comprises a series of large language models (LLMs) designed to advance performance, efficiency, and multilingual capabilities. The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion. A key innovation in Qwen3 is the integration of thinking mode (for complex, multi-step reasoning) and non-thinking mode (for rapid, context-driven responses) into a unified framework. This eliminates the need to switch between different models--such as chat-optimized models (e.g., GPT-4o) and dedicated reasoning models (e.g., QwQ-32B)--and enables dynamic mode switching based on user queries or chat templates. Meanwhile, Qwen3 introduces a thinking budget mechanism, allowing users to allocate computational resources adaptively during…

Qwen2.5 Technical Report

Qwen, :, An Yang +41 more

cs.CL · December 2024 · cited 5,256× · arXiv ↗ · more like this ·

In this report, we introduce Qwen2.5, a comprehensive series of large language models (LLMs) designed to meet diverse needs. Compared to previous iterations, Qwen 2.5 has been significantly improved during both the pre-training and post-training stages. In terms of pre-training, we have scaled the high-quality pre-training datasets from the previous 7 trillion tokens to 18 trillion tokens. This provides a strong foundation for common sense, expert knowledge, and reasoning capabilities. In terms of post-training, we implement intricate supervised finetuning with over 1 million samples, as well as multistage reinforcement learning. Post-training techniques enhance human preference, and notably improve long text generation, structural data analysis, and instruction following. To handle diverse and varied use cases effectively, we present Qwen2.5 LLM series in rich sizes. Open-weight…

Qwen2 Technical Report

An Yang, Baosong Yang, Binyuan Hui +59 more

cs.CL · July 2024 · cited 2,519× · arXiv ↗ · more like this ·

This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. We release a comprehensive suite of foundational and instruction-tuned language models, encompassing a parameter range from 0.5 to 72 billion, featuring dense models and a Mixture-of-Experts model. Qwen2 surpasses most prior open-weight models, including its predecessor Qwen1.5, and exhibits competitive performance relative to proprietary models across diverse benchmarks on language understanding, generation, multilingual proficiency, coding, mathematics, and reasoning. The flagship model, Qwen2-72B, showcases remarkable performance: 84.2 on MMLU, 37.9 on GPQA, 64.6 on HumanEval, 89.5 on GSM8K, and 82.4 on BBH as a base language model. The instruction-tuned variant, Qwen2-72B-Instruct, attains 9.1 on MT-Bench, 48.1 on Arena-Hard, and 35.7 on LiveCodeBench. Moreover…

An Improved YOLOv5 Method for Small Object Detection in UAV Capture Scenes

Zhen Liu, Xuehui Gao, Yu Wan +2 more

Computer Vision and Pattern Recognition · IEEE Access · 2023 · cited 103× · DOI ↗ · more like this ·

Aiming at the problem of a large number of small dense objects in high-altitude shooting and complex background noise interference in the captured scenes, an improved object detection algorithm for YOLOv5 UAV capture scenes is proposed. A Feature Enhancement Block (FEBlock) is first proposed to generate adaptive weights for different receptive field features by convolution, assigning major weights to shallow feature maps to improve small object feature extraction ability. The FEBlock is then integrated into Spatial Pyramid Pooling (SPP) to generate Enhanced Spatial Pyramid Pooling (ESPP), which performs feature enhancement for the result of each maximum pooling; and creates new features containing multi-scale contextual information with better feature characterization capability by weighting fused contextual features. Secondly, the Self-Characteristic Expansion Plate (SCEP) is proposed…

Uncertainty-Aware Curriculum Learning for Neural Machine Translation

Yikai Zhou, Baosong Yang, Derek F. Wong +2 more

Artificial Intelligence · 2020 · cited 79× · DOI ↗ · more like this ·

Neural machine translation (NMT) has proven to be facilitated by curriculum learning which presents examples in an easy-to-hard order at different training stages. The keys lie in the assessment of data difficulty and model competence. We propose uncertainty-aware curriculum learning, which is motivated by the intuition that: 1) the higher the uncertainty in a translation pair, the more complex and rarer the information it contains; and 2) the end of the decline in model uncertainty indicates the completeness of current training stage. Specifically, we serve cross-entropy of an example as its data difficulty and exploit the variance of distributions over the weights of the network to present the model uncertainty. Extensive experiments on various translation tasks reveal that our approach outperforms the strong baseline and related methods on both translation quality and convergence…

An online adaptive learning environment for critical‐thinking‐infused <scp>E</scp> nglish literacy instruction

Yating Yang, Jeffrey Hugh Gamble, Yu‐Wan Hung +1 more

Education · British Journal of Educational Technology · 3 Jul 2013 · cited 78× · DOI ↗ · more like this ·

Abstract Critical thinking ( CT ) and E nglish literacy are two essential 21st century competencies that are a priority for teaching and learning in an increasingly digital learning environment. Taking advantage of innovations in educational technology, this study empirically investigates the effectiveness of CT ‐infused adaptive E nglish literacy instruction using a M oodle system. A one‐group pretest–posttest design was employed to evaluate the effect of the treatment on students' acquisition of CT skills ( CTS ) and E nglish literacy. A total of 83 students enrolled in two sections of a general studies course at a large university in T aiwan participated in the semester‐long experiment. Adaptive learning was achieved through the use of an online M oodle system for (1) online grouping (based on pretest E nglish literacy scores), (2) delivery of specifically designed adaptive learning…

AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond

Zixiang Zhou, Yu Wan, Baoyuan Wang

cs.CV · 28 Nov 2023 · cited 75× · arXiv ↗ · more like this ·

Large Language Models(LLMs) have shown remarkable emergent abilities in unifying almost all (if not every) NLP tasks. In the human motion-related realm, however, researchers still develop siloed models for each task. Inspired by InstuctGPT, and the generalist concept behind Gato, we introduce AvatarGPT, an All-in-One framework for motion understanding, planning, generations as well as other tasks such as motion in-between synthesis. AvatarGPT treats each task as one type of instruction fine-tuned on the shared LLM. All the tasks are seamlessly interconnected with language as the universal interface, constituting a closed-loop within the framework. To achieve this, human motion sequences are first encoded as discrete tokens, which serve as the extended vocabulary of LLM. Then, an unsupervised pipeline to generate natural language descriptions of human action sequences from in-the-wild…

PolyLM: An Open Source Polyglot Large Language Model

Xiangpeng Wei, Haoran Wei, Huan Lin +15 more

cs.CL · 12 Jul 2023 · cited 75× · arXiv ↗ · more like this ·

Large language models (LLMs) demonstrate remarkable ability to comprehend, reason, and generate following nature language instructions. However, the development of LLMs has been primarily focused on high-resource languages, such as English, thereby limiting their applicability and research in other languages. Consequently, we present PolyLM, a multilingual LLM trained on 640 billion (B) tokens, avaliable in two model sizes: 1.7B and 13B. To enhance its multilingual capabilities, we 1) integrate bilingual data into training data; and 2) adopt a curriculum learning strategy that increases the proportion of non-English data from 30% in the first stage to 60% in the final stage during pre-training. Further, we propose a multilingual self-instruct method which automatically generates 132.7K diverse multilingual instructions for model fine-tuning. To assess the model's performance, we collect…

Self-Paced Learning for Neural Machine Translation

Yu Wan, Baosong Yang, Derek F. Wong +4 more

cs.CL · 13 Oct 2020 · cited 54× · arXiv ↗ · more like this ·

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. We ameliorate this procedure with a more flexible manner by proposing self-paced learning, where NMT model is allowed to 1) automatically quantify the learning confidence over training examples; and 2) flexibly govern its learning via regulating the loss in each iteration step. Experimental results over multiple translation tasks demonstrate that the proposed model yields better performance than strong baselines and those models trained with human-designed curricula on both translation quality and convergence speed.

UniTE: Unified Translation Evaluation

Yu Wan, Dayiheng Liu, Baosong Yang +4 more

cs.CL · 28 Apr 2022 · cited 46× · arXiv ↗ · more like this ·

Translation quality evaluation plays a crucial role in machine translation. According to the input format, it is mainly separated into three tasks, i.e., reference-only, source-only and source-reference-combined. Recent methods, despite their promising results, are specifically designed and optimized on one of them. This limits the convenience of these methods, and overlooks the commonalities among tasks. In this paper, we propose UniTE, which is the first unified framework engaged with abilities to handle all three evaluation tasks. Concretely, we propose monotonic regional attention to control the interaction among input segments, and unified pretraining to better adapt multi-task learning. We testify our framework on WMT 2019 Metrics and WMT 2020 Quality Estimation benchmarks. Extensive analyses show that our \textit{single model} can universally surpass various state-of-the-art or…

Challenges of Neural Machine Translation for Short Texts

Yu Wan, Baosong Yang, Derek F. Wong +4 more

Artificial Intelligence · Computational Linguistics · 2022 · cited 39× · DOI ↗ · more like this ·

Abstract Short texts (STs) present in a variety of scenarios, including query, dialog, and entity names. Most of the exciting studies in neural machine translation (NMT) are focused on tackling open problems concerning long sentences rather than short ones. The intuition behind is that, with respect to human learning and processing, short sequences are generally regarded as easy examples. In this article, we first dispel this speculation via conducting preliminary experiments, showing that the conventional state-of-the-art NMT approach, namely, Transformer (Vaswani et al. 2017), still suffers from over-translation and mistranslation errors over STs. After empirically investigating the rationale behind this, we summarize two challenges in NMT for STs associated with translation error types above, respectively: (1) the imbalanced length distribution in training set intensifies model…

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks

Hong Ji, Zhi Gao, Yongjun Zhang +3 more

Artificial Intelligence · IEEE Transactions on Geoscience and Remote Sensing · 2022 · cited 37× · DOI ↗ · more like this ·

Small data holds big AI potential. As one of the promising small data AI approaches, few-shot learning has the goal to learn a model efficiently that can recognize novel classes with extremely limited training samples. Therefore it is critical to accumulate useful prior knowledge obtained from large-scale base class dataset. To realize few-shot scene classification of optical remote sensing images, we start from a baseline model that trains all base classes using a standard cross-entropy loss leveraging two auxiliary objectives to capture intrinsical characteristics across the semantic classes. Specifically, rotation prediction learns to recognize the 2D rotation of an input to guide the learning of class-transferable knowledge, and contrastive learning aims to pull together the positive pairs while pushing apart the negative pairs to promote intra-class consistency and inter-class…

Evaluation of CD-HIT for constructing non-redundant databases

Qingyu Chen, Yu Wan, Yang Lei +2 more

Artificial Intelligence · Figshare · December 2016 · cited 31× · DOI ↗ · more like this ·

CD-HIT is one of the most popular tools for reducing sequence redundancy, and is considered to be the state-of-art method. It tries to minimise redundancy by reducing an input database into several representative sequences, under a user-defined threshold of sequence identity. We present a comprehensive assessment of the redundancy in the outputs of CD-HIT, exploring the impact of different identity thresholds and new evaluation data on the redundancy. We demonstrate that the relationship between threshold and redundancies is surprising weak. Applications of CD-HIT that set low identity threshold values also may suffer from substantial degradation in both efficiency and accuracy.

Distributed Conflict-Detection and Resolution Algorithm for UAV Swarms Based on Consensus Algorithm and Strategy Coordination

Yu Wan, Jun Tang, Songyang Lao

Computer Networks and Communications · IEEE Access · 2019 · cited 25× · DOI ↗ · more like this ·

In this paper, we study the problem of conflict detection and resolution for unmanned aerial vehicle (UAV) swarms. Specially, we propose a distributed conflict detection and resolution method for multi-UAVs in formation based on consensus algorithm and strategy coordination. When encountering threat swarms, the UAVs in one swarm act as one unit and are together treated as one control object. Each swarm in conflict selects three candidate collision avoidance maneuvers from the preset strategy pool, generates the corresponding planned trajectories with an uncertainty trajectory modeling, and then broadcasts and shares them. All of the swarms in conflict coordinate and determine an optimal combination of strategies. When a collision is imminent, the primary strategy is activated. Each swarm adopts a “leader-follower” strategy, where the leader UAV is regarded as the controller and flies…

Unsupervised Neural Dialect Translation with Commonality and Diversity Modeling

Yu Wan, Baosong Yang, Derek F. Wong +3 more

cs.CL · 11 Dec 2019 · cited 22× · arXiv ↗ · more like this ·

As a special machine translation task, dialect translation has two main characteristics: 1) lack of parallel training corpus; and 2) possessing similar grammar between two sides of the translation. In this paper, we investigate how to exploit the commonality and diversity between dialects thus to build unsupervised translation models merely accessing to monolingual data. Specifically, we leverage pivot-private embedding, layer coordination, as well as parameter sharing to sufficiently model commonality and diversity among source and target, ranging from lexical, through syntactic, to semantic levels. In order to examine the effectiveness of the proposed models, we collect 20 million monolingual corpus for each of Mandarin and Cantonese, which are official language and the most widely used dialect in China. Experimental results reveal that our methods outperform rule-based simplified and…

Deep Reinforcement Learning-Driven Collaborative Rounding-Up for Multiple Unmanned Aerial Vehicles in Obstacle Environments

Zipeng Zhao, Yu Wan, Yong Chen

Computer Vision and Pattern Recognition · Drones · 6 Sep 2024 · cited 18× · DOI ↗ · more like this ·

With the rapid advancement of UAV technology, the utilization of multi-UAV cooperative operations has become increasingly prevalent in various domains, including military and civilian applications. However, achieving efficient coordinated rounding-up of multiple UAVs remains a challenging problem. This paper addresses the issue of collaborative drone hunting by proposing a decision-making control model based on deep reinforcement learning. Additionally, a shared experience data pool is established to facilitate communication between drones. Each drone possesses independent decision-making and control capabilities while also considering the presence of other drones in the environment to collaboratively accomplish obstacle avoidance and rounding-up tasks. Furthermore, we redefine and design the reward function of reinforcement learning to achieve precise control of drone swarms in diverse…

Small object detection leveraging density‐aware scale adaptation

Yu Wan, Zhaohong Liao, Jia Liu +3 more

Computer Vision and Pattern Recognition · The Photogrammetric Record · 5 May 2023 · cited 18× · DOI ↗ · more like this ·

Abstract Albeit general object detection has made impressive progress in the last decade, as a significant subfield, small object detection still performs far from satisfactorily, which is impeded by several challenges, such as small size, severe occlusion and variant scales. To tackle these challenges, we propose a coarse‐to‐fine small object detection method leveraging density‐aware scale adaptation. Firstly, we employ global sketchy prediction via a coarse network in large scenes and generate adaptively scaled block regions with potential targets. Subsequently, we perform local accurate detection by a fine network for instances in densely packed areas with approximately unified scales. In particular, a density map with object distribution information is utilised to provide a scene classification auxiliary to instruct scale transformation. Extensive experiments on the popular remote…

Distributed Conflict-Detection and Resolution Algorithms for Multiple UAVs Based on Key-Node Selection and Strategy Coordination

Yu Wan, Jun Tang, Songyang Lao

Computer Networks and Communications · IEEE Access · 2019 · cited 17× · DOI ↗ · more like this ·

A distributed conflict-detection (CD) and resolution algorithm for multiple unmanned aerial vehicles based on key-node selection and strategy coordination are proposed in this paper. Each aircraft is regarded as a critical node in a complex network. A novel temporal and spatial integrated CD methodology is proposed for aircraft formations and clusters. Each node selects three candidate strategies from a pre-set pool of strategies and generates corresponding planned tracks using uncertainty modeling based on the 6 degrees-of-freedom motion. The primary combination of strategies required for coordination of the aircraft in conflict is based on the maximum-robustness principle. To address partial knowledge of the environment, a special token-allocation strategy for coordination with incomplete information is proposed in this paper. To address potential data dropouts, this study damps the…

Few-Shot Action Recognition via Multi-View Representation Learning

Xiao Wang, Yang Lu, YU Wan-chuan +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · 3 Apr 2024 · cited 16× · DOI ↗ · more like this ·

Few-shot action recognition aims to recognize novel action classes with limited labeled samples and has recently received increasing attention. The core objective of few-shot action recognition is to enhance the discriminability of feature representations. In this paper, we propose a novel multi-view representation learning network (MRLN) to model intra-video and inter-video relations for few-shot action recognition. Specifically, we first propose a spatial-aware aggregation refinement module (SARM), which mainly consists of a spatial-aware aggregation sub-module and a spatial-aware refinement sub-module to explore the spatial context of samples at the frame level. Then, we design a temporal-channel enhancement module (TCEM), which can capture the temporal-aware and channel-aware features of samples with the elaborately designed temporal-aware enhancement sub-module and channel-aware…

Collaboration of Dehazing and Object Detection Tasks: A Multitask Learning Framework for Foggy Image

Yu Wan, Jie Li, Liupeng Lin +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 2025 · cited 13× · DOI ↗ · more like this ·

Under foggy conditions, the atmospheric scattering effect diminishes the illumination intensity in images, causing a decline in the contrast of remote sensing images, which impacts the accuracy of object detection algorithms. Mainstream algorithms typically employ image restoration methods as a preprocessing step before object detection; however, the distributed method increases the time taken by the model to perform inference and it is difficult to ensure the dehazing module has positive effects on the object detection network modeling. To this end, we propose a multiscale feature collaborative foggy image object detection network (MS-FODN) within a multitask learning framework. This end-to-end model integrates a dehazing module to assist in object detection. In the proposed network, the encoder parameters of both the dehazing and detection modules are shared during the encoding stage.…

Building a Queer- and Trans-Inclusive Microbiology Conference

Rachel Gregor, Julie Johnston, Lisa S. Y. Coe +9 more

Health · 3 May 2023 · cited 13× · DOI ↗ · more like this ·

Microbiology conferences can be powerful places to build collaborations and exchange scientific thought, but for queer and transgender (trans) scientists they can also become sources of alienation and isolation. Many conference organizers would like to create welcoming and inclusive events but feel ill-equipped to make this vision a reality, and a historical lack of representation of queer and trans folks in microbiology means we rarely occupy these key leadership roles ourselves. Looking more broadly, queer and trans scientists are systematically marginalized across scientific fields, leading to disparities in career outcomes, professional networks, and opportunities, as well as loss of unique scientific perspectives at all levels. For queer and trans folks with multiple, intersecting, marginalized identities, these barriers often become even more severe. Here, we provide concrete…

Histogram-Based Quantization for Robust and/or Distributed Speech Recognition

Chia-yu Wan, Lin-shan Lee

Artificial Intelligence · IEEE Transactions on Audio Speech and Language Processing · 16 Apr 2008 · cited 13× · DOI ↗ · more like this ·

In a distributed speech recognition (DSR) framework, the speech features are quantized and compressed at the client and recognized at the server. However, recognition accuracy is degraded by environmental noise at the input, quantization distortion, and transmission errors. In this paper, histogram-based quantization (HQ) is proposed, in which the partition cells for quantization are dynamically defined by the histogram or order statistics of a segment of the most recent past values of the parameter to be quantized. This scheme is shown to be able to solve to a good degree many problems related to DSR. A joint uncertainty decoding (JUD) approach is further developed to consider the uncertainty caused by both environmental noise and quantization errors. A three-stage error concealment (EC) framework is also developed to handle transmission errors. The proposed HQ is shown to be an…

Prospecting for ophiolite-type chromite deposit in Sartohay, West Junggar (NW China): Constraints from geological and geophysical data

Hai Li, Yongjun Li, Gaoxue Yang +4 more

Artificial Intelligence · Ore Geology Reviews · 8 Mar 2023 · cited 11× · DOI ↗ · more like this ·

Chromite is a critical mineral that is of great significance for the development of metallurgical, chemical, and other industries. In order to study the deep ore prospecting methods of ophiolite-type chromitite, we have carried out plane-profile geological and mineral surveys, as well as high-precision gravity, magnetic, and controlled source audio-frequency magnetotelluric (CSAMT) measurements in the Sartohay, West Junggar. Based on the analysis, interpretation, and inference of multi-source geological information, a three-dimensional (3D) geological model of the typical mining area in Sartohay District was established. The results show that Sartohay ophiolite was occurred in the form of rootless tectonic blocks and generally displayed deformation and metamorphism (e.g., oblique thrust, transverse extrusion, and lateral strike slip). Sartohay ophiolite is in tectonic contact with…

The bifurcation diagram of a wavelet function

Yu Wan-Bo, Wei Xiao-peng, 大连理工大学机械工程学院，大连 116024;大连大学信息科学与工程辽宁省重点实验室,大连 116622

Artificial Intelligence · Acta Physica Sinica · 2006 · cited 10× · DOI ↗ · more like this ·

The bifurcation diagram of a wavelet function is discussed in the paper. The chaotic property of the map is changed with the variations of the constant k. Its μ-y diagram shows specially that there are bifurcations not only from period-2n to chaotic state but also from the chaotic state to period-2n when the parameter μ increases. The Lyapunov exponent diagram of the maps and one of the graphical iteration plot for the map are drawn. The wavelet function is also expanded with polynomial approximation in order to analyze the chaotic process.

Rethinking the Exploitation of Monolingual Data for Low-Resource Neural Machine Translation

Jianhui Pang, Baosong Yang, Derek F. Wong +4 more

Artificial Intelligence · Computational Linguistics · 15 Nov 2023 · cited 9× · DOI ↗ · more like this ·

Abstract The utilization of monolingual data has been shown to be a promising strategy for addressing low-resource machine translation problems. Previous studies have demonstrated the effectiveness of techniques such as back-translation and self-supervised objectives, including masked language modeling, causal language modeling, and denoise autoencoding, in improving the performance of machine translation models. However, the manner in which these methods contribute to the success of machine translation tasks and how they can be effectively combined remains an under-researched area. In this study, we carry out a systematic investigation of the effects of these techniques on linguistic properties through the use of probing tasks, including source language comprehension, bilingual word alignment, and translation fluency. We further evaluate the impact of pre-training, back-translation…