Author

Wei Lin

2,761 papers · 1971–2026

1971peak 218 in 20242026

Frequent co-authors

Papers

showing 1–25 of 2,761 RSS

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng +10 more

cs.CL · June 2023 · cited 11,735× · arXiv ↗ · more like this ·

Evaluating large language model (LLM) based chat assistants is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences. To address this, we explore using strong LLMs as judges to evaluate these models on more open-ended questions. We examine the usage and limitations of LLM-as-a-judge, including position, verbosity, and self-enhancement biases, as well as limited reasoning ability, and propose solutions to mitigate some of them. We then verify the agreement between LLM judges and human preferences by introducing two benchmarks: MT-bench, a multi-turn question set; and Chatbot Arena, a crowdsourced battle platform. Our results reveal that strong LLM judges like GPT-4 can match both controlled and crowdsourced human preferences well, achieving over 80% agreement, the same level of agreement between humans. Hence, LLM-as-a-judge…

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

Wei-Lin Chiang, Xuanqing Liu, Si Si +3 more

cs.LG · May 2019 · cited 1,632× · arXiv ↗ · more like this ·

Graph convolutional network (GCN) has been successfully applied to many graph-based applications; however, training a large-scale GCN remains challenging. Current SGD-based algorithms suffer from either a high computational cost that exponentially grows with number of GCN layers, or a large space requirement for keeping the entire graph and the embedding of each node in memory. In this paper, we propose Cluster-GCN, a novel GCN algorithm that is suitable for SGD-based training by exploiting the graph clustering structure. Cluster-GCN works as the following: at each step, it samples a block of nodes that associate with a dense subgraph identified by a graph clustering algorithm, and restricts the neighborhood search within this subgraph. This simple but effective strategy leads to significantly improved memory and computational efficiency while being able to achieve comparable test…

Learning from Synthetic Data for Crowd Counting in the Wild

Qi Wang, Junyu Gao, Wei Lin +1 more

cs.CV · 8 Mar 2019 · cited 607× · arXiv ↗ · more like this ·

Recently, counting the number of people for crowd scenes is a hot topic because of its widespread applications (e.g. video surveillance, public security). It is a difficult task in the wild: changeable environment, large-range number of people cause the current methods can not work well. In addition, due to the scarce data, many methods suffer from over-fitting to a different extent. To remedy the above two problems, firstly, we develop a data collector and labeler, which can generate the synthetic crowd scenes and simultaneously annotate them without any manpower. Based on it, we build a large-scale, diverse synthetic dataset. Secondly, we propose two schemes that exploit the synthetic data to boost the performance of crowd counting in the wild: 1) pretrain a crowd counter on the synthetic data, then finetune it using the real data, which significantly prompts the model's performance…

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng +10 more

cs.CL · September 2023 · cited 561× · arXiv ↗ · more like this ·

Studying how people interact with large language models (LLMs) in real-world scenarios is increasingly important due to their widespread use in various applications. In this paper, we introduce LMSYS-Chat-1M, a large-scale dataset containing one million real-world conversations with 25 state-of-the-art LLMs. This dataset is collected from 210K unique IP addresses in the wild on our Vicuna demo and Chatbot Arena website. We offer an overview of the dataset's content, including its curation process, basic statistics, and topic distribution, highlighting its diversity, originality, and scale. We demonstrate its versatility through four use cases: developing content moderation models that perform similarly to GPT-4, building a safety benchmark, training instruction-following models that perform similarly to Vicuna, and creating challenging benchmark questions. We believe that this dataset…

NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localization

Qi Wang, Junyu Gao, Wei Lin +1 more

cs.CV · January 2020 · cited 539× · arXiv ↗ · more like this ·

In the last decade, crowd counting and localization attract much attention of researchers due to its wide-spread applications, including crowd monitoring, public safety, space design, etc. Many Convolutional Neural Networks (CNN) are designed for tackling this task. However, currently released datasets are so small-scale that they can not meet the needs of the supervised CNN-based algorithms. To remedy this problem, we construct a large-scale congested crowd counting and localization dataset, NWPU-Crowd, consisting of 5,109 images, in a total of 2,133,375 annotated heads with points and boxes. Compared with other real-world datasets, it contains various illumination scenes and has the largest density range (0~20,033). Besides, a benchmark website is developed for impartially evaluating the different methods, which allows researchers to submit the results of the test set. Based on the…

AliGraph: A Comprehensive Graph Neural Network Platform

Rong Zhu, Kun Zhao, Hongxia Yang +5 more

cs.DC · 23 Feb 2019 · cited 478× · arXiv ↗ · more like this ·

An increasing number of machine learning tasks require dealing with large graph datasets, which capture rich and complex relationship among potentially billions of elements. Graph Neural Network (GNN) becomes an effective way to address the graph learning problem by converting the graph data into a low dimensional space while keeping both the structural and property information to the maximum extent and constructing a neural network for training and referencing. However, it is challenging to provide an efficient graph storage and computation capabilities to facilitate GNN training and enable development of new GNN algorithms. In this paper, we present a comprehensive graph neural network system, namely AliGraph, which consists of distributed graph storage, optimized sampling operators and runtime to efficiently support not only existing popular GNNs but also a series of in-house…

Pingmesh

Chuanxiong Guo, Lihua Yuan, Dong Xiang +9 more

Information Systems · 17 Aug 2015 · cited 382× · DOI ↗ · more like this ·

Can we get network latency between any two servers at any time in large-scale data center networks? The collected latency data can then be used to address a series of challenges: telling if an application perceived latency issue is caused by the network or not, defining and tracking network service level agreement (SLA), and automatic network troubleshooting. We have developed the Pingmesh system for large-scale data center network latency measurement and analysis to answer the above question affirmatively. Pingmesh has been running in Microsoft data centers for more than four years, and it collects tens of terabytes of latency data per day. Pingmesh is widely used by not only network software developers and engineers, but also application and service developers and operators.

DAPPLE: A Pipelined Data Parallel Approach for Training Large Models

Shiqing Fan, Yi Rong, Chen Meng +10 more

cs.DC · 2 Jul 2020 · cited 362× · arXiv ↗ · more like this ·

It is a challenging task to train large DNN models on sophisticated GPU platforms with diversified interconnect capabilities. Recently, pipelined training has been proposed as an effective approach for improving device utilization. However, there are still several tricky issues to address: improving computing efficiency while ensuring convergence, and reducing memory usage without incurring additional computing costs. We propose DAPPLE, a synchronous training framework which combines data parallelism and pipeline parallelism for large DNN models. It features a novel parallelization strategy planner to solve the partition and placement problems, and explores the optimal hybrid strategy of data and pipeline parallelism. We also propose a new runtime scheduling algorithm to reduce device memory usage, which is orthogonal to re-computation approach and does not come at the expense of…

Apollo: scalable and coordinated scheduling for cloud-scale computing

Éric Boutin, Jaliya Ekanayake, Wei Lin +5 more

Information Systems · Operating Systems Design and Implementation · 6 Oct 2014 · cited 304× · DOI ↗ · more like this ·

Efficiently scheduling data-parallel computation jobs over cloud-scale computing clusters is critical for job performance, system throughput, and resource utilization. It is becoming even more challenging with growing cluster sizes and more complex workloads with diverse characteristics. This paper presents Apollo, a highly scalable and coordinated scheduling framework, which has been deployed on production clusters at Microsoft to schedule thousands of computations with millions of tasks efficiently and effectively on tens of thousands of machines daily. The framework performs scheduling decisions in a distributed manner, utilizing global cluster information via a loosely coordinated mechanism. Each scheduling decision considers future resource availability and optimizes various performance and system factors together in a single unified model. Apollo is robust, with means to cope with…

AliGraph

Rong Zhu, Kun Zhao, Hongxia Yang +5 more

Artificial Intelligence · Proceedings of the VLDB Endowment · August 2019 · cited 293× · DOI ↗ · more like this ·

An increasing number of machine learning tasks require dealing with large graph datasets, which capture rich and complex relationship among potentially billions of elements. Graph Neural Network (GNN) becomes an effective way to address the graph learning problem by converting the graph data into a low dimensional space while keeping both the structural and property information to the maximum extent and constructing a neural network for training and referencing. However, it is challenging to provide an efficient graph storage and computation capabilities to facilitate GNN training and enable development of new GNN algorithms. In this paper, we present a comprehensive graph neural network system, namely AliGraph , which consists of distributed graph storage, optimized sampling operators and runtime to efficiently support not only existing popular GNNs but also a series of in-house…

A Survey of Utility-Oriented Pattern Mining

Wensheng Gan, Jerry Chun-Wei Lin, Philippe Fournier-Viger +3 more

cs.DB · May 2018 · cited 292× · arXiv ↗ · more like this ·

The main purpose of data mining and analytics is to find novel, potentially useful patterns that can be utilized in real-world applications to derive beneficial knowledge. For identifying and evaluating the usefulness of different kinds of patterns, many techniques and constraints have been proposed, such as support, confidence, sequence order, and utility parameters (e.g., weight, price, profit, quantity, satisfaction, etc.). In recent years, there has been an increasing demand for utility-oriented pattern mining (UPM, or called utility mining). UPM is a vital task, with numerous high-impact applications, including cross-marketing, e-commerce, finance, medical, and biomedical applications. This survey aims to provide a general, comprehensive, and structured overview of the state-of-the-art methods of UPM. First, we introduce an in-depth understanding of UPM, including concepts…

Steelix: program-state based binary fuzzing

Yuekang Li, Bihuan Chen, Mahinthan Chandramohan +3 more

Software · 2 Aug 2017 · cited 277× · DOI ↗ · more like this ·

Coverage-based fuzzing is one of the most effective techniques to find vulnerabilities, bugs or crashes. However, existing techniques suffer from the difficulty in exercising the paths that are protected by magic bytes comparisons (e.g., string equality comparisons). Several approaches have been proposed to use heavy-weight program analysis to break through magic bytes comparisons, and hence are less scalable. In this paper, we propose a program-state based binary fuzzing approach, named Steelix, which improves the penetration power of a fuzzer at the cost of an acceptable slow down of the execution speed. In particular, we use light-weight static analysis and binary instrumentation to provide not only coverage information but also comparison progress information to a fuzzer. Such program state information informs a fuzzer about where the magic bytes are located in the test input and…

A modified remote user authentication scheme using smart cards

Jau-Ji Shen, Chih‐Wei Lin, Min‐Shiang Hwang

Computer Networks and Communications · IEEE Transactions on Consumer Electronics · May 2003 · cited 270× · DOI ↗ · more like this ·

Hwang and Li (see IEEE Trans. Consumer Electron., vol.46, no.1, p.28-30, 2000) proposed a new remote authentication scheme using smart cards. Their scheme is based on the ElGamal's public key cryptosystem. However, Chan and Cheng (see IEEE Trans. Consumer Electron., vol.46, p.992-993, 2000) pointed out that the scheme is vulnerable to the masquerade attack. In this article, we show a different attack on Hwang-Li scheme which is easier and simpler. Furthermore, we present an enhanced scheme for repairing the above attacks.

Variable selection in regression with compositional covariates

Wei Lin, Peijun Shi, Rui Feng +1 more

Artificial Intelligence · Biometrika · 13 Aug 2014 · cited 269× · DOI ↗ · more like this ·

Motivated by research problems arising in the analysis of gut microbiome and metagenomic data, we consider variable selection and estimation in high-dimensional regression with compositional covariates. We propose an ℓ1 regularization method for the linear log-contrast model that respects the unique features of compositional data. We formulate the proposed procedure as a constrained convex optimization problem and introduce a coordinate descent method of multipliers for efficient computation. In the high-dimensional setting where the dimensionality grows at most exponentially with the sample size, model selection consistency and |$\ell _{\infty }$| bounds for the resulting estimator are established under conditions that are mild and interpretable for compositional data. The numerical performance of our method is evaluated via simulation studies and its usefulness is illustrated by an…

A Survey of Parallel Sequential Pattern Mining

Wensheng Gan, Jerry Chun-Wei Lin, Philippe Fournier-Viger +2 more

cs.DB · May 2018 · cited 262× · arXiv ↗ · more like this ·

With the growing popularity of shared resources, large volumes of complex data of different types are collected automatically. Traditional data mining algorithms generally have problems and challenges including huge memory cost, low processing speed, and inadequate hard disk space. As a fundamental task of data mining, sequential pattern mining (SPM) is used in a wide variety of real-life applications. However, it is more complex and challenging than other pattern mining tasks, i.e., frequent itemset mining and association rule mining, and also suffers from the above challenges when handling the large-scale data. To solve these problems, mining sequential patterns in a parallel or distributed computing environment has emerged as an important issue with many applications. In this paper, an in-depth survey of the current status of parallel sequential pattern mining (PSPM) is investigated…

A Survey of Smart Contract Formal Specification and Verification

Palina Tolmach, Yi Li, Shang-Wei Lin +2 more

cs.SE · August 2020 · cited 245× · arXiv ↗ · more like this ·

A smart contract is a computer program which allows users to automate their actions on the blockchain platform. Given the significance of smart contracts in supporting important activities across industry sectors including supply chain, finance, legal and medical services, there is a strong demand for verification and validation techniques. Yet, the vast majority of smart contracts lack any kind of formal specification, which is essential for establishing their correctness. In this survey, we investigate formal models and specifications of smart contracts presented in the literature and present a systematic overview in order to understand the common trends. We also discuss the current approaches used in verifying such property specifications and identify gaps with the hope to recognize promising directions for future work.

A robust deformed convolutional neural network (CNN) for image denoising

Qi Zhang, Jingyu Xiao, Chunwei Tian +2 more

Computer Vision and Pattern Recognition · CAAI Transactions on Intelligence Technology · 15 Jun 2022 · cited 236× · DOI ↗ · more like this ·

Abstract Due to strong learning ability, convolutional neural networks (CNNs) have been developed in image denoising. However, convolutional operations may change original distributions of noise in corrupted images, which may increase training difficulty in image denoising. Using relations of surrounding pixels can effectively resolve this problem. Inspired by that, we propose a robust deformed denoising CNN (RDDCNN) in this paper. The proposed RDDCNN contains three blocks: a deformable block (DB), an enhanced block (EB) and a residual block (RB). The DB can extract more representative noise features via a deformable learnable kernel and stacked convolutional architecture, according to relations of surrounding pixels. The EB can facilitate contextual interaction through a dilated convolution and a novel combination of convolutional layers, batch normalisation (BN) and ReLU, which can…

A survey of itemset mining

Philippe Fournier‐Viger, Jerry Chun‐Wei Lin, Bay Vo +3 more

Information Systems · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · 21 Apr 2017 · cited 228× · DOI ↗ · more like this ·

Itemset mining is an important subfield of data mining, which consists of discovering interesting and useful patterns in transaction databases. The traditional task of frequent itemset mining is to discover groups of items (itemsets) that appear frequently together in transactions made by customers. Although itemset mining was designed for market basket analysis, it can be viewed more generally as the task of discovering groups of attribute values frequently cooccurring in databases. Because of its numerous applications in domains such as bioinformatics, text mining, product recommendation, e‐learning, and web click stream analysis, itemset mining has become a popular research area. This study provides an up‐to‐date survey that can serve both as an introduction and as a guide to recent advances and opportunities in the field. The problem of frequent itemset mining and its applications…

A 1-GS/s FFT/IFFT processor for UWB applications

Yu-Wei Lin, Hsuan-Yu Liu, Chen‐Yi Lee

Signal Processing · IEEE Journal of Solid-State Circuits · 27 Jul 2005 · cited 223× · DOI ↗ · more like this ·

In this paper, we present a novel 128-point FFT/IFFT processor for ultrawideband (UWB) systems. The proposed pipelined FFT architecture, called mixed-radix multipath delay feedback (MRMDF), can provide a higher throughput rate by using the multidata-path scheme. Furthermore, the hardware costs of memory and complex multipliers in MRMDF are only 38.9% and 44.8% of those in the known FFT processor by means of the delay feedback and the data scheduling approaches. The high-radix FFT algorithm is also realized in our processor to reduce the number of complex multiplications. A test chip for the UWB system has been designed and fabricated using 0.18-/spl mu/m single-poly and six-metal CMOS process with a core area of 1.76/spl times/1.76 mm/sup 2/, including an FFT/IFFT processor and a test module. The throughput rate of this fabricated FFT processor is up to 1 Gsample/s while it consumes 175…

IDS-INT: Intrusion detection system using transformer-based transfer learning for imbalanced network traffic

Farhan Ullah, Shamsher Ullah, Gautam Srivastava +1 more

Computer Networks and Communications · Digital Communications and Networks · 17 Mar 2023 · cited 216× · DOI ↗ · more like this ·

A network intrusion detection system is critical for cyber security against illegitimate attacks. In terms of feature perspectives, the network traffic may include a variety of elements such as attack reference, attack type, a sub-category of attack, host information, malicious scripts, etc. In terms of network perspectives, network traffic may contain an imbalanced number of harmful attacks when compared to normal traffic. It is challenging to identify a specific attack due to complex features and data imbalance issues. To address these issues, this paper proposed an Intrusion Detection System using transformer-based transfer learning for Imbalanced Network Traffic (IDS-INT). IDS-INT uses transformer-based transfer learning to learn feature interactions in both network feature representation and imbalanced data. First, detailed information about each type of attack is gathered from…

Enhancing Privacy and Availability for Data Clustering in Intelligent Electrical Service of IoT

Jinbo Xiong, Jun Ren, Lei Chen +4 more

Artificial Intelligence · IEEE Internet of Things Journal · June 2018 · cited 200× · DOI ↗ · more like this ·

The ever-growing demand for electrical energy of sensing devices in the Internet of Things (IoT) has led to generating large amounts of electricity consumption data. Electricity service providers often use wireless sensor networks to collect sensing devices' electricity consumption data for statistical analysis, so as to provide sensing devices with improved electrical services. As an important data mining technique, while data clustering excels in dealing with such massive data, it imposes the risk of privacy disclosure in the process of data clustering. In an effort of solving this problem, Blum et al. proposed a differential privacy k-means algorithm, effectively preventing privacy disclosure. However, the availability of data clustering results is reduced due to the data distortion in Blum's algorithm. In this paper, we propose a privacy and availability data clustering (PADC)…

A Comprehensive Survey on Artificial Intelligence Empowered Edge Computing on Consumer Electronics

Jia-Hao Syu, Jerry Chun‐Wei Lin, Gautam Srivastava +1 more

Computer Networks and Communications · IEEE Transactions on Consumer Electronics · 21 Sep 2023 · cited 187× · DOI ↗ · more like this ·

The Internet revolution and Moore’s Law drove the rapid expansion of connected consumer electronics. As massive data is generated by Internet of Things (IoT) devices, edge computing has been developed and applied in consumer electronics to provide agile and real-time services. In this paper, we provide an overview of artificial intelligence (AI)-empowered edge computing in consumer electronics. We start with the background of consumer electronics and artificial intelligence and outline key characteristics and challenges, which are used to evaluate the state of research in smart homes, smart buildings, smart healthcare, and intelligent diagnosis. The evaluation shows that research in AI-empowered edge computing for consumer electronics has mainly focused on latency, robustness, and reliability over the past 5 years. However, explainability and load balancing are mentioned less and have…

Large Language Models in Education: Vision and Opportunities

Wensheng Gan, Zhenlian Qi, Jiayang Wu +1 more

cs.AI · 22 Nov 2023 · cited 183× · arXiv ↗ · more like this ·

With the rapid development of artificial intelligence technology, large language models (LLMs) have become a hot research topic. Education plays an important role in human social development and progress. Traditional education faces challenges such as individual student differences, insufficient allocation of teaching resources, and assessment of teaching effectiveness. Therefore, the applications of LLMs in the field of digital/smart education have broad prospects. The research on educational large models (EduLLMs) is constantly evolving, providing new methods and approaches to achieve personalized learning, intelligent tutoring, and educational assessment goals, thereby improving the quality of education and the learning experience. This article aims to investigate and summarize the application of LLMs in smart education. It first introduces the research background and motivation of…

Privacy-Preserving Multiobjective Sanitization Model in 6G IoT Environments

Jerry Chun‐Wei Lin, Gautam Srivastava, Yuyu Zhang +2 more

Artificial Intelligence · IEEE Internet of Things Journal · 21 Oct 2020 · cited 176× · DOI ↗ · more like this ·

The next revolution of the smart industry relies on the emergence of the Industrial Internet of Things (IoT) and 5G/6G technology. The properties of such sophisticated communication technologies will change our perspective of information and communication by enabling seamless connectivity and bring closer entities, data, and “things.” Terahertz-based 6G networks promise the best speed and reliability, but they will face new man-in-the-middle attacks. In such critical and high-sensitive environments, the security of data and privacy of information still a big challenge. Without privacy-preserving considerations, the configuration state may be attacked or modified, thus causing security problems and damage to data. In this article, motivated by the need to secure 6G IoT networks, an ant colony optimization (ACO) approach is presented by adopting multiple objectives as well as using…

A survey of incremental high‐utility itemset mining

Wensheng Gan, Jerry Chun‐Wei Lin, Philippe Fournier‐Viger +3 more

Information Systems · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · 14 Jan 2018 · cited 160× · DOI ↗ · more like this ·

Traditional association rule mining has been widely studied. But it is unsuitable for real‐world applications where factors such as unit profits of items and purchase quantities must be considered. High‐utility itemset mining (HUIM) is designed to find highly profitable patterns by considering both the purchase quantities and unit profits of items. However, most HUIM algorithms are designed to be applied to static databases. But in real‐world applications such as market basket analysis and business decision‐making, databases are often dynamically updated by inserting new data such as customer transactions. Several researchers have proposed algorithms to discover high‐utility itemsets (HUIs) in dynamically updated databases. Unlike batch algorithms, which always process a database from scratch, incremental high‐utility itemset mining (iHUIM) algorithms incrementally update and output…