Author

Kai Yang

1,116 papers · 1753–2026

1967peak 123 in 20252026

Frequent co-authors

Papers

showing 1–25 of 1,116 RSS

Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task

Tao Yu, Rui Zhang, Kai Yang +9 more

cs.CL · September 2018 · cited 2,203× · arXiv ↗ · more like this ·

We present Spider, a large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. It consists of 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple tables, covering 138 different domains. We define a new complex and cross-domain semantic parsing and text-to-SQL task where different complex SQL queries and databases appear in train and test sets. In this way, the task requires the model to generalize well to both new SQL queries and new database schemas. Spider is distinct from most of the previous semantic parsing tasks because they all use a single database and the exact same programs in the train set and the test set. We experiment with various state-of-the-art models and the best model achieves only 12.4% exact matching accuracy on a database split setting. This shows that Spider presents a strong…

Gemini: A Family of Highly Capable Multimodal Models

Gemini Team, Rohan Anil, Sebastian Borgeaud +1348 more

cs.CL · December 2023 · cited 816× · arXiv ↗ · more like this ·

This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models…

Group-wise Correlation Stereo Network

Xiaoyang Guo, Kai Yang, Wukui Yang +2 more

cs.CV · 10 Mar 2019 · cited 741× · arXiv ↗ · more like this ·

Stereo matching estimates the disparity between a rectified image pair, which is of great importance to depth sensing, autonomous driving, and other related tasks. Previous works built cost volumes with cross-correlation or concatenation of left and right features across all disparity levels, and then a 2D or 3D convolutional neural network is utilized to regress the disparity maps. In this paper, we propose to construct the cost volume by group-wise correlation. The left features and the right features are divided into groups along the channel dimension, and correlation maps are computed among each group to obtain multiple matching cost proposals, which are then packed into a cost volume. Group-wise correlation provides efficient representations for measuring feature similarities and will not lose too much information like full correlation. It also preserves better performance when…

A Unified Model for Multi-class Anomaly Detection

Zhiyuan You, Lei Cui, Yujun Shen +4 more

cs.CV · June 2022 · cited 585× · arXiv ↗ · more like this ·

Despite the rapid advance of unsupervised anomaly detection, existing methods require to train separate models for different objects. In this work, we present UniAD that accomplishes anomaly detection for multiple classes with a unified framework. Under such a challenging setting, popular reconstruction networks may fall into an "identical shortcut", where both normal and anomalous samples can be well recovered, and hence fail to spot outliers. To tackle this obstacle, we make three improvements. First, we revisit the formulations of fully-connected layer, convolutional layer, as well as attention layer, and confirm the important role of query embedding (i.e., within attention layer) in preventing the network from learning the shortcut. We therefore come up with a layer-wise query decoder to help model the multi-class distribution. Second, we employ a neighbor masked attention module to…

Communication-Efficient Edge AI: Algorithms and Systems

Yuanming Shi, Kai Yang, Tao Jiang +2 more

cs.IT · 22 Feb 2020 · cited 456× · arXiv ↗ · more like this ·

Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide range of fields, ranging from speech processing, image classification to drug discovery. This is driven by the explosive growth of data, advances in machine learning (especially deep learning), and easy access to vastly powerful computing resources. Particularly, the wide scale deployment of edge devices (e.g., IoT devices) generates an unprecedented scale of data, which provides the opportunity to derive accurate models and develop various intelligent applications at the network edge. However, such enormous data cannot all be sent from end devices to the cloud for processing, due to the varying channel quality, traffic congestion and/or privacy concerns. By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative. AI at the edge requires close…

Improving the CS1 experience with pair programming

Nachiappan Nagappan, Laurie Williams, Miriam Ferzli +4 more

Computer Science Applications · 11 Jan 2003 · cited 303× · DOI ↗ · more like this ·

Pair programming is a practice in which two programmers work collaboratively at one computer, on the same design, algorithm, or code. Prior research indicates that pair programmers produce higher quality code in essentially half the time taken by solo programmers. An experiment was run to assess the efficacy of pair programming in an introductory Computer Science course. Student pair programmers were more self-sufficient, generally perform better on projects and exams, and were more likely to complete the class with a grade of C or better than their solo counterparts. Results indicate that pair programming creates a laboratory environment conducive to more advanced, active learning than traditional labs; students and lab instructors report labs to be more productive and less frustrating.

In Support of Pair Programming in the Introductory Computer Science Course

Laurie Williams, Eric Wiebe, Kai Yang +2 more

Computer Science Applications · Computer Science Education · September 2002 · cited 270× · DOI ↗ · more like this ·

A formal pair programming experiment was run at North Carolina to empirically assess the educational efficacy of the technique in a CS1 course. Results indicate that students who practice pair programming perform better on programming projects and are more likely to succeed by completing the class with a C or better. Student pairs are more self-sufficient which reduces their reliance on the teaching staff. Qualitatively, paired students demonstrate higherorder thinking skills than students who worked alone. These results are supportive of pair programming as a collaborative learning technique. In industry, programmers collaborate for the majority of their day. In Peopleware (DeMarco and Lister, 1987), it was reported that software developers generally spend 30 % of their time working alone, 50 % of their time working with one other person, and 20 % of their time working with two or more…

SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Task

Tao Yu, Michihiro Yasunaga, Kai Yang +4 more

cs.CL · 25 Oct 2018 · cited 236× · arXiv ↗ · more like this ·

Most existing studies in text-to-SQL tasks do not require generating complex SQL queries with multiple clauses or sub-queries, and generalizing to new, unseen databases. In this paper we propose SyntaxSQLNet, a syntax tree network to address the complex and cross-domain text-to-SQL generation task. SyntaxSQLNet employs a SQL specific syntax tree-based decoder with SQL generation path history and table-aware column attention encoders. We evaluate SyntaxSQLNet on the Spider text-to-SQL task, which contains databases with multiple tables and complex SQL queries with multiple SQL clauses and nested queries. We use a database split setting where databases in the test set are unseen during training. Experimental results show that SyntaxSQLNet can handle a significantly greater number of complex SQL examples than prior work, outperforming the previous state-of-the-art model by 7.3% in exact…

A Review of Vehicle Detection Techniques for Intelligent Vehicles

Zhangu Wang, Jun Zhan, Chunguang Duan +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks and Learning Systems · 5 Jan 2022 · cited 207× · DOI ↗ · more like this ·

Robust and efficient vehicle detection is an important task of environment perception of intelligent vehicles, which directly affects the behavior decision-making and motion planning of intelligent vehicles. Due to the rapid development of sensor and computer technology, the algorithm and technology of vehicle detection have been updated rapidly. But, there are few reviews on vehicle detection of intelligent vehicles, especially covering all kinds of sensors and algorithms in recent years. This article presents a comprehensive review of vehicle detection approaches and their applications in intelligent vehicle systems to analyze the development of vehicle detection, with a specific focus on sensor types and algorithm classification. First, more than 300 research contributions are summarized in this review, including all kinds of vehicle detection sensors (machine vision, millimeter-wave…

SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-Domain Text-to-SQL Task

Tao Yu, Michihiro Yasunaga, Kai Yang +4 more

Artificial Intelligence · 2018 · cited 200× · DOI ↗ · more like this ·

Most existing studies in text-to-SQL tasks do not require generating complex SQL queries with multiple clauses or sub-queries, and generalizing to new, unseen databases. In this paper we propose SyntaxSQLNet, a syntax tree network to address the complex and crossdomain text-to-SQL generation task. Syn-taxSQLNet employs a SQL specific syntax tree-based decoder with SQL generation path history and table-aware column attention encoders. We evaluate SyntaxSQLNet on a new large-scale text-to-SQL corpus containing databases with multiple tables and complex SQL queries containing multiple SQL clauses and nested queries. We use a database split setting where databases in the test set are unseen during training. Experimental results show that SyntaxSQLNet can handle a significantly greater number of complex SQL examples than prior work, outperforming the previous state-of-the-art model by 9.5%…

Energy-Aware Application Placement in Mobile Edge Computing: A Stochastic Optimization Approach

Hossein Badri, Tayebeh Bahreini, Daniel Grosu +1 more

Computer Networks and Communications · IEEE Transactions on Parallel and Distributed Systems · 13 Nov 2019 · cited 130× · DOI ↗ · more like this ·

The Quality of Service (QoS) in Mobile Edge Computing (MEC) systems is significantly dependent on the application offloading and placement decisions. Due to the movement of users in MEC networks, an optimal application placement might turn into the least efficient placement in few minutes. Thus, it is crucial to take the dynamics of the system into account when designing application placement mechanisms. On the other hand, energy consumption of servers is a significant component of the cost of services in MEC systems and must also be considered in the design of the mechanisms. In this article, we model the problem of energy-aware application placement in edge computing systems as a multi-stage stochastic program. The objective is to maximize the QoS of the system while taking into account the limited energy budget of the edge servers. To solve the problem, we design a novel parallel…

Few-shot Object Counting with Similarity-Aware Feature Enhancement

Zhiyuan You, Kai Yang, Wenhan Luo +3 more

cs.CV · January 2022 · cited 126× · arXiv ↗ · more like this ·

This work studies the problem of few-shot object counting, which counts the number of exemplar objects (i.e., described by one or several support images) occurring in the query image. The major challenge lies in that the target objects can be densely packed in the query image, making it hard to recognize every single one. To tackle the obstacle, we propose a novel learning block, equipped with a similarity comparison module and a feature enhancement module. Concretely, given a support image and a query image, we first derive a score map by comparing their projected features at every spatial position. The score maps regarding all support images are collected together and normalized across both the exemplar dimension and the spatial dimensions, producing a reliable similarity map. We then enhance the query feature with the support features by employing the developed point-wise…

SiamCorners: Siamese Corner Networks for Visual Tracking

Kai Yang, Zhenyu He, Wenjie Pei +4 more

cs.CV · 15 Apr 2021 · cited 125× · arXiv ↗ · more like this ·

The current Siamese network based on region proposal network (RPN) has attracted great attention in visual tracking due to its excellent accuracy and high efficiency. However, the design of the RPN involves the selection of the number, scale, and aspect ratios of anchor boxes, which will affect the applicability and convenience of the model. Furthermore, these anchor boxes require complicated calculations, such as calculating their intersection-over-union (IoU) with ground truth bounding boxes.Due to the problems related to anchor boxes, we propose a simple yet effective anchor-free tracker (named Siamese corner networks, SiamCorners), which is end-to-end trained offline on large-scale image pairs. Specifically, we introduce a modified corner pooling layer to convert the bounding box estimate of the target into a pair of corner predictions (the bottom-right and the top-left corners). By…

NIDS-CNNLSTM: Network Intrusion Detection Classification Model Based on Deep Learning

Jiawei Du, Kai Yang, Yanjing Hu +1 more

Computer Networks and Communications · IEEE Access · 2023 · cited 118× · DOI ↗ · more like this ·

Intrusion detection is the core topic of network security, and the intrusion detection algorithm based on deep learning has become a research hotspot in the field of network security. In this paper, a network intrusion detection classification model (NIDS-CNNLSTM) based on deep learning is constructed for the wireless sensing scenario of the Industrial Internet of Things (IIoT) to effectively distinguish and identify network traffic data and ensure the security of the equipment and operation of the IIoT. NIDS-CNNLSTM combines the powerful learning ability of long short-term memory neural networks in time series data, learns and classifies the features selected by the convolutional neural network, and verifies the applicability based on binary classification and multi-classification scenarios. The model is trained using KDD CUP99, NSL_KDD and UNSW_NB15 classic datasets. The verification…

LSOTB-TIR:A Large-Scale High-Diversity Thermal Infrared Object Tracking Benchmark

Qiao Liu, Xin Li, Zhenyu He +8 more

cs.CV · 3 Aug 2020 · cited 115× · arXiv ↗ · more like this ·

In this paper, we present a Large-Scale and high-diversity general Thermal InfraRed (TIR) Object Tracking Benchmark, called LSOTBTIR, which consists of an evaluation dataset and a training dataset with a total of 1,400 TIR sequences and more than 600K frames. We annotate the bounding box of objects in every frame of all sequences and generate over 730K bounding boxes in total. To the best of our knowledge, LSOTB-TIR is the largest and most diverse TIR object tracking benchmark to date. To evaluate a tracker on different attributes, we define 4 scenario attributes and 12 challenge attributes in the evaluation dataset. By releasing LSOTB-TIR, we encourage the community to develop deep learning based TIR trackers and evaluate them fairly and comprehensively. We evaluate and analyze more than 30 trackers on LSOTB-TIR to provide a series of baselines, and the results show that deep trackers…

Active Learning for Wireless IoT Intrusion Detection

Kai Yang, Jie Ren, Yanqiao Zhu +1 more

cs.CR · 4 Aug 2018 · cited 114× · arXiv ↗ · more like this ·

Internet of Things (IoT) is becoming truly ubiquitous in our everyday life, but it also faces unique security challenges. Intrusion detection is critical for the security and safety of a wireless IoT network. This paper discusses the human-in-the-loop active learning approach for wireless intrusion detection. We first present the fundamental challenges against the design of a successful Intrusion Detection System (IDS) for wireless IoT network. We then briefly review the rudimentary concepts of active learning and propose its employment in the diverse applications of wireless intrusion detection. Experimental example is also presented to show the significant performance improvement of the active learning method over traditional supervised learning approach. While machine learning techniques have been widely employed for intrusion detection, the application of human-in-the-loop machine…

Trustworthy Federated Learning via Blockchain

Zhanpeng Yang, Yuanming Shi, Yong Zhou +2 more

cs.LG · 13 Aug 2022 · cited 111× · arXiv ↗ · more like this ·

The safety-critical scenarios of artificial intelligence (AI), such as autonomous driving, Internet of Things, smart healthcare, etc., have raised critical requirements of trustworthy AI to guarantee the privacy and security with reliable decisions. As a nascent branch for trustworthy AI, federated learning (FL) has been regarded as a promising privacy preserving framework for training a global AI model over collaborative devices. However, security challenges still exist in the FL framework, e.g., Byzantine attacks from malicious devices, and model tampering attacks from malicious server, which will degrade or destroy the accuracy of trained global AI model. In this paper, we shall propose a decentralized blockchain based FL (B-FL) architecture by using a secure global aggregation algorithm to resist malicious devices, and deploying practical Byzantine fault tolerance consensus protocol…

A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

Kai Yang, Tao Fan, Tianjian Chen +2 more

cs.LG · 4 Dec 2019 · cited 101× · arXiv ↗ · more like this ·

Data privacy and security becomes a major concern in building machine learning models from different data providers. Federated learning shows promise by leaving data at providers locally and exchanging encrypted information. This paper studies the vertical federated learning structure for logistic regression where the data sets at two parties have the same sample IDs but own disjoint subsets of features. Existing frameworks adopt the first-order stochastic gradient descent algorithm, which requires large number of communication rounds. To address the communication challenge, we propose a quasi-Newton method based vertical federated learning framework for logistic regression under the additively homomorphic encryption scheme. Our approach can considerably reduce the number of communication rounds with a little additional communication cost per round. Numerical results demonstrate the…

Matrix completion with noisy side information

Kai-Yang Chiang, Cho‐Jui Hsieh, Inderjit S. Dhillon

Signal Processing · Neural Information Processing Systems · 7 Dec 2015 · cited 90× · OpenAlex ↗ · more like this ·

We study the matrix completion problem with side information. Side information has been considered in several matrix completion applications, and has been empirically shown to be useful in many cases. Recently, researchers studied the effect of side information for matrix completion from a theoretical viewpoint, showing that sample complexity can be significantly reduced given completely clean features. However, since in reality most given features are noisy or only weakly informative, the development of a model to handle a general feature set, and investigation of how much noisy features can help matrix recovery, remains an important issue. In this paper, we propose a novel model that balances between features and observations simultaneously in order to leverage feature information yet be robust to feature noise. Moreover, we study the effect of general features in theory and show that…

Security Authentication System Using Encrypted Channel on UAV Network

Kwanwoong Yoon, Daejun Park, Yujin Yim +3 more

Computer Networks and Communications · April 2017 · cited 87× · DOI ↗ · more like this ·

Today, UAVs are used in various fields such as monitor, search and rescue missions as well as military. UAVs are useful in various fields, but security has always been a major concern. Additionally, UAV carries sensitive information related to people's privacy and it causes critical problems if the data is exploited by malicious attackers. There were many attempts to solve security problems of UAVs but there is no typical way to protect UAVs from cyber attacks. In this research, we focus on a solution of hijacking network channel or physical hardware by anonymous attackers on commercial UAVs. This paper proposed maintaining control of UAV in hijacking problem with an additional encrypted communication channel, authentication algorithm and DoS attack through Raspberry Pi and shown high applicability on the commercial UAVs.

Notice of Violation of IEEE Publication Principles: Single-Image Super-Resolution Algorithm Based on Structural Self-Similarity and Deformation Block Features

Yuantao Chen, Jin Wang, Xi Chen +4 more

Computer Vision and Pattern Recognition · IEEE Access · 2019 · cited 84× · DOI ↗ · more like this ·

Notice of Violation of IEEE Publication Principles “Single-Image Super-Resolution Algorithm Based on Structural Self-Similarity and Deformation Block Features” by Yuantao Chen, Jin Wang, Xi Chen, Mingwei Zhu, Kai Yang, Zhi Wang, and Runlong Xia in IEEE Access, April 2019 After careful and considered review of the content and authorship of this paper by a duly constituted expert committee, this paper has been found to be in violation of IEEE’s Publication Principles. This paper is a translation and duplication of the content from the paper cited below. The original content was copied without attribution (including appropriate references to the original author(s) and/or paper title) and without permission. Due to the nature of this violation, reasonable effort should be made to remove all past references to this paper, and future references should be…

Constraint extraction for pseudo-functional scan-based delay testing

Yung‐Chieh Lin, Feng Lu, Kai Yang +1 more

Hardware and Architecture · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 2005 · cited 82× · DOI ↗ · more like this ·

Recent research results have shown that the traditional structural testing for delay and crosstalk faults may result in over-testing due to the non-trivial number of such faults that are untestable in the functional mode while testable in the test mode. This paper presents a pseudo-functional test methodology that attempts to minimize the over-testing problem of the scan-based circuits for the delay faults. The first pattern of a two-pattern test is still delivered by scan in the test mode but the pattern is generated in such a way that it does not violate the functional constraints extracted from the functional logic. In this paper, we use a SAT solver to extract a set of functional constraints which consists of illegal states and internal signal correlation. Along with the functional justification (also called broad-side) test application scheme, the functional constraints are imposed…

Maximum a Posteriori Probability Estimation for Online Surveillance Video Synopsis

Chun-Rong Huang, Pau-Choo Julia Chung, Di-Kai Yang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · 26 Feb 2014 · cited 79× · DOI ↗ · more like this ·

To reduce human efforts in browsing long surveillance videos, synopsis videos are proposed. Traditional synopsis video generation applying optimization on video tubes is very time consuming and infeasible for real-time online generation. This dilemma significantly reduces the feasibility of synopsis video generation in practical situations. To solve this problem, the synopsis video generation problem is formulated as a maximum a posteriori probability (MAP) estimation problem in this paper, where the positions and appearing frames of video objects are chronologically rearranged in real time without the need to know their complete trajectories. Moreover, a synopsis table is employed with MAP estimation to decide the temporal locations of the incoming foreground objects in the synopsis video without needing an optimization procedure. As a result, the computational complexity of the…

A New Linear Programming Approach to Decoding Linear Block Codes

Kai Yang, Xiaodong Wang, Jon Feldman

Computer Networks and Communications · IEEE Transactions on Information Theory · 29 Feb 2008 · cited 79× · DOI ↗ · more like this ·

<para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> In this paper, we propose a new linear programming formulation for the decoding of general linear block codes. Different from the original formulation given by Feldman, the number of total variables to characterize a parity-check constraint in our formulation is less than twice the degree of the corresponding check node. The equivalence between our new formulation and the original formulation is proven. The new formulation facilitates to characterize the structure of linear block codes, and leads to new decoding algorithms. In particular, we show that any fundamental polytope is simply the intersection of a group of the so-called minimum polytopes, and this simplified formulation allows us to formulate the problem of calculating the minimum Hamming distance of any linear block code as a…

Multivariate statistical methods in quality management

Kai Yang, Jayant Trewn

Statistics and Probability · Choice Reviews Online · July 2004 · cited 79× · DOI ↗ · more like this ·

Chapter 1: Multivariate Statistical Methods and Quality Chapter 2: Graphical Multivariate Data Display and Data Stratification Chapter 3: Introduction to Multivariate Random Variables, Normal Distribution, and Sampling Properties Chapter 4: Multivariate Analysis of Variance Chapter 5: Principal Component Analysis and Factor Analysis Chapter 6: Discriminant Analysis Chapter 7: Cluster Analysis Chapter 8: Mahalanobis Distance and Taguchi Method Chapter 9: Path Analysis and the Structural Method Chapter 10: Multivariate Statistical Process Control APPENDIX: PROBABILITY DISTRIBUTION TABLES REFERENCES INDEX