Author

Xiangyu Li

403 papers · 1753–2026

1967peak 82 in 20262026

Frequent co-authors

Papers

showing 1–25 of 403 RSS

Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security

Yuanchun Li, Hao Wen, Weijun Wang +22 more

cs.HC · January 2024 · cited 386× · arXiv ↗ · more like this ·

Since the advent of personal computing devices, intelligent personal assistants (IPAs) have been one of the key technologies that researchers and engineers have focused on, aiming to help users efficiently obtain information and execute tasks, and provide users with more intelligent, convenient, and rich interaction experiences. With the development of smartphones and IoT, computing and sensing devices have become ubiquitous, greatly expanding the boundaries of IPAs. However, due to the lack of capabilities such as user intent understanding, task planning, tool using, and personal data management etc., existing IPAs still have limited practicality and scalability. Recently, the emergence of foundation models, represented by large language models (LLMs), brings new opportunities for the development of IPAs. With the powerful semantic understanding and reasoning capabilities, LLM can…

Davies Bouldin Index based hierarchical initialization K-means

Junwei Xiao, Jianfeng Lu, Xiangyu Li

Artificial Intelligence · Intelligent Data Analysis · 15 Nov 2017 · cited 161× · DOI ↗ · more like this ·

K-means algorithm is an effective clustering algorithm based on partition, which has been widely used for clustering analysis. However, there are two main problems for K-means algorithm: how to provide appropriate number of clusters and how to determine initial cluster centers automatically. Plenty of methods have been proposed to address the above problems. In our previous work, we proposed the hierarchical initialization approach to determine initial cluster centers, but we cannot provide the number of clusters automatically. In this paper, in order to determine the number of clusters automatically, we propose the Davies Bouldin Index (DBI) based hierarchical K-means (DHIKM) algorithm on the basis of our previous work. The proposed algorithm can integrate DBI metric into our hierarchical K-means algorithm and can determine the number of clusters with low time cost. Experiments on UCI…

Hetero-mark, a benchmark suite for CPU-GPU collaborative computing

Yifan Sun, Xiang Gong, Amir Kavyan Ziabari +6 more

Hardware and Architecture · September 2016 · cited 115× · DOI ↗ · more like this ·

Graphics Processing Units (GPUs) can easily outperform CPUs in processing large-scale data parallel workloads, but are considered weak in processing serialized tasks and communicating with other devices. Pursuing a CPU-GPU collaborative computing model which takes advantage of both devices could provide an important breakthrough in realizing the full performance potential of heterogeneous computing. In recent years platform vendors and runtime systems have added new features such as unified memory space and dynamic parallelism, providing a path to CPU-GPU coordination and necessary programming infrastructure to support future heterogeneous applications. As the rate of adoption of CPU-GPU collaborative computing continues to increase, it becomes increasingly important to formalize CPU-GPU collaborative programming paradigms and understand the impact of this emerging model on overall…

Siamese Contrastive Embedding Network for Compositional Zero-Shot Learning

Xiangyu Li, Xu Yang, Kun Wei +2 more

cs.CV · 29 Jun 2022 · cited 109× · arXiv ↗ · more like this ·

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen compositions formed from seen state and object during training. Since the same state may be various in the visual appearance while entangled with different objects, CZSL is still a challenging task. Some methods recognize state and object with two trained classifiers, ignoring the impact of the interaction between object and state; the other methods try to learn the joint representation of the state-object compositions, leading to the domain gap between seen and unseen composition sets. In this paper, we propose a novel Siamese Contrastive Embedding Network (SCEN) (Code: https://github.com/XDUxyLi/SCEN-master) for unseen composition recognition. Considering the entanglement between state and object, we embed the visual feature into a Siamese Contrastive Space to capture prototypes of them separately, alleviating the…

Trear: Transformer-based RGB-D Egocentric Action Recognition

Xiangyu Li, Yonghong Hou, Pichao Wang +3 more

cs.CV · 5 Jan 2021 · cited 107× · arXiv ↗ · more like this ·

In this paper, we propose a \textbf{Tr}ansformer-based RGB-D \textbf{e}gocentric \textbf{a}ction \textbf{r}ecognition framework, called Trear. It consists of two modules, inter-frame attention encoder and mutual-attentional fusion block. Instead of using optical flow or recurrent units, we adopt self-attention mechanism to model the temporal structure of the data from different modalities. Input frames are cropped randomly to mitigate the effect of the data redundancy. Features from each modality are interacted through the proposed fusion block and combined through a simple yet effective fusion operation to produce a joint RGB-D representation. Empirical experiments on two large egocentric RGB-D datasets, THU-READ and FPHA, and one small dataset, WCVS, have shown that the proposed method outperforms the state-of-the-art results by a large margin.

Generalized Zero-Shot Learning via Disentangled Representation

Xiangyu Li, Zhe Xu, Kun Wei +1 more

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence · 18 May 2021 · cited 77× · DOI ↗ · more like this ·

Zero-Shot Learning (ZSL) aims to recognize images belonging to unseen classes that are unavailable in the training process, while Generalized Zero-Shot Learning (GZSL) is a more realistic variant that both seen and unseen classes appear during testing. Most GZSL approaches achieve knowledge transfer based on the features of samples that inevitably contain information irrelevant to recognition, bringing negative influence for the performance. In this work, we propose a novel method, dubbed Disentangled-VAE, which aims to disentangle category-distilling factors and category-dispersing factors from visual as well as semantic features, respectively. In addition, a batch re-combining strategy on latent features is introduced to guide the disentanglement, encouraging the distilling latent features to be more discriminative for recognition. Extensive experiments demonstrate that our method…

Mystic: Predictive Scheduling for GPU Based Cloud Servers Using Machine Learning

Yash Ukidave, Xiangyu Li, David Kaeli

Information Systems · May 2016 · cited 63× · DOI ↗ · more like this ·

GPUs have become the primary choice of accelerators for high-end data centers and cloud servers, which can host thousands of disparate applications. With the growing demands for GPUs on clusters, there arises a need for efficient co-execution of applications on the same accelerator device. However, the resource contention among co-executing applications causes interference which leads to degradation in execution performance, impacts QoS requirements of applications and lowers overall system throughput. While previous work has proposed techniques for detecting interference, the existing solutions are either developed for CPU clusters, or use static profiling approaches which can be computationally intensive and do not scale well. We present Mystic, an interference-aware scheduler for efficient co-execution of applications on GPU-based clusters and cloud servers. The most important…

DIMMining

Guohao Dai, Zhenhua Zhu, Tianyu Fu +6 more

Computer Vision and Pattern Recognition · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 31 May 2022 · cited 52× · DOI ↗ · more like this ·

Graph mining, which finds specific patterns in the graph, is becoming increasingly important in various domains. We point out that accelerating graph mining suffers from the following challenges: (1) Heavy comparison for pruning: Pruning technique is widely used to reduce search space in graph mining. It applies constraints on vertex indices and involves massive index comparisons. (2) Low parallelism of set operations: The typical graph mining algorithms can be expressed as a series of set operations between neighbors of vertices, which suffer from low parallelism if vertices are streaming to the computation units. (3) Heavy data transfer: Graph mining needs to transfer intermediate data with two orders of magnitude larger than the original data volume between CPU and memory.

Enlightened debugging

Xiangyu Li, Shaowei Zhu, Marcelo d’Amorim +1 more

Information Systems · 27 May 2018 · cited 45× · DOI ↗ · more like this ·

Numerous automated techniques have been proposed to reduce the cost of software debugging, a notoriously time-consuming and human-intensive activity. Among these techniques, Statistical Fault Localization (SFL) is particularly popular. One issue with SFL is that it is based on strong, often unrealistic assumptions on how developers behave when debugging. To address this problem, we propose Enlighten, an interactive, feedback-driven fault localization technique. Given a failing test, Enlighten (1) leverages SFL and dynamic dependence analysis to identify suspicious method invocations and corresponding data values, (2) presents the developer with a query about the most suspicious invocation expressed in terms of inputs and outputs, (3) encodes the developer feedback on the correctness of individual data values as extra program specifications, and (4) repeats these steps until the fault is…

STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing

Zefeng Cai, Xiangyu Li, Binyuan Hui +8 more

cs.CL · 28 Oct 2022 · cited 40× · arXiv ↗ · more like this ·

In this paper, we propose a novel SQL guided pre-training framework STAR for context-dependent text-to-SQL parsing, which leverages contextual information to enrich natural language (NL) utterance and table schema representations for text-to-SQL conversations. Concretely, we propose two novel pre-training objectives which respectively explore the context-dependent interactions of NL utterances and SQL queries within each text-to-SQL conversation: (i) schema state tracking (SST) objective that tracks and explores the schema states of context-dependent SQL queries in the form of schema-states by predicting and updating the value of each schema slot during interaction; (ii) utterance dependency tracking (UDT) objective that employs weighted contrastive learning to pull together two semantically similar NL utterances and push away the representations of semantically dissimilar NL utterances…

The Factors Influencing Resident’s Intentions on E-Bike Sharing Usage in China

Ruiwei Li, Gobi Krishna Sinniah, Xiangyu Li

Transportation · Sustainability · 22 Apr 2022 · cited 40× · DOI ↗ · more like this ·

E-bike sharing is considered a new mode of transport that is rapidly developing in China. In order to better understand the factors affecting the intention to use e-bike sharing, this study is based on the theory of planned behavior (TPB) and the technology acceptance model (TAM) and added the variable of policy support. A sample of 441 respondents in a small city in China was collected to analyze residents’ intention on e-bike sharing usage. The results show that the research model can explain well residents’ intention to use shared e-bikes. Perceived ease of use, perceived usefulness, attitude, subjective norms, and perceived behavioral control have direct positive effects on the intention to use shared e-bikes. Among them, the perceived ease of use has the greatest impact on the intention to use shared e-bikes. Moreover, policy support has an indirect positive influence on the…

Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality

Jing Qian, Jiaju Ma, Xiangyu Li +5 more

Computer Vision and Pattern Recognition · 17 Oct 2019 · cited 40× · DOI ↗ · more like this ·

Smartphone augmented reality (AR) lets users interact with physical and virtual spaces simultaneously. With 3D hand tracking, smartphones become apparatus to grab and move virtual objects directly. Based on design considerations for interaction, mobility, and object appearance and physics, we implemented a prototype for portable 3D hand tracking using a smartphone, a Leap Motion controller, and a computation unit. Following an experience prototyping procedure, 12 researchers used the prototype to help explore usability issues and define the design space. We identified issues in perception (moving to the object, reaching for the object), manipulation (successfully grabbing and orienting the object), and behavioral understanding (knowing how to use the smartphone as a viewport). To overcome these issues, we designed object-based feedback and accommodation mechanisms and studied their…

High-efficiency reinforcement learning with hybrid architecture photonic integrated circuit

Xuan-Kun Li, Jian-Xu Ma, Xiangyu Li +6 more

Artificial Intelligence · Nature Communications · 5 Feb 2024 · cited 37× · DOI ↗ · more like this ·

Reinforcement learning (RL) stands as one of the three fundamental paradigms within machine learning and has made a substantial leap to build general-purpose learning systems. However, using traditional electrical computers to simulate agent-environment interactions in RL models consumes tremendous computing resources, posing a significant challenge to the efficiency of RL. Here, we propose a universal framework that utilizes a photonic integrated circuit (PIC) to simulate the interactions in RL for improving the algorithm efficiency. High parallelism and precision on-chip optical interaction calculations are implemented with the assistance of link calibration in the hybrid architecture PIC. By introducing similarity information into the reward function of the RL model, PIC-RL successfully accomplishes perovskite materials synthesis task within a 3472-dimensional state space, resulting…

An Improved Traffic Sign Detection and Recognition Deep Model Based on YOLOv5

Qianying Wang, Xiangyu Li, Ming Lu

Computer Vision and Pattern Recognition · IEEE Access · 2023 · cited 34× · DOI ↗ · more like this ·

In this paper, we aim at the traffic sign detection and recognition in complex road conditions. We proposed a deep model for traffic sign detection and recognition. There are a few difficulties in traffic sign detection task, such as, less recognizable, small target size, easily leading to detected failure and so on. First, for the failure detection, we introduce Coordinate Attention (CA); second, to accelerate the regression of prediction box, we introduce the angle loss into our objective function; third, for the overlapping and occlusion phenomenon of ground truth, a dynamic label assignment strategy- simple Optimal Transport Assignment (SimOTA) is utilized during label assignment; the last and the most important, for the target size problem, we propose a feature fusion network, named hierarchical-path feature fusion network (H-PFANet). Experiments were conducted on two public data…

Tutti

Shaoqing Xu, Anfu Zhou, Guixian Wang +4 more

Computer Vision and Pattern Recognition · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · 14 Oct 2022 · cited 32× · DOI ↗ · more like this ·

Mobile edge computing (MEC), as a key ingredient of the 5G ecosystem, is envisioned to support demanding applications with stringent latency requirements. The basic idea is to deploy servers close to end-users, e.g., on the network edge-side instead of the remote cloud. While conceptually reasonable, we find that the operational 5G is not coordinated with MEC and thus suffers from intolerable long response latency. In this work, we propose Tutti, which couples 5G RAN and MEC at the user space to assure the performance of latency-critical video analytics. To enable such capacity, Tutti precisely customizes the application service demand by fusing instantaneous wireless dynamics from the 5G RAN and application-layer content changes from edge servers. Tutti then enforces a deadline-sensitive resource provision for meeting the application service demand by real-time interaction between 5G…

SI PUF: An SRAM and Inverter-Based PUF With a Bit Error Rate of 0.0053% and 0.073/0.042 pJ/bit

Li Ni, Pengjun Wang, Yuejun Zhang +4 more

Hardware and Architecture · IEEE Transactions on Circuits & Systems II Express Briefs · 12 Dec 2023 · cited 31× · DOI ↗ · more like this ·

The physical unclonable function (PUF) can generate a unique identifier for each chip, ideal for key generation and chip anti-counterfeiting. The reliability of PUF is paramount, and therefore is one of the significant challenges for PUF design. This brief proposes a novel SRAM- and Inverter-based PUF (SI PUF) that can operate as either an SRAM PUF or an inverter PUF, depending on the input configuration signal. A zero-overhead bit configuration strategy (BCS) is proposed to enhance the reliability of PUF. Moreover, the working voltage of the sub-threshold level and the well-designed discharge stage ensure that our SI PUF can operate with low power consumption. The tested results of chips fabricated in 40-nm CMOS show that our SI PUF has only 0.0053% of the worst bit error rate (BER) under working conditions of −50 to 125°C and 0.75 to 1.5V, with 0.073/0.042 pJ/bit of power consumption.…

Generative Pre-Trained Transformer-Based Reinforcement Learning for Testing Web Application Firewalls

Hongliang Liang, Xiangyu Li, Da Xiao +4 more

Computer Networks and Communications · IEEE Transactions on Dependable and Secure Computing · 6 Mar 2023 · cited 31× · DOI ↗ · more like this ·

Web Application Firewalls (WAFs) are widely deployed to protect key web applications against multiple security threats, so it is important to test WAFs regularly to prevent attackers from bypassing them easily. Machine-learning-based black-box WAF testing is gaining more attention, though existing learning-based approaches have strict requirements on the source and scale of payload data and suffer from the local optimum problem, limiting their effectiveness and practical application. We propose GPTFuzzer, a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">practical</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">effective</i> generation-based approach to test WAFs by generating attack payloads token-by-token. Specifically, we fine-tune a Generative Pre-trained Transformer language…

Efficient High Cross-User Recognition Rate Ultrasonic Hand Gesture Recognition System

Feifei Zhou, Xiangyu Li, Zhihua Wang

Human-Computer Interaction · IEEE Sensors Journal · 22 Jun 2020 · cited 31× · DOI ↗ · more like this ·

Hand gesture recognition is the key technique to realize free air hand gesture human-computer interaction, which is promising and attractive for a wide range of emerging ubiquitous applications. Ultrasonic-based solutions are lighting-condition independent and low-power and have little interference. A low-complexity 40 kHz ultrasonic-based hand gesture recognition system featuring a novel classification algorithm robust to temporal variations of motions is proposed in this paper. It employs one transmitter, three receivers, and highly digitalized front-end hardware. A coherent pulse train ultrasonic system with moving target detection capability is built to collect the RDM (range Doppler map) streams of gestures. During training and inference, the classifier algorithm aligns the sequential features extracted from the RDM of each frame with the template sequence of each class by dynamic…

GSEDroid: GNN-based Android malware detection framework using lightweight semantic embedding

Jintao Gu, Hongliang Zhu, Zewei Han +2 more

Signal Processing · Computers & Security · 12 Mar 2024 · cited 29× · DOI ↗ · more like this ·

Currently, the prevalence of Android malware remains substantial. Malicious programs increasingly use advanced obfuscation techniques, posing challenges for security professionals with enhanced disguises, a proliferation of variants, and escalating detection difficulty. Leveraging semantic features presents a promising avenue to address these challenges. Rich semantic information encapsulated within opcodes and API call graphs has been identified as crucial in distinguishing benign from malicious applications. Consequently, various Natural Language Processing (NLP) technologies, such as Word2vec, are employed to encode features of Dalvik opcode sequences, thereby yielding embedded representations.Given that malware developers often opt for semantically similar APIs to achieve comparable functionalities, it is posited that the opcode embeddings for such APIs should exhibit similar…

Two-Stage Offloading for an Enhancing Distributed Vehicular Edge Computing and Networks: Model and Algorithm

Xuehan Li, Tao Jing, Xiaoxuan Wang +5 more

Computer Networks and Communications · IEEE Transactions on Intelligent Transportation Systems · 15 Jul 2024 · cited 26× · DOI ↗ · more like this ·

Vehicular Edge Computing and Networks (VECoNs) have gained popularity for its enhanced Internet of Vehicles (IoV) capabilities. To satisfy the needs of delay-sensitive and computation-intensive in-vehicle applications, VECoNs need to provide low-latency task offloading services. However, existing offloading frameworks generally overlook the spatially and temporally heterogeneous computation task arrival patterns. The former causes overloading and underloading of RSU computational resources and thus hinders further reduction of offloading latency on the macro-scale, while the latter emphasizes the importance of long-term system performance, especially energy constraints, posing challenges to the design of offloading framework and optimization strategies. This paper introduces a novel distributed two-stage task offloading architecture based on Lyapunov and multi-agent deep deterministic…

Web 2.0, the online community and destination marketing.

Peter O’Connor, Yubing Wang, Xiangyu Li

Sociology and Political Science · CABI eBooks · 2011 · cited 25× · DOI ↗ · more like this ·

This chapter examines the developing Web 2.0 phenomenon, assessing its implications for destination sales and marketing. Initially, the importance of information for travel is examined. How these information needs have been satisfied in the past (and, it must be said, continue to be satisfied in parallel with the Web 2.0 developments discussed here) is critiqued, and the effect of Web 2.0-and in particular the virtual community-is discussed. A conceptual model for the definition of virtual community as one form of social media is introduced followed by discussion of member participation in and active contribution to such virtual tourist community. Lastly, the implications of Web 2.0 and social media developments for the future of destination distribution are discussed.

Rural and urban general education teachers’ instructional strategies in inclusive classrooms in China: a dual system perspective

Huan Li, Xiangyu Li

Safety Research · International Journal of Inclusive Education · 16 Sep 2020 · cited 24× · DOI ↗ · more like this ·

Due to China’s unique rural-urban dual system, education differs significantly between rural and urban schools. However, research related to the rural-urban disparity in inclusive education is limited. Moreover, general education teachers’ instructional strategies, in particular, remain unclear and could be studied further. To bridge this gap, a qualitative method was adopted to interview 16 general education teachers in rural and urban inclusive classrooms in China, and the differences in inclusive instructional strategies, teaching design, and support for and barriers to general education teachers’ inclusive instruction were explored. The findings showed that shorter assignments and different expectations were the most frequently utilised strategies in inclusive classrooms; teachers’ teaching designs were significantly geared towards general education instead of students’…

Grass-Root Organisations, Intergovernmental Collaboration, and Emergency Preparedness: An Institutional Collective Action Approach

Simon A. Andrew, Kyujin Jung, Xiangyu Li

Sociology and Political Science · Local Government Studies · 24 Feb 2015 · cited 24× · DOI ↗ · more like this ·

This paper examines the importance of grass-root emergency response groups in emergency preparedness. Consistent with the Institutional Collective Action framework, we highlight key constraints associated with local government strategies of mutual resource exchange and barriers to intergovernmental collaboration. We examine local governments’ emergency preparedness using survey data collected in the North Central Texas region. We employed a simple OLS analysis to determine mutual exchange and Poisson estimations on the likelihood of local governments receiving and providing external assistance. Findings showed that the presence of grass-root organisations in a jurisdiction is associated with emergency preparedness, highlighting the importance of norms of volunteerism. Local political institutions and participation in federally funded programmes also have an effect on local government…

Design of Interface Circuits and Lightweight PUF for TMR Sensors

Xiangyu Li, Pengjun Wang, Gang Li +2 more

Hardware and Architecture · IEEE Sensors Journal · 18 Apr 2023 · cited 23× · DOI ↗ · more like this ·

The micromagnetometers with high-resolution digital output are widely used in military and civilian fields. We proposed a novel high-precision interface circuit with an optimized chopper technique and switched-capacitor (SC) modulator for tunneling magnetoresistance (TMR) sensors. This work also proposes a novel method to create a lightweight physically unclonable function (PUF) by using existing TMR devices. The sigma-delta modulator converts the sensor signal into a robust digital output and maintains the signal-to-noise ratio (SNR) of the front-end circuit. We also take advantage of inherent variations of TMR sensors to generate PUF responses that are similarly unique and unclonable. The interface circuit is fabricated by a 0.35- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mu \text{m}$…

Factor-Bounded Nonnegative Matrix Factorization

Kai Liu, Xiangyu Li, Zhihui Zhu +2 more

Computer Vision and Pattern Recognition · ACM Transactions on Knowledge Discovery from Data · 19 May 2021 · cited 23× · DOI ↗ · more like this ·

Nonnegative Matrix Factorization (NMF) is broadly used to determine class membership in a variety of clustering applications. From movie recommendations and image clustering to visual feature extractions, NMF has applications to solve a large number of knowledge discovery and data mining problems. Traditional optimization methods, such as the Multiplicative Updating Algorithm (MUA), solves the NMF problem by utilizing an auxiliary function to ensure that the objective monotonically decreases. Although the objective in MUA converges, there exists no proof to show that the learned matrix factors converge as well. Without this rigorous analysis, the clustering performance and stability of the NMF algorithms cannot be guaranteed. To address this knowledge gap, in this article, we study the factor-bounded NMF problem and provide a solution algorithm with proven convergence by rigorous…