arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tiansheng Huang

54 papers · 2006–2026

2006: 12007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 02015: 02016: 02017: 02018: 12019: 02020: 42021: 22022: 32023: 62024: 152025: 162026: 6
2006peak 16 in 20252026

Frequent co-authors

Papers

showing 1–25 of 54 RSS

An Efficiency-boosting Client Selection Scheme for Federated Learning with Fairness Guarantee

Tiansheng Huang, Weiwei Lin, Wentai Wu +3 more

cs.LG · · cited 310× · arXiv ↗ · more like this ·

The issue of potential privacy leakage during centralized AI's model training has drawn intensive concern from the public. A Parallel and Distributed Computing (or PDC) scheme, termed Federated Learning (FL), has emerged as a new paradigm to cope with the privacy issue by allowing clients to perform model training locally, without the necessity to upload their personal sensitive data. In FL, the number of clients could be sufficiently large, but the bandwidth available for model distribution and re-upload is quite limited, making it sensible to only involve part of the volunteers to participate in the training process. The client selection policy is critical to an FL process in terms of training efficiency, the final model's quality as well as fairness. In this paper, we will model the fairness guaranteed client selection as a Lyapunov optimization problem and then a C2MAB-based method…

Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectives

Sihao Hu, Tiansheng Huang, Fatih İlhan +2 more

cs.CR · · cited 136× · arXiv ↗ · more like this ·

This paper provides a systematic analysis of the opportunities, challenges, and potential solutions of harnessing Large Language Models (LLMs) such as GPT-4 to dig out vulnerabilities within smart contracts based on our ongoing research. For the task of smart contract vulnerability detection, achieving practical usability hinges on identifying as many true vulnerabilities as possible while minimizing the number of false positives. Nonetheless, our empirical study reveals contradictory yet interesting findings: generating more answers with higher randomness largely boosts the likelihood of producing a correct answer but inevitably leads to a higher number of false positives. To mitigate this tension, we propose an adversarial framework dubbed GPTLens that breaks the conventional one-stage detection into two synergistic stages $-$ generation and discrimination, for progressive detection…

Stochastic Client Selection for Federated Learning with Volatile Clients

Tiansheng Huang, Weiwei Lin, Li Shen +2 more

cs.LG · · cited 133× · arXiv ↗ · more like this ·

Federated Learning (FL), arising as a privacy-preserving machine learning paradigm, has received notable attention from the public. In each round of synchronous FL training, only a fraction of available clients are chosen to participate, and the selection decision might have a significant effect on the training efficiency, as well as the final model performance. In this paper, we investigate the client selection problem under a volatile context, in which the local training of heterogeneous clients is likely to fail due to various kinds of reasons and in different levels of frequency. {\color{black}Intuitively, too much training failure might potentially reduce the training efficiency, while too much selection on clients with greater stability might introduce bias, thereby resulting in degradation of the training effectiveness. To tackle this tradeoff, we in this paper formulate the…

An Ant Colony Optimization-Based Multiobjective Service Replicas Placement Strategy for Fog Computing

Tiansheng Huang, Weiwei Lin, Chennian Xiong +2 more

Computer Networks and Communications · IEEE Transactions on Cybernetics · · cited 94× · DOI ↗ · more like this ·

In recent years, fog computing has emerged as a new paradigm for the future Internet-of-Things (IoT) applications, but at the same time, ensuing new challenges. The geographically vast-distributed architecture in fog computing renders us almost infinite choices in terms of service orchestration. How to properly arrange the service replicas (or service instances) among the nodes remains a critical problem. To be specific, in this article, we investigate a generalized service replicas placement problem that has the potential to be applied to various industrial scenarios. We formulate the problem into a multiobjective model with two scheduling objectives, involving deployment cost and service latency. For problem solving, we propose an ant colony optimization-based solution, called multireplicas Pareto ant colony optimization (MRPACO). We have conducted extensive experiments on MRPACO. The…

FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy

Yan Sun, Li Shen, Tiansheng Huang +2 more

cs.LG · · cited 89× · arXiv ↗ · more like this ·

Federated learning is an emerging distributed machine learning framework which jointly trains a global model via a large number of local devices with data privacy protections. Its performance suffers from the non-vanishing biases introduced by the local inconsistent optimal and the rugged client-drifts by the local over-fitting. In this paper, we propose a novel and practical method, FedSpeed, to alleviate the negative impacts posed by these problems. Concretely, FedSpeed applies the prox-correction term on the current local updates to efficiently reduce the biases introduced by the prox-term, a necessary regularizer to maintain the strong local consistency. Furthermore, FedSpeed merges the vanilla stochastic gradient with a perturbation computed from an extra gradient ascent step in the neighborhood, thereby alleviating the issue of local over-fitting. Our theoretical analysis…

LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversity

Selim Furkan Tekin, Fatih Ilhan, Tiansheng Huang +2 more

cs.CL · · cited 61× · arXiv ↗ · more like this ·

Combining large language models during training or at inference time has shown substantial performance gain over component LLMs. This paper presents LLM-TOPLA, a diversity-optimized LLM ensemble method with three unique properties: (i) We introduce the focal diversity metric to capture the diversity-performance correlation among component LLMs of an ensemble. (ii) We develop a diversity-optimized ensemble pruning algorithm to select the top-k sub-ensembles from a pool of $N$ base LLMs. Our pruning method recommends top-performing LLM subensembles of size $S$, often much smaller than $N$. (iii) We generate new output for each prompt query by utilizing a learn-to-ensemble approach, which learns to detect and resolve the output inconsistency among all component LLMs of an ensemble. Extensive evaluation on four different benchmarks shows good performance gain over the best LLM ensemble…

Achieving Personalized Federated Learning with Sparse Local Models

Tiansheng Huang, Shiwei Liu, Li Shen +3 more

cs.LG · · cited 52× · arXiv ↗ · more like this ·

Federated learning (FL) is vulnerable to heterogeneously distributed data, since a common global model in FL may not adapt to the heterogeneous data distribution of each user. To counter this issue, personalized FL (PFL) was proposed to produce dedicated local models for each individual user. However, PFL is far from its maturity, because existing PFL solutions either demonstrate unsatisfactory generalization towards different model architectures or cost enormous extra computation and memory. In this work, we propose federated learning with personalized sparse mask (FedSpa), a novel PFL scheme that employs personalized sparse masks to customize sparse local models on the edge. Instead of training an intact (or dense) PFL model, FedSpa only maintains a fixed number of active parameters throughout training (aka sparse-to-sparse training), which enables users' models to achieve…

Contribution‐based Federated Learning client selection

Weiwei Lin, Yinhai Xu, Bo Liu +3 more

Artificial Intelligence · International Journal of Intelligent Systems · · cited 48× · DOI ↗ · more like this ·

Federated Learning (FL), as a privacy-preserving machine learning paradigm, has been thrusted into the limelight. As a result of the physical bandwidth constraint, only a small number of clients are selected for each round of FL training. However, existing client selection solutions (e.g., the vanilla random selection) typically ignore the heterogeneous data value of the clients. In this paper, we propose the contribution-based selection algorithm (Contribution-Based Exponential-weight algorithm for Exploration and Exploitation, CBE3), which dynamically updates the selection weights according to the impact of clients' data. As a novel component of CBE3, a scaling factor, which helps maintain a good balance between global model accuracy and convergence speed, is proposed to improve the algorithm's adaptability. Theoretically, we proved the regret bound of the proposed CBE3 algorithm…

VFedCS: Optimizing Client Selection for Volatile Federated Learning

Fang Shi, Chunchao Hu, Weiwei Lin +3 more

Artificial Intelligence · IEEE Internet of Things Journal · · cited 33× · DOI ↗ · more like this ·

Federated learning (FL) has shown great potential as a privacy-preserving solution to training a centralized model based on local data from available clients. However, we argue that, over the course of training, the available clients may exhibit some volatility in terms of the client population, client data, and training status. Considering these volatilities, we propose a new learning scenario termed volatile federated learning (volatile FL) featuring set volatility, statistical volatility, and training volatility. The volatile client set along with the dynamic of clients’ data and the unreliable nature of clients (e.g., unintentional shutdown and network instability) greatly increase the difficulty of client selection. In this article, we formulate and decompose the global problem into two subproblems based on alternating minimization. For an efficient settlement for the proposed…

Adaptive Deep Neural Network Inference Optimization with EENet

Fatih Ilhan, Ka-Ho Chow, Sihao Hu +9 more

cs.LG · · cited 28× · arXiv ↗ · more like this ·

Well-trained deep neural networks (DNNs) treat all test samples equally during prediction. Adaptive DNN inference with early exiting leverages the observation that some test examples can be easier to predict than others. This paper presents EENet, a novel early-exiting scheduling framework for multi-exit DNN models. Instead of having every sample go through all DNN layers during prediction, EENet learns an early exit scheduler, which can intelligently terminate the inference earlier for certain predictions, which the model has high confidence of early exit. As opposed to previous early-exiting solutions with heuristics-based methods, our EENet framework optimizes an early-exiting policy to maximize model accuracy while satisfying the given per-sample average inference budget. Extensive experiments are conducted on four computer vision datasets (CIFAR-10, CIFAR-100, ImageNet, Cityscapes)…

ZipZap: Efficient Training of Language Models for Large-Scale Fraud Detection on Blockchain

Sihao Hu, Tiansheng Huang, Ka-Ho Chow +3 more

Information Systems · · cited 18× · DOI ↗ · more like this ·

Language models (LMs) have demonstrated superior performance in detecting fraudulent activities on Blockchains. Nonetheless, the sheer volume of Blockchain data results in excessive memory and computational costs when training LMs from scratch, limiting their capabilities to large-scale applications. In this paper, we present ZipZap, a framework tailored to achieve both parameter and computational efficiency when training LMs on large-scale transaction data. First, with the frequency-aware compression, an LM can be compressed down to a mere 7.5% of its initial size with an imperceptible performance dip. This technique correlates the embedding dimension of an address with its occurrence frequency in the dataset, motivated by the observation that embeddings of low-frequency addresses are insufficiently trained and thus negating the need for a uniformly large dimension for knowledge…

Joint Task Offloading and Service Placement for Mobile Edge Computing: An Online Two-Timescale Approach

Xin Li, Xinglin Zhang, Tiansheng Huang

Computer Networks and Communications · IEEE Transactions on Cloud Computing · · cited 18× · DOI ↗ · more like this ·

As a new computing paradigm, mobile edge computing (MEC) pushes the centralized cloud resources close to the edge network, which significantly reduces the pressure of the backbone network and meets the requirements of emerging mobile applications. To achieve high performance of the MEC system, it is essential to design efficient task offloading and service placement schemes, which are responsible for offloading tasks to the edge servers while considering the heterogeneity and diversity of computation services. Our MEC system aims to maximize the long-term average network utility while maintaining the stability of the edge network. Considering that synchronous manner overlooks the scenarios endowed with asymmetric update frequencies for service placement and task offloading, we propose an online algorithm based on the two-timescale Lyapunov optimization in a stochastic network…

Asynchronous Online Service Placement and Task Offloading for Mobile Edge Computing

Xin Li, Xinglin Zhang, Tiansheng Huang

Computer Networks and Communications · · cited 17× · DOI ↗ · more like this ·

Mobile edge computing (MEC) pushes the centralized cloud resources close to the edge network, which significantly reduces the pressure of the backbone network and meets the requirements of emerging mobile applications. To achieve high performance of the MEC system, it is essential to design efficient task offloading schemes. Many existing works focus on offloading tasks to the edge servers while ignoring the heterogeneity and diversity of computation services, which is also important in MEC. In this paper, we investigate the joint problem of online task offloading and service placement-downloading and deploying the service-related resources at edge servers-in the dense MEC network. Our MEC system aims to maximize the long-term average network utility while maintaining the stability of the edge network. Due to the uncertainty of task demands, it is impossible to make an online long-term…

Adaptive Processor Frequency Adjustment for Mobile Edge Computing with Intermittent Energy Supply

Tiansheng Huang, Weiwei Lin, Xiaobin Hong +5 more

eess.SY · · cited 9× · arXiv ↗ · more like this ·

With astonishing speed, bandwidth, and scale, Mobile Edge Computing (MEC) has played an increasingly important role in the next generation of connectivity and service delivery. Yet, along with the massive deployment of MEC servers, the ensuing energy issue is now on an increasingly urgent agenda. In the current context, the large scale deployment of renewable-energy-supplied MEC servers is perhaps the most promising solution for the incoming energy issue. Nonetheless, as a result of the intermittent nature of their power sources, these special design MEC server must be more cautious about their energy usage, in a bid to maintain their service sustainability as well as service standard. Targeting optimization on a single-server MEC scenario, we in this paper propose NAFA, an adaptive processor frequency adjustment solution, to enable an effective plan of the server's energy usage. By…

Application of Data Warehouse Technique in Educational Decision Support System

Ping Dong, Junjun Dong, Tiansheng Huang

Information Systems · 2006 IEEE International Conference on Service Operations and Logistics, and Informatics · · cited 9× · DOI ↗ · more like this ·

This paper introduces techniques of data warehouse and online analyzing processing and provides a solution to decision-making support system based on an education-related case study. The paper also discusses how to collect business data, transform and integrate these data to analyze the state of education based on OLAP and how the end user can get the information easily

AdaptiveFL: Communication-Adaptive Federated Learning Under Dynamic Bandwidth

Guozhi Liu, Weiwei Lin, Tiansheng Huang +3 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 6× · DOI ↗ · more like this ·

Federated learning (FL) is a distributed machine learning paradigm that enables heterogeneous devices to train a model collaboratively. Recognizing communication as a bottleneck in FL, existing communication-efficient solutions, e.g., HeteroFL and LotteryFL, etc., utilize gradient sparsification to reduce communication costs. However, existing solutions fail to address the dynamic bandwidth issue in which the bandwidth of each client is constantly changing throughout the training process. In this article, we propose AdaptiveFL, a communication-adaptive FL framework, considering the dynamic constraints of bandwidth. The design of AdaptiveFL follows two key steps: 1) in each round, each device selects a best-fit sub-model for communication per currently available bandwidth; and 2) to guarantee the performance of each sub-model sent under dynamic bandwidth constraints, AdaptiveFL employs a…

A Survey on Large Language Model-Based Game Agents

Sihao Hu, Tiansheng Huang, Gaowen Liu +6 more

cs.AI · · cited 6× · arXiv ↗ · more like this ·

Game environments provide rich, controllable settings that stimulate many aspects of real-world complexity. As such, game agents offer a valuable testbed for exploring capabilities relevant to Artificial General Intelligence. Recently, the emergence of Large Language Models (LLMs) provides new opportunities to endow these agents with generalizable reasoning, memory, and adaptability in complex game environments. This survey offers an up-to-date review of LLM-based game agents (LLMGAs) through a unified reference architecture. At the single-agent level, we synthesize existing studies around three core components: memory, reasoning, and perception-action interfaces, which jointly characterize how language enables agents to perceive, think, and act. At the multi-agent level, we outline how communication protocols and organizational models support coordination, role differentiation, and…

Virtual Machine Consolidation for NUMA Systems: A Hybrid Heuristic Grey Wolf Approach

Kangli Hu, Weiwei Lin, Tiansheng Huang +2 more

Information Systems · · cited 5× · DOI ↗ · more like this ·

Virtual machines consolidation is known as a powerful means to reduce the number of activated physical machines (PMs), so as to achieve energy-saving for the data centers. Although the consolidation technique is widely studied in non-NUMA systems, we could only trace a few studies targeting NUMA systems. But the virtual machines (VMs) deployment of NUMA systems is quite different from that of non-NUMA systems. More specifically, consolidating VMs in NUMA systems need to decide both target physical machines and NUMA architectures to host the VMs, and more complicated constraints originated from the real usage of NUMA systems that need to be considered. Being motivated by these challenges, we in this paper formally derive the system model according to the real business model of NUMA systems and based on which, we propose a hybrid heuristics swarm intelligence optimization algorithm HHGWA…

Fusion of Global and Local Knowledge for Personalized Federated Learning

Tiansheng Huang, Li Shen, Yan Sun +2 more

cs.LG · · cited 4× · arXiv ↗ · more like this ·

Personalized federated learning, as a variant of federated learning, trains customized models for clients using their heterogeneously distributed data. However, it is still inconclusive about how to design personalized models with better representation of shared global knowledge and personalized pattern. To bridge the gap, we in this paper explore personalized models with low-rank and sparse decomposition. Specifically, we employ proper regularization to extract a low-rank global knowledge representation (GKR), so as to distill global knowledge into a compact representation. Subsequently, we employ a sparse component over the obtained GKR to fuse the personalized pattern into the global knowledge. As a solution, we propose a two-stage proximal-based algorithm named \textbf{Fed}erated learning with mixed \textbf{S}parse and \textbf{L}ow-\textbf{R}ank representation (FedSLR) to…

Hierarchical Deep Neural Network Inference for Device-Edge-Cloud Systems

Fatih İlhan, Selim Furkan Tekin, Sihao Hu +3 more

Computer Networks and Communications · The HKU Scholars Hub (University of Hong Kong) · · cited 3× · DOI ↗ · more like this ·

Edge computing and cloud computing have been utilized in many AI applications in various fields, such as computer vision, NLP, autonomous driving, and smart cities. To benefit from the advantages of both paradigms, we introduce HiDEC, a hierarchical deep neural network (DNN) inference framework with three novel features. First, HiDEC enables the training of a resource-adaptive DNN through the injection of multiple early exits. Second, HiDEC provides a latency-aware inference scheduler, which determines which input samples should exit locally on an edge device based on the exit scores, enabling inference on edge devices with insufficient resources to run the full model. Third, we introduce a dual thresholding approach allowing both easy and difficult samples to exit early. Our experiments on image and text classification benchmarks show that HiDEC significantly outperforms existing…

Pitch and Mode Recognition of Humming Melodies

Tiansheng Huang, Yibiao Yu

Signal Processing · · cited 3× · DOI ↗ · more like this ·

The pitch and mode recognition of the humming melody is an important guarantee for humming music retrieval and automatic transcription. In view of the character that the pitches of humming melody are understandard and unstable, based on the pitch extraction in the cepstrum domain, this paper recognizes the humming pitches and gets the note sequence by detecting the stable ranges of the extracted fundamental frequencies above all. Then, the mode of the note sequence is recognized according to the features of the 24 tonalities and the result of the tonic detection. Experiments show that the method proposed in this paper can effectively achieve the pitch and mode recognition of the humming melody.

Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey

Tiansheng Huang, Sihao Hu, Fatih Ilhan +2 more

cs.CR · · cited 2× · arXiv ↗ · more like this ·

Recent research demonstrates that the nascent fine-tuning-as-a-service business model exposes serious safety concerns: fine-tuning with a few harmful data uploaded from the users can compromise the safety alignment of the model. The attack, known as harmful fine-tuning attack, has generated broad research interests in both academia and industry. In this paper, we first systematically formulate the threat model and basic assumptions of harmful fine-tuning. Then, we provide a comprehensive review of harmful fine-tuning from three fundamental perspectives: attack setting, defense design, and evaluation methodology. First, we present the threat model of the problem and introduce the harmful fine-tuning attack and its variants. Next, we systematically survey representative attacks, defense methods, and mechanical analysis of adverse effects in the existing literature. Finally, we introduce…

Diversity-driven Privacy Protection Masks Against Unauthorized Face Recognition

Ka-Ho Chow, Sihao Hu, Tiansheng Huang +3 more

Computer Vision and Pattern Recognition · Proceedings on Privacy Enhancing Technologies · · cited 2× · DOI ↗ · more like this ·

Face recognition (FR) technologies have enabled many life-enriching applications but have also opened doors for potential misuse. Governments, private companies, or even individuals can scrape the web, collect facial images, and build a face database to fuel the FR system to identify human faces without their consent. This paper introduces PMask to combat such a privacy threat against unauthorized FR. It provides a holistic approach to enable privacy-preserving sharing of facial images. PMask preprocesses the facial image and hides its unique facial signature through iterative optimization with dual goals: (i) minimizing the amount of noise to ensure high image quality and (ii) minimizing the perception loss between the privacy-protected face and the original face to ensure the face is recognizable to be the same person by humans. Extensive experiments are conducted on eight…

Data Poisoning and Leakage Analysis in Federated Learning

Wenqi Wei, Tiansheng Huang, Zachary Yahn +3 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Data poisoning and leakage risks impede the massive deployment of federated learning in the real world. This chapter reveals the truths and pitfalls of understanding two dominating threats: {\em training data privacy intrusion} and {\em training data poisoning}. We first investigate training data privacy threat and present our observations on when and how training data may be leaked during the course of federated training. One promising defense strategy is to perturb the raw gradient update by adding some controlled randomized noise prior to sharing during each round of federated learning. We discuss the importance of determining the proper amount of randomized noise and the proper location to add such noise for effective mitigation of gradient leakage threats against training data privacy. Then we will review and compare different training data poisoning threats and analyze why and…

Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation

Tiansheng Huang, Sihao Hu, Fatih Ilhan +2 more

cs.CL · · cited 1× · arXiv ↗ · more like this ·

Harmful fine-tuning attack poses serious safety concerns for large language models' fine-tuning-as-a-service. While existing defenses have been proposed to mitigate the issue, their performances are still far away from satisfactory, and the root cause of the problem has not been fully recovered. To this end, we in this paper show that harmful perturbation over the model weights could be a probable cause of alignment-broken. In order to attenuate the negative impact of harmful perturbation, we propose an alignment-stage solution, dubbed Booster. Technically, along with the original alignment loss, we append a loss regularizer in the alignment stage's optimization. The regularizer ensures that the model's harmful loss reduction after the simulated harmful perturbation is attenuated, thereby mitigating the subsequent fine-tuning risk. Empirical results show that Booster can effectively…