Author

Xiaofei Wang

616 papers · 1997–2026

1997peak 84 in 20242026

Frequent co-authors

Papers

showing 1–25 of 616 RSS

Convergence of Edge Computing and Deep Learning: A Comprehensive Survey

Xiaofei Wang, Yiwen Han, Victor C. M. Leung +3 more

cs.NI · July 2019 · cited 1,274× · arXiv ↗ · more like this ·

Ubiquitous sensors and smart devices from factories and communities are generating massive amounts of data, and ever-increasing computing power is driving the core of computation and services from the cloud to the edge of the network. As an important enabler broadly changing people's lives, from face recognition to ambitious smart factories and cities, developments of artificial intelligence (especially deep learning, DL) based applications and services are thriving. However, due to efficiency and latency issues, the current cloud computing service architecture hinders the vision of "providing artificial intelligence for every person and every organization at everywhere". Thus, unleashing DL services using resources at the network edge near the data sources has emerged as a desirable solution. Therefore, edge intelligence, aiming to facilitate the deployment of DL services by edge…

Cache in the air: exploiting content caching and delivery techniques for 5G systems

Xiaofei Wang, Min Chen, Tarik Taleb +2 more

Computer Networks and Communications · IEEE Communications Magazine · February 2014 · cited 1,133× · DOI ↗ · more like this ·

The demand for rich multimedia services over mobile networks has been soaring at a tremendous pace over recent years. However, due to the centralized architecture of current cellular networks, the wireless link capacity as well as the bandwidth of the radio access networks and the backhaul network cannot practically cope with the explosive growth in mobile traffic. Recently, we have observed the emergence of promising mobile content caching and delivery techniques, by which popular contents are cached in the intermediate servers (or middleboxes, gateways, or routers) so that demands from users for the same content can be accommodated easily without duplicate transmissions from remote servers; hence, redundant traffic can be significantly eliminated. In this article, we first study techniques related to caching in current mobile networks, and discuss potential techniques for caching in…

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

Xiaofei Wang, Yiwen Han, Chenyang Wang +3 more

cs.NI · September 2018 · cited 912× · arXiv ↗ · more like this ·

Recently, along with the rapid development of mobile communication technology, edge computing theory and techniques have been attracting more and more attentions from global researchers and engineers, which can significantly bridge the capacity of cloud and requirement of devices by the network edges, and thus can accelerate the content deliveries and improve the quality of mobile services. In order to bring more intelligence to the edge systems, compared to traditional optimization methodology, and driven by the current deep learning techniques, we propose to integrate the Deep Reinforcement Learning techniques and Federated Learning framework with the mobile edge systems, for optimizing the mobile edge computing, caching and communication. And thus, we design the "In-Edge AI" framework in order to intelligently utilize the collaboration among devices and edge nodes to exchange the…

A Comparative Study on Transformer vs RNN in Speech Applications

Shigeki Karita, Nanxin Chen, Tomoki Hayashi +10 more

cs.CL · 28 Sep 2019 · cited 808× · arXiv ↗ · more like this ·

Sequence-to-sequence models have been widely used in end-to-end speech processing, for example, automatic speech recognition (ASR), speech translation (ST), and text-to-speech (TTS). This paper focuses on an emergent sequence-to-sequence model called Transformer, which achieves state-of-the-art performance in neural machine translation and other natural language processing applications. We undertook intensive studies in which we experimentally compared and analyzed Transformer and conventional recurrent neural networks (RNN) in a total of 15 ASR, one multilingual ASR, one ST, and two TTS benchmarks. Our experiments revealed various training tips and significant performance benefits obtained with Transformer for each task including the surprising superiority of Transformer in 13/15 ASR benchmarks in comparison with RNN. We are preparing to release Kaldi-style reproducible recipes using…

Federated Deep Reinforcement Learning for Internet of Things With Decentralized Cooperative Edge Caching

Xiaofei Wang, Chenyang Wang, Xiuhua Li +2 more

Computer Networks and Communications · IEEE Internet of Things Journal · 9 Apr 2020 · cited 410× · DOI ↗ · more like this ·

Edge caching is an emerging technology for addressing massive content access in mobile networks to support rapidly growing Internet-of-Things (IoT) services and applications. However, most current optimization-based methods lack a self-adaptive ability in dynamic environments. To tackle these challenges, current learning-based approaches are generally proposed in a centralized way. However, network resources may be overconsumed during the training and data transmission process. To address the complex and dynamic control issues, we propose a federated deep-reinforcement-learning-based cooperative edge caching (FADE) framework. FADE enables base stations (BSs) to cooperatively learn a shared predictive model by considering the first-round training parameters of the BSs as the initial input of the local training, and then uploads near-optimal local parameters to the BSs to participate in…

E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS

Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker +10 more

eess.AS · June 2024 · cited 255× · arXiv ↗ · more like this ·

This paper introduces Embarrassingly Easy Text-to-Speech (E2 TTS), a fully non-autoregressive zero-shot text-to-speech system that offers human-level naturalness and state-of-the-art speaker similarity and intelligibility. In the E2 TTS framework, the text input is converted into a character sequence with filler tokens. The flow-matching-based mel spectrogram generator is then trained based on the audio infilling task. Unlike many previous works, it does not require additional components (e.g., duration model, grapheme-to-phoneme) or complex techniques (e.g., monotonic alignment search). Despite its simplicity, E2 TTS achieves state-of-the-art zero-shot TTS capabilities that are comparable to or surpass previous works, including Voicebox and NaturalSpeech 3. The simplicity of E2 TTS also allows for flexibility in the input representation. We propose several variants of E2 TTS to improve…

Dynamic Resource Prediction and Allocation for Cloud Data Center Using the Multiobjective Genetic Algorithm

Fan‐Hsun Tseng, Xiaofei Wang, Li‐Der Chou +2 more

Information Systems · IEEE Systems Journal · 21 Jul 2017 · cited 200× · DOI ↗ · more like this ·

In order to optimize the resource utilization of physical machines (PMs), the workload prediction of virtual machines (VMs) is vital but challenging. Most of existing literatures focus on either resource prediction or allocation individually, but both of them are highly correlated. In this paper, we propose a multiobjective genetic algorithm (GA) to dynamically forecast the resource utilization and energy consumption in cloud data center. We formulate a multiobjective optimization problem of resource allocation, which considers the CPU and memory utilization of VMs and PMs, and the energy consumption of data center. The proposed GA forecasts the resource requirement of next time slot according to the historical data in previous time slots. We further propose a VM placement algorithm to allocate VMs for next time slot based on the prediction results of GA. In our simulation-based…

Serialized Output Training for End-to-End Overlapped Speech Recognition

Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang +2 more

cs.CL · March 2020 · cited 177× · arXiv ↗ · more like this ·

This paper proposes serialized output training (SOT), a novel framework for multi-speaker overlapped speech recognition based on an attention-based encoder-decoder approach. Instead of having multiple output layers as with the permutation invariant training (PIT), SOT uses a model with only one output layer that generates the transcriptions of multiple speakers one after another. The attention and decoder modules take care of producing multiple transcriptions from overlapped speech. SOT has two advantages over PIT: (1) no limitation in the maximum number of speakers, and (2) an ability to model the dependencies among outputs for different speakers. We also propose a simple trick that allows SOT to be executed in $O(S)$, where $S$ is the number of the speakers in the training sample, by using the start times of the constituent source utterances. Experimental results on LibriSpeech corpus…

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching

Xiaofei Wang, Ruibin Li, Chenyang Wang +3 more

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · 9 Nov 2020 · cited 150× · DOI ↗ · more like this ·

In order to meet the growing demands for multimedia service access and release the pressure of the core network, edge caching and device-to-device (D2D) communication have been regarded as two promising techniques in next generation mobile networks and beyond. However, most existing related studies lack consideration of effective cooperation and adaptability to the dynamic network environments. In this article, based on the flexible trilateral cooperation among user equipment, edge base stations and a cloud server, we propose a D2D-assisted heterogeneous collaborative edge caching framework by jointly optimizing the node selection and cache replacement in mobile networks. We formulate the joint optimization problem as a Markov decision process, and use a deep Q-learning network to solve the long-term mixed integer linear programming problem. We further design an attention-weighted…

Hierarchical Edge Caching in Device-to-Device Aided Mobile Networks: Modeling, Optimization, and Design

Xiuhua Li, Xiaofei Wang, Peng‐Jun Wan +2 more

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · 6 Jun 2018 · cited 143× · DOI ↗ · more like this ·

The explosive growth of content requests from mobile users is stretching the capability of current mobile networking technologies to satisfy users' demands with acceptable quality of service. An effective approach to address this challenge, which has not yet been thoroughly studied, is to offload network traffic by caching popular content at the edges (e.g., mobile devices and base stations) of mobile networks, thus reducing the massive duplication of content downloads. In this paper, we address the system modeling, large-scale optimization, and framework design of hierarchical edge caching in device-to-device aided mobile networks. In particular, taking into account the analysis of social behavior and preference of mobile users, heterogeneous cache sizes, and the derived system topology, we investigate the maximum capacity of the network infrastructure in terms of offloading network…

Multitask Offloading Strategy Optimization Based on Directed Acyclic Graphs for Edge Computing

Jiawen Chen, Yajun Yang, Chenyang Wang +3 more

Computer Networks and Communications · IEEE Internet of Things Journal · 9 Sep 2021 · cited 134× · DOI ↗ · more like this ·

With the advancement of the user application service demands, the IoT system tends to offload the tasks to the edge server for execution. Most of the current studies on edge computation offloading ignore the dependencies between components of the application. The few pieces of research on edge computing offloading which focus on the topology of application are primarily applied in single-user scenarios. Unlike previous work, our work mainly solves dependent task offloading with edge computing in multiuser scenarios, which is more in line with reality. In this article, the dependent task offloading problem is modeled as a Markov decision process (MDP) first. Then, we propose an actor–critic mechanism with two embedding layers for directed acyclic graphs (DAGs)-based multiple dependent tasks computation offloading, namely, ACED, by jointly considering the topology of the application and…

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen +7 more

eess.AS · August 2023 · cited 129× · arXiv ↗ · more like this ·

Recent advancements in generative speech models based on audio-text prompts have enabled remarkable innovations like high-quality zero-shot text-to-speech. However, existing models still face limitations in handling diverse audio-text speech generation tasks involving transforming input speech and processing audio captured in adverse acoustic conditions. This paper introduces SpeechX, a versatile speech generation model capable of zero-shot TTS and various speech transformation tasks, dealing with both clean and noisy signals. SpeechX combines neural codec language modeling with multi-task learning using task-dependent prompting, enabling unified and extensible modeling and providing a consistent way for leveraging textual input in speech enhancement and transformation tasks. Experimental results show SpeechX's efficacy in various tasks, including zero-shot TTS, noise suppression…

AMES-Cloud: A Framework of Adaptive Mobile Video Streaming and Efficient Social Video Sharing in the Clouds

Xiaofei Wang, Min Chen, Taehyeong Kwon +2 more

Computer Networks and Communications · IEEE Transactions on Multimedia · 11 Jan 2013 · cited 127× · DOI ↗ · more like this ·

While demands on video traffic over mobile networks have been souring, the wireless link capacity cannot keep up with the traffic demand. The gap between the traffic demand and the link capacity, along with time-varying link conditions, results in poor service quality of video streaming over mobile networks such as long buffering time and intermittent disruptions. Leveraging the cloud computing technology, we propose a new mobile video streaming framework, dubbed AMES-Cloud, which has two main parts: adaptive mobile video streaming (AMoV) and efficient social video sharing (ESoV). AMoV and ESoV construct a private agent to provide video streaming services efficiently for each mobile user. For a given user, AMoV lets her private agent adaptively adjust her streaming flow with a scalable video coding technique based on the feedback of link quality. Likewise, ESoV monitors the social…

Collaborative Multi-Tier Caching in Heterogeneous Networks: Modeling, Analysis, and Design

Xiuhua Li, Xiaofei Wang, Keqiu Li +2 more

Computer Networks and Communications · IEEE Transactions on Wireless Communications · 4 Aug 2017 · cited 122× · DOI ↗ · more like this ·

To deal with the explosive growth in multimedia service requests in mobile networks, caching contents at the cells (base stations) is regarded as an effective emerging technique to reduce the duplicated transmissions of content downloads, while heterogeneous networks (HetNets) are regarded as an effective technique to increase the network capacity. Yet, the combination of content caching and HetNets for future networks (i.e., 5G) is still not well explored. In this paper, we propose an efficient collaborative multi-tier caching framework in Het-Nets. In particular, based on patterns of user requests, link capacities, heterogenous cache sizes, and the derived system topology, we focus on exploring the maximum capacity of the network infrastructure so as to offload the network traffic and support users' content requests locally. Due to the NP-hardness of the complex multi-tier caching…

InFEDge: A Blockchain-Based Incentive Mechanism in Hierarchical Federated Learning for End-Edge-Cloud Communications

Xiaofei Wang, Yunfeng Zhao, Chao Qiu +3 more

Artificial Intelligence · IEEE Journal on Selected Areas in Communications · 13 Oct 2022 · cited 120× · DOI ↗ · more like this ·

Advances in communications and networking technologies are driving the computing paradigm toward the end-edge-cloud collaborative architecture to leverage ubiquitous data and resources. Opposite to centralized intelligence, Hierarchical Federated Learning (HFL) relieves overwhelmed communication overhead and enjoys the advantages of high bandwidth as well as abundant computing resources while retaining privacy-preserving benefits of Federated Learning (FL). It is difficult to balance system overhead and model performance in the HFL framework, while it could be solved by introducing an incentive mechanism. Although the incentive mechanism can alleviate the above anxiety by compensating relevant participants, some limitations (multi-dimensional properties, incomplete information and unreliable participants) will significantly degrade the performance and efficiency of the designed…

D2D Big Data: Content Deliveries over Wireless Device-to-Device Sharing in Large Scale Mobile Networks

Xiaofei Wang, Yuhua Zhang, Victor C. M. Leung +2 more

cs.NI · 3 Feb 2018 · cited 116× · arXiv ↗ · more like this ·

Recently the topic of how to effectively offload cellular traffic onto device-to-device (D2D) sharing among users in proximity has been gaining more and more attention of global researchers and engineers. Users utilize wireless short-range D2D communications for sharing contents locally, due to not only the rapid sharing experience and free cost, but also high accuracy on deliveries of interesting and popular contents, as well as strong social impacts among friends. Nevertheless, the existing related studies are mostly confined to small-scale datasets, limited dimensions of user features, or unrealistic assumptions and hypotheses on user behaviors. In this article, driven by emerging Big Data techniques, we propose to design a big data platform, named D2D Big Data, in order to encourage the wireless D2D communications among users effectively, to promote contents for providers…

TOSS: Traffic offloading by social network service-based opportunistic sharing in mobile social networks

Xiaofei Wang, Min Chen, Zhu Han +2 more

Computer Networks and Communications · April 2014 · cited 108× · DOI ↗ · more like this ·

The ever increasing traffic demand becomes a serious concern of mobile network operators. To solve this traffic explosion problem, there have been many efforts to offload the traffic from cellular links to direct communications among users. In this paper, we propose the framework of Traffic Offloading assisted by Social network services (SNS) via opportunistic Sharing in mobile social networks, TOSS, to offload SNS-based cellular traffic by user-to-user sharing. First we select a subset of users who are to receive the same content as initial seeds depending on their content spreading impacts in online SNSs and their mobility patterns in offline mobile social networks (MSNs). Then users share the content via opportunistic local connectivity (e.g., Bluetooth, Wi-Fi Direct, Device-to-device in LTE) with each other. The observation of SNS user activities reveals that individual users have…

Networking Integrated Cloud–Edge–End in IoT: A Blockchain-Assisted Collective <i>Q</i>-Learning Approach

Chao Qiu, Xiaofei Wang, Haipeng Yao +3 more

Computer Networks and Communications · IEEE Internet of Things Journal · 7 Jul 2020 · cited 102× · DOI ↗ · more like this ·

Recently, the term “Internet of Things” (IoT) has elicited escalating attention. The flexibility, agility, and ubiquitous accessibility have encouraged the integration between machine learning (ML) with IoT. However, there are many challenges that present the key inhibitors in moving ML to the public solution, such as centralized training, poor training efficiency, and heavy computing capabilities requirements. Therefore, bringing learning intelligence to edge IoT nodes has been spotlighted for some researches. Meanwhile, how to govern the use of learning results efficiently, reliably, scalably, and safely is hampered by the heterogeneity and nonconfidence among IoT nodes. In this article, we propose a blockchain-based collective Q-learning (CQL) approach to address the above issues, where lightweight IoT nodes are used to train parts of learning layers, then employing blockchain to…

Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers

Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang +4 more

eess.AS · June 2020 · cited 101× · arXiv ↗ · more like this ·

We propose an end-to-end speaker-attributed automatic speech recognition model that unifies speaker counting, speech recognition, and speaker identification on monaural overlapped speech. Our model is built on serialized output training (SOT) with attention-based encoder-decoder, a recently proposed method for recognizing overlapped speech comprising an arbitrary number of speakers. We extend SOT by introducing a speaker inventory as an auxiliary input to produce speaker labels as well as multi-speaker transcriptions. All model parameters are optimized by speaker-attributed maximum mutual information criterion, which represents a joint probability for overlapped speech recognition and speaker identification. Experiments on LibriSpeech corpus show that our proposed method achieves significantly better speaker-attributed word error rate than the baseline that separately performs…

Federated Deep Reinforcement Learning for Recommendation-Enabled Edge Caching in Mobile Edge-Cloud Computing Networks

Chuan Sun, Xiuhua Li, Junhao Wen +3 more

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · 12 Jan 2023 · cited 90× · DOI ↗ · more like this ·

To support rapidly increasing services and applications from users, multi-tier computing is emerged as a promising system-level computing architecture by distributing computing/caching/communication/networking capabilities between cloud servers to users, especially deploying edge servers at network edges (e.g., base stations). However, due to heterogeneous content requests of users and a high-cost hit manner with direct hits, edge caching is still a most serious issue to be addressed. In this paper, we investigate the issue of recommendation-enabled edge caching in mobile two-tier (edge-cloud) computing networks. Particularly, we integrate recommender systems and edge caching to support both direct hits and soft hits and thus improve the resource utilization of edge servers. We model the factors affecting the user quality of experience as a comprehensive system cost and further…

Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT

Shihao Shen, Yiwen Han, Xiaofei Wang +1 more

cs.DC · August 2023 · cited 85× · arXiv ↗ · more like this ·

With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by offloading part of the computational tasks to edge nodes close to the data source. Using this feature, IoT devices can save more resources while still maintaining the quality of service. However, since computation offloading decisions concern joint and complex resource management, we use multiple Deep Reinforcement Learning (DRL) agents deployed on IoT devices to guide their own decisions. Besides, Federated Learning (FL) is utilized to train DRL agents in a distributed fashion, aiming to make the DRL-based decision making practical and further decrease the transmission cost between IoT devices and Edge Nodes. In this article, we first study the problem…

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang +3 more

eess.AS · 18 Oct 2021 · cited 85× · arXiv ↗ · more like this ·

Personalized speech enhancement (PSE) models utilize additional cues, such as speaker embeddings like d-vectors, to remove background noise and interfering speech in real-time and thus improve the speech quality of online video conferencing systems for various acoustic scenarios. In this work, we propose two neural networks for PSE that achieve superior performance to the previously proposed VoiceFilter. In addition, we create test sets that capture a variety of scenarios that users can encounter during video conferencing. Furthermore, we propose a new metric to measure the target speaker over-suppression (TSOS) problem, which was not sufficiently investigated before despite its critical importance in deployment. Besides, we propose multi-task training with a speech recognition back-end. Our results show that the proposed models can yield better speech recognition accuracy, speech…

Improving trial generalizability using observational studies

Dasom Lee, Shu Yang, Lin Dong +3 more

stat.ME · March 2020 · cited 82× · arXiv ↗ · more like this ·

Complementary features of randomized controlled trials (RCTs) and observational studies (OSs) can be used jointly to estimate the average treatment effect of a target population. We propose a calibration weighting estimator that enforces the covariate balance between the RCT and OS, therefore improving the trial-based estimator's generalizability. Exploiting semiparametric efficiency theory, we propose a doubly robust augmented calibration weighting estimator that achieves the efficiency bound derived under the identification assumptions. A nonparametric sieve method is provided as an alternative to the parametric approach, which enables the robust approximation of the nuisance functions and data-adaptive selection of outcome predictors for calibration. We establish asymptotic results and confirm the finite sample performances of the proposed estimators by simulation experiments and an…

Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System

Yiwen Han, Shihao Shen, Xiaofei Wang +2 more

cs.DC · 17 Jan 2021 · cited 80× · arXiv ↗ · more like this ·

Kubernetes (k8s) has the potential to merge the distributed edge and the cloud but lacks a scheduling framework specifically for edge-cloud systems. Besides, the hierarchical distribution of heterogeneous resources and the complex dependencies among requests and resources make the modeling and scheduling of k8s-oriented edge-cloud systems particularly sophisticated. In this paper, we introduce KaiS, a learning-based scheduling framework for such edge-cloud systems to improve the long-term throughput rate of request processing. First, we design a coordinated multi-agent actor-critic algorithm to cater to decentralized request dispatch and dynamic dispatch spaces within the edge cluster. Second, for diverse system scales and structures, we use graph neural networks to embed system state information, and combine the embedding results with multiple policy networks to reduce the…

Federated-Learning-Empowered Collaborative Data Sharing for Vehicular Edge Networks

Xiuhua Li, Luxi Cheng, Chuan Sun +3 more

Artificial Intelligence · IEEE Network · May 2021 · cited 78× · DOI ↗ · more like this ·

The Internet of Vehicles connects all vehicles and shares dynamic vehicular data via wireless communications to effectively control vehicles and improve traffic efficiency. However, due to vehicular movement, vehicular data sharing based on conventional cloud computing can hardly realize real-time and dynamic updates. To address these challenges, artificial intelligence (AI)-empowered mobile/multi-access edge computing (MEC) has been regarded as a promising technique for intelligently supporting various vehicular services and applications in proximity of vehicles. In this article, we investigate the issue of collaborative data sharing in vehicular edge networks (VENs) with the deployment of AI-empowered MEC servers. Furthermore, we present a specific mode for collaborative data sharing. Then we propose a novel collaborative data sharing scheme with deep Q-network and federated learning…