Author

Tianshi Wang

77 papers · 2002–2026

2002peak 10 in 20252026

Frequent co-authors

Papers

showing 1–25 of 77 RSS

Deep compressive offloading

Shuochao Yao, Jinyang Li, Dongxin Liu +4 more

Artificial Intelligence · 16 Nov 2020 · cited 136× · DOI ↗ · more like this ·

With recent advances, neural networks have become a crucial building block in intelligent IoT systems and sensing applications. However, the excessive computational demand remains a serious impediment to their deployments on low-end IoT devices. With the emergence of edge computing, offloading grows into a promising technique to circumvent end-device limitations. However, transferring data between local and edge devices takes up a large proportion of time in existing offloading frameworks, creating a bottleneck for low-latency intelligent services. In this work, we propose a general framework, called deep compressive offloading. By integrating compressive sensing theory and deep learning, our framework can encode data for offloading into tiny sizes with negligible overhead on local devices and decode the data on the edge server, while offering theoretical guarantees on perfect…

Oscillator-based Ising Machine

Tianshi Wang, Jaijeet Roychowdhury

cs.ET · September 2017 · cited 89× · arXiv ↗ · more like this ·

Many combinatorial optimization problems can be mapped to finding the ground states of the corresponding Ising Hamiltonians. The physical systems that can solve optimization problems in this way, namely Ising machines, have been attracting more and more attention recently. Our work shows that Ising machines can be realized using almost any nonlinear self-sustaining oscillators with logic values encoded in their phases. Many types of such oscillators are readily available for large-scale integration, with potentials in high-speed and low-power operation. In this paper, we describe the operation and mechanism of oscillator-based Ising machines. The feasibility of our scheme is demonstrated through several examples in simulation and hardware, among which a simulation study reports average solutions exceeding those from state-of-art Ising machines on a benchmark combinatorial optimization…

Self-Contrastive Learning based Semi-Supervised Radio Modulation Classification

Dongxin Liu, Peng Wang, Tianshi Wang +1 more

cs.LG · 29 Mar 2022 · cited 79× · arXiv ↗ · more like this ·

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training step, our framework achieves higher performance given smaller amounts of labeled data, thereby largely reducing the labeling burden of deep learning. We evaluate the performance of our semi-supervised framework on a public dataset. The evaluation results demonstrate that our semi-supervised approach significantly outperforms supervised frameworks thereby substantially enhancing our ability to train deep neural networks for automatic modulation classification in a manner that leverages unlabeled data.

Targeted Adversarial Attack Against Deep Cross-Modal Hashing Retrieval

Tianshi Wang, Lei Zhu, Zheng Zhang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · 31 Mar 2023 · cited 46× · DOI ↗ · more like this ·

Deep cross-modal hashing has achieved excellent retrieval performance with the powerful representation capability of deep neural networks. Regrettably, current methods are inevitably vulnerable to adversarial attacks, especially well-designed subtle perturbations that can easily fool deep cross-modal hashing models into returning irrelevant or the attacker’s specified results. Although adversarial attacks have attracted increasing attention, there are few studies on specialized attacks against deep cross-modal hashing. To solve these issues, we propose a targeted adversarial attack method against deep cross-modal hashing retrieval in this paper. To the best of our knowledge, this is the first work in this research field. Concretely, we first build a progressive fusion module to extract fine-grained target semantics through a progressive attention mechanism. Meanwhile, we design a…

New Computational Results and Hardware Prototypes for Oscillator-based Ising Machines

Tianshi Wang, Leon Wu, Jaijeet Roychowdhury

Artificial Intelligence · 23 May 2019 · cited 46× · DOI ↗ · more like this ·

In this paper, we report new results on a novel Ising machine technology for solving combinatorial optimization problems using networks of coupled self-sustaining oscillators. Specifically, we present several working hardware prototypes using CMOS electronic oscillators, built on bread-boards/perfboards and PCBs, implementing Ising machines consisting of up to 240 spins with programmable couplings. We also report that, just by simulating the differential equations of such Ising machines of larger sizes, good solutions can be achieved easily on benchmark optimization problems, demonstrating the effectiveness of oscillator-based Ising machines.

Contrastive Self-Supervised Representation Learning for Sensing Signals from the Time-Frequency Perspective

Dongxin Liu, Tianshi Wang, Shengzhong Liu +3 more

Signal Processing · July 2021 · cited 44× · DOI ↗ · more like this ·

This paper presents a contrastive self-supervised representation learning framework that is new in being designed specifically for deep learning from frequency domain data. Contrastive self-supervised representation learning trains neural networks using mostly unlabeled data. It is motivated by the need to reduce the labeling burden of deep learning. In this paper, we are specifically interested in applying this approach to physical sensing scenarios, such as those arising in Internet-of-Things (IoT) applications. Deep neural networks have been widely utilized in IoT applications, but the performance of such models largely depends on the availability of large labeled datasets, which in turn entails significant training costs. Motivated by the success of contrastive self-supervised representation learning at substantially reducing the need for labeled data (mostly in areas of computer…

Scheduling Real-time Deep Learning Services as Imprecise Computations

Shuochao Yao, Yifan Hao, Yiran Zhao +6 more

cs.LG · 2 Nov 2020 · cited 43× · arXiv ↗ · more like this ·

The paper presents an efficient real-time scheduling algorithm for intelligent real-time edge services, defined as those that perform machine intelligence tasks, such as voice recognition, LIDAR processing, or machine vision, on behalf of local embedded devices that are themselves unable to support extensive computations. The work contributes to a recent direction in real-time computing that develops scheduling algorithms for machine intelligence tasks with anytime prediction. We show that deep neural network workflows can be cast as imprecise computations, each with a mandatory part and (several) optional parts whose execution utility depends on input data. The goal of the real-time scheduler is to maximize the average accuracy of deep neural network outputs while meeting task deadlines, thanks to opportunistic shedding of the least necessary optional parts. The work is motivated by…

AdaMask: Enabling Machine-Centric Video Streaming with Adaptive Frame Masking for DNN Inference Offloading

Shengzhong Liu, Tianshi Wang, Jinyang Li +3 more

Computer Vision and Pattern Recognition · Proceedings of the 30th ACM International Conference on Multimedia · 10 Oct 2022 · cited 39× · DOI ↗ · more like this ·

This paper presents AdaMask, a machine-centric video streaming framework for remote deep neural network (DNN) inference. The objective is to optimize the accuracy of downstream DNNs, offloaded to a remote machine, by adaptively changing video compression control knobs at runtime. Our main contributions are twofold. First, we propose frame masking as an effective mechanism to reduce the bandwidth consumption of video stream, which only preserves regions that potentially contain objects of interest. Second, we design a new adaptation algorithm that achieves the Pareto-optimal tradeoff between accuracy and bandwidth by controlling the masked portions of frames together with conventional H.264 control knobs (eg. resolution). Through extensive evaluations on three sensing scenarios (dash camera, traffic surveillance, and drone), frame masking saves the bandwidth by up to 65% with < 1%…

Efficient Query-based Black-box Attack against Cross-modal Hashing Retrieval

Lei Zhu, Tianshi Wang, Jingjing Li +3 more

Computer Vision and Pattern Recognition · ACM Transactions on Information Systems · 3 Sep 2022 · cited 39× · DOI ↗ · more like this ·

Deep cross-modal hashing retrieval models inherit the vulnerability of deep neural networks. They are vulnerable to adversarial attacks, especially for the form of subtle perturbations to the inputs. Although many adversarial attack methods have been proposed to handle the robustness of hashing retrieval models, they still suffer from two problems: (1) Most of them are based on the white-box settings, which is usually unrealistic in practical application. (2) Iterative optimization for the generation of adversarial examples in them results in heavy computation. To address these problems, we propose an Efficient Query-based Black-Box Attack (EQB 2 A) against deep cross-modal hashing retrieval, which can efficiently generate adversarial examples for the black-box attack. Specifically, by sending a few query requests to the attacked retrieval system, the cross-modal retrieval model…

paper2repo: GitHub Repository Recommendation for Academic Papers

Huajie Shao, Dachun Sun, Jiahao Wu +7 more

cs.SI · 13 Apr 2020 · cited 37× · arXiv ↗ · more like this ·

GitHub has become a popular social application platform, where a large number of users post their open source projects. In particular, an increasing number of researchers release repositories of source code related to their research papers in order to attract more people to follow their work. Motivated by this trend, we describe a novel item-item cross-platform recommender system, $\textit{paper2repo}$, that recommends relevant repositories on GitHub that match a given paper in an academic search system such as Microsoft Academic. The key challenge is to identify the similarity between an input paper and its related repositories across the two platforms, $\textit{without the benefit of human labeling}$. Towards that end, paper2repo integrates text encoding and constrained graph convolutional networks (GCN) to automatically learn and map the embeddings of papers and repositories into the…

Multi-View Scheduling of Onboard Live Video Analytics to Minimize Frame Processing Latency

Shengzhong Liu, Tianshi Wang, Hongpeng Guo +5 more

Computer Vision and Pattern Recognition · 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS) · July 2022 · cited 17× · DOI ↗ · more like this ·

This paper presents a real-time multi-view scheduling framework for DNN-based live video analytics at the edge to minimize frame processing latency. The work is motivated by applications where a higher frame rate is important, not to miss actions of interest. Examples include defense, border security, and intruder detection applications where sensors (in this paper, cameras) are deployed to monitor key roads, chokepoints, or passageways to identify events of interest (and intervene in real-time). Supporting a higher frame rate entails lowering frame processing latency. We assume that multiple cameras are deployed with partially overlapping views. Each camera has access to limited onboard computing capacity. Many targets cross the field of view of these cameras (but the great majority do not require action). We take advantage of the spatial-temporal correlations among multi-camera video…

Robust multiobjective and multidisciplinary design optimization of electrical drive systems

Gang Lei, Tianshi Wang, Jianguo Zhu +1 more

Computational Theory and Mathematics · CES Transactions on Electrical Machines and Systems · December 2018 · cited 16× · DOI ↗ · more like this ·

Design and optimization of electrical drive systems often involve simultaneous consideration of multiple objectives that usually contradict to each other and multiple disciplines that normally coupled to each other. This paper aims to present efficient system-level multiobjective optimization methods for the multidisciplinary design optimization of electrical drive systems. From the perspective of quality control, deterministic and robust approaches will be investigated for the development of the optimization models for the proposed methods. Meanwhile, two approximation methods, Kriging model and Taylor expansion are employed to decrease the computation/simulation cost. To illustrate the advantages of the proposed methods, a drive system with a permanent magnet synchronous motor driven by a field oriented control system is investigated. Deterministic and robust Pareto optimal solutions…

Hierarchical Overlapping Belief Estimation by Structured Matrix Factorization

Chaoqi Yang, Jinyang Li, Ruijie Wang +6 more

cs.SI · February 2020 · cited 15× · arXiv ↗ · more like this ·

Much work on social media opinion polarization focuses on a flat categorization of stances (or orthogonal beliefs) of different communities from media traces. We extend in this work in two important respects. First, we detect not only points of disagreement between communities, but also points of agreement. In other words, we estimate community beliefs in the presence of overlap. Second, in lieu of flat categorization, we consider hierarchical belief estimation, where communities might be hierarchically divided. For example, two opposing parties might disagree on core issues, but within a party, despite agreement on fundamentals, disagreement might occur on further details. We call the resulting combined problem a hierarchical overlapping belief estimation problem. To solve it, this paper develops a new class of unsupervised Non-negative Matrix Factorization (NMF) algorithms, we call…

Invisible Black-Box Backdoor Attack against Deep Cross-Modal Hashing Retrieval

Tianshi Wang, Fengling Li, Lei Zhu +3 more

Computer Vision and Pattern Recognition · ACM Transactions on Information Systems · 2 Mar 2024 · cited 14× · DOI ↗ · more like this ·

Deep cross-modal hashing has promoted the field of multi-modal retrieval due to its excellent efficiency and storage, but its vulnerability to backdoor attacks is rarely studied. Notably, current deep cross-modal hashing methods inevitably require large-scale training data, resulting in poisoned samples with imperceptible triggers that can easily be camouflaged into the training data to bury backdoors in the victim model. Nevertheless, existing backdoor attacks focus on the uni-modal vision domain, while the multi-modal gap and hash quantization weaken their attack performance. In addressing the aforementioned challenges, we undertake an invisible black-box backdoor attack against deep cross-modal hashing retrieval in this article. To the best of our knowledge, this is the first attempt in this research field. Specifically, we develop a flexible trigger generator to generate the…

H-Scheduler: Storage-Aware Task Scheduling for Heterogeneous-Storage Spark Clusters

Fengfeng Pan, Jin Xiong, Yijie Shen +2 more

Information Systems · December 2018 · cited 12× · DOI ↗ · more like this ·

A trend in nowadays data centers is that heterogeneous storage devices are deployed to meet different storage demands of various big data workloads. For example, many nodes are equipped with both SSDs and HDDs. And HDFS has introduced the heterogeneous-storage-aware feature to adapt to such hybrid storage clusters. However, current task scheduler on big data processing platforms (such as Hadoop and Spark) only considers the overhead of network data transmission by exploiting the data locality principle. On heterogeneous storage clusters, task completion time is also affected by the speed of storage devices (SSDs and HDDs) where the data are stored. Ignoring the different speed of storage devices results in poor utilization of high speed devices such as SSD. In this paper, we propose a task scheduling strategy for heterogeneous storage clusters called H-Scheduler. The key idea of…

Misinformation Detection and Adversarial Attack Cost Analysis in Directional Social Networks

Huajie Shao, Shuochao Yao, Andong Jing +7 more

Information Systems · August 2020 · cited 11× · DOI ↗ · more like this ·

This paper develops a novel detection system of possibly fake accounts on public social media, called FADE, that uses features based on group behaviors to identify suspicious groups. The work is motivated by the prospect of mitigating misinformation campaigns on social media, where malicious entities on directional social networks pose as credible sources and coordinate the spreading of highly corroborated false information. Instead of account-level detection, this paper aims to detect the very group activity that underlies misinformation campaigns; namely, the coordinated spreading of messages to boost (misinformation) visibility. The existing group detection methods group users into two clusters (fake or not) and directly produce clusters of fake accounts. Conversely, we group users into many clusters based on information propagation patterns and user features and then classify them.…

MAPP: The Berkeley Model and Algorithm Prototyping Platform

Tianshi Wang, Aadithya V. Karthik, Bichen Wu +2 more

Hardware and Architecture · September 2015 · cited 11× · DOI ↗ · more like this ·

We present the Berkeley Model and Algorithm Prototyping Platform (MAPP), a MATLAB <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">®</sup> -based framework for conveniently and quickly prototyping device compact models and simulation algorithms. MAPP's internal code structuring, which differs markedly from that of Berkeley SPICE and related simulators, allows users to add new devices with only minimal knowledge of simulation algorithms, and vice-versa. We describe MAPP's structuring and provide an overview of its capabilities. MAPP is available as open source under the GNU Public License.

The bottlenecks of AI: challenges for embedded and real-time research in a data-centric age

Tarek Abdelzaher, Y. Charlie Hu, Denizhan Kara +7 more

Artificial Intelligence · Real-Time Systems · June 2025 · cited 9× · DOI ↗ · more like this ·

Abstract Recent advances in AI culminate a shift in science and engineering away from strong reliance on algorithmic and symbolic knowledge towards new data-driven approaches. How does the emerging intelligent data-centric world impact research on real-time and embedded computing? We argue for two effects: (1) new challenges in embedded system contexts, and (2) new opportunities for community expansion beyond the embedded domain. First, on the embedded system side , the shifting nature of computing towards data-centricity affects the types of bottlenecks that arise. At training time, the bottlenecks are generally data-related . Embedded computing relies on scarce sensor data modalities, unlike those commonly addressed in mainstream AI, necessitating solutions for efficient learning from scarce sensor data. At inference time, the bottlenecks are resource-related , calling for improved…

PhyMask: An Adaptive Masking Paradigm for Efficient Self-Supervised Learning in IoT

Denizhan Kara, Tomoyoshi Kimura, Yatong Chen +6 more

Artificial Intelligence · 4 Nov 2024 · cited 9× · DOI ↗ · more like this ·

This paper introduces PhyMask, an adaptive masking paradigm designed to enhance the efficiency and interpretability of Masked Autoencoders (MAEs) in analyzing IoT sensing signals. Different from all mainstream MAEs, which rely on random masking techniques, PhyMask employs an adaptive masking strategy that aligns with critical signal information. Its main contributions are threefold. First, PhyMask leverages the energy significance of frequency components to prioritize information-rich time-frequency regions, improving the reconstruction of original signals. Second, it includes a coherence-based masking component to identify and preserve essential temporal dynamics within the data. Finally, PhyMask integrates these components into an adaptive masking paradigm tailored to optimize the sensing context awareness within the masking configuration, focusing on the most informative parts of the…

VibroFM: Towards Micro Foundation Models for Robust Multimodal IoT Sensing

Tomoyoshi Kimura, Jinyang Li, Tianshi Wang +9 more

Computer Networks and Communications · 23 Sep 2024 · cited 9× · DOI ↗ · more like this ·

The paper argues for the feasibility and utility of micro foundation models (µFMs), a key direction for future smart IoT/CPS systems that exploits advances in self-supervised pretraining to support multiple downstream tasks. We demonstrate key beneficial properties such as latent representation independence from the downstream task, robustness to domain shifts, and ability to learn from unlabeled data. Importantly, we demonstrate the emergence of these properties after pretraining with only moderate amounts of unlabeled data, earning the name µFMs. To make the argument, evaluate model efficacy, and surface some of the underlying challenges, this paper describes a vibration-based µFM, called VibroFM, pretrained with moderate amounts of unlabeled acoustic and seismic sensing data, to support target classification and tracking applications. VibroFM is pretrained in an environment-agnostic…

Joint Character-Level Convolutional and Generative Adversarial Networks for Text Classification

Tianshi Wang, Li Liu, Huaxiang Zhang +2 more

Artificial Intelligence · Complexity · 30 Apr 2020 · cited 9× · DOI ↗ · more like this ·

With the continuous renewal of text classification rules, text classifiers need more powerful generalization ability to process the datasets with new text categories or small training samples. In this paper, we propose a text classification framework under insufficient training sample conditions. In the framework, we first quantify the texts by a character-level convolutional neural network and input the textual features into an adversarial network and a classifier, respectively. Then, we use the real textual features to train a generator and a discriminator so as to make the distribution of generated data consistent with that of real data. Finally, the classifier is cooperatively trained by real data and generated data. Extensive experimental validation on four public datasets demonstrates that our method significantly performs better than the comparative methods.

The Methodological Pitfall of Dataset-Driven Research on Deep Learning: An IoT Example

Tianshi Wang, Denizhan Kara, Jinyang Li +3 more

Artificial Intelligence · MILCOM 2022 - 2022 IEEE Military Communications Conference (MILCOM) · 28 Nov 2022 · cited 8× · DOI ↗ · more like this ·

In this paper, we highlight a dangerous pitfall in the state-of-the-art evaluation methodology of deep learning algorithms. It results in deceptively good evaluation outcomes on test datasets, whereas the underlying algorithms remain prone to catastrophic failure in practice. We illustrate the pitfall in the context of an Internet-of-Things (IoT) application example and show that it occurs despite the use of cross-validation that breaks down the data into separate training, validation, and testing sets. The pitfall is illustrated by designing two target detection and classification algorithms. One is based on a recently proposed neural network architecture for embedded AI, and the other is based on a traditional machine learning approach with domain-inspired feature engineering. The neural network approach outperforms the traditional one on test data. Yet, it fails in deployment. The…

OIM: Oscillator-based Ising Machines for Solving Combinatorial Optimisation Problems

Tianshi Wang, Jaijeet Roychowdhury

cs.ET · 17 Mar 2019 · cited 8× · arXiv ↗ · more like this ·

We present a new way to make Ising machines, i.e., using networks of coupled self-sustaining nonlinear oscillators. Our scheme is theoretically rooted in a novel result that establishes that the phase dynamics of coupled oscillator systems, under the influence of sub-harmonic injection locking, are governed by a Lyapunov function that is closely related to the Ising Hamiltonian of the coupling graph. As a result, the dynamics of such oscillator networks evolve naturally to local minima of the Lyapunov function. Two simple additional steps (i.e., adding noise, and turning sub-harmonic locking on and off smoothly) enable the network to find excellent solutions of Ising problems. We demonstrate our method on Ising versions of the MAX-CUT and graph colouring problems, showing that it improves on previously published results on several problems in the G benchmark set. Our scheme, which is…

Late Breaking Results: New Computational Results and Hardware Prototypes for Oscillator-based Ising Machines

Tianshi Wang, Leon Wu, Jaijeet Roychowdhury

cs.ET · 23 Apr 2019 · cited 7× · arXiv ↗ · more like this ·

In this paper, we report new results on a novel Ising machine technology for solving combinatorial optimization problems using networks of coupled self-sustaining oscillators. Specifically, we present several working hardware prototypes using CMOS electronic oscillators, built on breadboards/perfboards and PCBs, implementing Ising machines consisting of up to 240 spins with programmable couplings. We also report that, just by simulating the differential equations of such Ising machines of larger sizes, good solutions can be achieved easily on benchmark optimization problems, demonstrating the effectiveness of oscillator-based Ising machines.

Audio Keyword Reconstruction from On-Device Motion Sensor Signals via Neural Frequency Unfolding

Tianshi Wang, Shuochao Yao, Shengzhong Liu +5 more

Signal Processing · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 9 Sep 2021 · cited 6× · DOI ↗ · more like this ·

In this paper, we present a novel deep neural network architecture that reconstructs the high-frequency audio of selected spoken human words from low-sampling-rate signals of (ego-)motion sensors, such as accelerometer and gyroscope data, recorded on everyday mobile devices. As the sampling rate of such motion sensors is much lower than the Nyquist rate of ordinary human voice (around 6kHz+), these motion sensor recordings suffer from a significant frequency aliasing effect. In order to recover the original high-frequency audio signal, our neural network introduces a novel layer, called the alias unfolding layer, specialized in expanding the bandwidth of an aliased signal by reversing the frequency folding process in the time-frequency domain. While perfect unfolding is known to be unrealizable, we leverage the sparsity of the original signal to arrive at a sufficiently accurate…