arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Saidutta

24 papers · 2008–2026

2008: 12009: 02010: 02011: 02012: 02013: 02014: 02015: 02016: 02017: 02018: 02019: 32020: 22021: 22022: 22023: 32024: 32025: 42026: 4
2008peak 4 in 20252026

Frequent co-authors

Papers

showing 1–24 of 24 RSS

Joint Source-Channel Coding Over Additive Noise Analog Channels Using Mixture of Variational Autoencoders

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

Artificial Intelligence · IEEE Journal on Selected Areas in Communications · · cited 56× · DOI ↗ · more like this ·

In this paper, we present a learning scheme for Joint Source-Channel Coding (JSCC) over analog independent additive noise channels. We formulate the learning problem by showing that the minimization loss function from rate-distortion theory, is upper bounded by the loss function of the Variational Autoencoder (VAE). We show that when the source dimension is greater than the channel dimension, the encoding of two source samples in the neighborhood of each other need not be near each other. Such discontinuous projection needs to be accounted for by using multiple encoders and selecting an encoder to encode samples on a particular side of the discontinuity. We explore two selection methodologies, one based on an intuitive rule and the other where it is posed as a learning task in a Mixture-of-Experts (MoE) setup. We analyze the gradients of these methods and reason why the latter is better…

Analog Compression and Communication for Federated Learning over Wireless MAC

Afshin Abdi, Yashas Malur Saidutta, Faramarz Fekri

Artificial Intelligence · · cited 22× · DOI ↗ · more like this ·

In this paper, we consider federated learning in wireless edge networks. Transmitting stochastic gradients (SG) or deep model's parameters over a limited-bandwidth wireless channel can incur large training latency and excessive power consumption. Hence, data compressing is often used to reduce the communication overhead. However, efficient communication requires the compression algorithm to satisfy the constraints imposed by the communication medium and take advantage of its characteristics, such as over-the-air computations inherent in wireless multiple-access channels (MAC), unreliable transmission and idle nodes in the edge network, limited transmission power, and preserving the privacy of data. To achieve these goals, we propose a novel framework based on Random Linear Coding (RLC) and develop efficient power management and channel usage techniques to manage the trade-offs between…

PREDICTION OF BOD AND COD OF A REFINERY WASTEWATER USING MULTILAYER ARTIFICIAL NEURAL NETWORKS

Eldon R. Rene, Saidutta

Artificial Intelligence · Journal of Urban and Environmental Engineering · · cited 20× · DOI ↗ · more like this ·

Abstract: In the recent past, artificial neural networks (ANNs) have shown the ability to learn and capture non-linear static or dynamic behaviour among variables based on the given set of data. Since the knowledge of internal procedure is not necessary, the modelling can take place with minimum previous knowledge about the process through proper training of the network. In the present study, 12 ANN based models were proposed to predict the Biochemical Oxygen Demand (BOD5) and Chemical Oxygen Demand (COD) concentrations of wastewater generated from the effluent treatment plant of a petrochemical industry. By employing the standard back error propagation (BEP) algorithm, the network was trained with 103 data points for water quality indices such as Total Suspended Solids (TSS), Total Dissolved Solids (TDS), Phenol concentration, Ammoniacal Nitrogen (AMN), Total Organic Carbon (TOC) and…

Joint Source-Channel Coding for Gaussian Sources over AWGN Channels using Variational Autoencoders

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

Artificial Intelligence · · cited 18× · DOI ↗ · more like this ·

In this paper, we study joint source-channel coding of gaussian sources over multiple AWGN channels where the source dimension is greater than the number of channels. We model our system as a Variational Autoencoder and show that its loss function takes up a form that is an upper bound on the optimization function got from rate-distortion theory. The constructed system employs two encoders that learn to split the source input space into almost half with no constraints. The system is jointly trained in a data-driven manner, end-to-end. We achieve state of the art results for certain configurations, some of which are 0.7dB better than previous works. We also showcase that the trained encoder/decoder is robust, i.e., even if the channel conditions change by +/-5dB, the performance of the system does not vary by more than 0.7dB w.r.t. a system trained at that channel condition. The trained…

VAE for Joint Source-Channel Coding of Distributed Gaussian Sources over AWGN MAC

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

Artificial Intelligence · · cited 14× · DOI ↗ · more like this ·

In this paper, we introduce a framework for Joint Source-Channel Coding of distributed Gaussian sources over a multiple access AWGN channel. Although there are prior works that have studied this, they either strongly rely on intuition to design encoders and decoder or require the knowledge of the complete joint distribution of all the distributed sources. Our system overcomes this. We model our system as a Variational Autoencoder and leverage insight provided by this connection to propose a crucial regularization mechanism for learning. This allows us to beat the state of the art by improving the signal reconstruction quality by almost 1dB for certain configurations. The end-to-end learned system is also found to be robust to channel condition variations of ±5dB and shows a drop in signal reconstruction quality by at most 1dB. Finally, we propose a novel lower bound on the optimal…

Joint Source-Channel Coding of Gaussian sources over AWGN channels via Manifold Variational Autoencoders

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

Artificial Intelligence · · cited 14× · DOI ↗ · more like this ·

In this paper, we give a new scheme for Joint Source-Channel Coding of Gaussian sources over AWGN channels. We present a novel VAE architecture that exploits the manifold nature of joint source-channel coding. Since the projection onto a complex manifold is a highly discontinuous function we split the encoder into two arms and a selector. This design combined with the power of data-driven deep neural networks allows us to efficiently train an encoder-decoder system end-to-end. The scheme achieves state of the art performance for five out of the seven configurations tested upon and match the state of the art for one of the other configurations for almost all channel conditions tested upon. Further, without providing any expert prior on the optimum JSCC encoder, the proposed method learns an encoding function that is similar to the ones proposed and found by the researchers in the past…

M to 1 Joint Source-Channel Coding of Gaussian Sources via Dichotomy of the Input Space Based on Deep Learning

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

Signal Processing · · cited 11× · DOI ↗ · more like this ·

In this paper, we propose a deep neural network framework for Joint Source-Channel Coding of an m dimensional i.i.d. Gaussian source for transmission over a single additive white Gaussian noise channel with no delay. The framework employs two neural encoder-decoder pairs that learn to split the input signal space into two disjoint support sets. The encoder and the decoder are jointly trained to minimize the mean square error subject to a power constraint on the signal transmitted across the channel. The proposed method achieves results as good as the state of the art for m=3,4 and is easily extendable to higher dimensions. The trained model, we discovered, assigns almost equal probability to the disjoint support sets. The results show that the scheme performance is within 1.9dB of the Shannon optimal limit over a wide range of Channel Signal to Noise Ratios (CSNR) from 0dB to 30dB for…

Leveraging Self-Supervised Speech Representations for Domain Adaptation in Speech Enhancement

Ching-Hua Lee, Chouchang Yang, Rakshith Sharma Srinivasa +4 more

Signal Processing · · cited 6× · DOI ↗ · more like this ·

Deep learning based speech enhancement (SE) approaches could suffer from performance degradation due to mismatch between training and testing environments. A realistic situation is that an SE model trained on parallel noisy-clean utterances from one environment, the source domain, may fail to perform adequately in another environment, the target (new) domain of unseen acoustic or noise conditions. Even though we can improve the target domain performance by leveraging paired data in that domain, in reality, noisy data is more straightforward to collect. Therefore, it is worth studying unsupervised domain adaptation techniques for SE that utilize only noisy data from the target domain, together with exploiting the knowledge available from the source domain paired data, for improved SE in the new domain. In this paper, we present a novel adaptation framework for SE by leveraging…

CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Loss

Rakshith Sharma Srinivasa, Jaejin Cho, Chouchang Yang +4 more

cs.LG · · cited 5× · arXiv ↗ · more like this ·

This paper considers contrastive training for cross-modal 0-shot transfer wherein a pre-trained model in one modality is used for representation learning in another domain using pairwise data. The learnt models in the latter domain can then be used for a diverse set of tasks in a zero-shot way, similar to ``Contrastive Language-Image Pre-training (CLIP)'' and ``Locked-image Tuning (LiT)'' that have recently gained considerable attention. Most existing works for cross-modal representation alignment (including CLIP and LiT) use the standard contrastive training objective, which employs sets of positive and negative examples to align similar and repel dissimilar training data samples. However, similarity amongst training examples has a more continuous nature, thus calling for a more `non-binary' treatment. To address this, we propose a novel loss function called Continuously Weighted…

Social event planning using hybrid pairwise Markov random fields

Xiao Li, Yashas Malur Saidutta, Faramarz Fekri

Transportation · International Journal of Intelligent Systems · · cited 3× · DOI ↗ · more like this ·

Event-based social networks (EBSNs) have become increasingly popular, which provide online social event management platforms for event organizers to publish and share social events (e.g., outdoor activities). In EBSNs, a major challenge for a social event organizer is how to plan a social event to attract the maximum number of attendance. To organize an event, three essential elements are required, namely, what (i.e., event content), where (i.e., event location), and when (i.e., event time). In this paper, we focus on the social event planning problem, which selects a location and time to hold a social event for the organizer with the given event content, to maximize the total number of participants. The solution of the social event planning problem could support decision-making for social event organizers. For simplicity, we denote a location and time pair as an item in this paper. To…

Better Exploiting Spatial Separability in Multichannel Speech Enhancement with an Align-and-Filter Network

Ching-Hua Lee, Chouchang Yang, Yashas Malur Saidutta +3 more

Signal Processing · · cited 2× · DOI ↗ · more like this ·

Multichannel speech enhancement (SE) techniques combine multiple microphone signals to extract clean speech from noisy mixtures based on spatial filtering. As the target speech may come from arbitrary, unknown directions, current deep learning-based SE systems could suffer from performance bottleneck in denoising speech within one stage. In contrast, conventional signal processing algorithms often feature a two-stage design, where the first stage focuses on spatially aligning the received signals with respect to the speech source, followed by the second stage to filter out noise. In this paper, we introduce Align-and-Filter network (AFnet) for deep learning-based SE that decouples the primal denoising problem into two sub-problems, which imitates the alignment-followed-by-filtering wisdom from signal processing. The key is to leverage the relative transfer functions (RTFs) that encode…

To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinement

Yashas Malur Saidutta, Rakshith Sharma Srinivasa, Ching-Hua Lee +3 more

eess.SP · · cited 2× · arXiv ↗ · more like this ·

Keyword spotting systems continuously process audio streams to detect keywords. One of the most challenging tasks in designing such systems is to reduce False Alarm (FA) which happens when the system falsely registers a keyword despite the keyword not being uttered. In this paper, we propose a simple yet elegant solution to this problem that follows from the law of total probability. We show that existing deep keyword spotting mechanisms can be improved by Successive Refinement, where the system first classifies whether the input audio is speech or not, followed by whether the input is keyword-like or not, and finally classifies which keyword was uttered. We show across multiple models with size ranging from 13K parameters to 2.41M parameters, the successive refinement technique reduces FA by up to a factor of 8 on in-domain held-out FA data, and up to a factor of 7 on out-of-domain…

A Machine Learning Framework for Privacy-Aware Distributed Functional Compression over AWGN Channels

Yashas Malur Saidutta, Faramarz Fekri, Afshin Abdi

Artificial Intelligence · 2022 IEEE Information Theory Workshop (ITW) · · cited 2× · DOI ↗ · more like this ·

In many diverse fields, distributed IoT devices perform collaborative inference by communicating with an edge router. Often sensory data contains sensitive attributes that should not be revealed to the router. To address this, we develop, to the best of our knowledge, the first privacy-aware machine learning framework for distributed functional compression over AWGN channels. The key feature of our approach to privacy is that we focus only on sensitive attributes of data rather than paying a high cost to protect everything. Employing a mutual information based privacy constraint, we first propose a novel approximate upper bound to protect sensitive attributes in the compressed representations of the sensory data. Next, in conjunction with the upper bound, we propose an adversarial lower bound to enhance the protection further. Thirdly, we propose novel decompositions to these bounds…

A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT

Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

cs.LG · · cited 2× · arXiv ↗ · more like this ·

IoT devices generating enormous data and state-of-the-art machine learning techniques together will revolutionize cyber-physical systems. In many diverse fields, from autonomous driving to augmented reality, distributed IoT devices compute specific target functions without simple forms like obstacle detection, object recognition, etc. Traditional cloud-based methods that focus on transferring data to a central location either for training or inference place enormous strain on network resources. To address this, we develop, to the best of our knowledge, the first machine learning framework for distributed functional compression over both the Gaussian Multiple Access Channel (GMAC) and orthogonal AWGN channels. Due to the Kolmogorov-Arnold representation theorem, our machine learning framework can, by design, compute any arbitrary function for the desired functional compression task in…

RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Prior

Ching-Hua Lee, Chouchang Yang, Jaejin Cho +4 more

eess.IV · · cited 1× · arXiv ↗ · more like this ·

Denoising diffusion probabilistic models (DDPMs) can be utilized to recover a clean signal from its degraded observation(s) by conditioning the model on the degraded signal. The degraded signals are themselves contaminated versions of the clean signals; due to this correlation, they may encompass certain useful information about the target clean data distribution. However, existing adoption of the standard Gaussian as the prior distribution in turn discards such information when shaping the prior, resulting in sub-optimal performance. In this paper, we propose to improve conditional DDPMs for signal restoration by leveraging a more informative prior that is jointly learned with the diffusion model. The proposed framework, called RestoreGrad, seamlessly integrates DDPMs into the variational autoencoder (VAE) framework, taking advantage of the correlation between the degraded and clean…

Distributed Functional Compression for Independent Component Analysis in Wireless Networks

A. Alamoudi, Yashas Malur Saidutta, Faramarz Fekri

Signal Processing · · cited 1× · DOI ↗ · more like this ·

In this paper, we consider distributed Independent Component Analysis (ICA) in wireless networks, where data from several geographically distributed wireless nodes (nodes) must be transmitted to a central server (server) to extract original sources through ICA. However, transmitting the vast amount of data over wireless channels to the server poses significant challenges due to limited bandwidth and privacy concerns. Our research addresses how to encode node data to meet channel rate constraints while providing maximally relevant information for ICA. Particularly, we propose a distributed functional compression framework for learning ICA over orthogonal AWGN channels. The framework leverages the Information Bottleneck (IB) principle to encode and compress the data to meet the channel rate constraint while maximally preserving the functionally relevant information for ICA. We train both…

Zero-Shot Intent Classification Using a Semantic Similarity Aware Contrastive Loss and Large Language Model

Jaejin Cho, Rakshith Sharma Srinivasa, Ching-Hua Lee +4 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Zero-shot systems can reduce the cost of collecting data and training in a new domain since they can work directly with the test data without further training. In this paper, we build zero-shot systems for intent classification, based on Semantic Similarity-aware Contrastive Loss (SSCL) that addresses an issue in the original CL which treats non-corresponding pairs indiscriminately. We confirm that SSCL outperforms CL through experiments. Then, we explore how including text or speech in-domain data during the SSCL training affects the out-of-domain intent classification.During the zero-shot classification, embeddings for a set of classes in the new domain are generated to calculate the similarities between each class embedding and an input utterance embedding, after which the most similar class is predicted for the utterance’s intent. Although manually-collected text sentences per class…

Not All Ranks Are Equal: Budget-Aware LoRA Merging Across Tasks

Avinash Amballa, Yashas Malur Saidutta, Wenbo Li +2 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Merging low-rank adapters (LoRAs) promises to eliminate the overhead of swapping task-specific weights at inference time. However, existing merging methods assume every layer needs the same rank budget. Further, some methods assume that rank budget needs to be split equally among the tasks too. We show this uniform-budget assumption is a major source of the performance gap between merged and per-task LoRAs. However, rank selection is an NP hard problem. To this end, we introduce Net Utility, a data free metric that first decomposes every task LoRA by its Singular Value Decomposition (SVD) and scores each of those singular directions by its task utility and its interference with other tasks directions. Next, we globally pool these scores to select singular directions with the highest values with a constraint on the total number of directions selected. The proposed Net Utility metric is…

MIB: Mixed Information Bottleneck for Out-of-Distribution Keyword Spotting

Yashas Malur Saidutta, Rakshith Sharma Srinivasa, Jaejin Cho +4 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Deep Keyword Spotting (KWS) systems continuously process audio streams to detect keywords. However, performance of deep neural networks degrade when the input data diverges from the training data; referred to as Out-of-Distribution (OOD) data problem. In this paper, we show performance degradation of existing State-of-the-Art (SOTA) keyword spotting models on OOD data w.r.t. in-domain testing data, and propose a training mechanism to improve performance on OOD data. Specifically, we propose a novel combination of Mixup and Information Bottleneck, called MIB, to achieve SOTA performance on OOD data. Considering on-device applications, we show across multiple models ranging from sizes of 12.5K parameters to 350K parameters, that MIB achieves as much as 2.5% (absolute) improvement in performance over OOD data. Further, in the more realistic case where OOD keywords are uttered in the…

Attri-Fed: A GIB Framework for Attribute-Based Privacy and Communication-Efficient Federated Learning

Ahmet Faruk Saz, Yashas Malur Saidutta, Faramarz Fekri +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

We present an attribute-based privacy framework for Federated Learning. Our framework utilizes the Generalized Information Bottleneck (GIB) principle to create functionally compressed representations that obscure designated sensitive attributes from potential inferential adversaries at the server. These functional representations are generated following a minimax adversarial optimization of the privacy and utility bounds on the optimization function. We show that our proposed framework inherently provides attribute-based differential privacy (DP) guarantees, reduces communication overhead and improves utility (e.g., image classification performance). We presented both theoretical and experimental comparisons of our less restrictive attribute-based DP approach with conventional DP.

PROGRESS: Coverage-guided RL to Train Search-augmented LLM Agent

Sudipta Paul, Vijay Srinivasan, Vivek Kulkarni +4 more

cs.AI · · arXiv ↗ · more like this ·

Existing search-augmented LLM agents are trained using Reinforcement Learning to boost its reasoning capabilities. However, these approaches primarily rely on outcome-level rewards, which provide little supervision over search behavior and overlook agent's ability to decompose complex queries properly. To mitigate this issue, we propose PROGRESS which utilizes teacher-guided coverage reward to explicitly shape decomposed query generation of the policy model. During training, frozen teacher models are used to decompose complex queries into essential search queries. These essential search queries are utilized to guide the search behavior of the policy model. Integrated into an R1-style training framework, our approach provides lightweight guidance over query decomposition decisions without dense process-level supervision. Experiments show that coverage-guided RL improves overall task…

Latent Personal Memory: Represent personal memory as dynamic soft prompts

Debrup Das, Avinash Amballa, Yashas Malur Saidutta +3 more

cs.CL · · arXiv ↗ · more like this ·

Personalizing large language models (LLMs) requires encoding long-term, user-specific behavioral patterns in a way that is computationally efficient, scalable, and compatible with a frozen base model. We present Latent Personal Memory (LPM), a scalable framework that represents user-specific history as a compact, persistent matrix of N latent slots, that are interpretable. A shared cross-attention projection network maps these slots into dynamic, input-conditioned soft prompts that are prepended to the input of a frozen LLM. We evaluate LPM on PersonaMem v1 and LoCOMO benchmarks across Qwen3-1.7B, 4B, and 8B backbones. Results demonstrate that LPM outperforms LoRA and Prompt Tuning by up to 8.8% and 54.4% in overall accuracy respectively on PersonaMem v1, while reducing KV-cache usage by over 64x. On LoCoMo, LPM matches LoRA accuracy with 120x fewer trainable parameters. We also show…

Doc-to-Atom: Learning to Compile and Compose Memory Atoms

Xingjian Diao, Wenbo Li, Yashas Malur Saidutta +3 more

cs.CL · · arXiv ↗ · more like this ·

Long input sequences are central to document understanding and multi-step reasoning in Large Language Models, yet the quadratic cost of attention makes inference both memory-intensive and slow. Context distillation mitigates this by compressing contextual information into model parameters, and recent work such as Doc-to-LoRA amortizes context distillation into a single forward pass that generates one LoRA adapter per document. However, producing a single monolithic adapter for all queries leads to irrelevant-query interference, limited compositional recall, and poor scalability to long-document reasoning. To address these challenges, we propose Doc-to-Atom (Doc2Atom), a compositional parametric memory framework that decomposes each document into semantically typed knowledge atoms. Each atom is compiled into an independent micro-LoRA adapter and a provenance retrieval key. At inference…

VOYAGER: A Training Free Approach for Generating Diverse Datasets using LLMs

Avinash Amballa, Yashas Malur Saidutta, Chi-Heng Lin +2 more

cs.CL · · arXiv ↗ · more like this ·

Large language models (LLMs) are increasingly being used to generate synthetic datasets for the evaluation and training of downstream models. However, prior work has noted that such generated data lacks diversity. In this paper, we propose Voyager, a novel principled approach to generate diverse datasets. Our approach is iterative and directly optimizes a mathematical quantity that optimizes the diversity of the dataset using the machinery of determinantal point processes. Furthermore, our approach is training-free, applicable to closed-source models, and scalable. In addition to providing theoretical justification for the working of our method, we also demonstrate through comprehensive experiments that Voyager significantly outperforms popular baseline approaches by providing a 1.5-3 times improvement in diversity.