Author

Ashutosh Pandey

125 papers · 1991–2026

1991peak 25 in 20252026

Frequent co-authors

Papers

showing 1–25 of 125 RSS

TCNN: Temporal Convolutional Neural Network for Real-time Speech Enhancement in the Time Domain

Ashutosh Pandey, DeLiang Wang

Signal Processing · 16 Apr 2019 · cited 388× · DOI ↗ · more like this ·

This work proposes a fully convolutional neural network (CNN) for real-time speech enhancement in the time domain. The proposed CNN is an encoder-decoder based architecture with an additional temporal convolutional module (TCM) inserted between the encoder and the decoder. We call this architecture a Temporal Convolutional Neural Network (TCNN). The encoder in the TCNN creates a low dimensional representation of a noisy input frame. The TCM uses causal and dilated convolutional layers to utilize the encoder output of the current and previous frames. The decoder uses the TCM output to reconstruct the enhanced frame. The proposed model is trained in a speaker- and noise-independent way. Experimental results demonstrate that the proposed model gives consistently better enhancement results than a state-of-the-art real-time convolutional recurrent model. Moreover, since the model is fully…

A New Framework for CNN-Based Speech Enhancement in the Time Domain

Ashutosh Pandey, DeLiang Wang

Signal Processing · IEEE/ACM Transactions on Audio Speech and Language Processing · 29 Apr 2019 · cited 300× · DOI ↗ · more like this ·

This paper proposes a new learning mechanism for a fully convolutional neural network (CNN) to address speech enhancement in the time domain. The CNN takes as input the time frames of noisy utterance and outputs the time frames of the enhanced utterance. At the training time, we add an extra operation that converts the time domain to the frequency domain. This conversion corresponds to simple matrix multiplication, and is hence differentiable implying that a frequency domain loss can be used for training in the time domain. We use mean absolute error loss between the enhanced short-time Fourier transform (STFT) magnitude and the clean STFT magnitude to train the CNN. This way, the model can exploit the domain knowledge of converting a signal to the frequency domain for analysis. Moreover, this approach avoids the well-known invalid STFT problem since the proposed CNN operates in the…

Dense CNN with Self-Attention for Time-Domain Speech Enhancement

Ashutosh Pandey, DeLiang Wang

eess.AS · September 2020 · cited 171× · arXiv ↗ · more like this ·

Speech enhancement in the time domain is becoming increasingly popular in recent years, due to its capability to jointly enhance both the magnitude and the phase of speech. In this work, we propose a dense convolutional network (DCN) with self-attention for speech enhancement in the time domain. DCN is an encoder and decoder based architecture with skip connections. Each layer in the encoder and the decoder comprises a dense block and an attention module. Dense blocks and attention modules help in feature extraction using a combination of feature reuse, increased network depth, and maximum context aggregation. Furthermore, we reveal previously unknown problems with a loss based on the spectral magnitude of enhanced speech. To alleviate these problems, we propose a novel loss based on magnitudes of enhanced speech and a predicted noise. Even though the proposed loss is based on…

Densely Connected Neural Network with Dilated Convolutions for Real-Time Speech Enhancement in The Time Domain

Ashutosh Pandey, DeLiang Wang

Signal Processing · 9 Apr 2020 · cited 144× · DOI ↗ · more like this ·

In this work, we propose a fully convolutional neural network for real-time speech enhancement in the time domain. The proposed network is an encoder-decoder based architecture with skip connections. The layers in the encoder and the decoder are followed by densely connected blocks comprising of dilated and causal convolutions. The dilated convolutions help in context aggregation at different resolutions. The causal convolutions are used to avoid information flow from future frames, hence making the network suitable for real-time applications. We also propose to use sub-pixel convolutional layers in the decoder for upsampling. Further, the model is trained using a loss function with two components; a time-domain loss and a frequency-domain loss. The proposed loss function outperforms the time-domain loss. Experimental results show that the proposed model significantly outperforms other…

On Adversarial Training and Loss Functions for Speech Enhancement

Ashutosh Pandey, DeLiang Wang

Signal Processing · April 2018 · cited 89× · DOI ↗ · more like this ·

Generative adversarial networks (GANs) are becoming increasingly popular for image processing tasks. Researchers have started using GAN s for speech enhancement, but the advantage of using the GAN framework has not been established for speech enhancement. For example, a recent study reports encouraging enhancement results, but we find that the architecture of the generator used in the GAN gives better performance when it is trained alone using the L <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> loss. This work presents a new GAN for speech enhancement, and obtains performance improvement with the help of adversarial training. A deep neural network (DNN) is used for time-frequency mask estimation, and it is trained in two ways: regular training with the L <sub xmlns:mml="http://www.w3.org/1998/Math/MathML"…

On Cross-Corpus Generalization of Deep Learning Based Speech Enhancement

Ashutosh Pandey, DeLiang Wang

cs.SD · February 2020 · cited 66× · arXiv ↗ · more like this ·

In recent years, supervised approaches using deep neural networks (DNNs) have become the mainstream for speech enhancement. It has been established that DNNs generalize well to untrained noises and speakers if trained using a large number of noises and speakers. However, we find that DNNs fail to generalize to new speech corpora in low signal-to-noise ratio (SNR) conditions. In this work, we establish that the lack of generalization is mainly due to the channel mismatch, i.e. different recording conditions between the trained and untrained corpus. Additionally, we observe that traditional channel normalization techniques are not effective in improving cross-corpus generalization. Further, we evaluate publicly available datasets that are promising for generalization. We find one particular corpus to be significantly better than others. Finally, we find that using a smaller frame shift in…

TPARN: Triple-path Attentive Recurrent Network for Time-domain Multichannel Speech Enhancement

Ashutosh Pandey, Buye Xu, Anurag Kumar +3 more

cs.SD · October 2021 · cited 58× · arXiv ↗ · more like this ·

In this work, we propose a new model called triple-path attentive recurrent network (TPARN) for multichannel speech enhancement in the time domain. TPARN extends a single-channel dual-path network to a multichannel network by adding a third path along the spatial dimension. First, TPARN processes speech signals from all channels independently using a dual-path attentive recurrent network (ARN), which is a recurrent neural network (RNN) augmented with self-attention. Next, an ARN is introduced along the spatial dimension for spatial context aggregation. TPARN is designed as a multiple-input and multiple-output architecture to enhance all input channels simultaneously. Experimental results demonstrate the superiority of TPARN over existing state-of-the-art approaches.

Self-attending RNN for Speech Enhancement to Improve Cross-corpus Generalization

Ashutosh Pandey, DeLiang Wang

cs.SD · May 2021 · cited 54× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) represent the mainstream methodology for supervised speech enhancement, primarily due to their capability to model complex functions using hierarchical representations. However, a recent study revealed that DNNs trained on a single corpus fail to generalize to untrained corpora, especially in low signal-to-noise ratio (SNR) conditions. Developing a noise, speaker, and corpus independent speech enhancement algorithm is essential for real-world applications. In this study, we propose a self-attending recurrent neural network, or attentive recurrent network (ARN), for time-domain speech enhancement to improve cross-corpus generalization. ARN comprises of recurrent neural networks (RNNs) augmented with self-attention blocks and feedforward blocks. We evaluate ARN on different corpora with nonstationary noises in low SNR conditions. Experimental results…

Modeling the relationship between service quality, destination attachment and eWOM intention in heritage tourism

Ashutosh Pandey, Rajendra Sahu

Sociology and Political Science · International Journal of Tourism Cities · 15 May 2020 · cited 54× · DOI ↗ · more like this ·

Purpose This paper aims to empirically investigate the relationship between service quality (SQ) in heritage tourism, destination attachment (DA), and electronic word-of-mouth (eWOM) intention. Design/methodology/approach This study followed cross-sectional survey-based research design and surveyed 327 foreign tourists visiting the Golden Triangle, a heritage tourist circuit in India through mall interception method. The data were analysed using structural equation modelling. Findings The results reveal that heritage SQ has a significant positive effect on DA and eWOM intention and DA has a significant positive effect on eWOM intention. Originality/value The research findings make the theoretical and practical contribution in the domain, focussing explicitly on heritage tourism, in which such relation has not been studied yet, in sense of the foreign tourists.

Optimal planning for architecture-based self-adaptation via model checking of stochastic games

Javier Cámara, David Garlan, Bradley Schmerl +1 more

Artificial Intelligence · 13 Apr 2015 · cited 51× · DOI ↗ · more like this ·

Architecture-based approaches to self-adaptation rely on architectural descriptions to reason about the best way of adapting the structure and behavior of software-intensive systems at runtime, either by choosing among a set of predefined adaptation strategies, or by automatically generating adaptation plans. Predefined strategy selection has a low computational overhead and facilitates dealing with uncertainty (e.g., by accounting explicitly for contingencies derived from unexpected outcomes of actions), but requires additional designer effort regarding the specification of strategies and is unable to guarantee optimal solutions. In contrast, runtime plan generation is able to explore a richer solution space and provide optimal solutions in some cases, but is more limited when dealing with uncertainty, and in-curs higher computational overheads. In this paper, we propose an approach to…

Social media marketing impact on the purchase intention of millennials

Ashutosh Pandey, Rajendra Sahu, Manoj Kumar Dash

Sociology and Political Science · International Journal of Business Information Systems · 2018 · cited 49× · DOI ↗ · more like this ·

During the last decade we have seen an enormous growth of new channel of interaction i.e., social media such as Facebook, Twitter and YouTube, where people can share their feelings, likes, dislikes publicly in the forum. Social media is emerging as a new sophisticated and uncontrollable element influencing consumer behaviour. They have also changed the way now businesses and consumers communicate with each other by instigating a power shift from business towards consumers. Due to a widespread use of social media, publicly as a medium of marketing communication, it is the need of time to examine the social media marketing (SMM) empirically. From past relevant studies three constructs namely eWOM, attitude toward social media advertising and peer communication has been identified and through it, an attempt has been made to find out the effect of all these mediums of SMM on purchase…

Hybrid Planning for Decision Making in Self-Adaptive Systems

Ashutosh Pandey, Gabriel A. Moreno, Javier Cámara +1 more

Artificial Intelligence · September 2016 · cited 41× · DOI ↗ · more like this ·

Run-time generation of adaptation plans is a powerful mechanism that helps a self-adaptive system to meet its goals in a dynamically changing environment. In the past, researchers have demonstrated successful use of various automated planning techniques to generate adaptation plans at run time. However, for a planning technique, there is often a trade-off between timeliness and optimality of the solution. For some self-adaptive systems, ideally, one would like to have a planning approach that is both quick and finds an optimal adaptation plan. To find the right balance between these conflicting requirements, this paper introduces a hybrid planning approach that combines more than one planner to obtain the benefits of each. In this paper, to instantiate a hybrid planner we combine deterministic planning with Markov Decision Process (MDP) planning to obtain the best of both worlds…

Exploring Deep Complex Networks for Complex Spectrogram Enhancement

Ashutosh Pandey, DeLiang Wang

Signal Processing · IEEE Conference Proceedings · 17 Apr 2019 · cited 34× · DOI ↗ · more like this ·

A recent study has demonstrated the effectiveness of complex-valued deep neural networks (CDNNs) using newly developed tools such as complex batch normalization and complex residual blocks. Motivated by the fact that CDNNs are well suited for the processing of complex-domain representations, we explore CDNNs for speech enhancement. In particular, we train a CDNN that learns to map the complex-valued noisy short-time Fourier transform (STFT) to the clean STFT. Additionally, we propose the complex-valued extensions of the parametric rectified linear unit (PReLU) nonlinearity that helps to improve the performance of CDNN. Experimental results demonstrate that a CDNN using the proposed nonlinearity can give similar or better enhancement results compared to real-valued deep neural networks (DNNs).

DARTSim: An Exemplar for Evaluation and Comparison of Self-Adaptation Approaches for Smart Cyber-Physical Systems

Gabriel A. Moreno, Cody Kinneer, Ashutosh Pandey +1 more

Artificial Intelligence · May 2019 · cited 33× · DOI ↗ · more like this ·

Motivated by the need for cyber-physical systems (CPS) to perform in dynamic and uncertain environments, smart CPS (sCPS) utilize self-adaptive capabilities to autonomously manage uncertainties at the intersection of the cyber and physical worlds. In this context, self-adaptation approaches face particular challenges, including (i) environment monitoring that is subject to sensing errors; (ii) adaptation actions that take time, sometimes due to physical movement; (iii) dire consequences for not adapting in a timely manner; and (iv) incomparable objectives that cannot be conflated into a single utility metric (e.g., avoiding an accident vs. providing good service). To enable researchers to evaluate and compare self-adaptation approaches aiming to address these unique challenges of sCPS, we introduce the DARTSim exemplar. DARTSim implements a high-level simulation of a team of unmanned…

Low-Delay Signal Processing for Digital Hearing Aids

Ashutosh Pandey, V.J. Mathews

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · 22 Jul 2010 · cited 33× · DOI ↗ · more like this ·

Digital signal processing in modern hearing aids is typically performed in a subband or transform domain that introduces analysis-synthesis delays in the forward path. Long forward-path delays are not desirable because the processed sound combines with the unprocessed sound that arrives at the cochlea through the vent and changes the sound quality. Nonetheless, subband domain processing for digital hearing aids is the most popular choice for hearing aids because of the associated computational simplicity. In this paper, we present an alternative digital hearing aid structure with low-delay characteristics. The central idea in the paper is a low-delay spectral gain shaping method (SGSM) that employs parallel parametric equalization (EQ) filters. The low-delay SGSM provides frequency-dependent amplification for hearing loss compensation with low forward path delays and performs dynamic…

Automated planning for software architecture evolution

Jeffrey M. Barnes, Ashutosh Pandey, David Garlan

Information Systems · November 2013 · cited 29× · DOI ↗ · more like this ·

In previous research, we have developed a theoretical framework to help software architects make better decisions when planning software evolution. Our approach is based on representation and analysis of candidate evolution paths-sequences of transitional architectures leading from the current system to a desired target architecture. One problem with this kind of approach is that it imposes a heavy burden on the software architect, who must explicitly define and model these candidate paths. In this paper, we show how automated planning techniques can be used to support automatic generation of evolution paths, relieving this burden on the architect. We illustrate our approach by applying it to a data migration scenario, showing how this architecture evolution problem can be translated into a planning problem and solved using existing automated planning tools.

Dual-path Self-Attention RNN for Real-Time Speech Enhancement

Ashutosh Pandey, DeLiang Wang

cs.SD · October 2020 · cited 26× · arXiv ↗ · more like this ·

We propose a dual-path self-attention recurrent neural network (DP-SARNN) for time-domain speech enhancement. We improve dual-path RNN (DP-RNN) by augmenting inter-chunk and intra-chunk RNN with a recently proposed efficient attention mechanism. The combination of inter-chunk and intra-chunk attention improves the attention mechanism for long sequences of speech frames. DP-SARNN outperforms a baseline DP-RNN by using a frame shift four times larger than in DP-RNN, which leads to a substantially reduced computation time per utterance. As a result, we develop a real-time DP-SARNN by using long short-term memory (LSTM) RNN and causal attention in inter-chunk SARNN. DP-SARNN significantly outperforms existing approaches to speech enhancement, and on average takes 7.9 ms CPU time to process a signal chunk of 32 ms.

Volterra Filter design for edge enhancement of mammogram lesions

Ashutosh Pandey, Abhay Kumar Yadav, Vikrant Bhateja

Computer Vision and Pattern Recognition · February 2013 · cited 22× · DOI ↗ · more like this ·

Non-linear filters have the property to enhance and preserve edges of lesion. Detection of edges of tumour is required in application such as to evaluate effectiveness of breast cancer treatment. Proposed algorithm uses polynomial filtering technique to enhance the contrast of lesion while preserving its edges with effective suppression of background noise. This algorithm successfully detected edges of lesion in digital mammograms taken from DDSM mammogram database. Also different metrics were used to establish effectiveness of enhancement and noise suppression in mammograms.

Time-domain Ad-hoc Array Speech Enhancement Using a Triple-path Network

Ashutosh Pandey, Buye Xu, Anurag Kumar +3 more

cs.SD · October 2021 · cited 15× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) are very effective for multichannel speech enhancement with fixed array geometries. However, it is not trivial to use DNNs for ad-hoc arrays with unknown order and placement of microphones. We propose a novel triple-path network for ad-hoc array processing in the time domain. The key idea in the network design is to divide the overall processing into spatial processing and temporal processing and use self-attention for spatial processing. Using self-attention for spatial processing makes the network invariant to the order and the number of microphones. The temporal processing is done independently for all channels using a recently proposed dual-path attentive recurrent network. The proposed network is a multiple-input multiple-output architecture that can simultaneously enhance signals at all microphones. Experimental results demonstrate the excellent…

Dynamic Gated Recurrent Neural Network for Compute-efficient Speech Enhancement

Longbiao Cheng, Ashutosh Pandey, Buye Xu +2 more

eess.AS · August 2024 · cited 14× · arXiv ↗ · more like this ·

This paper introduces a new Dynamic Gated Recurrent Neural Network (DG-RNN) for compute-efficient speech enhancement models running on resource-constrained hardware platforms. It leverages the slow evolution characteristic of RNN hidden states over steps, and updates only a selected set of neurons at each step by adding a newly proposed select gate to the RNN model. This select gate allows the computation cost of the conventional RNN to be reduced during network inference. As a realization of the DG-RNN, we further propose the Dynamic Gated Recurrent Unit (D-GRU) which does not require additional parameters. Test results obtained from several state-of-the-art compute-efficient RNN-based speech enhancement architectures using the DNS challenge dataset, show that the D-GRU based model variants maintain similar speech intelligibility and quality metrics comparable to the baseline GRU based…

Machine Learning-Based Crowd behavior Analysis and Forecasting

Sachin Bhardwaj, Apoorva Dwivedi, Ashutosh Pandey +2 more

Artificial Intelligence · International Journal of Scientific Research in Computer Science Engineering and Information Technology · June 2023 · cited 14× · DOI ↗ · more like this ·

In many places today, the world's overcrowding causes crowded conditions. Analysis of crowd activity is a developing field of study. It is common knowledge that mob activity can forecast what might happen during an event. Crowd management could be very effective if situations like riots, mass lynchings, traffic jams, accidents, stampedes, etc. could be predicted beforehand. In this paper, we propose a new multicolumn convolutional neural network (MCNN) based technique for predicting mob behavior. The features of the incoming image are first analyzed and extracted. The approximated number of the gathering is then established, and image cropping is completed. For each area of the image, low level characteristics are retrieved. The objects in the picture are then created as density images. Using our method, the gathered characteristics and their object density maps are then linearly…

Social media marketing impact on the purchase intention of millennials

Manoj Kumar Dash, Rajendra Sahu, Ashutosh Pandey

Sociology and Political Science · International Journal of Business Information Systems · 2018 · cited 13× · DOI ↗ · more like this ·

Enhancing Bluetooth Channel Sounding Performance in Complex Indoor Environments

Avik Santra, Igor Kravets, Nazarii Kotliar +1 more

Computer Networks and Communications · IEEE Sensors Letters · 9 Sep 2024 · cited 12× · DOI ↗ · more like this ·

The Internet of Things (IoT) relies on accurate distance estimation between devices, crucial for localization in various applications. While received signal strength indicator (RSSI)-based ranging lacks precision and time-of-flight narrow band systems perform poorly, phase-based ranging emerges as the preferred choice for Bluetooth Low Energy (BLE). Infineon's BLE prototype and its performance with a novel processing pipeline based on the minimum variance distortionless response (MVDR) algorithm are presented in this letter. Our pipeline comprises subalgorithms for preprocessing, scene identification, feature selection, feature engineering, and postprocessing. Preprocessing includes zero distance calibration, low-pass filtering, and time history averaging. Scene identification adapts parameters to environmental conditions. MVDR algorithms enable high-resolution feature transformation to…

Effectiveness of Government Policies in Controlling COVID-19 in India

Ashutosh Pandey, Nitin Kishore Saxena

Modeling and Simulation · International Journal of Health Services · 29 Dec 2020 · cited 11× · DOI ↗ · more like this ·

The purpose of this study is to find the demographic factors associated with the spread of COVID-19 and to suggest a measure for identifying the effectiveness of government policies in controlling COVID-19. The study hypothesizes that the cumulative number of confirmed COVID-19 patients depends on the urban population, rural population, number of persons older than 50, population density, and poverty rate. A log-linear model is used to test the stated hypothesis, with the cumulative number of confirmed COVID-19 patients up to period [Formula: see text] as a dependent variable and demographic factors as an independent variable. The policy effectiveness indicator is calculated by taking the difference of the COVID rank of the [Formula: see text]th state based on the predicted model and the actual COVID rank of the [Formula: see text]th state[Formula: see text]Our study finds that the…

Towards a Formal Framework for Hybrid Planning in Self-Adaptation

Ashutosh Pandey, Ivan Ruchkin, Bradley Schmerl +1 more

Artificial Intelligence · May 2017 · cited 11× · DOI ↗ · more like this ·

Decision-making approaches in self-adaptation face a fundamental trade-off between quality and timeliness of adaptation plans. Due to this trade-off, designers often have to make an offline compromise between finding adaptation plans quickly and finding closer-to-optimal plans that demand longer computation times. Recent work has proposed that hybrid planning can resolve this trade-off dynamically, achieving higher utility than either fast or slow approaches individually. The promise of hybrid planning is to combine multiple decision-making approaches at run time to produce adaptation plans of the high quality within given time constraints. However, the diversity of decision-making approaches makes the problem of hybrid planning complex and multi-faceted. This paper advances the theory of hybrid planning by formalizing the central concepts and four sub-problems of hybrid planning. This…