arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Meng Yu

400 papers · 2000–2026

2000: 12001: 52002: 62003: 12004: 52005: 112006: 82007: 122008: 72009: 82010: 102011: 122012: 202013: 152014: 92015: 92016: 42017: 112018: 172019: 302020: 322021: 252022: 232023: 292024: 392025: 352026: 16
2000peak 39 in 20242026

Frequent co-authors

Papers

showing 1–25 of 400 RSS

An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation

Daniel Michelsanti, Zheng-Hua Tan, Shi-Xiong Zhang +4 more

eess.AS · · cited 347× · arXiv ↗ · more like this ·

Speech enhancement and speech separation are two related tasks, whose purpose is to extract either one or more target speech signals, respectively, from a mixture of sounds generated by several sources. Traditionally, these tasks have been tackled using signal processing and machine learning techniques applied to the available acoustic signals. Since the visual aspect of speech is essentially unaffected by the acoustic environment, visual information from the target speakers, such as lip movements and facial expressions, has also been used for speech enhancement and speech separation systems. In order to efficiently fuse acoustic and visual information, researchers have exploited the flexibility of data-driven approaches, specifically deep learning, achieving strong performance. The ceaseless proposal of a large number of techniques to extract features and fuse multimodal information…

Communication related health crisis on social media: a case of COVID-19 outbreak

Meng Yu, Zhiyong Li, Zhicheng Yu +2 more

Sociology and Political Science · Current Issues in Tourism · · cited 347× · DOI ↗ · more like this ·

Social media is an important element in disaster and health crisis related communication. This research reviews 10, 132 online comments related to COVID-19 through automated and manual content analysis. The key themes are identified and discussed including dynamically changed tourists’ risk perception, the effects of tourism enterprises’ service quality in crisis, the quarantine issues in public health, the authenticity of media coverage, and racial discrimination. This research contributes to suggestions and insights for future research in the field of epidemic-induced tourism crisis.

Perceived teacher support, student engagement, and academic achievement: a meta-analysis

Tao Yang, Meng Yu, Zhenya Gao +1 more

Education · Educational Psychology · · cited 292× · DOI ↗ · more like this ·

Guided by the self-system process model, the aim of this study was to unravel the relationship between students’ perceived teacher support and academic achievement as well as to address the role of student engagement, using a meta-analytic approach. Based on 71 empirical articles, we found that there was a small to medium correlation between perceived teacher support and achievement (r = 0.16), moderated by grade level, dimensions of teacher support, and measures of academic achievement. Perceived teacher support had the greatest impact on achievement among upper-secondary students, while also had a larger influence on student course grades than standardised test scores. Meanwhile, perceived emotional support had a larger effect size than autonomy or academic support on student achievement. In terms of mediating analysis, both general student engagement and its sub-types (behavioural…

Incentive-based modeling and inference of attacker intent, objectives, and strategies

Peng Liu, Wanyu Zang, Meng Yu

Information Systems · ACM Transactions on Information and System Security · · cited 202× · DOI ↗ · more like this ·

Although the ability to model and infer attacker intent, objectives, and strategies (AIOS) may dramatically advance the literature of risk assessment, harm prediction, and predictive or proactive cyber defense, existing AIOS inference techniques are ad hoc and system or application specific. In this paper, we present a general incentive-based method to model AIOS and a game-theoretic approach to inferring AIOS. On one hand, we found that the concept of incentives can unify a large variety of attacker intents; the concept of utilities can integrate incentives and costs in such a way that attacker objectives can be practically modeled. On the other hand, we developed a game-theoretic AIOS formalization which can capture the inherent interdependency between AIOS and defender objectives and strategies in such a way that AIOS can be automatically inferred. Finally, we use a specific case…

Containing COVID-19 Among 627,386 Persons in Contact With the Diamond Princess Cruise Ship Passengers Who Disembarked in Taiwan: Big Data Analytics

Chi-Mai Chen, Hong-Wei Jyan, Shih-Chieh Chien +9 more

Information Systems · Journal of Medical Internet Research · · cited 166× · DOI ↗ · more like this ·

BACKGROUND: Low infection and case-fatality rates have been thus far observed in Taiwan. One of the reasons for this major success is better use of big data analytics in efficient contact tracing and management and surveillance of those who require quarantine and isolation. OBJECTIVE: We present here a unique application of big data analytics among Taiwanese people who had contact with more than 3000 passengers that disembarked at Keelung harbor in Taiwan for a 1-day tour on January 31, 2020, 5 days before the outbreak of coronavirus disease (COVID-19) on the Diamond Princess cruise ship on February 5, 2020, after an index case was identified on January 20, 2020. METHODS: The smart contact tracing-based mobile sensor data, cross-validated by other big sensor surveillance data, were analyzed by the mobile geopositioning method and rapid analysis to identify 627,386 potential…

TrustShadow: Secure Execution of Unmodified Applications with ARM TrustZone

Le Guan, Peng Liu, Xinyu Xing +4 more

cs.CR · · cited 155× · arXiv ↗ · more like this ·

The rapid evolution of Internet-of-Things (IoT) technologies has led to an emerging need to make it smarter. A variety of applications now run simultaneously on an ARM-based processor. For example, devices on the edge of the Internet are provided with higher horsepower to be entrusted with storing, processing and analyzing data collected from IoT devices. This significantly improves efficiency and reduces the amount of data that needs to be transported to the cloud for data processing, analysis and storage. However, commodity OSes are prone to compromise. Once they are exploited, attackers can access the data on these devices. Since the data stored and processed on the devices can be sensitive, left untackled, this is particularly disconcerting. In this paper, we propose a new system, TrustShadow that shields legacy applications from untrusted OSes. TrustShadow takes advantage of ARM…

Time Domain Audio Visual Speech Separation

Jian Wu, Yong Xu, Shi-Xiong Zhang +4 more

eess.AS · · cited 152× · arXiv ↗ · more like this ·

Audio-visual multi-modal modeling has been demonstrated to be effective in many speech related tasks, such as speech recognition and speech enhancement. This paper introduces a new time-domain audio-visual architecture for target speaker extraction from monaural mixtures. The architecture generalizes the previous TasNet (time-domain speech separation network) to enable multi-modal learning and at meanwhile it extends the classical audio-visual speech separation from frequency-domain to time-domain. The main components of proposed architecture include an audio encoder, a video encoder that extracts lip embedding from video streams, a multi-modal separation network and an audio decoder. Experiments on simulated mixtures based on recently released LRS2 dataset show that our method can bring 3dB+ and 4dB+ Si-SNR improvements on two- and three-speaker cases respectively, compared to…

ADL-MVDR: All deep learning MVDR beamformer for target speech separation

Zhuohuang Zhang, Yong Xu, Meng Yu +3 more

eess.AS · · cited 147× · arXiv ↗ · more like this ·

Speech separation algorithms are often used to separate the target speech from other interfering sources. However, purely neural network based speech separation systems often cause nonlinear distortion that is harmful for automatic speech recognition (ASR) systems. The conventional mask-based minimum variance distortionless response (MVDR) beamformer can be used to minimize the distortion, but comes with high level of residual noise. Furthermore, the matrix operations (e.g., matrix inversion) involved in the conventional MVDR solution are sometimes numerically unstable when jointly trained with neural networks. In this paper, we propose a novel all deep learning MVDR framework, where the matrix inversion and eigenvalue decomposition are replaced by two recurrent neural networks (RNNs), to resolve both issues at the same time. The proposed method can greatly reduce the residual noise…

ETCM v2.0: An update with comprehensive resource and rich annotations for traditional Chinese medicine

Yanqiong Zhang, Xin Li, Yulong Shi +9 more

Computational Theory and Mathematics · Acta Pharmaceutica Sinica B · · cited 121× · DOI ↗ · more like this ·

Existing traditional Chinese medicine (TCM)-related databases are still insufficient in data standardization, integrity and precision, and need to be updated urgently. Herein, an Encyclopedia of Traditional Chinese Medicine version 2.0 (ETCM v2.0, http://www.tcmip.cn/ETCM2/front/#/) was constructed as the latest curated database hosting 48,442 TCM formulas recorded by ancient Chinese medical books, 9872 Chinese patent drugs, 2079 Chinese medicinal materials and 38,298 ingredients. To facilitate the mechanistic research and new drug discovery, we improved the target identification method based on a two-dimensional ligand similarity search module, which provides the confirmed and/or potential targets of each ingredient, as well as their binding activities. Importantly, five TCM formulas/Chinese patent drugs/herbs/ingredients with the highest Jaccard similarity scores to the submitted…

DurIAN: Duration Informed Attention Network For Multimodal Synthesis

Chengzhu Yu, Heng Lu, Na Hu +9 more

cs.CL · · cited 119× · arXiv ↗ · more like this ·

In this paper, we present a generic and robust multimodal synthesis system that produces highly natural speech and facial expression simultaneously. The key component of this system is the Duration Informed Attention Network (DurIAN), an autoregressive model in which the alignments between the input text and the output acoustic features are inferred from a duration model. This is different from the end-to-end attention mechanism used, and accounts for various unavoidable artifacts, in existing end-to-end speech synthesis systems such as Tacotron. Furthermore, DurIAN can be used to generate high quality facial expression which can be synchronized with generated speech with/without parallel speech and face data. To improve the efficiency of speech generation, we also propose a multi-band parallel generation strategy on top of the WaveRNN model. The proposed Multi-band WaveRNN effectively…

Self-supervised Text-independent Speaker Verification using Prototypical Momentum Contrastive Learning

Wei Xia, Chunlei Zhang, Chao Weng +2 more

eess.AS · · cited 95× · arXiv ↗ · more like this ·

In this study, we investigate self-supervised representation learning for speaker verification (SV). First, we examine a simple contrastive learning approach (SimCLR) with a momentum contrastive (MoCo) learning framework, where the MoCo speaker embedding system utilizes a queue to maintain a large set of negative examples. We show that better speaker embeddings can be learned by momentum contrastive learning. Next, alternative augmentation strategies are explored to normalize extrinsic speaker variabilities of two random segments from the same speech utterance. Specifically, augmentation in the waveform largely improves the speaker representations for SV tasks. The proposed MoCo speaker embedding is further improved when a prototypical memory bank is introduced, which encourages the speaker embeddings to be closer to their assigned prototypes with an intermediate clustering step. In…

Deep Extractor Network for Target Speaker Recovery From Single Channel Speech Mixtures

Jun Wang, Jie Chen, Dan Su +4 more

cs.SD · · cited 95× · arXiv ↗ · more like this ·

Speaker-aware source separation methods are promising workarounds for major difficulties such as arbitrary source permutation and unknown number of sources. However, it remains challenging to achieve satisfying performance provided a very short available target speaker utterance (anchor). Here we present a novel "deep extractor network" which creates an extractor point for the target speaker in a canonical high dimensional embedding space, and pulls together the time-frequency bins corresponding to the target speaker. The proposed model is different from prior works in that the canonical embedding space encodes knowledges of both the anchor and the mixture during an end-to-end training phase: First, embeddings for the anchor and mixture speech are separately constructed in a primary embedding space, and then combined as an input to feed-forward layers to transform to a canonical…

A comprehensive study of speech separation: spectrogram vs waveform separation

Fahimeh Bahmaninezhad, Jian Wu, Rongzhi Gu +4 more

cs.SD · · cited 87× · arXiv ↗ · more like this ·

Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network (TasNet) is introduced for single-channel data, with achieving high Si-SNR (scale-invariant source-to-noise ratio) and SDR (source-to-distortion ratio) comparing against the state-of-the-art solution in frequency-domain. In this study, we incorporate effective components of the TasNet into a frequency-domain separation method. We compare both for alternative scenarios. We introduce a solution for directly optimizing the separation criterion in frequency-domain networks. In addition to speech separation objective and subjective measurements, we evaluate the separation performance on a speech recognition task as well. We study the speech separation problem for far-field…

End-to-End Multi-Channel Speech Separation

Rongzhi Gu, Jian Wu, Shi-Xiong Zhang +6 more

cs.SD · · cited 80× · arXiv ↗ · more like this ·

The end-to-end approach for single-channel speech separation has been studied recently and shown promising results. This paper extended the previous approach and proposed a new end-to-end model for multi-channel speech separation. The primary contributions of this work include 1) an integrated waveform-in waveform-out separation system in a single neural network architecture. 2) We reformulate the traditional short time Fourier transform (STFT) and inter-channel phase difference (IPD) as a function of time-domain convolution with a special kernel. 3) We further relaxed those fixed kernels to be learnable, so that the entire architecture becomes purely data-driven and can be trained from end-to-end. We demonstrate on the WSJ0 far-field speech separation task that, with the benefit of learnable spatial features, our proposed end-to-end multi-channel model significantly improved the…

FAST-RIR: Fast neural diffuse room impulse response generator

Anton Ratnarajah, Shi-Xiong Zhang, Meng Yu +3 more

cs.SD · · cited 76× · arXiv ↗ · more like this ·

We present a neural-network-based fast diffuse room impulse response generator (FAST-RIR) for generating room impulse responses (RIRs) for a given acoustic environment. Our FAST-RIR takes rectangular room dimensions, listener and speaker positions, and reverberation time as inputs and generates specular and diffuse reflections for a given acoustic environment. Our FAST-RIR is capable of generating RIRs for a given input reverberation time with an average error of 0.02s. We evaluate our generated RIRs in automatic speech recognition (ASR) applications using Google Speech API, Microsoft Speech API, and Kaldi tools. We show that our proposed FAST-RIR with batch size 1 is 400 times faster than a state-of-the-art diffuse acoustic simulator (DAS) on a CPU and gives similar performance to DAS in ASR experiments. Our FAST-RIR is 12 times faster than an existing GPU-based RIR generator (gpuRIR).…

Enhancing End-to-End Multi-channel Speech Separation via Spatial Feature Learning

Rongzhi Gu, Shi-Xiong Zhang, Lianwu Chen +5 more

eess.AS · · cited 69× · arXiv ↗ · more like this ·

Hand-crafted spatial features (e.g., inter-channel phase difference, IPD) play a fundamental role in recent deep learning based multi-channel speech separation (MCSS) methods. However, these manually designed spatial features are hard to incorporate into the end-to-end optimized MCSS framework. In this work, we propose an integrated architecture for learning spatial features directly from the multi-channel speech waveforms within an end-to-end speech separation framework. In this architecture, time-domain filters spanning signal channels are trained to perform adaptive spatial filtering. These filters are implemented by a 2d convolution (conv2d) layer and their parameters are optimized using a speech separation objective function in a purely data-driven fashion. Furthermore, inspired by the IPD formulation, we design a conv2d kernel to compute the inter-channel convolution differences…

Amplify-Forward and Decode-Forward: The Impact of Location and Capacity Contour

Meng Yu, Jing Li, Hamid R. Sadjadpour

Computer Networks and Communications · · cited 63× · DOI ↗ · more like this ·

Successful message relay, or the quality of the inter-user channel, is critical to fully realize the cooperative benefits promised by the theory. This in turn points out the importance of the relative location of the users. This paper investigates the impact of the location on the system capacity and outage probability for both amplify-forward (AF) and decode-forward (DF) schemes. Signal attenuation is modeled using power laws and capacity is evaluated using the max-flow min-cut theory. The resemblance and difference between cooperative systems and multi-input multi-output (MIMO) systems are also discussed. Finally a capacity contour for DF, the more popular mode of the two, is provided to facilitate the derivation of engineering rules.

Audio-Visual Speech Separation and Dereverberation with a Two-Stage Multimodal Network

Ke Tan, Yong Xu, Shi-Xiong Zhang +2 more

eess.AS · · cited 57× · arXiv ↗ · more like this ·

Background noise, interfering speech and room reverberation frequently distort target speech in real listening environments. In this study, we address joint speech separation and dereverberation, which aims to separate target speech from background noise, interfering speech and room reverberation. In order to tackle this fundamentally difficult problem, we propose a novel multimodal network that exploits both audio and visual signals. The proposed network architecture adopts a two-stage strategy, where a separation module is employed to attenuate background noise and interfering speech in the first stage and a dereverberation module to suppress room reverberation in the second stage. The two modules are first trained separately, and then integrated for joint training, which is based on a new multi-objective loss function. Our experimental results show that the proposed multimodal…

EEND-SS: Joint End-to-End Neural Speaker Diarization and Speech Separation for Flexible Number of Speakers

Soumi Maiti, Yushi Ueda, Shinji Watanabe +4 more

eess.AS · · cited 51× · arXiv ↗ · more like this ·

In this paper, we present a novel framework that jointly performs three tasks: speaker diarization, speech separation, and speaker counting. Our proposed framework integrates speaker diarization based on end-to-end neural diarization (EEND) models, speaker counting with encoder-decoder based attractors (EDA), and speech separation using Conv-TasNet. In addition, we propose a multiple 1x1 convolutional layer architecture for estimating the separation masks corresponding to a flexible number of speakers and a fusion technique for refining the separated speech signal with obtained speaker diarization information to improve the joint framework. Experiments using the LibriMix dataset show that our proposed method outperforms the single-task baselines in both diarization and separation metrics for fixed and flexible numbers of speakers and improves speaker counting performance for flexible…

Seq2Seq Attentional Siamese Neural Networks for Text-dependent Speaker Verification

Yichi Zhang, Meng Yu, Na Li +3 more

Artificial Intelligence · · cited 47× · DOI ↗ · more like this ·

In this paper, we present a Sequence-to-Sequence Attentional Siamese Neural Network (Seq2Seq-ASNN) that leverages temporal alignment information for end-to-end speaker verification. In prior works of speaker discriminative neural networks, utterance-level evaluation/enrollment speaker representations are usually calculated. Our proposed model, utilizing a sequence-to-sequence (Seq2Seq) attention mechanism, maps the frame-level evaluation representation into enrollment feature domain and further generates an utterance-level evaluation-enrollment joint vector for final similarity measure. Feature learning, attention mechanism, and metric learning are jointly optimized using an end-to-end loss function. Experimental results show that our proposed model outperforms various baseline methods, including the traditional i-Vector/PLDA method, multi-enrollment end-to-end speaker verification…

Neural Spatio-Temporal Beamformer for Target Speech Separation

Yong Xu, Meng Yu, Shi-Xiong Zhang +4 more

eess.AS · · cited 45× · arXiv ↗ · more like this ·

Purely neural network (NN) based speech separation and enhancement methods, although can achieve good objective scores, inevitably cause nonlinear speech distortions that are harmful for the automatic speech recognition (ASR). On the other hand, the minimum variance distortionless response (MVDR) beamformer with NN-predicted masks, although can significantly reduce speech distortions, has limited noise reduction capability. In this paper, we propose a multi-tap MVDR beamformer with complex-valued masks for speech separation and enhancement. Compared to the state-of-the-art NN-mask based MVDR beamformer, the multi-tap MVDR beamformer exploits the inter-frame correlation in addition to the inter-microphone correlation that is already utilized in prior arts. Further improvements include the replacement of the real-valued masks with the complex-valued masks and the joint training of the…

Far-Field Location Guided Target Speech Extraction Using End-to-End Speech Recognition Objectives

Aswin Shanmugam Subramanian, Chao Weng, Meng Yu +4 more

Artificial Intelligence · · cited 45× · DOI ↗ · more like this ·

Target speech extraction is a specific case of source separation where an auxiliary information like the location or some pre-saved anchor speech examples of the target speaker is used to resolve the permutation ambiguity. Traditionally such systems are optimized based on signal reconstruction objectives. Recently end-to-end automatic speech recognition (ASR) methods have enabled to optimize source separation systems with only the transcription based objective. This paper proposes a method to jointly optimize a location guided target speech extraction module along with a speech recognition module only with ASR error minimization criteria. Experimental comparisons with corresponding conventional pipeline systems verify that this task can be realized by end-to-end ASR training objectives without using parallel clean data. We show promising target speech recognition results in mixtures of…

Joint Training of Complex Ratio Mask Based Beamformer and Acoustic Model for Noise Robust Asr

Yong Xu, Chao Weng, Like Hui +4 more

Signal Processing · · cited 45× · DOI ↗ · more like this ·

In this paper, we present a joint training framework between the multi-channel beamformer and the acoustic model for noise robust automatic speech recognition (ASR). The complex ratio mask (CRM), demonstrated to be more effective than the ideal ratio mask (IRM), is proposed to estimate the covariance matrix for the beamformer. Minimum Variance Distortionless Response (MVDR) beamformer and Generalized Eigenvalue (GEV) beamformer are both investigated under the CRM-based joint training architecture. We also propose a robust mask pooling strategy among multiple channels. A long short-term memory (LSTM) based language model is utilized to re-score hypotheses which further improves the overall performance. We evaluate the proposed methods on CHiME-4 challenge dataset. The CRM based system achieves a relative 10% reduction on word error rate (WER) compared with the IRM based system. Without…

Early Introduction of Severe Acute Respiratory Syndrome Coronavirus 2 into Europe

Sonja J. Olsen, Meng-Yu Chen, Yu‐Lun Liu +9 more

Modeling and Simulation · Emerging infectious diseases · · cited 40× · DOI ↗ · more like this ·

Early infections with severe acute respiratory syndrome coronavirus 2 in Europe were detected in travelers from Wuhan, China, in January 2020. In 1 tour group, 5 of 30 members were ill; 3 cases were laboratory confirmed. In addition, a healthcare worker was infected. This event documents early importation and subsequent spread of the virus in Europe.