arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Meng Ge

96 papers · 2003–2026

2003: 12004: 02005: 12006: 02007: 02008: 12009: 42010: 12011: 02012: 02013: 02014: 02015: 02016: 02017: 22018: 62019: 02020: 42021: 52022: 192023: 152024: 152025: 152026: 7
2003peak 19 in 20222026

Frequent co-authors

Papers

showing 1–25 of 96 RSS

SpEx+: A Complete Time Domain Speaker Extraction Network

Meng Ge, Chenglin Xu, Longbiao Wang +3 more

eess.AS · · cited 204× · arXiv ↗ · more like this ·

Speaker extraction aims to extract the target speech signal from a multi-talker environment given a target speaker's reference speech. We recently proposed a time-domain solution, SpEx, that avoids the phase estimation in frequency-domain approaches. Unfortunately, SpEx is not fully a time-domain solution since it performs time-domain speech encoding for speaker extraction, while taking frequency-domain speaker embedding as the reference. The size of the analysis window for time-domain and the size for frequency-domain input are also different. Such mismatch has an adverse effect on the system performance. To eliminate such mismatch, we propose a complete time-domain speaker extraction solution, that is called SpEx+. Specifically, we tie the weights of two identical speech encoder networks, one for the encoder-extractor-decoder pipeline, another as part of the speaker encoder.…

USEV: Universal Speaker Extraction with Visual Cue

Zexu Pan, Meng Ge, Haizhou Li

eess.AS · · cited 74× · arXiv ↗ · more like this ·

A speaker extraction algorithm seeks to extract the target speaker's speech from a multi-talker speech mixture. The prior studies focus mostly on speaker extraction from a highly overlapped multi-talker speech mixture. However, the target-interference speaker overlapping ratios could vary over a wide range from 0% to 100% in natural speech communication, furthermore, the target speaker could be absent in the speech mixture, the speech mixtures in such universal multi-talker scenarios are described as general speech mixtures. The speaker extraction algorithm requires an auxiliary reference, such as a video recording or a pre-recorded speech, to form top-down auditory attention on the target speaker. We advocate that a visual cue, i.e., lip movement, is more informative than an audio cue, i.e., pre-recorded speech, to serve as the auxiliary reference for speaker extraction in…

RAW-GNN: RAndom Walk Aggregation based Graph Neural Network

Di Jin, Rui Wang, Meng Ge +4 more

cs.LG · · cited 71× · arXiv ↗ · more like this ·

Graph-Convolution-based methods have been successfully applied to representation learning on homophily graphs where nodes with the same label or similar attributes tend to connect with one another. Due to the homophily assumption of Graph Convolutional Networks (GCNs) that these methods use, they are not suitable for heterophily graphs where nodes with different labels or dissimilar attributes tend to be adjacent. Several methods have attempted to address this heterophily problem, but they do not change the fundamental aggregation mechanism of GCNs because they rely on summation operators to aggregate information from neighboring nodes, which is implicitly subject to the homophily assumption. Here, we introduce a novel aggregation mechanism and develop a RAndom Walk Aggregation-based Graph Neural Network (called RAW-GNN) method. The proposed approach integrates the random walk strategy…

Multi-stage Speaker Extraction with Utterance and Frame-Level Reference Signals

Meng Ge, Chenglin Xu, Longbiao Wang +3 more

eess.AS · · cited 64× · arXiv ↗ · more like this ·

Speaker extraction requires a sample speech from the target speaker as the reference. However, enrolling a speaker with a long speech is not practical. We propose a speaker extraction technique, that performs in multiple stages to take full advantage of short reference speech sample. The extracted speech in early stages is used as the reference speech for late stages. For the first time, we use frame-level sequential speech embedding as the reference for target speaker. This is a departure from the traditional utterance-based speaker embedding reference. In addition, a signal fusion scheme is proposed to combine the decoded signals in multiple scales with automatically learned weights. Experiments on WSJ0-2mix and its noisy versions (WHAM! and WHAMR!) show that SpEx++ consistently outperforms other state-of-the-art baselines.

L-SpEx: Localized Target Speaker Extraction

Meng Ge, Chenglin Xu, Longbiao Wang +3 more

eess.AS · · cited 35× · arXiv ↗ · more like this ·

Speaker extraction aims to extract the target speaker's voice from a multi-talker speech mixture given an auxiliary reference utterance. Recent studies show that speaker extraction benefits from the location or direction of the target speaker. However, these studies assume that the target speaker's location is known in advance or detected by an extra visual cue, e.g., face image or video. In this paper, we propose an end-to-end localized target speaker extraction on pure speech cues, that is called L-SpEx. Specifically, we design a speaker localizer driven by the target speaker's embedding to extract the spatial features, including direction-of-arrival (DOA) of the target speaker and beamforming output. Then, the spatial cues and target speaker's embedding are both used to form a top-down auditory attention to the target speaker. Experiments on the multi-channel reverberant dataset…

A novel image encryption scheme based on 3D bit matrix and chaotic map with Markov properties

Meng Ge, Ruisong Ye

Computer Vision and Pattern Recognition · Egyptian Informatics Journal · · cited 35× · DOI ↗ · more like this ·

Based on 3D cat map, reverse 3D cat map and an improved class of chaotic maps with Markov properties, an effective bit-level image encryption scheme is proposed. Firstly, we convert the plain-image into binary matrix, and use the sum of all bits in the binary matrix as a part of secret keys to resist chosen-plaintext attack and known-plaintext attack. Secondly, we design a mapping which maps a random bit position to another random bit position rather than using traditional sequential visiting the plain-image. Thirdly, a chaotic map with Markov properties is used in the diffuse process. This kind of chaotic map has good chaotic natures than the Logistic map, which keeps the uniformity and low autocorrelation. The results of simulation and security analysis show that the proposed image encryption scheme is able to resist various attacks and has excellent encryption performance. Keywords…

A Hybrid Continuity Loss to Reduce Over-Suppression for Time-domain Target Speaker Extraction

Zexu Pan, Meng Ge, Haizhou Li

eess.AS · · cited 29× · arXiv ↗ · more like this ·

The speaker extraction algorithm extracts the target speech from a mixture speech containing interference speech and background noise. The extraction process sometimes over-suppresses the extracted target speech, which not only creates artifacts during listening but also harms the performance of downstream automatic speech recognition algorithms. We propose a hybrid continuity loss function for time-domain speaker extraction algorithms to settle the over-suppression problem. On top of the waveform-level loss used for superior signal quality, i.e., SI-SDR, we introduce a multi-resolution delta spectrum loss in the frequency-domain, to ensure the continuity of an extracted speech signal, thus alleviating the over-suppression. We examine the hybrid continuity loss function using a time-domain audio-visual speaker extraction algorithm on the YouTube LRS2-BBC dataset. Experimental results…

Association between health behaviours and the COVID-19 vaccination: risk compensation among healthcare workers in Taizhou, China

Liang-Xue Sun, Lili Chen, Weiying Chen +6 more

Health · Human Vaccines & Immunotherapeutics · · cited 23× · DOI ↗ · more like this ·

This study is conducted to explore the association between health behaviors and the COVID-19 vaccination based on the risk compensation concept among health-care workers in Taizhou, China. We conducted a self-administered online survey to estimate the health behaviors among the staff in a tertiary hospital in Taizhou, China, from May 18 to 21 May 2021. A total of 592 out of 660 subjects (89.7%) responded to the questionnaire after receiving an e-poster on WeChat. Subjects who had been inoculated with the COVID-19 vaccine were asked to mention the differences in their health behaviors before and after the vaccination. The results showed that there were no statistical differences in health behaviors between vaccinated and unvaccinated groups, except in terms of the type of gloves they used (62.8% in the vaccinated group and 49.2% in the unvaccinated group, p = .048). Subjects who received…

Integrative Network Embedding via Deep Joint Reconstruction

Di Jin, Meng Ge, Liang Yang +3 more

Artificial Intelligence · · cited 20× · DOI ↗ · more like this ·

Network embedding is to learn a low-dimensional representation for a network in order to capture intrinsic features of the network. It has been applied to many applications, e.g., network community detection and user recommendation. One of the recent research topics for network embedding has been focusing on exploitation of diverse information, including network topology and semantic information on nodes of networks. However, such diverse information has not been fully utilized nor adequately integrated in the existing methods, so that the resulting network embedding is far from satisfactory. In this paper, we develop a weight-free multi-component network embedding approach by network reconstruction via a deep Autoencoder. Three key components make our new approach effective, i.e., a uniformed graph representation of network topology and semantic information, enhancement to the graph…

Time-Domain Speech Separation Networks With Graph Encoding Auxiliary

Tingting Wang, Zexu Pan, Meng Ge +2 more

Signal Processing · IEEE Signal Processing Letters · · cited 18× · DOI ↗ · more like this ·

End-to-end time-domain speech separation with masking strategy has shown its performance advantage, where a 1-D convolutional layer is used as the speech encoder to encode a sliding window of waveform to a latent feature representation, i.e. an embedding vector. A large window leads to low resolution in the speech processing, on the other hand, a small window offers high resolution but at the expense of high computational cost. In this work, we propose a graph encoding technique to model the fine structural knowledge of speech samples in a window of reasonable size. Specifically, we build a graph representation for each latent representation, and encode the structural details with a graph convolutional network encoder. The encoded graph feature representation complements the original latent feature representation and benefits the separation and reconstruction of speech. Experiments on…

An Empirical Study on the Impact of Positional Encoding in Transformer-based Monaural Speech Enhancement

Qiquan Zhang, Meng Ge, Hongxu Zhu +4 more

eess.AS · · cited 17× · arXiv ↗ · more like this ·

Transformer architecture has enabled recent progress in speech enhancement. Since Transformers are position-agostic, positional encoding is the de facto standard component used to enable Transformers to distinguish the order of elements in a sequence. However, it remains unclear how positional encoding exactly impacts speech enhancement based on Transformer architectures. In this paper, we perform a comprehensive empirical study evaluating five positional encoding methods, i.e., Sinusoidal and learned absolute position embedding (APE), T5-RPE, KERPLE, as well as the Transformer without positional encoding (No-Pos), across both causal and noncausal configurations. We conduct extensive speech enhancement experiments, involving spectral mapping and masking methods. Our findings establish that positional encoding is not quite helpful for the models in a causal configuration, which indicates…

Spectrograms Fusion with Minimum Difference Masks Estimation for Monaural Speech Dereverberation

Hao Shi, Longbiao Wang, Meng Ge +2 more

Signal Processing · Tokyo Tech Research Repository (Tokyo Institute of Technology) · · cited 17× · DOI ↗ · more like this ·

Spectrograms fusion is an effective method for incorporating complementary speech dereverberation systems. Previous linear spectrograms fusion by averaging multiple spectrograms shows outstanding performance. However, various systems with different features cannot apply this simple method. In this study, we design the minimum difference masks (MDMs) to classify the time-frequency (T-F) bins in spectrograms according to the nearest distances from labels. Then, we propose a two-stage nonlinear spectrograms fusion system for speech dereverberation. First, we conduct a multitarget learning-based speech dereverberation front-end model to get spectrograms simultaneously. Then, MDMs are estimated to take the best parts of different spectrograms. We are using spectrograms in the first stage and MDMs in the second stage to recombine T-F bins. The experiments on the REVERB challenge show that a…

Iterative Sound Source Localization for Unknown Number of Sources

Yanjie Fu, Meng Ge, Haoran Yin +4 more

eess.AS · · cited 11× · arXiv ↗ · more like this ·

Sound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio. For the practical problem of unknown number of sources, existing localization algorithms attempt to predict a likelihood-based coding (i.e., spatial spectrum) and employ a pre-determined threshold to detect the source number and corresponding DOA value. However, these threshold-based algorithms are not stable since they are limited by the careful choice of threshold. To address this problem, we propose an iterative sound source localization approach called ISSL, which can iteratively extract each source's DOA without threshold until the termination criterion is met. Unlike threshold-based algorithms, ISSL designs an active source detector network based on binary classifier to accept residual spatial spectrum and decide whether to stop the iteration. By doing…

Selective HuBERT: Self-Supervised Pre-Training for Target Speaker in Clean and Mixture Speech

Jingru Lin, Meng Ge, Wupeng Wang +2 more

eess.AS · · cited 9× · arXiv ↗ · more like this ·

Self-supervised pre-trained speech models were shown effective for various downstream speech processing tasks. Since they are mainly pre-trained to map input speech to pseudo-labels, the resulting representations are only effective for the type of pre-train data used, either clean or mixture speech. With the idea of selective auditory attention, we propose a novel pre-training solution called Selective-HuBERT, or SHuBERT, which learns the selective extraction of target speech representations from either clean or mixture speech. Specifically, SHuBERT is trained to predict pseudo labels of a target speaker, conditioned on an enrolled speech from the target speaker. By doing so, SHuBERT is expected to selectively attend to the target speaker in a complex acoustic environment, thus benefiting various downstream tasks. We further introduce a dual-path training strategy and use the…

A Hybrid DCT-CLAHE Approach for Brightness Enhancement of Uneven-illumination Underwater Images

Meng Ge, Qingqing Hong, Lifeng Zhang

Computer Vision and Pattern Recognition · Institutional Repositories DataBase (IRDB) · · cited 9× · DOI ↗ · more like this ·

Underwater images have been drawing sufficient attentions, as more and more researchers and companies are committed to ocean engineering, underwater archaeology, mining etc in recent years. Underwater images often suffer from unbalanced illumination, which bring image analysis and processing challenges. This paper introduces a novel approach for underwater image enhancement based on the DCT coefficient and CLAHE algorithm. Image changes with operations on the statistical model of the image DCT coefficients. The proposed methods firstly perform brightness equalization of the image, which optimize the underexposed and overexposed regions by regulating the low-frequency part of the image DCT coefficients. Afterwards CLAHE is applied to achieve image contrast enhancement. Finally experiments shows the better image enhancement performance compared to other algorithms.

Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement

Junyu Wang, Zizhen Lin, Tianrui Wang +3 more

cs.SD · · cited 8× · arXiv ↗ · more like this ·

In recent speech enhancement (SE) research, transformer and its variants have emerged as the predominant methodologies. However, the quadratic complexity of the self-attention mechanism imposes certain limitations on practical deployment. Mamba, as a novel state-space model (SSM), has gained widespread application in natural language processing and computer vision due to its strong capabilities in modeling long sequences and relatively low computational complexity. In this work, we introduce Mamba-SEUNet, an innovative architecture that integrates Mamba with U-Net for SE tasks. By leveraging bidirectional Mamba to model forward and backward dependencies of speech signals at different resolutions, and incorporating skip connections to capture multi-scale information, our approach achieves state-of-the-art (SOTA) performance. Experimental results on the VCTK+DEMAND dataset indicate that…

Audio-Visual Active Speaker Extraction for Sparsely Overlapped Multi-talker Speech

Junjie Li, Ruijie Tao, Zexu Pan +3 more

cs.SD · · cited 8× · arXiv ↗ · more like this ·

Target speaker extraction aims to extract the speech of a specific speaker from a multi-talker mixture as specified by an auxiliary reference. Most studies focus on the scenario where the target speech is highly overlapped with the interfering speech. However, this scenario only accounts for a small percentage of real-world conversations. In this paper, we aim at the sparsely overlapped scenarios in which the auxiliary reference needs to perform two tasks simultaneously: detect the activity of the target speaker and disentangle the active speech from any interfering speech. We propose an audio-visual speaker extraction model named ActiveExtract, which leverages speaking activity from audio-visual active speaker detection (ASD). The ASD directly provides the frame-level activity of the target speaker, while its intermediate feature representation is trained to discriminate speech-lip…

USED: Universal Speaker Extraction and Diarization

Junyi Ao, Mehmet Sinan Yıldırım, Ruijie Tao +4 more

cs.SD · · cited 8× · arXiv ↗ · more like this ·

Speaker extraction and diarization are two enabling techniques for real-world speech applications. Speaker extraction aims to extract a target speaker's voice from a speech mixture, while speaker diarization demarcates speech segments by speaker, annotating `who spoke when'. Previous studies have typically treated the two tasks independently. In practical applications, it is more meaningful to have knowledge about `who spoke what and when', which is captured by the two tasks. The two tasks share a similar objective of disentangling speakers. Speaker extraction operates in the frequency domain, whereas diarization is in the temporal domain. It is logical to believe that speaker activities obtained from speaker diarization can benefit speaker extraction, while the extracted speech offers more accurate speaker activity detection than the speech mixture. In this paper, we propose a unified…

VCSE: Time-Domain Visual-Contextual Speaker Extraction Network

Junjie Li, Meng Ge, Zexu Pan +2 more

cs.CV · · cited 8× · arXiv ↗ · more like this ·

Speaker extraction seeks to extract the target speech in a multi-talker scenario given an auxiliary reference. Such reference can be auditory, i.e., a pre-recorded speech, visual, i.e., lip movements, or contextual, i.e., phonetic sequence. References in different modalities provide distinct and complementary information that could be fused to form top-down attention on the target speaker. Previous studies have introduced visual and contextual modalities in a single model. In this paper, we propose a two-stage time-domain visual-contextual speaker extraction network named VCSE, which incorporates visual and self-enrolled contextual cues stage by stage to take full advantage of every modality. In the first stage, we pre-extract a target speech with visual cues and estimate the underlying phonetic sequence. In the second stage, we refine the pre-extracted target speech with the…

GA-GGD: Improving semantic discriminability in graph contrastive learning via Generative Adversarial Network

Jitao Zhao, Dongxiao He, Meng Ge +4 more

Artificial Intelligence · Information Fusion · · cited 7× · DOI ↗ · more like this ·

Graph contrastive learning has garnered considerable research interest due to its ability to effectively embed graph data without manual labels. Among them, methods based on Deep Graph Infomax (DGI) have been widely studied and favored in the industry because of their fast training speed, applicability to large-scale data. DGI-based methods usually obtain a noise graph through node shuffling. The proxy task of these methods encourages the encoder to distinguish whether the nodes come from the original graph or the noise graph, thereby maximizing the mutual information between the node representation and the graph it belongs to, while also maximizing the Jenson–Shannon divergence between the nodes of original graph and noise graph. However, we argue that these approaches only enable the encoder to differentiate between semantically meaningful graphs and noise graphs, but not to…

Self-healing key management service for Mobile Ad hoc Networks

Meng Ge, Kwok‐Yan Lam

Computer Networks and Communications · · cited 7× · DOI ↗ · more like this ·

This paper presents a robust key management scheme for supporting the secure communication needs of emergency response operations. The proposed scheme aims to tolerate the dynamic nature of such operations where some system and network components may be damaged or redeployed frequently. mobile ad hoc network (MANET) is widely accepted to be a suitable approach to meet the communication needs of emergency response operations. Such operations tend to be carried out in an environment where existing infrastructures have been destroyed by natural disasters. Security is an important feature of the underlying command, control and communication (C3) systems of emergency response operations. Security functions almost invariably require the support of some key management services. Distributed CA (DCA) is one of the most important schemes to key management in MANET; however the key management…

Robust Voice Activity Detection Using a Masked Auditory Encoder Based Convolutional Neural Network

Nan Li, Longbiao Wang, Masashi Unoki +4 more

Signal Processing · Tokyo Tech Research Repository (Tokyo Institute of Technology) · · cited 6× · DOI ↗ · more like this ·

Voice activity detection (VAD) based on deep learning has achieved remarkable success. However, when the traditional features (e.g., raw waveforms and MFCCs) are directly fed to the deep neural network model, the performance decreases because of noise interference. Here, we propose a robust VAD approach using a masked auditory encoder based convolutional neural network (M-AECNN). First, we analyze the effectiveness of using auditory features as deep learning encoder. These features can roughly simulate the transmission of sound to human inner-ear hair cells; thus, they are more robust than the raw waveform and frequency domain features designed as encoders. Second, similar to the human ear’s masking effect for different speech frequencies, the proposed auditory encoder can further improve the robustness of VAD by increasing the gain for cleaner speech frequencies. Extensive experimental…

A Reinforcement-Learning-Based Bus Scheduling Model

Meng Xiao, Jianbing Xiahou, Meng Ge

Transportation · 2022 IEEE 10th Joint International Information Technology and Artificial Intelligence Conference (ITAIC) · · cited 5× · DOI ↗ · more like this ·

The fixed departure time set in the traditional public transit system often can not meet the needs of passengers in different time slot. Due to the uneven distribution of regional passenger flow in different time slot, there are usually vehicle congestion or a large number of seat vacancies in the process of bus operation. These phenomena lead to the bus companies can not control the operation cost well, and the passengers can not enjoy higher service quality. This paper proposes a bus scheduling model based on reinforcement learning, which effectively relieve the traffic pressure of the city.

[Retracted] Recognition and Detection Methods of Artificial Intelligence in Computer Network Faults under the Background of Big Data

Meng Ge

Artificial Intelligence · Wireless Communications and Mobile Computing · · cited 5× · DOI ↗ · more like this ·

With the widespread use of computers and the rapid development of Internet technology, computer application technology has become more and more important in people’s work and life. The article mainly studies particle swarm optimization (PSO) and radial basis neural network function (RBF). Particle swarm optimization is an evolutionary swarm intelligence algorithm, such as nonderivative node transfer function or gradient information loss. Because its principle is simple and easy to implement, it can deal with some problems that cannot be solved by traditional methods. It is widely used in neural networks, and has achieved good results in many fields such as network training, performance optimization, and system mismanagement. RBF neural network is a feedforward neural network, which overcomes the shortcomings of traditional neural network learning process that the convergence is highly…

Adaptive Attention Network with Domain Adversarial Training for Multi-Accent Speech Recognition

Yanbing Yang, Hao Shi, Yuqin Lin +4 more

Artificial Intelligence · 2022 13th International Symposium on Chinese Spoken Language Processing (ISCSLP) · · cited 4× · DOI ↗ · more like this ·

Spoken accents severely degrade the performance of automatic speech recognition (ASR) systems. Domain adversarial training (DAT) is widely adopted for generating domain-invariant features to reduce the influence of accents. However, the generated features trained by DAT are still maintaining some accent discrimination information, limiting the ASR performance. In addition, the features generated by DAT of each accent have different degrees of residual accent discriminant information. In this paper, we propose an adaptive attention network with DAT to further eliminate the influence of retaining accent information in features generated by DAT. We employ the adaptive attention module to transform the encoder output to a more general representation. Experiments on the AESRC2020 dataset show that the proposed method can achieve satisfactory performance improvements on seen and unseen accent…