arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Shaoxiang Dang

7 papers · 2022–2026

2022: 12023: 02024: 42025: 12026: 1
2022peak 4 in 20242026

Frequent co-authors

Papers

showing 1–7 of 7 RSS

U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation

Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi +1 more

cs.SD · · cited 4× · arXiv ↗ · more like this ·

The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated rapidly over time. However, the size and computational load of these models have also increased accordingly. This is a disaster for the community, as researchers need more time and computational resources to reproduce and compare existing models. In this paper, we propose U-mamba-net: a lightweight Mamba-based U-style model for speech separation in complex environments. Mamba is a state space sequence model that incorporates feature selection capabilities. U-style network is a fully convolutional neural network whose symmetric contracting and expansive paths are able to learn multi-resolution features. In our work, Mamba serves as a feature filter…

A Separation Priority Pipeline for Single-Channel Speech Separation in Noisy Environments

Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi +1 more

Signal Processing · · cited 4× · DOI ↗ · more like this ·

The research topic of speech separation is dedicated to addressing the issues associated with the separation of overlapping speeches, and it becomes more challenging when mixed speeches take place in noisy environments. The main pipeline so far consists of a first-place enhancement module and a following-up separation module, and some may further employ a so-called gradient modulation technique to solve the conflict that may exist during optimizing multitask of enhancement and separation. In this work, we conceive a hypothesis that separation-sensitive information might be erased during the enhancement module in traditional pipelines, and we propose a separation priority pipeline (SPP) to verify it. Furthermore, this work also provides an independent encoders and decoders scheme (IEDS) which is able to mitigate gradient conflict. According to our experiments, we found the effectiveness…

In-Context Learning for Robots: Methods and Applications

Haojian Huang, Zexi Li, Junhao Guo +36 more

cs.RO · · cited 2× · arXiv ↗ · more like this ·

General-purpose robots must infer what a new task requires and translate that understanding into appropriate physical action. In-context learning (ICL) for robots supports this process by using demonstrations and interaction to direct existing competence with neural parameters held fixed during deployment. We organize this literature review around the interfaces connecting contextual evidence to execution, distinguishing four families: context-conditioned policies, geometric demonstration transfer, world-model-based control, and skill- and agent-based execution. Comparing these interfaces clarifies their transfer assumptions and the roles of training, correspondence, and memory in making context useful. Across manipulation and navigation, we examine how these mechanisms preserve taught requirements as objects, environments, and execution conditions change. This analysis links method…

A comprehensive study on supervised single-channel noisy speech separation with multi-task learning

Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi +1 more

Signal Processing · Speech Communication · · cited 1× · DOI ↗ · more like this ·

This research presents a comprehensive investigation and comparison of noisy speech separation methods using multi-task learning. First, we categorize all methods into two pipelines: enhancement priority pipeline (EPP) and separation priority pipeline (SPP), based on whether prioritizing enhancement or separation. Next, we classify each pipeline into shared encoder–decoder scheme (SEDS) and independent encoder–decoder scheme (IEDS), depending on whether the two modules share the same encoder and decoder. Additionally, we introduce two types of intermediate structures between the two modules. One structure uses time–frequency (T–F) representations, while the other uses T–F masks. This article elaborates on the strengths and weaknesses of each approach, particularly in mitigating over-suppression and improving computational efficiency. Our experiments show substantial improvements in SPP…

Improved Speech Separation Performance from Monaural Mixed Speech Based on Deep Embedding Network

Shaoxiang Dang, Tetsuya Matsumoto, Hiroaki Kudo +1 more

Signal Processing · IEEJ Transactions on Electronics Information and Systems · · cited 1× · DOI ↗ · more like this ·

Speech separation refers to the separation of mixed utterances in which multiple people are speaking simultaneously. This topic was created to address the cocktail party problem, and it has also evolved into a front-end procedure for speech-related research recently. There are two types of models for addressing it: classification methods and regression methods. Classification methods avoid considering the permutation problem, and regression methods are more precise. Deep clustering (DC) is a common deep learning classification technique that uses a deep embedding network to embed signals in the underlying manifold and allows signals with similar properties to cluster together in the embedded space. The ideal binary mask (IBM) supervises the model. Even if it is entirely isolated via supervised binary masking, this setting is susceptible to mistake. To remedy this flaw, this paper…

Improving DF-Conformer Using Hydra For High-Fidelity Generative Speech Enhancement on Discrete Codec Token

Shogo Seki, Shaoxiang Dang, Li Li

cs.SD · · arXiv ↗ · more like this ·

The Dilated FAVOR Conformer (DF-Conformer) is an efficient variant of the Conformer architecture designed for speech enhancement (SE). It employs fast attention through positive orthogonal random features (FAVOR+) to mitigate the quadratic complexity associated with self-attention, while utilizing dilated convolution to expand the receptive field. This combination results in impressive performance across various SE models. In this paper, we propose replacing FAVOR+ with bidirectional selective structured state-space sequence models to achieve two main objectives:(1) enhancing global sequential modeling by eliminating the approximations inherent in FAVOR+, and (2) maintaining linear complexity relative to the sequence length. Specifically, we utilize Hydra, a bidirectional extension of Mamba, framed within the structured matrix mixer framework. Experiments conducted using a generative SE…

Developing vocal system impaired patient-aimed voice quality assessment approach using ASR representation-included multiple features

Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi +7 more

cs.SD · · arXiv ↗ · more like this ·

The potential of deep learning in clinical speech processing is immense, yet the hurdles of limited and imbalanced clinical data samples loom large. This article addresses these challenges by showcasing the utilization of automatic speech recognition and self-supervised learning representations, pre-trained on extensive datasets of normal speech. This innovative approach aims to estimate voice quality of patients with impaired vocal systems. Experiments involve checks on PVQD dataset, covering various causes of vocal system damage in English, and a Japanese dataset focusing on patients with Parkinson's disease before and after undergoing subthalamic nucleus deep brain stimulation (STN-DBS) surgery. The results on PVQD reveal a notable correlation (>0.8 on PCC) and an extraordinary accuracy (<0.5 on MSE) in predicting Grade, Breathy, and Asthenic indicators. Meanwhile, progress has been…