arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

HartantoRoland

2 papers · 2025–2025

2025: 2
2025peak 2 in 20252025

Frequent co-authors

Papers

showing 1–2 of 2 RSS

SepVAC: Multitask Learning of Speaker Separation, Speaker Localization, Microphone Array Localization, and Room Acoustic Parameter Estimation in Various Acoustic Conditions

HartantoRoland, Roland Hartanto, Sakti +3 more

Signal Processing · Tokyo Tech Research Repository (Tokyo Institute of Technology) · · cited 0× · OpenAlex ↗ · more like this ·

This paper proposes a multitask learning method for speech separation, that Separates speech and estimates the recording conditions in Various Acoustic Conditions (SepVAC) jointly. Unlike the previous methods that aim to achieve robustness against the uncertainty caused by noise and reverberation, this method explicitly estimates speaker & microphone location and room acoustic parameters to disambiguate them from speech features. We introduce curriculum learning to learn the model parameters stably. In our evaluation using SMS-WSJ-Plus dataset, it outperforms the state-of-the-art SpatialNet baseline by 0.67 points in word error rate (WER).

Multitask Training of Multi-channel Speaker Separation and Room Acoustic Parameter Estimation

HartantoRoland, Roland Hartanto, Sakriani Sakti +2 more

Signal Processing · Tokyo Tech Research Repository (Tokyo Institute of Technology) · · cited 0× · OpenAlex ↗ · more like this ·

Speaker separation focuses on extracting individual speech signals from a speech mixture. It is applied for single and multi-channel front-end speech processing to deal with overlapping speech. Multichannel separation leverages spectral and spatial information of speakers, improving separation. Deep learning methods for multi-channel speech separation have been widely explored. Permutation Invariant Training (PIT) is an approach for training speech separation models, minimizing separation loss across all possible output-target pair permutations. Other studies show that using location information can help improve separation. For example, Location-Based Training (LBT) leverages the direction-of-arrival (DoA) of speakers to organize target speech based on their DoA for loss computation and performs better than PIT. MSDET performs multitask learning of speaker separation and DoA estimation…