Author

Houjun Huang

17 papers · 2013–2022

2013peak 4 in 20172022

Frequent co-authors

Papers

showing 1–17 of 17 RSS

Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition

Xu Xiang, Shuai Wang, Houjun Huang +2 more

eess.AS · 18 Jun 2019 · cited 167× · arXiv ↗ · more like this ·

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy loss with softmax. However, this kind of loss function does not explicitly encourage inter-class separability and intra-class compactness. As a result, the embeddings are not optimal for speaker recognition tasks. In this paper, to address this issue, three different margin based losses which not only separate classes but also demand a fixed margin between classes are introduced to deep speaker embedding learning. It could be demonstrated that the margin is the key to obtain more discriminative speaker embeddings. Experiments are conducted on two public text independent tasks: VoxCeleb1 and Speaker in The Wild (SITW). The proposed approach can…

DeepVein: Novel finger vein verification methods based on Deep Convolutional Neural Networks

Houjun Huang, Shilei Liu, Zheng He +3 more

Signal Processing · February 2017 · cited 53× · DOI ↗ · more like this ·

Finger vein verification is using vein patterns to verify a person's identity, which is widely used in various fields. In practice, the method for verification is the most important part of a biometric system, which determines the reliability of the system. In this paper, we propose methods called DeepVein for finger vein verification based on deep convolutional neural networks and conduct experiments to evaluate our methods. The experimental results show that our proposed methods can achieve state-of-the-art performance in accuracy. In addition, we present how the amount of data for training affects the accuracy in the test datasets.

AISPEECH-SJTU accent identification system for the Accented English Speech Recognition Challenge

Houjun Huang, Xu Xiang, Yexin Yang +2 more

cs.SD · 19 Feb 2021 · cited 29× · arXiv ↗ · more like this ·

This paper describes the AISpeech-SJTU system for the accent identification track of the Interspeech-2020 Accented English Speech Recognition Challenge. In this challenge track, only 160-hour accented English data collected from 8 countries and the auxiliary Librispeech dataset are provided for training. To build an accurate and robust accent identification system, we explore the whole system pipeline in detail. First, we introduce the ASR based phone posteriorgram (PPG) feature to accent identification and verify its efficacy. Then, a novel TTS based approach is carefully designed to augment the very limited accent training data for the first time. Finally, we propose the test time augmentation and embedding fusion schemes to further improve the system performance. Our final system is ranked first in the challenge and outperforms all the other participants by a large margin. The…

Unit selection synthesis based data augmentation for fixed phrase speaker verification

Houjun Huang, Xu Xiang, Fei Zhao +2 more

cs.SD · 19 Feb 2021 · cited 9× · arXiv ↗ · more like this ·

Data augmentation is commonly used to help build a robust speaker verification system, especially in limited-resource case. However, conventional data augmentation methods usually focus on the diversity of acoustic environment, leaving the lexicon variation neglected. For text dependent speaker verification tasks, it's well-known that preparing training data with the target transcript is the most effectual approach to build a well-performing system, however collecting such data is time-consuming and expensive. In this work, we propose a unit selection synthesis based data augmentation method to leverage the abundant text-independent data resources. In this approach text-independent speeches of each speaker are firstly broke up to speech segments each contains one phone unit. Then segments that contain phonetics in the target transcript are selected to produce a speech with the target…

Botzone

Haoyu Zhou, Yushan Zhou, Haifeng Zhang +2 more

Artificial Intelligence · 8 May 2017 · cited 7× · DOI ↗ · more like this ·

This paper presents Botzone, a competitive and interactive platform for game AI education, aiming to simplify the teaching process of game AI courses and inspire self-study AI learners. Botzone is a universal online game AI platform, designed to evaluate different implementations of game AI by applying them to agents in a variety of games and compete with each other. It has been successfully used in various AI competition and courses in practice, and has the expandability to support more games and languages, as well as further usages such as researching machine learning on game AI. In this paper, we describe the structure and features of Botzone, and provide case studies of instances of applications.

Voice biometrics using linear Gaussian model

Hai Yang, Yunfei Xu, Houjun Huang +2 more

Artificial Intelligence · IET Biometrics · 19 Aug 2013 · cited 5× · DOI ↗ · more like this ·

This study introduces a linear Gaussian model‐based framework for voice biometrics. The model works with discrete‐time linear dynamical systems. The study motivation is to use the linear Gaussian modelling method in voice biometrics, and show that the accuracy offered by the linear Gaussian modelling method is comparable with other state‐of‐the‐art methods such as Probabilistic Linear Discriminant Analysis and two‐covariance model. An expectation–maximisation algorithm is derived to train the model and a Bayesian solution is used to calculate the log‐likelihood ratio score of all trials of speakers. This approach performed well on the core‐extended conditions of the NIST 2010 Speaker Recognition Evaluation, and is competitive compared with the Gaussian probabilistic linear discriminant analysis, in terms of normalised decision cost function.

SJTU-AISPEECH System for VoxCeleb Speaker Recognition Challenge 2022

Zhengyang Chen, Bing Han, Xu Xiang +3 more

cs.SD · 20 Sep 2022 · cited 4× · arXiv ↗ · more like this ·

This report describes the SJTU-AISPEECH system for the Voxceleb Speaker Recognition Challenge 2022. For track1, we implemented two kinds of systems, the online system and the offline system. Different ResNet-based backbones and loss functions are explored. Our final fusion system achieved 3rd place in track1. For track3, we implemented statistic adaptation and jointly training based domain adaptation. In the jointly training based domain adaptation, we jointly trained the source and target domain dataset with different training objectives to do the domain adaptation. We explored two different training objectives for target domain data, self-supervised learning based angular proto-typical loss and semi-supervised learning based classification loss with estimated pseudo labels. Besides, we used the dynamic loss-gate and label correction (DLG-LC) strategy to improve the quality of pseudo…

Speaking style compensation on synthetic audio for robust keyword spotting

Houjun Huang, BYanmin Qian

Artificial Intelligence · 2022 13th International Symposium on Chinese Spoken Language Processing (ISCSLP) · 11 Dec 2022 · cited 3× · DOI ↗ · more like this ·

With the rise of intelligent speech processing applications, quickly producing keyword spotting (KWS) models with low resource has gained particular importance in recent years. Multi-speaker text-to-speech (TTS) has been proved to be an effective data augmentation technique for KWS to help complement inadequacies in the training data. However, in previous works, KWS system built with TTS augmented data couldn’t obtain considerable performance of that trained with real recordings as synthetic speeches could not fully represent target speaker’s speaking style. This work focuses on how to make synthesized speeches to be more similar to reference speaker’s speaking style under a specific metric. Speaker classification accuracy of synthesized keyword data on a speaker recognition model trained with real common recordings is used as the objective metrics, and the deep complex convolution…

ICFVR 2017: 3rd International Competition on Finger Vein Recognition

Yi Zhang, Houjun Huang, Haifeng Zhang +8 more

cs.CV · 4 Jan 2018 · cited 3× · arXiv ↗ · more like this ·

In recent years, finger vein recognition has become an important sub-field in biometrics and been applied to real-world applications. The development of finger vein recognition algorithms heavily depends on large-scale real-world data sets. In order to motivate research on finger vein recognition, we released the largest finger vein data set up to now and hold finger vein recognition competitions based on our data set every year. In 2017, International Competition on Finger Vein Recognition(ICFVR) is held jointly with IJCB 2017. 11 teams registered and 10 of them joined the final evaluation. The winner of this year dramatically improved the EER from 2.64% to 0.483% compared to the winner of last year. In this paper, we introduce the process and results of ICFVR 2017 and give insights on development of state-of-art finger vein recognition algorithms.

Parameter adjustment of finger vein recognition algorithms

Zheng He, Yapeng Ye, Shilei Liu +4 more

Signal Processing · February 2017 · cited 3× · DOI ↗ · more like this ·

Finger vein recognition is a biometric method utilizing the vein patterns inside one's fingers for personal identification. Recognition algorithm is the key part of a finger vein recognition system, dominating the system performance. There are usually a lot of parameters in algorithms, and different values of the parameters could lead to different system performance so that it is essential to set a proper value for each parameter in practice. In this paper, we conduct a set of experiments to study how the parameters influence the performance measured by equal error rate. We have made two observations from the results: 1.When an algorithm is applied on a dataset, the performance differs a lot as the parameter value changes even in a small range; 2.When an algorithm is applied on different datasets, the performance differs a lot, in other words, the optimized parameter value combination…

Robust speaker recognition using library of cross‐domain variation compensation transforms

Houjun Huang, Shengyu Yao, Ruohua Zhou +1 more

Artificial Intelligence · Electronics Letters · 7 Jan 2016 · cited 3× · DOI ↗ · more like this ·

Although the state‐of‐the‐art i‐vector‐based probabilistic linear discriminant analysis systems resulted in promising performances in the National Institute of Standards and Technology speaker recognition evaluations, the impact of domain mismatch when the system development data and the evaluation data are collected from different sources remains a challenging problem. This issue was a focus of the Johns Hopkins University 2013 speaker recognition workshop where a domain adaptation challenge (DAC13) corpus was created to address it. The cross‐domain variation compensation (CDVC) approach has been recently proposed to address it when in‐domain development data are available. The work reported by the present authors addresses this issue when in‐domain development data are unavailable using a library of CDVC transforms. This approach is evaluated on the DAC13 corpus and is shown to be…

Text-dependent Speaker Verification Using Word-based Scoring

Shengyu Yao, Houjun Huang, Ruohua Zhou +1 more

Artificial Intelligence · November 2018 · cited 2× · DOI ↗ · more like this ·

As the separated modeling methods are widely used in text-dependent speaker verification task. The reason why they are so effective is discussed in this paper. A word-based scoring method is then proposed based on our discussion. Specifically, a segmentation algorithm is firstly used for segmenting the enrollment and test utterances into words, automatically. Then every segment of the enrollment utterance is used to enroll a word based speaker model. Scoring is done with each testing segment and a corresponding word-based speaker model of the same word. The experiments are carried out on a short duration text-dependent speaker verification database in Chinese spoken language. Our examples show that, systems based on word-based scoring method are superior to the relevance MAP GMM-UBM system and achieve significant performance improvement.

Cross‐domain variation compensation for robust speaker verification

Houjun Huang, Ruohua Zhou, Yonghong Yan

Artificial Intelligence · Electronics Letters · October 2015 · cited 2× · DOI ↗ · more like this ·

Recent studies have shown that when state‐of‐the‐art probabilistic linear discriminant analysis (PLDA) speaker verification systems are developed with out‐domain data, the mismatch between development data and evaluation data significantly degrades speaker verification performance. An unsupervised cross‐domain variation compensation (CDVC) approach to compensate the domain mismatch is proposed. This approach is based on the assumption that the inter‐domain variability is an additive factor with normal distribution in the i ‐vector space. The effect of the approach on the domain adaption challenge of the JHU 2013 speaker recognition workshop is tested. Applying the CDVC approach on evaluation i ‐vectors, the out‐domain PLDA system achieves a relative performance improvement of 61.9% in equal error rate.

Feature recovery for noise‐robust speaker verification

Houjun Huang, Yunfei Xu, Ruohua Zhou +1 more

Signal Processing · Electronics Letters · 13 Aug 2015 · cited 2× · DOI ↗ · more like this ·

Noisy condition is an important extrinsic degradation affecting speaker verification system performance. A feature‐recovery approach is proposed to eliminate noise‐dependent variability in feature space. A frame of the noisy feature vector is recovered using the information of itself and the neighbour feature vectors. Experiments are conducted on noisy test sets for text‐dependent speaker verification tasks and the results indicate that the system can achieve significant performance improvement by using recovered feature vectors.

A Decision Reliability Ratio Based Fusion Scheme for Biometric Verification

Liao Ni, Yi Zhang, Shilei Liu +2 more

Signal Processing · 14 May 2017 · cited 1× · DOI ↗ · more like this ·

Unimodal biometric verification has developed a lot and become more accurate, but there is still not a perfect algorithm. In the meantime, cases exist where unimodal verification system could not meet the requirements in practical use. It is proved that algorithms with the same overall accuracy may have different misclassified patterns. We could make use of this complementation to fuse individual algorithms together for more precise result. According to our observation, algorithm has different confidence on its decisions but this is seldom considered in fusion methods. Our work focuses on this confidence. We first define decision reliability ratio to quantify this confidence, and then propose the Maximum Decision Reliability Ratio (MDRR) fusion scheme incorporating Weighted Voting. Two experiments conducted on different datasets prove the effectiveness of the method. One is to fuse 4…

Build a SRE Challenge System: Lessons from VoxSRC 2022 and CNSRC 2022

Zhengyang Chen, Bing Han, Xu Xiang +3 more

cs.SD · November 2022 · cited 0× · arXiv ↗ · more like this ·

Many speaker recognition challenges have been held to assess the speaker verification system in the wild and probe the performance limit. Voxceleb Speaker Recognition Challenge (VoxSRC), based on the voxceleb, is the most popular. Besides, another challenge called CN-Celeb Speaker Recognition Challenge (CNSRC) is also held this year, which is based on the Chinese celebrity multi-genre dataset CN-Celeb. This year, our team participated in both speaker verification closed tracks in CNSRC 2022 and VoxSRC 2022, and achieved the 1st place and 3rd place respectively. In most system reports, the authors usually only provide a description of their systems but lack an effective analysis of their methods. In this paper, we will outline how to build a strong speaker verification challenge system and give a detailed analysis of each method compared with some other popular technical means.

A Fusion Method Based on Decision Reliability Ratio for Finger Vein Verification

Liao Ni, Yi Zhang, He Zheng +3 more

cs.CV · 17 Dec 2016 · cited 0× · arXiv ↗ · more like this ·

Finger vein verification has developed a lot since its first proposal, but there is still not a perfect algorithm. It is proved that algorithms with the same overall accuracy may have different misclassified patterns. We could make use of this complementation to fuse individual algorithms together for more precise result. According to our observation, algorithm has different confidence on its decisions but it is seldom considered in fusion methods. Our work is first to define decision reliability ratio to quantify this confidence, and then propose the Maximum Decision Reliability Ratio (MDRR) fusion method incorporating Weighted Voting. Experiment conducted on a data set of 1000 fingers and 5 images per finger proves the effectiveness of the method. The classifier obtained by MDRR method gets an accuracy of 99.42% while the maximum accuracy of the original individual classifiers is…