arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jichen Yang

98 papers · 2009–2026

2009: 22010: 12011: 22012: 42013: 32014: 62015: 42016: 52017: 32018: 32019: 122020: 132021: 72022: 62023: 92024: 82025: 72026: 3
2009peak 13 in 20202026

Frequent co-authors

Papers

showing 1–25 of 98 RSS

Segment Anything Model for Medical Image Analysis: an Experimental Study

Maciej A. Mazurowski, Haoyu Dong, Hanxue Gu +3 more

cs.CV · · cited 880× · arXiv ↗ · more like this ·

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest in an interactive manner. While the performance on natural images is impressive, medical image domains pose their own set of challenges. Here, we perform an extensive evaluation of SAM's ability to segment medical images on a collection of 19 medical imaging datasets from various modalities and anatomies. We report the following findings: (1) SAM's performance based on single prompts highly varies depending on the dataset and the task, from IoU=0.1135 for spine MRI to IoU=0.8650 for hip X-ray. (2) Segmentation performance appears to be better for well-circumscribed objects with prompts with less ambiguity and poorer in various other scenarios such as…

Forced oscillation of nonlinear fractional differential equations with damping term

Jichen Yang, Anping Liu, Ting Liu

Applied Mathematics · Advances in Difference Equations · · cited 275× · DOI ↗ · more like this ·

Advances in Continuous and Discrete Models: Theory and Modern Applications is a peer-reviewed open access journal published under the brand SpringerOpen. Computational and applied mathematics along with data science play a vital role in contemporary society by driving innovation. This success can be attributed to revolutionary theoretical and algorithmic developments in machine learning, data driven modeling, differential equations, numerical analysis, scientific computing, control, optimization, and computing resources together with new tools to deal with uncertainty and randomness. This journal encourages new research in these broad areas. In addition to research on algorithmic and analytical developments, the journal also encourages papers related to (but not limited to) broad applications in Signal and Image Processing, Computer Vision, Materials Science, Mathematical Biology and…

Light Convolutional Neural Network with Feature Genuinization for Detection of Synthetic Speech Attacks

Zhenzong Wu, Rohan Kumar Das, Jichen Yang +1 more

eess.AS · · cited 134× · arXiv ↗ · more like this ·

Modern text-to-speech (TTS) and voice conversion (VC) systems produce natural sounding speech that questions the security of automatic speaker verification (ASV). This makes detection of such synthetic speech very important to safeguard ASV systems from unauthorized access. Most of the existing spoofing countermeasures perform well when the nature of the attacks is made known to the system during training. However, their performance degrades in face of unseen nature of attacks. In comparison to the synthetic speech created by a wide range of TTS and VC methods, genuine speech has a more consistent distribution. We believe that the difference between the distribution of synthetic and genuine speech is an important discriminative feature between the two classes. In this regard, we propose a novel method referred to as feature genuinization that learns a transformer with convolutional…

Multi-modal Attention for Speech Emotion Recognition

Zexu Pan, Zhaojie Luo, Jichen Yang +1 more

eess.AS · · cited 97× · arXiv ↗ · more like this ·

Emotion represents an essential aspect of human speech that is manifested in speech prosody. Speech, visual, and textual cues are complementary in human communication. In this paper, we study a hybrid fusion method, referred to as multi-modal attention network (MMAN) to make use of visual and textual cues in speech emotion recognition. We propose a novel multi-modal attention mechanism, cLSTM-MMA, which facilitates the attention across three modalities and selectively fuse the information. cLSTM-MMA is fused with other uni-modal sub-networks in the late fusion. The experiments show that speech emotion recognition benefits significantly from visual and textual cues, and the proposed cLSTM-MMA alone is as competitive as other fusion methods in terms of accuracy, but with a much more compact network structure. The proposed hybrid network MMAN achieves state-of-the-art performance on…

Significance of Subband Features for Synthetic Speech Detection

Jichen Yang, Rohan Kumar Das, Haizhou Li

Artificial Intelligence · IEEE Transactions on Information Forensics and Security · · cited 75× · DOI ↗ · more like this ·

In text-to-speech or voice conversion based synthetic speech detection, it is a common practice that spectral information over the entire frequency band is used for feature representation. We propose a new method, referred to as subband transform, that characterizes the signals by subband. It is found that subband transform captures the artifacts in synthetic speech more effectively than full band transform. We propose equal subband transform, octave subband transform, and mel subband transform for three novel features, namely, constant-Q equal subband transform (CQ-EST), constant-Q octave subband transform (CQ-OST) and discrete Fourier mel subband transform (DF-MST). We evaluate the three features on the ASVspoof 2015, noisy ASVspoof 2015 and ASVspoof 2019 logical access corpora. The experiments show that the proposed CQ-EST feature achieves an average equal error rate of 0.056% on…

Long Range Acoustic and Deep Features Perspective on ASVspoof 2019

Rohan Kumar Das, Jichen Yang, Haizhou Li

Artificial Intelligence · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · · cited 67× · DOI ↗ · more like this ·

To secure automatic speaker verification (ASV) systems from intruders, robust countermeasures for spoofing attack detection are required. The ASVspoof series of challenge provides a shared anti-spoofing task. The recent edition, ASVspoof 2019, focuses on attacks by both synthetic and replay speech that are referred to as logical and physical access attacks, respectively. In the ASVspoof 2019 submission, we considered novel countermeasures based on long range acoustic features, that are unique in many ways as they are derived using octave power spectrum and subbands, as opposed to the commonly used linear power spectrum. During the post-challenge study, we further investigate the use of deep features that enhances the discriminative ability between genuine and spoofed speech. In this paper, we summarize the findings from the perspective of long range acoustic and deep features for spoof…

How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model

Hanxue Gu, Haoyu Dong, Jichen Yang +1 more

cs.CV · · cited 63× · arXiv ↗ · more like this ·

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for some time, the foundation model developed with image segmentation in mind - Segment Anything Model (SAM) - has been developed only recently and has shown similar promise. However, there are still no systematic analyses or "best-practice" guidelines for optimal fine-tuning of SAM for medical image segmentation. This work summarizes existing fine-tuning strategies with various backbone architectures, model components, and fine-tuning algorithms across 18 combinations, and evaluates them on 17 datasets covering all common radiology modalities. Our study reveals that (1) fine-tuning SAM leads to slightly better performance than previous segmentation methods…

Modified Magnitude-Phase Spectrum Information for Spoofing Detection

Jichen Yang, Hongji Wang, Rohan Kumar Das +1 more

Artificial Intelligence · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 52× · DOI ↗ · more like this ·

Most of the existing feature representations for spoofing countermeasures consider information either from the magnitude or phase spectrum. We hypothesize that both magnitude and phase spectra can be beneficial for spoofing detection (SD) when collectively used to capture the signal artifacts. In this work, we propose a novel feature referred to as modified magnitude-phase spectrum (MMPS) to capture both magnitude and phase information from the speech signal. The constant-Q transform is used to obtain the magnitude and phase information in terms of MMPS, which can be denoted as CQT-MMPS. We then use this information for the proposal of a handcrafted feature, namely, constant-Q modified octave coefficients (CQMOC). To evaluate the proposed CQT-MMPS and CQMOC features, three classic anti-spoofing models are adopted, including the Gaussian mixture model (GMM), the light CNN (LCNN) and the…

Extraction of Octave Spectra Information for Spoofing Attack Detection

Jichen Yang, Rohan Kumar Das, Nina Zhou

Artificial Intelligence · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 51× · DOI ↗ · more like this ·

This article focuses on extracting information from the octave power spectra of long-term constant-Q transform (CQT) for spoofing attack detection. A novel framework based on multi-level transform (MLT) is proposed that can capture the relevant information from octave power spectra using level by level in a multi-level manner. We then derive a novel feature referred to as constant-Q multi-level coefficient (CMC) based on proposed MLT. The proposed feature is evaluated on synthetic as well as replay speech detection studies on ASVspoof 2015 and ASVspoof 2017 version 2.0 database, respectively. We find the proposed CMC feature outperforms the conventional constant-Q cepstral coefficient based long-term feature obtained from linear power spectrum after uniform resampling. This depicts the usefulness of MLT to extract salient artifacts from octave power spectrum. Further, the proposed CMC…

Extended Constant-Q Cepstral Coefficients for Detection of Spoofing Attacks

Jichen Yang, Rohan Kumar Das, Haizhou Li

Artificial Intelligence · · cited 49× · DOI ↗ · more like this ·

The constant-Q cepstral coefficients (CQCC) feature is one of the most effective feature in the field of spoof speech detection. The extraction of this feature involves constant-Q transform that captures long range information from the signal. It is followed by uniform resampling of the octave power spectrum to have linear power spectrum from which the CQCC features are obtained. However, we hypothesize that the information obtained from octave power spectrum is complementary with that captured by the linear spectrum. In this regard, we propose to combine the coefficients generated using both linear and octave power spectrum. The combined feature is referred to as extended CQCC (eCQCC) which is hypothesized to have better discriminative information for detection of spoof attacks. The studies for spoof detection are conducted on both synthetic voice and replay based spoofing attacks…

Assessing the Scope of Generalized Countermeasures for Anti-Spoofing

Rohan Kumar Das, Jichen Yang, Haizhou Li

Computer Vision and Pattern Recognition · · cited 43× · DOI ↗ · more like this ·

Most of the research on anti-spoofing countermeasures are specific to a type of spoofing attacks, where models are trained on data of a particular nature, either synthetic or replay. However, one does not have such leverage as there is no prior knowledge about the kind of spoofing attack in practice. Therefore, there is a requirement to assess the scope of generalized countermeasures for anti-spoofing. The ASVspoof 2019 challenge covers both synthetic as well as replay attacks, which makes the database suitable for such study. In this work, we consider widely popular constant-Q cepstral coefficient features along with two other promising front-ends that capture long-term signal characteristics to assess their scope as generalized countermeasures. Additionally, a comprehensive study is made across different editions of ASVspoof corpora to highlight the need of robust generalized…

Data Augmentation with Signal Companding for Detection of Logical Access Attacks

Rohan Kumar Das, Jichen Yang, Haizhou Li

eess.AS · · cited 39× · arXiv ↗ · more like this ·

The recent advances in voice conversion (VC) and text-to-speech (TTS) make it possible to produce natural sounding speech that poses threat to automatic speaker verification (ASV) systems. To this end, research on spoofing countermeasures has gained attention to protect ASV systems from such attacks. While the advanced spoofing countermeasures are able to detect known nature of spoofing attacks, they are not that effective under unknown attacks. In this work, we propose a novel data augmentation technique using a-law and mu-law based signal companding. We believe that the proposed method has an edge over traditional data augmentation by adding small perturbation or quantization noise. The studies are conducted on ASVspoof 2019 logical access corpus using light convolutional neural network based system. We find that the proposed data augmentation technique based on signal companding…

DIGRE: Drug‐Induced Genomic Residual Effect Model for Successful Prediction of Multidrug Effects

Jichen Yang, Jing Tang, Yunguo Li +5 more

Computational Theory and Mathematics · CPT Pharmacometrics & Systems Pharmacology · · cited 39× · DOI ↗ · more like this ·

Multidrug regimens are a promising strategy for improving therapeutic efficacy and reducing side effects, especially for complex disorders such as cancer. However, the use of multidrug therapies is very challenging, due to a lack of understanding of the mechanisms of drug interactions. We herein present a novel computational approach-Drug-Induced Genomic Residual Effect (DIGRE) Computational Model-to predict drug combination effects by explicitly modeling drug response curves and gene expression changes after drug treatments. The prediction performance of DIGRE was evaluated using two datasets: (i) OCI-LY3 B-lymphoma cells treated with 14 different drugs and (ii) MCF breast cancer cells treated with combinations of gefitinib and docetaxel at different doses. In both datasets, the predicted drug combination effects significantly correlated with the experimental results. The results…

Exploiting Morphological and Phonological Features to Improve Prosodic Phrasing for Mongolian Speech Synthesis

Rui Liu, Berrak Şişman, Feilong Bao +3 more

Artificial Intelligence · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 33× · DOI ↗ · more like this ·

Prosodic phrasing is an important factor that affects naturalness and intelligibility in text-to-speech synthesis. Studies show that deep learning techniques improve prosodic phrasing when large text and speech corpus are available. However, for low-resource languages, such as Mongolian, prosodic phrasing remains a challenge for various reasons. First, the database suitable for system training is limited. Second, word composition knowledge that is prosody-informing has not been used in prosodic phrase modeling. To address these problems, in this article, we propose a feature augmentation method in conjunction with a self-attention neural classifier. We augment input text with morphological and phonological decompositions of words to enhance the text encoder. We study the use of self-attention classifier, that makes use of global context of a sentence, as a decoder for phrase break…

Mobile Phone Clustering From Speech Recordings Using Deep Representation and Spectral Clustering

Yanxiong Li, Zhang Xue, Xianku Li +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Information Forensics and Security · · cited 30× · DOI ↗ · more like this ·

Considerable attention has been paid to acquisition device recognition over the past decade in the forensic community, especially in digital image forensics. In contrast, acquisition device clustering from speech recordings is a new problem that aims to merge the recordings acquired by the same device into a single cluster without having prior information about the recordings and training classifiers in advance. In this paper, we propose a method for mobile phone clustering from speech recordings by using a new feature of deep representation and a spectral clustering algorithm. The new feature is learned by a deep auto-encoder network for representing the intrinsic trace left behind by each phone in the recordings, and spectral clustering is used to merge recordings acquired by the same phone into a single cluster. The impacts of the structures of the deep auto-encoder network on the…

Playback speech detection based on magnitude–phase spectrum

Jichen Yang, Leian Liu

Signal Processing · Electronics Letters · · cited 28× · DOI ↗ · more like this ·

In current playback speech detection (PSD) Letter, commonly used features are often extracted from magnitude spectrum while phase spectrum information is not used. In order to extract more discriminative information for PSD, the idea of magnitude–phase spectrum (MPS) is proposed. Then a new feature based on MPS is proposed, namely constant‐Q magnitude–phase octave coefficients (CMPOC). The experimental result on ASVspoof 2017 evaluation set using CMPOC indicates that: (i) the performance of CMPOC is better than features extracted not only from magnitude spectrum but also from MPS. (ii) CMPOC performs better than some commonly used features. (iii) Their system gives better performance than some known systems.

I4U Submission to NIST SRE 2018: Leveraging from a Decade of Shared Experiences

Kong Aik Lee, Ville Hautamaki, Tomi Kinnunen +43 more

eess.AS · · cited 21× · arXiv ↗ · more like this ·

The I4U consortium was established to facilitate a joint entry to NIST speaker recognition evaluations (SRE). The latest edition of such joint submission was in SRE 2018, in which the I4U submission was among the best-performing systems. SRE'18 also marks the 10-year anniversary of I4U consortium into NIST SRE series of evaluation. The primary objective of the current paper is to summarize the results and lessons learned based on the twelve sub-systems and their fusion submitted to SRE'18. It is also our intention to present a shared view on the advancements, progresses, and major paradigm shifts that we have witnessed as an SRE participant in the past decade from SRE'08 to SRE'18. In this regard, we have seen, among others, a paradigm shift from supervector representation to deep speaker embedding, and a switch of research challenge from channel compensation to domain adaptation.

Audiovisual Dependency Attention for Violence Detection in Videos

Wenfeng Pang, Wei Xie, Qianhua He +2 more

Artificial Intelligence · IEEE Transactions on Multimedia · · cited 19× · DOI ↗ · more like this ·

Violence detection in videos can help maintain public order, detect crimes, or provide timely assistance. In this paper, we aim to leverage multimodal information to determine whether successive frames contain violence. Specifically, we propose an audiovisual dependency attention (AVD-attention) module modified from the co-attention architecture to fuse visual and audio information, unlike commonly used methods such as the feature concatenation, addition, and score fusion. Because the AVD-attention module’s dependency map contains sufficient fusion information, we argue that it should be applied more sufficiently. A combination pooling method is utilized to convert the dependency map to an attention vector, which can be considered a new feature that includes fusion information or a mask of the attention feature map. Since some information in the input feature might be lost after…

GridTracer: Automatic Mapping of Power Grids using Deep Learning and Overhead Imagery

Bohao Huang, Jichen Yang, Artem Streltsov +3 more

cs.CV · · cited 19× · arXiv ↗ · more like this ·

Energy system information valuable for electricity access planning such as the locations and connectivity of electricity transmission and distribution towers, termed the power grid, is often incomplete, outdated, or altogether unavailable. Furthermore, conventional means for collecting this information is costly and limited. We propose to automatically map the grid in overhead remotely sensed imagery using deep learning. Towards this goal, we develop and publicly-release a large dataset ($263km^2$) of overhead imagery with ground truth for the power grid, to our knowledge this is the first dataset of its kind in the public domain. Additionally, we propose scoring metrics and baseline algorithms for two grid mapping tasks: (1) tower recognition and (2) power line interconnection (i.e., estimating a graph representation of the grid). We hope the availability of the training data, scoring…

Improving anti-spoofing with octave spectrum and short-term spectral statistics information

Jichen Yang, Rohan Kumar Das

Computer Vision and Pattern Recognition · Applied Acoustics · · cited 19× · DOI ↗ · more like this ·

The long-term window based features have been found to be effective for spoofing attack detection. One such important countermeasure is constant-Q cepstral coefficients (CQCC) that is derived from constant-Q transform. During its extraction, the octave power spectrum is converted to the linear power spectrum by performing uniform resampling. However, the information from the octave power spectrum is different from that carried by the linear power spectrum. We believe that the octave power spectrum can offer complementary information to the linear power spectrum for spoofing attack detection. In this regard, we propose to combine the coefficients generated using both linear and octave power spectrum. The combined feature is referred to as extended CQCC (eCQCC), which is hypothesized to have better discriminative information for detection of spoofing attacks. In addition, we use the…

Generative x-vectors for text-independent speaker verification

Longting Xu, Rohan Kumar Das, Emre Yılmaz +2 more

eess.AS · · cited 16× · arXiv ↗ · more like this ·

Speaker verification (SV) systems using deep neural network embeddings, so-called the x-vector systems, are becoming popular due to its good performance superior to the i-vector systems. The fusion of these systems provides improved performance benefiting both from the discriminatively trained x-vectors and generative i-vectors capturing distinct speaker characteristics. In this paper, we propose a novel method to include the complementary information of i-vector and x-vector, that is called generative x-vector. The generative x-vector utilizes a transformation model learned from the i-vector and x-vector representations of the background data. Canonical correlation analysis is applied to derive this transformation model, which is later used to transform the standard x-vectors of the enrollment and test segments to the corresponding generative x-vectors. The SV experiments performed on…

Device Features Based on Linear Transformation With Parallel Training Data for Replay Speech Detection

Longting Xu, Jichen Yang, Chang Huai You +2 more

Artificial Intelligence · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 14× · DOI ↗ · more like this ·

Replay speech poses a growing threat to speaker verification systems, thus the detection of replay speech becomes increasingly important. A critical factor differentiating replay speech and genuine speech is the representation of device information. Replay speech carries physical device information that originates from recording device, playback device, and environmental noise. In this work, a device-related linear transformation strategy is proposed to disentangle non-device information from replay speech. First, we conduct factor analysis by introducing a common vector for both replay utterance and the corresponding genuine speech utterance on parallel training data; then, we derive an expectation maximization formula to obtain the parameters of the device-related linear transformation; subsequently, three device feature extraction methods are developed based on the device-related…

Source cell phone matching from speech recordings by sparse representation and KISS metric

Ling Zou, Qianhua He, Jichen Yang +1 more

Computer Vision and Pattern Recognition · · cited 14× · DOI ↗ · more like this ·

Source recording device matching from two speech recordings is a new and important problem of digital media forensics. It aims to answer the question that whether or not two speech recordings are recorded by the same recording device. In this study we propose a source cell phone matching scheme. The Gaussian supervector (GSV) based on Mel-frequency cepstral coefficients (MFCCs) is extracted from the speech recording and is sparse represented with respect to a dictionary learned by K-SVD algorithm. The reduced-dimensional sparse representation coefficient is utilized to characterize the intrinsic fingerprint of the recording device. Then, KISS metric learning based similarity matching is conducted on a pair of fingerprints extracted from the two speech recordings. Evaluation experiments were conducted on a database of speech recordings recorded by 14 cell phones. The experimental results…

Border-collision bifurcations in a generalizedpiecewise linear-power map

Zhiying Qin, Jichen Yang, Soumitro Banerjee +1 more

Geometry and Topology · Discrete and Continuous Dynamical Systems - B · · cited 14× · DOI ↗ · more like this ·

In this paper a class of generalized piecewise smooth maps isstudied, which is linear at one side and nonlinear with powerdependence at the other side. According to the value of the powerin the term $x^z$, the bifurcations occurring in this map areclassified into five types: $z>1$, $z=1$, $0&#60;z<1$, $z=0$, and$z<0$. We derive the occurrence conditions ofborder collision bifurcation and smooth fold and flipbifurcation, especially the codimension-2bifurcation points describing the interaction between bordercollision bifurcation and smooth bifurcation. The general results are thenapplied to the specific cases of the power $z$, and differentbifurcation scenarios are shown for individual cases, from which theperiod-adding scenario is found to be general for any power.

Automatic cell phone recognition from speech recordings

Ling Zou, Jichen Yang, Tangsen Huang

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

Recording device recognition is an important research field of digital audio forensic. In this paper, we utilize Gaussian mixture model-universal background model (GMM-UBM) as the classifier to form a recording device recognition system. We examine the performance of Mel-frequency cepstral coefficients (MFCCs) and Power-normalized cepstral coefficients (PNCCs) to this problem. Experiments conducted on recordings come from 14 cell phones show that MFCCs are more effective than PNCCs in cell phone recognition. We find that the identification performance can be improved by stacking MFCCs and energy feature. We also investigate the effect of speaker mismatch and de-noising processing for acoustic feature to this problem. The highest identification accuracy achieved here is 97.71%.