arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Cyril Joder

21 papers · 2008–2016

2008: 12009: 12010: 22011: 32012: 32013: 52014: 32015: 12016: 2
2008peak 5 in 20132016

Frequent co-authors

Papers

showing 1–21 of 21 RSS

Temporal Integration for Audio Classification With Application to Musical Instrument Classification

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 125× · DOI ↗ · more like this ·

Nowadays, it appears essential to design automatic indexing tools which provide meaningful and efficient means to describe the musical audio content. There is in fact a growing interest for music information retrieval (MIR) applications amongst which the most popular are related to music similarity retrieval, artist identification, musical genre or instrument recognition. Current MIR-related classification systems usually do not take into account the mid-term temporal properties of the signal (over several frames) and lie on the assumption that the observations of the features in different frames are statistically independent. The aim of this paper is to demonstrate the usefulness of the information carried by the evolution of these characteristics over time. To that purpose, we propose a number of methods for early and late temporal integration and provide an in-depth experimental…

A Conditional Random Field Framework for Robust and Scalable Audio-to-Score Matching

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 61× · DOI ↗ · more like this ·

In this paper, we introduce the use of conditional random fields (CRFs) for the audio-to-score alignment task. This framework encompasses the statistical models which are used in the literature and allows for more flexible dependency structures. In particular, it allows observation functions to be computed from several analysis frames. Three different CRF models are proposed for our task, for different choices of tradeoff between accuracy and complexity. Three types of features are used, characterizing the local harmony, note attacks and tempo. We also propose a novel hierarchical approach, which takes advantage of the score structure for an approximate decoding of the statistical model. This strategy reduces the complexity, yielding a better overall efficiency than the classic beam search method used in HMM-based models. Experiments run on a large database of classical piano and…

A comparative study of tonal acoustic features for a symbolic level music-to-score alignment

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 30× · DOI ↗ · more like this ·

In this paper we review the acoustic features used for music-to-score alignment and study their influence on the performance in a challenging alignment task, where the audio data is polyphonic and may contain percussion. Furthermore, as we aim at using “real world” scores, we follow an approach which does exploit the rhythm information (considered unreliable) and test its robustness to score errors. We use a unified framework to handle different state-of-the-art features, and propose a simple way to exploit either a model of the feature values, or an audio synthesis of a musical score, in an audio-to-score alignment system. We confirm that chroma vectors drawn from representations using a logarithmic frequency scale are the most efficient features, and lead to a good precision, even with a simple alignment strategy. Robustness tests also show that the relative performance of the…

Learning Optimal Features for Polyphonic Audio-to-Score Alignment

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 27× · DOI ↗ · more like this ·

This paper addresses the design of feature functions for the matching of a musical recording to the symbolic representation of the piece (the score). These feature functions are defined as dissimilarity measures between the audio observations and template vectors corresponding to the score. By expressing the template construction as a linear mapping from the symbolic to the audio representation, one can learn the feature functions by optimizing the linear transformation. In this paper, we explore two different learning strategies. The first one uses a best-fit criterion (minimum divergence), while the second one exploits a discriminative framework based on a Conditional Random Fields model (maximum likelihood criterion). We evaluate the influence of the feature functions in an audio-to-score alignment task, on a large database of popular and classical polyphonic music. The results show…

Exploring Nonnegative Matrix Factorization for Audio Classification: Application to Speaker Recognition

Cyril Joder, Björn W. Schuller

Signal Processing · · cited 22× · OpenAlex ↗ · more like this ·

In this paper, we test the use of Nonnegative Matrix Fac-torization (NMF) for feature extraction in the context of audio classification. NMF calculates a decomposition of the spectrogram into nonnegative factors and has been successfully applied to audio source separation. Thus, it has the potential to be robust to noise disturbances when used for feature calculation. We then introduce two fea-ture sets directly derived from the NMF decomposition. Experiments performed on an 8-class speaker recognition task with Support Vector Machines show that the pro-posed representations convey complementary information to the baseline MFCC features. Indeed, the use of only the NMF-based descriptors lead to similar results as the refer-ence features, and the combination of these representations yields a significant improvement of the obtained accuracy. 1

A comparative study on sparsity penalties for NMF-based speech separation: Beyond LP-norms

Cyril Joder, Felix Weninger, David Virette +1 more

Signal Processing · OPUS (Augsburg University) · · cited 19× · DOI ↗ · more like this ·

In this work, we study the usefulness of several types of sparsity penalties in the task of speech separation using supervised and semi-supervised Nonnegative Matrix Factorization (NMF). We compare different criteria from the literature to two novel penalty functions based on Wiener Entropy, in a large-scale evaluation on spontaneous speech overlaid by realistic domestic noise, as well as music and stationary environmental noise corpora. The results show that enforcing the sparsity constraint in the separation phase does not improve the perceptual quality. In the learning phase however, it yields a better estimation of the base spectra, especially in the case of supervised NMF, where the proposed criteria delivered the best results.

Integrating noise estimation and factorization-based speech separation: A novel hybrid approach

Cyril Joder, Felix Weninger, David Virette +1 more

Signal Processing · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · · cited 10× · DOI ↗ · more like this ·

We present a novel method to integrate noise estimates by unsupervised speech enhancement algorithms into a semi-supervised non-negative matrix factorization framework. A multiplicative update algorithm is derived to estimate a non-negative noise dictionary given a time-varying background noise estimate with a stationarity constraint. A large-scale, speaker-independent evaluation is carried out on spontaneous speech overlaid with the official CHiME 2011 Challenge corpus of realistic domestic noise, as well as music and stationary environmental noise corpora. In the result, the proposed method delivers higher signal-distortion ratio and objective perceptual measure than standard semi-supervised NMF or spectral subtraction based on the same noise estimation algorithm, and further gains can be expected by speaker adaptation.

Off-line refinement of audio-to-score alignment by observation template adaptation

Cyril Joder, Björn W. Schuller

Signal Processing · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · · cited 8× · DOI ↗ · more like this ·

Audio-to-score alignment aims at matching a symbolic representation (the score) to a musical recording. A key problem in this application is the great variability of audio observations which can be explained by a single symbolic element. Whereas most previous works deal with this problem by training or heuristic design of a generic observation model, we propose the adaptation of this model to each musical piece. We exploit a template-based formulation of the observation model and we investigate two strategies for the adaptation of the templates using a Hidden Markov Model for the alignment. Experiments run on a large dataset of popular and classical piano music show that such an approach can lead to a significant improvement of the alignment accuracy compared to the use of a single generic model, even if the latter is trained on real data.

The TUM Cumulative DTW Approach for the Mediaeval 2012 Spoken Web Search Task

Cyril Joder, Felix Johannes Weninger, Martin Wöllmer +1 more

Signal Processing · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · · cited 8× · OpenAlex ↗ · more like this ·

This paper describes the system proposed for the Spoken Web Search task at Mediaeval 2012 campaign.We use an audio-only system based on our new called Cumulative Dynamic Time Warping (CDTW) algorithm.This algorithm combines the scores of all the alignment paths and allows for the learning of different cost functions for each kind of step in the alignment matrix (diagonal, horizontal and vertical).The results obtained with basic audio descriptors show the promising potential of our algorithm.

Optimizing the mapping from a symbolic to an audio representation for music-to-score alignment

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 7× · DOI ↗ · more like this ·

A key processing step in music-to-score alignment systems is the estimation of the intantaneous match between an audio observation and the score. We here propose a general formulation of this matching measure, using a linear transformation from the symbolic domain to any time-frequency representation of the audio. We investigate the learning of the mapping for several common audio representations, based on a best-fit criterion. We evaluate the effectiveness of our mapping approach with two different alignment systems, on a large database of popular and classical polyphonic music. The results show that the learning procedure significantly improves the precision of the alignments, compared to common heuristic templates used in the literature.

A Conditional Random Field system for beat tracking

Thomas Fillon, Cyril Joder, Simon Durand +1 more

Signal Processing · · cited 6× · DOI ↗ · more like this ·

In the present work, we introduce a new probabilistic model for the task of estimating beat positions in a musical audio recording, instantiating the Conditional Random Field (CRF) framework. Our approach takes its strength from a sophisticated temporal modeling of the audio observations, accounting for local tempo variations which are readily represented in the CRF model proposed using well-chosen potentials. The system is experimentally evaluated by studying its performance on 3 datasets of 1394 music excerpts of various western music styles and comparatively to 4 reference systems in the light of 6 reference evaluation metrics. The results show that the proposed system tracks perceptively coherent pulses and is very effective in estimating the beat positions while further work is needed to find the correct salient tempo.

A conditional random field viewpoint of symbolic audio-to-score matching

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 6× · DOI ↗ · more like this ·

We present a new approach of symbolic audio-to-score alignment, with the use of Conditional Random Fields (CRFs). Unlike Hidden Markov Models, these graphical models allow the calculation of state conditional probabilities to be made on the basis of several audio frames. The CRF models that we propose exploit this property to take into account the rhythmic information of the musical score. Assuming that the tempo is locally constant, they confront the neighborhood of each frame with several tempo hypotheses.

Alignment kernels for audio classification with application to music instrument recognition

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 6× · OpenAlex ↗ · more like this ·

In this paper we study the efficiency of support vector machines (SVM) with alignment kernels in audio classification. The classification task chosen is music instrument recognition. The alignment kernels have the advantage of handling sequential data, without assuming a model for the probability density of the features as in the case of Gaussian Mixture Model-based Hidden Markov Models (HMM). These classifiers are compared to several reference systems, namely Gaussian Mixture Model, HMM classifiers and SVMs with “static ” kernels. Using a higher-level representation of the feature sequence, which we call summary sequence, we show that the use of alignment kernels can significantly improve the classification scores in comparison to the reference systems. 1.

Hidden Discrete Tempo Model: A tempo-aware timing model for audio-to-score alignment

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 2× · DOI ↗ · more like this ·

In this paper, we present the Hidden Discrete Tempo Model, an effective Dynamic Bayesian Network for audio to score matching. Its main feature is an explicit modeling of tempo, which directly in fluences the timing model of the musical performance. Thanks to a discretization of the tempo set, it allows for an efficient decoding by the Viterbi algorithm, and facilitates the introduction of features which directly depend on the local tempo. We take advantage of this property by using the cyclic tempogram descriptor in addition to chroma vectors and onset detection features. Experiment run on both classical piano and pop music show the very high accuracy of this model for audio to score alignment, as well as the usefulness of die tempo feature used.

Hidden discrete tempo model: a tempo-aware timing model for audioto-score alignment

Cyril Joder, Slim Essid

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

In this paper, we present the Hidden Discrete Tempo Model, an ef-fective Dynamic Bayesian Network for audio to score matching. Its main feature is an explicit modeling of tempo, which directly in-ƀuences the timing model of the musical performance. Thanks to a discretization of the tempo set, it allows for an efſcient decoding by the Viterbi algorithm, and facilitates the introduction of features which directly depend on the local tempo. We take advantage of this property by using the cyclic tempogram descriptor in addition to chroma vectors and onset detection features. Experiment run on both classical piano and pop music show the very high accuracy of this model for audio to score alignment, as well as the usefulness of the tempo feature used. Index Terms — music information retrieval, automatic align-ment, dynamic Bayesian networks, acoustic features 1.

Musical Instrument Recognition using Wavelet Coefficient Histograms

Cyril Joder, Slim Essid, Golden G. Richard +2 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

In pattern recognition applications, finding compact and efficient feature set is important in overall problem solving. In this paper, feature analysis using wavelet coefficient histogram for the musical instrument recognition has been presented and compared with traditional features. The new proposed wavelet coefficient histograms features found compact and efficient with existing traditional features. With this work it is justified that the musical instrument information is available in particular frequency sub bands and can be easily extracted using wavelet features. The proposed wavelet based features shows better accuracy than existing traditional features. The database used in this work is from Mc Gill university, Canada . The work is

paristech.fr

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

paristech.fr We present a new approach of symbolic audio-to-score align-ment, with the use of Conditional Random Fields (CRFs). Unlike Hidden Markov Models, these graphical models allow the calculation of state conditional probabilities to be made on the basis of several audio frames. The CRF models that we propose exploit this property to take into account the rhythmic information of the musical score. Assuming that the tempo is locally constant, they confront the neighbor-hood of each frame with several tempo hypotheses. Experiments on a pop-music database show that this use of contextual information leads to a significant improvement of the alignment accuracy. In particular, the proportion of detected onsets inside a 100-ms tolerance window increases by more than 10 % when a 1-s neighborhood is considered.

1 Learning Optimal Features for Polyphonic Audio-to-Score Alignment

Cyril Joder, Slim Essid, Gaël Richard

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—This paper addresses the design of feature functions for the matching of a musical recording to the symbolic representation of the piece (the score). These feature functions are defined as dissimilarity measures between the audio observations and template vectors corresponding to the score. By expressing the template construction as a linear mapping from the symbolic to the audio representation, one can learn the feature functions by optimizing the linear transformation. In this paper, we explore two different learning strategies. The first one uses a best-fit criterion (minimum divergence), while the second one exploits a discriminative framework based on a Conditional Random Fields model (maximum likelihood criterion). We evaluate the influence of the feature functions in an audioto-score alignment task, on a large database of popular and classical polyphonic music. The…

On-Line NMF-Based Stereo Up-Mixing of Speech Improves Perceived Reduction of Non-Stationary Noise

Christian Kirst, Felix Weninger, Cyril Joder +3 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

Speech de-noising algorithms often suffer from introduction of artifacts, either by removal of parts of the speech signal, or imperfect noise reduction causing the remaining noise to sound unnatural and disturbing. This contribution proposes to spatially distribute monaural noisy speech signals based on single-channel source separation, in order to improve the perceived speech quality. Stereo up-mixing is utilized on the estimated speech and noise sources instead of simply suppressing the noise. This paper investigates the case of non-negative matrix factorization (NMF) speech enhancement applied to high levels of non-stationary noise. NMF-based and spectral subtraction speech enhancement algorithms are evaluated in a listening test in terms of speech intelligibility, presence of interfering noises and overall quality with respect to the unprocessed signal. In the result, the listening…

Integrating noise estimation and factorization-based speech spearation: A novel hybrid approach

Cyril Joder, Felix Weninger, David Virette

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

We present a novel method to integrate noise estimates by unsuper-vised speech enhancement algorithms into a semi-supervised non-negative matrix factorization framework. A multiplicative update al-gorithm is derived to estimate a non-negative noise dictionary given a time-varying background noise estimate with a stationarity constraint. A large-scale, speaker-independent evaluation is carried out on spon-taneous speech overlaid with the official CHiME 2011 Challenge corpus of realistic domestic noise, as well as music and stationary environmental noise corpora. In the result, the proposed method de-livers higher signal-distortion ratio and objective perceptual measure than standard semi-supervised NMF or spectral subtraction based on the same noise estimation algorithm, and further gains can be expected by speaker adaptation. Index Terms — Source separation, single-channel speech…

MediaEval. The TUM cumulative DTW approach for the Mediaeval 2012 spoken web search task

Cyril Joder, Felix Weninger, Martin Wöllmer

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

This paper describes the system proposed for the Spoken Web Search task at Mediaeval 2012 campaign. We use an audio-only system based on our new called Cumulative Dynamic Time Warping (CDTW) algorithm. This algorithm combines the scores of all the alignment paths and allows for the learning of different cost functions for each kind of step in the alignment matrix (diagonal, horizontal and vertical). The results obtained with basic audio descriptors show the promising potential of our algorithm.