arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

X. Rodet

26 papers · 1990–2016

1990: 11991: 11992: 11993: 31994: 11995: 01996: 01997: 01998: 01999: 22000: 02001: 02002: 32003: 12004: 02005: 22006: 42007: 12008: 02009: 12010: 02011: 22012: 12013: 02014: 12015: 02016: 1
1990peak 4 in 20062016

Frequent co-authors

Papers

showing 1–25 of 26 RSS

Tracking of partials for additive sound synthesis using hidden Markov models

Philippe Depalle, G. Garcı́a, X. Rodet

Signal Processing · IEEE International Conference on Acoustics Speech and Signal Processing · · cited 93× · DOI ↗ · more like this ·

The authors present a sinusoidal partial tracking method for additive synthesis of sound. Partials are tracked by identifying time functions of parameters as underlying trajectories in a successive set of spectral peaks. This is done by a purely combinatorial hidden Markov model. A partial trajectory is considered as a time sequence of peaks which satisfies continuity constraints on parameter slopes. The method allows frequency line crossing and can be used for formant tracking.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Spectral Envelopes and Inverse FFT Synthesis

X. Rodet, Philippe Depalle

Signal Processing · Journal of the Audio Engineering Society · · cited 74× · OpenAlex ↗ · more like this ·

This preprint has been reproduced from the author&amp;apos;s advance manuscript, without editing, corrections or consideration by the Review Board. The AES takes no responsibility for the contents, Additional preprints may be obtained by sending request and remittance to the Audio Engineering Society, 60 East 42nd St.,

Multiple Fundamental Frequency Estimation Of Polyphonic Music Signals

Chunghsin Yeh, Axel Röbel, X. Rodet

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 52× · DOI ↗ · more like this ·

The article is concerned with the estimation of fundamental frequencies, or F0s, in polyphonic music. We propose a new method for jointly evaluating multiple F0 hypotheses based on three physical principles, harmonicity, spectral smoothness and synchronous amplitude evolution, within a single source. Based on the generative quasiharmonic model, a set of hypothetical partial sequences is derived and an optimal assignment of the observed peaks to the hypothetical sources and noise is performed. The hypothetical partial sequences are then evaluated by a score function which formulates the guiding principles in a mathematical manner. The algorithm has been tested on a large collection of artificially mixed polyphonic samples and the results show the competitive performance of the proposed method.

Analysis of sound signals with high resolution matching pursuit

Rémi Gribonval, Emmanuel Bacry, Stéphane Mallat +2 more

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 52× · DOI ↗ · more like this ·

Sound recordings include transients and sustained parts. Their analysis with a basis expansion is not rich enough to represent efficiently all such components. Pursuit algorithms choose the decomposition vectors depending upon the signal properties. The dictionary among which these vectors are selected is much larger than a basis. Matching pursuit is fast to compute, but can provide coarse representations. Basis pursuit gives a better representation but is very expensive in terms of calculation time. This paper develops a high resolution matching pursuit: it is a fast, high time-resolution, time-frequency analysis algorithm, that makes it likely to be used far musical applications.

Fundamental frequency estimation and tracking using maximum likelihood harmonic matching and HMMs

Boris Doval, X. Rodet

Signal Processing · IEEE International Conference on Acoustics Speech and Signal Processing · · cited 51× · DOI ↗ · more like this ·

A new approach is presented for the estimation and tracking of the fundamental frequency (f0) of pseudoperiodic signals. It is based on a probabilistic model of pseudoperiodic signals that makes it possible to take prior knowledge into account and to include constraints on the evolution of the signal. The resulting method can operate on a large interval of f0 values (typically from 50 to 4000 Hz) and on a great variety of sound signals (speech and music signals).< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Improving Lpc Spectral Envelope Extraction Of Voiced Speech By True-Envelope Estimation

Fernando Villavicencio, Axel Röbel, X. Rodet

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 48× · DOI ↗ · more like this ·

n this work we address the problem of all pole spectral envelope estimation for speech signals. The currently widely used all pole spectral envelope model suffers from well-known systematic errors and more severely from model order mismatch. We will propose a procedure to first establish a band limited interpolation of the observed spectrum using a recently rediscovered true envelope estimator and then using the band limited envelope to derive an all pole envelope model named TE-LPC . The band-limited envelope that is used to derive the all pole envelope model reduces the problem of the unknown all pole model order. For the experimental investigation we propose a new perceptually motivated residual spectral peak flatness measure. The experimental results demonstrate that the proposed method significantly increases the spectral flatness for the perceptually especially important low order…

Estimation of fundamental frequency of musical sound signals

Boris Doval, X. Rodet

Signal Processing · · cited 48× · DOI ↗ · more like this ·

In order to estimate the fundamental frequency (fO) of pseudoperiodical sounds with a wide band of possible fO, a theoretical model based on a maximum likelihood for fO is proposed. The model is simplified to make it fast enough for extensive tests. The resulting algorithm is tested on musical speech sounds. As a musical application, an instrument follower based on the algorithm and operating in real time is implemented.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Automatic Characterisation of Musical Signals: Feature Extraction and Temporal Segmentation

Stéphane Rossignol, X. Rodet, J. Soumagne +2 more

Signal Processing · Journal of New Music Research · · cited 32× · DOI ↗ · more like this ·

This paper presents some results on automatic characterisation of musical and acoustic signals in terms of features attributed to signal segments. These features describe some of the musical and acoustical content of the sound and can be used in applications such as intelligent sound processing, retrieval of music and sound in databases or music editing and labeling. The paper describes research in a very advanced stage but still ongoing. Applications and results on various examples are presented.

Inversion of a physical model of a trumpet

Thomas Hélie, C. Vergez, Jean Lévine +1 more

Computer Vision and Pattern Recognition · · cited 23× · DOI ↗ · more like this ·

We deal with the inversion of a physical model of a trumpet, i.e. how should the model be controlled in order to obtain a given sound. It is shown that this problem is ill-posed since an infinity of inputs can produce the same sound. Then, a criterion based on the slowness of the musician's gestures compared to the sound signal evolution is used: this leads to a physically pertinent solution. Finally, we present some simulation results.

Globally Optimal Short-Time Dynamic Time Warping, Application to Score to Audio Alignment

Hagen Kaprykowsky, X. Rodet

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 20× · DOI ↗ · more like this ·

Dynamic Time Warping (DTW) finds the best global match or alignment between two sequences by ‘time’ warping them optimally. Since the algorithm uses the whole sequences, it can be very demanding in calculation cost and memory. In particular, this limits the size of the sequences which can be aligned. In this paper a novel algorithm is presented, Short-Time Dynamic Time Warping (STDTW), which requires much less memory because optimization is done iteratively on portions of the sequences. The very remarkable property of the algorithm is that under some weak hypothesis, it produces the same globally optimal solution as the classical DTW. As an example, STDTW is applied to Score to Audio Alignment which links events in a musical score and points on the audio performance time axis.

Analysis and modification of excitation source characteristics for singing voice synthesis

Axel Röebel, Stefan Huber, X. Rodet +1 more

Artificial Intelligence · · cited 13× · DOI ↗ · more like this ·

The present article investigates into the use of the LF glottal pulse model for singing synthesis and transformation. A recent estimator of the LF-glottal pulse shape parameter (rd) is used to analyze a small collection of professional singing examples and the results are discussed in the context of recent findings relating the rd shape parameter to other speech signal parameters (intensity and vibrato). We propose a rd shape parameter model for vibrato rendering and present an algorithm that allows modifying the glottal pulse shape parameter of a given speech signal and is used to enhance the vibrato generation in a speech to singing transformation system.

On the measurement of the instantaneous frequency and amplitude of partials in vocal vibrato

Ixone Arroabarren, X. Rodet, A. Carlosena

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 12× · DOI ↗ · more like this ·

In this paper, we analyze some methodological and practical grounds affecting a correct estimation of the instantaneous amplitude (IA) and instantaneous frequency (IF) of the partials of vocal vibrato signals. This particular class of acoustical signals can be described as a set of harmonics, or partials, whose amplitude and frequency vary with time following a particular pattern. The interest in the correct measurement of these two magnitudes stems from the fact that they are widely used to extract more information about the production mechanisms of this vocal effect, and even the singing voice. Focusing on the estimation of these magnitudes from the signal processing point of view, the estimation of the IA and the IF of a partial represents a practical example for the more general problem of the AM-FM decomposition of a bandpass signal, which has received considerable attention by the…

The recreation of a castrato voice, Farinelli's voice

Philippe Depalle, G. Garcı́a, X. Rodet

Signal Processing · · cited 12× · DOI ↗ · more like this ·

We present an original research work culminating in the high quality production of thirty-nine minutes of castrato voice, by the means of sound analysis, processing and synthesis. The goal of the project is the creation of a soundtrack for a film about a famous eighteenth century castrato. Two complementary voices-a coloratura-soprano and a counter-tenor-are used to cover the entire range and compensate for technical difficulties. Then their timbres are homogenised by using combined techniques such as phase-vocoding, additive analysis/synthesis as well as spectral envelope and pitch estimation. Thirty-nine minutes of high quality processed singing have been created for a CD of the soundtrack.

Purging Musical Instrument Sample Databases Using Automatic Musical Instrument Recognition Methods

Arie Livshin, X. Rodet

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 11× · DOI ↗ · more like this ·

Compilation of musical instrument sample databases requires careful elimination of badly recorded samples and validation of sample classification into correct categories. This paper introduces algorithms for automatic removal of bad instrument samples using automatic musical instrument recognition and outlier detection techniques. Best evaluation results on a methodically contaminated sound database are achieved using the introduced MCIQR method, which removes 70.1% "bad" samples with 0.9% false-alarm rate and 90.4% with 8.8% false-alarm rate.

Synthesis by rule: LPC diphones and calculation of formant trajectories

X. Rodet, Philippe Depalle

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

We describe a new method for very high quality speech synthesis, and the procedure used for the automatic acquisition of the rules. Our method retains positive aspects of both diphone LPC synthesis and calculation of formant trajectories. For each sequence /VC#/ or /#CV/, we apply a very precise, pitch synchronous, LP analysis, we represent each spectrum in terms of the parameters for a parallel formant syntheziser, and we extract formant trajectories from these data. At the synthesis stage, for any /V <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</inf> C <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">c</inf> V <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</inf> / sequence, trajectories are calculated by rule using the stored trajectories…

A Reduced Multiple Gabor Frame for Local Time Adaptation of the Spectrogram

M. Liuni, A. Röbel, M. Romito +1 more

cs.SD · · cited 4× · arXiv ↗ · more like this ·

In this paper we propose a method for automatic local time adap- tation of the spectrogram of an audio signal, based on its decomposition within a Gabor multi-frame. The sparsity of the analyses within each individual frame is evaluated through the Rényi entropies measures. According to the sparsity of the decompositions, an optimal resolution and a reduced multi-frame are determined, defining an adapted spectrogram with variable resolution and hop size. The composition of such a reduced multi-frame allows an immediate definition of a dual frame: re-synthesis techniques for this adapted analysis are easily derived by the traditional phase vocoder scheme.

Time domain speech synthesis-by-rules using a flexible and fast signal management system

X. Rodet, J.-L. Delatre

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

The SARA-JUNIOR text-to-speech synthesis uses new developments in the techniques pioneered in the previous SARA software. Acoustic parameters (i.e. pitch period duration, formant frequencies and formant amplitudes) are calculated by rules for each pitch period, according to prosodic features and given phonetic string. The signal is calculated as a summation of formant time-domain functions derived from the previously determined acoustic parameters. These methods are implemented with a general-purpose software system dedicated to fast generation, editing and merging of streams of samples to produce complex audio signals. This system facilitates user control of critical events in time such as the onset of sound components, beginning of envelopes etc. Synthesis commands can be stated as LL(1) rewriting rules.

Study of spectro-temporal parameters in musical performance for expressive instrument synthesis

Shlomo Dubnov, X. Rodet

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Modeling expressive synthesis requires one to deal with a wide range of sound's behaviors that include spectral dynamics which are idiomatic to the instrument or characteristics of the playing technique. In the paper we analyze short time evolution of power-spectral envelopes, adaptively changing the analysis parameters so as to variably include filter envelopes, and the pitched excitation parts. Typical sequences of sound features are obtained from quantized sequences of parameters. By applying string matching techniques, new sequences of features are created and new sounds that have dynamically changing temporal behavior are re-synthesized.

A short review of research on voice transformations at IRCAM

P. Lanchantin, S. Farner, C. Veaux +3 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

IRCAM has a long experience in analysis, synthesis and transformation of voice. Natural voice transformations are of great interest for many applications and can be combine with text-to-speech system, leading to a powerful creation tool. We present research conducted at IRCAM on voice transformations for the last few years. Transformations can be achieved in a global way by modifying pitch, spectral en-velope, durations etc. While it sacrifices the possibility to attain a specific target voice, the approach allows the pro-duction of new voices of a high degree of naturalness with different gender and age, modified vocal quality, or another speech style. These transformations can be applied in re-altime using ircamTools TRAX.Transformation can also be done in a more specific way in order to transform a voice towards the voice of a target speaker. Finally, we present some recent research…

VIVOS VOCO: A SURVEY OF RECENT RESEARCH ON VOICE TRANSFORMATIONS AT IRCAM

P. Lanchantin, S. Farner, C. Veaux +8 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

IRCAM has a long experience in analysis, synthesis and transfor-mation of voice. Natural voice transformations are of great inter-est for many applications and can be combine with text-to-speech system, leading to a powerful creation tool. We present research conducted at IRCAM on voice transformations for the last few years. Transformations can be achieved in a global way by mod-ifying pitch, spectral envelope, durations etc. While it sacrifices the possibility to attain a specific target voice, the approach al-lows the production of new voices of a high degree of naturalness with different gender and age, modified vocal quality, or another speech style. These transformations can be applied in realtime us-ing ircamTools TRAX.Transformation can also be done in a more specific way in order to transform a voice towards the voice of a target speaker. Finally, we present some recent…

An Entropy Based Method for Local Time-Adaptation of the Spectrogram

M. Liuni, A. Röbel, M. Romito +1 more

cs.SD · · cited 0× · arXiv ↗ · more like this ·

We propose a method for automatic local time-adaptation of the spectrogram of audio signals: it is based on the decomposition of a signal within a Gabor multi-frame through the STFT operator. The sparsity of the analysis in every individual frame of the multi-frame is evaluated through the Rényi entropy measures: the best local resolution is determined minimizing the entropy values. The overall spectrogram of the signal we obtain thus provides local optimal resolution adaptively evolving over time. We give examples of the performance of our algorithm with an instrumental sound and a synthetic one, showing the improvement in spectrogram displaying obtained with an automatic adaptation of the resolution. The analysis operator is invertible, thus leading to a perfect reconstruction of the original signal through the analysis coefficients.

Model Of The Trumpet Fuctionning: Real Time Simulation And Experiments With An Artificial Mouth

C. Vergez, X. Rodet

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

For several years, we have been developing and studying computer-simulated models of brass instruments, including the player&amp;apos;s lips. We demonstrate here the most recent developments of our physical model, including physical functioning and real-time control with MIDI events. These improvements result in great improvements of sound quality and musical expressivity. To better understand the physics of real lips, we have built a working latex model of a pair of lips. We show that this artificial mouth can play a trumpet like a real trumpet player. We make comparisons between naturally blown trumpet signals, artificially-blown trumpet signals, and simulations with our computer model. 1. Introduction In Rodet [1] , we explained and demonstrated a simple real-time model of trumpet-like instruments. The aim was to find the simplest structure which would exhibit the basic properties of…

Vibrato: Detection, Estimation, Extraction, Modification

S. Rossignol, P. Depalle, J. Soumagne +2 more

Information Systems · · cited 0× · OpenAlex ↗ · more like this ·

This paper deals with vibrato detection, vibrato extraction on f 0 trajectory, and vibrato parameter estimation and modification. Vibrato detection and extraction are aimed at being a first step for note segmentation of singing voice signals. The aim is also to characterize sounds with the descriptor: &amp;quot;presence of vibrato&amp;quot; or &amp;quot;absence of vibrato&amp;quot;. Changing vibrato parameters, that is to say its magnitude and its frequency, is also one of the possible musical applications. It is firstly required to detect the presence of vibrato. In order to do that, several approaches are possible: we can analyse directly the sound signal or its f 0 trajectory. For each approach, several techniques exist: some of them are described here: the &amp;quot;spectrum modelling&amp;quot; method, the &amp;quot;spectral envelopes distortion&amp;quot; method, the &amp;quot;AR…

Additive analysis and synthesis using partial tracking, spectral envelopes, and inverse fast Fourier transform

X. Rodet, Philippe Depalle, G. Garcı́a

Computer Vision and Pattern Recognition · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

Additive methods developed and used at IRCAM and CNMAT are presented. Analysis includes new techniques to find spectral peaks, estimate their parameters, track partial sinusoids, and separate sinusoidal components from the residual considered as noise. Partials are tracked by identifying trajectories in successive set of spectral peaks using a combinatorial hidden Markov model. Control is made easier by use of spectral envelopes instead of the classical time functions. Characteristic features of sounds are given in term of fundamental frequency, spectral envelopes for amplitude, phase, deviation from harmonicity, noise components, etc. This procedure renders user control much more economical and efficient. To reduce the computational cost of the synthesis algorithm, a method has been developed that is based on the short-time Fourier model of a sound signal allowing for the synthesis and…

X.: Tracking of partials for additive sound synthesis using Hidden Markov Models

Ph. Depalle, G. Garcia, X Rodet

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

estimation detection matching structure, synthesis-In this paper, we present a sinusoidal partial tracking method for additive synthesis of sound. Partials are tracked by identifying time functions of parameters as underlying trajectories in successsive set of spectral peaks. This is done by a purely combinatorial Hidden Markov Model. We consider a partial trajectory as a time-sequence of peaks which satisfies continuity consuaints on parameter slopes. Our method allows frequency line crossing and can be used for formant wacking.