arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mathieu Lagrange

104 papers · 2001–2026

2001: 12002: 02003: 12004: 12005: 12006: 32007: 92008: 42009: 12010: 42011: 42012: 62013: 62014: 52015: 62016: 32017: 42018: 52019: 12020: 42021: 22022: 12023: 102024: 92025: 82026: 5
2001peak 10 in 20232026

Frequent co-authors

Papers

showing 1–25 of 104 RSS

Detection and Classification of Acoustic Scenes and Events

Dan Stowell, Dimitrios Giannoulis, Emmanouil Benetos +2 more

Signal Processing · IEEE Transactions on Multimedia · · cited 595× · DOI ↗ · more like this ·

For intelligent systems to make best use of the audio modality, it is important that they can recognize not just speech and music, which have been researched as specific tasks, but also general sounds in everyday environments. To stimulate research in this field we conducted a public research challenge: the IEEE Audio and Acoustic Signal Processing Technical Committee challenge on Detection and Classification of Acoustic Scenes and Events (DCASE). In this paper, we report on the state of the art in automatically classifying audio scenes, and automatically detecting and classifying audio events. We survey prior work as well as the state of the art represented by the submissions to the challenge from various research groups. We also provide detail on the organization of the challenge, so that our experience as challenge hosts may be useful to those organizing challenges in similar…

Detection and Classification of Acoustic Scenes and Events: Outcome of the DCASE 2016 Challenge

Annamaria Mesaros, Toni Heittola, Emmanouil Benetos +4 more

Signal Processing · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 307× · DOI ↗ · more like this ·

Public evaluation campaigns and datasets promote active development in target research areas, allowing direct comparison of algorithms. The second edition of the challenge on detection and classification of acoustic scenes and events (DCASE 2016) has offered such an opportunity for development of the state-of-the-art methods, and succeeded in drawing together a large number of participants from academic and industrial backgrounds. In this paper, we report on the tasks and outcomes of the DCASE 2016 challenge. The challenge comprised four tasks: acoustic scene classification, sound event detection in synthetic audio, sound event detection in real-life audio, and domestic audio tagging. We present each task in detail and analyze the submitted systems in terms of design and performance. We observe the emergence of deep learning as the most popular classification method, replacing the…

Detection and classification of acoustic scenes and events: An IEEE AASP challenge

Dimitrios Giannoulis, Emmanouil Benetos, Dan Stowell +3 more

Signal Processing · City Research Online (City University London) · · cited 176× · DOI ↗ · more like this ·

This paper describes a newly-launched public evaluation challenge on acoustic scene classification and detection of sound events within a scene. Systems dealing with such tasks are far from exhibiting human-like performance and robustness. Undermining factors are numerous: the extreme variability of sources of interest possibly interfering, the presence of complex background noise as well as room effects like reverberation. The proposed challenge is an attempt to help the research community move forward in defining and studying the aforementioned tasks. Apart from the challenge description, this paper provides an overview of systems submitted to the challenge as well as a detailed evaluation of the results achieved by those systems.

The Internet of Audio Things: State of the Art, Vision, and Challenges

Luca Turchet, György Fazekas, Mathieu Lagrange +2 more

Signal Processing · IEEE Internet of Things Journal · · cited 86× · DOI ↗ · more like this ·

The Internet of Audio Things (IoAuT) is an emerging research field positioned at the intersection of the Internet of Things, sound and music computing, artificial intelligence, and human-computer interaction. The IoAuT refers to the networks of computing devices embedded in physical objects (Audio Things) dedicated to the production, reception, analysis, and understanding of audio in distributed environments. Audio Things, such as nodes of wireless acoustic sensor networks, are connected by an infrastructure that enables multidirectional communication, both locally and remotely. In this article, we first review the state of the art of this field, then we present a vision for the IoAuT and its motivations. In the proposed vision, the IoAuT enables the connection of digital and physical domains by means of appropriate information and communication technologies, fostering novel…

The Internet of Sounds: Convergent Trends, Insights, and Future Directions

Luca Turchet, Mathieu Lagrange, Cristina Rottondi +6 more

Signal Processing · IEEE Internet of Things Journal · · cited 82× · DOI ↗ · more like this ·

Current sound-based practices and systems developed in both academia and industry point to convergent research trends that bring together the field of Sound and Music Computing with that of the Internet of Things. This paper proposes a vision for the emerging field of the Internet of Sounds (IoS), which stems from such disciplines. The IoS relates to the network of Sound Things, i.e., devices capable of sensing, acquiring, processing, actuating, and exchanging data serving the purpose of communicating sound-related information. In the IoS paradigm, which merges under a unique umbrella the emerging fields of the Internet of Musical Things and the Internet of Audio Things, heterogeneous devices dedicated to musical and non-musical tasks can interact and cooperate with one another and with other things connected to the Internet to facilitate sound-based services and applications that are…

Extended playing techniques

Vincent Lostanlen, Joakim Andén, Mathieu Lagrange

Signal Processing · · cited 41× · DOI ↗ · more like this ·

The expressive variability in producing a musical note conveys information essential to the modeling of orchestration and style. As such, it plays a crucial role in computer-assisted browsing of massive digital music corpora. Yet, although the automatic recognition of a musical instrument from the recording of a single "ordinary" note is considered a solved problem, automatic identification of instrumental playing technique (IPT) remains largely underdeveloped. We benchmark machine listening systems for query-by-example browsing among 143 extended IPTs for 16 instruments, amounting to 469 triplets of instrument, mute, and technique. We identify and discuss three necessary conditions for significantly outperforming the traditional mel-frequency cepstral coefficient (MFCC) baseline: the addition of second-order scattering coefficients to account for amplitude modulation, the incorporation…

Multimodal similarity between musical streams for cover version detection

Rémi Foucard, Jean-Louis Durrieu, Mathieu Lagrange +1 more

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 38× · DOI ↗ · more like this ·

Expressing the similarity between musical streams is a challenging task as it involves the understanding of many factors which are most often blended into one information channel: the audio stream. Consequently, separating the musical audio stream into its main melody and its accompaniment may prove as being useful to root the similarity computation on a more robust and expressive representation. In this paper, we show that considering the mixture, an estimation of its main melody and its accompaniment as modalities allows us to propose new ways of defining the similarity between musical streams. In the context of the detection of cover version, we show that highest performance is achieved by jointly considering the mixture and the estimated accompaniment. As demonstrated by the experiments carried out using two different evaluation databases, this scheme allows the scoring system to…

Enhanced Partial Tracking Using Linear Prediction

Mathieu Lagrange, Sylvain Marchand, Martin Raspaud +2 more

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 38× · OpenAlex ↗ · more like this ·

In this paper, we introduce a new partial tracking method suitable for the sinusoidal modeling of mixtures of instrumental sounds with pseudo-stationary frequencies. This method, based on the linear prediction of the frequency evolutions of the partials, enables us to track these partials more accurately at the analysis stage, even in complex sound mixtures. This allows our spectral model to better handle polyphonic sounds.

Normalized Cuts for Predominant Melodic Source Separation

Mathieu Lagrange, Luís Gustavo Martins, Jennifer Murdoch +1 more

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 37× · DOI ↗ · more like this ·

The predominant melodic source, frequently the singing voice, is an important component of musical signals. In this paper, we describe a method for extracting the predominant source and corresponding melody from ldquoreal-worldrdquo polyphonic music. The proposed method is inspired by ideas from computational auditory scene analysis. We formulate predominant melodic source tracking and formation as a graph partitioning problem and solve it using the normalized cut which is a global criterion for segmenting graphs that has been used in computer vision. Sinusoidal modeling is used as the underlying representation. A novel harmonicity cue which we term harmonically wrapped peak similarity is introduced. Experimental results supporting the use of this cue are presented. In addition, we show results for automatic melody extraction using the proposed approach.

Estimating the instantaneous frequency of sinusoidal components using phase-based methods

Mathieu Lagrange, Sylvain Marchand

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 36× · OpenAlex ↗ · more like this ·

The robust estimation of the frequency of some sinusoidal comp-nents is a major prerequisite for many applications, such as in sinu-soidal sound modeling, where the estimation has often to be done with a low complexity, on short-term spectra. Among the estimators proposed in the literature, we focus in this paper on a class known as the phase-based estimators. In this paper, we prove that five of these estimators are equivalent, at least in theory. In-depth practical experiments demonstrate that these estimators perform roughly similarly in practice, although small differences remain, differences which are most probably due to numerical properties of the mathematical operators used in their implementation.

Detection of overlapping acoustic events using a temporally-constrained probabilistic model

Emmanouil Benetos, Grégoire Lafay, Mathieu Lagrange +1 more

Signal Processing · View · · cited 35× · DOI ↗ · more like this ·

In this paper, a system for overlapping acoustic event detection is proposed, which models the temporal evolution of sound events. The system is based on probabilistic latent component analysis, supporting the use of a sound event dictionary where each exemplar consists of a succession of spectral templates. The temporal succession of the templates is controlled through event class-wise Hidden Markov Models (HMMs). As input time/frequency representation, the Equivalent Rectangular Bandwidth (ERB) spectrogram is used. Experiments are carried out on polyphonic datasets of office sounds generated using an acoustic scene simulator, as well as real and synthesized monophonic datasets for comparative purposes. Results show that the proposed system outperforms several state-of-the-art methods for overlapping acoustic event detection on the same task, using both frame-based and event-based…

Enhancing the Tracking of Partials for the Sinusoidal Modeling of Polyphonic Sounds

Mathieu Lagrange, Sylvain Marchand, Jean-Bernard Rault

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 30× · DOI ↗ · more like this ·

This paper addresses the problem of tracking partials, i.e., determining the evolution over time of the parameters of a given number of sinusoids with respect to the analyzed audio stream. We first show that the minimal frequency difference heuristic generally used to identify continuities between local maxima of successive short-time spectra can be successfully generalized using the linear prediction formalism to handle modulated sounds such as musical tones with vibrato. The spectral properties of the evolutions in time of the parameters of the partials are next studied to ensure that the parameters of the partials effectively satisfy the slow time-varying constraint of the sinusoidal model. These two improvements are combined in a new algorithm designed for the sinusoidal modeling of polyphonic sounds. The comparative tests show that onsets/offsets of sinusoids as well as closely…

Sound Event Detection in Synthetic Audio: Analysis of the DCASE 2016 Task Results

Grégoire Lafay, Emmanouil Benetos, Mathieu Lagrange

eess.AS · · cited 25× · arXiv ↗ · more like this ·

As part of the 2016 public evaluation challenge on Detection and Classification of Acoustic Scenes and Events (DCASE 2016), the second task focused on evaluating sound event detection systems using synthetic mixtures of office sounds. This task, which follows the `Event Detection - Office Synthetic' task of DCASE 2013, studies the behaviour of tested algorithms when facing controlled levels of audio complexity with respect to background noise and polyphony/density, with the added benefit of a very accurate ground truth. This paper presents the task formulation, evaluation metrics, submitted systems, and provides a statistical analysis of the results achieved, with respect to various aspects of the evaluation dataset.

Representing environmental sounds using the separable scattering transform

Carlo Bauge, Mathieu Lagrange, Joakim Andén +1 more

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 25× · DOI ↗ · more like this ·

Environmental sounds are an interesting subject of study for machine audition because of their wide variety of acoustical characteristics and their central presence in our everyday life. They are perceived effortlessly in the human auditory system whereas state-of-the-art computational systems are far from reaching the same efficiency. In this paper we propose a novel representation of such sounds based on the scattering transform which has the property of stability to time-warping deformations and invariance to time-shift useful for classifications tasks. This representation is compared to several state-of-the-art approaches for the task of quantifying similarity between environmental sounds.

Characterisation of acoustic scenes using a temporally-constrained shift-invariant model

Emmanouil Benetos, Mathieu Lagrange, Simon Dixon

Signal Processing · City Research Online (City University London) · · cited 22× · OpenAlex ↗ · more like this ·

In this paper, we propose a method for modeling and classifying acoustic scenes using temporally-constrained shift-invariant probabilistic latent component analysis (SIPLCA). SIPLCA can be used for extracting time-frequency patches from spectrograms in an unsupervised manner. Component-wise hidden Markov models are incorporated to the SIPLCA formulation for enforcing temporal constraints on the activation of each acoustic component. The time-frequency patches are converted to cepstral coefficients in order to provide a compact representation of acoustic events within a scene. Experiments are made using a corpus of train station recordings, classified into 6 scene classes. Results show that the proposed model is able to model salient events within a scene and outperforms the non-negative matrix factorization algorithm for the same task. In addition, it is demonstrated that the use of…

Real-Time Additive Synthesis of Sound by Taking Advantage of Psychoacoustics

Mathieu Lagrange, Sylvain Marchand

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 19× · OpenAlex ↗ · more like this ·

In this paper we present an original technique designed in order to speed up additive synthesis. This technique consists in taking into account psychoacoustic phenomena (thresholds of hearing and masking) in order to ignore the inaudible partials during the synthesis process, thus saving a lot of computation time. Our algorithm relies on a specific data structure called "skip list" and has proven to be very efficient in practice. As a consequence, we are now able to synthesize an impressive number of spectral sounds in real time, without overloading the processor.

Sound Source Tracking and Formation using Normalized Cuts

Mathieu Lagrange, George Tzanetakis

Signal Processing · · cited 15× · DOI ↗ · more like this ·

The goal of computational auditory scene analysis (CASA) is to create computer systems that can take as input a mixture of sounds and form packages of acoustic evidence such that each package most likely has arisen from a single sound source. We formulate sound source tracking and formation as a graph partitioning problem and solve it using the normalized cut which is a global criterion for segmenting graphs that has been used in computer vision. It measures both the total dissimilarity between the different groups as well as the total similarity within groups. We describe how this formulation can be used with sinusoidal modeling, a common technique for sound analysis, manipulation and synthesis. Several examples showing the potential of this approach are provided.

Relevance-based quantization of scattering features for unsupervised mining of environmental audio

Vincent Lostanlen, Grégoire Lafay, Joakim Andén +1 more

Signal Processing · EURASIP Journal on Audio Speech and Music Processing · · cited 14× · DOI ↗ · more like this ·

The emerging field of computational acoustic monitoring aims at retrieving high-level information from acoustic scenes recorded by some network of sensors. These networks gather large amounts of data requiring analysis. To decide which parts to inspect further, we need tools that automatically mine the data, identifying recurring patterns and isolated events. This requires a similarity measure for acoustic scenes that does not impose strong assumptions on the data. The state of the art in audio similarity measurement is the “bag-of-frames” approach, which models a recording using summary statistics of short-term audio descriptors, such as mel-frequency cepstral coefficients (MFCCs). They successfully characterise static scenes with little variability in auditory content, but cannot accurately capture scenes with a few salient events superimposed over static background. To overcome this…

An Efficient Audio Coding Scheme for Quantitative and Qualitative Large Scale Acoustic Monitoring Using the Sensor Grid Approach

Félix Gontier, Mathieu Lagrange, Pierre Aumond +2 more

Signal Processing · Sensors · · cited 14× · DOI ↗ · more like this ·

The spreading of urban areas and the growth of human population worldwide raise societal and environmental concerns. To better address these concerns, the monitoring of the acoustic environment in urban as well as rural or wilderness areas is an important matter. Building on the recent development of low cost hardware acoustic sensors, we propose in this paper to consider a sensor grid approach to tackle this issue. In this kind of approach, the crucial question is the nature of the data that are transmitted from the sensors to the processing and archival servers. To this end, we propose an efficient audio coding scheme based on third octave band spectral representation that allows: (1) the estimation of standard acoustic indicators; and (2) the recognition of acoustic events at state-of-the-art performance rate. The former is useful to provide quantitative information about the…

Energy Efficiency is Not Enough:Towards a Batteryless Internet of Sounds

Vincent Lostanlen, Antoine Bernabeu, Jean-Luc Béchennec +3 more

Signal Processing · · cited 13× · DOI ↗ · more like this ·

This position paper advocates for digital sobriety in the design and usage of wireless acoustic sensors. As of today, these devices all rely on batteries, which are either recharged by a human operator or via solar panels. Yet, batteries contain chemical pollutants and have a shorter lifespan than electronic components: as such, they hinder the autonomy and sustainability of the Internet of Sounds at large. Against this problem, our radical answer is to avoid the use of batteries altogether; and instead, to harvest ambient energy in real time and store it in a supercapacitor allowing a few minutes of operation. We show the inherent limitations of battery-dependent technologies for acoustic sensing. Then, we describe how a low-cost Micro-Controller Unit (MCU) could serve for audio acquisition and feature extraction on the edge. In particular, we stress the advantage of storing…

Bandwidth Extension of Musical Audio Signals With No Side Information Using Dilated Convolutional Neural Networks

Mathieu Lagrange, Félix Gontier

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 13× · DOI ↗ · more like this ·

Bandwidth extension has a long history in audio processing. While speech processing tools do not rely on side information, production-ready bandwidth extension tools of general audio signals rely on side information that has to be transmitted alongside the bitstream of the low frequency part, mostly because polyphonic music has a more complex and less predictable spectral structure than speech.This paper studies the benefit of considering a dilated fully convolutional neural network to perform the bandwidth extension of musical audio signals with no side information on the magnitude spectra. Experimental evaluation using two public datasets, medley-solos-db and gtzan, respectively of monophonic and polyphonic music demonstrate that the proposed architecture achieves state of the art performance.

Polyphonic training set synthesis improves self-supervised urban sound classification

Félix Gontier, Vincent Lostanlen, Mathieu Lagrange +3 more

Signal Processing · The Journal of the Acoustical Society of America · · cited 11× · DOI ↗ · more like this ·

Machine listening systems for environmental acoustic monitoring face a shortage of expert annotations to be used as training data. To circumvent this issue, the emerging paradigm of self-supervised learning proposes to pre-train audio classifiers on a task whose ground truth is trivially available. Alternatively, training set synthesis consists in annotating a small corpus of acoustic events of interest, which are then automatically mixed at random to form a larger corpus of polyphonic scenes. Prior studies have considered these two paradigms in isolation but rarely ever in conjunction. Furthermore, the impact of data curation in training set synthesis remains unclear. To fill this gap in research, this article proposes a two-stage approach. In the self-supervised stage, we formulate a pretext task (Audio2Vec skip-gram inpainting) on unlabeled spectrograms from an acoustic sensor…

Polyphonic Sound Event Tracking Using Linear Dynamical Systems

Emmanouil Benetos, Grégoire Lafay, Mathieu Lagrange +1 more

Signal Processing · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 11× · DOI ↗ · more like this ·

In this paper, a system for polyphonic sound event detection and tracking is proposed, based on spectrogram factorization techniques and state space models. The system extends probabilistic latent component analysis (PLCA) and is modeled around a four-dimensional spectral template dictionary of frequency, sound event class, exemplar index, and sound state. In order to jointly track multiple overlapping sound events over time, the integration of linear dynamical systems (LDS) within the PLCA inference is proposed. The system assumes that the PLCA sound event activation is the (noisy) observation in an LDS, with the latent states corresponding to the true event activations. LDS training is achieved using fully observed data, making use of ground truth-informed event activations produced by the PLCA-based model. Several LDS variants are evaluated, using polyphonic datasets of office sounds…

Analysis/Synthesis of Sounds Generated by Sustained Contact Between Rigid Objects

Mathieu Lagrange, Gary Scavone, Philippe Depalle

Computer Vision and Pattern Recognition · IEEE Transactions on Audio Speech and Language Processing · · cited 11× · DOI ↗ · more like this ·

This paper introduces an analysis/synthesis scheme for the reproduction of sounds generated by sustained contact between rigid bodies. This scheme is rooted in a Source/Filter decomposition of the sound where the filter is described as a set of poles and the source is described as a set of impulses representing the energy transfer between the interacting objects. Compared to single impacts, sustained contact interactions like rolling and sliding make the estimation of the parameters of the Source/Filter model challenging because of two issues. First, the objects are almost continuously interacting. The second is that the source is generally unknown and has therefore to be modeled in a generic way. In an attempt to tackle those issues, the proposed analysis/synthesis scheme combines advanced analysis techniques for the estimation of the filter parameters and a flexible model of the…

Tracking Partials for the Sinusoidal Modeling of Polyphonic Sounds

Mathieu Lagrange, Sylvain Marchand, Jean-Bernard Rault

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 10× · DOI ↗ · more like this ·

The paper proposes to improve further the tracking of partials in a polyphonic context. Spectral characteristics of the controlling parameters (amplitude and frequency) are taken into account to ensure that these parameters evolve slowly with time. The resulting algorithm tracks closely-spaced sinusoids better and is able to avoid most of the spectral data belonging to noise. As a consequence, the proposed algorithm extracts a more meaningful sinusoidal representation from polyphonic recordings.