arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Peter Grosche

28 papers · 2007–2025

2007: 12008: 02009: 32010: 32011: 22012: 52013: 32014: 42015: 12016: 02017: 02018: 32019: 02020: 02021: 12022: 02023: 12024: 02025: 1
2007peak 5 in 20122025

Frequent co-authors

Papers

showing 1–25 of 28 RSS

High resolution audio synchronization using chroma onset features

Sebastian Ewert, Meinard Müller, Peter Grosche

Signal Processing · Max Planck Institute for Plasma Physics · · cited 135× · DOI ↗ · more like this ·

The general goal of music synchronization is to automatically align the multiple information sources such as audio recordings, MIDI files, or digitized sheet music related to a given musical work. In computing such alignments, one typically has to face a delicate tradeoff between robustness and accuracy. In this paper, we introduce novel audio features that combine the high temporal accuracy of onset features with the robustness of chroma features. We show how previous synchronization methods can be extended to make use of these new features. We report on experiments based on polyphonic Western music demonstrating the improvements of our proposed synchronization framework.

Cyclic tempogram—A mid-level tempo representation for musicsignals

Peter Grosche, Meinard Müller, Frank Kurth

Signal Processing · Max Planck Institute for Plasma Physics · · cited 84× · DOI ↗ · more like this ·

The extraction of local tempo and beat information from audio recordings constitutes a challenging task, particularly for music that reveals significant tempo variations. Furthermore, the existence of various pulse levels such as measure, tactus, and tatum often makes the determination of absolute tempo problematic. In this paper, we present a robust mid-level representation that encodes local tempo information. Similar to the well-known concept of cyclic chroma features, where pitches differing by octaves are identified, we introduce the concept of cyclic tempograms, where tempi differing by a power of two are identified. Furthermore, we describe how to derive cyclic tempograms from music signals using two different methods for periodicity analysis and finally sketch some applications to tempo-based audio segmentation.

Extracting Predominant Local Pulse Information From Music Recordings

Peter Grosche, Meinard Müller

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 80× · DOI ↗ · more like this ·

The extraction of tempo and beat information from music recordings constitutes a challenging task in particular for non-percussive music with soft note onsets and time-varying tempo. In this paper, we introduce a novel mid-level representation that captures musically meaningful local pulse information even for the case of complex music. Our main idea is to derive for each time position a sinusoidal kernel that best explains the local periodic nature of a previously extracted note onset representation. Then we employ an overlap-add technique accumulating all these kernels over time to obtain a single function that reveals the predominant local pulse (PLP). Our concept introduces a high degree of robustness to noise and distortions resulting from weak and blurry onsets. Furthermore, the resulting PLP curve reveals the local pulse information even in the presence of continuous tempo…

Unsupervised Music Structure Annotation by Time Series Structure Features and Segment Similarity

Joan Serrà, Meinard Müller, Peter Grosche +1 more

Signal Processing · IEEE Transactions on Multimedia · · cited 70× · DOI ↗ · more like this ·

Automatically inferring the structural properties of raw multimedia documents is essential in today's digitized society. Given its hierarchical and multi-faceted organization, musical pieces represent a challenge for current computational systems. In this article, we present a novel approach to music structure annotation based on the combination of structure features with time series similarity. Structure features encapsulate both local and global properties of a time series, and allow us to detect boundaries between homogeneous, novel, or repeated segments. Time series similarity is used to identify equivalent segments, corresponding to musically meaningful parts. Extensive tests with a total of five benchmark music collections and seven different human annotations show that the proposed approach is robust to different ground truth choices and parameter settings. Moreover, we see that…

Audio Content-Based Music Retrieval

Peter Grosche, Meinard Müller, Joan Serrà

Signal Processing · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · · cited 66× · DOI ↗ · more like this ·

The rapidly growing corpus of digital audio material requires novel retrieval strategies for exploring large music collections. Traditional retrieval strategies rely on metadata that describe the actual audio content in words. In the case that such textual descriptions are not available, one requires content-based retrieval strategies which only utilize the raw audio material. In this contribution, we discuss content-based retrieval strategies that follow the query-by-example paradigm: given an audio query, the task is to retrieve all documents that are somehow similar or related to the query from a music collection. Such strategies can be loosely classified according to their "specificity", which refers to the degree of similarity between the query and the database documents. Here, high specificity refers to a strict notion of similarity, whereas low specificity to a rather vague one.…

Unsupervised Detection of Music Boundaries by Time Series Structure Features

Joan Serrà, Meinard Müller, Peter Grosche +1 more

Signal Processing · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 56× · DOI ↗ · more like this ·

Locating boundaries between coherent and/or repetitive segments of a time series is a challenging problem pervading many scientific domains. In this paper we propose an unsupervised method for boundary detection, combining three basic principles: novelty, homogeneity, and repetition. In particular, the method uses what we call structure features, a representation encapsulating both local and global properties of a time series. We demonstrate the usefulness of our approach in detecting music structure boundaries, a task that has received much attention in recent years and for which exist several benchmark datasets and publicly available annotations. We find our method to significantly outperform the best accuracies published so far. Importantly, our boundary approach is generic, thus being applicable to a wide range of time series beyond the music and audio domains.

A Robust Fitness Measure for Capturing Repetitions in Music Recordings With Applications to Audio Thumbnailing

Meinard Müller, Nanzhu Jiang, Peter Grosche

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 37× · DOI ↗ · more like this ·

The automatic extraction of structural information from music recordings constitutes a central research topic. In this paper, we deal with a subproblem of audio structure analysis called audio thumbnailing with the goal to determine the audio segment that best represents a given music recording. Typically, such a segment has many (approximate) repetitions covering large parts of the recording. As the main technical contribution, we introduce a novel fitness measure that assigns a fitness value to each segment that expresses how much and how well the segment “explains” the repetitive structure of the entire recording. The thumbnail is then defined to be the fitness-maximizing segment. To compute the fitness measure, we describe an optimization scheme that jointly performs two error-prone steps, path extraction and grouping, which are usually performed successively. As a result, our…

Analyzing Chroma Feature Types for Automated Chord Recognition

Nanzhu Jiang, Peter Grosche, Verena Konz +1 more

Signal Processing · Max Planck Institute for Plasma Physics · · cited 32× · OpenAlex ↗ · more like this ·

The computer-based harmonic analysis of music recordings with the goal to automatically extract chord labels directly from the given audio data constitutes a major task in music information retrieval. In most automated chord recognition procedures, the given music recording is first converted into a sequence of chroma-based audio features and then pattern matching techniques are applied to map the chroma features to chord labels. In this paper, we analyze the role of the feature extraction step within the recognition pipeline of various chord recognition procedures based on template matching strategies and hidden Markov models. In particular, we report on numerous experiments which show how the various procedures depend on the type of the underlying chroma feature as well as on parameters that control temporal and spectral aspects. 1.

Toward characteristic audio shingles for efficient cross-version music retrieval

Peter Grosche, Meinard Müller

Signal Processing · MPG.PuRe (Max Planck Society) · · cited 20× · DOI ↗ · more like this ·

The general goal of cross-version music retrieval is to identify all versions of a given piece of music by means of a short query audio fragment. To speed up the retrieval process, hashing techniques have been proposed, where the audio material is split up into small overlapping shingles (used as hashes) that consist of short feature subsequences. In this paper, we extend this work with the goal to minimize the number of hash lookups. To this end, one requires larger shingles that characterize the underlying piece of music to a high degree, while being robust to variations that occur across different versions. As our main contribution, we report on extensive experiments to highlight the delicate trade-off between the query length, feature parameters, shingle dimension, and index settings. These insights are of fundamental importance for building efficient cross-version retrieval systems…

Perceptually Motivated Analysis of Numerically Simulated Head-Related Transfer Functions Generated By Various 3D Surface Scanning Systems

Manoj Dinakaran, Fabian Brinkmann, Stine Harder +4 more

Signal Processing · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · · cited 15× · DOI ↗ · more like this ·

Numerical simulations offer a feasible alternative to the direct acoustic measurement of individual head-related transfer functions (HRTFs). For the acquisition of high quality 3D surface scans, as required for these simulations, several approaches exist. In this paper, we systematically analyze the variations between different approaches and evaluate the influence of the accuracy of 3D scans on the resulting simulated HRTFs. To assess this effect, HRTFs were numerically simulated based on 3D scans of the head and pinna of the FABIAN dummy head generated with 6 different methods. These HRTFs were analyzed in terms of interaural time difference, interaural level difference, energetic error in auditory filters and by their modeled localization performance. From the results, it is found that a geometric precision of about 1 mm is needed to maintain accurate localization cues, while a…

Automated analysis of performance variations in folk song recordings

Meinard Müller, Peter Grosche, Frans Wiering

Signal Processing · Max Planck Institute for Plasma Physics · · cited 11× · DOI ↗ · more like this ·

Performance analysis of recorded music material has become increasingly important in musicological research and music psychology. In this paper, we present various techniques for extracting performance aspects from field recordings of folk songs. Main challenges arise from the fact that the recorded songs are performed by non-professional singers, who deviate significantly from the expected pitches and timings even within a single recording of a song. Based on a multimodal approach, we exploit the existence of a symbolic transcription of an idealized stanza in order to analyze a given audio recording of the song that comprises a large number of stanzas. As the main contribution of this paper, we introduce the concept of chroma templates by which consistent and inconsistent aspects across the various stanzas of a recorded song are captured in the form of an explicit and semantically…

Dialogue enhancement of stereo sound

Jürgen T. Geiger, Peter Grosche, Yesenia Lacouture Parodi

Signal Processing · · cited 10× · DOI ↗ · more like this ·

Studies show that many people have difficulties in understanding dialogue in movies when watching TV, especially hard-of-hearing listeners or in adverse listening environments. In order to overcome this problem, we propose an efficient methodology to enhance the speech component of a stereo signal. The method is designed with low computational complexity in mind, and consists of first extracting a center channel from the stereo signal. Novel methods for speech enhancement and voice activity detection are proposed which exploit the stereo information. A speech enhancement filter is estimated based on the relationship between the extracted center channel and all other channels. Subjective and objective evaluations show that this method can successfully enhance intelligibility of the dialogue without affecting the overall sound quality negatively.

Automated Segmentation of Folk Song Field Recordings

Meinard Müller, Peter Grosche

Signal Processing · MPG.PuRe (Max Planck Society) · · cited 6× · OpenAlex ↗ · more like this ·

In this paper, we introduce an automated procedure for segmenting a given folk song field recording into its constituent stanzas. One challenge arises from the fact that these recordings are performed by elderly non-professional singers under poor recording conditions such that the constituent stanzas may reveal significant temporal and spectral deviations. Unlike a previously described segmentation approach that relies on a manually transcribed reference stanza, we introduce a reference-free segmentation procedure, which is driven by an audio thumbnailing procedure in combination with enhanced similarity matrices. Our experiments on a Dutch folk song collection show that our segmentation results are comparable to the ones obtained by the reference-based method.

Toward musically-motivated audio fingerprints

Peter Grosche, Meinard Müller

Signal Processing · MPG.PuRe (Max Planck Society) · · cited 5× · DOI ↗ · more like this ·

In this paper, we investigate to which extent well-known audio fingerprinting techniques, which aim at identifying a specific audio recording, can be modified to also deal with more musical variations. To this end, we replace the standard peak fingerprints based on a spectrogram by peak fingerprints based on other more “musical” feature representations. Our systematic experiments show that such modified peak fingerprints allow for a robust identification of different versions and performances of the same piece of music if the query length is at least 15 seconds. This indicates that highly efficient audio fingerprinting techniques can also be applied to accelerate tasks such as audio matching or cover song identification.

Time-Frequency Masking Strategies for Single-Channel Low-Latency Speech Enhancement Using Neural Networks

Mikko Parviainen, Pasi Pertilä, Tuomas Virtanen +1 more

Signal Processing · Trepo - Institutional Repository of Tampere University · · cited 4× · DOI ↗ · more like this ·

This paper presents a low-latency neural network based speech enhancement system. Low-latency operation is critical for speech communication applications. The system uses the time-frequency (TF) masking approach to retain speech and remove the non-speech content from the observed signal. The ideal TF mask are obtained by supervised training of neural networks. As the main contribution different neural network models are experimentally compared to investigate computational complexity and speech enhancement performance. The proposed system is trained and tested on noisy speech data where signal-to-noise ratio (SNR) ranges from -5 dB to +5 dB and the results show significant reduction of non-speech content in the resulting signal while still meeting a low-latency operation criterion, which is here considered to be less than 20 ms.

Computing predominant local periodicity information in music recordings

Peter Grosche, Meinard Müller

Signal Processing · Max Planck Institute for Plasma Physics · · cited 3× · DOI ↗ · more like this ·

The periodic structure of musical events plays a crucial role in the perception of tempo as well as the sensation of note changes and onsets. In this paper, we introduce a novel function that reveals the predominant local periodicity (PLP) in music recordings. Here, our main idea is to estimate for each time position a periodicity kernel that best explains the local periodic nature of previously extracted note onset information and then to accumulate all these kernels to yield a single function. This function, which is also referred to as PLP curve, reveals musically meaningful periodicity information even for non-percussive music with soft and blurred note onsets. Such information is useful not only for stabilizing note onset detection but also for beat tracking and tempo estimation in the case of music with changing tempo.

Towards cover group thumbnailing

Peter Grosche, Meinard Müller, Joan Serrà

Signal Processing · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · · cited 1× · DOI ↗ · more like this ·

In this paper we investigate whether we can extract the commonalities shared by a group of cover songs or versions of the same musical piece. As a main contribution, we introduce the concept of cover group thumbnail, which is the most representative, essential subsequence for an entire group of versions. Opposed to previous approaches, we jointly consider all versions of a given song to compute a single cover group template, which then shows a high degree of robustness against version-specific aspects. To compute such a template, we introduce a modification of a recent audio thumbnailing technique. To evaluate the reliability of our conceptual contribution, we consider the task of template-based version identification, where we show comparable accuracies to existing systems.

Towards Automated Processing of Folk Song Recordings

Meinard Müller, Peter Grosche, Frans Wiering

Signal Processing · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · · cited 1× · DOI ↗ · more like this ·

Folk music is closely related to the musical culture of a specific nation or region. Even though folk songs have been passed down mainly by oral tradition, most musicologists study the relation between folk songs on the basis of symbolic music descriptions, which are obtained by transcribing recorded tunes into a score-like representation. Due to the complexity of audio recordings, once having the transcriptions, the original recorded tunes are often no longer used in the actual folk song research even though they still may contain valuable information. In this paper, we present various techniques for making audio recordings more easily accessible for music researchers. In particular, we show how one can use synchronization techniques to automatically segment and annotate the recorded songs. The processed audio recordings can then be made accessible along with a symbolic transcript by…

Singing Voice Accompaniment Data Augmentation with Generative Models

Miguel Perez, Holger Kirchhoff, Peter Grosche +1 more

Artificial Intelligence · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 0× · DOI ↗ · more like this ·

Singing voice transcription is a key task in Music Information Retrieval (MIR) that focuses on identifying sung notes within a music audio segment. Advancing state-of-the-art methods in this area relies heavily on high-quality data, yet annotating such data is resource-intensive and requires musical expertise. In genres like pop music, data sharing is further complicated by copyright and distribution limitations. In this paper, we refine a recently proposed data augmentation technique that leverages AI-generated music audio to address these data-related challenges. Specifically, we create musical accompaniments for vocals with known target notes, enabling the generation of new mixes that retain the original piece’s harmony while introducing substantial audio variation. Our cross-dataset experiments reveal that using harmony-matched mixes improves generalization, though performance…

WikiMuTe: A web-sourced dataset of semantic descriptions for music audio

Benno Weck, Holger Kirchhoff, Peter Grosche +1 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Multi-modal deep learning techniques for matching free-form text with music have shown promising results in the field of Music Information Retrieval (MIR). Prior work is often based on large proprietary data while publicly available datasets are few and small in size. In this study, we present WikiMuTe, a new and open dataset containing rich semantic descriptions of music. The data is sourced from Wikipedia's rich catalogue of articles covering musical works. Using a dedicated text-mining pipeline, we extract both long and short-form descriptions covering a wide range of topics related to music content such as genre, style, mood, instrumentation, and tempo. To show the use of this data, we train a model that jointly learns text and audio representations and performs cross-modal retrieval. The model is evaluated on two tasks: tag-based music retrieval and music auto-tagging. The results…

Drivers of Renewable Technology Adoption in the Household Sector

Anke Jacksohn, Peter Grösche, Katrin Rehdanz +1 more

Sociology and Political Science · Econstor (Econstor) · · cited 0× · OpenAlex ↗ · more like this ·

Using representative household survey panel data from Germany, we undertake a simultaneous assessment of the importance of factors that have individually been found significant for the adoption of renewable energy systems but have never been tested jointly. These are sociodemographic and housing characteristics, environmental concern, personality traits, and economic factors, i.e. the expected costs of and revenue from the investment. Our results suggest that household decisions to invest in photovoltaic systems and solar thermal facilities are mainly driven by the economic factors. Taking account of sociodemographic and housing characteristics, environmental concern or personality traits has comparatively little relevance, while the quantitative nexus between the decision to invest and returns on the investment is robust to their inclusion.

On-Line NMF-Based Stereo Up-Mixing of Speech Improves Perceived Reduction of Non-Stationary Noise

Christian Kirst, Felix Weninger, Cyril Joder +3 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

Speech de-noising algorithms often suffer from introduction of artifacts, either by removal of parts of the speech signal, or imperfect noise reduction causing the remaining noise to sound unnatural and disturbing. This contribution proposes to spatially distribute monaural noisy speech signals based on single-channel source separation, in order to improve the perceived speech quality. Stereo up-mixing is utilized on the estimated speech and noise sources instead of simply suppressing the noise. This paper investigates the case of non-negative matrix factorization (NMF) speech enhancement applied to high levels of non-stationary noise. NMF-based and spectral subtraction speech enhancement algorithms are evaluated in a listening test in terms of speech intelligibility, presence of interfering noises and overall quality with respect to the unprocessed signal. In the result, the listening…

Towards Automated Processing of Folk Song

Meinard Müller, Peter Grosche, Frans Wiering

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

Abstract. Folk music is closely related to the musical culture of a specific nation or region. Even though folk songs have been passed down mainly by oral tradition, most musicologists study the relation between folk songs on the basis of symbolic music descriptions, which are obtained by transcribing recorded tunes into a score-like representation. Due to the complexity of audio recordings, once having the transcriptions, the original recorded tunes are often no longer used in the actual folk song research even though they still may contain valuable information. In this paper, we present various techniques for making audio recordings more easily accessible for music researchers. In particular, we show how one can use synchronization techniques to automatically segment and annotate the recorded songs. The processed audio recordings can then be made accessible along with a symbolic…

Computing Predominant Local Periodicity Information

Peter Grosche, Meinard Müller

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

The periodic structure of musical events plays a crucial role in the perception of tempo as well as the sensation of note changes and onsets. In this paper, we introduce a novel function that reveals the predominant local periodicity (PLP) in music recordings. Here, our main idea is to estimate for each time position a periodicity kernel that best explains the local periodic nature of previously extracted note onset information and then to accumulate all these kernels to yield a single function. This function, which is also referred to as PLP curve, reveals musically meaningful periodicity information even for non-percussive music with soft and blurred note onsets. Such information is useful not only for stabilizing note onset detection but also for beat tracking and tempo estimation in the case of music with changing tempo. Index Terms — onset detection, novelty curve, periodicity…