arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ryan Stables

20 papers · 2010–2022

2010: 22011: 22012: 02013: 02014: 22015: 12016: 32017: 32018: 52019: 12020: 02021: 02022: 1
2010peak 5 in 20182022

Frequent co-authors

Papers

showing 1–20 of 20 RSS

SAFE: A System for the Extraction and Retrieval of Semantic Audio Descriptors

Ryan Stables, Sean Enderby, Brecht De Man +2 more

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 36× · OpenAlex ↗ · more like this ·

We present an overview of the Semantic Audio Feature Ex-traction (SAFE) Project, a novel data collection architec-ture for the extraction and retrieval of semantic descrip-tions of musical timbre, deployed within the digital au-dio workstation. By embedding the data capture system into the music production workflow, we are able to max-imise the return of semantically annotated music produc-tion data, whilst mitigating against issues such as musical and environmental bias. Users of the plug-ins are able to submit semantic descriptions of their own music, whilst utilising the continually growing collaborative dataset of musical descriptors. In order to provide more contextually representative timbral transformations, the dataset is parti-tioned using metadata, captured within the application. 1.

Semantic Description of Timbral Transformations in Music Production

Ryan Stables, Brecht De Man, Sean Enderby +3 more

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 20× · DOI ↗ · more like this ·

Abstract. In music production, descriptive terminology is used to define perceived sound transformations. By understanding the underlying statistical features associated with these descriptions, we can aid the retrieval of contextually relevant processing parameters using natural language, and create intelligent systems capable of assisting in audio engineering. In this study, we present an analysis of a dataset containing descriptive terms gathered using a series of processing modules, embedded within a Digital Audio Workstation. By applying hierarchical clustering to the audio feature space, we show that similarity in term representations exists within and between transformation classes. Furthermore, the organisation of terms in low-dimensional timbre space can be explained using perceptual concepts such as size and dissonance. We conclude by performing Latent Semantic Indexing to…

Semantically Controlled Adaptive Equalisation in Reduced Dimensionality Parameter Space

Spyridon Stasis, Ryan Stables, Jason Hockman

Signal Processing · Applied Sciences · · cited 19× · DOI ↗ · more like this ·

Equalisation is one of the most commonly-used tools in sound production, allowing users to control the gains of different frequency components in an audio signal. In this paper we present a model for mapping a set of equalisation parameters to a reduced dimensionality space. The purpose of this approach is to allow a user to interact with the system in an intuitive way through both the reduction of the number of parameters and the elimination of technical knowledge required to creatively equalise the input audio. The proposed model represents 13 equaliser parameters on a two-dimensional plane, which is trained with data extracted from a semantic equalisation plug-in, using the timbral adjectives warm and bright. We also include a parameter weighting stage in order to scale the input parameters to spectral features of the audio signal, making the system adaptive. To maximise the efficacy…

Audio Latency Measurement for Desktop Operating Systems with Onboard Soundcards

Yonghao Wang, Ryan Stables, Joshua D. Reiss

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 14× · OpenAlex ↗ · more like this ·

Using commodity computers in conjunction with live music digital audio workstations (DAW) has become increasingly more popular in recent years. The latency of these DAW audio processing chains for some application such as live audio monitoring has always been perceived as a problem when DSP audio effects are needed. With "High Definition Audio" being standardised as the onboard soundcard's hardware architecture for personal computers, and with advances in audio APIs, the low latency and multi-channel capability has made its way into home studios. This paper will discuss the results of latency measurements of current popular operating systems andhosts applications with different audio APIs and audio processing loads.

A model for adaptive reduced-dimensionality equalisation

Spyridon Stasis, Ryan Stables, Jason Hockman

Computer Vision and Pattern Recognition · BCU Open Access Repository (Birmingham City University) · · cited 8× · OpenAlex ↗ · more like this ·

We present a method for mapping between the input space of a parametric equaliser and a lower-dimensional representation, whilst preserving the effect's dependency on the incoming audio signal.The model consists of a parameter weighting stage in which the parameters are scaled to spectral features of the audio signal, followed by a mapping process, in which the equaliser's 13 inputs are converted to (x, y) coordinates.The model is trained with parameter space data representing two timbral adjectives (warm and bright), measured across a range of musical instrument samples, allowing users to impose a semantically-meaningful timbral modification using the lower-dimensional interface.We test 10 mapping techniques, comprising of dimensionality reduction and reconstruction methods, and show that a stacked autoencoder algorithm exhibits the lowest parameter reconstruction variance, thus…

Zero-Delay large signal convolution using multiple processor architectures

Nicholas Jillings, Joshua D. Reiss, Ryan Stables

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 7× · DOI ↗ · more like this ·

Zero latency convolution typically uses the Direct Form approach, requiring a large amount of computational resources for every additional sample in the impulse response. A number of methods have been developed to reduce the computational cost of very large signal convolution. However these all introduce latency into the system. In some scenarios this is not acceptable and must be removed. Modern computer systems hold multiple processor architectures, with their own strengths and weaknesses for the purpose of convolution. This paper shows how correctly combining these processors can lead to a powerful system which can be deployed for real-time, zero-latency large signal convolution.

Multi-Player Microtiming Humanisation using a Multivariate Markov Model

Ryan Stables, Satoshi Endo, Alan M. Wing

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 5× · OpenAlex ↗ · more like this ·

In this paper, we present a model for the modulation of multiperformer microtiming variation in musical groups. This is done using a multivariate Markov model, in which the relationship between players is modelled using an interdependence matrix ( ) and a multidimensional state transition matrix (S). This method allows us to generate more natural sounding musical sequences due to the reduction of out-of-phase errors that occur in Gaussian pseudorandom and player-independent probabilistic models. We verify this using subjective listening tests, where we demonstrate that our multivariate model is able to outperform commonly used univariate models at producing human-like microtiming variability. Whilst the participants in our study judged the real time sequences performed by humans to be more natural than the proposed model, we were still able to achieve a mean score of 63.39% naturalness…

Player Vs Transcriber: A Game Approach To Data Manipulation For Automatic Drum Transcription

Carl Southall, Ryan Stables, Jason Hockman

Signal Processing · Zenodo (CERN European Organization for Nuclear Research) · · cited 4× · DOI ↗ · more like this ·

State-of-the-art automatic drum transcription (ADT) approaches utilise deep learning methods reliant on timeconsuming manual annotations and require congruence between training and testing data. When these conditions are not held, they often fail to generalise. We propose a game approach to ADT, termed player vs transcriber (PvT), in which a player model aims to reduce transcription accuracy of a transcriber model by manipulating training data in two ways. First, existing data may be augmented, allowing the transcriber to be trained using recordings with modified timbres. Second, additional individual recordings from sample libraries are included to generate rare combinations. We present three versions of the PvT model: AugExist, which augments pre-existing recordings; AugAddExist, which adds additional samples of drum hits to the AugExist system; and Generate, which generates training…

Improving Peak-picking Using Multiple Time-step Loss Functions

Carl Southall, Ryan Stables, Jason Hockman

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 4× · DOI ↗ · more like this ·

The majority of state-of-the-art methods for music information retrieval (MIR) tasks now utilise deep learning methods reliant on minimisation of loss functions such as cross entropy. For tasks that include framewise binary classification (e.g., onset detection, music transcription) classes are derived from output activation functions by identifying points of local maxima, or peaks. However, the operating principles behind peak picking are different to that of the cross entropy loss function, which minimises the absolute difference between the output and target values for a single frame. To generate activation functions more suited to peak-picking, we propose two versions of a new loss function that incorporates information from multiple time-steps: 1) multi-individual, which uses multiple individual time-step cross entropies; and 2) multi-difference, which directly compares the…

Navigating Descriptive Sub-Representations Of Musical Timbre

Spyridon Stasis, Jason Hockman, Ryan Stables

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 4× · DOI ↗ · more like this ·

Musicians, audio engineers and producers often make use of common timbral adjectives to describe musical signals and transformations. However, the subjective nature of these terms, and the variability with respect to musical context often leads to inconsistencies in their definition. In this study, a model is proposed for controlling an equaliser by navigating clusters of datapoints, which represent grouped parameter settings with the same timbral description. The interface allows users to identify the nearest cluster to their current parameter setting and recommends changes based on its relationship to a cluster centroid. To do this, we apply dimensionality reduction to a dataset of equaliser curves described as warm and bright using a stacked autoencoder, then group the entries using an agglomerative clustering algorithm with a coherence based distance criterion. To test the efficacy…

Subjective comparison of music production practices using the Web Audio Evaluation Tool

Bm De Man, Nicholas Jillings, David Moffat +2 more

Computer Vision and Pattern Recognition · Queen Mary Research Online (Queen Mary University of London) · · cited 4× · OpenAlex ↗ · more like this ·

The Web Audio Evaluation Tool is an open-source, browser- based framework for creating and conducting listening tests. It allows remote deployment, GUI-guided setup, and analy- sis in the browser. While currently being used for listening tests in various fields, it was initially developed specifically for the study of music production practices. In this work, we highlight some of the features that facilitate evaluation of such content.

An Intelligent Audio Workstation in the Browser

Nicholas Jillings, Ryan Stables

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 3× · OpenAlex ↗ · more like this ·

Music production is a complex process requiring skill and time to undertake. The industry has undergone a digital revolution, but unlike other industries the process has not changed. However, intelligent systems, using the semantic web and signal processing, can reduce this complexity by making certain decisions for the user with minimal interaction, saving both time and investment on the engineers’ part. This paper will outline an intelligent Digital Audio Workstation (DAW) designed for use in the browser. It outlines the architecture of the DAW with its audio engine (built on the Web Audio API), using AngularJS for the user interface and a relational database.

Microphone Comparison: Spectral Feature Mapping for Snare Drum Recording

Matthew Cheshire, Ryan Stables, Jason Hockman

Computer Vision and Pattern Recognition · BCU Open Access Repository (Birmingham City University) · · cited 2× · OpenAlex ↗ · more like this ·

Microphones are known to exhibit sonic differences and microphone selection is integral in achieving desired tonal qualities of recordings. In this paper an initial multi-stimuli listening test is used to categorize microphones based on user preference when recording snare drums. A spectral modification technique is then applied to recordings made with a microphone from the least preferred category, such that they take on the frequency characteristics of recordings from the most preferred category. To assess the success of the audio transformation, a second experiment is undertaken with expert listeners to gauge pre- and post-transformation preferences. Results indicate spectral transformation dramatically improves listener preference for recordings from the least preferred category, placing them on par with those of the most preferred.

Score-Aligned Polyphonic Microtiming Estimation

Xueyang Wang, Ryan Stables, Bochen Li +1 more

Signal Processing · · cited 2× · DOI ↗ · more like this ·

Accurate estimation of note onset timing is important for music ensemble performance analysis and synthesis. In this study, we present a method for the detection of onsets from polyphonic mixtures, using score information. First, a MIDI score is aligned to the audio signal using dynamic time warping, and pitches of performed notes are refined using a multi-pitch estimation technique. Notes in a signal are then isolated using a spectral masking method, based on the average harmonic structure learned from each source. Onset timing is finally estimated by maximizing the time derivative of the energy curve of the note within an observation window. We show that this method significantly improves the onset timing estimation accuracy, measured by both the align rate and onset time deviation, and outperforms a state-of-art reference method.

Microphone Comparison for Snare Drum Recording

Matthew Cheshire, Jason Hockman, Ryan Stables

Computer Vision and Pattern Recognition · BCU Open Access Repository (Birmingham City University) · · cited 1× · OpenAlex ↗ · more like this ·

We present two experiments to test listener preference for snare microphones within real-world recording scenarios. In the first experiment, listeners evaluated isolated recordings captured with 25 microphones. In the second experiment, listeners performed the same task with the addition of a kick drum and hi-hat as part of a performed drum sequence. Results indicate a prominent contrast between the highest and lowest rated microphones and that condensers were rated higher than other subsets tested. The preference for three microphones significantly changed between the two listening test conditions. A post-test survey revealed that most listeners compared high-frequency characteristics, which were measured using spectral features. A positive correlation was observed between test scores of cardioid microphones and the brightness feature.

Perceptually Relevant Models for Articulation in Synthesised Drum Patterns

Ryan Stables, Jamie Bullock, Ian Williams

Computer Vision and Pattern Recognition · BCU Open Access Repository (Birmingham City University) · · cited 1× · OpenAlex ↗ · more like this ·

In this study, we evaluate current techniques for drum pattern humanisation and suggest new methods using a probabilistic model. Our statistical analysis shows that both deviations from a fixed grid and corresponding amplitude values of drum patterns can have non-Gaussian distributions with underlying temporal structures. We plot distributions and probability matrices of sequences played by humans in order to demonstrate this. A new method for humanisation with structural preservation is proposed, using a Markov Chain and an Empirical Cumulative Distribution Function (ECDF) in order to weight pseudorandom variables. Finally we demonstrate the perceptual relevance of these methods using paired listening tests.

Towards a Model for the Humanisation Of Pitch Drift in Singing Voice Synthesis

Ryan Stables, Cham Athwal, Jamie Bullock

Signal Processing · The Journal of the Abraham Lincoln Association · · cited 1× · OpenAlex ↗ · more like this ·

A model is presented for the analysis and synthesis of low frequency human-like pitch deviation, as a replacement for existing modulation techniques in singing voice synthesis systems.Fundamental Frequency ( f 0 ) measurements are taken from vocalists producing a selected range of utterances without vibrato and trends in the data are observed.Finally, we present a function that provides natural sounding low frequency f 0 modulation to synthesized singing voices.

Annotation of Soft Onsets in String Ensemble Recordings

Maciej Tomczak, Min Susan Li, Adrian Bradbury +8 more

eess.AS · · cited 0× · arXiv ↗ · more like this ·

Onset detection is the process of identifying the start points of musical note events within an audio recording. While the detection of percussive onsets is often considered a solved problem, soft onsets-as found in string instrument recordings-still pose a significant challenge for state-of-the-art algorithms. The problem is further exacerbated by a paucity of data containing expert annotations and research related to best practices for curating soft onset annotations for string instruments. To this end, we investigate inter-annotator agreement between 24 participants, extend an algorithm for determining the most consistent annotator, and compare the performance of human annotators and state-of-the-art onset detection algorithms. Experimental results reveal a positive trend between musical experience and both inter-annotator agreement and performance in comparison with automated…

Player vs Transcriber: A Game approach to automatic music transcription

Carl Southall, Ryan Stables, Jason Hockman

Signal Processing · BCU Open Access Repository (Birmingham City University) · · cited 0× · OpenAlex ↗ · more like this ·

State-of-the-art automatic drum transcription (ADT) ap-proaches utilise deep learning methods reliant on time-consuming manual annotations and require congruence be-tween training and testing data. When these conditionsare not held, they often fail to generalise. We proposea game approach to ADT, termed player vs transcriber(PvT), in which a player model aims to reduce transcrip-tion accuracy of a transcriber model by manipulating train-ing data in two ways. First, existing data may be aug-mented, allowing the transcriber to be trained using record-ings with modified timbres. Second, additional individualrecordings from sample libraries are included to generaterare combinations. We present three versions of the PvTmodel:AugExist, which augments pre-existing record-ings;AugAddExist, which adds additional samples ofdrum hits to theAugExistsystem; andGenerate, whichgenerates training…

Audio Engineering Society Convention Paper Presented at the 128th Convention

Yonghao Wang, Ryan Stables, Joshua Reiss

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

The papers at this Convention have been selected on the basis of a submitted abstract and extended precis that have been peer reviewed by at least two qualified anonymous reviewers. This convention paper has been reproduced from the author's advance manuscript, without editing, corrections, or consideration by the Review Board. The AES takes no responsibility for the contents. Additional papers may be obtained by sending request and remittance to Audio Engineering Society, 60 East 42nd Street, New