arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tim Brookes

28 papers · 1994–2022

1994: 11995: 11996: 01997: 01998: 01999: 02000: 12001: 02002: 02003: 02004: 02005: 12006: 12007: 02008: 22009: 12010: 32011: 22012: 02013: 12014: 12015: 42016: 22017: 22018: 22019: 02020: 12021: 12022: 1
1994peak 4 in 20152022

Frequent co-authors

Papers

showing 1–25 of 28 RSS

Dynamic Precedence Effect Modeling for Source Separation in Reverberant Environments

Christopher Hummersone, Russell Mason, Tim Brookes

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 71× · DOI ↗ · more like this ·

Reverberation continues to present a major problem for sound source separation algorithms. However, humans demonstrate a remarkable robustness to reverberation and many psychophysical and perceptual mechanisms are well documented. The precedence effect is one of these mechanisms; it aids our ability to localize sounds in reverberation. Despite this, relatively little work has been done on incorporating the precedence effect into automated source separation. Furthermore, no work has been carried out on adapting a precedence model to the acoustic conditions under test and it is unclear whether such adaptation, analogous to the perceptual Clifton effect, is even necessary. Hence, this study tests a previously proposed binaural separation/precedence model in real rooms with a range of reverberant conditions. The precedence model inhibitory time constant and inhibitory gain are varied in…

Audio Commons: bringing Creative Commons audio content to the creative industries

Frederic Font, Tim Brookes, György Fazekas +7 more

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 19× · OpenAlex ↗ · more like this ·

Significant amounts of user-generated audio content, such as sound effects, musical samples and music pieces, are uploaded to online repositories and made available under open licenses. Moreover, a constantly increasing amount of multimedia content, originally released with traditional licenses, is becoming public domain as its license expires. Nevertheless, the creative industries are not yet using much of all this content in their media productions. There is still a lack of familiarity and understanding of the legal context of all this open content, but there are also problems related with its accessibility. A big percentage of this content remains unreachable either because it is not published online or because it is not well organised and annotated. In this paper we present the Audio Commons Initiative, which is aimed at promoting the use of open audio content and at developing…

Qualitative Evaluation of Media Device Orchestration for Immersive Spatial Audio Reproduction

Jon Francombe, James Woodcock, Richard J. Hughes +9 more

Computer Vision and Pattern Recognition · Journal of the Audio Engineering Society · · cited 15× · DOI ↗ · more like this ·

The challenge of installing and setting up dedicated spatial audio systems can make it difficult to deliver immersive listening experiences to the general public. However, the proliferation of smart mobile devices and the rise of the Internet of Things mean that there are increasing numbers of connected devices capable of producing audio in the home.

An auditory onset detection algorithm for improved automatic source localization

Ben Supper, Tim Brookes, Francis Rumsey

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 11× · DOI ↗ · more like this ·

An algorithm is described which detects auditory onsets quickly in arbitrary binaural audio streams. Aspects of the precedence effect are implemented to speed up computation, and to increase the usability of the output. The onset detector is tested with a number of binaural signals. Onsets that are suitable for spatial auditory processing are found reliably. This will allow spatial feature extraction to be performed.

A Comparison of Computational Precedence Models for Source Separation in Reverberant Environments

Christopher Hummersone, Russell Mason, Tim Brookes

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 10× · OpenAlex ↗ · more like this ·

Reverberation is a problem for source separation algorithms. Because the precedence effect allows human listeners to suppress the perception of reflections arising from room boundaries, numerous computational models have incorporated the precedence effect. However, relatively little work has been done on using the precedence effect in source separation algorithms. This paper compares several precedence models and their influence on the performance of a baseline separation algorithm. The models were tested in a variety of reverberant rooms and with a range of mixing parameters. Although there was a large difference in performance among the models, the one that was based on interaural coherence and onset-based inhibition produced the greatest performance improvement. There is a trade-off between selecting reliable cues that correspond closely to free-field conditions and maximizing the…

Ideal Binary Mask Ratio: A Novel Metric for Assessing Binary-Mask-Based Sound Source Separation Algorithms

Christopher Hummersone, Russell Mason, Tim Brookes

Signal Processing · IEEE Transactions on Audio Speech and Language Processing · · cited 10× · DOI ↗ · more like this ·

A number of metrics has been proposed in the literature to assess sound source separation algorithms. The addition of convolutional distortion raises further questions about the assessment of source separation algorithms in reverberant conditions as reverberation is shown to undermine the optimality of the ideal binary mask (IBM) in terms of signal-to-noise ratio (SNR). Furthermore, with a range of mixture parameters common across numerous acoustic conditions, SNR-based metrics demonstrate an inconsistency that can only be attributed to the convolutional distortion. This suggests the necessity for an alternate metric in the presence of convolutional distortion, such as reverberation. Consequently, a novel metric-dubbed the IBM ratio (IBMR)-is proposed for assessing source separation algorithms that aim to calculate the IBM. The metric is robust to many of the effects of convolutional…

An informal comparison between surround-sound microphone techniques

Rafael Kassier, Hyunkook Lee, Tim Brookes +1 more

Computer Vision and Pattern Recognition · Surrey Research Insight Open Access (The University of Surrey) · · cited 10× · OpenAlex ↗ · more like this ·

There is currently a lack of recorded test materials in five-channel surround format. Particularly lacking are recordings made simultaneously using different microphone arrays that would allow comparative switching between different recorded versions of the same acoustical event. An ambitious pilot experiment was conducted involving the recording of various different programme items using eight different recording techniques simultaneously. This was undertaken to determine the practicality of making of such recordings, to allow informal comparisons between microphone techniques, and to create a set of simultaneous multichannel recordings for subsequent perceptual evaluation. This paper details experimental design considerations and practical limitations, as well as reporting initial observations regarding the resulting recordings.

Spectrography of disputed speech samples by peripheral human hearing modelling

David M. Howard, Allen Hirson, Tim Brookes +1 more

Signal Processing · International Journal of Speech Language and the Law · · cited 8× · DOI ↗ · more like this ·

Visual images have considerable value in freezing rapidly changing speech signals, both for the analysis of disputed speech samples and in the presentation of such material in court. Speech spectrograms are routinely used in speech analysis to examine the speech signal as a whole, prior to a more systematic and directed examination of particular speech characteristics, the forensic significance of which requires forensic phonetic expertise. This paper presents spectrograms based on peripheral human hearing modelling to illustrate their potential usefulness for speech analysis and discusses current developments towards a real-time version of such a system. The main differences between these and spectrograms derived by traditional means are discussed.

Production and reproduction of programme material for a variety of spatial audio formats

Jon Francombe, Tim Brookes, Russell Mason +4 more

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 7× · OpenAlex ↗ · more like this ·

For subjective experimentation on 3D audio systems, suitable programme material is needed. A large-scale recording session was performed in which four ensembles were recorded with a range of existing microphone techniques (aimed at mono, stereo, 5.0, 9.0, 22.0, ambisonic, and headphone reproduction) and a novel 48-channel circular microphone array. Further material was produced by remixing and augmenting pre-existing multichannel content. To mix and monitor the programme items (which included classical, jazz, pop and experimental music, and excerpts from a sports broadcast and a lm soundtrack), a flexible 3D audio reproduction environment was created. Solutions to the following challenges were found: level calibration for different reproduction formats; bass management; and adaptable signal routing from different software and fille formats.

A Multi-Angle, Multi-Distance Dataset of Microphone Impulse Responses

Juan Carlos Franco Hernández, Bogdan Baǎcilǎ, Tim Brookes +1 more

Signal Processing · Journal of the Audio Engineering Society · · cited 5× · DOI ↗ · more like this ·

A new publicly available dataset of microphone impulse responses (IRs) has been generated. The dataset covers 25 microphones, including a Class-1 measurement microphone and polar pattern variations for seven of the microphones. Microphones that were included had omnidirectional, cardioid, supercardioid, and bidirectional polar patterns; condenser, movingcoil, and ribbon transduction types; single and dual diaphragms; multiple body and head basket shapes; small and large diaphragms; and end-address and side-address designs. Using a customdeveloped computer-controlled precision turntable, IRs were captured quasi-anechoically at incident angles from 0 to 355 in steps of 5 and at source-to-microphone distances of 0.5, 1.25, and 5 m. The resulting dataset is suitable for perceptual and objective studies related to the incident-angle-dependent response of microphones and for the development…

Media Device Orchestration for Immersive Spatial Audio Reproduction

Jon Francombe, Russell Mason, Philip J. B. Jackson +6 more

Computer Vision and Pattern Recognition · View · · cited 5× · DOI ↗ · more like this ·

Whilst it is possible to create exciting, immersive listening experiences with current spatial audio technology, the required systems are generally difficult to install in a standard living room. However, in any living room there is likely to already be a range of loudspeakers (such as mobile phones, tablets, laptops, and so on). "Media device orchestration" (MDO) is the concept of utilising all available devices to augment the reproduction of a media experience. In this demonstration, MDO is used to augment low channel count renderings of various programme material, delivering immersive three-dimensional audio experiences.

Improvements to a Spherical Binaural Capture Model for Objective Measurement of Spatial Impression with Consideration of Head Movements

Chungeun Kim, Russell Mason, Tim Brookes

Human-Computer Interaction · Surrey Research Insight Open Access (The University of Surrey) · · cited 5× · OpenAlex ↗ · more like this ·

This research aims to develop an objective evaluation system of spatial impression, incorporating the finding from a previous study that head movements are naturally made in the subjective evaluation of spatial impression. Research already conducted indicated the limitations of a spherical binaural capture model for the objective measurement and evaluation of spatial impression. Further research has minimised the differences in interaural time and level differences, and cross-correlation coefficient between this spherical model and a head and torso simulator by implementing the effects of a torso and simplified pinnae. Further analysis of the head movements made by listeners in a range of listening situations is undertaken in order to determine the range of positions that needs to be taken into account. Analysis of these results together with the required microphone spacing is…

On the differences between conventional and auditory spectrograms of English consonants

Tim Brookes, A.M. Tyrrell, David M. Howard

Signal Processing · Logopedics Phoniatrics Vocology · · cited 5× · DOI ↗ · more like this ·

A new tool for speech analysis is presented, operating in real-time and incorporating the analysing power of a contemporary auditory model to produce the familiar display of the speech spectrograph. This "auditory spectrograph" is used to analyse English consonant sounds and the results are compared with conventional wide and narrow band spectrograms. The auditory analyses are found to attach more visual weight to the acoustic cues associated with speech production and perception, and features that are either difficult or impossible to distinguish on conventional spectrograms are clarified.

Elicitation of the Differences between Real and Reproduced Audio

Jon Francombe, Tim Brookes, Russell Mason

Computer Vision and Pattern Recognition · Surrey Research Insight Open Access (The University of Surrey) · · cited 4× · OpenAlex ↗ · more like this ·

To improve the experience of listening to reproduced audio, it is beneficial to determine the differences between listening to a live performance and a recording. An experiment was performed in which three live performances (a jazz duet, a jazz-rock quintet, and a brass quintet) were captured and simultaneously replayed over a nine-channel with-height surround sound system. Experienced and inexperienced listeners moved freely between the live performance and the reproduction and described the difference in listening experience. In subsequent group discussions, the experienced listeners produced twenty-nine categories using some terms that are not commonly found in the current spatial audio literature. The inexperienced listeners produced five categories that overlapped with the experienced group terms but that were not as detailed.

Eliciting the most prominent perceived differences between microphones

Andy Pearce, Tim Brookes, Martin Dewhirst +1 more

Signal Processing · The Journal of the Acoustical Society of America · · cited 3× · DOI ↗ · more like this ·

The attributes contributing to the differences perceived between microphones (when auditioning recordings made with those microphones) are not clear from previous research. Consideration of technical specifications and expert opinions indicated that recording five programme items with eight studio and two microelectromechanical system microphones could allow determination of the attributes related to the most prominent inter-microphone differences. Pairwise listening comparisons between the resulting 50 recordings, followed by multi-dimensional scaling analysis, revealed up to 5 salient dimensions per programme item; 17 corresponding pairs of recordings were selected exemplifying the differences across those dimensions. Direct elicitation and panel discussions on the 17 pairs identified a hierarchy of 40 perceptual attributes. An attribute contribution experiment on the 31 lowest-level…

Validation of Experimental Methods to Record Stimuli for Microphone Comparisons

Andy Pearce, Tim Brookes, Martin Dewhirst

Signal Processing · View · · cited 3× · OpenAlex ↗ · more like this ·

Test recordings can facilitate evaluation of a microphone's characteristics but there is currently no standard or experimentally validated method for making recordings to compare the perceptual characteristics of microphones. This paper evaluates previously used recording methods, concluding that, of these, the most appropriate approach is to record multiple microphones simultaneously. However, perceived differences between recordings made with microphones in a multi-microphone array might be due to (i) the characteristics of the microphones and/or (ii) the different locations of the microphones. Listening tests determined the maximum acceptable size of a multi-microphone array to be 150 mm in diameter, but the diameter must be reduced to no more than 100 mm if the microphones to be compared are perceptually very similar.

Considering New Privacy Laws in Australia

Gordon Hughes, Sophie Dawson, Tim Brookes

Law · IEEE Security & Privacy · · cited 3× · DOI ↗ · more like this ·

Like many nations, Australia is currently weighing numerous options regarding privacy legislation. The Australian Law Reform Commission (ALRC) has released a 2,000-page review of Australian privacy law, in which it proposes several changes that would significantly shift the balance between freedom of speech and privacy in Australia because they would extend to the media and private individuals as well as governments and businesses - especially important because Australia has no express right of free speech.

Loudness Matching Multichannel Audio Program Material with Listeners and Predictive Models

Jon Francombe, Tim Brookes, Russell Mason +1 more

Signal Processing · Journal of the Audio Engineering Society · · cited 2× · OpenAlex ↗ · more like this ·

Loudness measurements are often necessary in psychoacoustic research and legally required in broadcasting. However, existing loudness models have not been widely tested with new multichannel audio systems. A trained listening panel used the method of adjustment to balance the loudnesses of eight reproduction methods: low-quality mono, mono, stereo, 5-channel, 9-channel, 22-channel, ambisonic cuboid, and headphones. Seven programme items were used, including music, sport, and a lm soundtrack. The results were used to test loudness models including simple energy-based metrics, variants of ITU-R BS.1770, and complex psychoacoustically motivated models. The mean differences between the perceptual results and model predictions were statistically insignificant for all but the simplest model. However, some weaknesses in the model predictions were highlighted.

Modelling the Microphone-Related Timbral Brightness of Recorded Signals

Andy Pearce, Tim Brookes, Russell Mason

Signal Processing · Applied Sciences · · cited 1× · DOI ↗ · more like this ·

Brightness is one of the most common timbral descriptors used for searching audio databases, and is also the timbral attribute of recorded sound that is most affected by microphone choice, making a brightness prediction model desirable for automatic metadata generation. A model, sensitive to microphone-related as well as source-related brightness, was developed based on a novel combination of the spectral centroid and the ratio of the total magnitude of the signal above 500 Hz to that of the full signal. This model performed well on training data (r = 0.922). Validating it on new data showed a slight gradient error but good linear correlation across source types and overall (r = 0.955). On both training and validation data, the new model out-performed metrics previously used for brightness prediction.

A Framework for Intelligent Metadata Adaptation in Object-Based Audio

James Woodcock, Jon Franombe, Andreas Franck +9 more

Signal Processing · ePrints Soton (University of Southampton) · · cited 1× · OpenAlex ↗ · more like this ·

Object-based audio can be used to customize, personalize, and optimize audio reproduction depending on the speci?c listening scenario. To investigate and exploit the bene?ts of object-based audio, a framework for intelligent metadata adaptation was developed. The framework uses detailed semantic metadata that describes the audio objects, the loudspeakers, and the room. It features an extensible software tool for real-time metadata adaptation that can incorporate knowledge derived from perceptual tests and/or feedback from perceptual meters to drive adaptation and facilitate optimal rendering. One use case for the system is demonstrated through a rule-set (derived from perceptual tests with experienced mix engineers) for automatic adaptation of object levels and positions when rendering 3D content to two- and ?ve-channel systems.

Perceptual Quality of Audio Separated Using Sigmoidal Masks

Toby Stokes, Christopher Hummersone, Tim Brookes +1 more

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 1× · OpenAlex ↗ · more like this ·

Separation of underdetermined audio mixtures is often performed in the Time-Frequency (TF) domain by masking each TF element according to its target-to-mixture ratio. This work uses sigmoidal functions to map the target-to-mixture ratio to mask values. The series of functions used encompasses the ratio mask and an approximation of the binary mask. Mixtures are chosen to represent a range of different amounts of TF overlap, then separated and evaluated using objective measures. PEASS results show improved interferer suppression and artifact scores can be achieved using softer masking than that applied by binary or ratio masks. The improvement in these scores gives an improved overall perceptual score; this observation is repeated at multiple TF resolutions.

A NEW SET OF DIRECTIONAL WEIGHTS FOR ITU-R BS.1770 LOUDNESSMEASUREMENT OF MULTICHANNEL AUDIO

Leandro Pires, Maurílio Nunes Vieira, Hani Camille Yehia +2 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

The ITU-R BS.1770 multichannel loudness algorithm performs a sum of channel energies with weighting coefficients based on azimuth and elevation angles of arrival of the audio signal. In its current version, these coefficients were estimated based on binaural summation gains and not on subjective directional loudness. Also, the algorithm lacks directional weights for wider elevation angles (jfj � 30�). A listening test with broadband stimuli was conducted to collect subjective data on directional effects. The results were used to calculate a new set of directional weights. A modified version of the loudness algorithm with these estimated weights was tested against its benchmark using the collected data, and using program material rendered to reproduction systems with different loudspeaker configurations. The modified algorithm performed better than the benchmark, particularly with…

Signal Processing, Psychoacoustic Engineering and Digital Worlds: Interdisciplinary Audio Research at the University of Surrey

Philip J. B. Jackson, Mark D. Plumbley, Wenwu Wang +6 more

Computer Vision and Pattern Recognition · Surrey Research Insight Open Access (The University of Surrey) · · cited 0× · OpenAlex ↗ · more like this ·

At the University of Surrey (Guildford, UK), we have brought together research groups in different disciplines, with a shared interest in audio, to work on a range of collaborative research projects. In the Centre for Vision, Speech and Signal Processing (CVSSP) we focus on technologies for machine perception of audio scenes; in the Institute of Sound Recording (IoSR) we focus on research into human perception of audio quality; the Digital World Research Centre (DWRC) focusses on the design of digital technologies; while the Centre for Digital Economy (CoDE) focusses on new business models enabled by digital technology. This interdisciplinary view, across different traditional academic departments and faculties, allows us to undertake projects which would be impossible for a single research group. In this poster we will present an overview of some of these interdisciplinary projects…

Prediction of perceived elevation using multiple psuedo-binaural microphones

Tommy Ashby, Russell Mason, Tim Brookes

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 0× · OpenAlex ↗ · more like this ·

Computational auditory models that predict the perceived location of sound sources in terms of azimuth are already available, yet little has been done to predict perceived elevation. Interaural time and level differences, the primary cues in horizontal localisation, do not resolve source elevation, resulting in the ‘Cone of Confusion’. In natural listening, listeners can make head movements to resolve such confusion. To mimic the dynamic cues provided by head movements, a multiple microphone sphere was created, and a hearing model was developed to predict source elevation from the signals captured by the sphere. The prototype sphere and hearing model proved effective in both horizontal and vertical localisation. The next stage of this research will be to rigorously test a more physiologically accurate capture device.