arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mark Dolson

19 papers · 1982–2024

1982: 11983: 31984: 01985: 11986: 21987: 11988: 01989: 11990: 01991: 01992: 11993: 01994: 11995: 01996: 01997: 11998: 01999: 32000: 02001: 02002: 12003: 12004: 02005: 02006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 12014: 02015: 02016: 02017: 02018: 02019: 02020: 02021: 02022: 02023: 02024: 1
1982peak 3 in 19832024

Frequent co-authors

Papers

showing 1–19 of 19 RSS

The Phase Vocoder: A Tutorial

Mark Dolson

Signal Processing · Computer Music Journal · · cited 273× · DOI ↗ · more like this ·

For composers interested in the modification of natural sounds, the phase vocoder is a digital signal processing technique of potentially great significance. By itself, the phase vocoder can perform very high fidelity time-scale modification or pitch transposition of a wide variety of sounds. In conjunction with a standard software synthesis program, the phase vocoder can provide the composer with arbitrary control of individual harmonics. But use of the phase vocoder to date has been limited primarily to experts in digital signal processing. Consequently, its musical potential has remained largely untapped. In this article, I attempt to explain the operation of the phase vocoder in terms accessible to musicians. I rely heavily on the familiar concepts of sine waves, filters, and additive synthesis, and I employ a minimum of mathematics. My hope is that this tutorial will lay the…

Improved phase vocoder time-scale modification of audio

J. Laroche, Mark Dolson

Signal Processing · IEEE Transactions on Speech and Audio Processing · · cited 269× · DOI ↗ · more like this ·

The phase vocoder is a well established tool for time scaling and pitch shifting speech and audio signals via modification of their short-time Fourier transforms (STFTs). In contrast to time-domain time-scaling and pitch-shifting techniques, the phase vocoder is generally considered to yield high quality results, especially for large modification factors and/or polyphonic signals. However, the phase vocoder is also known for introducing a characteristic perceptual artifact, often described as "phasiness", "reverberation", or "loss of presence". This paper examines the problem of phasiness in the context of time-scale modification and provides new insights into its causes. Two extensions to the standard phase vocoder algorithm are introduced, and the resulting sound quality is shown to be significantly improved. Moreover, the modified phase vocoder is shown to provide a factor-of-two…

New phase-vocoder techniques for pitch-shifting, harmonizing and other exotic effects

J. Laroche, Mark Dolson

Signal Processing · · cited 83× · DOI ↗ · more like this ·

The phase-vocoder is usually presented as a high-quality solution for time-scale modification of signals, pitch-scale modifications usually being implemented as a combination of timescaling and sampling rate conversion. We present two new phase-vocoder-based techniques which allow direct manipulation of the signal in the frequency-domain, enabling such applications as pitch-shifting, chorusing, harmonizing, partial stretching and other exotic modifications which cannot be achieved by the standard time-scale sampling-rate conversion scheme. The new techniques are based on a very simple peak-detection stage, followed by a peak-shifting stage. The very simplest one allows for 50% overlap but restricts the precision of the modifications, while the most flexible techniques requires a more expensive 75% overlap.

Phase-vocoder: about this phasiness business

J. Laroche, Mark Dolson

Signal Processing · · cited 51× · DOI ↗ · more like this ·

The phase-vocoder is a well-known tool for the frequency domain processing of speech or audio signals, with applications such as time compression or expansion, pitch-scale modification, noise reduction, etc. In the context of time-scale or pitch-scale modification, the phase-vocoder is usually considered to yield high quality results, especially when large modification factors are used on polyphonic or non-pitched signals. However, the phase-vocoder is also known for an artifact that plagues its output, and has been described in the literature as either "phasiness", "reverberation", or "loss of presence". Research has been devoted to understanding and reducing this artifact, and solutions have been proposed which either significantly improve the quality of the output at the cost of a very high additional computation time, or are inexpensive but only marginally effective. This paper…

New Phase-Vocoder Techniques are Real-Time Pitch Shifting, Chorusing, Harmonizing, and Other Exotic Audio Modifications

Jean Laroche, Mark Dolson

Signal Processing · Journal of the Audio Engineering Society · · cited 45× · OpenAlex ↗ · more like this ·

The phase vocoder is a well-established tool for time-scaling and pitch shifting speech and audio signals. Its theory is now well understood and improvements have been proposed to reduce artifacts commonly encountered when time expanding signals by large factors. In the literature the phase vocoder has been described primarily as a tool for time scaling rather than pitch shifting, the latter usually being achieved by a combination of time scaling and sampling-rate conversion. The authors focus mainly on pitch-scale modifications of speech and audio signals and discuss the drawbacks of the standard time-scaling and resampling technique. Two alternative techniques are presented which reduce the complexity and computational cost significantly while offering dramatically extended capabilities. In particular, the new techniques, which operate solely in the frequency domain, enable chorusing…

Absolute pitch is demonstrated in speakers of tone languages

Diana Deutsch, Trevor Henthorn, Mark Dolson

Artificial Intelligence · The Journal of the Acoustical Society of America · · cited 27× · DOI ↗ · more like this ·

In two experiments, Vietnamese and Mandarin speakers manifested a precise form of absolute pitch in reading lists of words. In one experiment, seven Vietnamese speakers read out a list of ten words twice, on two separate days. The average pitch of each word was determined by computer analysis, and for each speaker comparisons were made between the average pitches produced by the same word on different days. Remarkable correspondences were obtained: For most speakers, the signed pitch difference, averaged across words, was well within a semitone. In another experiment, 15 Mandarin speakers read out a list of 12 words twice within a session, with the 2 readings separated by roughly 20 s; and in 2 sessions which were held on different days. Again, comparing across sessions, for most speakers the signed pitch difference, averaged across words, was well within a semitone. Furthermore, the…

About this phasiness business

Jean Laroche, Mark Dolson

Signal Processing · The Journal of the Abraham Lincoln Association · · cited 16× · OpenAlex ↗ · more like this ·

The phase-vocoder is a w ell-known tool for the frequency domain processing of speech or audio signals, with applications such as time-scale or pitch-scale modiaecation.In this context, the phasevocoder is usually considered to yield high-quality results, but is also known for an artifact that plagues its output, and has been described in the literature as either "phasiness", "reverberation", or "loss of presence".This paper examines the problem of phasiness in the context of time-scale modiaecation of signals, and presents a new phase synchronization scheme which is shown to both signiaecantly improve the sound quality, and reduce the computational cost of such modiaecations.

Machine Tongues XII: Neural Networks

Mark Dolson

Artificial Intelligence · Computer Music Journal · · cited 14× · DOI ↗ · more like this ·

Most computer users have become so accustomed to the standard von Neumann approach to computing that they rarely question the fundamental assumptions implicit in the underlying architecture. Foremost among these is the idea that a computer basically consists of a powerful and sophisticated central processing unit (CPU) with lots of peripheral memory. This model-common to the vast majority of computers to date-has at least two important implications. First, it means that as successive generations of CPUs and memory become progressively faster, the communication between them becomes the major bottleneck. Second, it means that using the computer always comes down to instructing the CPU to perform some particular sequence of operations involving various portions of memory. This latter point, in particular, has attracted much attention from computer scientists because it burdens the computer…

Reflections through Reflexivity: Why My Collaborative Research Project in Arctic Labrador Did Not Work

Mark S. Dolson

Sociology and Political Science · Collaborative anthropologies · · cited 4× · DOI ↗ · more like this ·

Reflections through ReflexivityWhy My Collaborative Research Project in Arctic Labrador Did Not Work Mark S. Dolson (bio) The best- laid plans o’ mice an’ men gang aft a-gley, an’ lea’e us nought but grief an’ pain for promised joy. —Robert Burns (1759–96) Collaborative ethnography is a complex affair, stratified into many layers of varying and constantly shifting intersubjective, moral, and political imperatives. Each bears the impress of negotiation, respect, and responsibility at every step of the often politically arduous and precarious process that characterizes collaborative fieldwork from start to open-ended—“unfinalizable” (cf. Bakhtin 1963)—finish. Community collaboration may consist (ideally, but not always) of the joint formulation and negotiation of the code of conduct regarding participant observations, establishing the research question, research protocols, style, and…

DISCRIMINATIVE NONLINEAR DIMENSIONALITY REDUCTION FOR IMPROVED CLASSIFICATION

Mark Dolson

Artificial Intelligence · International Journal of Neural Systems · · cited 3× · DOI ↗ · more like this ·

Multi-Layer Perception (MLP) neural networks have been used extensively for classification tasks. Typically, the MLP network is trained explicitly to produce the correct classification as its output. For speech recognition, however, several investigators have recently experimented with an indirect approach: a unique MLP predictive network is trained for each class of data, and classification is accomplished by determining which predictive network serves as the best model for samples of unknown speech. Results from this approach have been mixed. In this report, we compare the direct and indirect approaches to classification from a more fundamental perspective. We show how recent advances in nonlinear dimensionality reduction can be incorporated into the indirect approach, and we show how the two approaches can be integrated in a novel MLP framework. We further show how these new MLP…

Introduction

Mark Dolson

Public Administration · · cited 0× · DOI ↗ · more like this ·

That familiar steely blue-grey hue to the sky makes me feel cold—as it always does this time of year. It’s mid-November, and I’m downtown London (Ontario) again. My feet negotiate sometimes unwillingly with the undulating interlocked brick on Richmond Street. As I pass some of the smaller bookshops on the right-hand side, I always think to myself how they’re able to stay in business—there’s never anyone in them, besides staff. Startled by the piercing B flat of a car horn, I turn quickly and can see the tips of the oat-meal coloured office dividers on the second floor of the Ontario Works social assistance building. It’s only a block or so away from where I’m heading, which is the Youth Action Centre (YAC)—a drop in shelter for street-involved and homeless youth.

Transputer Implementation of the TRACE Model of Speech Recognition

Jeffrey L. Elman, Paul S. Smith, Mark Dolson

Artificial Intelligence · Defense Technical Information Center (DTIC) · · cited 0× · OpenAlex ↗ · more like this ·

We describe the accomplishments of the five-year project to develop an extended version of the TRACE model of speech recognition and to port it to a Transputer platform. We begin with an over view of the project. We then describe the TRACE Model. TRACE is an artificial neural network which attempts to model the processing of speech from acoustic input to word extraction, in a manner consistent with what is known of human perceptual abilities. Following that, we discuss the work done to extend and develop the model in the direction of real- time performance with an extended phonemic inventory. This includes algorithm changes to TRACE, software for managing the Transputer processors, a new acoustic/phonetic front-end, debugging and testing tools, and graphics visualization software.

Review: <i>Microcomputers and Music</i>, by Gary Wittlich, John Schaffer, and Larry Babb

Mark Dolson

Computer Vision and Pattern Recognition · Music Perception An Interdisciplinary Journal · · cited 0× · DOI ↗ · more like this ·

Book Review| April 01 1987 Review Microcomputers and MusicGary WittlichJohn SchafferLarry Babb Mark Dolson Mark Dolson Search for other works by this author on: This Site PubMed Google Scholar Music Perception (1987) 4 (3): 306–309. https://doi.org/10.2307/40285373 Views Icon Views Article contents Figures & tables Video Audio Supplementary Data Peer Review Share Icon Share Twitter LinkedIn Tools Icon Tools Get Permissions Cite Icon Cite Search Site Citation Mark Dolson; Review. Music Perception 1 April 1987; 4 (3): 306–309. doi: https://doi.org/10.2307/40285373 Download citation file: Ris (Zotero) Reference Manager EasyBib Bookends Mendeley Papers EndNote RefWorks BibTex toolbar search Search Dropdown Menu nav search search input Search input auto suggest search filter All ContentMusic Perception Search This content is only available via PDF. Article PDF first page preview Close Modal…

Computer microworlds for sound and music

Gerald J. Balzano, Mark Dolson

Computer Vision and Pattern Recognition · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

Computers are increasingly being used both for education in acoustics and for making music. But frequently the computer is used merely to automate an established paradigm. Thus we have the spectacle of music students using the computer as a drill-and-practice machine, of musicians using the computer as a sophisticated tape recorder, and of students in acoustics using the computer as a data-acquisition-and-plotting tool in laboratory experiments. In a more innovative “microworld” approach, the computer is the laboratory. In the SESAME project, we are designing a set of Structured Environments for Sound And Music Exploration in which students and professionals alike can use the computer to design their own musical and/or acoustical experiments. But this is feasible only with software that shields users from the machine-oriented details of conventional programming languages, allowing users…

A personal computer workstation for music education

Mark Dolson

Computer Vision and Pattern Recognition · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

Courses in acoustics and psychoacoustics are becoming increasingly common within the music curriculum. An introduction to these subjects enables students both to better understand the structure of traditional music and to explore contemporary alternatives to that structure. But the information in these courses is generally imparted to students exclusively by means of lecture/demonstration. This mode of presentation makes the material remote and difficult to absorb. A sufficiently powerful personal computer with analog-to-digital and digital-to-analog converters can overcome this problem by providing the student with a rich environment in which to explore the material directly. In this report we describe a major software-development project aimed at producing a coherent personal-computer-based workstation for sound analysis, synthesis, and modification. The software is written in C and…

Applications of digital signal processing in computer music

Gareth Loy, Mark Dolson

Computer Vision and Pattern Recognition · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

Recent developments in signal processing have opened many new lines of inquiry in computer music. Areas where signal processing techniques are appropriate include measurement and observation, signal representation, transformation, analysis, and synthesis of musical sound. Topics addressed in this paper include representational requirements for music, segmentation and analysis techniques such as linear predictive coding, the phase vocoder, data reduction, filtering, and synthesis. Examples will be given within the context of a digital signal processing paradigm developed at C.A.R.L. that tightly couples the facilities of UNIX operating system with research tools for computer music.

Modification of musical sounds by means of the phase vocoder

Mark Dolson

Signal Processing · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

The usefulness of the phase vocoder for performing time-scale modification of speech signals is well established. However, the application of the phase vocoder to musical signals is far less common. Musical applications of the phase vocoder differ from speech applications in several important respects: (1) Musical sampling rates are much higher; hence, minimization of computation and storage requirements is far more important. (2) Musical fidelity requirements are also much higher; this counteracts attempts to minimize computation and storage. (3) Musical applications often require analysis of individual harmonics; in this case, filter spacing must match harmonic spacing. (4) Pitch translation (as opposed to time-scale modification) requires spectral envelope estimation to sound convincing. (5) Musical signals may be polyphonic. (6) Lastly, musical applications frequently seek to…

The use of the phase vocoder in the analysis of ensemble sounds

Mark Dolson

Signal Processing · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

An important step in the synthesis of rich and interesting artificial timbres has been the analysis of natural instrument timbres. In this research, we analyze ensemble timbres (e.g., a violin section playing in unison) with a similar motivation. As in many studies of solo timbre, we present tones via an additive model in which the time-varying amplitudes and frequencies of individual partials are estimated by means of the phase vocoder. However, we show that changes in the actual amplitude or frequency of a given partial can significantly distort the phase vocoder estimates. Furthermore, we show that this distortion can be eliminated by the use of a tracking phase vocoder which automatically adjusts the analysis frequency to match the instantaneous frequency of the partial being analyzed. With the tracking phase vocoder, we analyze actual violin ensembles and show how they can be…

Spectral and perceptual features of a violin ensemble versus solo violin

Mark Dolson

Computer Vision and Pattern Recognition · The Journal of the Acoustical Society of America · · cited 0× · DOI ↗ · more like this ·

A violin section playing in unison sounds very different from a solo violin. This is true even when the comparison is carried out with a low-fidelity monaural sound reproduction system. Electronic instruments attempt to simulate this ensemble effect by summing several slightly detuned solo waveforms or by adding together several replicas of the solo waveform with a continuously varying random time delay. In this study, recordings were made of solo violins and violin ensembles playing both isolated and connected notes. The resulting waveforms were analyzed with a phase vocoder to extract the amplitude and frequency versus time for each harmonic. A variety of simulated ensemble sounds were also subjected to the same analysis. Those sounds which were perceived to be associated with an ensemble were then examined to identify the common features in terms of the phase vocoder analysis. This…