Perceptual Considerations in Audio Morphing
Research Student: Dr Duncan Williams
Principal Supervisor: Dr Tim Brookes
Start date: 2004
End date: 2010
Project Outline
A prototype timbre morpher has been designed, developed, and evaluated. The prototype morpher is capable of adjusting the timbre of a source sound toward that of a target sound specifically in terms of its brightness, softness, and/or warmth, independently from other perceptual attributes, and provides a novel tool for sound design and composition.
A literature review revealed that several different paradigms of timbre exist. Consideration of the alternatives led to the conclusion that a multidimensional paradigm of timbre, comprising attributes with both meaningful descriptors and specific acoustic correlates was the most suitable for the development of the timbre morpher. In order to develop the prototype morpher, a range of attributes with spectral, temporal, independent, and overlapping acoustic correlations was required. The most suitable candidate attributes were brightness, softness, and warmth.
Various computer implementations of cross-synthesis, audio morphing, and sound hybridisation were investigated to inform the selection of a suitable platform for the prototype timbre morpher. Spectral Modelling Synthesis was found to be the most suitable alternative, partly as a result of its fast processing speed.
Three iterations of the prototype morpher were developed in MATLAB, creating a complete system capable of selectively adjusting the acoustic correlates of each of the chosen timbral attributes.
A review of literature relating to perceptual evaluation methodologies established that a combination of Multidimensional Scaling and Verbal Protocol Analysis was the most suitable approach with which to evaluate the prototype morpher. Through a series of listener evaluations involving stimuli created by the morpher, this approach, combined with a third quality control experimental stage, demonstrated that brightness, softness, and warmth can each be morphed independently of each other.
Using the procedures devised in this thesis, a complete morpher, controlling the full range of possible timbral attributes, can now be developed, coded and evaluated.
Publications
- Williams, D. (2010) Towards a Timbre Morpher. Doctoral thesis, University of Surrey (United Kingdom).
- Brookes T, Williams D. (2010) 'Perceptually-Motivated Audio Morphing: Warmth'. Audio Engineering Society Convention Proceedings, Paper 8019, London, UK: AES 128th Convention
Full text is available at: epubs.surrey.ac.uk/712912 - Williams D, Brookes T. (2010) 'Testing a prototype timbre morpher'. London: DMRN+4: Digital Music Research Network
- Williams D, Brookes T. (2009) 'Perceptually-motivated audio morphing: softness'. Audio Engineering Society Convention Proceedings, Paper 7778, Munich, Germany: AES 126th Convention
Full text is available at: epubs.surrey.ac.uk/712916 - Williams D, Brookes TS. (2007) 'Perceptually-Motivated Audio Morphing: Brightness'. Audio Engineering Society Vienna: 122nd Audio Engineering Society Convention Convention Paper 7035
Full text is available at: epubs.surrey.ac.uk/856829