Categorization of broadcast audio objects in complex auditory scenes

Woodcock, JS; Davies, WJ; Cox, TJ; Melchior, F

Abstract

This paper presents a series of experiments to determine a categorization framework for broadcast audio objects. Object-based audio is becoming an evermore important paradigm for the representation of complex sound scenes. However, there is a lack of knowledge regarding object level perception and cognitive processing of complex broadcast audio scenes. As categorization is a fundamental strategy in reducing cognitive load, knowledge of the categories utilized by listeners in the perception of complex scenes will be beneficial to the development of perceptually based representations and rendering strategies for object-based audio. In this study, expert and non-expert listeners took part in a free card sorting task using audio objects from a variety of different types of programme material. Hierarchical agglomerative clustering suggests that there are 7 general categories, which relate to sounds indicating actions and movement, continuous and transient background sound, clear speech, non-diegetic music and effects, vocalisations, and prominent attention grabbing transient sounds. A three dimensional perceptual space calculated via multidimensional scaling suggests that these categories vary along dimensions related to the semantic content of the objects, the temporal extent of the objects, and whether the object indicates the presence of people.

Citation

Woodcock, J., Davies, W., Cox, T., & Melchior, F. (2016). Categorization of broadcast audio objects in complex auditory scenes. Journal of the Audio Engineering Society, 64(6), 380-394. https://doi.org/10.17743/jaes.2016.0007

• Journal Article Type: Article
• Acceptance Date: Feb 23, 2016
• Publication Date: Jun 27, 2016
• Deposit Date: Feb 29, 2016
• Publicly Available Date: Jul 26, 2016
• Journal: Journal of the Audio Engineering Society
• Print ISSN: 1549-4950
• Publisher: Audio Engineering Society
• Volume: 64
• Issue: 6
• Pages: 380-394
• DOI: https://doi.org/10.17743/jaes.2016.0007
• Publisher URL: http://dx.doi.org/10.17743/jaes.2016.0007
• Related Public URLs: http://www.aes.org/journal/
• Additional Information: Funders : Engineering and Physical Sciences Research Council (EPSRC); Projects : S3A: Future Spatial Audio in the Home; Grant Number: EP/L000539/1