TY - JOUR
T1 - A machine learning approach to hierarchical categorization of auditory objects
AU - Coleman, William
AU - Delany, Sarah Jane
AU - Yan, Ming
AU - Cullen, Charlie
N1 - Publisher Copyright:
© 2020 Audio Engineering Society. All rights reserved.
PY - 2020/2
Y1 - 2020/2
N2 - With the advent of new audio delivery technologies comes opportunities and challenges for content creators and providers. The proliferation of consumption modes (stereo headphones, home cinema systems, ‘hearables’), media formats (mp3, CD, video and audio streaming), and content types (gaming, music, drama and current affairs broadcasting) has given rise to a complicated landscape where content must often be adapted for multiple end use scenarios. The concept of object-based audio envisages content delivery not via a fixed mix but as a series of auditory objects which can then be controlled either by consumers or content creators and providers via accompanying metadata. Such a separation of audio assets facilitates the concept of Variable Asset Compression (VAC) where the most important elements from a perceptual standpoint are prioritized before others. In order to implement such a system, however, insight is first required into what objects are most important and secondly how this importance changes over time. This paper investigates the first of these questions, the hierarchical classification of isolated auditory objects, using machine learning techniques. We present results that suggest audio object hierarchies can be successfully modeled and outline considerations for future research.
AB - With the advent of new audio delivery technologies comes opportunities and challenges for content creators and providers. The proliferation of consumption modes (stereo headphones, home cinema systems, ‘hearables’), media formats (mp3, CD, video and audio streaming), and content types (gaming, music, drama and current affairs broadcasting) has given rise to a complicated landscape where content must often be adapted for multiple end use scenarios. The concept of object-based audio envisages content delivery not via a fixed mix but as a series of auditory objects which can then be controlled either by consumers or content creators and providers via accompanying metadata. Such a separation of audio assets facilitates the concept of Variable Asset Compression (VAC) where the most important elements from a perceptual standpoint are prioritized before others. In order to implement such a system, however, insight is first required into what objects are most important and secondly how this importance changes over time. This paper investigates the first of these questions, the hierarchical classification of isolated auditory objects, using machine learning techniques. We present results that suggest audio object hierarchies can be successfully modeled and outline considerations for future research.
UR - http://www.scopus.com/inward/record.url?scp=85090177908&partnerID=8YFLogxK
U2 - 10.17743/JAES.2020.0001
DO - 10.17743/JAES.2020.0001
M3 - Article
AN - SCOPUS:85090177908
SN - 1549-4950
VL - 68
SP - 48
EP - 56
JO - AES: Journal of the Audio Engineering Society
JF - AES: Journal of the Audio Engineering Society
IS - 1-2
ER -