Affective Calibration of Musical Feature Sets in an Emotionally Intelligent Music Composition System

Williams, Duncan; Kirke, Alexis; Miranda, Eduardo; Daly, Ian; Hwang, Faustina; Weaver, James; Nasuto, Slawomir

Abstract

Affectively driven algorithmic composition (AAC) is a rapidly growing field that exploits computer-aided composition in order to generate new music with particular emotional qualities or affective intentions. An AAC system was devised in order to generate a stimulus set covering nine discrete sectors of a two-dimensional emotion space by means of a 16-channel feed-forward artificial neural network. This system was used to generate a stimulus set of short pieces of music, which were rendered using a sampled piano timbre and evaluated by a group of experienced listeners who ascribed a two-dimensional valence-arousal coordinate to each stimulus. The underlying musical feature set, initially drawn from the literature, was subsequently adjusted by amplifying or attenuating the quantity of each feature in order to maximize the spread of stimuli in the valence-arousal space before a second listener evaluation was conducted. This process was repeated a third time in order to maximize the spread of valence-arousal coordinates ascribed to the generated stimulus set in comparison to a spread taken from an existing prerated database of stimuli, demonstrating that this prototype AAC system is capable of creating short sequences of music with a slight improvement on the range of emotion found in a stimulus set comprised of real-world, traditionally composed musical excerpts.

Citation

Williams, D., Kirke, A., Miranda, E., Daly, I., Hwang, F., Weaver, J., & Nasuto, S. (2017). Affective Calibration of Musical Feature Sets in an Emotionally Intelligent Music Composition System. ACM transactions on applied perception, 14(3), 1-13. https://doi.org/10.1145/3059005

• Journal Article Type: Article
• Online Publication Date: May 10, 2017
• Publication Date: Jul 31, 2017
• Deposit Date: Oct 23, 2023
• Journal: ACM Transactions on Applied Perception
• Print ISSN: 1544-3558
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Volume: 14
• Issue: 3
• Pages: 1-13
• DOI: https://doi.org/10.1145/3059005