Musical Composition by Regressional Mapping of Physiological Responses to Acoustic Features

D. J. Valtteri Wikström

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper an emotionally justified approach for controlling sound with physiology is presented. Measurements of listeners' physiology, while they are listening to recorded music of their own choosing, are used to create a regression model that predicts features extracted from music with the help of the listeners' physiological response patterns. This information can be used as a control signal to drive musical composition and synthesis of new sounds an approach involving concatenative sound synthesis is suggested. An evaluation study was conducted to test the feasibility of the model. A multiple linear regression model and an artificial neural network model were evaluated against a constant regressor, or dummy model. The dummy model outperformed the other models in prediction accuracy, but the artificial neural network model achieved significant correlations between predictions and target values for many acoustic features.

Citation:

D. J. Valtteri Wikström. 2014. Musical Composition by Regressional Mapping of Physiological Responses to Acoustic Features. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178981

BibTeX Entry:

  @inproceedings{dwikstrom2014,
 abstract = {In this paper an emotionally justified approach for controlling sound with physiology is presented. Measurements of listeners' physiology, while they are listening to recorded music of their own choosing, are used to create a regression model that predicts features extracted from music with the help of the listeners' physiological response patterns. This information can be used as a control signal to drive musical composition and synthesis of new sounds an approach involving concatenative sound synthesis is suggested. An evaluation study was conducted to test the feasibility of the model. A multiple linear regression model and an artificial neural network model were evaluated against a constant regressor, or dummy model. The dummy model outperformed the other models in prediction accuracy, but the artificial neural network model achieved significant correlations between predictions and target values for many acoustic features.},
 address = {London, United Kingdom},
 author = {D. J. Valtteri Wikstr\''om},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178981},
 issn = {2220-4806},
 month = {June},
 pages = {549--552},
 publisher = {Goldsmiths, University of London},
 title = {Musical Composition by Regressional Mapping of Physiological Responses to Acoustic Features},
 url = {http://www.nime.org/proceedings/2014/nime2014_311.pdf},
 year = {2014}
}