Towards a Virtual Assistant for Performers and Stage Directors

Alain Bonardi, Isis Truck, and Herman Akdag

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this article, we present the first step of our research work todesign a Virtual Assistant for Performers and Stage Directors,able to give a feedback from performances. We use amethodology to automatically construct fuzzy rules in a FuzzyRule-Based System that detects contextual emotions from anactor's performance during a show. We collect video data from a lot of performances of the sameshow from which it should be possible to visualize all the emotions and intents or more precisely "intent graphs". To perform this, the collected data defining low-level descriptors are aggregated and converted into high-level characterizations. Then, depending on the retrieved data and on their distributionon the axis, we partition the universes into classes. The last stepis the building of the fuzzy rules that are obtained from the classes and that permit to give conclusions to label the detected emotions.

Citation:

Alain Bonardi, Isis Truck, and Herman Akdag. 2006. Towards a Virtual Assistant for Performers and Stage Directors. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176875

BibTeX Entry:

  @inproceedings{Bonardi2006,
 abstract = {In this article, we present the first step of our research work todesign a Virtual Assistant for Performers and Stage Directors,able to give a feedback from performances. We use amethodology to automatically construct fuzzy rules in a FuzzyRule-Based System that detects contextual emotions from anactor's performance during a show. We collect video data from a lot of performances of the sameshow from which it should be possible to visualize all the emotions and intents or more precisely "intent graphs". To perform this, the collected data defining low-level descriptors are aggregated and converted into high-level characterizations. Then, depending on the retrieved data and on their distributionon the axis, we partition the universes into classes. The last stepis the building of the fuzzy rules that are obtained from the classes and that permit to give conclusions to label the detected emotions.},
 address = {Paris, France},
 author = {Bonardi, Alain and Truck, Isis and Akdag, Herman},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176875},
 issn = {2220-4806},
 keywords = {Virtual Assistant, Intents, Emotion detector, Fuzzy Classes, Stage Director, Performance. },
 pages = {326--329},
 title = {Towards a Virtual Assistant for Performers and Stage Directors},
 url = {http://www.nime.org/proceedings/2006/nime2006_326.pdf},
 year = {2006}
}