What does 'Evaluation' mean for the NIME community?

Jeronimo Barbosa, Joseph Malloch, Marcelo Wanderley, and Stéphane Huot

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2015
• Location: Baton Rouge, Louisiana, USA
• Pages: 156–161
• DOI: 10.5281/zenodo.1179010 (Link to paper)
• PDF link
• Supplementary File 1: 0301-file1.xlsx

Abstract:

Evaluation has been suggested to be one of the main trends in current NIME research. However, the meaning of the term for the community may not be as clear as it seems. In order to explore this issue, we have analyzed all papers and posters published in the proceedings of the NIME conference from 2012 to 2014. For each publication that explicitly mentioned the term evaluation, we looked for: a) What targets and stakeholders were considered? b) What goals were set? c) What criteria were used? d) What methods were used? e) How long did the evaluation last? Results show different understandings of evaluation, with little consistency regarding the usage of the word. Surprisingly in some cases, not even basic information such as goal, criteria and methods were provided. In this paper, we attempt to provide an idea of what evaluation means for the NIME community, pushing the discussion towards how could we make a better use of evaluation on NIME design and what criteria should be used regarding each goal.

Citation:

BibTeX Entry:

  @inproceedings{jbarbosa2015,
 abstract = {Evaluation has been suggested to be one of the main trends in current NIME research. However, the meaning of the term for the community may not be as clear as it seems. In order to explore this issue, we have analyzed all papers and posters published in the proceedings of the NIME conference from 2012 to 2014. For each publication that explicitly mentioned the term evaluation, we looked for: a) What targets and stakeholders were considered? b) What goals were set? c) What criteria were used? d) What methods were used? e) How long did the evaluation last? Results show different understandings of evaluation, with little consistency regarding the usage of the word. Surprisingly in some cases, not even basic information such as goal, criteria and methods were provided. In this paper, we attempt to provide an idea of what evaluation means for the NIME community, pushing the discussion towards how could we make a better use of evaluation on NIME design and what criteria should be used regarding each goal.},
 address = {Baton Rouge, Louisiana, USA},
 author = {Jeronimo Barbosa and Joseph Malloch and Marcelo Wanderley and St\'ephane Huot},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1179010},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {156--161},
 publisher = {Louisiana State University},
 title = {What does 'Evaluation' mean for the NIME community?},
 url = {http://www.nime.org/proceedings/2015/nime2015_301.pdf},
 urlsuppl1 = {http://www.nime.org/proceedings/2015/301/0301-file1.xlsx},
 year = {2015}
}