Talks and Poster Presentations (with Proceedings-Entry):
R. Vogl, H. Eghbal-Zadeh, G. Widmer, P. Knees:
"GANs and Poses: An Interactive Generative Music Installation Controlled by Dance Moves";
Poster: 19th International Society for Music Information Retrieval Conference: Interactive Machine-Learning for Music @Exhibition,
Paris, France;
2018-09-23
- 2018-09-27; in: "19th International Society for Music Information Retrieval Conference: Interactive Machine-Learning for Music @Exhibition",
(2018),
5 pages.
English abstract:
GANs and Poses is an interactive multi-media installation using human poses to control artificial neural networks generating parts for a music arrangement. To provide incentive for interaction, a game-style UI rewards the audience with audio-visual feedback, which in turn drives the progress through the musical arrangement. This work uses a variety of artificial neural networks to (i) detect persons and their body posture, (ii) classify dance moves, and (iii) generate drum as well as melody patterns.
Electronic version of the publication:
http://ismir2018.ircam.fr/doc/pdfs2/vogl.pdf
Related Projects:
Project Head Peter Knees:
SmarterJam
Created from the Publication Database of the Vienna University of Technology.