Expressive and Interactive Music Performance

Abstract:

As both a computer scientist and a musician, Gus Xia designs intelligent systems that understand and extend human musical expression. To "understand" means to model the musical expression conveyed through acoustic, gestural, and emotional signals. To "extend" means to use this understanding to create expressive, interactive, and autonomous agents, serving both amateur and professional musicians.  In particular, Xia creates interactive performers that are able to perform expressively in concert with humans by learning musicianship from rehearsal experience. Xia's study unifies machine learning and knowledge representation of music structure and performance skills in an HCI framework. In this talk, Xia will go over the learning techniques and present robot musicians capable of playing interactively with humans while generating facial and gestural expressions. At the end, Xia will show the potential impacts of this study on the future of music appreciation, performance, and education.

NYU Shanghai STEM seminar series is a weekly seminar series on every Wednesday. Please see below schedule of STEM seminar series in 2017 Fall Semester.

• October 11: Gerard Ben Arous, Professor of Mathematics
• October 18: Gus Xia, Assistant Professor of Computer Science
• October 25: Brad Weslake, Associate Professor of Philosophy
• November 1: William Glover, Assistant Professor of Chemistry
• November 8: Chuck Newman, Professor of Mathematics & Vladas Sidorvicius, Professor of Mathematics
• November 15: Tim Byrnes, Assistant Professor of Physics
• November 29: Xing Tian, Assistant Professor of Neural and Cognitive Sciences & Zheng Zhang, Professor of Computer Science
• December 6: Yves Le Jan, Visiting Professor of Mathematics