Anna Huang

Creativity through Interaction

Advances in Generative AI are making us rethink the impact of technology on the human creative process. How can we elicit creativity not through imitation but through interaction? First, I’ll illustrate how we can design generative models to better support music composition and performance synthesis. Coconet, the ML model behind the Bach Doodle, supports a nonlinear compositional process through an iterative block-Gibbs like generative procedure, while MIDI-DDSP supports intuitive user control in performance synthesis through hierarchical modeling. Second, I’ll propose a common framework, Expressive Communication, for evaluating how developments in generative models and steering interfaces are both important for empowering human-ai co-creation, where the goal is to create music that communicates an imagery or mood. Third, I’ll introduce the AI Song Contest and discuss some of the technical, creative, and sociocultural challenges musicians face when adapting ML-powered tools into their creative workflows. Looking ahead, I’m excited to co-design with musicians to discover new modes of human-ai collaboration. I’m interested in designing visualizations and interactions that can help musicians understand and steer system behavior, and algorithms that can learn from their feedback in more organic ways. I aim to build systems that musicians can shape, negotiate, and jam with in their creative practice.

Bio:
Anna is an associate professor at Massachusetts Institute of Technology, with a shared position in Music and Theater Arts (MTA) and Electrical Engineering and Computer Science (EECS). For the past eight years, she has been a researcher at Magenta in Google Brain and then Google DeepMind, spearheading efforts in generative modeling, reinforcement learning and human-computer interaction to support human-AI partnerships in music-making. She is the creator of Music Transformer and Coconet (which powered the Bach Doodle). In two days, Coconet harmonized 55 million melodies from users around the world. She was a judge and then organizer for the AI Song Contest. Anna held a Canada CIFAR AI Chair at Mila, has a BM in music composition and BS in computer science from the University of Southern California, an MS from the MIT Media Lab, and a PhD from Harvard University.