Embedded AI for NIME: Challenges and Opportunities
Workshop at NIME 2022
Organisers: Teresa Pelinski, Victor Shepardson, Steve Symons, Franco S. Caspe, Adan L. Benito Temprano, Jack Armitage, Chris Kiefer, Rebecca Fiebrink, Thor Magnusson, and Andrew McPherson
Emute Lab - Intelligent Instruments Lab - Augmented Instruments Lab
Thank you!
We would like to thank the NIME 2022 organizers for the opportunity of hosting this Workshop, and the presenters and attendees for sharing their work and for many interesting discussions. We hope this first approach into embedded AI for NIME has sparkled new ideas and shed some light on the challenges and opportunities brought by these technologies to the practices of researchers, musicians and makers.
More info and shared material:
- The accepted extended abstracts can be found in the Accepted Submissions section.
- For insight on the discusisons that took place please check out the sessions' Padlet.
- Finally, we have recorded and uploaded the Workshop's sessions for anyone to check out.
- We hope to continue exploring this field, and fostering the community with a future, fully open event. Stay Tuned !
Workshop Session 1
Workshop Session 2
Welcome
With this Workshop we aim to bring together researchers with the common interest of working with and developing embedded AI for New Interfaces for Musical Expression (NIME), and to jointly identify the challenges, trends, and technologies in use. Furthermore, we expect it to serve as the starting point for an embedded AI NIME community and as future reference to help newcomers get started with embedded AI.
Schedule
The Workshop took place on Tuesday, 28th June.
Times are in UTC+1 (London)
Session 1 (12:00 - 15:00)
| Start | Activity | Speakers |
|---|---|---|
| 12:00 | Welcome and introduction | |
| 12:05 | Considering Ethics, Culture and Invention in Embedded AI Research for NIME | Jack Armitage |
| 12:25 | Embedded AI: Some unconventional considerations for the NIME space | Rebecca Fiebrink |
| 12:45 | Classification and Neural Audio Synthesis on a Raspberry Pi: a Practice-based-Research Enquiry | Mark Hanslip |
| 13:00 | The Neuralacoustics Project: Exploring Deep-Learning for Lightweight Numerical Modeling Synthesis | Victor Zappi and Kıvanç Tatar |
| 13:15 | Embedded Real-Time Expressive Guitar Technique Recognition | Domenico Stefani |
| 13:30 | Break | |
| 13:45 | DDSP Here, There and Everywhere | Lamtharn "Hanoi" Hantrakul |
| 14:00 | Embedding Embodied Music Generation | Charles Martin |
| 14:15 | Discussion | |
| 14:55 | Closing |
Session 2 (19:00 - 22:00)
| Start | Activity | Speakers |
|---|---|---|
| 19:00 | Welcome and introduction | |
| 19:05 | Considering Ethics, Culture and Invention in Embedded AI Research for NIME | Jack Armitage |
| 19:25 | Embedded AI: Some unconventional considerations for the NIME space | Rebecca Fiebrink |
| 19:45 | Bela AI Toolbench | Ezra Pierce |
| 20:00 | Deep Learning for Bela | Rodrigo Diaz |
| 20:15 | Tensil.ai | Tom Alcorn |
| 20:30 | Break | |
| 20:45 | Real-time DNN-based analysis at audio rate | Andrea Martelloni |
| 21:00 | Real-time FM tone transfer with Bela | Franco Caspe |
| 21:15 | Discussion | |
| 21:55 | Closing |
Get in touch :)
We use the Intelligent Instruments Lab Discord server(look for the #embedded channel)