Gesture-sound interaction in digital media

This event will be delivered by Frederic Bevilacqua, Head of the Real-Time Musical Interactions Team IRCAM- Centre Pompidou, STMS-CNRS UPMC Paris, France

Frederic will present an overview of the research and applications performed by the Real-Time Musical Interactions Team of IRCAM (Paris).


We have developed for the last seven years various methods and tools for computer-based gesture analysis, with the general goal to use body movements to interact with sonic and/or visual environments. This research has largely been influenced by sustained collaborations with musicians/composers and dancers/choreographers.

We will present some of these works, focusing on gesture research and interfaces. In particular, we will present the cases of musical interfaces and various experiments we have been carried on in music pedagogy. We will also present dance performances and interactive installations we have collaborated on.

In music, we studied physical gestures of musicians such as the bow movement of violin players. This allowed us to formalize key concepts about continuous gesture control, gesture vocabulary and co-articulation (similarly to speech production). This fundamental research led us to design augmented instruments, incorporating these challenging concepts. In parallel, we are designing new interfaces and paradigms to control sonic environments, individually or collectively. In particular, we are developing tools to re-perform sound and music with such interfaces. In particular, we developed a "gesture follower" system that allows for the recognition and synchronization of gestures with sound materials.

In dance, we will present performances and installations, where we used the same technology than for music. While designed with different goals and aesthetics, two of them use a similar interaction principle: the visitor is invited to dance “imitating” dance material displayed on a large screen. This brings us back to open questions with musical interfaces: how can we learn gestures and the interaction with digital media, and how this affects our gesture and sound perception?

Event Information

Location: LG01, New Academic Building
Department: Computing
Time: 30 March 2011, 14:00 - 15:00

For Further Details

E-mail: m.gillies

If you are attending an event and need the College to help with any mobility requirements you may have, please contact the event organiser in advance to ensure we can accommodate your needs.

View all events for week 13
View all events for March 2011
Back to today's events
Search events
Log in

Content last modified: 06 Jan 2012

Goldsmiths, University of London, New Cross, London, SE14 6NW, UK
Telephone: + 44 (0)20 7919 7171

Goldsmiths has charitable status

© 2000- Goldsmiths, University of London. Copyright, Disclaimer and Company information | Statement on the use of cookies by Goldsmiths