Music Interface using Webcam

webcam image processing music

Audio d-touch is making a collection of applications for real-time musical composition and performance freely available. Using a web-cam, computer, and printer, you can play sounds using image processing to recognize physical markers. You can visit the site below to get the application which includes a drum machine and a sampling sequencer, both are controlled by spatially arranging physical objects on an interactive table surface. Each object represents a sound, and its position with respect to the surface is mapped to certain playback parameters. For example, the horizontal position of an object represents the timing of the sound.

The system is freely available for download because it is part of an academic research project in human-computer interaction.  To make the research successful, they are trying to involve as many users as soon as possible.

You can download software here

Here’s a video of the application at work:

dtouch webcam music

dtouch webcam music

dtouch webcam music


3 Comments »

  • cocmpositeone said:

    Your link is broken its a got full stop in it. :s

    Anyone know if this is windows only? Don’t want to go through the registering to find I can’t use it. Couldn’t find any info on the site about what platform it runs on.

    • NA Admin said:

      Thanks. Fixed the link. They have a download for Windows and OS X. You can also contact them if you want to get the Linux version(looks like they don’t have an installer ready for it and you may need to do some troubleshooting).

  • Rosie Cross said:

    I am the Director of melody, a charity which promotes the value of instrumental playing for those with a learning disability. We run a project at Birmingham Conservatoire to give learning disabled people a chance to participate in creative music making, and, where appropriate, to learfn to play a musical instrument. The tutors are Conservatoire students who learn to work with learning dsiabled people.

    One of our tutors is a student of composition and has drawn your website to my attention. He thinks it would be very useful for a very autistic boy. Please could you let me know how much it would cost to buy the necessary equipment. We would be very happy to document the proceedings and be part of your research.

    Best wishes

    Rosie Cross


Leave a Comment!

Add your comment below, or trackback from your own site. You can also subscribe to these comments via RSS.

Be nice. Keep it clean. Stay on topic. No spam.

You can use these tags:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

This is a Gravatar-enabled weblog. To get your own globally-recognized-avatar, please register at Gravatar.