An interesting new concept has been developed by Bruno Zamborlin’s called, Mogees (an abbreviation of “mosaicing gestural surface”). Which has been designed to enable multitouch gesturing on nearly any surface you can think of from glass to wood. Watch the video of the concept in action after the jump, to get a better understanding of the system.
Through gesture recognition techniques the system can detect different kind of fingers-touch and associate them with different sounds. It can also recognise objects that emit a sound, such as the coin
Zamborlin explains: In the video we used two different audio synthesis techniques:
1- physic modelling, which consists in generating the sound by simulating physical laws;
2- concatenative synthesis (audio mosaicing), in which the sound of the contact microphone is associated with its closest frame present in a sound database.