A demonstration of super high-speed face mapping at 1000 frames per second has been published via the Vimeo video website takes the form of the breathtaking INORI (Prayer).
Check it out embedded below to see what can be created using the latest faced mapping technology thanks to a collaboration between AYABAMBI and Ishikawa Watanabe Lab based in Tokyo Japan, who responded to the call for collaboration by Nobumichi Asai (WOW).
First, the soundtrack was composed according along the theme “Life”. Nobumichi Asai and Shingo Abe was inspired by the music and then made face mapping work. Aya Sato designed choreography. TOKYO completed the project by making the video work.
The music brought Asai the image of “the radioactive.” The destructive force of the radioactive could cause “death,” “suffering,” and “sorrow.” And “prayers” could overcome them. These subjects infuse AYABAMBI’s powerful performance. Their performance crushes and conquer black tears, skulls and the Heart Sutra. We built up the concept during the production and Abe designed animation for face mapping.
There was a big challenge in technical aspects. We realized the new mapping system that allows us to follow intense performances by using the latest 1,000 fps projector, DynaFlash(*1) and a super speed sensor. It is very new and it had not been done before. Projected images become part of their skin and they transform their faces.
At the beginning of our development, there was an issue, AYABAMBI would loose freedom of performances if we accelerated the tracking speed. Asai, Yoshimura (WOW), Lecturer Watanabe and Teshima (EXVISION) explored how we could keep the tracking speed securing the freedom of performances, taking three months of trial and error to reduce a few milliseconds. And we finally developed this system(*2).*
*1 “DynaFlash” is developed jointly by Ishikawa Watanabe Laboratory, the University of Tokyo and is commercialized by Tokyo Electron Device Limited.
*2 For tracking hands, we use the dynamic projection mapping technology developed by Ishikawa Watanabe Laboratory, the University of Tokyo. For tracking faces, we use the face mapping technology developed by the visual design studio, WOW inc.