A new system to help the blind has been developed called EyeMusic, by a team of researchers at the Hebrew University of Jerusalem. The new EyeMusic sensory substitution devices (SSD) converts images into music, enabling the visually impaired to “see” using music.
The team of researchers and developers have programmed EyeMusic with a number of algorithms that use different musical instruments for five different colours, providing the wearer with music as the camera passes over colours.
How EyeMusic Works
The EyeMusic system uses white for vocals, blue for trumpets, red for reggae organ, green for synthesized reed, yellow for violin, and finally Black is represented by silence. This innovative approach allows users to interpret their surroundings through a symphony of sounds. For instance, a visually impaired person walking through a park might hear a blend of violins and synthesized reeds, indicating the presence of yellow flowers and green grass. This auditory feedback can help them navigate and understand their environment more effectively.
Team leaders Drs. Shelly Levy-Tzedek, an ELSC researcher at the Faculty of Medicine, Hebrew University, Jerusalem, and Prof. Amir Amedi explain:
“We demonstrated in this study that the EyeMusic, which employs pleasant musical scales to convey visual information, can be used after a short training period (in some cases, less than half an hour) to guide movements, similar to movements guided visually,”-“The level of accuracy reached in our study indicates that performing daily tasks with an SSD is feasible, and indicates a potential for rehabilitative use.”
Potential Applications and Future Developments
The potential applications of EyeMusic extend beyond simple navigation. For example, it could be used in educational settings to help visually impaired students understand visual concepts through sound. Art galleries and museums could also employ EyeMusic to make visual art accessible to those who cannot see. By translating colors and shapes into music, EyeMusic can offer a unique and enriching experience for the visually impaired.
Moreover, the technology could be integrated into smart glasses or other wearable devices, making it more convenient for daily use. Future developments might include the ability to recognize and translate more complex visual scenes, such as facial expressions or written text, into musical cues. This would further enhance the independence and quality of life for visually impaired individuals.
For more information jump over to the website for details.
Source: Gizmag
Latest Geeky Gadgets Deals
Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.
