Shalom Life | April 22, 2014

EyeMusic: An Israeli App That Lets the Blind 'Hear' Images

Hebrew University researchers have developed a sensory substitution device which lets one hear pleasant musical notes, conveying info about colours, shapes, location of objects, etc.

By: Laura London

Published: April 7th, 2014 in Business » Israel

In the world of Marvel Comics, blind superhero Daredevil is able to fight crime using his other senses, which were heightened to super-human levels due to his blindness. While that may be complete fiction, it turns out that you can use other senses, such as sound, to help the blind “see” their surroundings.

In order for the blind to perceive colors or shapes, Hebrew University researchers use a sensory substitution device (SSD) that transforms images into pieces of music, enabling the blind to “hear” pictures. With the new EyeMusic SSD app (available on the App Store) one hears pleasant musical notes, which convey information about colors, shapes and location of objects in the world.

The system uses different pitch level notes and specific timing to convey the images. The higher the pitch is – the higher the pixels on a vertical level. On the horizontal plane, the notes played first represent the left side of the image and the notes towards the end represent the right side of the image. Color is transformed into different instruments, so soft vocals would be white, a trumpet is blue and silence means black.

Regain “sight” within three hours

In recent studies, blind and blindfolded sighted users were shown to correctly perceive and interact with objects using EyeMusic. Participants were able to recognize different shapes and colors or reach for a specific beverage:


Professor Amir Amedi, Head of the Center for Human Perception and Cognition at the Hebrew University of Jerusalem, developed the technology for the blind and visually impaired. Amedi says that using the SSD and a unique training program, the blind are able to achieve various advanced visual-linked abilities in two to three hours of training.

“The human brain is more flexible than we thought,” says Amedi. “These results give a lot of hope for the successful regaining of visual functions using cheap non-invasive SSDs or other sight restoration approaches. They suggest that in the blind, brain areas have the potential to be ‘awakened’ to processing visual properties and tasks even after years or maybe even lifelong blindness, if the proper technologies and training approaches are used.”

Tasks, not senses

Past studies have validated that the blind can characterize sound-conveyed images into complex object categories such as faces, houses and outdoor scenes, plus everyday objects and could locate people’s positions, identify facial expressions and read letters and words.

The Hebrew University research has shown that many brain areas are characterized by their computational task, meaning they can be activated using senses other than the one commonly used for a certain task. These areas can be awakened even in people who were never exposed to “original” sensory information at all, such as a person who’s blind from birth.

Helping the blind and understanding the brain

When processing “visual information” conveyed through SSD, the researchers found that congenitally blind people who learned to read by touch using the Braille script or through their ears with sensory substitution devices use the same areas in the visual cortex as those used by sighted readers.

The researchers hope EyeMusic can become a tool for future neuroscience research and holds great promise for the field of visual rehabilitation.

“The utilization of the EyeMusic and its added color information in the field of neuroscience could facilitate exploring several questions in the blind with the potential to expand our understanding of brain organization in general,” says Amedi.

The work of Amedi and his colleagues is patented by Yissum, the Hebrew University’s Technology Transfer Company.

Reprinted with permission from NoCamels - Israeli Innovation News

WhatsApp Hits 500 Million Active Users Trending Game of Thrones Given 'Google Maps' Treatment Trending Miss A Seder, Take Home $1 Million Trending
 

Israeli Wi-Fi Powers Russian Subways

April 22, 2014 | By Daniel Koren
Israeli Wi-Fi Powers Russian Subways

Passengers aboard subways in in Moscow enjoy Wi-Fi courtesy of Israeli communications provider, Radwin

Read More

Israeli Comedian on 4.20: Let My People Smoke! [VIDEO]

April 22, 2014 | By Daniel Koren

Gadi Wilcherski and a group of Israeli pot advocates campaigned outside Health Minister Yael German's house early Sunday morning

Read More

Shalom, French Polynesia: A Jewish Culture Guide

April 22, 2014 | By Sarah Bauder

Approximately 130 islands comprise French Polynesia, with Tahiti being the most famous, largest, and most populated.

Read More

Katy Perry Impersonates Unfunny Rabbi in ‘Birthday’ Music Video [VIDEO]

April 22, 2014 | By Ashley Baylen

The pop star takes on a number of the "World's Worst Birthday Party Entertainers"

Read More

Seth Rogen and James Franco to Perform ‘Bound 2’ Spoof at Kim Kardashian Wedding?

April 22, 2014 | By Ashley Baylen
Seth Rogen and James Franco to Perform ‘Bound 2’ Spoof at Kim Kardashian Wedding?

Franco shared some interesting intel about the Kardashian/West wedding on 'The View'.

Read More

Drake to Join Pharrell and Kendrick Lamar at iHeart Radio Music Awards

April 22, 2014 | By Ashley Baylen

NBC has announced several big names for iHeart Radio's inaugural event

Read More

David Foster Wallace’s Estate Opposes Upcoming Segel and Eisenberg Biopic

April 22, 2014 | By Ashley Baylen

Wallace's family and literally trust "have no connection with, and neither endorse nor support" the film entitled 'The End of the Tour'.

Read More

Missouri Mayor Resigns After Siding with Kansas Shooter

April 22, 2014 | By Daniel Koren

After saying that he "kind of agreed" with 73-year-old former white supremacist Frazier Glenn Miller, Dan Clevenger has now renounced his position as Mayor of Marionville

Read More

More Headlines