March 23, 2012

When most of us get lost in unfamiliar territory – a hotel, for example – we consult a map to orient ourselves. But for the blind it's not so easy. With this in mind, researchers have developed a virtual gaming platform that uses other sensory cues to help blind individuals develop mental maps of new surroundings before visiting them in person.

The game platform uses virtual layouts of actual public buildings. Like a level map in a computer game, the simulated environment can be explored with a keyboard (future interfaces will use joysticks, or motion controllers like the Wii remote), but instead of using visual feedback to navigate, players don headphones and rely on auditory cues to orient themselves spatially. Players are then given a mission objective: find jewels within the building and carry them back outside, while avoiding building-roaming monsters who steal the jewels and hide them in a different location. Over time, this interaction helps the player generate an accurate mental layout not just of the simulated building, but its real-world counterpart.