Creating and sharing knowledge for telecommunications

Seeing through your ears

on 26-07-2016

... João Pereira, from IT in Leiria and Nuno Almeida, from ESTG/IP Leiria, are developing a device that will allow blind people seeing through three-dimensional sounds. The device allows estimating the shape of real objects or the depth of scenarios, intended for the visually impaired or people lacking three-dimensional perception in unlit spaces.

While resembling headphones, the device actually includes a pair of 3D ultrasound scanners, a pair of visible light and infrared 3D scanners, and three pairs of speakers. The system calculates the distance from every point in the scenario to the user and generates a sound with proportional audible frequency. The farther is the point, the lower is its audible frequency and vice-versa. The layout of the speakers near the ears and the appropriate signal processing allows to provide the user with a spacial representation of the scenario through audible sounds of different frequencies.

Preliminary tests of the device allow to clearly identifying simple objects. Of course some training is required for complex shapes and scenarios. A provisional patent application was already submitted for the prototype of the device "Conversion of 3D objects and three-dimensional scenarios in 3D sound sources".

João Pereira said that he intends to incorporate this device in the autonomous wheel chair he also developed, so as to allow blind people driving it.

IT has now three IET Fellows

on 04-11-2015

... Rafael Caldeirinha, from the Instituto Politécnico de Leiria, received the Fellowship status from IET in the beginning of this month.

He is now the third researcher from IT receiving this Fellowship, along with Jonathan Rodriguez from IT in Aveiro and Fernando Pereira from Instituto Superior Técnico, all in 2015.