This page contains recorded examples of audio and touch experiences. These are completely manually generated mockups to demonstrate what we hope to be able to accomplish in the future, as machine learning algorithms improve and more underlying data is available along with graphics on the web.
Diagrams in textbooks and educational websites are often essential to the learning experience. In this example, a map of the solar system, with the planets orbiting the sun, conveys the ordering and relative sizes of the planets. Thermal haptic feedback can demonstrate the temperatures of the various planets in a much more direct way than simply reading about them, providing an experience richer than that delivered to sighted users simply looking at the graphic.
Objects are presented from left to right, loudness is mapped to object size.
Objects are presented in order of size, loudness is also mapped to object size.
Visual artworks such as paintings can be particularly difficult to capture using sound and touch. We are investigating methods of allowing artists and creators to produce their own custom audio-haptic experiences.
Presentation of objects from left to right with confidence mapped to loudness.