Technology

The following is an overview of current Information Access Laboratory research and development projects. For more details about the projects and access to project publications and software, click on the title of the project.

Haptic Visualization - intended to make multidimensional mathematical concepts accessible to visually impaired individuals through haptic and multimodal scientific visualization. Current development focuses on utilizing the Phantom haptic interface in conjunction with sonification methodologies to develop a multiresolution multimodal visualization interface.

Tactile Image Processing - intended to provide visually impaired individuals access to image based information through tactile rendering of images. Such rendering transforms color and gray scale images into a binary format that can be displayed on a tactile device, such as microcapsule paper, and manually explored. Current work focuses on the development of multiresolution edge extraction algorithms and texture analysis.

Virtual Instruments - intended to provide improved access to computer controlled laboratory instruments. Current work focuses on developing speech and audio interfaces for LabVIEW controlled instruments. Additionally, remote access methods are being developed to allow Web based control of laboratory experiments and the creation of a virtual laboratory.

Classroom Speechreading Aid - intended to provide hearing impaired individuals continuous visual access to an educator's lips in an everyday classroom setting where lighting, positioning, background noise, and other conditions may hinder perception. In this system, live video of the educator's lips is provided through a heads up display or a small desktop monitor. Research includes speechreading and multimodal studies, pilot testing, and further development of the system.

Sign Language Video Communications - intended to provide the deaf and hard of hearing individuals the ability to communicate through guestures and sign language over telephone line and Internet connections. MPEG-4 content-based coding techniques are being developed to allow perceptually improved transmission of high motion sign language sequences over low bandwidth channels. Further development is focusing on real-time, two-way sign language video conferencing over low bandwidth channels with effective picture quality.

Animated Sign Language for Literacy - intended to investigate and understand the relationship of animated sign language and language acquisition and literacy with an emphasis on multimedia applications in an educational environment. One application of particular interest under development is that of a signed closed caption system for broadcast television.

Speech to Braille Computer Interpreter - intended to equip deaf-blind individuals with a means for communicating without the assistance of an interpreter. While interpreters are often available for formal events, such as classes, they are not always available for less structured learning situations like group study and informal discussion, or tutoring and mentoring. Current work focuses on combining speech recognition technologies with Braille displays to allow interpreter free communications.