[ Technology ] | [ Papers ] | [ Get Involved ] | [ Home ]

Animated Sign Language to Literacy

This project investigates the potential for using animated sign language to assist students with deafness in acquiring proficient literacy skills. The acquisition of these skills is often a significant problem faced by students who are deaf at an early age. Some research suggests that the success of students in the math and sciences is strongly related to his/her having mastered the most fundamental tool for access; language.

Work on this project explores the use of computer animations of sign language to aid in the learning of English words and English grammar, as well as in the augmenting of educational multimedia with closed captioning. Animations superimposed on video recordings of science and mathematics videos used in various curriculum are being studied. Students view materials with text captions and with animated sign captions. Comparisons are made based on comprehension and subjective opinions.

This work also explores patterns in which students may attend while viewing the information presented. Studies include the tracking of students eye-gaze to gain a better understanding for how he/she focuses on text and animated captions.

Papers and Publications

Staff

Rick Foulds PhD., Principle Investigator
Ken Barner PhD., Principle Investigator