Sounds that are difficult to hear can be made more audible by increasing the volume. What is the same effect for visual component of speech? We know that lipreading is notoriously difficult, especially for untrained viewers. We have been looking at techniques for making lipreading tasks easier.

In particular, we've been looking to see if the visual gestures that accompany speech are exaggerated, is the resultant visual speech easier to lipread? That is, does exaggerating visual gestures (opening the mouth further, rounding the lips more, etc.) have the same effect in the visual modality as increasing the volume in the auditory modality?

Demos

Example sequences that demonstrate our approach for exaggerating visual speech gestures can be found here:

Pre Processed Video 1

Post Processed Video 2

Research TeamDownload files: pre-processed video  and enhanced video.

Dr. Barry Theobald