Sistema de Comunicación Oral para Personas Sordas (Evaluating a Speech Communication System for Deaf People)

Verónica López-Ludeña (, Rubén San-Segundo (, Raquel Martín (, David Sánchez (, Adolfo García (

1Grupo de Tecnología del Habla-Universidad Politécnica de Madrid
2Fundación CNSE

This paper appears in: Revista IEEE América Latina

Publication Date: July 2011
Volume: 9,   Issue: 4 
ISSN: 1548-0992

This paper describes the development of an Advanced Speech Communication System for Deaf People and its field evaluation in a real application domain: the renewal of Driver's License. The system is composed of two modules. The first one is a Spanish into Spanish Sign Language (LSE: Lengua de Signos Española) translation module made up of a speech recognizer, a natural language translator (for converting a word sequence into a sequence of signs), and a 3D avatar animation module (for playing back the signs). The second module is a Spoken Spanish generator from sign-writing composed of a visual interface (for specifying a sequence of signs), a language translator (for generating the sequence of words in Spanish), and finally, a text to speech converter. For language translation, the system integrates three technologies: an example-based strategy, a rule-based translation method and a statistical translator. This paper also includes a detailed description of the evaluation carried out in the Local Traffic Office in the city of Toledo (Spain) involving real government employees and deaf people. This evaluation includes objective measurements from the system and subjective information from questionnaires. Finally, the paper reports an analysis of the main problems and a discussion about possible solutions.

Index Terms:
Deaf people, Spanish Sign Language (LSE), Spoken Language Translation, Sign Animation, Driver’s License renewal, e-Inclusion   

Documents that cite this document
This function is not implemented yet.

[PDF Full-Text (444)]