TelecomI+D04: Sistema de Traducción Estadística de Voz a Lengua de Signos para Personas Sordas (TelecomI+D04: Speech into Sign Language Statistical Translation System for Deaf People)

Rubén San Segundo (, Beatriz Gallo (, Juan Manuel Lucas (, Roberto Barra-Chicote (, Luis Fernando D'Haro (, Fernando Fernández (

Universidad Politécnica de Madrid (UPM)
This paper appears in: Revista IEEE América Latina

Publication Date: July 2009
Volume: 7,   Issue: 3 
ISSN: 1548-0992

This paper presents a set of experiments used to develop a statistical system from translating speech to sign language for deaf people. This system is composed of an Automatic Speech Recognition (ASR) system, followed by a statistical translation module and an animated agent that represents the different signs. Two different approaches have been used to perform the translations: a phrase-based system and a finite state transducer. For the evaluation, the followings figures have been considered: WER (Word Error Rate), BLEU and NIST. The paper presents translation results of reference sentences and sentences from the Automatic Speech Recognizer. Also three different configurations have been evaluated for the Speech Recognizer. The best results were obtained with the finite state transducer, with a word error rate of 28.21% for the reference text, and 29.27% using the ASR output.

Index Terms:
Statistical Machine Translation, Sign Language, phrase, Finite State Transducer, Language Model, Translation Model, alignment, word error rate.   

Documents that cite this document
This function is not implemented yet.

[PDF Full-Text (357)]