Observatorio de I+D+i UPM

Memorias de investigación
Research Publications in journals:
Increasing adaptability of a speech into sign language translation system
Year:2013
Research Areas
  • Electronic technology and of the communications,
  • Electric engineers, electronic and automatic (eil)
Information
Abstract
This paper describes a new version of a speech into sign language translation system with new tools and characteristics for increasing its adaptability to a new task or a new semantic domain. This system is made up of a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of signs belonging to the sign language), and a 3D avatar animation module (for playing back the signs). In order to increase the system adaptability, this paper presents new improvements in all the three main modules for generating automatically the task dependent information from a parallel corpus: automatic generation of Spanish variants when generating the vocabulary and language model for the speech recogniser, an acoustic adaptation module for the speech recogniser, data-oriented language and translation models for the machine translator and a list of signs to design. The avatar animation module includes a new editor for rapidly design of the required signs. These developments have been necessary to reduce the effort when adapting a Spanish into Spanish sign language (LSE: Lengua de Signos Española) translation system to a new domain. The whole translation presents a SER (Sign Error Rate) lower than 10% and a BLEU higher than 90% while the effort for adapting the system to a new domain has been reduced more than 50%.
International
Si
JCR
Si
Title
EXPERT SYSTEMS WITH APPLICATIONS
ISBN
0957-4174
Impact factor JCR
2,203
Impact info
Volume
40
10.1016/j.eswa.2012.08.059
Journal number
40
From page
1312
To page
1322
Month
SIN MES
Ranking
13/78
Participants
  • Autor: Veronica Lopez Ludeña (UPM)
  • Autor: Ruben San Segundo Hernandez (UPM)
  • Autor: Carlos González Morcillo (Grupo de Sistemas Inteligentes Aplicados, Departamento de Tecnologías y Sistemas de Información, Universidad de Castilla-La Mancha)
  • Autor: Juan Carlos López (Grupo de Sistemas Inteligentes Aplicados, Departamento de Tecnologías y Sistemas de Información, Universidad de Castilla-La Mancha)
  • Autor: Jose Manuel Pardo Muñoz (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Grupo de Tecnología del Habla
  • Departamento: Ingeniería Electrónica
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)