Observatorio de I+D+i UPM

Memorias de investigación
Research Publications in journals:
On the dynamic adaptation of language models based on dialogue information
Year:2012
Research Areas
  • Artificial intelligence
Information
Abstract
We present an approach to adapt dynamically the language models (LMs) used by a speech recognizer that is part of a spoken dialogue system. We have developed a grammar generation strategy that automatically adapts the LMs using the semantic information that the user provides (represented as dialogue concepts), together with the information regarding the intentions of the speaker (inferred by the dialogue manager, and represented as dialogue goals). We carry out the adaptation as a linear interpolation between a background LM, and one or more of the LMs associated to the dialogue elements (concepts or goals) addressed by the user. The interpolation weights between those models are automatically estimated on each dialogue turn, using measures such as the posterior probabilities of concepts and goals, estimated as part of the inference procedure to determine the actions to be carried out. We propose two approaches to handle the LMs related to concepts and goals. Whereas in the first one we estimate a LM for each one of them, in the second one we apply several clustering strategies to group together those elements that share some common properties, and estimate a LM for each cluster. Our evaluation shows how the system can estimate a dynamic model adapted to each dialogue turn, which helps to improve the performance of the speech recognition (up to a 14.82% of relative improvement), which leads to an improvement in both the language understanding and the dialogue management tasks.
International
Si
JCR
Si
Title
Expert Systems With Applications
ISBN
0957-4174
Impact factor JCR
2,203
Impact info
Datos JCR del año 2011
Volume
10.1016/j.eswa.2012.08.029
Journal number
From page
1069
To page
1085
Month
SIN MES
Ranking
Participants
  • Autor: Juan Manuel Lucas Cuesta (UPM)
  • Autor: Javier Ferreiros Lopez (UPM)
  • Autor: Fernando Fernandez Martinez (UPM)
  • Autor: Julian David Echeverry Correa (UPM)
  • Autor: Syaheerah Binti Lebai Lutfi (UPM)
Research Group, Departaments and Institutes related
  • Creador: Departamento: Ingeniería Electrónica
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)