Observatorio de I+D+i UPM

Memorias de investigación
Ponencias en congresos:
Natural User Interfaces for Human-Drone Multi-Modal Interaction
Áreas de investigación
  • Robots aéreos
Personal drones are becoming part of every day life. To fully integrate them into society, it is crucial to design safe and intuitive ways to interact with these aerial systems. The recent advances on User-Centered Design (UCD) applied to Natural User Interfaces (NUIs) intend to make use of human innate features, such as speech, gestures and vision to interact with technology in the way humans would with one another. In this paper, a Graphical User Interface (GUI) and several NUI methods are studied and implemented, along with computer vision techniques, in a single software framework for aerial robotics called Aerostack which allows for intuitive and natural human-quadrotor interaction in indoor GPS-denied environments. These strategies include speech, body position, hand gesture and visual marker interactions used to directly command tasks to the drone. The NUIs presented are based on devices like the Leap Motion Controller, microphones and small size monocular on-board cameras which are unnoticeable to the user. Thanks to this UCD perspective, the users can choose the most intuitive and effective type of interaction for their application. Additionally, the strategies proposed allow for multi-modal interaction between multiple users and the drone by being able to integrate several of these interfaces in one single application as is shown in various real flight experiments performed with non-expert users.
Nombre congreso
International Conference on Unmanned Aircraft Systems (ICUAS), 2016
Tipo de participación
Lugar del congreso
Arlington, Virginia, USA
Fecha inicio congreso
Fecha fin congreso
Desde la página
Hasta la página
Título de las actas
Natural User Interfaces for Human-Drone Multi-Modal Interaction
Esta actividad pertenece a memorias de investigación
  • Autor: Ramon Antonio Suarez Fernandez (UPM)
  • Autor: Jose Luis Sanchez Lopez (UPM)
  • Autor: Carlos Sampedro Perez (UPM)
  • Autor: Martin Molina Gonzalez (UPM)
  • Autor: Pascual Campoy Cervera (UPM)
Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Grupo de Investigación: Visión por Computador y Robótica Aérea
  • Centro o Instituto I+D+i: Centro de Automática y Robótica (CAR). Centro Mixto UPM-CSIC
  • Departamento: Automática, Ingeniería Eléctrica y Electrónica e Informática Industrial
  • Departamento: Inteligencia Artificial
S2i 2023 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)