Observatorio de I+D+i UPM

Memorias de investigación
Communications at congresses:
Natural User Interfaces for Human-Drone Multi-Modal Interaction
Year:2016
Research Areas
  • Aerial robots
Information
Abstract
Personal drones are becoming part of every day life. To fully integrate them into society, it is crucial to design safe and intuitive ways to interact with these aerial systems. The recent advances on User-Centered Design (UCD) applied to Natural User Interfaces (NUIs) intend to make use of human innate features, such as speech, gestures and vision to interact with technology in the way humans would with one another. In this paper, a Graphical User Interface (GUI) and several NUI methods are studied and implemented, along with computer vision techniques, in a single software framework for aerial robotics called Aerostack which allows for intuitive and natural human-quadrotor interaction in indoor GPS-denied environments. These strategies include speech, body position, hand gesture and visual marker interactions used to directly command tasks to the drone. The NUIs presented are based on devices like the Leap Motion Controller, microphones and small size monocular on-board cameras which are unnoticeable to the user. Thanks to this UCD perspective, the users can choose the most intuitive and effective type of interaction for their application. Additionally, the strategies proposed allow for multi-modal interaction between multiple users and the drone by being able to integrate several of these interfaces in one single application as is shown in various real flight experiments performed with non-expert users.
International
Si
Congress
International Conference on Unmanned Aircraft Systems (ICUAS), 2016
960
Place
Arlington, VA USA
Reviewers
Si
ISBN/ISSN
978-1-4673-9334-8
10.1109/ICUAS.2016.7502665
Start Date
07/06/2016
End Date
10/06/2016
From page
1013
To page
1022
Natural User Interfaces for Human-Drone Multi-Modal Interaction
Participants
  • Autor: Ramón Suarez Fernández (UPM)
  • Autor: Jose Luis Sanchez Lopez (UPM)
  • Autor: Carlos Sampedro Perez (UPM)
  • Autor: Martin Molina Gonzalez (UPM)
  • Autor: Pascual Campoy Cervera (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Visión por Computador y Robótica Aérea
  • Departamento: Inteligencia Artificial
  • Centro o Instituto I+D+i: Centro de Automática y Robótica (CAR). Centro Mixto UPM-CSIC
  • Departamento: Automática, Ingeniería Eléctrica y Electrónica e Informática Industrial
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)