Natural Voice & Gesture Robot Interaction

Natural Voice & Gesture Robot Interaction

Zero-shot HRI system using LLMs to understand natural human commands

NVP-HRI enables robots to interact with humans through natural voice commands and gestures without predefined training, particularly beneficial for elderly users.

  • Eliminates need to memorize specific commands or gestures
  • Handles zero-shot interaction with previously unseen objects
  • Leverages Large Language Models to interpret natural human communication
  • Addresses key challenges in service robots for aging populations

This engineering breakthrough makes human-robot interaction more intuitive and accessible, removing barriers that typically exclude elderly or non-technical users from effectively utilizing robotic assistance.

NVP-HRI: Zero Shot Natural Voice and Posture-based Human-Robot Interaction via Large Language Model

126 | 168