NVP-HRI introduces a breakthrough approach enabling robots to understand and respond to natural human communication without needing pre-trained objects.

• Combines natural voice commands and body posture recognition for intuitive robot control
• Leverages Large Language Models to interpret human intentions for previously unseen objects
• Addresses key challenges for elderly users who struggle with memorizing commands or gestures
• Creates more accessible and natural interactions for service robots in aging societies

This engineering innovation eliminates the need for predefined gestures or specialized vocabulary, making human-robot interaction significantly more intuitive and accessible for all users, particularly the elderly.

NVP-HRI: Zero Shot Natural Voice and Posture-based Human-Robot Interaction via Large Language Model