Visual Aids for Human-Robot Communication
Enhancing task collaboration through generative AI interfaces
GenComUI is an LLM-powered system that dynamically generates visual aids to improve human-robot task communication and program generation.
- Provides contextual visual elements like map annotations and path indicators to support verbal instructions
- Creates a bidirectional communication channel that helps humans express complex tasks more effectively
- Demonstrates how AI-generated visualizations can bridge communication gaps in robotics
- Enables more intuitive programming of robots for non-technical users
This research advances engineering capabilities by creating interfaces that make robots more accessible to everyday users, potentially transforming automation in manufacturing, healthcare, and service industries.