
Proactive AR Assistance with Satori
Moving from reactive to predictive AR guidance through user mind modeling
Satori introduces a novel AR assistance system that proactively guides users by modeling their mental states (beliefs, desires, intentions) alongside environmental context for tasks like assembly and cooking.
- Integrates Belief-Desire-Intention (BDI) framework with multi-modal large language models
- Anticipates user needs rather than waiting for explicit requests
- Creates more natural, context-aware assistance for physical tasks
- Demonstrates enhanced user experience through predictive support
Why it matters: This research transforms AR assistance from reactive tools to intelligent companions that understand user goals and context, particularly valuable for engineering applications requiring step-by-step guidance and real-time support.
Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modeling