Proactive AR Assistance with Satori

Proactive AR Assistance with Satori

Moving from reactive to predictive AR guidance through user mind modeling

Satori introduces a novel AR assistance system that proactively guides users by modeling their mental states (beliefs, desires, intentions) alongside environmental context for tasks like assembly and cooking.

  • Integrates Belief-Desire-Intention (BDI) framework with multi-modal large language models
  • Anticipates user needs rather than waiting for explicit requests
  • Creates more natural, context-aware assistance for physical tasks
  • Demonstrates enhanced user experience through predictive support

Why it matters: This research transforms AR assistance from reactive tools to intelligent companions that understand user goals and context, particularly valuable for engineering applications requiring step-by-step guidance and real-time support.

Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modeling

42 | 204