This research introduces Surgical Action Planning (SAP), a novel approach that leverages LLMs to generate future action plans from visual inputs during robot-assisted minimally invasive surgeries.

• Addresses the critical gap in intraoperative predictive planning
• Enhances surgical guidance by anticipating next steps in procedures
• Demonstrates potential for improving surgical education and skill assessment
• Shows promise for increasing automation in robotic surgery

This innovation matters for medical professionals by providing real-time decision support, reducing cognitive load during complex procedures, and creating new pathways for surgical training and assessment.

Surgical Action Planning with Large Language Models