Smarter Robot Planning with LLMs

Smarter Robot Planning with LLMs

Leveraging language models to bootstrap object-level planning for robots

This research introduces a novel approach that extracts knowledge from Large Language Models to produce object-level plans that guide robots in completing complex tasks.

  • Bridges the gap between LLMs and physical task planning by focusing on object states rather than direct action sequences
  • Uses Functional Object-Oriented Networks (FOON) to represent how objects change during manipulation tasks
  • Significantly outperforms baseline approaches in pick-and-place scenarios
  • Provides a more robust foundation for factory automation and industrial robotics

This advancement matters for engineering because it creates a more reliable framework for robotic systems to understand and execute complex manipulation tasks in real-world environments, potentially transforming factory automation.

Bootstrapping Object-level Planning with Large Language Models

39 | 168