CodeTool is a new framework that enhances LLMs' ability to use external tools by supervising code generation and execution processes in a stepwise manner.

• Addresses limitations in current tool invocation methods that create unnecessarily complex reasoning paths
• Leverages process supervision to verify intermediate steps during tool use
• Improves accuracy and efficiency when LLMs need to perform complex tasks requiring multiple tools
• Demonstrates practical engineering solutions for making AI assistants more reliable and capable

This research introduces an important approach for engineering better AI systems that can safely and effectively interact with external applications and APIs.

CodeTool: Enhancing Programmatic Tool Invocation of LLMs via Process Supervision