This research introduces compiler-inspired intrinsics to standardize LLM APIs, particularly for RAG applications, enabling better developer collaboration and interoperability.

• Establishes well-defined APIs that can be shared across LLM providers
• Proposes a library pattern to support large-scale collaboration in LLM development
• Creates standardized intrinsics specifically for Retrieval-Augmented Generation use cases
• Addresses the current fragmentation in LLM development ecosystems

For engineering teams, this research offers a pathway to more consistent, maintainable LLM applications with reduced vendor lock-in and improved collaboration potential.

A Library of LLM Intrinsics for Retrieval-Augmented Generation