LiteLLM

LiteLLM is an open-source proxy that provides a unified OpenAI-compatible API for 100+ LLM providers. It handles authentication, load balancing, spend tracking, and rate limiting across providers. Teams use LiteLLM as a self-hosted gateway to standardize their LLM access layer, track costs per team/key, and switch providers without code changes.