BerriAI/litellm - GitHub Freemium

LiteLLM offers a universal solution for integrating various large language model (LLM) APIs into your applications by using a consistent OpenAI format. This tool allows seamless access to multiple providers such as Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, and Replicate, among others, without the need for adapting to each provider's specific API style. LiteLLM's features include input translation to different providers’ endpoints, consistent output formats, common exception mapping, and load balancing for high-volume requests. It supports over 100 LLM APIs, making it an indispensable tool for developers looking to leverage AI language models across different cloud platforms, all with the ease of OpenAI-style API calls.