LiteLLM

AI-powered
Open source AI gateway and LLM proxy giving one API for 100+ models with spend tracking
Litellm.aiOpens in new tabIs this your tool? Claim this page
Claim Your Tool Page
Free to claim • Premium features available
- Verified Badge – Show users your tool is legitimate with a verified checkmark that builds instant credibility.
- Edit Your Profile – Update descriptions, screenshots, pricing, and keep your listing accurate and up-to-date.
- Boost Visibility – Get featured placements, priority listing in categories, and promotional badges to stand out.
- Respond to Reviews – Engage with your users by responding to feedback and building trust with potential customers.
Follow for updates & deals
Get alerts for LiteLLM discounts, feature releases & pricing changes
Similar Tools








New Tools







What is LiteLLM?
LiteLLM is an open source AI gateway and LLM proxy for platform teams. It puts access to many model providers behind one key and one OpenAI-compatible API, covering more than 100 LLMs.
The gateway includes spend tracking and budgets, authentication, guardrails, routing, observability and governance for LLMs, MCPs and agents. It can be self-hosted, and a Python SDK is available for calling models directly. A separate agent SDK, liteagents, routes each turn to a suitable model across providers.
LiteLLM is free as open source software, with an Enterprise plan available through sales for organizations that need additional support and features. The project is developed on GitHub by BerriAI.
Pros & Cons
Pros
- One OpenAI-compatible API covers more than 100 LLMs.
- Includes spend tracking, budgets, authentication and guardrails.
Cons
Frequently Asked Questions
How much does LiteLLM cost?
LiteLLM is open source and free to use.
Does LiteLLM have a lifetime deal?
According to our latest information, this tool does not seem to have a lifetime deal at the moment, unfortunately.
How does LiteLLM simplify access to many model providers?
LiteLLM puts access to many model providers behind one key and one OpenAI-compatible API. The site says this covers more than 100 LLMs. Your application can call different models through the same interface, so the calling code stays consistent across them.
Can I run LiteLLM on my own infrastructure?
Yes, LiteLLM can be self-hosted. It is open source, and the project is developed on GitHub by BerriAI, so the code is available to review. Self-hosting keeps the gateway running on infrastructure you control. A Python SDK is also available for calling models directly from code.
What governance features does the LiteLLM gateway include?
The gateway includes spend tracking and budgets, authentication, guardrails, routing, observability and governance. The site says these cover LLMs, MCPs and agents. Teams that need to watch model spend can rely on the spend tracking and budget features listed on the site. Configuration details are not in the listing, so the litellm.ai documentation is the right reference.
What is liteagents, the separate agent SDK?
liteagents is a separate agent SDK described on the site. It routes each turn to a suitable model across providers. The listing does not describe its setup in detail, so review the litellm.ai documentation before relying on it. It is presented as separate from the gateway, so it can be evaluated on its own.
Who is LiteLLM designed for?
LiteLLM is aimed at platform teams that need one API across many providers. Spend tracking, authentication and guardrails target that audience. Organizations that need extra support can contact sales for the Enterprise plan. Open source availability means smaller teams can self-host the project as well.
Notice: This website uses affiliate links to earn commissions from sales. Please read their ToS when signing up somewhere.



