LiteLLM
LiteLLM simplifies LLM completion and embedding calls with an open-source library.
Score
60
User Rating
1.0
Free/Trial Support
Supported
Starting Price
--
Last Updated
Sep 08, 2026
Overview
What is LiteLLM?
LiteLLM is an LLM Gateway (OpenAI Proxy) designed to manage authentication, load balancing, and spend tracking across 100+ LLMs, all while maintaining the OpenAI format. It simplifies the process of using LLM APIs from various providers like OpenAI, Azure, Cohere, Anthropic, Replicate, and Google. LiteLLM offers consistent outputs and exceptions for all LLM APIs, along with logging and error tracking for all models. It provides features like cost tracking, batches API, guardrails, model access, budgets, LLM observability, rate limiting, prompt management, S3 logging, and pass-through endpoints.
What is LiteLLM used for?
Tags
Top Features
- LLM Gateway for 100+ LLMs
- OpenAI-compatible API
- Cost Tracking and Budget Management
- LLM Fallbacks
- Load Balancing
- Rate Limiting
- Prompt Management
- Logging and Error Tracking
How to use LiteLLM?
Use LiteLLM by calling LLM APIs using the chatGPT format - completion(model, messages). It provides consistent outputs and exceptions for all LLM APIs. You can deploy LiteLLM open source or try LiteLLM Enterprise for more features.
Alternative Tools
No alternative tools found
Pros & Cons
No Data
Use Cases
- Giving developers access to multiple LLMs
- Managing spend across different LLM providers
- Implementing LLM fallbacks for reliability
- Standardizing LLM API access across an organization
LiteLLM Pricing
Free PlanSubscription Plan
No detailed pricing information available
User Reviews
1.0
out of 5
1.0
No reviews yet
Be the first to review this tool!