AI & MLFrom $29/app/month

Managed LiteLLM Hosting

Name: LiteLLM
Price: 29 USD
Availability: InStock

LLM proxy gateway for 100+ providers

What is LiteLLM on ManageStacks?

LiteLLM is a unified proxy gateway that routes requests across 100+ LLM providers using a single OpenAI-compatible API. ManageStacks deploys LiteLLM with persistent configuration, key management, and usage tracking.

Deploy LiteLLM Back to Catalog

Last updated July 7, 2026Official site Source on GitHub Documentation

About LiteLLM

What LiteLLM does, and why teams deploy it.

LiteLLM is an open-source LLM proxy that provides a unified OpenAI-compatible interface for over 100 LLM providers including OpenAI, Anthropic, Azure, AWS Bedrock, Google Vertex AI, and self-hosted models. It enables teams to switch between providers, set budgets, track usage, and manage API keys from a single control plane.

With built-in load balancing, fallback routing, spend tracking, and virtual key management, LiteLLM is the ideal gateway for organizations using multiple AI providers. It simplifies vendor management and provides centralized observability across all LLM consumption.

DIY vs ManageStacks

What running LiteLLM yourself looks like — and what it looks like with us.

DIY self-hosting

Hard-code provider-specific SDKs into every service; rewrite when switching models
Track LLM spend across OpenAI, Anthropic, and Bedrock with separate billing dashboards
Distribute raw API keys to every developer and service — no centralized access control
Implement retry logic, fallback routing, and rate limiting per provider by hand
No visibility into which team or feature is driving LLM costs until the monthly invoice arrives

On ManageStacks

Subscribe through your AWS, Azure, or GCP marketplace
LiteLLM proxy deploys with PostgreSQL, Redis cache, and admin UI — all pre-configured
Virtual API keys with per-team and per-model budget caps enforced at the proxy layer
Automatic fallback routing and load balancing across providers — zero application changes
Real-time spend dashboards broken down by team, key, and model

100+ providers

OpenAI, Anthropic, Azure, Bedrock, Vertex, Ollama, and more

$29/mo

Flat per instance — no per-request or per-token markup

Virtual keys

Issue scoped API keys with budget limits per team or project

<5ms overhead

Proxy adds minimal latency to LLM requests

Key features

Everything LiteLLM ships with, running on our stack.

Unified API for 100+ LLM providers
Budget limits and spend tracking per key and team
Load balancing and fallback routing across models
Virtual API key management for teams
Request logging and usage analytics dashboard
Caching layer to reduce costs and latency

How it deploys

From subscribe to live in minutes.

Subscribe to ManageStacks through your AWS, Azure, or GCP marketplace.

Provision

LiteLLM proxy spins up with PostgreSQL, Redis, and admin dashboard — typically under 3 minutes.

Configure providers

Add API keys for OpenAI, Anthropic, Azure OpenAI, Bedrock, or point at Ollama/LocalAI on the same account. Define routing rules and fallback chains.

Route traffic

Point your applications at the LiteLLM endpoint — it speaks the OpenAI API format. Issue virtual keys to teams with budget limits.

Who this is for

Built for teams that want LiteLLM to just work.

Platform teams managing LLM spend

You have 5-15 teams consuming LLM APIs and need centralized cost tracking, per-team budgets, and provider-agnostic access. LiteLLM is the control plane for all of it.

Startups hedging across LLM providers

You want to try Anthropic for reasoning and OpenAI for function calling without refactoring every service. LiteLLM unifies the interface so you switch models in config, not code.

Enterprises consolidating AI gateway access

Multiple business units have separate LLM contracts. LiteLLM centralizes routing, enforces security policies, and gives finance one dashboard for all AI spend.

Compliance & compatibility

What we handle, what LiteLLM runs on.

Compliance & operations

TLS-encrypted proxy and admin dashboard traffic
API keys stored encrypted in PostgreSQL — never logged in plain text
Per-key and per-team budget enforcement prevents runaway spend
GDPR data-residency — proxy stays in your chosen cloud region
Audit log of every routed request with token counts and cost attribution
OS-level security patches applied during your maintenance window

Compatibility

Version: Latest LiteLLM proxy stable (validated before each upgrade)
Runtime: Python on containerized infrastructure
Dependencies: PostgreSQL 14+, Redis 7 (for caching and rate limiting)
Min. resources: 1 vCPU / 2 GB RAM (dedicated); scale with request volume

How ManageStacks helps

We handle the parts you shouldn't be writing yourself.

ManageStacks deploys LiteLLM with its PostgreSQL database, Redis cache, and admin UI pre-configured. Centralize your LLM spend tracking and provider routing without managing proxy infrastructure.

Deploy LiteLLM now View pricing

How it compares

LiteLLM on ManageStacks vs the alternatives.

How LiteLLM on ManageStacks compares to other LLM gateway and proxy solutions.

Comparison of LiteLLM on ManageStacks against publicly-documented alternatives across deployment model, data residency, pricing basis, custom domain support, open-source status, and data export.
Property	LiteLLM on ManageStacksUs	Portkey	Helicone (proxy mode)	Custom Nginx/Envoy proxy
Deployment	Managed on your AWS, Azure, or GCP	Vendor-hosted	Vendor-hosted or self-hosted	You build + operate
Data residency	Your cloud region	Vendor infrastructure	Vendor or your infra	Your cloud region
Pricing basis	Flat $29/mo per instance	Per request tier	Per log event	Your compute cost
Provider coverage	100+ providers	Major providers	OpenAI-compatible	You implement each
Open source	Yes (MIT)	No (proprietary)	Yes (Apache 2.0)	Yes
Budget controls	Per-key and per-team budgets	Spend limits via dashboard	Cost tracking, no enforcement	You implement

Comparison focuses on architectural properties (deployment model, pricing basis, open-source status) that don't change with vendor pricing pages. Verify current pricing on each vendor's own site.

FAQ

Common questions about LiteLLM on ManageStacks.

Can LiteLLM on ManageStacks route to both cloud and local models?

Yes. LiteLLM can route to cloud providers like OpenAI and Anthropic as well as self-hosted Ollama or LocalAI instances running on ManageStacks. You configure all endpoints in a single proxy configuration.

How does ManageStacks handle LiteLLM's API key storage?

ManageStacks deploys LiteLLM with a PostgreSQL database for secure key and configuration storage. All data is encrypted at rest and included in automated daily backups.

Can I set per-team spending limits with LiteLLM on ManageStacks?

Yes. LiteLLM supports virtual keys with budget limits per key, per team, and per model. The ManageStacks deployment includes the admin dashboard for managing these controls.

Related applications