Tags: #api-proxy
AI Gateway & LLM Orchestration Platform
Python
43.1k
BerriAI/litellm
A Python SDK and AI Gateway unifying access to 100+ LLM APIs in an OpenAI-compatible format, offering cost tracking, load balancing, and guardrails.
Local AI Model Management Proxy
Docker
3.2k
mostlygeek/llama-swap
A high-performance Go-based proxy for hot-swapping and managing multiple local generative AI models compatible with OpenAI and Anthropic APIs.