Tags: #load-balancing

A unified open-source AI Gateway and Python SDK to call over 100 LLM APIs in an OpenAI-compatible format, offering features like cost tracking, load balancing, and guardrails.

AxonHub is an open-source AI gateway that enables seamless integration with over 100 LLMs using any SDK, featuring built-in failover, load balancing, cost control, and end-to-end tracing.

A blazing fast, open-source AI Gateway for routing to 250+ LLMs with integrated guardrails, ensuring reliability and scalability for AI applications.

An Ingress Controller for Kubernetes that leverages NGINX and NGINX Plus to provide advanced traffic management, load balancing, and routing capabilities for containerized applications.