OSS Alternative - Discover Top Open Source Alternatives to Popular Software

looplj/axonhub

AxonHub is an open-source AI gateway that enables seamless integration with over 100 LLMs using any SDK, featuring built-in failover, load balancing, cost control, and end-to-end tracing.

Core Features

Seamlessly switch between 100+ LLM providers using any SDK with zero code changes.

Gain full request tracing and thread-aware observability for faster debugging.

Implement enterprise-grade RBAC, usage quotas, and data isolation.

Ensure high availability with smart load balancing and sub-100ms auto failover.

Track real-time costs per request, including input, output, and cache tokens.

Detailed Introduction

AxonHub is an all-in-one AI development platform designed to eliminate vendor lock-in and integration complexity when working with large language models. It acts as a transparent proxy, allowing developers to use any AI SDK (e.g., OpenAI, Anthropic) to access over 100 different LLM providers by simply changing a configuration. This gateway provides critical enterprise features such as automatic failover, intelligent load balancing, comprehensive end-to-end request tracing for enhanced observability, fine-grained access control (RBAC), and real-time cost tracking, empowering efficient and resilient AI application development.