AI Gateway
11.3k 2026-04-13
Portkey-AI/gateway
A blazing fast, open-source AI Gateway for routing requests to 1600+ LLMs and multi-modal models with integrated guardrails, ensuring reliability and scalability.
Core Features
Blazing fast routing to 1600+ LLMs and multi-modal models
Automatic retries and fallbacks to prevent downtimes
Load balancing and conditional routing for scalable AI apps
Integrated guardrails for enhanced AI deployment security
Support for multi-modal capabilities beyond text
Quick Start
npx @portkey-ai/gatewayDetailed Introduction
Portkey AI Gateway is a high-performance, open-source solution designed for routing requests to over 1600 language, vision, audio, and image models with minimal latency. It simplifies the integration of diverse LLMs, offering enterprise-grade features like automatic retries, fallbacks, load balancing, and conditional routing to ensure reliability and scalability for AI applications. Furthermore, it incorporates robust guardrails for enhanced security and supports multi-modal capabilities, making it a comprehensive platform for managing complex AI deployments efficiently.