AI Infrastructure Tool
11.5k 2026-04-26
Portkey-AI/gateway
A blazing fast, open-source AI Gateway for routing to 250+ LLMs with integrated guardrails, ensuring reliability and scalability for AI applications.
Core Features
Blazing fast (<1ms latency) and lightweight with a tiny footprint (122kb).
Automatic retries and fallbacks to prevent downtimes.
Load balancing and conditional routing for scaling AI applications.
Integrated guardrails for protecting AI deployments.
Multi-modal capabilities and agentic workflow integrations.
Quick Start
npx @portkey-ai/gatewayDetailed Introduction
Portkey AI Gateway is an enterprise-ready, open-source solution designed for high-performance routing to over 1600 language, vision, audio, and image models. It enables developers to integrate with any LLM rapidly, offering critical features like automatic retries, load balancing, and robust guardrails. This gateway ensures AI applications are reliable, scalable, and secure, processing billions of tokens daily with minimal latency and a tiny footprint, making it ideal for demanding AI workloads.