gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Frameworks and platforms for building autonomous AI agents and LLM apps.
Key features
- 一个 API 路由 1600+ 模型
- 低于 1ms 的网关延迟
- 自动重试与 fallback 防宕机
- 50+ AI 安全护栏
- 负载均衡与条件路由
- MCP 网关企业级管理
Good for
- 多模型统一接入
- 生产环境模型容灾
- AI 应用安全护栏
- 网关级可观测性
Stack & tags
Node.jsTypeScriptnpmDockerMCPOpenAI APIai-gatewaygatewaygenerative-aihacktoberfestlangchainllmllm-gatewayllmops
Quick start
npx @portkey-ai/gatewayFrom the project README on GitHub.
Similar open-source projects
superpowers
★ 294,114An agentic skills framework & software development methodology that works.
skills
★ 274,171Skills for Real Engineers. Straight from my .agents directory.