网关与路由
74 条多模型聚合、协议转换、限流与回退。
| # | 仓库 | 分类 | Stars | 最近推送 |
|---|---|---|---|---|
| 1 | traefik/traefik The Cloud Native Application Proxy | 网关与路由 | 66k | 2026-11-10 08:12 UTC |
| 2 | BerriAI/litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] | 网关与路由 | 63k | 2026-11-10 11:00 UTC |
| 3 | QuantumNous/new-api Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting. | 网关与路由 | 52k | 2026-11-09 13:41 UTC |
| 4 | Kong/kong 🦍 The API and AI Gateway | 网关与路由 | 44k | 2026-10-19 02:45 UTC |
| 5 | songquanpeng/one-api LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. | 网关与路由 | 37k | 2026-01-09 03:26 UTC |
| 6 | fosrl/pangolin Modern networking and security platform providing secure access and connectivity to apps, infrastructure, and AI workloads. Connect and protect your users. | 网关与路由 | 24k | 2026-11-10 01:39 UTC |
| 7 | lidge-jun/opencodex Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code | 网关与路由 | 18k | 2026-11-10 04:21 UTC |
| 8 | apache/apisix The Cloud-Native API Gateway and AI Gateway | 网关与路由 | 17k | 2026-11-10 04:47 UTC |
| 9 | casdoor/casdoor An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD | 网关与路由 | 15k | 2026-11-10 05:09 UTC |
| 10 | Portkey-AI/gateway A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. | 网关与路由 | 13k | 2026-05-25 13:54 UTC |
| 11 | triton-inference-server/server The Triton Inference Server provides an optimized cloud and edge inferencing solution. | 网关与路由 | 11k | 2026-11-10 01:43 UTC |
| 12 | TykTechnologies/tyk Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol) | 网关与路由 | 11k | 2026-11-09 20:48 UTC |
| 13 | higress-group/higress 🤖 AI Gateway | AI Native API Gateway | 网关与路由 | 9.7k | 2026-11-10 03:07 UTC |
| 14 | maximhq/bifrost Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS. | 网关与路由 | 9.5k | 2026-11-10 05:14 UTC |
| 15 | coaidev/coai 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache. | 网关与路由 | 9.3k | 2026-03-12 10:00 UTC |
| 16 | tbphp/gpt-load Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。 | 网关与路由 | 7.2k | 2026-11-09 15:33 UTC |
| 17 | katanemo/plano Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. | 网关与路由 | 7.1k | 2026-10-24 19:03 UTC |
| 18 | vllm-project/semantic-router An open, programmable decision layer for models and compute. | 网关与路由 | 6.4k | 2026-11-10 03:04 UTC |
| 19 | agentgateway/agentgateway Next Generation Agentic Proxy for AI Agents and MCP servers | 网关与路由 | 6.1k | 2026-11-10 00:18 UTC |
| 20 | weave-os/router Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change. | 网关与路由 | 5.6k | 2026-11-10 04:43 UTC |
| 21 | pomerium/pomerium Pomerium is an identity and context-aware access proxy. | 网关与路由 | 5.1k | 2026-11-10 02:21 UTC |
| 22 | IBM/mcp-context-forge An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins. | 网关与路由 | 4.8k | 2026-11-09 18:12 UTC |
| 23 | arvin341az-glitch/RVG Multi-protocol proxy management panel built with Python & FastAPI, deployable on Railway. | 网关与路由 | 4.3k | 2026-09-13 16:14 UTC |
| 24 | octelium/octelium A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure. | 网关与路由 | 4.2k | 2026-11-09 16:39 UTC |
| 25 | 1technophile/OpenMQTTGateway MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa. | IoT / 固件 | 4.1k | 2026-11-10 00:36 UTC |
| 26 | seakee/CPA-Manager-Plus A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health. | 网关与路由 | 4.0k | 2026-11-10 05:20 UTC |
| 27 | nextlevelbuilder/goclaw GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety. | 网关与路由 | 3.7k | 2026-11-09 07:19 UTC |
| 28 | kaitranntt/ccs Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready. | 网关与路由 | 2.9k | 2026-11-04 20:10 UTC |
| 29 | bestruirui/octopus One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关 | 网关与路由 | 2.7k | 2026-10-23 00:51 UTC |
| 30 | krakend/krakend-ce KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go. | 网关与路由 | 2.7k | 2026-11-02 14:51 UTC |
| 31 | theagentrouter/agent-router Manages Unified Access to Generative AI Services built on Envoy Gateway | 网关与路由 | 2.4k | 2026-11-09 16:05 UTC |
| 32 | APIParkLab/APIPark Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用。 | 网关与路由 | 1.8k | 2026-10-27 02:40 UTC |
| 33 | Continuum-AI-Corp/OrcaRouter-Lite Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter | 网关与路由 | 1.7k | 2026-10-08 07:08 UTC |
| 34 | theopenco/llmgateway Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. | 网关与路由 | 1.7k | 2026-11-10 05:40 UTC |
| 35 | astaxie/TokenHub TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable. | 网关与路由 | 1.4k | 2026-11-06 02:36 UTC |
| 36 | LiteLLM-Labs/litellm-agent-control-plane 1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents. | 网关与路由 | 1.3k | 2026-10-24 23:29 UTC |
| 37 | ENTERPILOT/GoModel AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready. | 网关与路由 | 1.3k | 2026-11-09 23:45 UTC |
| 38 | bolkedebruin/rdpgw Remote Desktop Gateway in Go for deploying on Linux/BSD/Kubernetes | 网关与路由 | 1.1k | 2026-11-07 12:37 UTC |
| 39 | kittors/CliRelay Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas. | 网关与路由 | 1.1k | 2026-11-10 02:46 UTC |
| 40 | beizhu-1209/AIHelms 企业级 AI 资源纳管平台,提供统一 AI网关、Token调度能力,纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型,并支持 MCP 工具与 Skill 的集中注册分发。具备内外双轨定价、成本归因、统一身份认证、安全审计与效能报表,帮助企业精准控制成本、量化 ROI,高效治理 AI 资产。 | 网关与路由 | 1.0k | 2026-11-04 02:05 UTC |
| 41 | ThinkWatchProject/ThinkWatch-Lite Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request. | 网关与路由 | 936 | 2026-11-09 14:41 UTC |
| 42 | AQBot-Desktop/AQBot ☁️ 轻量级高性能跨平台AI对话 + AI Agent + AI网关桌面客户端 | Lightweight, high-performance cross-platform AI dialogue + AI Agent + AI gateway desktop client | 网关与路由 | 924 | 2026-10-31 14:59 UTC |
| 43 | mozilla-ai/otari Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking. | 网关与路由 | 890 | 2026-11-10 02:25 UTC |
| 44 | ThinkWatchProject/ThinkWatch Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs. | 网关与路由 | 817 | 2026-11-10 05:46 UTC |
| 45 | stacklok/codegate CodeGate: Security, Workspaces and Multiplexing for AI Agentic Frameworks | 网关与路由 | 789 | 2025-06-05 04:41 UTC |
| 46 | apache/casbin-gateway See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records. | 网关与路由 | 649 | 2026-10-31 10:53 UTC |
| 47 | Fast-Editor/Lynkr Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI. | 网关与路由 | 640 | 2026-11-05 23:12 UTC |
| 48 | askalf/dario One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies. | 网关与路由 | 585 | 2026-11-10 04:42 UTC |
| 49 | Calcium-Ion/AstrLink A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection. | 网关与路由 | 548 | 2026-11-08 01:33 UTC |
| 50 | eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. | 网关与路由 | 455 | 2026-11-07 11:33 UTC |