网关与路由
74 条多模型聚合、协议转换、限流与回退。
| # | 仓库 | 分类 | Stars | 最近推送 |
|---|---|---|---|---|
| 1 | traefik/traefik 把服务发现和路由配置从手写 nginx conf 里抽出来,让容器编排器自己决定流量怎么走 | 网关与路由 | 66k | 2026-11-10 15:02 UTC |
| 2 | BerriAI/litellm 自托管 LLM 网关,用 OpenAI 格式统一 100+ 供应商,顶替各家 SDK 和自建代理层 | 网关与路由 | 63k | 2026-11-10 23:17 UTC |
| 3 | QuantumNous/new-api 自托管 LLM 网关,把多家模型渠道收成一个 OpenAI/Claude/Gemini 兼容入口,顺带管配额和计费 | 网关与路由 | 52k | 2026-11-10 16:46 UTC |
| 4 | Kong/kong 在 API 网关里做 LLM 多供应商路由和 MCP 治理,把认证、限流、可观测性留在同一层 | 网关与路由 | 44k | 2026-10-19 02:45 UTC |
| 5 | songquanpeng/one-api 把十几家模型厂商收敛成一个 OpenAI 兼容端点,顺带做 key 分发和额度控制 | 网关与路由 | 37k | 2026-01-09 03:26 UTC |
| 6 | fosrl/pangolin 自托管零信任接入层,用 WireGuard 隧道替代公网端口暴露和 Cloudflare Tunnel | 网关与路由 | 24k | 2026-11-10 21:46 UTC |
| 7 | lidge-jun/opencodex 本地协议翻译网关,让 Codex CLI 和 Claude Code 接上非官方模型后端 | 网关与路由 | 18k | 2026-11-10 23:14 UTC |
| 8 | apache/apisix 用 etcd 做配置面、NGINX 做数据面的动态 API 网关,同时顶替 LLM 代理层 | 网关与路由 | 17k | 2026-11-10 09:41 UTC |
| 9 | casdoor/casdoor 自托管 IAM,用一个 Go 二进制替掉 Keycloak,同时给 MCP/Agent 发令牌 | 网关与路由 | 15k | 2026-11-10 18:06 UTC |
| 10 | Portkey-AI/gateway 在应用和各家模型厂商之间插一层 OpenAI 兼容路由,把重试、fallback、护栏和日志从业务代码里挪出去 | 网关与路由 | 13k | 2026-05-25 13:54 UTC |
| 11 | triton-inference-server/server 把 TensorRT、PyTorch、ONNX 等多个框架的模型统一成一套 HTTP/gRPC 推理接口,替代自己写 Flask 包一层模型的做法 | 网关与路由 | 11k | 2026-11-10 23:23 UTC |
| 12 | TykTechnologies/tyk 把 REST/GraphQL/gRPC/MCP 收敛到一个 Go 网关进程里,顺带做 LLM 与 MCP 工具调用的策略层 | 网关与路由 | 11k | 2026-11-10 14:50 UTC |
| 13 | higress-group/higress 🤖 AI Gateway | AI Native API Gateway | 网关与路由 | 9.7k | 2026-11-10 17:04 UTC |
| 14 | maximhq/bifrost Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS. | 网关与路由 | 9.5k | 2026-11-10 23:10 UTC |
| 15 | coaidev/coai 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache. | 网关与路由 | 9.3k | 2026-03-12 10:00 UTC |
| 16 | tbphp/gpt-load Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。 | 网关与路由 | 7.2k | 2026-11-09 15:33 UTC |
| 17 | katanemo/plano Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. | 网关与路由 | 7.1k | 2026-10-24 19:03 UTC |
| 18 | vllm-project/semantic-router An open, programmable decision layer for models and compute. | 网关与路由 | 6.4k | 2026-11-10 21:02 UTC |
| 19 | agentgateway/agentgateway Next Generation Agentic Proxy for AI Agents and MCP servers | 网关与路由 | 6.1k | 2026-11-10 18:59 UTC |
| 20 | weave-os/router Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change. | 网关与路由 | 5.6k | 2026-11-10 22:56 UTC |
| 21 | pomerium/pomerium Pomerium is an identity and context-aware access proxy. | 网关与路由 | 5.1k | 2026-11-10 22:37 UTC |
| 22 | IBM/mcp-context-forge An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins. | 网关与路由 | 4.8k | 2026-11-10 17:44 UTC |
| 23 | arvin341az-glitch/RVG Multi-protocol proxy management panel built with Python & FastAPI, deployable on Railway. | 网关与路由 | 4.3k | 2026-09-13 16:14 UTC |
| 24 | octelium/octelium A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure. | 网关与路由 | 4.2k | 2026-11-10 13:04 UTC |
| 25 | 1technophile/OpenMQTTGateway MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa. | IoT / 固件 | 4.1k | 2026-11-10 11:47 UTC |
| 26 | seakee/CPA-Manager-Plus A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health. | 网关与路由 | 4.1k | 2026-11-10 20:03 UTC |
| 27 | nextlevelbuilder/goclaw GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety. | 网关与路由 | 3.7k | 2026-11-09 07:19 UTC |
| 28 | kaitranntt/ccs Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready. | 网关与路由 | 2.9k | 2026-11-04 20:10 UTC |
| 29 | bestruirui/octopus One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关 | 网关与路由 | 2.7k | 2026-10-23 00:51 UTC |
| 30 | krakend/krakend-ce KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go. | 网关与路由 | 2.7k | 2026-11-02 14:51 UTC |
| 31 | theagentrouter/agent-router Manages Unified Access to Generative AI Services built on Envoy Gateway | 网关与路由 | 2.4k | 2026-11-10 15:51 UTC |
| 32 | APIParkLab/APIPark Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用。 | 网关与路由 | 1.8k | 2026-10-27 02:40 UTC |
| 33 | Continuum-AI-Corp/OrcaRouter-Lite Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter | 网关与路由 | 1.7k | 2026-10-08 07:08 UTC |
| 34 | theopenco/llmgateway Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. | 网关与路由 | 1.7k | 2026-11-10 23:43 UTC |
| 35 | astaxie/TokenHub TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable. | 网关与路由 | 1.4k | 2026-11-10 18:10 UTC |
| 36 | LiteLLM-Labs/litellm-agent-control-plane 1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents. | 网关与路由 | 1.3k | 2026-10-24 23:29 UTC |
| 37 | ENTERPILOT/GoModel AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready. | 网关与路由 | 1.3k | 2026-11-10 22:43 UTC |
| 38 | bolkedebruin/rdpgw Remote Desktop Gateway in Go for deploying on Linux/BSD/Kubernetes | 网关与路由 | 1.1k | 2026-11-07 12:37 UTC |
| 39 | kittors/CliRelay Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas. | 网关与路由 | 1.1k | 2026-11-10 17:31 UTC |
| 40 | beizhu-1209/AIHelms 企业级 AI 资源纳管平台,提供统一 AI网关、Token调度能力,纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型,并支持 MCP 工具与 Skill 的集中注册分发。具备内外双轨定价、成本归因、统一身份认证、安全审计与效能报表,帮助企业精准控制成本、量化 ROI,高效治理 AI 资产。 | 网关与路由 | 1.0k | 2026-11-04 02:05 UTC |
| 41 | ThinkWatchProject/ThinkWatch-Lite Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request. | 网关与路由 | 1.0k | 2026-11-10 18:27 UTC |
| 42 | AQBot-Desktop/AQBot ☁️ 轻量级高性能跨平台AI对话 + AI Agent + AI网关桌面客户端 | Lightweight, high-performance cross-platform AI dialogue + AI Agent + AI gateway desktop client | 网关与路由 | 924 | 2026-10-31 14:59 UTC |
| 43 | mozilla-ai/otari Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking. | 网关与路由 | 900 | 2026-11-10 21:32 UTC |
| 44 | ThinkWatchProject/ThinkWatch Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs. | 网关与路由 | 817 | 2026-11-10 09:53 UTC |
| 45 | stacklok/codegate CodeGate: Security, Workspaces and Multiplexing for AI Agentic Frameworks | 网关与路由 | 789 | 2025-06-05 04:41 UTC |
| 46 | apache/casbin-gateway See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records. | 网关与路由 | 649 | 2026-10-31 10:53 UTC |
| 47 | Fast-Editor/Lynkr Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI. | 网关与路由 | 640 | 2026-11-05 23:12 UTC |
| 48 | askalf/dario One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies. | 网关与路由 | 586 | 2026-11-10 22:06 UTC |
| 49 | Calcium-Ion/AstrLink A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection. | 网关与路由 | 549 | 2026-11-10 16:53 UTC |
| 50 | eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. | 网关与路由 | 456 | 2026-11-07 11:33 UTC |