phoenix

Arize-ai活跃维护

开源的 LLM 可观测性与评测平台,能追踪、调试和评估 RAG 与 Agent 应用,帮团队定位大模型链路中的问题。

AI Observability & Evaluation

@arizeai/[email protected]发布于 2026-11-07 00:08 UTC12,233star +40 / 7 天1,284fork同步于 2026-11-10 17:28 UTC

怎么上手

由 README 提炼,执行前请确认
pip install arize-phoenix
硬件要求按 README 说明

README 未说明

有 Docker 镜像
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

开源 AI 可观测平台,用来追踪、评测和调试 LLM 应用

开源的 LLM 可观测性与评测平台,能追踪、调试和评估 RAG 与 Agent 应用,帮团队定位大模型链路中的问题。

核心能力

  • 基于 OpenTelemetry 追踪 LLM 应用运行时调用
  • 用 LLM 对响应与检索做基准评测
  • 创建带版本的数据集用于实验与微调
  • 跟踪提示词、模型与检索变更的实验对比
  • 内置 Playground 优化提示词并回放追踪调用

容易踩的坑

README 未说明是否需要额外下载模型或指定默认端口

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本@arizeai/[email protected]
  1. @arizeai/[email protected]2026-11-07 · 2026-11-07 00:08 UTC
    查看更新说明

    Patch Changes

  2. @arizeai/[email protected]最新正式版2026-11-07 · 2026-11-07 00:08 UTC

    Patch Changes

    • 6e6e101: fix(phoenix-client): preserve literal dollar sequences in prompt variables
  3. arize-phoenix-otel-v0.17.3arize-phoenix-otel: v0.17.32026-11-06 · 2026-11-06 23:31 UTC
    查看更新说明

    0.17.3 (2026-11-06)

    Bug Fixes

    • otel, client, config: parse .env.phoenix the same way in Python and TypeScript (#17075) (67cc379), closes #17048
    • otel: pick the OTLP protocol once (#17531) (0f5024c)
    • otel: show the header name in the URL-encoding warning (#16428) (30949b8)

    Documentation

  4. @arizeai/[email protected]2026-11-06 · 2026-11-06 00:46 UTC
    查看更新说明

    Minor Changes

    • 974be43: Add px prompt-versions list <prompt-identifier> with cursor pagination, optional limits, and pretty, JSON, and raw output. Show creation dates when supported by the server.
  5. arize-phoenix-client-v3.7.0arize-phoenix-client: v3.7.02026-11-05 · 2026-11-05 03:07 UTC
    查看更新说明

    3.7.0 (2026-11-05)

    Features

    • harbor: record model parameters and agent settings in experiment metadata (#17457) (2b2b9fb)

    Bug Fixes

    • client: validate required name and annotator_kind columns in annotation dataframes (#17433) (3146086)

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    Arize Phoenix is Arize's open-source AI observability platform designed for experimentation, evaluation, and troubleshooting. For managed production workflows, Arize also offers Arize AX. Phoenix provides:

    • Tracing - Trace your LLM application's runtime using OpenTelemetry-based instrumentation.
    • Evaluation - Leverage LLMs to benchmark your application's performance using response and retrieval evals.
    • Datasets - Create versioned datasets of examples for experimentation, evaluation, and fine-tuning.
    • Experiments - Track and evaluate changes to prompts, LLMs, and retrieval.
    • Playground- Optimize prompts, compare models, adjust parameters, and replay traced LLM calls.
    • Prompt Management- Manage and test prompt changes systematically using version control, tagging, and experimentation.
    • PXI (Phoenix Intelligence) - An AI engineering agent built into Phoenix for debugging traces, iterating on prompts, and navigating the product.
    • Remote MCP Server - Connect Claude Code, Cursor, and other MCP clients directly to your Phoenix instance's /mcp endpoint to query traces, datasets, experiments, and more.

    Phoenix is vendor and language agnostic with out-of-the-box support for popular frameworks (OpenAI Agents SDK, Claude Agent SDK, LangGraph, Vercel AI SDK, Mastra, CrewAI, LlamaIndex, DSPy) and LLM providers (OpenAI, Anthropic, Google GenAI, Google ADK, AWS Bedrock, OpenRouter, LiteLLM, and more). For details on auto-instrumentation, check out the OpenInference project.

    Phoenix runs practically anywhere, including your local machine, a containerized deployment, or in the cloud. See Self-Hosting for a walkthrough of each option, or jump straight into the Tracing Quickstart.

    [!NOTE] Phoenix is open-source and self-hosted. For a managed platform, Arize offers Arize AX — the same OpenTelemetry/OpenInference instrumentation works with both. See the full comparison.

    Table of Contents

    Run Locally

    Install Phoenix via pip or conda and have a fully functional Phoenix. For all installation and hosting options, see the install guide.

    pip install arize-phoenix
    phoenix serve
    

    Or run it with no install using uvx:

    uvx arize-phoenix serve
    

    Trace Your Application

    The fastest way to send traces is to let your coding agent (Claude Code, Codex, Cursor, and others) instrument your app. From your project directory, run:

    npx @arizeai/phoenix-cli setup
    # or, with Phoenix installed: px setup
    

    Setup detects your framework and LLM provider, installs the right OpenInference instrumentation, and wires up trace export. Prefer to wire it up in code? See the tracing documentation.

    Deploy

    Phoenix container images are available via Docker Hub and can be deployed using Docker or Kubernetes via the Helm chart.

    For Docker Compose, Kubernetes/Helm, and other deployment options, see the self-hosting documentation.

    [!NOTE] The Google Cloud button builds Phoenix from source in Cloud Shell rather than deploying the prebuilt Docker Hub image. The Azure template serves plain HTTP (Azure Container Instances does not terminate TLS) — front it with a TLS proxy such as an Application Gateway before production use.

    Packages

    The arize-phoenix package includes the entire Phoenix platform. However, if you have deployed the Phoenix platform, there are lightweight Python sub-packages and TypeScript packages that can be used in conjunction with the platform.

    Python Subpackages

    PackageVersion & DocsDescription
    arize-phoenix-otelPyPI Version DocsProvides a lightweight wrapper around OpenTelemetry primitives with Phoenix-aware defaults
    arize-phoenix-clientPyPI Version DocsLightweight client for interacting with the Phoenix server via its OpenAPI REST interface
    arize-phoenix-evalsPyPI Version DocsTooling to evaluate LLM applications including RAG relevance, answer relevance, and more

    TypeScript Subpackages

    PackageVersion & DocsDescription
    @arizeai/phoenix-otelNPM Version DocsProvides a lightweight wrapper around OpenTelemetry primitives with Phoenix-aware defaults
    @arizeai/phoenix-clientNPM Version DocsClient for the Arize Phoenix API
    @arizeai/phoenix-evalsNPM Version DocsTypeScript evaluation library for LLM applications (alpha release)
    @arizeai/phoenix-cliNPM Version DocsCLI for fetching traces, datasets, and experiments for use with Claude Code, Cursor, and other coding agents

    Tracing Integrations

    Phoenix is built on top of OpenTelemetry and is vendor, language, and framework agnostic. For details about tracing integrations and example applications, see the OpenInference project and the integrations documentation.

    Python Integrations

    IntegrationPackageVersion
    OpenAIopeninference-instrumentation-openaiPyPI Version
    OpenAI Agentsopeninference-instrumentation-openai-agentsPyPI Version
    LlamaIndexopeninference-instrumentation-llama-indexPyPI Version
    DSPyopeninference-instrumentation-dspyPyPI Version
    AWS Bedrockopeninference-instrumentation-bedrockPyPI Version
    LangChainopeninference-instrumentation-langchainPyPI Version
    LangGraphopeninference-instrumentation-langchainPyPI Version
    MistralAIopeninference-instrumentation-mistralaiPyPI Version
    Cohereopeninference-instrumentation-coherePyPI Version
    Together AIopeninference-instrumentation-togetherPyPI Version
    Ollamaopeninference-instrumentation-ollamaPyPI Version
    Google GenAIopeninference-instrumentation-google-genaiPyPI Version
    Google ADKopeninference-instrumentation-google-adkPyPI Version
    Guardrailsopeninference-instrumentation-guardrailsPyPI Version
    VertexAIopeninference-instrumentation-vertexaiPyPI Version
    CrewAIopeninference-instrumentation-crewaiPyPI Version
    Haystackopeninference-instrumentation-haystackPyPI Version
    LiteLLMopeninference-instrumentation-litellmPyPI Version
    OpenRouteropeninference-instrumentation-openaiPyPI Version
    OrcaRouteropeninference-instrumentation-openaiPyPI Version
    Groqopeninference-instrumentation-groqPyPI Version
    Instructoropeninference-instrumentation-instructorPyPI Version
    Anthropicopeninference-instrumentation-anthropicPyPI Version
    Smolagentsopeninference-instrumentation-smolagentsPyPI Version
    Agnoopeninference-instrumentation-agnoPyPI Version
    BeeAIopeninference-instrumentation-beeaiPyPI Version
    Strands Agentsopeninference-instrumentation-strands-agentsPyPI Version
    Restateopeninference-instrumentation-openai-agentsPyPI Version
    MCPopeninference-instrumentation-mcpPyPI Version
    Microsoft Agent Frameworkopeninference-instrumentation-agent-frameworkPyPI Version
    Pydantic AIopeninference-instrumentation-pydantic-aiPyPI Version
    Pipecatopeninference-instrumentation-pipecatPyPI Version
    AG2openinference-instrumentation-ag2PyPI Version
    Autogen AgentChatopeninference-instrumentation-autogen-agentchatPyPI Version
    Portkeyopeninference-instrumentation-portkeyPyPI Version
    Agent Specopeninference-instrumentation-agentspecPyPI Version
    Claude Agent SDKopeninference-instrumentation-claude-agent-sdkPyPI Version
    TypeSafe AIopeninference-instrumentation-typesafePyPI Version
    Atomic Agentsatomic-agents[observability]PyPI Version

    Span Processors

    Normalize and convert data across other instrumentation libraries by adding span processors that unify data.

    PackageDescriptionVersion
    openinference-instrumentation-openlitOpenInference Span Processor for OpenLIT traces.PyPI Version
    openinference-instrumentation-openllmetryOpenInference Span Processor for OpenLLMetry (Traceloop) traces.PyPI Version

    JavaScript Integrations

    IntegrationPackageVersion
    OpenAI@arizeai/openinference-instrumentation-openaiNPM Version
    OpenAI Agents@arizeai/openinference-instrumentation-openai-agentsNPM Version
    LangChain.js@arizeai/openinference-instrumentation-langchainNPM Version
    TanStack AI@arizeai/openinference-tanstack-aiNPM Version
    Vercel AI SDK@arizeai/openinference-vercelNPM Version
    BeeAI@arizeai/openinference-instrumentation-beeaiNPM Version
    Claude Agent SDK@arizeai/openinference-instrumentation-claude-agent-sdkNPM Version
    Mastra@mastra/arizeNPM Version
    MCP@arizeai/openinference-instrumentation-mcpNPM Version
    TypeSafe AI@arizeai/openinference-instrumentation-typesafeNPM Version

    Java Integrations

    IntegrationPackageVersion
    LangChain4jopeninference-instrumentation-langchain4jMaven Central
    SpringAIopeninference-instrumentation-springAIMaven Central
    Arconia for Spring AIio.arconia:arconia-openinference-semantic-conventionsMaven Central
    Google ADKopeninference-instrumentation-adk-javaMaven Central

    Go Integrations

    IntegrationPackageVersion
    OpenAIgithub.com/Arize-ai/openinference/go/openinference-instrumentation-openai-goGo Reference
    Anthropicgithub.com/Arize-ai/openinference/go/openinference-instrumentation-anthropic-sdk-goGo Reference

    Platforms

    PlatformDescriptionDocs
    BeeAIAI agent framework with built-in observabilityIntegration Guide
    DifyOpen-source LLM app development platformIntegration Guide
    Envoy AI GatewayAI Gateway built on Envoy Proxy for AI workloadsIntegration Guide
    LangFlowVisual framework for building multi-agent and RAG applicationsIntegration Guide
    LiteLLM ProxyProxy server for LLMsIntegration Guide
    FlowiseVisual framework for building LLM applicationsIntegration Guide
    Prompt FlowMicrosoft's prompt flow orchestration toolIntegration Guide
    NVIDIA NeMoNVIDIA NeMo Agent Toolkit for enterprise agentsIntegration Guide
    GraphiteMulti-agent LLM workflow framework with visual builderIntegration Guide

    Vector Databases

    IntegrationDescriptionDocs
    QdrantStaged hybrid search tracing with dense, sparse, RRFIntegration Guide

    Sandboxes

    Run Phoenix code evaluators in hosted sandbox providers for kernel-level isolation and runtime dependency installation.

    IntegrationDescriptionDocs
    E2BHosted micro-VM sandboxes for AI-generated codeIntegration Guide
    DaytonaManaged development sandboxes with snapshot startupIntegration Guide
    Vercel SandboxEphemeral compute on Vercel's infrastructureIntegration Guide
    ModalServerless, Python-first container platformIntegration Guide
    Docker SandboxesCloud sandboxes hosted by DockerIntegration Guide

    For Humans and Coding Agents

    People and coding agents such as Claude Code, Codex, and Cursor can both work with Phoenix. To give an agent access to your traces, datasets, and experiments, connect it in one of these ways:

    • Claude Code or Codex. Install the Arize Phoenix plugin. It registers the Phoenix MCP server and installs the Phoenix skills.
    • Any other agent. Add the Remote MCP Server at your instance's /mcp endpoint. It serves your Phoenix data and the Phoenix skills, which match your server version.
    • Optional CLI. The Phoenix CLI, npx @arizeai/phoenix-cli, runs Phoenix commands in a terminal, and px setup instruments your app through your coding agent.

    See Connect Your Coding Agent for setup steps.

    The skills live in skills/ and teach agents how to trace, evaluate, and debug with Phoenix:

    SkillDescription
    phoenix-cliDebug LLM applications with the Phoenix CLI. Fetch traces, analyze errors, review experiments, and query the GraphQL API
    phoenix-error-analysisRead sampled traces, write notes, and group them into failure categories that pick eval targets and fix priorities
    phoenix-evalsBuild, run, and validate evaluators for AI/LLM applications using Phoenix
    phoenix-harborConfigure and interpret the Phoenix plugin for Harbor agent evaluations
    phoenix-tracingOpenInference semantic conventions and instrumentation for tracing LLM applications

    Security & Privacy

    We take data security and privacy very seriously. For more details, see our Security and Privacy documentation.

    Telemetry

    By default, Phoenix collects basic web analytics (e.g., page views, UI interactions) to help us understand how Phoenix is used and improve the p