LLM 可观测

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

APM, Application Performance Monitoring System

Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.

CNCF Jaeger, a Distributed Tracing Platform

Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.

Your window into all of your data

Build production-ready applications in TypeScript

Zipkin is a distributed tracing system

Apache Doris is a real-time analytics and hybrid search database for AI agents.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Capture SSL/TLS plaintext with eBPF—no MITM proxy or custom CA installation. Supports Linux and Android on x86_64\arm64 and loong64.

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

APM, (Application Performance Management) tool for large-scale distributed systems.

BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.

Continuous Profiling Platform. Debug performance issues down to a single line of code

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

A curated collection of publicly available resources on how technology and tech-savvy organizations around the world practice Site Reliability Engineering (SRE)

highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

⚙️🦀 Build modular and scalable LLM Applications in Rust

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

Coroot is an open-source observability and APM tool with AI-powered Root Cause Analysis. It combines metrics, logs, traces, continuous profiling, and SLO-based alerting with predefined dashboards and inspections.

Complete open-source monitoring and observability platform.

OpenTelemetry Collector

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

An AI-powered next-generation open source real-time observability system.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

Production-safe dynamic tracing and diagnostics for Java applications—attach to live JVMs with no restart or recompilation.

An awesome & curated list of best LLMOps tools for developers

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

See what Claude Code and Codex actually send to the API — and what each part costs.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

Grafana Mimir provides horizontally scalable, highly available, multi-tenant, long-term storage for Prometheus.

Stunning status pages, batteries included!

Enterprise-ready, Git native feature management solution

An application observability facade for the most popular observability tools. Think SLF4J, but for observability.

Aya is an eBPF library for the Rust programming language, built with a focus on developer experience and operability.

AI observability platform for production LLM and agent systems.

A curated list of awesome DevOps platforms, tools, practices and resources

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

Open source APM: OpenTelemetry traces, metrics, and logs

The missing DevTools for Claude Code — inspect session logs, tool calls, token usage, subagents, and context window in a visual UI. Free, open source.

Main repository for Datadog Agent

Agent Skills as a Memory Layer

OpenTelemetry Collector distribution with programmable pipelines

Kiali project, observability for the Istio service mesh

🚀 Realtime Monitoring solution for Node.js/Express.js apps, inspired by status.github.com, sponsored by https://dynobase.dev

High performance Java APM. Powered by ASM. Try it. Test it. If you feel its better, use it.