数据质量

一套把 ML 从 notebook 推到 CI/CD 和线上服务的完整工程化教程，用来替换零散的 MLOps 拼装经验

用 JSON Schema 直接生成 React 表单，替代手写表单组件和字段映射层

把散在仓库、BI、管道里的元数据收成一张带血缘和业务语义的图，给人和 AI 助手当上下文层

给数据表写断言并自动生成校验报告，顶替手写 SQL 对账脚本和一次性 pandas 检查

在训练前用现有模型的预测概率反查错标和异常样本，替代人工抽检数据集

给 ML/LLM 流水线加一层可断言的质量门禁，把漂移和效果退化挡在发布前

在训练与在线推理之间统一特征定义，替掉散落在各处的特征拼接脚本和离线在线两套逻辑

A light-weight, flexible, and expressive statistical data testing library

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Lightweight, extensible data validation library for Python

Data Contracts engine for the modern data stack. https://www.soda.io

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.

Validation library with type-safe schemas and rules

Automatically find issues in image datasets and practice data-centric computer vision.

Data quality assessment and metadata reporting for data frames and database tables

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

Data validation toolkit for assessing and monitoring data quality.

Coercion and validation for data structures

The data-validation toolkit for enhanced dbt (data build tool) PR review

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

A proxy that validates responses and requests against an OpenAPI document. https://www.npmjs.com/package/openapi-cop https://hub.docker.com/r/lxlu/openapi-cop

The Open Data Editor (ODE) is a no-code application to explore and validate tabular data in a simple way. Forever free and open source project powered by the Frictionless Framework.

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

AtroPIM is a flexible, highly configurable, modular, open-source product information management (PIM) system that extends the AtroCore data management and system integration platform.