数据清洗与处理

8 条

去重、过滤、质量打分的流水线。

#仓库Stars
1openai/openai-cookbook
Examples and guides for using the OpenAI API
77k
2rocketride-org/rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
20k
3apache/arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
17k
4voxel51/fiftyone
Refine high-quality datasets and visual AI models
11k
5onceupon/Bash-Oneliner
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
11k
6datajuicer/data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
7.2k
7NVIDIA/DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
5.8k
8unionai-oss/pandera
A light-weight, flexible, and expressive statistical data testing library
4.5k