MLOps 平台

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

The absolute trainer to light up AI agents.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

An orchestration platform for the development, production, and observation of data assets.

Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Open-source, low-code AutoML platform for Python. PyCaret 4.0: sklearn-native engine + React control plane.

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

:sunglasses: A curated list of awesome MLOps tools

Curated list of the best truly open-source AI projects, models, tools, and infrastructure. Daily updated.

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

✨ Build a machine learning model from a prompt

LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

nannyml: post-deployment data science in python

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Gemini, Ollama, etc supported. :fireworks: Code RAG

MLeap: Deploy ML Pipelines to Production

Production-shaped MLOps Python package and reference implementation of the MLOps Coding Course: MLflow, scikit-learn, Pydantic, Pandera, uv, and mise.

The simplest way to serve AI/ML models in production

Efficient Deep Learning Systems course materials

CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.

LightlyStudio - The Unified Data Platform for Multimodal ML

Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes

List of Deep Learning Cloud Providers

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

Learn how to create, develop, and maintain a state-of-the-art MLOps code base

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.

NucliaDB, The AI Search database for RAG

Google Cloud Platform Vertex AI end-to-end workflows for machine learning operations

Serverless LLM Serving for Everyone.

BharatMLStack is an open-source, end-to-end machine learning infrastructure stack built at Meesho to support real-time and batch ML workloads at Bharat scale

Cookiecutter template for FastAPI projects using: Machine Learning, uv, Github Actions and Pytests

FastAPI Skeleton App to serve machine learning models production-ready.

The missing bridge between your ML models and your AI agents.