这是资源清单仓库,本身不含可运行代码,需按条目跳转到各项目自行安装;部分收录项目依赖外部模型或 API Key,需另行准备

awesome-LLM-resources
WangRongshengApache-2.0活跃维护汇总全球优质大模型学习资料,覆盖多模态生成、Agent、辅助编程、模型训练与推理、RAG 等方向,帮开发者快速找到教程、课程和实战资源。
🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.
README 未说明README 未说明
一份持续更新的 LLM 资源清单,帮工程师快速找到数据、微调、推理、Agent 等各环节值得用的开源项目
汇总全球优质大模型学习资料,覆盖多模态生成、Agent、辅助编程、模型训练与推理、RAG 等方向,帮开发者快速找到教程、课程和实战资源。
核心能力
- 按数据、微调、推理、评估、RAG、Agent 等环节分类索引项目
- 收录多模态生成、辅助编程、AI 审稿、小语言模型等专题资源
- 汇总书籍、课程、教程、论文与社区等学习材料
- 标注推荐与热门条目,便于快速筛选
容易踩的坑
暂无 release 数据(可能没有发版,或尚未同步)。
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。

[!TIP] 如果您对医疗数据集/大模型/多模态/评估相关资源感兴趣!请访问我们的 🤗 Awesome-AI4Med !
📢友情赞助
⚡ 稳定高效的模型通道:价格低至官方渠道0.3折,模型倍率公开透明,多节点冗余保障,有效降低限流、429 与断连影响; 🧠 主流模型一站式接入:一个 API Key 即可调用 Claude、ChatGPT、Gemini、Kimi、GLM、DeepSeek 等主流模型,覆盖文本生成、图像生成、多模态推理等场景; 📚 契合本仓库资源实践:无论是多模态生成、辅助编程、模型推理还是 MCP / Agent 开发,都可直接把 Infistar 作为 OpenAI、Claude、Gemini 兼容上游,边学边练,零门槛跑通仓库中收录的各类项目与教程;
🎁 专属福利:通过 [专属推广链接] 注册即可领取 5 美元等值测试额度 / 首充专属优惠,快速接入并开始调用!
点此链接注册 ,立即开始使用!
目录
- 推荐 Suggestion 🌟
- 数据 Data
- 微调 Fine-Tuning
- Agentic RL 🌟
- 推理 Inference
- 评估 Evaluation
- 体验 Usage
- 知识库 RAG
- 智能体 Agents
- 研究 Research 🔥
- 代码 Coding
- 视频 Video
- 图片 Image 🔥
- 搜索 Search
- 语音 Speech 🔥
- 世界模型 World Models 🔥
- 龙虾 OpenClaw
- 统一模型 Unified Model 🌟
- 书籍 Book
- 课程 Course
- 教程 Tutorial
- 论文 Paper
- 社区 Community
- 模型上下文协议 MCP
- 技能 Skills
- 推理 Open o1
- 推理 Open o3
- 小语言模型 Small Language Model 🌟
- 小多模态模型 Small Vision Language Model 🌟
- 技巧 Tips
推荐 Suggestion
Podcast
- 谷歌AI的14年、Gemini翻身之战,与视觉理解模型:专访DeepMind前核心科学家Andrew Dai|Neolabs特辑
- 140. 对姚顺宇的4小时访谈:请允许我小疯一下!在Anthropic和Gemini训模型、技术预测、英雄主义已过去
- 张驰: A Year Inside ByteDance's AI Lab
- Luo Fuli: OpenClaw, Agent Frameworks — The AI Paradigm Has Already Changed Dramatically!
- A 7-hour marathon interview with Saining Xie: World Models, AMI Labs, Yann LeCun, Fei-Fei Li, and 42
- 翁家翌:OpenAI,GPT,强化学习,Infra,后训练,天授,tuixue,开源,CMU,清华|WhynotTV Podcast
- Lovart 创始人陈冕×罗永浩!且让我大闹一场,然后悄然离去
- MiniMax 创始人闫俊杰×罗永浩!大山并非无法翻越
- 影视飓风TIM×罗永浩!用影像打开世界的梦想家
- 129. 全球大模型第一股的上市访谈,和智谱CEO张鹏聊:敢问路在何方?
- 128. Manus决定出售前最后的访谈:啊,这奇幻的2025年漂流啊…
- 122. 朱啸虎现实主义故事的第三次连载:人工智能的盛筵与泡泡
- 119. Kimi Linear、Minimax M2?和杨松琳考古算法变种史,并预演未来架构改进方案
- 118. 对李想的第二次3小时访谈:CEO大模型、MoE、梁文锋、VLA、能量、记忆、对抗人性、亲密关系、人类的智慧
- 115. 对OpenAI姚顺雨3小时访谈:6年Agent研究、人与系统、吞噬的边界、既单极又多元的世界
- 113. 和杨植麟时隔1年的对话:K2、Agentic LLM、缸中之脑和“站在无限的开端”
数据 Data
[!NOTE]
此处命名为
数据,但这里并没有提供具体数据集,而是提供了处理获取大规模数据的方法
- AotoLabel: Label, clean and enrich text datasets with LLMs.
- LabelLLM: The Open-Source Data Annotation Platform.
- data-juicer: A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs!
- OmniParser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
- MinerU (
🔥): MinerU is a one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction. - PDF-Extract-Kit: A Comprehensive Toolkit for High-Quality PDF Content Extraction.
- Parsera: Lightweight library for scraping web-sites with LLMs.
- Sparrow: Sparrow is an innovative open-source solution for efficient data extraction and processing from various documents and images.
- Docling: Get your documents ready for gen AI.
- GOT-OCR2.0: OCR Model.
- LLM Decontaminator: Rethinking Benchmark and Contamination for Language Models with Rephrased Samples.
- DataTrove: DataTrove is a library to process, filter and deduplicate text data at a very large scale.
- llm-swarm: Generate large synthetic datasets like Cosmopedia.
- Distilabel: Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
- Common-Crawl-Pipeline-Creator: The Common Crawl Pipeline Creator.
- Tabled: Detect and extract tables to markdown and csv.
- Zerox: Zero shot pdf OCR with gpt-4o-mini.
- DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception.
- TensorZero: make LLMs improve through experience.
- Promptwright: Generate large synthetic data using a local LLM.
- pdf-extract-api: Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models.
- pdf2htmlEX: Convert PDF to HTML without losing text or format.
- Extractous: Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
- MegaParse: File Parser optimised for LLM Ingestion with no loss.
- MarkItDown: Python tool for converting files and office documents to Markdown.
- datasketch: datasketch gives you probabilistic data structures that can process and search very large amount of data super fast, with little loss of accuracy.
- semhash: lightweight and flexible tool for deduplicating datasets using semantic similarity.
- ReaderLM-v2: a 1.5B parameter language model that converts raw HTML into beautifully formatted markdown or JSON.
- Bespoke Curator: Data Curation for Post-Training & Structured Data Extraction.
- LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). Extracts signals from prompts & responses, ensuring safety & security.
- Curator: Synthetic Data curation for post-training and structured data extraction.
- olmOCR: A toolkit for training language models to work with PDF documents in the wild.
- Easy Dataset (
🔥): A powerful tool for creating fine-tuning datasets for LLM. - BabelDOC: PDF scientific paper translation and bilingual comparison library.
- Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting.
- EasyDistill: Easy Knowledge Distillation for Large Language Models.
- ContextGem: a free, open-source LLM framework that makes it radically easier to extract structured data and insights from documents.
- OCRFlux: a lightweight yet powerful multimodal toolkit that significantly advances PDF-to-Markdown conversion, excelling in complex layout handling, complicated table parsing and cross-page content merging.
- DataFlow: Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- DatasetLoom (
multimodal): 一个面向多模态大模型训练的智能数据集构建与评估平台. - Logics-Parsing
- DeepSeek-OCR
- PaddleOCR-VL
- Chandra: a highly accurate OCR model that converts images and PDFs into structured HTML/Markdown/JSON while preserving layout information.
- HunyuanOCR: a leading end-to-end OCR expert VLM powered by Hunyuan's native multimodal architecture.
- DeepSeek-OCR-2: Visual Causal Flow.
- PaddleOCR-VL-1.5 (
🔥): Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsing. - GLM-OCR: a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture.
微调 Fine-Tuning
- LLaMA-Factory (
🔥): Unify Efficient Fine-Tuning of 100+ LLMs. - 360-LLaMA-Factory: Unify Efficient Fine-Tuning of 100+ LLMs. (add Sequence Parallelism for supporting long context training)
- unsloth (
🔥): 2-5X faster 80% less memory LLM finetuning. - TRL: Transformer Reinforcement Learning.
- Firefly: Firefly: 大模型训练工具,支持训练数十种大模型
- Xtuner: An efficient, flexible and full-featured toolkit for fine-tuning large models.
- torchtune: A Native-PyTorch Library for LLM Fine-tuning.
- Swift: Use PEFT or Full-parameter to finetune 200+ LLMs or 15+ MLLMs.
- AutoTrain: A new way to automatically train, evaluate and deploy state-of-the-art Machine Learning models.
- OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO).
- Ludwig: Low-code framework for building custom LLMs, neural networks, and other AI models.
- mistral-finetune: A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models.
- aikit: Fine-tune, build, and deploy open-source LLMs easily!
- H2O-LLMStudio: H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs.
- LitGPT: Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
- LLMBox: A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
- PaddleNLP: Easy-to-use and powerful NLP and LLM library.
- workbench-llamafactory: This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
- OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral).
- TinyLLaVA Factory: A Framework of Small-scale Large Multimodal Models.
- LLM-Foundry: LLM training code for Databricks foundation models.
- lmms-finetune: A unified codebase for finetuning (full, lora) large multimodal models, supporting llava-1.5, qwen-vl, llava-interleave, llava-next-video, phi3-v etc.
- Simplifine: Simplifine lets you invoke LLM finetuning with just one line of code using any Hugging Face dataset or model.
- Transformer Lab: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
- Liger-Kernel: Efficient Triton Kernels for LLM Training.
- ChatLearn: A flexible and efficient training framework for large-scale alignment.
- nanotron: Minimalistic large language model 3D-parallelism training.
- Proxy Tuning: Tuning Language Models by Proxy.
- Effective LLM Alignment: Effective LLM Alignment Toolkit.
- Autotrain-advanced
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
- Vision-LLM Alignemnt: This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vision models.
- finetune-Qwen2-VL: Quick Start for Fine-tuning or continue pre-train Qwen2-VL Model.
- Online-RLHF: A recipe for online RLHF and online iterative DPO.
- InternEvo: an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
- veRL (
🔥): Volcano Engine Reinforcement Learning for LLM. - Axolotl: Axolotl is designed to work with YAML config files that contain everything you need to preprocess a dataset, train or fine-tune a model, run model inference or evaluation, and much more.
- Oumi: Everything you need to build state-of-the-art foundation models, end-to-end.
- Kiln: The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.
- DeepSeek-671B-SFT-Guide: An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions.
- MLX-VLM: MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
- RL-Factory: Train your Agent model via our easy and efficient framework.
- RM-Gallery: A One-Stop Reward Model Platform.
- ART: rain multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training.
- LMMs-Engine: A simple, any-to-any modality framework for pretraining and finetuning. Lean, flexible, and built for research.
- dLLM: a library that unifies the training and evaluation of diffusion language models, bringing transparency and reproducibility to the entire development pipeline.
diffusion - Miles: an enterprise-facing reinforcement learning framework for large-scale MoE post-training and production workloads.
- Skills: a collection of pipelines to improve "skills" of large language models (LLMs).
- Twinkle: a lightweight, client-server training framework engineered with modular, high-cohesion interfaces.
- NeMo AutoModel: Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support.
- VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo.
- Soup: One-config CLI for LLM post-training (SFT/DPO/GRPO/KTO/ORPO). Layer streaming trains an 8B model on a 4 GB laptop GPU by streaming the frozen base from host RAM one decoder layer at a time.
Agentic RL
- veRL (
🔥): https://github.com/volcengine/verl - AReaL: https://github.com/inclusionAI/AReaL
- slime (
🔥): https://github.com/THUDM/slime - Agent Lightning: https://github.com/microsoft/agent-lightning
- Molt: https://github.com/NVIDIA-NeMo/labs-molt
- prime-rl: https://github.com/PrimeIntellect-ai/prime-rl
推理 Inference
- ollama (
🔥): Get up and running with Llama 3, Mistral, Gemma, and other large language models. - Open WebUI: User-friendly WebUI for LLMs (Formerly Ollama WebUI).
- Text Generation WebUI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
- Xinference: A powerful and versatile library designed to serve language, speech recognition, and multimodal models.
- LangChain: Build context-aware reasoning applications.
- LlamaIndex: A data framework for your LLM applications.
- lobe-chat: an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers, Multi-Modals (Vision/TTS) and plugin system.
- TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.
- vllm (
🔥): A high-throughput and memory-efficient inference and serving engine for LLMs. - LlamaChat: Chat with your favourite LLaMA models in a native macOS app.
- NVIDIA ChatRTX: ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, or other data.
- LM Studio (
🔥): Discover, download, and run local LLMs. - chat-with-mlx: Chat with your data natively on Apple Silicon using MLX Framework.
- LLM Pricing: Quickly Find the Perfect Large Language Models (LLM) API for Your Budget! Use Our Free Tool for Instant Access to the Latest Prices from Top Providers.
- Open Interpreter: A natural language interface for computers.
- Chat-ollama: An open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.
- chat-ui: Open source codebase powering the HuggingChat app.
- MemGPT: Create LLM agents with long-term memory and custom tools.
- koboldcpp: A simple one-file way to run various GGML and GGUF models with KoboldAI's UI.
- LLMFarm: llama and other large language models on iOS and MacOS offline using GGML library.
- enchanted: Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
- Flowise: Drag & drop UI to build your customized LLM flow.
- Jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM).
- LMDeploy: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
- MInference: About To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
- Mem0: The memory layer for Personalized AI.
- SGLang (
🔥): SGLang is yet another fast serving framework for large language models and vision language models. - AirLLM: AirLLM optimizes inference memory usage, allowing 70B large language models to run inference on a single 4GB GPU card without quantization, distillation and pruning. And you can run 405B Llama3.1 on 8GB vram now.
- LLMHub: LLMHub is a lightweight management platform designed to streamline the operation and interaction with various language models (LLMs).
- YuanChat
- LiteLLM (
🔥): Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, Groq etc.] - GuideLLM: GuideLLM is a powerful tool for evaluating and optimizing the deployment of large language models (LLMs).
- LLM-Engines: A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
- OARC: ollama_agent_roll_cage (OARC) is a local python agent fusing ollama llm's with Coqui-TTS speech models, Keras classifiers, Llava vision, Whisper recognition, and more to create a unified chatbot agent for local, custom automation.
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains.
- MemoryScope: MemoryScope provides LLM chatbots with powerful and flexible long-term memory capabilities, offering a framework for building such abilities.
- OpenLLM: Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
- Infinity: The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense embedding, sparse embedding, tensor and full-text.
- optillm: an OpenAI API compatible optimizing inference proxy which implements several state-of-the-art techniques that can improve the accuracy and performance of LLMs.
- LLaMA Box: LLM inference server implementation based on llama.cpp.
- ZhiLight: A highly optimized inference acceleration engine for Llama and its variants.
- DashInfer: DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures.
- LocalAI: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required.
- ktransformers: A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations.
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 14+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
- Chitu: High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
- TokenSwift: From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation.
- Cherry Studio (
🔥): a desktop client that supports for multiple LLM providers, available on Windows, Mac and Linux. - Shimmy: Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary.
- LlamaBarn: Run local LLMs on your Mac with a simple menu bar app.
- Parallax: a distributed model serving framework that lets you build your own AI cluster anywhere.
- xLLM: A high-performance inference engine for LLMs, optimized for diverse AI accelerators.
- Rapid-MLX: OpenAI-compatible local LLM inference server for Apple Silicon, 2-4x faster than Ollama.
- TokenSpeed: a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability. Our goal is to be the most performant inference engine for production agentic workloads.
- FreeToken: Unlock datacenter-class intelligence on the hardware you already own.
- NInfer: High-performance single-GPU inference for selected model checkpoints and GPUs.
评估 Evaluation
- lm-evaluation-harness: A framework for few-shot evaluation of language models.
- opencompass (
🔥): OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets. - llm-comparator: LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed.
- EvalScope (
🔥) - Weave: A lightweight toolkit for tracking and evaluating LLM applications.
- MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures.
- Evaluation guidebook: If you've ever wondered how to make sure an LLM performs well on your specific task, this guide is for you!
- Ollama Benchmark: LLM Benchmark for Throughput via Ollama (Local LLMs).
- VLMEvalKit: Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks.
- AGI-Eval
- EvalScope: A streamlined and customizable framework for efficient large model evaluation and performance benchmarking.
- DeepEval: a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems.
- Lighteval: Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends.
- QwQ/eval: QwQ is the reasoning model series developed by Qwen team, Alibaba Cloud.
- Evalchemy: A unified and easy-to-use toolkit for evaluating post-trained language models.
- MathArena: Evaluation of LLMs on latest math competitions.
- YourBench: A Dynamic Benchmark Generation Framework.
- MedEvalKit: A Unified Medical Evaluation Framework.
- OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards.
体验 Usage
- LM Arena
- Design Arena
- Vals AI
evaluation - 蚂蚁数科
知识库 RAG
- AnythingLLM: The all-in-one AI app for any LLM with full RAG and AI Agent capabilites.
- MaxKB: 基于 LLM 大语言模型的知识库问答系统。开箱即用,支持快速嵌入到第三方业务系统
- RAGFlow: An open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
- Dify: An open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
- FastGPT: A knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization.
- Langchain-Chatchat: 基于 Langchain 与 ChatGLM 等不同大语言模型的本地知识库问答
- QAnything: Question and Answer based on Anything.
- Quivr: A personal productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented generation.
- RAG-GPT: RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.
- Verba: Retrieval Augmented Generation (RAG) chatbot powered by Weaviate.
- FlashRAG: A Python Toolkit for Efficient RAG Research.
- GraphRAG: A modular graph-based Retrieval-Augmented Generation (RAG) system.
- LightRAG: LightRAG helps developers with both building and optimizing Retriever-Agent-Generator pipelines.
- GraphRAG-Ollama-UI: GraphRAG using Ollama with Gradio UI and Extra Features.
- nano-GraphRAG: A simple, easy-to-hack GraphRAG implementation.
- RAG Techniques: This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.
- ragas: Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines.
- kotaemon: An open-source clean & customizable RAG UI for chatting with your documents. Built with both end users and developers in mind.
- RAGapp: The easiest way to use Agentic RAG in any enterprise.
- TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text.
- LightRAG: Simple and Fast Retrieval-Augmented Generation.
- TEN: the Next-Gen AI-Agent Framework, the world's first truly real-time multimodal AI agent framework.
- AutoRAG: RAG AutoML tool for automatically finding an optimal RAG pipeline for your data.
- KAG: KAG is a knowledge-enhanced generation framework based on OpenSPG engine, which is used to build knowledge-enhanced rigorous decision-making and information retrieval knowledge services.
- Fast-GraphRAG: RAG that intelligently adapts to your use case, data, and queries.
- Tiny-GraphRAG
- DB-GPT GraphRAG: DB-GPT GraphRAG integrates both triplet-based knowledge graphs and document structure graphs while leveraging community and document retrieval mechanisms to enhance RAG capabilities, achieving comparable performance while consuming only 50% of the tokens required by Microsoft's GraphRAG. Refer to the DB-GPT Graph RAG User Manual for details.
- Chonkie: The no-nonsense RAG chunking library that's lightweight, lightning-fast, and ready to CHONK your texts.
- RAGLite: RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with PostgreSQL or SQLite.
- KAG: KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs.
- CAG: CAG leverages the extended context windows of modern large language models (LLMs) by preloading all relevant resources into the model’s context and caching its runtime parameters.
- MiniRAG: an extremely simple retrieval-augmented generation framework that enables small models to achieve good RAG performance through heterogeneous graph indexing and lightweight topology-enhanced retrieval.
- XRAG: a benchmarking framework designed to evaluate the foundational components of advanced Retrieval-Augmented Generation (RAG) systems.
- Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation.
- RAG-Anything: All-in-One RAG System.
智能体 Agents
- AutoGen: AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks. AutoGen AIStudio
- CrewAI: Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
- Coze
- AgentGPT: Assemble, configure, and deploy autonomous AI Agents in your browser.
- XAgent: An Autonomous LLM Agent for Complex Task Solving.
- MobileAgent: The Powerful Mobile Device Operation Assistant Family.
- Lagent: A lightweight framework for building LLM-based agents.
- Qwen-Agent: Agent framework and applications built upon Qwen2, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
- LinkAI: 一站式 AI 智能体搭建平台
- Baidu APPBuilder
- agentUniverse: agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications. Furthermore, through the community, they can exchange and share practices of patterns across different domains.
- LazyLLM: 低代码构建多Agent大模型应用的开发工具
- AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
- AgentField: Open-source control plane for building and operating AI agents like APIs at scale, with routing, memory, observability, identity, auth, and policy controls.
- MoA: Mixture of Agents (MoA) is a novel approach that leverages the collective strengths of multiple LLMs to enhance performance, achieving state-of-the-art results.
- Agently: AI Agent Application Development Framework.
- OmAgent: A multimodal agent framework for solving complex tasks.
- Tribe: No code tool to rapidly build and coordinate multi-agent teams.
- CAMEL: First LLM multi-agent framework and an open-source community dedicated to finding the scaling law of agents.
- PraisonAI: PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customisation, and efficient human-agent collaboration.
- IoA: An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through internet-like connectivity.
- llama-agentic-system : Agentic components of the Llama Stack APIs.
- Agent Zero: Agent Zero is not a predefined agentic framework. It is designed to be dynamic, organically growing, and learning as you use it.
- Agents: An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents.
- AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
- FastAgency: The fastest way to bring multi-agent workflows to production.
- Swarm: Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.
- Agent-S: an open agentic framework that uses computers like a human.
- PydanticAI: Agent Framework / shim to use Pydantic with LLMs.
- Agentarium: open-source framework for creating and managing simulations populated with AI-powered agents.
- smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.
- Cooragent: Cooragent is an AI agent collaboration community.
- Agno: Agno is a lightweight library for building Agents with memory, knowledge, tools and reasoning.
- Kortix: The open-source AI Operating System — agents, skills, memory and connectors live in a git repo you own, and every session runs on its own cloud computer.
- rowboat: Let AI build multi-agent workflows for you in minutes.
- EvoAgentX: Building a Self-Evolving Ecosystem of AI Agents.
- ii-agent: a new open-source framework to build and deploy intelligent agents.
- OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation.
- OpenManus: No fortress, purely open ground. OpenManus is Coming.
- JoyAgent-JDGenie: 业界首个开源高完成度轻量化通用多智能体产品.
- coze-studio: An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before.
- OxyGent: An advanced Python framework that empowers developers to quickly build production-ready intelligent systems.
- LazyCraft: LazyCraft 是一个基于 LazyLLM 构建的 AI Agent 应用开发与管理平台,旨在协助开发者以 低门槛、低成本 快速构建和发布大模型应用。
- OpenAgents: AI Agent Networks for Open Collaboration.
- SandBox: All-in-One Sandbox for AI Agents that combines Browser, Shell, File, MCP and VSCode Server in a single Docker container.
- DeepAnalyze: First agentic LLM for autonomous data science, supporting specific data tasks (data preparation, analysis, modeling, visualization, and insight) and data-oriented deep research (produce analyst-grade research reports).
- Astron Agent: Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
- Youtu-Agent: A simple yet powerful agent framework that delivers with open-source models.
- MiroThinker: an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.
- Nexent: A zero-code platform for auto-generating agents — no orchestration, no complex drag-and-drop required, using pure language to develop any agent you want.
- Yunjue-Agent: A Fully Reproducible, Zero-Start In-Situ Self-Evolving Agent System for Open-Ended Tasks.
- Hindsight: State-of-the-art long-term memory for AI agents by Vectorize. Open-source, self-hostable, with integrations for LangChain, CrewAI, LlamaIndex, MCP, and more.
- AgentsMesh: The AI Agent Workforce Platform. Self-hostable multi-agent orchestration with remote AI workstations (AgentPods), PTY sandbox + git worktree isolation, channels-based agent collaboration, built-in Kanban, and per-pod MCP server. Supports Claude Code, Codex CLI, Gemini CLI, Aider, OpenCode.
- BitFun: Open-source agentic development environment with a Rust/Tauri desktop app and CLI for coding, research, office work, browser and desktop automation, extensible through MCP, Skills, and custom agents.
Harness
- pi: AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI.
- DeepSeek Harness: Everything is a Plugin.
- OpenSquilla: a token-efficient, microkernel AI agent.
- PenguinHarness: Your Automated Agent Builder, Right on Your Desktop / Server.
- FrontierAgent: an open-source agent runtime, terminal product, and evaluation suite for long-horizon research and file-based work.
- oh-my-agent: Vendor-agnostic harness that adds planner, engineer, reviewer and debugger roles to the coding agent you already use (Claude Code, Codex CLI, Cursor and others), from one portable
.agents/folder.
研究 Research
写作
- PaperDebugger: https://github.com/PaperDebugger/PaperDebugger
- XtraGPT served as refiner: https://github.com/Xtra-Computing/XtraGPT
- Chat Overleaf: https://github.com/anuin-cat/chat-overleaf
- 文智云助手: https://overleaf.top/
- LiteWrite: https://litewrite.ai/
- Prism: https://openai.com/zh-Hans-CN/prism/
- claude-prism: https://github.com/delibae/claude-prism
审稿
- PaperReview: https://paperreview.ai/
- aiXiv: https://aixiv.science/
- OpenJudge Review: https://openjudge.me/paper_review
PPT
- PPTAgent: https://github.com/icip-cas/PPTAgent
- Paper PPT Agent: https://github.com/CRui5in/paper-ppt-agent
- PPT Master: https://github.com/hugohe3/ppt-master
- LandPPT: https://github.com/sligter/LandPPT
- Kami: https://github.com/tw93/kami
- beautiful-html-templates: https://github.com/zarazhangrui/beautiful-html-templates
- guizang-ppt-skill: https://github.com/op7418/guizang-ppt-skill
- GordenSuperPPTSkills: https://github.com/GordenSun/GordenSuperPPTSkills
- dashiAI-ppt-skill: https://github.com/chuspeeism/dashiAI-ppt-skill
其他
- Paper2Video: https://github.com/showlab/Paper2Video
- Paper2Poster: https://github.com/Paper2Poster/Paper2Poster
- AutoPR: https://github.com/irgolic/AutoPR
- Auto-Slides: https://github.com/Westlake-AGI-Lab/Auto-Slides
- EvoPresent: https://github.com/eric-ai-lab/EvoPresent
- Paper2All: https://github.com/YuhangChen1/Paper2All
- AutoPage: https://github.com/AutoLab-SAI-SJTU/AutoPage
- pdf2video: https://github.com/DangJin/pdf2video
- Idea2Paper: https://github.com/AgentAlphaAGI/Idea2Paper
- PaperX: https://github.com/yutao1024/PaperX
- figures4papers: https://github.com/ChenLiu-1996/figures4papers
- PaperBanana: https://github.com/dwzhu-pku/PaperBanana
- PaperBanana-Pro: https://github.com/elpsykongloo/PaperBanana-Pro
- AutoFigure: https://github.com/ResearAI/AutoFigure
- FigureWeave: https://github.com/Krisocer/FigureWeave
- EditDeck: https://github.com/Morgensonne/EditDeck
- AutoFigure-Edit: https://github.com/ResearAI/AutoFigure-Edit
- Kahneman4Review: https://huggingface.co/spaces/nuojohnchen/Kahneman4Review
- Academic Figure Generator: https://github.com/LigphiDonk/academic-figure-generator
- PaperFit: https://github.com/OpenRaiser/PaperFit
全自动科研
- EvoScientist: https://github.com/EvoScientist/EvoScientist
- Auto-claude-code-research-in-sleep: https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep
- ArgusBot: https://github.com/waltstephen/ArgusBot
- Station: https://github.com/dualverse-ai/station
- Dr.Claw: https://github.com/OpenLAIR/dr-claw
- Redigg: https://github.com/redigg/redigg
- AutoResearchClaw: https://github.com/aiming-lab/AutoResearchClaw
- NanoResearch: https://github.com/OpenRaiser/NanoResearch
- ScienceClaw: https://github.com/AgentTeam-TaichuAI/ScienceClaw
- EurekaClaw: https://github.com/EurekaClaw/EurekaClaw
- Claude-scholar: https://github.com/Galaxy-Dawn/claude-scholar/
- claude-scientific-skills: https://github.com/K-Dense-AI/claude-scientific-skills
- K-Dense BYOK: https://github.com/K-Dense-AI/k-dense-byok
- latex-paper-skills: https://github.com/yunshenwuchuxun/latex-paper-skills
- NeuriCo: https://github.com/ChicagoHAI/NeuriCo
- AutoResearch : https://github.com/karpathy/autoresearch
- RD-Agent : https://github.com/microsoft/RD-Agent
- DeepScientist : https://github.com/ResearAI/DeepScientist
- Deep Researcher Agent: https://github.com/Xiangyue-Zhang/auto-deep-researcher-24x7
- academic-research-skills: https://github.com/Imbad0202/academic-research-skills
- Supervisor-Skills: https://github.com/HKUSTDial/Supervisor-Skills
代码 Coding
- Cloi CLI: Local debugging agent that runs in your terminal.
- Devin
- v0
- Blot.new
- cursor
- Windsurf
- cline
- Trae
- MGX
- Roo Code
- Kilo Code
- AugmentCode
- Claude Code (
🔥) - Claude Code (
🔥) + Happy Coder / CodePilot / cc-connect - Gemini CLI
- Serena
- Claudia
- OpenCode
- Kiro
- CodeBuddy
- Kiro
- CodeX (
🔥) - Kimi-CLI
- opencode
- Multica
- Atomic Agent
- DeepSeek Harness
视频 Video
模型
[!NOTE] 🤝Awesome-Video-Diffusion
- HunyuanVideo
- CogVideo
- Wan2.1
- Open-Sora
- Open-Sora-Plan
- LTX-Video
- Step-Video-T2V
- Step1X-Edit
Editing - Wan2.1-VACE
Editing - ICEdit
Editing - mochi-1-preview
- Wan2.1-Fun
- Wan2.1-FLF2V
首尾帧 - MAGI-1
自回归模型 - SkyReels-V2
- FramePack
- Pusa-VidGen
- Wan2.2
- MoGA
长视频 - LongCat-Video
- HunyuanVideo-1.5
- LTX-2
- daVinci-MagiHuman
- LongLive
- JoyAI-Echo
- NAVA
- LTX-2.3 (
🔥) - LingBot-Video
- MiniMax-H3 (
🔥) - MAGI-2-preview
- LTX-2.5 (
🔥)
编辑
- Wan2.1-VACE-14B: https://huggingface.co/Wan-AI/Wan2.1-VACE-14B
- Ditto: https://github.com/EzioBy/Ditto
- Bernini (
🔥): https://github.com/bytedance/Bernini - JoyAI-Video-Edit: https://huggingface.co/jdopensource/JoyAI-Video-Edit
训练
- https://github.com/hao-ai-lab/FastVideo
- https://github.com/tdrussell/diffusion-pipe
- https://github.com/VideoVerses/VideoTuna
- (
🔥) https://github.com/modelscope/DiffSynth-Studio - https://github.com/huggingface/diffusers
- https://github.com/kohya-ss/musubi-tuner
- https://github.com/spacepxl/HunyuanVideo-Training
- https://github.com/Tele-AI/TeleTron
- https://github.com/Yaofang-Liu/Mochi-Full-Finetuner
- https://github.com/bghira/SimpleTuner
- https://github.com/X-GenGroup/Flow-Factory
- https://github.com/shengshu-ai/minWM
world model
推理
实用工具
- PySceneDetect: Python and OpenCV-based scene cut/transition detection program & library.
- DOVER: Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives.
- ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understanding.
图片 Image
生成
- awesome-nano-banana
- Awesome-Nano-Banana-images
- HunyuanImage-3.0:https://github.com/Tencent-Hunyuan/HunyuanImage-3.0
- Seedream 4.0:https://arxiv.org/abs/2509.20427
- LongCat-Image:https://huggingface.co/meituan-longcat/LongCat-Image
- Z-Image-Turbo:https://huggingface.co/Tongyi-MAI/Z-Image-Turbo
- Qwen-Image:https://huggingface.co/Qwen/Qwen-Image
- Qwen-Image-2512:https://huggingface.co/Qwen/Qwen-Image-2512
- Z-Image:https://huggingface.co/Tongyi-MAI/Z-Image
- ERNIE-Image: https://huggingface.co/baidu/ERNIE-Image
- ERNIE-Image-Turbo: https://huggingface.co/Baidu/ERNIE-Image-Turbo
- Nucleus-Image: https://huggingface.co/NucleusAI/Nucleus-Image
- HiDream-O1-Image: https://huggingface.co/HiDream-ai/HiDream-O1-Image
- Ideogram 4: https://github.com/ideogram-oss/ideogram4
- Boogu-Image: https://github.com/boogu-project/Boogu-Image
- Krea-2-Raw: https://huggingface.co/krea/Krea-2-Raw
- SenseNova-U1: https://github.com/OpenSenseNova/SenseNova-U1
- Mage-Flow: https://huggingface.co/collections/microsoft/mage
- Qwen-Image-2.1: https://huggingface.co/Qwen/Qwen-Image-2.1
- Ming-Image-0.1: https://huggingface.co/inclusionAI/Ming-Image-0.1-Design
编辑
- ChronoEdit-14B: https://huggingface.co/nvidia/ChronoEdit-14B-Diffusers
- Eigen-Banana-Qwen-Image-Edit: https://huggingface.co/eigen-ai-labs/eigen-banana-qwen-image-edit
- Qwen-Image-Edit-2509: https://huggingface.co/Qwen/Qwen-Image-Edit-2509
- Upscale: https://huggingface.co/vafipas663/Qwen-Edit-2509-Upscale-LoRA
- Multiple-angles: https://huggingface.co/dx8152/Qwen-Edit-2509-Multiple-angles
- Multi-Angle-Lighting: https://huggingface.co/dx8152/Qwen-Edit-2509-Multi-Angle-Lighting
- LongCat-Image-Edit: https://huggingface.co/meituan-longcat/LongCat-Image-Edit
- Qwen-Image-Edit-2511: https://huggingface.co/Qwen/Qwen-Image-Edit-2511
- Qwen-Image-Edit-2511-Upscale2K: https://huggingface.co/valiantcat/Qwen-Image-Edit-2511-Upscale2K
- Qwen-Image-Edit-2511-Multiple-Angles-LoRA: https://huggingface.co/fal/Qwen-Image-Edit-2511-Multiple-Angles-LoRA
- FireRed-Image-Edit: https://huggingface.co/FireRedTeam/FireRed-Image-Edit-1.0
- JoyAI-Image-Edit: https://hugg