大模型推理服务

把「本地跑大模型」压缩成一条命令，最适合做原型和日常使用

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.

纯 C/C++ 的本地推理引擎，GGUF + 量化是「在自己电脑上跑模型」的标准答案

🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.

单卡也能压榨出高吞吐的 LLM 推理引擎，PagedAttention 基本成了行业标准

Agent skill that removes signs of AI-generated writing from text

Context7 Platform -- Up-to-date docs for AI agents

The best-benchmarked open-source AI memory system. And it's free.

A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.

Port of OpenAI's Whisper model in C/C++

A community-supported supercharged document management system: scan, index and archive all your documents

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

AirLLM 2.8T LLM inference with single 4GB GPU

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

前缀复用做得最好的推理框架，RAG 与多轮对话场景吞吐明显占优

⌥ Coding agent with the IDE wired in. Built by Stencil Labs.

"Vibe-Trading: Your Personal Trading Agent"

Draw and edit draw.io diagrams by chatting with an AI. Web app, desktop app, and an MCP server for Claude Code, Cursor, Codex and VS Code.

LLM Frontend for Power Users.

Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up｜Star if you like it!

Community plugin to control Blender 3D with any LLM of your choice. Not affiliated with the official Blender Foundation.

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

Python scraper based on AI

Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai

Mastra is the modern TypeScript framework for AI-powered applications and agents.

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

open-source agentic AI data assistant for the next generation of AI + Data products.

Machine Learning Engineering Open Book

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

Nano vLLM

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Unified framework for building enterprise RAG pipelines with small, specialized models

One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

A straightforward method for training your LLM, from downloading data to generating text.

Pocket Flow: Codebase to Tutorial

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer