RAGHub

RAGHub: A Directory of Tools for Retrieval-Augmented Generation (RAG)

Welcome to RAGHub, a living collection of new and emerging frameworks, projects, and resources in the Retrieval-Augmented Generation (RAG) ecosystem. This is a community-driven project for r/RAG, where we aim to catalog the rapid growth of RAG tools and projects that are pushing the boundaries of the field.

Each day, it feels like a new tool or framework emerges, and choosing the right one is becoming more of an art than a science. Is the framework from three months ago still relevant? Or was it just hype, rehashing old concepts with a fresh look? RAGHub exists to help you stay ahead of these changes, providing a platform for the latest innovations in RAG.

How to Contribute

This is a community project, and we welcome contributions from everyone! If you’d like to add a new framework, project, or resource, please check out our Contribution Guidelines for details on how to get started.

Table of Contents

• RAGHub: A Directory of Tools for Retrieval-Augmented Generation (RAG)
  • How to Contribute
  • Table of Contents
  • RAG Frameworks
  • RAG Evaluation and Optimization Frameworks
  • RAG Engines
  • FAQ
  • RAG Resources and Sites
  • Model LeaderBoards
  • License
  • Join the Conversation

FAQ

What is RAG (Retrieval-Augmented Generation)?

RAG is a technique that enhances Large Language Model (LLM) responses by retrieving relevant information from external knowledge sources before generating answers. This approach reduces hallucinations and provides more accurate, contextually relevant responses based on actual data.

How do I choose the right RAG framework?

Consider these factors when selecting a framework:

Factor	Consideration
Use Case	Chatbot, search engine, or document QA?
Scale	Enterprise-scale needs vs. prototyping
Complexity	LangChain/LlamaIndex (full-featured) vs. LightRAG (simple)
Integration	Does it support your vector DB and LLM provider?
Language	Python (LangChain/LlamaIndex) vs. TypeScript vs. Rust

What's the difference between RAG Frameworks and RAG Engines?

• Frameworks (e.g., LangChain, LlamaIndex): Libraries you integrate into your code to build custom RAG pipelines
• Engines (e.g., RAGFlow, Dify): Standalone platforms providing ready-to-use RAG functionality

Do I need a vector database for RAG?

Yes, vector databases store document embeddings for semantic search. Popular options:

Database	Best For
ChromaDB	Prototyping, easy setup
Qdrant	Production, high performance
Pinecone	Enterprise, managed service
Weaviate	Hybrid search, GraphQL

How do I evaluate my RAG system?

Use evaluation frameworks listed in this directory:

• ragas: Measures faithfulness, answer relevancy, context precision
• Trulens: Feedback functions for quality assessment
• Phoenix: Observability and troubleshooting tools
• Deepchecks: Continuous validation and drift detection

What are common RAG challenges and solutions?

Challenge	Solution
Poor retrieval quality	Optimize chunking strategy and embeddings
Context window limits	Use reranking to reduce retrieved content
Hallucinations	Ensure retrieved context is properly used by LLM
Latency	Optimize retrieval indexing, use streaming

Can I use RAG with local/self-hosted models?

Yes! Many frameworks support local LLMs:

Method	Description
Ollama	Easy local model deployment
vLLM	High-performance local inference
LM Studio	User-friendly local model management
LocalAI	OpenAI-compatible local API

How can I contribute to RAGHub?

We welcome contributions! To add a new framework, project, or resource:

1. Fork the repository
2. Add your entry to the relevant section
3. Follow the existing table format
4. Submit a Pull Request

See CONTRIBUTING.md for detailed guidelines.

---

RAG Frameworks

Name	Description	Website	Github	Stars	Activity
Dcup Open-Source RAG-as-a-Service	Connect your app to user data in minutes with self-hostable RAG pipelines.	Website	Github		1h ago
LangChain	Building applications with LLMs	Website	Github		9h ago
Scout	Building apps with LLMs/vector databases/web scraping	Website	Github		1h ago
Semantica	Open-source framework for Context Graphs, GraphRAG, Decision Intelligence, Explainable Reasoning, Provenance, and AI Governance.	Website	GitHub		1d ago
Haystack	A framework for building search engines using neural networks	Website	Github		Last week
LlamaIndex	A framework for building data-driven LLM applications	Website	Github		7h ago
BentoML	Build Inference APIs, LLM apps, Multi-model chains, RAG	Website	Github		1h ago
Contextual AI	End-to-end RAG including document understanding, retrieval, grounded generation, and evaluation	Website	GitHub		--
LightRAG	Simple and fast Retrieval-Augmented Generation	Website	Github		1d ago
Swarm by OpenAI	Educational framework for lightweight multi-agent orchestration	-	Github		1d ago
Langroid	Python framework to easily build LLM-powered applications	Website	Github		10h ago
NeMo-Guardrails	Add programmable guardrails to LLM-based applications	Website	Github		Last week
Swiftide	A Rust library for building fast, streaming applications with LLMs	Website	GitHub		1h ago
Korvus	The entire RAG pipeline in a single database query	Website	GitHub		Last month
semantic-router	A framework for routing LLM requests using semantic vectors	Website	GitHub		4h ago
AWS Bedrock Knowledge Bases	Service to build, scale, and deploy RAG-powered applications	Website	-	-	1h ago
langflow	Build, scale, and deploy RAG and multi-agent AI apps	Website	GitHub		1h ago
dspy	Build language model apps with modular programming	Website	GitHub		13h ago
mem0	The Memory layer for your AI apps	Website	GitHub		2h ago
RAGLite	A Python package for building RAG applications	Website	GitHub		18h ago
cognee	Memory framework for building GraphRAG applications	Website	GitHub		2h ago
ragbits	Building blocks for rapid development of GenAI applications	Website	GitHub		1h ago
Interchange	End-to-end API for RAG, from document upload to search	Website	GitHub		1h ago
ZeroEntropy	Rerankers, embeddings and end-to-end retrieval API	Website	GitHub	-	1h ago
memori	Multi-Agent Memory Engine that gives your AI agents human-like memory	Website	GitHub		3d ago
ZettelForge	Agentic memory for CTI — entity extraction, knowledge graphs, STIX ontology	Website	GitHub		1h ago

RAG Evaluation and Optimization Frameworks

Name	Description	Website	GitHub	Stars	Activity
Trulens	Measures and enhance LLM app quality with feedback functions for scalable evaluation	Website	GitHub		11h ago
Phoenix	AI observability platform designed for experimentation, evaluation, and troubleshooting	Website	GitHub		1d ago
ragas	Evaluates and quantifies the performance of RAG pipelines that enhance LLM context with external data	Website	GitHub		3h ago
LMUnit	Language model optimized for evaluating natural language unit tests	Website	-	-	--
Deepchecks	Continuous validation of AI & ML models, detecting data drift and model issues	Website	GitHub		8m ago
AutoRAG	End-to-end RAG optimization: parsing, chunking, evaluation dataset creation, and pipeline deployment	Website	GitHub		1h ago
evalmy.ai	Fine-tuned lightweight RAG evaluation service + Python client library	Website	GitHub		--
TextGrad	A framework for LLM-based text optimization, focusing on reducing hallucinations and improving prompts	Website	GitHub		24h ago
langfuse	Traces, evals, prompt management, and metrics to debug and improve your LLM application.	Website	GitHub		1h ago
Vectara HHEM	Hallucination evaluation model for RAG	Huggingface	--	--	--
StepsTrack	An Observability tool built to track, inspect, and visualize every steps in a pipeline	-	GitHub		15h ago
syftr	Multi-objective end-to-end agentic RAG optimization.	-	GitHub		1h ago
zbench	Annotation and evaluation framework for retrieval and reranking	Website	GitHub	-	1h ago
rag-select	End-to-end RAG architecture evaluation/optimization across RAG tool offerings.	Website	GitHub		1h ago
Raggit	Monitor RAG production queries, write evals against the queries that matter, re-run on model swaps	Website	GitHub		1h ago

RAG Engines

Name	Description	Website	GitHub	Stars	Activity
Agentset	Open-source agentic RAG platform.	Website	GitHub		1d ago
Engramic	RAG engine focused on long-term memory and advanced context management	Website	Github		2h ago
TrustGraph	LLM Agnostic Agent Development Platform	Website	GitHub		2d ago
R2R	The Elasticsearch for RAG, helps you quickly build and launch scalable RAG solutions	Website	GitHub		6h ago
RAGFlow	Open-source RAG engine based on deep document understanding	Website	GitHub		1h ago
Liquid Index	The Unified RAG Platform. One API. Every Tool You Need	Website	-	-	1h ago
Vertex AI Knowledge Engine	A data framework for context-augmented LLM applications	Website	-	-	1d ago
Embedchain	Open Source Framework for personalizing LLM responses under 10 lines of code	Website	GitHub		Last week
txtai	All-in-one embeddings database for semantic search, LLM orchestration, and RAG workflows	Website	GitHub		Last week
dsRAG	High-performance retrieval engine for unstructured data	-	GitHub		Last week
Flash-Rank	Use Pairwise or Listwise rerankers to improve search accuracy before passing to LLMs.	-	GitHub		2w ago
Graphlit	API-first platform for building knowledge-driven AI applications and agents	Website	GitHub		8h ago
rag-citation	Combines RAG with automatic citation generation to enhance content credibility	Website	GitHub		Last week
PostgresML	Postgres + GPUs with functions for chunking, embedding, transforming and ranking	Website	GitHub		Yesterday
chainlit	Build production-ready Conversational AI applications in minutes, not weeks	Website	GitHub		24h ago
pathway	Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.	Website	GitHub		7h ago
cognita	RAG framework for modular, open-source production apps.	Website	GitHub		2 days ago
FlashRAG	A Python Toolkit for Efficient RAG Research	-	GitHub		3h ago
RAGatouille	Easily train and use advanced retrieval methods in any RAG pipeline.	-	GitHub		4 months ago
pgai	A suite of tools to develop RAG, semantic search, and other AI applications just in PostgreSQL	Website	GitHub		10h ago
Vectara	The trusted RAG platform for quickly building AI assistants and agents.	Website	GitHub	-	-
mode	RAG framework with expert models, smart clustering,and efficient retrieval for small datasets.	-	GitHub		2 days ago
haiku.rag	Open-Source RAG framework with monitoring, CLI, search, Q/A, MCP support on SQLite.	-	Github		3h ago
ZeroEntropy AI	Open-Weight Rerankers, Embeddings and End-to-End Retrieval API	Website	Github	-	3h ago

RAG Data Preparation Frameworks

Name	Description	Website	GitHub	Stars	Activity
CocoIndex	ETL framework to build fresh index	Website	Github		1h ago
Gitana.io	Content platform for editorial approval and scheduled deployment of trained data sets to RAG vector DBs	Website	-	-	-
Chonkie	No-nonsense, lightweight and fast RAG chunking library	Website	GitHub		1h ago
pdfmux	PDF-to-Markdown extraction with per-page confidence scoring and self-healing fallback. Built-in MCP server, LangChain + LlamaIndex loaders. #2 on opendataloader-bench.	Website	GitHub		1d ago

RAG Projects

Name	Description	Website	GitHub	Stars	Activity
RAG-LCC	Hybrid RAG lab: Vector/BM25/Graph retrieval, multilingual, web search fallback	-	GitHub		-
LlamaParse	GenAI-native document parsing platform	Website	GitHub		2d ago
Langchain-extract	Web server to extract information from text and files using LLMs	Website	GitHub		4m ago
Needle	Production-ready RAG pipelines out of the box.	Website	GitHub		1h ago
Unstructured.io	Build custom preprocessing pipelines for labeling, training, or production ML	Website	GitHub		3d ago
Verba	RAG chatbot powered by Weaviate	Website	GitHub		2w ago
Unstract	No-code platform to launch APIs and ETL Pipelines to structure unstructured documents	Website	GitHub		4h ago
Humata.ai	Ask questions across all of your document files	Website	-	-	4h ago
Kiln	Build AI systems with evals, RAG, agents, fine-tuning, and synthetic data	Website	GitHub		12h ago
Ragie.ai	Fully managed RAG-as-a-Service for developers.	Website	GitHub	-	12h ago
Reducto	Parses complex documents and creates LLM-ready inputs	Website	GitHub	-	2w ago
Midship	Extract document data straight into your spreadsheet/ERP/CRM	Website	-	-	-
DocuPanda	Convert documents into a structured, standard set of fields and values	Website	-	-	-
contextual-doc-retrieval-opneai-reranker	Using GPT-4 and Cohere for query expansion and re-ranking with BM25	-	GitHub		Last week
Raggenie	Low-code platform to build custom RAG-based AI applications	Website	GitHub		10h ago
Chunkr	Vision model-based PDF chunking and OCR, optimized for fast processing of large datasets	Website	GitHub		11h ago
tldw	Open-source project similar to NotebookLM	Website	GitHub		Yesterday
Cerbos	Access control for RAG and LLMs.	Website	GitHub		14h ago
extractous	Extremely fast data extraction for your AI applications	Website	GitHub		-
SWIRL	AI search & RAG for your workplace. Get AI insights from your company's knowledge instantly.	Website	GitHub		2w ago
ChatDOC PDF Parser	Precision PDF parsing that transforms documents into flawless structured data for RAG systems.	Website	-	-	-
Gurubase	Create AI-powered Q&A assistants by indexing websites, PDF documents, YouTube videos, and GitHub code repositories.	Website	GitHub		1d ago
Archive Agent	Open-source semantic file tracker with OCR + AI search. Smart indexer with RAG engine.	-	GitHub		-
MidrasAI	Simple API for Colpali, a multi-modal retrieval model.	-	Github		6m ago
EmbeddingBridge	Version control and migration tool for embeddings	-	Github		-
Stream-Rag-Agent	Streaming RAG Agent for Kafka	-	Github		-
zchunk	Open-Source efficient LLM-based chunking	Website	Github	-	2h ago
hydrot	A production-ready Retrieval-Augmented Generation (RAG) system designed for enterprise documentation, with first-class support for markdown content. Built with a microservices architecture for horizontal scaling and flexibility.	-	Github		-
Tensorlake	Document parsing for citable, traceable RAG systems. Extracts text, tables, and images while maintaining complex layouts, attaching bounding box coordinates, and supporting structured output	Website	Github		2d ago
KV Cache Store	Hosted KV-cache artifact registry plus open-source Rust CLI. Precompute attention states once, verify bit-exact, and reuse across RAG and long-context prompts to cut prefill cost and latency.	Website	GitHub		-
FastRAG	Starter kit for shipping RAG apps fast with Next.js, Pinecone & LangChain pre-configured.	Website	Closed-source	-	-

RAG Resources and Sites

Site/Article	Description	Link
Contextual Retrieval	Anthropic introducing Contextual Retrieval	Website
Open-RAG	Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models	Website
ColPali	Efficient Document Retrieval with Vision Language Models	Website
RAG_Techniques	Showcases various advanced techniques for RAG systems	Website
GenAI_Agents	Tutorials and implementations for various AI Agent techniques	Website
RAG From Scratch	Official LangChain guide for building a RAG pipeline from scratch	Website

Model LeaderBoards

Name	Description	Link
Artificial Analysis	LLM Comparison	Website
HuggingFace/mteb	Embedding models leaderboard	Website
Vectara Hallucination Leaderboard	Hallucination leaderboard for LLMs	Website

If you're looking for mainstream RAG frameworks and techniques, check out the excellent repository by Nir Diamant: RAG Techniques. This repository focuses on more established tools and methods that have already gained traction in the community.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Join the Conversation

This project is part of the r/RAG community. Have feedback or suggestions? Feel free to open an issue, start a discussion, or join the conversation on our Discord server! We want to make this repository a valuable resource for everyone exploring the RAG ecosystem, and your input is crucial.