Skip to main content

Directory

RAG tools directory

Filter tools by category, open-source status, hosting model, and likely fit. Pricing and exact feature claims should be verified from official sources before procurement.

Tool categories explained

  • Platforms provide application workflows and UI.
  • Frameworks provide code-level orchestration.
  • Vector databases store and search embeddings.
  • Parsers prepare documents.
  • Rerankers improve retrieved evidence order.
  • Observability tools expose traces and failures.

Selection checklist

  • Define your users and source corpus.
  • Decide cloud, self-hosted, or hybrid.
  • Test retrieval on your own data.
  • Verify licensing and pricing officially.
  • Check who will maintain updates and evaluation.

How to use this directory

Treat tools as parts of a stack, not as interchangeable products. A RAG platform, orchestration framework, vector database, parser, reranker, and evaluation tool solve different problems.

“Check official source” means the public information may change or depends on the product edition, deployment model, or license. Confirm the current status in the official documentation before choosing a tool.

  • Do you need a visual platform, a code framework, or a database component?
  • Must the system be self-hosted, cloud-hosted, or both?
  • Who will maintain ingestion, evaluation, and source updates?
  • Does the corpus need keyword search, vector search, or hybrid search?
  • What traces, logs, and evaluation reports are required before launch?
  • Which claims must be verified from official pricing or feature pages?

23 tools shown

Dify

RAG platform

Partly open source

Platform for building AI applications, agentic workflows, knowledge bases, and RAG pipelines with visual and API-oriented interfaces.

workflowagentknowledge basevisual builder

Last verified: 2026-06-22

LangChain

orchestration

Partly open source

Framework and ecosystem for composing LLM applications, retrieval chains, tools, and agentic systems.

frameworkagentsretrievalpython

Last verified: 2026-06-22

LlamaIndex

orchestration

Partly open source

Data framework focused on connecting private or domain data to LLM applications through indexes, retrievers, and workflows.

indexingretrievaldata frameworkevaluation

Last verified: 2026-06-22

Haystack

orchestration

Open source

Open-source framework from deepset for building search, RAG, question-answering, and agent pipelines.

pipelinesearchquestion answeringpython

Last verified: 2026-06-22

RAGFlow

RAG platform

Open source

RAG-oriented platform emphasizing document understanding and knowledge workflows.

documentsknowledge baseplatform

Last verified: 2026-06-22

Flowise

no-code/low-code

Open source

Visual builder for LLM flows, agents, and RAG-style applications.

visual builderlow-codeagentsprototype

Last verified: 2026-06-22

n8n

agent workflow

Partly open source

Workflow automation platform that can orchestrate AI steps, data movement, and integrations around RAG systems.

automationworkflowintegrations

Last verified: 2026-06-22

AnythingLLM

local AI

Open source

Application for local or private AI workspaces with document chat and knowledge-base features.

localdocument chatprivacy

Last verified: 2026-06-22

Open WebUI

local AI

Open source

Self-hosted AI interface commonly used with local models and private chat workflows.

localchat UIollama

Last verified: 2026-06-22

Ollama

local AI

Partly open source

Tool for running and managing local language models, often paired with local RAG prototypes.

local modelsruntimeprivacy

Last verified: 2026-06-22

Qdrant

vector database

Open source

Vector database and similarity search engine used for semantic retrieval and metadata filtering.

vector databasesemantic searchfiltering

Last verified: 2026-06-22

Weaviate

vector database

Open source

Vector database with hybrid search and managed or self-hosted deployment options.

vector databasehybrid searchsemantic search

Last verified: 2026-06-22

Milvus

vector database

Open source

Open-source vector database designed for large-scale similarity search.

vector databasescalesimilarity search

Last verified: 2026-06-22

Chroma

vector database

Open source

Developer-friendly embedding database commonly used for prototypes and local RAG systems.

vector databaseprototypelocal

Last verified: 2026-06-22

Pinecone

vector database

Proprietary

Managed vector database service used for semantic search and RAG systems.

managedvector databasesemantic search

Last verified: 2026-06-22

Partly open source

Search platforms that can combine keyword, vector, and hybrid search patterns for RAG retrieval.

hybrid searchkeyword searchenterprise search

Last verified: 2026-06-22

Proprietary

Reranking model/API commonly used to reorder retrieved passages before generation.

rerankingretrieval qualityAPI

Last verified: 2026-06-22

Jina AI

embedding model

Partly open source

AI company offering embedding, reranking, and retrieval-related models and APIs.

embeddingsrerankingretrieval

Last verified: 2026-06-22

Unstructured

document parsing

Partly open source

Document processing tooling for extracting structured content from PDFs, Office files, HTML, and other formats.

parsingPDFingestiondocuments

Last verified: 2026-06-22

Langfuse

observability

Open source

Open-source observability and tracing platform for LLM applications, including RAG pipelines.

observabilitytracingevaluation

Last verified: 2026-06-22

Phoenix / Arize

observability

Open source

Phoenix is an open-source observability tool associated with Arize for tracing, evaluation, and analysis of LLM applications.

observabilitytracingevaluation

Last verified: 2026-06-22

Ragas

evaluation

Open source

Framework for evaluating RAG pipelines with metrics related to retrieval and answer quality.

evaluationfaithfulnessretrieval metrics

Last verified: 2026-06-22

TruLens

evaluation

Open source

Evaluation and tracking tooling for LLM applications, including feedback functions for RAG quality.

evaluationfeedbackobservability

Last verified: 2026-06-22