RAG and Search

17 tools in this fixed category.

RAG and Search

17 tools

Auto-Deep-Research

An open-source, fully-automated personal AI assistant that serves as a cost-effective alternative to OpenAI's Deep Research. Built on the AutoAgent framework, it supports integration with various LLMs, function-calling interactions, file uploads, and a one-click launch for effortless research automation.

Crawl4AI

An open-source, LLM-friendly tool designed to crawl and extract data, facilitating content aggregation for AI applications.

DeepSearcher

DeepSearcher is an open-source tool that leverages multiple large language models and vector databases to perform private data search, evaluation, and reasoning, providing accurate answers and comprehensive reports for enterprise knowledge management and intelligent Q&A systems.

Firecrawl

Firecrawl is a web data API built for AI that crawls and scrapes entire websites and pages, returning LLM‑ready outputs such as clean Markdown, structured JSON, HTML, screenshots, links, and metadata. It supports dynamic, JS‑rendered sites with proxies and anti‑bot handling, offers endpoints for crawl, scrape, map, search, and extract, and includes SDKs (Python/Node) plus integrations with LangChain, LlamaIndex, Dify, and Langflow. A hosted API is available with optional self‑hosting.

GPT Researcher

An LLM-based autonomous agent that conducts deep local and web research on any topic and generates long reports with citations, with support for connecting to specialized data sources.

GPT-RAG

GPT-RAG is an enterprise-grade Retrieval-Augmented Generation (RAG) solution accelerator designed for integrating Azure Cognitive Search and Azure OpenAI services to power ChatGPT-style and Q&A experiences. It provides a modular architecture featuring data ingestion, an orchestrator (with options for Semantic Kernel functions or AutoGen-driven agentic workflows), and customizable front-end interfaces for efficient deployment in secure, enterprise environments.

Haystack

Haystack is an open-source LLM orchestration framework by deepset-ai that enables developers to build production-ready applications such as retrieval-augmented generation (RAG), question answering systems, semantic search, and conversational agents by connecting various components (models, vector databases, file converters, etc.) into customizable pipelines.

Haystack

Open-source framework to build LLM apps (RAG, chat, agents) with pluggable components and connectors.

Maxun

An open-source no-code web data extraction platform that lets users train a robot in minutes to automatically scrape websites and convert them into APIs and spreadsheets.

Open Deep Research Agent

An open–source deep research AI agent that utilizes reasoning models to conduct in–depth factual research. It separates planning and research execution for detailed report generation.

Perplexica

Open-source AI-powered search engine that performs deep web research to generate and cite answers.

Perplexity

An AI‑powered answer engine and search tool that browses the web in real time, synthesizes results with citations, and supports follow‑up questions, deep research, and file/image Q&A. Available on web and mobile with free and pro tiers.

RLAMA

RLAMA is a powerful AI-driven document question-answering tool that connects to local Ollama models. It allows users to create, manage, and interact with Retrieval-Augmented Generation (RAG) systems for processing and querying documents via a CLI and API server.

ScraperAI

ScraperAI is an open-source, AI-powered tool that simplifies web scraping by leveraging large language models like ChatGPT to automatically detect data elements, generate XPATHs, handle pagination, and create reusable scraping recipes. It supports multiple scraping methods including Selenium and custom crawlers.

SkynetAgent

An AI agent that visits webpages and extracts content as formatted markdown, enabling automated web content retrieval.

Tavily Crawl API

Website crawling API for high-quality, low-latency information retrieval; resources for beta testers.

Tongyi DeepResearch

Open‑source deep research agent and specialized 30B MoE language model by Alibaba Tongyi Lab, optimized for long‑horizon web research. It supports ReAct and IterResearch inference modes, provides HF/ModelScope weights and online demos, and includes code for agent/web browsing, evaluation, and local deployment with search/page‑reading integrations.