Firecrawl API
Web data API for AI agents: search the web, scrape any page to clean data and interact with it through one API.
Tags
Description
Open-source core (AGPL-3.0) with a hosted API. Docs publish llms.txt and OpenAPI specs (v1, v2, webhooks).
Agent access
Related
- Firecrawl MCP Server: Official Firecrawl MCP server adding web scraping, crawling and search to Cursor, Claude and other MCP clients.
- Crawl4AI: Open-source LLM-friendly web crawler and scraper that turns any website into clean Markdown; self-host or use the hosted cloud.
Guides & comparisons
- Convert documents to Markdown for agents with MarkItDown and Docling (Guide): Turn PDFs, Office files and other documents into Markdown or chunks an agent can read, with Microsoft's MarkItDown for speed and Docling for layout and tables, then expose either one to an agent over MCP.
- Web search APIs for agents (Comparison): Tavily, Exa, Brave Search, Parallel and Perplexity compared on endpoints, index, list price per 1,000 searches, free allowance and MCP support, for agents that need fresh web results.
- Research agent stack (Stack): An agent that searches the web and the scholarly record, reads full sources, runs analysis code in a sandbox and cites what it found, with tracing so you can audit how it got there.
Sources
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)