Search and collection
Find search results, optionally retrieve their content, scrape individual pages, or crawl a site.
Search, collect, and structure web content for AI agents and application data pipelines.
Firecrawl gives developers APIs for finding web pages and collecting content as Markdown, HTML, or structured JSON. Applications can scrape a page, crawl linked pages, or map URLs before selecting what to fetch. The hosted service also provides AI-directed browser interaction for tasks that require navigation. An open-source core is available for self-hosting, with a different operating and feature scope from Firecrawl Cloud.
Find search results, optionally retrieve their content, scrape individual pages, or crawl a site.
Map a site's URLs before choosing pages to collect. Mapping discovers links rather than downloading each page's content.
Return cleaned Markdown or HTML, or use LLM-backed formats to extract JSON fields and relevant passages.
Render JavaScript content and use hosted browser sessions for clicking, typing, scrolling, and navigating with code or AI prompts.
Connect through the HTTP API, Python or Node.js SDKs, CLI, and MCP-compatible agents. Core code is primarily AGPL-3.0; SDKs and some UI components use MIT licenses.
Collect documentation and reference pages for search indexes or retrieval-based assistants.
Discover pages, retrieve supporting content, and extract fields for comparison or analysis.
Gather published product details and company information for application-managed catalogs or records.
Free includes 1,000 credits per month and two concurrent browsers, without a card. Hobby includes 5,000 credits monthly and five concurrent browsers for $19 USD per month or $190 per year. API request-rate limits are separate from browser concurrency.
Basic Scrape and Crawl cost one credit per page; Map costs one per call. Search costs two per ten results, with extra costs for scraping those results. JSON extraction adds four credits per page. Interact costs two credits per minute for code-only sessions or seven with an AI prompt, with a one-minute minimum; additional options can increase cost.
Paid plans can add credits automatically in $5 increments. Set a monthly pay-as-you-go cap, or set it to zero to disable automatic purchases. All endpoints use the same credit balance.
No. The core scraping APIs are available, but LLM-backed formats require your own provider configuration. Agent, Browser, Interact, managed dashboards, and enterprise controls are outside the default open-source stack. You operate the infrastructure and pay its provider costs.
Enterprise offers zero retention of scraped content for approved use cases. It is not a general promise that every plan or all account and billing information is never stored.
Traffic data is for reference only.
| Jun | 1479404 |
|---|---|
| Jul | 1397046 |
| Aug | 1853810 |
Traffic analytics are not available yet.
you.com
You.com provides developer APIs for web search, content extraction, and cited research across web, news, and finance workflows for AI agents and RAG systems.
kadoa.com
Web data pipelines, monitors, and custom datasets for investment teams and AI agents.
www.diffbot.com
Diffbot transforms unstructured public web content into structured data for AI applications. Its APIs and agent skills support web search, page extraction, crawling, entity resolution, natural-language processing, and Knowledge Graph research.
www.valyu.ai
Valyu provides search, content extraction, answer, and DeepResearch APIs for AI agents and knowledge-work applications. It combines open-web results with financial, scientific, biomedical, legal, economic, and other specialist sources, returning cited content and research outputs.
webscraping.ai
Web scraping API for developers to retrieve web content and extract structured data with AI.
landing.ai
Document processing APIs for developers building structured, traceable data pipelines.