firecrawl / firecrawl

firecrawl / firecrawl

🔥 Firecrawl: The API to search, scrape, and interact with the web at scale. The web context API to find sources, extract content, and turn it into clean Markdown or structured data your agents can ship with. Open source and available as a hosted service. Pst. Hey, you, join our stargazers :)

🔥 Firecrawl:一个用于大规模搜索、抓取并与网络进行交互的 API。它是获取网络上下文的 API,用于查找来源、提取内容,并将其转换为干净的 Markdown 或结构化数据,供你的 AI Agent 使用。该项目开源并提供托管服务。嘿,快来加入我们的星标用户行列吧 :)

Why Firecrawl?

为什么选择 Firecrawl?

  • Industry-leading reliability: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks)

  • Blazingly fast: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps

  • LLM-ready output: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps

  • We handle the hard stuff: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration

  • Agent ready: Connect Firecrawl to any AI agent or MCP client with a single command

  • Media parsing: Parse and extract content from web-hosted PDFs, DOCX, and more

  • Actions: Click, scroll, write, wait, and press before extracting content

  • Open source: Developed transparently and collaboratively — join our community

  • 行业领先的可靠性: 覆盖 96% 的网页,包括重度依赖 JS 的页面——无需处理代理难题,直接获取干净数据(查看基准测试)。

  • 极速响应: 在数百万个页面中 P95 延迟仅为 3.4 秒,专为实时 Agent 和动态应用构建。

  • LLM 就绪的输出: 提供干净的 Markdown、结构化 JSON、截图等——节省 Token,构建更优秀的 AI 应用。

  • 处理复杂难题: 自动处理轮换代理、编排、速率限制、JS 拦截内容等——零配置。

  • Agent 就绪: 通过单条命令即可将 Firecrawl 连接到任何 AI Agent 或 MCP 客户端。

  • 媒体解析: 解析并提取托管在网页上的 PDF、DOCX 等文件内容。

  • 操作支持: 在提取内容前执行点击、滚动、输入、等待和按键操作。

  • 开源: 透明且协作式开发——欢迎加入我们的社区。


Feature Overview

功能概览

Core EndpointsFeature Description
SearchSearch the web and get full page content from results
ScrapeConvert any URL to markdown, HTML, screenshots, or structured JSON
InteractScrape a page, then interact with it using AI prompts or code
核心端点功能描述
搜索 (Search)搜索网络并从结果中获取完整页面内容
抓取 (Scrape)将任何 URL 转换为 Markdown、HTML、截图或结构化 JSON
交互 (Interact)抓取页面后,使用 AI 提示词或代码与页面进行交互
MoreFeature Description
AgentAutomated data gathering, just describe what you need
CrawlScrape all URLs of a website with a single request
MapDiscover all URLs on a website instantly
Batch ScrapeScrape thousands of URLs asynchronously
更多功能功能描述
Agent自动化数据收集,只需描述你的需求
爬取 (Crawl)通过单次请求抓取网站的所有 URL
映射 (Map)瞬间发现网站上的所有 URL
批量抓取 (Batch Scrape)异步抓取数千个 URL

Quick Start

快速开始

Sign up at firecrawl.dev to get your API key. Try the playground to test it out. 请在 firecrawl.dev 注册以获取你的 API Key。你可以尝试使用 Playground 进行测试。

搜索

Search the web and get full content from results. 搜索网络并从结果中获取完整内容。

from firecrawl import Firecrawl
app = Firecrawl(api_key="fc-YOUR_API_KEY")
search_result = app.search("firecrawl", limit=5)

Node.js / cURL / CLI

Node.js / cURL / CLI

Node.js

import { Firecrawl } from 'firecrawl';
const app = new Firecrawl({apiKey: "fc-YOUR_API_KEY"});
app.search("firecrawl", { limit: 5 })

cURL

curl -X POST 'https://api.firecrawl.dev/v2/search' \
 -H 'Authorization: Bearer fc-YOUR_API_KEY' \
 -H 'Content-Type: application/json' \
 -d '{ "query": "firecrawl", "limit": 5 }'

CLI

firecrawl search "firecrawl" --limit 5

Output:

[
  { "url": "https://firecrawl.dev", "title": "Firecrawl", "markdown": "Turn websites into..." },
  { "url": "https://docs.firecrawl.dev", "title": "Firecrawl Docs", "markdown": "# Getting Started..." }
]

Scrape

抓取

Get LLM-ready data from any website — markdown, JSON, screenshots, and more. 从任何网站获取 LLM 就绪的数据——包括 Markdown、JSON、截图等。

from firecrawl import Firecrawl
app = Firecrawl(api_key="fc-YOUR_API_KEY")
result = app.scrape('firecrawl.dev')

Node.js

import { Firecrawl } from 'firecrawl';
const app = new Firecrawl({ apiKey: "fc-YOUR_API_KEY" });
app.scrape('firecrawl.dev')

cURL

curl -X POST 'https://api.firecrawl.dev/v2/scrape' \
 -H 'Authorization: Bearer fc-YOUR_API_KEY' \
 -H 'Content-Type: application/json' \
 -d '{ "url": "firecrawl.dev" }'

CLI

firecrawl scrape https://firecrawl.dev
firecrawl https://firecrawl.dev --only-main-content

Output:

# Firecrawl
Firecrawl helps AI agents search, scrape, and interact with the web.
## Features
- Search: Find information across the web
- Scrape: Clean data from any page
- Interact: Click, navigate, and operate pages
- Agent: Autonomous data gathering

Interact

交互

Scrape a page, then interact with it using AI prompts or code. 抓取页面,然后使用 AI 提示词或代码与页面进行交互。

from firecrawl import Firecrawl
app = Firecrawl(api_key="fc-YOUR_API_KEY")
result = app.scrape("https://amazon.com")
scrape_id = result.metadata.scrape_id
app.interact(scrape_id, prompt="Search for 'mechanical keyboard'")
app.interact(scrape_id, prompt="Click the first result")

Node.js

import { Firecrawl } from 'firecrawl';
const app = new Firecrawl({apiKey: "fc-YOUR_API_KEY"});
const result = await app.scrape("https://amazon.com");
await app.interact(result.metadata.scrapeId, { prompt: "Search for 'mechanical keyboard'" });
await app.interact(result.metadata.scrapeId, { prompt: "Click the first result" });

cURL

# 1. Scrape the page
curl -X POST 'https://api.firecrawl.dev/v2/scrape' \
 -H 'Authorization: Bearer fc-YOUR_API_KEY' \
 -H 'Content-Type: application/json' \
 -d '{"url": "https://amazon.com"}'

# 2. Interact with the page (use scrapeId from step 1)
curl -X POST 'https://api.firecrawl.dev/v2/scrape/SCRAPE_ID/interact' \
 -H 'Authorization: Bearer fc-YOUR_API_KEY' \
 -H 'Content-Type: application/json' \
 -d '{"prompt": "Search for mechanical keyboard"}'

CLI

firecrawl scrape https://amazon.com
firecrawl interact exec --prompt "Search for 'mechanical keyboard'"
firecrawl interact exec --prompt "Click the first result"

Output:

{
  "success": true,
  "output": "Keyboard available at $100",
  "liveViewUrl": "https://liveview.firecrawl.dev/..."
}

Power Your Agent

为你的 Agent 赋能

Connect Firecrawl to any AI agent or MCP client in minutes. 在几分钟内将 Firecrawl 连接到任何 AI Agent 或 MCP 客户端。

Skill Give your agent easy access to real-time web data with one command. 通过一条命令让你的 Agent 轻松访问实时网络数据。

npx -y firecrawl-cli@latest init --all --browser

Restart your agent after installing. Works with Claude Code, Antigravity, OpenCode, and more. 安装后重启你的 Agent。适用于 Claude Code、Antigravity、OpenCode 等。

MCP Connect any MCP-compatible client to the web in seconds. 在几秒钟内将任何兼容 MCP 的客户端连接到网络。

{
  "mcpServers": {
    "firecrawl-mcp": {
      "command": "npx",
      "args": ["-y", "firecrawl-mcp"],
      "env": {
        "FIRECRAWL_API_KEY": "fc-YOUR_API_KEY"
      }
    }
  }
}

Agent Onboarding Are you an AI agent? Fetch this skill to sign up your user, get an API key, and start building with Firecrawl. 你是 AI Agent 吗?获取此技能以注册你的用户、获取 API Key 并开始使用 Firecrawl 进行构建。

curl -s https://firecrawl.dev/agent-onboarding/SKILL.md

See the Skill + CLI documentation for all available commands. For MCP, see firecrawl-mcp-server. 查看 Skill + CLI 文档以获取所有可用命令。关于 MCP,请参阅 firecrawl-mcp-server。


More Endpoints

更多端点

Agent The easiest way to get data from the web. Describe what you need, and our AI agent searches, navigates, and retrieves it. No URLs required. Agent is the evolution of our /extract endpoint: faster, more reliable, and doesn’t require you to know the URLs upfront.

Agent 从网络获取数据的最简单方式。只需描述你的需求,我们的 AI Agent 就会进行搜索、导航并检索内容。无需提供 URL。Agent 是我们 /extract 端点的进化版:速度更快、更可靠,且不需要你预先知道 URL。

curl -X POST 'https://api.firecrawl.dev/v2/agent' \
 -H 'Authorization: Bearer fc-YOUR_API_KEY' \
 -H 'Content-Type: application/json' \
 -d ...