Overview
Firecrawl turns any URL into clean Markdown via a managed browser cluster. Handles JS rendering, anti-bot defenses, and PDFs. Paid per-page; requires FIRECRAWL_API_KEY. When the key is missing, doctor() reports warn.
When to Choose It
- Page is heavily JS-rendered (SPA, React, Next.js)
- Target site blocks
fetch-jinaorfetch-crawl4ai - PDF or document conversion needed
How To Use
Call via run_channel("fetch-firecrawl", url) where the query IS the URL to scrape. Returns one Evidence item with body = full Markdown content.
Quality Bar
- Evidence items have non-empty title and url.
- No crash on empty or malformed API response.
- Source channel field matches the channel name.