This skill uses the Cloudflare Browser Rendering /crawl REST API to crawl websites, extract content as HTML/Markdown/JSON, and build knowledge bases. It also covers making websites crawlable with tools like robots.txt, sitemaps, and Cloudflare AI Crawl Control.
Pesquisa e Web#ai#apiby portdeveloper
