/fetch -- Ad-hoc URL fetch with smart extraction

Pulls a URL's main content (title, description, body paragraphs) without the HTML boilerplate. Delegates to silo's smart-fetch MCP tool, which strips scripts/styles/nav/footer and targets <main> or <article> regions. Typical reduction: 80-99% vs raw HTML.

Arguments

$ARGUMENTS

Expected: /fetch <url> [--mode auto|concise|full|meta-only] [--no-cache] [--privacy]

• --mode auto (default): tries concise extraction, falls back to full if quality degrades
• --mode concise: caps body at ~2KB
• --mode full: returns all extracted paragraphs
• --mode meta-only: only title + description (smallest)
• --no-cache: skip local cache read, force network fetch
• --privacy: don't write to cache (use for sensitive URLs)

When to use

• Quick reference: "what does this page say" — /fetch <url> beats opening a browser
• Before witnessing: peek at content before committing to /witness (which creates a claim)
• Third-party pages: docs sites, blog posts, research articles
• Re-reading: cache hits are ~1ms; great for iterating on content you've already fetched

When NOT to use

• Confluence: use /pull — structured API is better than HTML scraping
• DeepWiki: use /pull deepwiki — it already has a cleaner path
• Authenticated pages: smart-fetch doesn't do auth. Use farmer for approval-gated flows.
• PDFs, images, JSON: smart-fetch rejects non-HTML content types with unsupported-content-type

Instructions

1. Call mcp__silo__silo_smart-fetch with the URL and parsed flags.

2. If the response quality is "failed" (empty body, SPA, link list, HTTP error), tell the user:

   • What the reported quality was
   • Any warnings returned
   • Suggest retrying with --mode full or raw WebFetch as a fallback

3. Display the extracted content in a readable format:

   • Title, description
   • Full content (or first N lines if very long)
   • Size reduction metric and cache hit/miss status

4. Suggest next actions based on what the user seems to be doing:

   • If they're corroborating a claim: /witness <claim_id> <url> --smart
   • If they want to save findings: /research "<topic extracted from content>"
   • If the content was weak/failed: /fetch <url> --mode full or open in a browser

Example output

URL:        https://example.com/article
Quality:    high  |  Cached: no (first fetch)
Title:      "Understanding Smart Fetch"
Size:       142.1 KB -> 2.3 KB (98% reduction)
Mode used:  concise
Elapsed:    340ms

--- Content ---
[first 2KB of extracted main content]

Next steps:
  /witness r003 <url> --smart  -- corroborate a claim with this source
  /fetch <url> --mode full     -- get the full extracted body
  silo cache stats             -- see what's cached locally

Anti-rationalization