Fact Checker

Overview

This skill provides a structured approach to evaluating factual claims—assessing whether a statement is accurate, partially accurate, misleading, or false, and explaining why with evidence and reasoning. Good fact-checking goes beyond a binary true/false verdict: it identifies the precise claim being made, locates the best available evidence, accounts for context and nuance, and rates confidence appropriately. The output is a clear, evidence-backed assessment that helps readers understand not just whether something is accurate, but why it matters.

When to Use

• Verifying statistics, quotes, or factual assertions in articles or documents
• Checking whether a viral social media claim holds up to scrutiny
• Assessing whether historical facts cited in writing are accurate
• Auditing factual claims in a draft before publication
• Evaluating whether scientific findings are being accurately reported
• Confirming whether attributed quotes are real and in context
• Vetting claims in speeches, presentations, or marketing copy

When NOT to Use

• Evaluating subjective opinions or value judgments ("X policy is better than Y")
• Providing legal advice or legal interpretations of statutes
• Providing medical diagnoses or treatment recommendations
• Verifying real-time data such as live stock prices, current weather, or breaking news
• Assessing internal business claims that require proprietary data access
• Deciding which of two contested scientific theories is definitively correct (use literature-reviewer skill for contested scientific debates)

Quick Reference

Instructions

1. Isolate the precise claim. Restate the claim in neutral, specific terms before evaluating it. Many claims contain embedded assumptions or vague language that must be unpacked. "Studies show coffee causes cancer" is not a single claim—it bundles together a specific substance, a causal mechanism, and a category of disease. Break compound claims into individual checkable assertions.

2. Assess the claim type. Determine whether this is:

   • A factual assertion (a specific, verifiable statement about the world)
   • A statistical claim (requires checking source, date, methodology, and applicability)
   • A quote attribution (requires locating the original source and verifying wording and context)
   • A causal claim (requires evaluating whether evidence supports causation or only correlation)
   • A historical claim (requires consulting authoritative historical records)

3. Identify the best sources. Rank sources by reliability:

   • Tier 1: Peer-reviewed research, official government data, primary documents
   • Tier 2: Established news organizations with editorial standards, expert consensus statements
   • Tier 3: Reputable secondary sources, encyclopedias, expert interviews
   • Avoid: Anonymous posts, sites with known bias and no editorial accountability, single-source claims without corroboration

4. Evaluate the evidence. Apply these checks:

   • Does the original source actually say what the claim implies?
   • Is the data current and applicable to the specific context?
   • Are there important caveats or limitations the claim omits?
   • Do other independent sources corroborate or contradict this?

5. Assess context and framing. A claim can be technically true but deeply misleading. Check: Is the statistic cherry-picked from a broader dataset? Is the quote taken out of context? Does the claim imply causation from a correlation? Does it generalize from a narrow study to a broad population?

6. Assign a verdict with confidence level. Use a clear rating:

   • True: Accurate and properly contextualized
   • Mostly True: Accurate in substance but missing important nuance or context
   • Mixed: Contains both accurate and inaccurate elements
   • Mostly False: Misleading framing or significant inaccuracies, though a kernel may be accurate
   • False: Contradicted by the best available evidence
   • Unverifiable: Cannot be confirmed or denied with available sources Also note your confidence level (High / Medium / Low) based on the quality and quantity of evidence.

7. Write the fact-check clearly. Structure the output as: (1) the claim as stated, (2) the verdict up front, (3) the evidence and reasoning, (4) any important caveats or context. Attribute every piece of evidence to a named source. Avoid weasel words—be direct about what the evidence does and does not show.

Examples

Example 1: Statistical Claim Fact-Check

Input: "Fact-check this claim: 'The Great Wall of China is the only man-made structure visible from space.'"

Output:

Claim: "The Great Wall of China is the only man-made structure visible from space."

Verdict: FALSE Confidence: High

Evidence and Reasoning:

This is one of the most persistent myths in popular culture, but it is contradicted by direct observation, physics, and astronaut testimony.

What astronauts actually report: Multiple astronauts have specifically addressed this claim. Chinese astronaut Yang Liwei, the first Chinese person in space, stated after his 2003 mission that he could not see the Great Wall. NASA astronaut Ed Lu confirmed this in 2004. Far from supporting the myth, the people best positioned to verify it have consistently denied it.

The physics: The Great Wall is, on average, 5–8 meters wide—narrower than a human hair as seen from the International Space Station (roughly 400 km altitude). Visibility at that scale would require impossibly acute vision. NASA's Earth Observatory notes that the wall "would be as difficult to see as a human hair from two miles away."

What IS visible: Many man-made features are visible from low Earth orbit under good conditions, including highways, airports, cities, reservoirs, and agricultural fields—all of which are wider than the Wall. From the Moon (385,000 km away), no man-made structure of any kind is visible.

Origin of the myth: The claim appears as early as 1932 in Ripley's Believe It Or Not and was repeated in reference books for decades before being widely debunked.

Sources: NASA Earth Observatory; Chinese National Space Administration statements; Liu Yang and Yang Liwei mission reports (2003, 2012).

Example 2: Quoted Statistic Fact-Check

Input: "Someone cited this statistic in a presentation: 'We only use 10% of our brains.' Is this true?"

Output:

Claim: "Humans only use 10% of their brains."

Verdict: FALSE Confidence: High

Evidence and Reasoning:

This claim has no basis in neuroscience and is contradicted by multiple independent lines of evidence.

Brain imaging data: Functional MRI and PET scan studies show that virtually all brain regions are active over the course of a day. While not every neuron fires simultaneously (which would cause a seizure), there is no dormant 90% waiting to be unlocked. A 2014 University of Western Ontario study explicitly tested this myth and found activity throughout the brain during normal function.

Evolutionary evidence: The human brain accounts for approximately 2% of body weight but consumes 20% of the body's energy at rest. Evolution