holdout-validation

Name: holdout-validation
Rating: 5 (5 reviews)
Author: synaptiai

Cross-reference agent self-review claims against actual file state using hidden holdout scenarios, producing mapped P1/P2/P3 findings that reference visible acceptance criteria only. Use when verifying implementation completeness after self-review in start (Phase 4 VERIFY), address (convergence check), or review (parallel fan-out). Also use when an agent claims evidence for a criterion but the fil

5stars

Updated 2 months ago

View on GitHub ↗

How to add

/plugin marketplace add synaptiai/synapti-marketplace

The exact command may vary by repository. Check the README on GitHub.

For the skill author

Drop this on your repo README

Shows your skill is listed on Skillteca, generates a backlink and trackable traffic.

[![Listada na Skillteca](https://www.skillteca.com.br/api/badge/holdout-validation/svg)](https://www.skillteca.com.br/skills/holdout-validation?utm_source=badge&utm_medium=readme&utm_campaign=badge)

#ai

Related skills

See all in Pesquisa e Web →

understand-dashboard

64.4k1

Launch the interactive web dashboard to visualize a codebase's knowledge graph.

Pesquisa e Webby Lum1104

understand-chat

64.4k

Use when you need to ask questions about a codebase or understand code using a knowledge graph.

Pesquisa e Webby Lum1104

understand-domain

64.4k

Extract business domain knowledge from a codebase and generate an interactive domain flow graph. Works standalone (lightweight scan) or derives from an existing /understand knowledge graph.

Pesquisa e Web#aiby Lum1104

dev-browser

63k

Automates browser interactions with persistent page state. Use for navigating websites, filling forms, taking screenshots, extracting web data, testing web apps, or automating browser workflows.

Pesquisa e Web#testby code-yeongyu

Category alert

Get new Pesquisa e Web skills every Monday

One short email with only the new Pesquisa e Web skills. 4 minutes of reading, no spam, unsubscribe with one click.

You confirm your email on the first send. No spam. Unsubscribe with one click.

Holdout Validation

You are an independent claim verifier — you cross-reference agent self-review claims against actual file state using hidden holdout scenarios that the executing agent never sees. Your core insight: agents often claim "test added for X" or "error handling covers Y" without the claim being true. You verify the claim against the files.

This skill is adapted from the ai-first-org-design-kit holdout-evaluator but simplified to flow's finding vocabulary (P1/P2/P3) and crit

[Description truncada. Veja o README completo no GitHub.]

ShareX LinkedIn

Comments · No comments

No comments yet. Be the first.