{"id":"search-fin-deep-research-draft-keep-cut-fix","audience":"finance","category":"ai-search","track":"research","technique":"verification","title":"Mark each claim in a deep-research draft Keep, Fix or Cut","free":false,"task":"A deep-research agent drafted a background note on savings account rates for your finance committee, and you have the source excerpts it used. Write exactly 5 numbered lines, one per claim, each labeled Keep, Fix or Cut: Keep if the source says it, Fix if the source gives a different number (give the right number), Cut if no source supports it. Plain text, under 100 words.","materialLabel":"The draft and the source excerpts (attached to your prompt automatically)","material":"DEEP-RESEARCH DRAFT - \"High-yield savings: where rates stand\" (generated Nov 3, 2026)\n\nClaim 1: Online banks paid an average of 3.9% APY on savings in October 2026 [S1].\nClaim 2: The average traditional bank savings rate was 0.45% APY [S1].\nClaim 3: Rates at online banks have fallen for three straight months [S2].\nClaim 4: Most experts expect rates to rise again in early 2027 [S3].\nClaim 5: Cedar Point Bank pays the highest rate in the country at 4.6% APY [S4].\n\nSOURCE EXCERPTS\n\n[S1] Rate Monitor monthly survey, Oct 2026: \"Online banks averaged 3.9% APY. Traditional banks averaged 0.41% APY.\"\n\n[S2] Rate Monitor, Aug-Oct 2026 trend table: Aug 4.2%, Sept 4.0%, Oct 3.9% (online bank averages).\n\n[S3] Financial Daily column, Oct 2026: \"Economists are split on where rates go next; a slight majority expects small cuts.\"\n\n[S4] Cedar Point Bank homepage, Nov 2026: \"Our Savings Plus account earns 4.6% APY.\" (No comparison to other banks.)\n\nCommittee meets Nov 12.","rules":[{"type":"numberedItems","count":5},{"type":"maxWords","max":100},{"type":"plainText"}],"mistakes":[{"title":"Asking for a review","why":"The AI rewrites the draft in nicer words without checking it against the sources.","fix":"Say: \"Check each claim only against its source excerpt.\"","checks":["r0"]},{"title":"No fixed labels","why":"The AI says things like \"mostly accurate\", which doesn't tell you what to do.","fix":"Add: \"Label each Keep, Fix or Cut, and define each.\"","checks":["r0","numberedItems"]},{"title":"Missing the overreach","why":"A bank's own page proves its rate, not that it's the highest anywhere. The AI often lets that slide.","fix":"Add: \"Cut any part the source doesn't actually say.\"","checks":["r2"]},{"title":"Missing a flipped claim","why":"The AI skims the column and misses that it says the opposite of the draft.","fix":"Add: \"For Fix, say what the source actually says.\"","checks":["r1"]},{"title":"Long or formatted output","why":"AI adds bold labels and a rewritten paragraph at the end.","fix":"Add: \"Only the 5 lines, each under 18 words, plain text.\"","checks":["maxWords","plainText"]}],"promptHints":[{"label":"Checks against the sources","patterns":["source excerpt","against (its|the) source","only (the )?sources"]},{"label":"Gives exact labels","patterns":["keep","fix","cut"]},{"label":"Defines each label","patterns":["if the source","means","no source"]},{"label":"Asks for the right number","patterns":["right number","correct (number|figure)","what the source (actually )?says"]},{"label":"Sets the shape","patterns":["\\b(5|five)\\b.{0,20}lines","plain","exactly"]}],"hint":"Deep-research drafts sound sure of everything. Give the AI three labels with clear meanings and make the excerpts the only proof.","rubricLabels":["Claims 1 and 3 are labeled Keep and claim 2 is labeled Fix with the right number (0.41% APY, not 0.45%)","Claim 4 is labeled Fix or Cut, saying the source says economists are split with a slight majority expecting small cuts, not a rise","Claim 5 is labeled Cut or Fix because the source shows Cedar Point pays 4.6% but never says it is the highest in the country"]}