{"id":"data2-verify-pivot-summary-claims-labels","audience":"analysts","category":"data","track":"data","technique":"verification","level":"beginner","title":"Verify four claims in an AI summary against the region totals","free":false,"task":"An AI summarized last quarter's sales by region and you need to check its four claims. Write exactly 4 plain-text lines starting 'Claim 1:' to 'Claim 4:', then Confirmed, Wrong or Not on page, then a reason with the numbers, each reason under 15 words, under 90 words in all. Use only the table.","materialLabel":"The table and the AI's claims (attached to your prompt automatically)","material":"Q3 sales by region (Sunrise Wholesale, in dollars)\n\nEast: 52,000\nWest: 48,000\nSouth: 31,000\nNorth: 19,000\nTotal: 150,000\n\nAI summary claims:\nClaim 1: West was the top region.\nClaim 2: South contributed about a fifth of total sales.\nClaim 3: North sales fell compared with last year.\nClaim 4: Total Q3 sales were $150,000.\n\nNotes:\n- The table has this quarter only. There is no prior-year data in the file.\n- \"About a fifth\" means roughly 20%.\n- Percent of total = region / 150,000.","rules":[{"type":"plainText"},{"type":"maxWords","max":90}],"mistakes":[{"title":"Guessing about last year","why":"The AI calls Claim 3 true or false with no prior-year data.","fix":"Add: \"If the table can't answer it, write Not on page.\"","checks":["r0"]},{"title":"Not checking the top region","why":"The AI repeats that West was top.","fix":"Add: \"Compare the numbers: East 52,000 vs West 48,000.\"","checks":["r1"]},{"title":"Skipping the arithmetic","why":"The AI says the total 'looks right' without adding.","fix":"Add: \"Show the arithmetic for any percent or total.\"","checks":["r2"]},{"title":"Leaving the format to chance","why":"The AI picks its own length and layout unless told the exact shape.","fix":"Add: \"Plain text, no bold or headings.\"","checks":["plainText"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for a total word limit and it often lands over it.","fix":"Cap each part instead, for example \"each line under 15 words.\"","checks":["maxWords"]}],"promptHints":[{"label":"Gives the labels","patterns":["confirmed","wrong","not on page"]},{"label":"Asks for the line shape","patterns":["claim 1:","4 lines"]},{"label":"Asks for arithmetic","patterns":["arithmetic","numbers"]},{"label":"Rules out guessing","patterns":["can.t answer","don.t guess"]},{"label":"Rules out extras","patterns":["no intro","no notes"]}],"hint":"A fixed label set and a 'not on page' option stop the AI from guessing.","mission":"Are these claims about our regional sales correct?","musts":["Four claim lines","Exact three labels","Arithmetic in reasons"],"rubricLabels":["Claim 1 is labeled Wrong because East ($52,000) is above West ($48,000), and Claim 4 is labeled Confirmed because 52,000 + 48,000 + 31,000 + 19,000 = 150,000","Claim 2 is labeled Confirmed with 31,000 / 150,000 = about 20.7%","Claim 3 is labeled Not on page because there is no prior-year data, and the reply has exactly four lines starting Claim 1: through Claim 4: using only the labels Confirmed, Wrong or Not on page"]}