Library › AI Evals › Finance and accounting
Check AI variance commentary against the actual numbers
Practice: Catching mistakes and made-up facts. About 5 minutes.
About this exercise
An AI wrote the monthly variance commentary for your budget review, and every number must match the report before it goes to the CFO. Write exactly 5 numbered lines, one per sentence, each labeled Matches, Wrong or Not in report. For each Wrong line, add the report's figure in quotation marks. Judge only by the report. Plain text, under 100 words.
Common mistakes when you ask AI for this
- Asking for a review. The AI polishes the wording and never checks each number against the report. Try: Say: "Label each sentence Matches, Wrong or Not in report."
- Letting an invented reason pass. The $13K is right, so the AI misses that the 'analytics license' reason isn't in the report. Try: Add: "Not in report includes reasons the report doesn't give."
- No proof for corrections. The AI says a number is off without giving the report's figure. Try: Add: "For Wrong, quote the report's figure."
- A rewritten commentary. The AI 'helps' by rewriting the paragraph for the CFO. Try: Be exact: "Exactly 5 numbered lines, one per sentence, nothing else."
What a strong prompt includes
- Gives exact labels
- Makes the report the judge
- Asks for a quote as evidence
- Says exactly how many
- Asks for plain text
Related exercises
- Alert sales to a competitor's price change, facts only (Research & AI Search · Product managers)
- Approve or return expense claims against the policy (Productivity AI · Finance and accounting)
- Approve part of an overtime request with the math (Writing AI · Managers and team leads)
- Catch a chatbot's mistake on your invoice total (Data AI · Freelancers and creators)
- Catch a chatbot's mistakes about a supplier's return policy (Research & AI Search · Small business owners)