Library › AI Evals › College students
Check an AI lit-review paragraph against 3 abstracts
Practice: Catching mistakes and made-up facts. About 5 minutes.
About this exercise
An AI wrote a literature-review paragraph from 3 abstracts for your psych seminar, and you want to check each claim before using it. Write exactly 5 numbered lines, one per claim, each 'N. Supported (A2)', 'N. Contradicted (A1) - abstract says "..."' or 'N. Not in abstracts', naming the abstract you checked. Judge only by the abstracts. Plain text, under 110 words.
Common mistakes when you ask AI for this
- Asking 'is it accurate?'. The AI says the paragraph is 'mostly accurate' and misses the flipped findings. Try: Say: "Label each claim Supported, Contradicted or Not in abstracts."
- Missing the causal claim. 'Causes lower grades' sounds close to the survey, so the AI lets it pass. Try: Add: "Treat a cause claim from a survey as Contradicted if the abstract says it can't show cause."
- Not naming the source. The AI says a claim is supported without saying which abstract, so you can't check it. Try: Ask: "Name the abstract you checked, like (A2)."
- No proof for corrections. The AI says a claim is wrong but doesn't show the abstract's words. Try: Add: "For Contradicted, quote the abstract."
- A rewritten paragraph. The AI 'helps' by rewriting the whole paragraph, which you didn't ask for. Try: Be exact: "Exactly 5 numbered lines, nothing else."
What a strong prompt includes
- Gives exact labels
- Asks which abstract
- Asks for a quote
- Says exactly how many
- Asks for plain text
Related exercises
- Alert sales to a competitor's price change, facts only (Research & AI Search · Product managers)
- Approve or return expense claims against the policy (Productivity AI · Finance and accounting)
- Approve part of an overtime request with the math (Writing AI · Managers and team leads)
- Catch a chatbot's mistake on your invoice total (Data AI · Freelancers and creators)
- Catch a chatbot's mistakes about a supplier's return policy (Research & AI Search · Small business owners)