Library › AI Evals › College students

Check an AI lit-review paragraph against 3 abstracts

Practice: Catching mistakes and made-up facts. About 5 minutes.

About this exercise

An AI wrote a literature-review paragraph from 3 abstracts for your psych seminar, and you want to check each claim before using it. Write exactly 5 numbered lines, one per claim, each 'N. Supported (A2)', 'N. Contradicted (A1) - abstract says "..."' or 'N. Not in abstracts', naming the abstract you checked. Judge only by the abstracts. Plain text, under 110 words.

Common mistakes when you ask AI for this

  • Asking 'is it accurate?'. The AI says the paragraph is 'mostly accurate' and misses the flipped findings. Try: Say: "Label each claim Supported, Contradicted or Not in abstracts."
  • Missing the causal claim. 'Causes lower grades' sounds close to the survey, so the AI lets it pass. Try: Add: "Treat a cause claim from a survey as Contradicted if the abstract says it can't show cause."
  • Not naming the source. The AI says a claim is supported without saying which abstract, so you can't check it. Try: Ask: "Name the abstract you checked, like (A2)."
  • No proof for corrections. The AI says a claim is wrong but doesn't show the abstract's words. Try: Add: "For Contradicted, quote the abstract."
  • A rewritten paragraph. The AI 'helps' by rewriting the whole paragraph, which you didn't ask for. Try: Be exact: "Exactly 5 numbered lines, nothing else."

What a strong prompt includes

  • Gives exact labels
  • Asks which abstract
  • Asks for a quote
  • Says exactly how many
  • Asks for plain text

Practice this now ↑

Related exercises