Library › Research AI › High school students

Check a chatbot's answer against your textbook

Practice: Catching mistakes and made-up facts. About 5 minutes.

About this exercise

You asked a chatbot about the Constitutional Convention for your civics review, and you're not sure its answer is right. Have the AI check that answer against your textbook excerpt only. You want exactly 3 numbered lines, one per claim the textbook contradicts, each in the shape 'Chatbot said X; textbook says Y', under 25 words each, plain text, nothing else. Claims the textbook supports or doesn't mention should not be listed.

Common mistakes when you ask AI for this

  • Asking "is this right?". The AI answers in long prose, mixing in what it knows, and mentions correct claims too. Try: Ask for a list: "Exactly 3 numbered lines, one per claim the textbook contradicts."
  • Trusting the AI to count words. AI is bad at counting. Ask for a total and it often lands 20% over. Try: Cap each line: "each line under 20 words."
  • Not naming the referee. The AI checks the answer against its own memory, which can be wrong too. Your test follows your textbook. Try: Say: "Use only my textbook excerpt as the standard. Skip claims it doesn't mention."
  • No shape for the corrections. The AI might just say 'the location is wrong' without the right answer, which you need to study. Try: Show it: "Each line: Chatbot said X; textbook says Y."
  • Forgetting it's going in your notes. AI uses bold and headings, which make a messy paste into your study notes. Try: Add: "Plain text, nothing before or after the list."

What a strong prompt includes

  • Uses the textbook as the standard
  • Asks for only the contradictions
  • Shows the line shape
  • Limits the lines
  • Skips what checks out

Practice this now ↑

Related exercises