Library › AI Evals › College students

Write a golden reference answer for a stats tutor bot

Practice: Keeping the AI to your sources. About 5 minutes.

About this exercise

You're a TA building test cases for your Stats 101 tutor bot, and this question needs a golden answer to grade the bot against. TutorBot always ends with a check question, so write exactly 3 numbered lines: '1. Formula: ...', '2. Plug in: ...' with the numbers worked out, and '3. Check: ...' asking what happens to the SE if the sample grows to 100 people, without giving the answer. Use the course notes, including the corrected formula. Plain text, under 60 words.

Common mistakes when you ask AI for this

  • Copying the typo. Slide 4's wrong formula is still in the notes, and the AI may use it and get 0.4. Try: Add: "Use the corrected formula from Oct 28."
  • A full lesson instead of a reference. The AI explains standard error at length, which makes a poor answer to grade against. Try: Show the shape: "1. Formula: 2. Plug in: 3. Check:"
  • Forgetting the check question. The AI doesn't know TutorBot ends with a question, so it ends with a summary or gives the answer away. Try: Add: "End with Check: what happens to SE if n is 100? Don't answer it."
  • Markdown math. The AI formats formulas with bold or LaTeX that won't show up in your test file. Try: Ask for "plain text, no bold, no LaTeX."

What a strong prompt includes

  • Uses the correction
  • Shows the three-line shape
  • Asks for the check question
  • Keeps it short
  • Asks for plain text

Practice this now ↑

Related exercises