Library › AI Evals › College students
Write a golden reference answer for a stats tutor bot
Practice: Keeping the AI to your sources. About 5 minutes.
About this exercise
You're a TA building test cases for your Stats 101 tutor bot, and this question needs a golden answer to grade the bot against. TutorBot always ends with a check question, so write exactly 3 numbered lines: '1. Formula: ...', '2. Plug in: ...' with the numbers worked out, and '3. Check: ...' asking what happens to the SE if the sample grows to 100 people, without giving the answer. Use the course notes, including the corrected formula. Plain text, under 60 words.
Common mistakes when you ask AI for this
- Copying the typo. Slide 4's wrong formula is still in the notes, and the AI may use it and get 0.4. Try: Add: "Use the corrected formula from Oct 28."
- A full lesson instead of a reference. The AI explains standard error at length, which makes a poor answer to grade against. Try: Show the shape: "1. Formula: 2. Plug in: 3. Check:"
- Forgetting the check question. The AI doesn't know TutorBot ends with a question, so it ends with a summary or gives the answer away. Try: Add: "End with Check: what happens to SE if n is 100? Don't answer it."
- Markdown math. The AI formats formulas with bold or LaTeX that won't show up in your test file. Try: Ask for "plain text, no bold, no LaTeX."
What a strong prompt includes
- Uses the correction
- Shows the three-line shape
- Asks for the check question
- Keeps it short
- Asks for plain text
Related exercises
- Accept a job offer and confirm the exact terms (Writing AI · Job seekers)
- Answer a 'where is my order' email with the real new date (Writing AI · Customer support teams)
- Answer a big discount ask with two priced options (Writing AI · Sales and customer success)
- Answer a buyer's HOA questions from the bylaws (Research & AI Search · Real estate agents)
- Answer a charge nurse application question with evidence (Writing AI · Nurses and healthcare workers)