Library › AI Evals › Teachers

Sort 13 flagged AI quiz questions into 3 failure types

Practice: Asking for a format you can use. About 5 minutes.

About this exercise

You flagged 13 questions from an AI quiz generator and wrote a note on each. Group them into exactly 3 numbered failure types, each line 'Type name: #ids = count', then one last line 'Total: N'. Leave out any note you later took back. Plain text, under 70 words.

Common mistakes when you ask AI for this

  • Too many types. The AI makes a separate group for almost every note, so nothing stands out to report. Try: Say: "Exactly 3 failure types."
  • No ids or counts. The AI describes the problems but you can't tell which questions belong where. Try: Show the shape: "Type name: #1, #4 = 2".
  • Counting the note you took back. The AI counts every numbered note, including #8. Try: Add: "Leave out notes I took back, and end with Total: N."
  • Getting markdown back. AI defaults to bold type names and headings. Try: Ask for "plain text, no bold, no headings."

What a strong prompt includes

  • Says exactly how many
  • Asks for ids and counts
  • Handles the withdrawn note
  • Asks for a total
  • Asks for plain text

Practice this now ↑

Related exercises