Library › AI Evals › College students

Write a 4-line pass/fail rubric for AI study guides

Practice: Setting limits and rules. About 5 minutes.

About this exercise

Your study group uses AI to make midterm study guides from lecture notes, and you want a rubric to check them. Your professor said only slides 1-30 are on the midterm. Write exactly 4 numbered criteria, each 'N. Pass if ...; Fail if ...', binary only, covering: only slides 1-30, every term has a definition from the notes, at most 15 terms, and the 3 formulas she said to memorize. Plain text, under 160 words.

Common mistakes when you ask AI for this

  • Getting a rating scale. Asked if a guide is good, the AI suggests rating 'clarity' 1-5. Try: Say: "Binary only: each line is 'Pass if ...; Fail if ...'."
  • Not giving the professor's limits. The AI doesn't know only slides 1-30 count or which 3 formulas matter. Try: Add: "Only slides 1-30. Must include elasticity, consumer surplus and Qd = Qs."
  • Fuzzy length check. A check like 'not too long' gets different answers from everyone. Try: Use a number: "Fail if more than 15 terms."
  • Too many criteria. The AI writes 8 or more criteria, including formatting and emoji. Try: Be exact: "Exactly 4 numbered criteria, one line each."

What a strong prompt includes

  • Asks for binary pass/fail
  • Gives the professor's limits
  • Caps the terms
  • Says exactly how many
  • Asks for plain text

Practice this now ↑

Related exercises