Library › AI Evals › College students

Pick the right metric for an AI flashcard generator

Practice: Giving the right context. About 5 minutes.

About this exercise

Your study group's AI flashcard generator gets great ratings, but you want to know if the cards are actually right. Your TA says cards must be at least 95% correct against the textbook, and duplicates must stay at or under 5%. Write exactly 4 numbered lines: Metric (not ratings), Threshold (the number and who set it), Result (the math, then Ready or Not ready), and Guardrail (the duplicate math against 5%). Plain text, under 80 words.

Common mistakes when you ask AI for this

  • Trusting the ratings. The AI sees 4.6 stars and calls the cards great, but ratings don't check facts. Try: Say: "Don't use ratings. Measure correct cards against the textbook."
  • Missing the TA's bar. The AI picks its own threshold because it doesn't know your TA's rule. Try: Add: "Threshold: 95% correct, from the TA."
  • No duplicate check. The AI doesn't know duplicates matter to you, so it skips them. Try: Ask: "Guardrail: duplicates out of 120 vs the 5% limit."
  • A long review. The AI writes study tips and a chapter breakdown. Try: Show the shape: "1. Metric: 2. Threshold: 3. Result: 4. Guardrail:"

What a strong prompt includes

  • Rules out ratings
  • Measures correctness
  • Gives the TA's bar
  • Adds the duplicate guardrail
  • Asks for plain text

Practice this now ↑

Related exercises