Library › AI Evals › Customer support teams

Turn "better at refunds" into 5 test cases with expected answers

  • For Customer support teams
  • You practice Asking for a format you can use
  • Time about 5 minutes
  • Level Beginner

About this exercise

Your lead's wish is "make Pedalbot better at refunds." Turn it into 5 test cases from the policy sheet, in this order: cancel 4 days before pickup, cancel 36 hours before, cancel 6 hours before, shop closed for weather, and a day pass. Write a markdown table with the columns Customer message and Expected answer, with exactly 5 rows. Each customer message is under 12 words, written as the customer would say it. Each expected answer is under 15 words and comes from the policy. Under 190 words.

Common mistakes when you ask AI for this

  • Dozens of cases. The AI writes 20 cases covering everything it can imagine. Try: Say: "Exactly 5 rows, in this order: 4 days, 36 hours, 6 hours, weather, day pass."
  • Vague expected answers. The AI writes "bot explains the policy" instead of the actual result. Try: Add: "Each expected answer states the exact refund from the policy."
  • Using the old rule. The AI trusts the retired 72-hour rule or invents one. Try: Say: "Use only policy sheet v4; the 72-hour rule is retired."
  • Messages that sound like tests. The AI writes "Test: user cancels" instead of a real customer line. Try: Add: "Write each message as the customer would say it, under 12 words."
  • Markdown decoration. The AI adds bold headers and notes around the table. Try: Add: "Plain text, only the table."

What a strong prompt includes

  • Asks for a table
  • Lists the five situations
  • Ties answers to the policy
  • Limits row count and length
  • Asks for plain text

Practice this now ↑

Related exercises