Library › AI Evals › Small business owners

Check your restaurant chatbot's reply against the menu

  • For Small business owners
  • You practice Catching mistakes and made-up facts
  • Time about 5 minutes

About this exercise

Your restaurant's website chatbot answered a customer's questions, and you want to check each claim against your menu and hours sheet. Write exactly 5 numbered lines, one per claim, each labeled Matches, Wrong or Not on sheet. For each Wrong line, add what the sheet says in quotation marks. Judge only by the sheet. Plain text, under 100 words.

Common mistakes when you ask AI for this

  • Asking 'is it right?'. The AI says the reply is 'mostly accurate' and misses the risky gluten-free claim. Try: Say: "Label each claim Matches, Wrong or Not on sheet."
  • No proof for corrections. The AI says a claim is wrong without showing what your sheet says. Try: Add: "For Wrong, quote the sheet."
  • A rewritten reply. The AI 'helps' by writing a new reply to the customer. Try: Be exact: "Exactly 5 numbered lines, nothing else."
  • Getting markdown back. AI defaults to bold labels and a table. Try: Ask for "plain text, no bold, no tables."

What a strong prompt includes

  • Gives exact labels
  • Makes the sheet the judge
  • Asks for a quote as evidence
  • Says exactly how many
  • Asks for plain text

Practice this now ↑

Related exercises