Library › AI Evals › Small business owners
Spot which of 4 proposed evals is really a vibes check
- For Small business owners
- You practice Catching mistakes and made-up facts
- Time about 5 minutes
- Level Beginner
About this exercise
Lena Ortiz owns Petal & Post, a florist, and her consultant sent four ways to "evaluate" the order chatbot Posy. Lena asks which one is just a vibes check. Write a plain-text Slack reply under 90 words: first the line "Hi Lena,", then exactly 4 labeled lines: "Vibes check: [letter]", "Missing: [what it lacks, in one sentence]", "Fix: [one sentence under 25 words]" and "Keep: [the other three letters]".
Common mistakes when you ask AI for this
- Calling several options vibes. The AI says A and C are both weak because C is narrow. Try: Say: "Exactly one is a vibes check: the one with no fixed cases and no written answers."
- Vague complaints. The AI says A is "subjective" without naming what is missing. Try: Add: "Missing: no fixed cases and no written correct answers."
- Advice with no fix. The AI writes a paragraph about better evaluation in general. Try: Add: "Fix: one sentence under 25 words, scoring the same questions against written answers."
- Chatty Slack message. The AI adds greetings, emoji and offers more help. Try: Say: "Hi Lena, then exactly 4 labeled lines, plain text, under 90 words."
What a strong prompt includes
- Names the 4 labeled lines
- Addresses Lena
- Asks for one letter
- Caps the length
- Asks for plain text
Related exercises
- Accrue unpaid wages for the working days after the last pay period (Finance AI · Accountants)
- Age a returns queue in business days and flag the ones over the limit (Customer Support & Success AI · Customer support teams)
- Alert sales to a competitor's price change, facts only (Research & AI Search · Product managers)
- Annualize recurring revenue without the one-time fee (Data AI · Finance and accounting)
- Answer a credit dispute with the full-hour rule and the math (Customer Support & Success AI · Customer support teams)