Library › AI Evals › Product managers

Match each Pedalbot failure to the right fix

  • For Product managers
  • You practice Giving the right context
  • Time about 5 minutes
  • Level Intermediate

About this exercise

Spokewise has five possible prompt fixes (defined in the material) and four failures from Pedalbot. Write exactly 4 numbered lines, one per failure, each like '1. Failure A: fix name - reason'. Use only the fix names from the material, use no fix twice, and keep each reason under 10 words. One fix will not be used. Plain text, under 90 words.

Common mistakes when you ask AI for this

  • Using the wrong fix for A. The AI picks the verifying second call because it sounds safest. Try: Say: "A missing answer needs permission to say I don't know."
  • Mixing up B and D. Both involve documents, so the AI swaps a quote per claim and quote first. Try: Say: "B: reviewers can't trace sentences. D: it never showed what it read."
  • Reusing a fix. The AI picks the same fix for two failures. Try: Say: "Use each fix at most once."
  • Long reasons and markdown. AI writes a paragraph per failure with bold fix names. Try: Ask for "plain text, each reason under 10 words."

What a strong prompt includes

  • Asks for one fix per failure
  • Says use each fix once
  • Says to use the listed names
  • Limits the reason
  • Asks for plain text

Practice this now ↑

Related exercises