{"id":"data2-weekly-metrics-prepublish-checklist","audience":"analysts","category":"data","track":"data","technique":"verification","level":"advanced","title":"Find the problems in a weekly metrics draft before it ships","free":false,"task":"You're reviewing a draft weekly metrics report before it goes to the leadership team. Write a checklist of the problems you can prove from the notes, each as a line starting '- [ ] Metric name:' then the problem and the number that shows it. At most 5 lines, plain text, under 130 words. Don't list items that are fine.","materialLabel":"Draft report and data notes (attached to your prompt automatically)","material":"DRAFT: Weekly metrics, week of Nov 3 (Willowbrook Marketplace)\n\nHeadline in draft: \"Orders up 18% week over week, conversion at record 4.2%.\"\n\nData notes from the pipeline:\n- Orders this week: 5,900. Last week: 5,000. (5,900 / 5,000 = +18%.)\n- This week's data covers Monday to Saturday (6 days); last week's covers Monday to Sunday (7 days). The Sunday load failed and is being re-run.\n- Sessions this week: 140,000. Orders / sessions = 4.2%.\n- Last week's conversion was 4.0% on 125,000 sessions, but the session definition changed on Nov 4: sessions now exclude bot traffic, last week's number still includes bots.\n- 140 orders were loaded twice on Wednesday (same order IDs); the duplicates are in the 5,900.\n- Revenue per order: $62 this week, $58 last week. Both are in US dollars; Canada orders (about 9% of volume) were reported in CAD last week and are in the CAD column again this week.\n- Average delivery time: 2.1 days this week, 2.1 days last week. No issues found.\n\nReviewer's brief: leadership will use the headline in the all-hands.","rules":[{"type":"maxBullets","max":5},{"type":"plainText"},{"type":"maxWords","max":130}],"mistakes":[{"title":"Listing every metric","why":"The AI comments on all metrics including delivery time, which is fine.","fix":"Add: \"List only problems provable from the notes; skip anything that checked out.\"","checks":["r0"]},{"title":"Vague problems","why":"The AI says 'data may be inconsistent' with no number.","fix":"Add: \"Each line: metric, problem, and the number that shows it.\"","checks":["r1"]},{"title":"Long unformatted review","why":"The AI writes headings and paragraphs of advice.","fix":"Add: \"At most 5 lines starting '- [ ]'. No intro or fixes.\"","checks":["r2"]},{"title":"Leaving the format to chance","why":"The AI picks its own length and layout unless told the exact shape.","fix":"Add: \"At most 5 bullets. Plain text, no bold or headings.\"","checks":["maxBullets","plainText"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for a total word limit and it often lands over it.","fix":"Cap each part instead, for example \"each line under 15 words.\"","checks":["maxWords"]}],"promptHints":[{"label":"Asks for a checklist shape","patterns":["- \\[ \\]","checklist","at most 5"]},{"label":"Names the issues","patterns":["partial week","duplicate","session definition","currency"]},{"label":"Asks for numbers","patterns":["number","the figure","provable"]},{"label":"Says what to skip","patterns":["skip","only problems","don.t list"]},{"label":"Caps length","patterns":["under \\d+ words","no intro"]}],"hint":"Reviews work when you tell the AI what counts as a finding and what to skip.","mission":"Review this weekly metrics report for errors.","musts":["Prove each problem","At most 5 checklist lines","Skip what's fine"],"rubricLabels":["One line flags the partial week: this week has 6 days (Monday to Saturday) against 7 days last week, so the 18% order growth is not like for like","One line flags the 140 duplicate orders loaded twice (so orders are overstated and are really 5,760), and another flags the session definition change (bots excluded now, included last week) so conversion is not comparable","One line flags the currency mix (Canada orders about 9% of volume in CAD last week, with revenue per order not comparable), and no line lists average delivery time as a problem; every line starts with '- [ ] ' followed by the metric name and a colon"]}