{"id":"eval-mkt-checks-ai-newsletter-drafts","audience":"marketing","category":"evaluation","track":"evals","technique":"audience","title":"Write 4 pass/fail checks for AI newsletter drafts","free":false,"task":"Your team uses AI to draft the weekly customer newsletter, and the editor wants 4 checks to grade drafts. She wants the offer in the first sentence, exactly one link, a subject line under 50 characters, and no claims without a source in the product sheet. Write exactly 4 numbered lines, each 'N. Check: ... | Pass: ... | Fail: ...', binary only. Plain text, under 170 words.","materialLabel":"A sample AI draft and the editor's notes (attached to your prompt automatically)","material":"Juniper & Pine Candles - AI newsletter draft (week 46)\n\nSubject: Cozy season is officially here and we have so many exciting things to share with you!\n\n\"Hi friend! As the days get shorter, there's nothing like the glow of a candle. Our new Cedar & Smoke scent is the longest-burning candle on the market. Shop the collection: juniperpine.example/fall. Read our candle care guide: juniperpine.example/care. And don't forget, this week only, get 20% off with code FALL20 at juniperpine.example/sale!\"\n\nEditor's comments (Maya, last 3 issues)\n- \"The offer is buried at the end. People skim.\"\n- \"Three links means nobody clicks any of them.\"\n- \"Subject lines get cut off on phones.\"\n- \"'Longest-burning on the market' - who says? Legal will ask.\"\n- \"The warm tone is great, keep it.\"\n\nProduct sheet (Cedar & Smoke): soy wax, 55-hour burn time, cotton wick.","rules":[{"type":"numberedItems","count":4},{"type":"plainText"},{"type":"maxWords","max":170}],"mistakes":[{"title":"Getting a rating scale","why":"The AI suggests rating 'engagement' and 'clarity' 1-5.","fix":"Say: \"Binary only: each line has a Pass and a Fail.\"","checks":["r1"]},{"title":"Generic email checks","why":"The AI doesn't know what your editor wants, so it invents checks like 'is compelling'.","fix":"List them: \"offer first, one link, subject under 50 characters, claims backed by the product sheet.\"","checks":["r0"]},{"title":"Checks you can't count","why":"'Subject is short' gets a different answer from every reviewer.","fix":"Use numbers: \"Fail if the subject is 50 characters or more.\"","checks":["r2"]},{"title":"A guide instead of checks","why":"The AI writes newsletter tips with headings.","fix":"Be exact: \"Exactly 4 lines: Check | Pass | Fail.\"","checks":["numberedItems","maxWords","plainText"]}],"promptHints":[{"label":"Names the editor's wants","patterns":["first sentence","one link|1 link","50 char","product sheet|claim"]},{"label":"Asks for pass/fail","patterns":["pass","fail","binary"]},{"label":"Shows the line shape","patterns":["check:","\\|","shape"]},{"label":"Says exactly how many","patterns":["\\b(4|four)\\b.{0,25}(check|line)","exactly \\d+"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"Checks work when they test what the reader of the draft actually wants. Give the AI the editor's four rules, ask for pass/fail lines, and use numbers wherever you can.","rubricLabels":["The 4 checks cover exactly the editor's 4 wants: the offer in the first sentence, exactly one link, a subject line under 50 characters, and no claim that isn't backed by the product sheet","Each line has all three parts in the shape 'N. Check: ... | Pass: ... | Fail: ...', and the Pass and Fail parts are concrete opposites (no scores, no 'mostly')","The link check uses the number one (1), the subject check uses 50 characters, and no check penalizes the warm tone"]}