{"id":"res-off-chatbot-holiday-schedule-errors","audience":"office","category":"fact-checking","technique":"verification","title":"Catch the errors in a chatbot's holiday schedule summary","free":false,"task":"You asked a chatbot to summarize the 2027 office holiday memo for the staff calendar, and you want to check it before posting. You want only the errors, as numbered lines in the form \"Summary says X; memo says Y\", under 60 words total, in plain text. Use only the memo, skip lines that match it, and don't rewrite the summary.","materialLabel":"The holiday memo and the chatbot's summary (attached to your prompt automatically)","material":"MEMO - 2027 Office Holidays (from Gloria Hart, Operations, Oct 28, 2026)\nThe office will be closed on these days in 2027:\n- New Year's Day: Friday, Jan 1\n- Memorial Day: Monday, May 31\n- Independence Day (observed): Monday, July 5\n- Labor Day: Monday, Sept 6\n- Thanksgiving: Thursday, Nov 25 and Friday, Nov 26\n- Christmas (observed): Friday, Dec 24\nEach employee also gets 1 floating holiday to use any time with manager approval. Floating holidays do not carry over.\n\n-----\nCHATBOT SUMMARY (draft for the staff calendar)\nIn 2027 the office closes on New Year's Day (Jan 1), Memorial Day (May 31), Independence Day (Monday, July 5), Labor Day (Sept 6), Thanksgiving Thursday and Friday (Nov 25-26), and Christmas Day (Saturday, Dec 25). Everyone gets 2 floating holidays, and unused floating days carry over into 2028.","rules":[{"type":"maxWords","max":60},{"type":"plainText"}],"mistakes":[{"title":"Asking for a better summary","why":"The AI rewrites the whole thing, and you can't see what was wrong in the first one.","fix":"Say: \"List only the errors. Don't rewrite.\"","checks":["r2"]},{"title":"Not naming the source of truth","why":"The AI may judge by its own idea of when Christmas is, not by the memo's observed date.","fix":"Add: \"The memo is the only source of truth.\"","checks":["r0"]},{"title":"Listing every holiday","why":"The AI confirms each correct line too, so the real errors get buried.","fix":"Say: \"Skip lines that match the memo.\"","checks":["r1"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for a total word limit and it often lands 10-20% over.","fix":"Cap each line: \"each line under 15 words.\"","checks":["maxWords"]},{"title":"Getting markdown back","why":"AI defaults to bold labels and headings, which show up as stray symbols in the staff calendar.","fix":"Ask for \"plain text, no bold, no headings.\"","checks":["plainText"]}],"promptHints":[{"label":"Names the source of truth","patterns":["memo.{0,30}(only|source|truth)","only.{0,30}memo","against the memo"]},{"label":"Asks for errors only","patterns":["only.{0,20}(error|mistake|wrong)","skip.{0,30}match","(don't|do not) list (correct|matching)"]},{"label":"Gives the line format","patterns":["summary says","memo says","\\bX\\b.{0,20}\\bY\\b"]},{"label":"Sets a length limit","patterns":["\\d+\\s*words","one (short )?sentence","word (limit|count)"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"Checking is a different job from rewriting. Make the memo the judge, ask for only the mismatches, and give the line shape.","rubricLabels":["Flags all three errors: Christmas (summary: Saturday, Dec 25; memo: observed Friday, Dec 24), floating holidays (summary: 2; memo: 1), and carry-over (summary: they carry over; memo: they do not)","Does not flag lines that match the memo (the New Year's, Memorial Day, July 5, Labor Day and Thanksgiving dates)","Outputs only numbered lines in the form 'Summary says X; memo says Y': no intro, no corrected calendar, no closing note"]}