{"id":"res-hr-remote-stipend-chatbot-errors","audience":"hr","category":"fact-checking","technique":"verification","title":"Catch errors in the HR chatbot's remote work stipend answer","free":false,"task":"Your internal HR chatbot answered an employee's question about the remote work stipend, and you're auditing the answer. You want only the errors, as numbered lines in the form \"Bot says X; policy says Y\", under 60 words total, plain text. Use only the 2026 stipend policy, skip lines that match it, and don't rewrite the answer.","materialLabel":"The stipend policy and the chatbot's answer (attached to your prompt automatically)","material":"REMOTE WORK STIPEND POLICY - Calloway Design Group (rev. July 2026)\n- Fully remote employees receive $75 per month for internet and phone.\n- Hybrid employees (2-3 office days a week) receive $40 per month.\n- A one-time $500 home office allowance is available in the first 90 days of employment.\n- Receipts are not required for the monthly stipend; they are required for the home office allowance.\n- The stipend is paid through payroll and is taxable.\n\n-----\nCHATBOT ANSWER (to a fully remote employee)\nGreat question! As a fully remote employee you get $75 a month for internet and phone, paid through payroll. You can also claim a $500 home office allowance anytime during your first year. You'll need to submit receipts every month for the $75 stipend. The good news is the stipend is tax-free.","rules":[{"type":"maxWords","max":60},{"type":"plainText"}],"mistakes":[{"title":"Asking if the bot is right","why":"The AI writes a fixed answer, and you lose the list of errors to report.","fix":"Say: \"List only the errors. Don't rewrite.\"","checks":["r2"]},{"title":"Not naming the policy","why":"The AI may judge by common stipend rules instead of yours.","fix":"Add: \"The July 2026 policy is the only source of truth.\"","checks":["r0"]},{"title":"Flagging correct lines","why":"The AI confirms matching lines too, padding the list.","fix":"Say: \"Skip lines that match.\"","checks":["r1"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for a total word limit and it often lands 10-20% over.","fix":"Cap each line: \"each line under 13 words.\"","checks":["maxWords"]},{"title":"Getting markdown back","why":"AI defaults to bold labels and headings, which show up as stray symbols in your audit log.","fix":"Ask for \"plain text, no bold, no headings.\"","checks":["plainText"]}],"promptHints":[{"label":"Names the source of truth","patterns":["policy.{0,30}(only|source|truth)","only.{0,30}policy","against the policy"]},{"label":"Asks for errors only","patterns":["only.{0,20}(error|mistake|wrong)","skip.{0,30}match","contradict"]},{"label":"Gives the line format","patterns":["bot says","policy says","\\bX\\b.{0,20}\\bY\\b"]},{"label":"Sets a length limit","patterns":["\\d+\\s*words","one (short )?sentence","word (limit|count)"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"An audit needs a clean list of what's wrong. Make the policy the judge, ask only for mismatches, and give the line shape.","rubricLabels":["Flags all three errors: home office allowance timing (bot: first year; policy: first 90 days), monthly receipts (bot: required; policy: not required for the monthly stipend), and taxes (bot: tax-free; policy: taxable)","Does not flag lines that match the policy ($75 a month for fully remote, paid through payroll, $500 allowance amount)","Outputs only numbered lines in the form 'Bot says X; policy says Y': no intro, no rewritten answer, no closing note"]}