{"id":"eval-hc-golden-answer-records-request","audience":"healthcare","category":"evaluation","track":"evals","technique":"context","title":"Write the golden answer for a clinic portal records question","free":false,"task":"You're the front-office lead building test cases for your clinic's patient-portal help bot, and this records question needs a golden answer. Since Nov 1, the $25 copy fee is waived for electronic copies (paper copies still cost $25). Write exactly 3 numbered lines: '1. Answer: ...', '2. Steps: ...' and '3. Cost: ...'. Use only the help page plus that change. Plain text, under 60 words.","materialLabel":"The test question and the portal help page (attached to your prompt automatically)","material":"TEST CASE #4 for the Fernhill Family Clinic portal help bot (admin questions only)\nPatient message: \"How do I get a copy of my visit records sent to my email? Is there a fee?\"\n\nPORTAL HELP PAGE: \"Requesting your records\" (updated in March)\n- Log in to the portal, go to Records > Request a copy, and choose electronic or paper.\n- Electronic copies arrive in your portal inbox within 3 business days. We don't send records by regular email for privacy.\n- Paper copies are mailed within 10 business days.\n- There is a $25 copy fee for each request.\n- For records from before 2018, call the front desk at 555-0190.\n\nTest-writing notes\n- The bot sometimes offers to \"email the records right now\", which it can't do.\n- Golden answers are the shortest complete correct answer we grade the bot against.","rules":[{"type":"numberedItems","count":3},{"type":"plainText"},{"type":"maxWords","max":60}],"mistakes":[{"title":"Using the old fee","why":"The help page still lists a $25 fee, and the AI doesn't know it's waived for electronic copies.","fix":"Tell it: \"Since Nov 1, electronic copies are free. Paper is still $25.\"","checks":["r2"]},{"title":"Promising email","why":"The patient asked for email, and the AI may say yes even though the clinic doesn't send records that way.","fix":"Add: \"Say records go to the portal inbox, not regular email.\"","checks":["r0"]},{"title":"No steps","why":"The AI says 'request through the portal' without the menu path.","fix":"Ask: \"Steps: the exact menu path from the help page.\"","checks":["r1"]},{"title":"A long reply","why":"The AI writes a paragraph that's hard to grade against.","fix":"Show the shape: \"1. Answer: 2. Steps: 3. Cost:\"","checks":["numberedItems","maxWords","plainText"]}],"promptHints":[{"label":"Gives the fee change","patterns":["waived|free","nov(ember)? 1","\\$25"]},{"label":"Shows the three-line shape","patterns":["answer:","steps:","cost:"]},{"label":"Handles the email request","patterns":["email","portal inbox","privacy"]},{"label":"Keeps to the help page","patterns":["only.{0,30}(help page|page|portal)"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"A golden answer has to match today's rules and what the clinic can actually do. Give the AI the fee change, show the exact shape, and make sure it answers the email part honestly.","rubricLabels":["Says records can't be sent by regular email and instead arrive in the portal inbox (within 3 business days)","The Steps line gives Records > Request a copy and choosing electronic","The Cost line says electronic copies are free (fee waived since Nov 1), and the answer doesn't say the $25 fee applies to the electronic copy"]}