{"id":"res-re-chatbot-school-zone-errors","audience":"real-estate","category":"fact-checking","technique":"verification","title":"Catch a chatbot's school zone mistakes before telling your buyer","free":false,"task":"Your buyers asked which schools serve a listing, and a chatbot answered. You want to check it against the district's boundary lookup before replying. You want only the errors, as numbered lines in the form \"Chatbot says X; district says Y\", under 50 words total, plain text. Use only the district lookup, skip lines that match, and don't rewrite the answer.","materialLabel":"The district boundary lookup and the chatbot's answer (attached to your prompt automatically)","material":"NORTHBROOK SCHOOL DISTRICT - BOUNDARY LOOKUP (2026-27 school year)\nAddress: 2210 Willow Bend Drive\n- Elementary (K-5): Maple Grove Elementary\n- Middle (6-8): Ridgeview Middle School\n- High (9-12): Northbrook High School\nNote: Boundaries were redrawn for 2026-27. Addresses east of Route 9, including Willow Bend Drive, moved from Lincoln Elementary to Maple Grove Elementary.\n\n-----\nCHATBOT ANSWER\n2210 Willow Bend Drive is zoned for Lincoln Elementary, Ridgeview Middle School and Northbrook High School. Lincoln Elementary is rated 9/10 and is a short walk away. The district also offers free busing to all three schools.","rules":[{"type":"maxWords","max":50},{"type":"plainText"}],"mistakes":[{"title":"Trusting old boundaries","why":"Chatbots often know older zoning, and won't notice a redraw unless you check the lookup.","fix":"Say: \"The 2026-27 district lookup is the only source of truth.\"","checks":["r0"]},{"title":"Flagging extras as errors","why":"The rating and busing claims aren't in the lookup, so they're unverified, not contradicted.","fix":"Add: \"Only list what the lookup contradicts.\"","checks":["r1"]},{"title":"Drafting the buyer reply","why":"The AI writes a message to your clients instead of a list of errors.","fix":"Say: \"Output only the error lines.\"","checks":["r2"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for a total word limit and it often lands 10-20% over.","fix":"Cap each line: \"each line under 14 words.\"","checks":["maxWords"]},{"title":"Getting markdown back","why":"AI defaults to bold labels and headings, which show up as stray symbols in your client notes.","fix":"Ask for \"plain text, no bold, no headings.\"","checks":["plainText"]}],"promptHints":[{"label":"Names the source of truth","patterns":["district.{0,30}(only|source|truth|lookup)","only.{0,30}(lookup|district)"]},{"label":"Asks for contradictions only","patterns":["contradict","only.{0,20}(error|mistake|wrong)","skip.{0,30}match"]},{"label":"Gives the line format","patterns":["chatbot says","district says","\\bX\\b.{0,20}\\bY\\b"]},{"label":"Sets a length limit","patterns":["\\d+\\s*words","one (short )?sentence","word (limit|count)"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"School zones change, and chatbots don't always know. Make the district lookup the judge and ask only for what it contradicts.","rubricLabels":["Flags the elementary school error (chatbot: Lincoln Elementary; district: Maple Grove Elementary after the 2026-27 boundary change)","Does not flag Ridgeview Middle or Northbrook High (they match), and does not label the rating, walking distance or busing claims as errors (the lookup doesn't cover them)","Outputs only numbered lines in the form 'Chatbot says X; district says Y': no intro, no rewritten answer, no advice to the buyers"]}