{"id":"sec-tch-classroom-app-approval-check","audience":"teachers","category":"security","track":"security","technique":"verification","title":"Check AI advice about a classroom app against district rules","free":false,"task":"You asked a chatbot whether you can use a new quiz app with your class. Check each of its 4 claims against the district's app rules only. Write exactly 4 numbered lines starting 'Matches district rules', 'Conflicts with district rules' or 'Rules don't say', each with the rule number in parentheses right after the label, like '(R1)', when there is one. Plain text, under 90 words.","materialLabel":"Chatbot answer and district rules (attached to your prompt automatically)","material":"What the chatbot said:\n\"QuizBurst looks great for your class! Here's what to know:\n1. Since it's free, you don't need anyone's approval to use it.\n2. Have students sign up with their school email so you can track their scores.\n3. It's fine to upload your class roster with students' full names and birthdays to save time.\n4. QuizBurst is used by over 2 million teachers, so it's safe.\"\n\nLakeview District rules for classroom apps (2026):\nR1. Teachers may only use apps on the approved list, including free apps. New apps need approval from the district tech office (form takes about 2 weeks).\nR2. Students under 13 must not create accounts with personal information; use the class code feature or district sign-in.\nR3. Never upload student birthdays, addresses or ID numbers to any app. First names and initials are allowed in approved apps.\nR4. Check the approved list at apps.lakeview.example.edu.\n\nNote: QuizBurst is not on the approved list yet. My students are 11 and 12.","rules":[{"type":"numberedItems","count":4},{"type":"plainText"},{"type":"maxWords","max":90}],"mistakes":[{"title":"Grading by common sense","why":"The AI thinks free apps are usually fine and student emails are normal.","fix":"Say: \"Check only against the district rules.\"","checks":["r1"]},{"title":"No fixed labels","why":"The AI writes 'partly right' or 'be careful'.","fix":"Give the labels: \"Matches, Conflicts with, or Rules don't say.\"","checks":["r0"]},{"title":"Trusting popularity","why":"The AI accepts '2 million teachers' as a safety signal.","fix":"Add: \"Popularity isn't a district rule; label it by the rules only.\"","checks":["r1"]},{"title":"No rule numbers","why":"The AI explains the problem but doesn't say which rule, so you can't check it.","fix":"Ask: \"Put the rule number in parentheses after the label, like (R1).\"","checks":["r2"]},{"title":"A long answer","why":"The AI rewrites the advice into a guide.","fix":"Be exact: \"Exactly 4 numbered lines, one per claim.\"","checks":["numberedItems","maxWords"]},{"title":"Letting markdown in","why":"AI adds bold and headings by default, and in your notes they show up as stray symbols.","fix":"Add: \"Plain text only, no bold, no headings.\"","checks":["plainText"]}],"promptHints":[{"label":"Checks against district rules","patterns":["district","rules","only"]},{"label":"Gives the labels","patterns":["matches","conflicts","rules don'?t say"]},{"label":"Asks for rule numbers","patterns":["rule number","r\\d","cite"]},{"label":"Says exactly how many","patterns":["\\b4\\b.{0,25}(line|claim|item)","exactly (4|four)"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"A chatbot can't know your district's rules unless you make it check against them. Give it the rules as the only judge, with fixed labels.","rubricLabels":["Each line starts with exactly 'Matches district rules', 'Conflicts with district rules' or 'Rules don't say'","Claims 1, 2 and 3 are Conflicts with district rules, and claim 4 (2 million teachers) is not marked as matching","Lines 1 to 3 each give the rule number in parentheses right after the label, like 'Conflicts with district rules (R1):'"]}