{"id":"eval-tch-grade-ai-writing-feedback","audience":"teachers","category":"evaluation","track":"evals","technique":"format","title":"Grade 4 AI feedback comments against your district's rules","free":false,"task":"You're spot-checking the AI writing coach's comments on student drafts. The district limit for next steps is 2, so a comment with 3 or more fails C2. Grade the 4 comments in exactly 4 numbered lines: '1. PASS' or '1. FAIL - C2 - \"exact words from the comment\"', naming the first criterion it fails. Plain text, under 90 words.","materialLabel":"The criteria and 4 AI comments (attached to your prompt automatically)","material":"Westbrook Middle - AI Writing Coach spot-check (Grade 7, personal narrative drafts)\n\nCRITERIA\nC1: Quotes at least a few of the student's own words when naming a strength.\nC2: Keeps next steps within the district limit.\nC3: Gives no grade, score or letter.\n\nCOMMENT 1 (Aiden)\n\"Your line 'the gym smelled like rubber and nerves' puts me right there. Next steps: show how you felt after the game, and cut the second paragraph's repeated idea.\"\n\nCOMMENT 2 (Mila)\n\"Your opening, 'Grandma's kitchen was always loud,' is a great hook. Next steps: add dialogue, slow down the ending, and fix comma splices.\"\n\nCOMMENT 3 (Jonah)\n\"Strong voice throughout! Next step: add one more detail about the trail.\"\n\nCOMMENT 4 (Priya)\n\"'I held the trophy like it might break' is a vivid image. Next step: explain why the moment mattered. This draft is a solid B.\"\n\nNote from the literacy coach: one line per comment please, I'm sharing these with the department.","rules":[{"type":"numberedItems","count":4},{"type":"plainText"},{"type":"maxWords","max":90}],"mistakes":[{"title":"Not giving the limit","why":"C2 just says 'the district limit', and the AI guesses a number or passes Comment 2.","fix":"Tell it: \"The limit is 2 next steps. 3 fails C2.\"","checks":["r0"]},{"title":"No evidence behind a FAIL","why":"The AI writes 'fails C1' without showing the words.","fix":"Say: \"Quote the exact words from the comment that fail it.\"","checks":["r1"]},{"title":"Rewrites instead of grades","why":"The AI suggests better comments instead of grading them.","fix":"Show the shape: \"2. FAIL - C2 - \\\"quote\\\"\", no rewrites.","checks":["r2","numberedItems"]},{"title":"Getting markdown back","why":"AI defaults to bold verdicts and a table.","fix":"Ask for \"plain text, no bold, no tables.\"","checks":["plainText","maxWords"]}],"promptHints":[{"label":"Shows the line shape","patterns":["FAIL - C","PASS","one line per"]},{"label":"Asks for a quote as evidence","patterns":["quote","exact words","evidence"]},{"label":"Gives the new limit","patterns":["\\b2 next steps|two next steps","limit","3 fails|three fails"]},{"label":"Says exactly how many","patterns":["\\b(4|four)\\b.{0,25}(line|comment)","exactly \\d+"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"When a rule changes, an AI grader keeps using the written one. Give the change, show the one-line shape, and ask for the quote behind each fail.","rubricLabels":["Grades Comment 1 PASS, Comment 2 FAIL on C2 (three next steps), Comment 3 FAIL on C1 (no quote from the student), and Comment 4 FAIL on C3 (gives a B)","Every FAIL line quotes exact words from that comment in quotation marks (for example \"add dialogue, slow down the ending, and fix comma splices\", \"Strong voice throughout!\" or \"a solid B\")","Each line uses only the shape 'N. PASS' or 'N. FAIL - Cx - \"quote\"' with no extra commentary, rewrites or summary"]}