{"id":"cx-chat-transcript-qa-line-evidence","audience":"customer-support","category":"support-work","technique":"verification","track":"support","level":"advanced","title":"Score a chat against four criteria with line numbers as proof","free":false,"task":"Score the chat on the four criteria. Output a table with the header row exactly \"Criterion | Pass | Line\" and four rows. Pass is Yes or No. Line is the number of the line that proves it (like L4) or \"-\" if no line applies. Judge only what the transcript shows. Plain text, table only, under 100 words.","materialLabel":"Your material (attached to your prompt automatically)","material":"CRITERIA\n1. Greets the customer by name.\n2. Verifies identity with BOTH the old email and the last 4 digits of the phone number before changing an account.\n3. Gives a next step with a specific time.\n4. Never asks for a password.\n\nTRANSCRIPT (customer name on the account: Sam Okoye)\nL1 Customer: Hi, I need to change my email address.\nL2 Agent: Hello! How can I help today?\nL3 Customer: I want my email changed to sam@newmail.example\nL4 Agent: Sure Sam, I can do that. What's your old email?\nL5 Customer: sam.old@mail.example\nL6 Agent: Thanks. Done, it's updated.\nL7 Customer: Great, when will I get confirmation?\nL8 Agent: You should get it soon. Anything else?\n\nReviewer's draft: 'Verified identity: yes, the agent asked for the old email.'","rules":[{"type":"plainText"},{"type":"maxWords","max":100}],"mistakes":[{"title":"Accepting the reviewer's draft","why":"The draft says identity was verified; the AI agrees.","fix":"Say: \"Both items are required. Ignore the draft.\"","checks":["r1"]},{"title":"Missing the vague time","why":"The AI passes 'soon' as a next step.","fix":"Say: \"A specific time is required.\"","checks":["r2"]},{"title":"Wrong table","why":"The AI adds a comments column.","fix":"Give the exact header row.","checks":["r0"]},{"title":"Getting markdown back","why":"AI adds bold and headings by default, which show up as stray symbols where this is pasted.","fix":"Say \"plain text, no bold, no headings, no asterisks\".","checks":["plainText"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting and usually runs long, so a vague \"keep it short\" lands well over the limit.","fix":"Cap each part instead of the total, for example \"each line under 15 words\".","checks":["maxWords"]}],"promptHints":[{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]},{"label":"Sets a length limit","patterns":["\\d+\\s*words","word (limit|count)","under \\d+"]},{"label":"Gives the header","patterns":["criterion \\|","header"]},{"label":"Asks for line evidence","patterns":["line","l4","evidence"]}],"hint":"Scorecards need the definitions applied literally. Give the header, the evidence format, and a warning about a wrong draft.","rubricLabels":["The header row is exactly \"Criterion | Pass | Line\" with four rows and no text outside the table","Criterion 1 is Yes at L4, and criterion 2 is No because only the old email was asked (L4) and the phone digits never were","Criterion 3 is No at L8 (the word soon is not a time), and criterion 4 is Yes with a dash for the line"]}