{"id":"res-tch-chatbot-lewis-clark-handout","audience":"teachers","category":"fact-checking","technique":"verification","title":"Check a chatbot's Lewis and Clark handout against your textbook","free":false,"task":"A chatbot wrote 6 facts for a Lewis and Clark handout for your 5th graders, and you want to check them against the class textbook before printing. You want exactly 6 numbered lines, one per fact, labeled Matches, Wrong, or Not in textbook, with the textbook's version after any Wrong label. Judge only by the textbook page, plain text, nothing else.","materialLabel":"The textbook page and the chatbot's handout facts (attached to your prompt automatically)","material":"TEXTBOOK - Our Nation's Story, Grade 5, p. 188\n\nIn 1803, the United States bought the Louisiana Territory from France. President Thomas Jefferson asked Meriwether Lewis and William Clark to explore it. Their group, called the Corps of Discovery, left from near St. Louis in May 1804. A Shoshone woman named Sacagawea joined them and helped as an interpreter. The group reached the Pacific Ocean in November 1805. They returned to St. Louis in September 1806, bringing maps and notes about plants and animals.\n\n-----\nCHATBOT HANDOUT FACTS\n1. The United States bought the Louisiana Territory from Spain in 1803.\n2. President Thomas Jefferson asked Lewis and Clark to explore it.\n3. The group was called the Corps of Discovery.\n4. They left from near St. Louis in May 1805.\n5. Sacagawea helped the group as an interpreter.\n6. York, Clark's enslaved servant, was part of the group.","rules":[{"type":"numberedItems","count":6},{"type":"plainText"}],"mistakes":[{"title":"Letting the AI use what it knows","why":"The AI knows York was on the trip and may mark it Matches, even though your textbook doesn't say so.","fix":"Say: \"Judge only by the textbook page.\"","checks":["r1"]},{"title":"No fixed labels","why":"The AI writes comments like 'mostly right', which don't tell you what to change.","fix":"Give them: \"Matches, Wrong, or Not in textbook.\"","checks":["r2"]},{"title":"Not asking for the right version","why":"A bare 'wrong' doesn't tell you what to print instead.","fix":"Add: \"After Wrong, give the textbook's version.\"","checks":["r0"]},{"title":"Not saying how many","why":"The AI decides the length itself and usually returns more lines, one per fact than you can use.","fix":"Be exact: \"exactly 6 numbered lines, one per fact.\"","checks":["numberedItems"]},{"title":"Getting markdown back","why":"AI defaults to bold labels and headings, which show up as stray symbols in your printed handout notes.","fix":"Ask for \"plain text, no bold, no headings.\"","checks":["plainText"]}],"promptHints":[{"label":"Gives exact labels","patterns":["matches","not in (the )?textbook","label"]},{"label":"Names the source","patterns":["only.{0,30}textbook","textbook.{0,20}(only|source|truth)","p\\.? ?188"]},{"label":"Asks for the textbook's version","patterns":["textbook('s)? (version|says)","correct (version|fact)","what the textbook says"]},{"label":"Says exactly how many","patterns":["\\b(6|six)\\b.{0,25}(line|fact)","exactly \\d+"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"Your handout should match what students read in class. Make the textbook the only judge, give exact labels, and ask for the textbook's wording when a fact is wrong.","rubricLabels":["Labels fact 1 Wrong (bought from France) and fact 4 Wrong (left in May 1804)","Labels facts 2, 3 and 5 Matches, and fact 6 (York) Not in textbook rather than Wrong or Matches","Outputs only the 6 labeled lines using Matches, Wrong or Not in textbook: no intro, no rewritten handout, no extra history"]}