{"id":"job-company-factcheck","audience":"job-seekers","category":"fact-checking","technique":"verification","title":"Check a chatbot's company facts before your interview","free":false,"task":"Before your interview at Greenleaf Community Credit Union, a chatbot gave you 5 \"facts\" about the company. Check each one against the company's own About page only: exactly 5 numbered lines, each starting with Confirmed, Wrong, or Not on page, then a short reason. Keep it under 110 words, plain text, with no intro or advice. Write a prompt that gets you exactly that.","materialLabel":"The chatbot's answer and the About page (attached to your prompt automatically)","material":"WHAT THE CHATBOT SAID:\nHere are 5 key facts about Greenleaf Community Credit Union:\n1. It was founded in 1998 in Tacoma, Washington.\n2. It has 14 branches across Pierce County.\n3. Its CEO is Linda Park.\n4. It won a \"Best Place to Work\" award in 2023.\n5. It offers free money classes for teens.\n\nGREENLEAF ABOUT PAGE (copied from their website):\nWho we are\nGreenleaf Community Credit Union was started in 1987 by a group of Tacoma school teachers who wanted a fair place to save. Today we serve more than 60,000 members through 14 branches in Pierce County and our mobile app.\n\nOur leadership\nMarcus Obi became CEO in 2021. He follows Linda Park, who led Greenleaf from 2009 to 2021 and now chairs our community foundation.\n\nGiving back\nOur \"Money Moves\" workshops teach budgeting and saving to teens ages 13-18, free of charge, at every branch. Each year our staff volunteer more than 5,000 hours with local schools and food banks.\n\nCareers\nWe're hiring for member service and lending roles. We offer tuition help, 4 weeks of PTO, and a pension plan.","rules":[{"type":"numberedItems","count":5},{"type":"maxWords","max":110},{"type":"plainText"}],"mistakes":[{"title":"Asking \"is this accurate?\"","why":"The AI answers from its own memory, which may be just as wrong as the chatbot you're checking.","fix":"Add: \"Check each claim only against the About page below.\"","checks":["r2"]},{"title":"No label for \"can't tell\"","why":"Left to itself, the AI writes its own verdicts (\"True\", \"Partly accurate\") and calls the award claim false, or true, when the page just doesn't mention it.","fix":"Give three exact labels to start each line: \"Confirmed, Wrong, or Not on page.\"","checks":["r1"]},{"title":"Missing the half-true claim","why":"Linda Park really was CEO, so a quick read passes claim 3. The page says she left in 2021.","fix":"Add: \"For Wrong, give the correct fact from the page.\"","checks":["r0"]},{"title":"Trusting the AI to count words","why":"AI is bad at counting. Ask for \"under 110 words\" and it often lands well over.","fix":"Cap each part instead, like \"each line under 15 words,\" so the total lands near 85.","checks":["maxWords"]},{"title":"Getting a report back","why":"AI wraps the check in a heading, bold labels, and a paragraph of interview tips.","fix":"Be exact: \"Exactly 5 numbered lines, plain text, no intro or advice.\"","checks":["numberedItems","plainText","r2"]}],"promptHints":[{"label":"Checks only against the page","patterns":["only.{0,25}(about|page|source)","against the (about )?page","no outside"]},{"label":"Gives clear labels","patterns":["confirmed","not on page","can'?t (tell|verify)","not (mentioned|stated)"]},{"label":"Says how many lines","patterns":["\\b(5|five)\\b.{0,20}(lines|numbered|items|claims)"]},{"label":"Sets a size limit","patterns":["\\d+\\s*words","word (limit|count)","under \\d+"]},{"label":"Asks for plain text","patterns":["plain","no bold","no markdown","no formatting","no headings"]}],"hint":"Asking an AI whether another AI was right just swaps one guess for another. Make it check against the page you trust, give it three labels, and say what shape you want back.","rubricLabels":["Marks claim 1 (founded 1998) as Wrong because the page says 1987, and claim 3 (CEO Linda Park) as Wrong because the page says Marcus Obi has been CEO since 2021","Every line starts with one of the exact labels Confirmed, Wrong, or Not on page, and claims 2 (14 branches) and 5 (free teen classes) are Confirmed while claim 4 (the 2023 award) is Not on page","Uses only the About page as evidence: adds no outside facts about Greenleaf, and has no intro, summary, or interview advice around the 5 lines"]}