Library › Cybersecurity AI › IT and security teams

Fact-check an AI-written incident summary against the log

  • For IT and security teams
  • You practice Catching mistakes and made-up facts
  • Time about 5 minutes

About this exercise

A coworker used AI to write the incident summary below. Check each of its 5 sentences against the incident log only, as exactly 5 numbered lines: first the log time(s) and a short reason, then the label at the end, 'Supported', 'Contradicted' or 'Not in log'. Plain text, under 100 words.

Common mistakes when you ask AI for this

  • Skimming instead of checking. The AI says 'mostly accurate' and misses the detection time and the download claim. Try: Say: "Check each sentence against the log, one line each."
  • No fixed labels. The AI writes 'partly true' or 'needs review'. Try: Give the labels and put them last: "reason, then Supported, Contradicted or Not in log."
  • No proof. Without log times, nobody can check the check. Try: Ask: "Cite the log time on each line."
  • Trusting the AI to count words. AI is bad at counting. Ask for "under 100 words" and it often lands well over. Try: Ask for less than the limit and cap each line: "each line under 15 words, under 75 words total."
  • Letting markdown in. AI adds bold and headings by default, and in your reply to Jun they show up as stray symbols. Try: Add: "Plain text only, no bold, no headings."

What a strong prompt includes

  • Checks against the log
  • Gives the labels
  • Asks for log times
  • Says exactly how many
  • Asks for plain text

Practice this now ↑

Related exercises