Cisco tried using AI to write security incident reports — and things didn't really go as planned
- Cisco warns AI‑generated incident reports are often inaccurate, inconsistent, and prone to data loss due to LLM limitations
- The company advises granular, single‑task prompts, fixed source documents, and strict formatting rules to improve reliability
- Cross‑contamination between reports remains a challenge, with researchers recommending fresh sessions for each new incident report to avoid errors
Any companies looking to utilize AI tools for their security reporting may want to read a new report from Cisco outlining its experience using AI-generated incident reporting.
The company has warned those using AI to create long-form technical content should expect “significant inaccuracies, unusual conclusions, and inconsistent writing styles,” mostly because of the probability-driven nature of Large Language Models (LLM).
“These models generate output by predicting the next token, typically a word or sub-word, in a sequence, based on model weights and training data,” Cisco says or, as The Register puts it, “they’re essentially a fancy autocomplete...
Copyright of this story solely belongs to techradar.com. To see the full text click HERE
