Formula Predicts When AI Chatbots Are at Risk of Turning Bad

https://www.securityweek.com/wp-content/uploads/2025/05/AI-Hallucinations.jpg

Researchers from George Washington University have published a paper examining whether the time and cause of AI going rogue can be predicted; and if predicted, prevented.

Since 50% of the world’s population carry devices that can run personal AI companions with no internet connection and limited security, they focused their research here. The lack of cloud-based safety filters, real-time telemetry, live monitoring, or the ability to patch weights once deployed provides a good test bed for analyzing AI’s chat-style transformer behavior when left to its own devices.

If there is a tipping point, it will stem from the AI’s Attention head. This is the computational component that determines which earlier AI tokens are most relevant when processing the current token. The decision lays the foundation for the next token and so on until the chatbot has finished responding to the user’s prompt. The token is loosely, but not precisely, related...

Copyright of this story solely belongs to www.securityweek.com. To see the full text click HERE

Read more

https://cdn.mos.cms.futurecdn.net/VF4egKqqkKq5CbHhYxQi6U-1200-80.jpg

Anthropic tells investors Claude Mythos Preview got its AI running on AMD GPUs in ~3 days with “basically no human intervention”, vs. the usual 6-12 months

Featured Podcasts Big Technology Podcast: How Humans Will Work Alongside AI Agents — With Mike Cannon-Brookes The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Subscribe to Big Technology Podcast. Why Enterprise Sales Still Matters in the AI Era

https://image.cnbcfm.com/api/v1/image/108342704-1785438454346-dsc_2664.jpg?v=1785438632&w=1920&h=1080

Filing: Leopold Aschenbrenner's hedge fund Situational Awareness, after nearly blowing up, loaded back up on AI stocks at the end of Q3; all have since plunged

Featured Podcasts Big Technology Podcast: How Humans Will Work Alongside AI Agents — With Mike Cannon-Brookes The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Subscribe to Big Technology Podcast. Why Enterprise Sales Still Matters in the AI Era

https://static01.nyt.com/images/2026/11/16/multimedia/BIZ-MADISON-HUANG-1-01-cmjw/BIZ-MADISON-HUANG-1-01-cmjw-facebookJumbo.jpg

Sources: Jensen Huang's daughter remains in a senior Nvidia role; before Jensen Huang resigned, she was his de facto chief of staff with considerable authority

Featured Podcasts Big Technology Podcast: How Humans Will Work Alongside AI Agents — With Mike Cannon-Brookes The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Subscribe to Big Technology Podcast. Why Enterprise Sales Still Matters in the AI Era