Nvidia launches new AI safety program designed at stopping models escaping their sandboxes
- Nvidia response to "recent security incidents" by tightening restrictions on autonomous agents
- New software and hardware safeguards impose barriers if agents go rogue
- More than 100 customers have already agreed to work with the principles
Nvidia hasunveiled the new Open Agent Safety Platform designed to prevent autonomous AI agents from 'escaping' and acting beyond their established boundaries.
Following several recent alarming reports of AI-led attacks, the company admitted that safety should not just rely on safeguards built into AI models and applications, and that additional compute and hardware-level controls should also be used as more solid barriers.
"Recent security incidents have underscored the need to equip organizations with open, customizable tools," the company wrote in its announcement.
Nvidia adds even more layers of control for autonomous AI agents
The Open Agent Safety Platform consists of two key controls – OpenShell, which Nvidia describes as a software-based "secure runtime boundary," and...
Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE
