Z.ai and Concordia AI propose six stages for managing open-weight AI risk
Chinese AI company Z.ai and Beijing safety consultancy Concordia AI have published a framework for managing the risks of open-weight AI models. Anyone can download, modify and run the trained parameters of such models.
The two released the report on Monday, Chong Ming Lee reported for the South China Morning Post.
The report “provides the first comprehensive, evidence-based foundation for navigating these tensions” between openness and safety, its authors write.
Why open weights are different
The framework starts from three problems. A release is difficult or impossible to reverse. Fine-tuning can strip out safeguards. And once weights are out, developers can no longer monitor how people use the model.
“Safety training can be undone with a small number of harmful training examples,” the report says.
So the report focuses on measures that act before release, or that keep working after the weights are out. It lists training data curation...
Copyright of this story solely belongs to thenextweb.com. To see the full text click HERE
