Teaching models to forget: Selective unlearning with Amazon Nova | Amazon Web Services
Organizations deploying foundation models (FMs) often encounter a common challenge: model safeguards designed for content moderation can also prevent legitimate, business-critical use cases. A media company summarizing scripts with mature language, a cyber security firm simulating real-world threats, or a legal team processing sensitive evidence may all find that default content moderation controls deflect the very content they need to work with. For example, a security team asking the model to generate a sample phishing email for employee awareness training may receive a refusal, even though the intent is defensive.
Because the model learns these safeguards during post-training alignment, prompt engineering alone cannot overcome them. The model’s tendency to deflect is embedded in its parameters, requiring a targeted modification at the model level to selectively adjust this behavior. In this post, we introduce Reverse Direct Preference Optimization (rDPO), the novel unlearning technique behind Amazon Nova Customizable Content Moderation Settings...
Copyright of this story solely belongs to amazon.com. To see the full text click HERE
