Automated Reasoning policy refinement in Amazon Bedrock | Amazon Web Services
Refining an Automated Reasoning policy in Amazon Bedrock has been a manual cycle of diagnose, hand-edit, retest, and repeat. Today, we are announcing automatic policy refinement, which automates the diagnose-and-fix work in that cycle. The refinement engine diagnoses failing tests and proposes formal-logic fixes. You approve every change before it takes effect.
Automated Reasoning checks in Amazon Bedrock Guardrails use formal verification to prove answer correctness. On unambiguous translations from natural language to formal logic, they deliver up to 99% verification accuracy, as reported in the GA announcement. To get started, you build an Automated Reasoning policy from a source document and validate it with test cases. Customers told us that this iterative tuning creates the biggest friction point in policy development.
In this post, we walk through two new refinement modes: Iterative Refinement for rule issues, and Ambiguous Variable Refinementfor language issues. For each mode, we show...
Copyright of this story solely belongs to amazon.com. To see the full text click HERE