What we have learned applying formal methods to control AI agents
An intro to using formal methods to reason about permission changes in long-running AI agents.
In this post- we’ll dive into how permission review breaks at agent scale, and how to use the Z3 open source library to write a formal proof that a policy change proposed by an agent stays inside what you approved.
Why permission review breaks at agent scale
AI agents are becoming smarter, and the work we ask them to do is becoming increasingly autonomous. Today, many of us use small groups of agents t...
Read more at nvidia.github.io