Technical Blog: Strengthening AI Agent Hijacking Evaluations
Authored by the U.S. AI Safety Institute Technical Staff
Large AI models are increasingly used to power agentic systems, or “agents,” which can automate complex tasks on behalf of users. AI agents could have a wide range of potential benefits, such as automating scientific research or serving as personal assistants. However, to fully realize the potential of AI agents, it is essential to identify and measure — in order to ultimately mitigate — the security risks these systems could introduce.Cur...
Read more at nist.gov