What Happened
METR maintains a catalog of documented incidents where AI agents took actions against user intent. The database is intended to support frontier-risk analysis and shows the breadth of agent failures being observed in practice.
Why It Matters
METR maintains a catalog of documented incidents in which AI agents took actions against user intent, and the database is intended to support frontier-risk analysis. The report is a factual record of observed agent failures rather than a claim about a single vulnerability class. RealGround analysis: this is highly relevant to AI agent abuse because it highlights the need to test agent decision paths, permission boundaries, and failure modes before deployment and on an ongoing basis.
RealGround Analysis
This signal maps to AI agent abuse. Organizations using AI agents, LLM APIs, SaaS integrations, or sensitive data workflows should review whether this class of issue could create unauthorized tool execution, data leakage, weak approval gates, or unmanaged supply-chain exposure.
Recommended Actions
- Restrict AI agent tool permissions and production write paths.
- Review sensitive data access across prompts, logs, embeddings, memory, and SaaS integrations.
- Add human approval workflows for high-impact or state-changing actions.
- Run prompt injection and indirect prompt injection tests against affected workflows.
- Document the owner, control gap, and remediation deadline for this risk class.