What’s SCAM?

SCAM (Security Comprehension Awareness Measure) is an open-source benchmark by 1Password that tests whether AI agents can complete realistic workplace tasks without falling for embedded security threats like phishing, social engineering, and credential theft.

Below is a recorded evaluation. The agent was given a routine task with a threat hidden in the environment. Everything is sandboxed; no real credentials, emails, or systems were involved.