Thumbnail for Know-It-All?: A Human-Calibrated LLM Benchmark for Cybersecurity Knowledge

At RSAC 2025 Conference, RSAC’s research team ran the largest-scale knowledge-based benchmarking study in the cybersecurity domain. We pitted humans against a battery of LLMs in a game we called “AI Showdown," and the LLMs won:

  • 279 cybersecurity professionals submitted 2,439 answers to our

Access the Full Resource

Get access to resources, exclusive research, RSA Conference sessions, webcasts, podcasts and more.

Create a Free Account

Already have an account?