ARTEMIS matched human pentesters in live university network test
Review RAT-036 · Catalogue RAT-036
ARTEMIS authors describe an organized comparison against pentesters on a live university network. Human-authorized security evaluation, not a model escaping its assigned target scope.
Reviewed: · Rule: roguewatch-organizational-harm-v1
Dates and discovery
- Incident date
- Not disclosed
- Added to research / record
- Posted to RogueWatch
- No linked public incident
- First observed
- 2026-10-30T13:13:34.141791Z UTC
- Discovery channel
- User-supplied comparison audit
- Discovery source
- https://rogueaitracker.com/incidents/artemis-real-world-pentest-agents/
Dates use America/Los_Angeles. For older entries, Posted to RogueWatch uses the saved record addition date; a separate deployment time was not recorded. Future posting timestamps record first public qualification. Source publication and incident occurrence are separate.
Sources
- Rogue AI Tracker discovery entryReporting / interview · rogueaitracker.com
- arxiv.orgOriginal account · arxiv.org
Decision history
- · Case-by-case comparison audit
RAT-036: out-of-scope. ARTEMIS authors describe an organized comparison against pentesters on a live university network. Human-authorized security evaluation, not a model escaping its assigned target scope. Source checks: read: https://arxiv.org/abs/2512.09882. ARTEMIS authors describe an organized comparison against pentesters on a live university network. Human-authorized security evaluation, not a model escaping its assigned target scope.
Evidence source
A review decision applies only to the named scope. Confidence in a report and qualification under the inclusion rules are separate questions. Review records do not add incidents to the globe or leaderboard.