AU-B-05Level 1 · Signal
Acts on AI output without validation
A risky Behavior signal from the pulse survey (SURVEY, pulse: AI output checking): this person reports using AI output in their work without checking it against a trusted source.
Classification
- Risk domain One of 9 areas of human risk, from social engineering to readiness and response. Every signal belongs to one.
- Evidence level
- Maturity practices One capability a program performs, scored on its own: See, Understand, Act, Prove, Govern and Culture.
- Leads to The kind of breach the evidence beneath it points toward, each anchored to a Verizon DBIR or VERIS pattern or an FBI IC3 category.
- NIST CSF 2.0
-
- GV.RM-05
- MITRE ATT&CK
-
None mapped
The definition, in detail
Definition
Errors in the output pass straight into decisions.
Example
A junior analyst says in the pulse that he pastes AI-generated regulatory summaries into client memos as they come, with no check against the regulation text.
How it is measured
- Source
- Pulse survey
- Subject
- Person
- Event
- Pulse: AI output checking
- Risk domain
- AI use
- Provenance
- Forrester
How it is used
Programs count "Acts on AI output without validation" per person from Pulse survey and read it beside the other AI use signals; it feeds 0 cohorts, 0 sequences and 1 breach scenario.
A "acts on AI output without validation" event is evidence of behavior under pressure. It is one observed action, and on its own it is no proof of compromise.
Library indicators
The detailed observations in the indicator library with the same risk domain, dimension and polarity as this signal.
- I.0103Copies enterprise data into personal AI chat tools
- I.0155Processes source code with unapproved AI services
- I.0164Visits websites categorized as AI tools
- I.0437Inputs secrets into AI prompts
- I.0438Submits enterprise data to unmanaged AI platforms
- I.0439Inputs proprietary code into AI tools
- I.0440Inputs customer PII into AI tools
- I.0441Inputs sensitive HR or legal content into AI tools
- I.0442Exposes sensitive prompts during live sessions
- I.0443Uses unapproved AI applications
- I.0444Uses personal AI accounts for work
- I.0445Authorizes AI use outside job scope
- I.0446Implements AI-generated code without validation
- I.0447Sends unverified AI responses to customers
- I.0448Uses AI to craft manipulative or misleading content
- I.0449Inputs third-party copyrighted content into AI
- I.0450Attempts to bypass AI safety controls
- I.0451Employs AI jailbreak techniques
- I.0452Probes AI models to extract training data
- I.0453Persists with unsafe AI prompting
- I.0454Deploys unvetted open-source AI models
- I.0455Disregards enterprise AI policies
- I.0456Accepts AI outputs without validation
Continue exploring
"Acts on AI output without validation" (AU-B-05), Human Risk Management Framework v2.0.0, Living Security, CC BY 4.0. https://www.humanriskmanagement.com/taxonomy/signals/au-b-05-acts-on-ai-output-without-validation
Part of the open HRM Taxonomy, CC BY 4.0. Download the taxonomy as JSON · Version history. This page describes one signal.
The initial assessment
Find your level.Then fix what matters.
18 questions, about 4 minutes and nothing to type before the result: your level, a score for each practice and three first playbooks, each Easy, Medium or Hard.