Preprint
Article

This version is not peer-reviewed.

Agentic AI for Cyber Defense: A Survey of Failure Modes, Applications, and Research Opportunities

Submitted:

12 August 2026

Posted:

13 August 2026

You are already at the latest version

Abstract
Modern agentic systems that plan, reason, invoke tools, and self-reflect offer a promising path to autonomous cyber defense and SOC analyst augmentation. Yet this same autonomy introduces novel failure modes and attack surfaces absent from traditional security pipelines. Despite rapid adoption, prior surveys remain fragmented: addressing agentic safety domain-agnostically, focusing on offensive use, or examining pre-agentic LLM-based defense in isolation, leaving the field without a structured, defense-focused framework integrating failure characterization, operational lifecycle mapping, and compliance alignment. This survey closes that gap through four analytical artefacts: a four-category failure taxonomy (natural, system, adversarial, compliance) spanning 22 subcategories and 94 failure modes with mitigations; a decomposition of defensive cybersecurity into 13 tasks classified by autonomy level, oversight regime, and failure exposure; a review of 22 research systems and 10 commercial offerings across five operational categories; and a catalogue of 20 governance gaps mapped to GDPR, EU AI Act, NIST AI RMF, ISO 42001, and sector-specific frameworks. We argue the autonomy ceiling is bounded asymmetrically, not by reasoning capability but by action irreversibility, mitigation maturity, and compliance envelope, and consolidate open challenges into eight research directions.
Keywords: 
;  ;  ;  ;  

1. Introduction

Perpetual co-evolution of cyber threats and defenses ensures that no security posture remains sufficient indefinitely. Cyberthreat landscape has undergone a significant transformation in recent years. From highly targeted Advanced Persistent Threats (APTs) [89] to autonomous botnets and ransomware campaigns [88], cyberattacks have become increasingly adaptive, scalable, and context-aware. While symbolic automation through signature-based detection and Machine Learning (ML) classifiers has advanced, defensive workflows remain predominantly reactive and reliant on continuous human decision-making. This burden falls disproportionately on analysts working in Security Operations Centers (SOCs), who must filter through enormous volumes of alerts, logs, and indicators to triage, analyze, and respond in real time. Operational asymmetry is stark: attackers traverse networks under 30 minutes [77], yet SOC teams require a reported mean of 181 days to identify and an additional 60 days to contain a breach [132]. This gap is compounded by alert fatigue, knowledge fragmentation across disconnected tools and memory, and analyst expertise [7].
This imbalance exposes a fundamental limitation of current cybersecurity operations: the absence of adaptive, goal-driven intelligence that can reason across heterogeneous knowledge sources and formulate multi-step response strategies autonomously to assist SOC analysts [86]. Agentic AI, a category of intelligent systems that exhibit autonomy through perception, planning, acting, and self-reflection, has emerged as a promising paradigm for addressing this gap [1]. Unlike narrow AI, modern agentic systems, often powered by LLMs, operate autonomously and are capable of perceiving context, formulating strategies, invoking external tools, and revising behavior based on feedback. These capabilities directly support critical SOC functionality, including alert triage, threat correlation, vulnerability remediation, and response generation [52]. Reflecting this, Gartner’s Predicts 2025 report forecasts that agentic AI will improve SOC efficiency by 40% by 2026 relative to 2024, while concluding that fully autonomous SOC remains unlikely [37].
While this autonomy enables adaptive defense, it simultaneously introduces substantial risks, including hallucinations, adversarial exploitation, and limited explainability [87]. These risks are amplified in the cybersecurity context, especially when agents manage production systems and interact with external sources under little human oversight, thereby considerably expanding the attack surface [64,98]. Reflecting these concerns, a KPMG survey of UK technology leaders found that half of corporate boards identified cybersecurity as a significant barrier to adopting generative or agentic AI [63]. With regular developments, the literature on agentic AI for cybersecurity remains fragmented. Prior work broadly addresses AI in cybersecurity [5,46], focusing predominantly on ML classifiers or generative models [44,126], while treating agentic systems as a peripheral topic rather than a distinct paradigm with unique architectural, operational, and risk characteristics. Recently, researchers have begun to examine agentic AI in cybersecurity [2,65,67,137], and domain-agnostic surveys have advanced threat taxonomies for modern LLM-powered agents [20,42,47,118,130]. However, no existing survey structurally maps agentic AI to the defensive cybersecurity operations lifecycle, classifies failure modes across causal categories, addresses compliance implications, or bridges the gap between academic research and industry practice in a unified manner. To address these gaps, we ask the following Research Questions (RQ):
Preprints 227964 i001
The rest of this paper is organized as follows: Section 2 describes our survey methodology. Section 3 positions this work relative to existing literature. Section 4 defines agentic AI capabilities and introduces a failure taxonomy and possible mitigation. Section 5 characterizes defensive cybersecurity operations and identifies entry points for agentic automation. Section 6 reviews applied research organized by operational lifecycle tasks. Section 7 reviews commercial offerings based on operational lifecycle tasks with research–practice relations. Section 8 examines the implications of compliance failure. Section 9 identifies challenges and research directions before concluding.

2. Survey Methodology

Given the nascent and rapidly evolving agentic AI landscape, where terminology and reference frameworks remain unstandardized, this survey adopts a structured literature decomposition approach. Our coverage is organized around the major research trajectories shaping the field, with representative works selected from each. Sources include scholarly databases, industry white papers, documentation, and standards-body technical reports. Industry sources are included as significant cybersecurity developments often originate in commercial deployments rather than controlled testbeds. We include brief contextual primers at the beginning of each section to present definitions, reference frameworks, and standards upon their first use, ensuring narrative continuity and avoiding redundancy. Figure 1 presents the survey methodology and section navigation to support reader orientation and illustrate the logical decomposition.

4. Agentic AI: Capabilities, Failure Modes, and Mitigations

This section defines agentic AI and its capabilities, and introduces a four-category domain-agnostic failure taxonomy: three causal axes (natural, system, adversarial) examined here in detail, and a regulatory consequence axis (compliance) that we summarize here and discuss in depth in Section 8, after regulated deployment contexts are established in Section 6 and Section 7. We integrate research-backed mitigation strategies and align each with operational compliance frameworks.

4.1. Capabilities and Lifecycle

Agentic AI refers to autonomous systems that demonstrate goal-oriented behavior through perception, reasoning-based planning, and action within dynamic environments while utilizing memory [1]. Architecturally, modern agents extend a Large Language Model (LLM) that serves as the reasoning core, augmenting it with memory, tool interfaces, and orchestration logic that enable persistent state, external action, and feedback-driven revision. These systems operate in single- or multi-agent system (MAS) architectures, where specialized agents collaborate to achieve complex goals. As illustrated in Figure 2(A), agentic AI systems follow a dynamic, iterative lifecycle composed of five phases (each representing a core operational capability) that loop back from reflection to perception upon error detection [52,121,149].
Preprints 227964 i002
These capabilities collectively enable agentic systems to handle tasks that are multi-step, tool-dependent, context-sensitive, and require adaptive reasoning, as well as non-deterministic functionalities that cannot be achieved through static automation. In MAS configurations, agents apply these capabilities to specialized roles coordinated through task delegation, enabling complex workflows that would otherwise require manual coordination across specialists. The degree to which these capabilities are exercised varies across deployments. Some systems invoke only a single inference step, while others execute long, autonomous loops with extensive tool use. Table 2 captures this spectrum across four autonomy levels (0–3), distinguishing systems by how predictably their execution paths can be enumerated.

4.2. Failure Taxonomy

Deploying MAS reliably requires addressing failures, which we define as any deviation from intended behavior, safety constraints, or operational requirements that arises during the lifecycle phases. Kumar et al. [123], in a joint effort between Microsoft and the Berkman Klein Center, established a foundational two-category taxonomy that classifies ML failures as either intentional (caused by an active adversary) or unintentional (produced by inherent system limitations). This binary distinction provided a common vocabulary across engineering, policy, and legal communities, but also conflates two fundamentally different causal origins within “unintentional”: natural failures inherent to the underlying model limitations (e.g., hallucination, reasoning degradation) and systemic failures attributable to engineering design and deployment decisions (e.g., poor orchestration, insufficient verification), each demanding different mitigation strategies and different accountable stakeholders. Furthermore, Cemri et al. [16] analyzed over 1,600 multi-agent execution traces to produce the MAS Failure Taxonomy (MAST), identifying 14 failure modes clustered into specification and design issues, inter-agent misalignment, and task verification failures. Critically, specification and coordination deficiencies, not underlying model capability, account for the majority of observed failures, confirming that preventable engineering choices dominate system reliability and warrant a distinct causal category. Building on these foundations and drawing from the OWASP [33], Microsoft’s AI failure-mode taxonomy [83], and domain-specific failure analyses, we develop a four-category failure taxonomy: three causal (natural, system, adversarial) spanning 18 sub-categories and 72 modes, and a regulatory consequence axis (compliance) with 4 sub-categories and 20 modes. The full taxonomy is illustrated in Figure 2(B–C); compliance is detailed in Section 8 after deployment scope establishment.
Preprints 227964 i003
This taxonomy splits “unintentional” category into Natural failures (architectural limitation) and System failures (engineering problem), while their “intentional” category becomes Adversarial failures (security problem). Co-manifestation is common in practice; for example, a natural hallucination may be indistinguishable from an adversary-induced one. The taxonomy resolves this by classifying by causal origin, not by observable symptoms. Compliance failures sit on a separate axis and cannot manifest until deployment within a regulated scope, so we defer them to Section 8 after cyberops research and practices are established. The following three subsections examine each causal category in detail across the 18 sub-categories and 72 failure modes ([4, 16] natural, [8, 31] system, and [6, 25] adversarial).

4.2.1. Natural Failures

We organize 16 natural failure modes under four sub-categories based on their causal origin. This classification incorporates key aspects such as data, training, input [50,56], model decomposition [71], and context handling [74]. Refining these for MAS deployments, we identify 4 sub-categories of natural failure: the model itself (reasoning limitations), its learned knowledge (data and knowledge gaps), the input interface (inference errors), and the architecture limitations (context constraints). Figure 3 visualizes the resulting architecture-to-lifecycle mapping for downstream impact and mitigation analysis; Table 3 catalogs each mode, its impacted lifecycle phase with description.
Security Implications: First, agentic perception and planning limitations warrant research attention, as reasoning is the key driver of agent effectiveness and has been most extensively demonstrated across numerous studies [50,56,71]. The severity of their consequences differs between regular inference and MAS settings: a hallucination in regular inference can be mere noise, whereas a hallucinated tool call can trigger irreversible real-world action [104]. In agentic contexts, hallucination is therefore unacceptable and is a threat to integrity instead of being within acceptable threshold.
Second, the four sub-categories differ in their proximity to mitigation. Data and knowledge limitations, as well as context constraints, are partially addressed through retrieval-augmented generation (RAG) [69], hierarchical memory [45], and context management pipelines [74], even though the underlying limitations persist. Reasoning limitations and input quality failures, by contrast, manifest at architectural layers where mitigation is harder: calibration [145], non-determinism [60], and ambiguity resolution [16] are all directly impacted by model training/fine-tuning or design.
Third, the cluster in Figure 3 reveals an asymmetric distribution across lifecycle phases. Perception is affected by all four limitation sources because it is the boundary at which both inputs and learned knowledge are first invoked. Memory is affected exclusively by context architecture, since natural failures in memory mechanisms are inseparable from the context window and attention mechanism that govern them. Planning appears in 11 of 16 modes, the most of any phase, because reasoning, retrieval, and contextual integration all converge during plan construction. Reflection inherits errors from upstream phases but rarely originates new natural failures.

4.2.2. System Failures

This arises from wrong design decisions, not from inherent model limitations, and are preventable through better engineering. We organize 31 failure modes following Microsoft AIRT [83] into eight sub-categories, as summarized in Table 4. Figure 4 maps each agentic lifecycle phase to the engineering deficiency that originates there.
Second, system failures originate at design time but manifest at runtime, often several lifecycle phases removed from the design decision that caused them. Specification ambiguity ([fm:S.1.3]S.1.3) surfaces as planning-phase oscillation; over-permissive role definitions ([fm:S.7.1]S.7.1) surface as unauthorized tool actions; missing circuit-breakers ([fm:S.2.4]S.2.4) surface as cascading multi-agent failures [33]. This origin-consequence gap is most pronounced for tool and memory surfaces, both of which aggregate state across the entire lifecycle and propagate defects far from their introduction point. Third, the failure surface expands sharply in multi-agent topologies. All 31 modes are applicable to multi-agent deployments, primarily concentrated in workflow orchestration ([fm:S.2]S.2) and inter-agent coordination ([fm:S.3]S.3). A single agent cannot ignore peer outputs, drift from shared objectives, or deadlock on inter-agent dependencies; these failures are topology-induced [16,119]. Every agent-to-agent/tool interaction in a MAS constitutes an implicit trust assumption [87].
Fourth, the lifecycle distribution differs structurally from natural failures. Natural failures concentrate at Perception and Planning; system failures concentrate at Planning, Action, and Reflection, where tool integration, access control, and output handling manifest. Hence, controls aimed at perception will fail to address system failures, and controls at integration layers (tool invocations, state transitions) will fail to address natural failures. The two categories require mitigation through largely disjoint channels [129,138].
Fifth, system failures cascade across sub-categories. A schema mismatch ([fm:S.4.2]S.4.2) produces incorrect output parsing ([fm:S.4.3]S.4.3), which corrupts memory ([fm:S.5.1]S.5.1), which in turn drives subsequent decisions based on stale state ([fm:S.5.2]S.5.2). In MAS settings, coordination failures ([fm:S.3]S.3) propagate through orchestration ([fm:S.2]S.2) into cross-agent state collusion ([fm:S.3.3]S.3.3) or inconsistency ([fm:S.5.4]S.5.4). MAST documents these chains empirically [16]; treating modes in isolation underestimates the actual fault surface, since breakdowns typically involve multi-mode chains rather than single-mode failures [115,129].

4.2.3. Adversarial Failures

This results from intentional exploitation by an active adversary seeking to subvert agent behavior for malicious purposes. We organize 25 modes into 6 sub-categories, as summarized in Table 5. Figure 5 maps each sub-category to the NIST Gen. AI 100 [100], showing which agentic lifecycle phases it targets.
Threat model: We consider a capability-tiered threat model spanning four independent capability dimensions, each mapped to a distinct attack surface. Black-box query access (tier-1) limits the adversary to the agent’s public input interface, where they craft prompts or provide manipulated content ingested during normal operation. Data channel access (tier-2) allows the adversary to inject or modify content in external sources the agent retrieves, including knowledge bases, RAG corpora, vector stores, and persistent memory. Tool and environment access (tier-3) enables compromise of tools, plugins, third-party servers, or environmental inputs such as file systems and API responses. Multi-agent access (tier-4) permits the adversary to compromise, impersonate, or inject agents within a multi-agent architecture, exploiting trust relationships and communication channels. Output and access exploitation and resource attacks are consequences achievable at any of the four access tiers rather than independent levels. The defender’s objective across all categories is to maintain secure operations by upholding the four NIST GenAI security properties.
Security Implications: Five observations emerge from this organization, each grounded in the capability-tiered threat model. First, adversarial failures have the strongest quantitative evidence base of the three causal categories, with published attacks reporting concrete success rates at every access tier: HOUYI compromised 31 of 36 production applications at the black-box tier [76]; AgentPoison achieved over 80% retrieval success at under 0.1% poisoning rate at the data-channel tier [17,151]; McHugh et al. [80] demonstrated hybrid XSS/CSRF injection at the tool tier; and Lee et al. [68] showed self-propagating prompt infection at the multi-agent tier. These rates establish that adversarial failures are reproducible at high confidence against production systems across all four access levels.
Second, attack persistence and stealth increase with adversary access and capabilities. Black-box attacks (tier-1) are visible in input logs and require per-session re-injection. Data-channel attacks (tier-2) persist in retrieval corpora and activate repeatedly without attacker presence; AgentPoison [17] and BadAgent [142] both demonstrate dormant payloads that survive across sessions. Tool and environment attacks (tier-3) operate below the agent’s reasoning layer, injecting false observations that the agent cannot distinguish from legitimate responses [49]. Multi-agent attacks (tier-4) exploit established trust relationships, making malicious messages indistinguishable from legitimate peer coordination [83,134]. The security implication is that higher-tier attacks require fundamentally different detection strategies: input filtering suffices for tier-1, tier-2 and tier-3 require provenance verification, tool-output validation, but tier-4 requires authenticated integration layer such as inter-agent communication validator or consensus channels due to adversary possessing insider threat characteristics.
Third, indirect attack vectors dominate the agentic threat surface. Standalone LLM safety research has historically focused on direct jailbreaks (tier 1) [105,150], but agentic deployments expose a wider indirect surface across tiers 2–4: retrieved documents, tool outputs, peer-agent messages, and persistent memory all accept external content that the agent treats as trusted. Greshake et al. [41] established the foundational XPIA taxonomy; Microsoft AIRT identifies indirect injection as the most significant agentic failure mode [83]. The lifecycle distribution confirms this: Perception is the entry point for 7 of the 25 modes because it is the phase where untrusted external content enters the reasoning loop.
Fourth, 6 of the 25 modes are exclusive to multi-agent deployments (tier-4), mirroring the topology-induced expansion observed for system failures (10 of 31 modes in Section 4.2.2). The security implication differs qualitatively: system-failure expansion introduces unintentional breakdowns, whereas adversarial expansion introduces exploitable trust surfaces. Lee et al. [68] demonstrated that prompt infection self-propagates via logistic growth, with stronger models becoming more effective vectors once compromised. Inter-agent trust thus becomes a lateral-movement channel; every unverified agent-to-agent interaction constitutes an implicit trust assumption exploitable at this tier [55,87].
Fifth, the two consequence categories, output/access exploitation ([fm:A.5]A.5) and resource attacks ([fm:A.6]A.6), are reachable from any access tiers rather than requiring a specific entry point. A black-box injection can exfiltrate data just as a compromised tool can; a data-channel poison can trigger unbounded consumption just as a multi-agent jailbreak can. This tier-independence means the consequence categories threaten all four NIST GenAI properties simultaneously: integrity (corrupted reasoning), privacy (data exfiltration), availability (resource exhaustion), and resistance to misuse (unauthorized action execution). Defending against consequences alone is thus insufficient without controlling each tier independently. Compounding this, adversarial campaigns routinely chain tiers: a tier-1 prompt injection can seed tier-2 memory poisoning that activates tier-3 tool actions, with each transition inheriting trust from the prior [83,134]. Tier-wise hardening must protect against both initial compromise and payload propagation from lower tiers.

4.3. Mitigation Strategies and Compliance Alignment

The preceding sections (Section 4.2.1, Section 4.2.2 and Section 4.2.3) catalog what can go wrong; we now address how to prevent it. Furthermore, a mitigation must also be compliant with authorized standards. Table 6 maps each of the 18 causal failure modes to mitigation strategies and aligns each with operational compliance frameworks: NIST AI RMF [93], NIST SP 800-207 Zero Trust Architecture [113], ISO/IEC 27001 [53], ISO/IEC 42001 [54], SOC 2 [4], GDPR [31], and the EU AI Act [32]. Natural-failure mitigations are probabilistic (reducing but not eliminating inherent limitations), while system and adversarial mitigations admit deterministic controls auditable against compliance baselines. The defense-in-depth principle endorsed by NIST, OWASP, and Microsoft AIRT requires that at least two complementary controls cover each sub-category. Hence, no single mitigation addresses any sub-category in isolation. As system failures cascade across sub-categories (Section 4.2.2) and adversarial campaigns chain across access tiers (Section 4.2.3), the listed controls must function compositionally: hardening one sub-category in isolation leaves adjacent sub-categories as exploit pivots. We considered answers to RQ-1 while formulating persistent challenges and proposing future research (Section 9).
Preprints 227964 i004

5. Defensive Cybersecurity Operations: Lifecycle, Task Categorization, and Automation

Defensive cybersecurity operations comprise the continuous and structured processes through which organizations monitor, detect, investigate, and neutralize threats to their digital infrastructure [96,133]. These operations are typically centralized within SOCs, where analysts work across heterogeneous tool-chains, solutions, and threat intelligence feeds [61]. Identifying where agentic systems can intervene effectively requires a principled characterization of the operations lifecycle and its constituent tasks. Hence, structured alignment determines where automation is tractable and where deployment risks are concentrated. This section establishes that alignment in three steps. Section 5.1 defines a simplified defensive cybersecurity lifecycle grounded in established frameworks [22,131]. Section 5.2 decomposes the lifecycle into 13 disjoint operational tasks classified by cognitive demand and automation feasibility. Section 5.3 maps each task to agentic capabilities and human oversight level from Section 4.1, the dominant failure exposures from Section 4.2.1, Section 4.2.2 and Section 4.2.3, establishing the automation scope with mitigation from Section 4.3. This approach leads to the identification of agentic cyberdefense use cases in Section 6.

5.1. Defensive Cybersecurity Operations (CyberOps) Lifecycle

Defensive cybersecurity operations are the sequence of activities through which an organization detects, investigates, responds to, and learns from security incidents [22]. We adopt a simplified three-phase lifecycle (Detection, Analysis, and Eradication) grounded in NIST SP 800 [22] and operationalized through MITRE D3FEND [131], and the NIST CSF 2.0 [94]. These frameworks specify finer-grained taxonomies, suited to control-level mapping and audit. We consolidate at the activity level to keep our focus on where agentic AI integrates rather than on operational sub-decomposition. Knowledge sharing is a cross-cutting feedback and recovery mechanism rather than a discrete phase, reflecting its continuous operation across stages as new findings, updates, and policies propagate back into detection modules, threat repositories, and configurations. Figure 6 illustrates this structure in a simplified yet detailed manner.
Preprints 227964 i005
The defensive cybersecurity operations lifecycle is inherently iterative rather than linear. A single incident commonly cycles between Analysis and Detection as containment actions in the Eradication phase surface new indicators, while Knowledge Sharing outputs (refined detection rules, updated playbooks, and enriched CTI feeds) directly modify Detection thresholds for subsequent incidents. This iterative, stateful character distinguishes defensive cyber operations from tasks amenable to static, single-pass automation, and it establishes the fundamental case for agentic systems capable of maintaining coherent state across phases and adapting behavior in response to novel evidence.

5.2. Task Categorization Framework

Effective multi-agent system integration into the existing cyberops lifecycle requires decomposing discrete operational tasks and characterizing each input-output structure in terms of its cognitive demands and automation feasibility. We categorize tasks along two dimensions to facilitate better alignment of automation in (Section 5.3). First is cognitive demand, from Rasmussen’s skill-rule-knowledge taxonomy of human performance [108]. Mechanical tasks are high-volume, deterministic, rule-based, without ambiguity, making them amenable to direct automation with minimal reasoning overhead. Cognitive tasks are reasoning-intensive, context-dependent, and require multi-step inference or domain judgment that cannot be reduced to symbolic enforcement. Composite tasks combine mechanical execution with cognitive judgment, requiring systems that can both act through tool invocation and reason over the results.
Second is automation feasibility, from Parasuraman et al. [103], which links automation level to consequence severity, reversibility, and required human oversight. High indicates that agentic systems can perform the task with minimal human oversight. Moderate indicates that agentic assistance substantially reduces cognitive burden, but human validation of consequential outputs remains appropriate given current limitations. Low indicates that agentic systems can augment but not replace human judgment, and human-in-the-loop control is mandatory. Low designation reflects the severity and accountability of consequences rather than computational intractability: the cost of an agentic failure (Section 4.2) in these tasks is critical or irreversible. Table 7 presents the resulting categorization.
We derive the task set by decomposing each phase against the activity categories of NIST SP 800-61, NIST CSF 2.0, and MITRE D3FEND, with each of the 13 tasks mapping to a distinct named activity cluster in at least one framework. Tasks are consolidated by analytical function: for example, root cause analysis (RCA) ([task:T-6]T-6) subsumes log querying, forensic artifact collection, and timeline reconstruction as a single cognitive unit, yielding a framework stable across SOC toolchain configurations. Furthermore, from this decomposition, three observations emerge. First, Detection tasks are Mechanical or Composite and High-feasibility, making them tractable for near-term agentic deployment; the bottleneck is input volume and heterogeneity, not reasoning depth. Second, Analysis tasks are Cognitive and moderately feasible, requiring the multi-step planning and external knowledge retrieval that distinguish agentic systems from static classifiers [69,149], while exposing them to causal failure modes (Section 4.2) such as reasoning degradation ([fm:N.1.3]N.1.3), knowledge staleness ([fm:N.2.1]N.2.1), and retrieval errors ([fm:S.5.3]S.5.3), and others. Third, Eradication and Knowledge sharing tasks span the full lifecycle: rule refinement ([task:T-11]T-11) and CTI dissemination ([task:T-13]T-13) are Moderate as outputs are advisory, while containment ([task:T-10]T-10) and policy update ([task:T-12]T-12) are Low as they invoke irreversible actions where excessive agency ([fm:S.7.1]S.7.1) and absent graceful degradation ([fm:S.2.5]S.2.5) carry the highest operational consequence.

5.3. Automation Scopes for Agentic AI

The case for agentic automation in defensive cyber operations is not made in phases but by tasks, and not by preference but derivation. For each task in Table 7, the tools it must invoke and the memory it must retain jointly determine the autonomy level (Table 2) at which an agent can operate. The autonomy level, combined with the agentic capabilities, defines the failure modes from Section 4 that become challenges. The challenges, in turn, dictate the mitigation (Table 6) and the compliance anchors that any deployment must satisfy. Oversight is the point of accountability, not an absolute mitigation. The remainder of this subsection traces the chain through each phase and consolidates the results in Table 8.
Detection is the phase where mitigations are mechanical and mature: schema enforcement at the perception boundary, AST-level tool-call validation [104], exponential-backoff retries, and periodic baseline re-validation suffice. Compliance maps cleanly to NIST AI RMF 2.4–2.5, SOC 2 CC6.1 and CC8.1, and ISO 27001 A.8.28. The Minimal-to-Advisory oversight gradient reflects a downstream-correction property: residual perception errors propagate as false positives or missed alerts that Analysis tasks can recover. Hence, the failure budget here is more generous than in later phases. [task:T-4]T-4 sits one level higher as behavioral baselines are themselves subject to drift ([fm:S.5.2]S.5.2) and training-data bias ([fm:N.2.3]N.2.3) that downstream tasks cannot transparently correct.
Analysis is where mitigations become probabilistic rather than deterministic. Required interventions span RAG grounding with provenance [69,86], self-consistency sampling and reflection [121], hierarchical memory with position-aware retrieval [45,74], dedicated verifier agents [16], and calibration-aware confidence reporting [145], none of which provide correctness guarantees. Multi-agent configurations partially absorb the uncertainty by parallelizing sub-tasks across specialized agents with an orchestrator synthesizing outputs, as demonstrated by FALCON [85], but cannot eliminate it. The compliance envelope broadens according to NIST AI RMF 2.3 and 2.7, ISO 42001, EU AI Act Article 15, and GDPR Article 22, where outputs influence decisions affecting individuals. The uniform advisory oversight reflects this irreducibility: layered mitigations bound but cannot eliminate plausible-but-incorrect reasoning chains.
Eradication splits along the action-reversibility boundary. Here, mitigation is dominated by deterministic access-control primitives drawn from zero-trust architecture: per-session least-privilege tokens [33,87], signed inter-agent manifests, audit logging [83], mandatory human approval gates, and continuous verification [113]. The compliance envelope is the strictest here, anchoring on NIST SP 800-207, SOC 2 CC6.1–CC6.3, GDPR Article 32, and EU AI Act Article 14. This combination forecloses higher autonomy regardless of model capability, illustrating the central inversion of this phase: oversight requirements set the autonomy ceiling rather than reasoning capability. Across all three tasks, memory integrity remains the silent failure point: containment grounded in incorrect incident context ([fm:S.5.1]S.5.1, [fm:S.5.2]S.5.2) produces strategies mismatched to the actual attacker footprint, regardless of access controls.
Knowledge sharing ([task:T-13]T-13) carries a dual asymmetry that distinguishes it from the other phases. Outward, dissemination of CTI has a low local blast radius but high ecosystem amplification: hallucinated indicators, biased TTP annotations, or unfiltered exfiltration propagate from the agent into shared repositories consumed by peer organizations. Inward, the same task channels back into the organization’s own SIEM configurations and recovery procedures, closing the loop. Mitigations, therefore, center on bidirectional integrity rather than execution control: provenance tracking, output validation [33], and pattern-based DLP filtering, consistency checks against existing data, and version-controlled rollback on the inward path. Compliance anchors span GDPR Article 5(1)(d), SOC 2 criterion C1, ISO 27001 A.5.23 for shared information governance, and ISO 27001 A.5.24–A.5.26 for the incident management lifecycle. The Advisory oversight reflects this dual asymmetry: dissemination is locally low-stakes but globally consequential, and feedback into operational defense is consequential but reversible through the same version controls.

5.3.0.1. Critical Insights:

The 13 fine-grained tasks aggregate into the five distinct task categories mapped onto the traditional cybersecurity ecosystem in Section 6 by analytical objective and shared tool/memory, based on the engineering question “how to safely realize autonomy, not how to maximize it?”. Threat Detection ([task:T-3]T-3, [task:T-4]T-4) shares telemetry-driven pattern matching. Alert Triage and Prioritization ([task:T-5]T-5) bridges alerts to investigative sequence. Investigation and Root-Cause Analysis ([task:T-6]T-6, [task:T-11]T-11) shares deep reasoning over incident state, pairing [task:T-11]T-11 with [task:T-6]T-6 across phases as both produce analytical artifacts rather than direct actions. Threat Intelligence and Reporting ([task:T-7]T-7–[task:T-9]T-9, [task:T-13]T-13) shares knowledge-product synthesis from long-term memory across Analysis and Knowledge Sharing phases. Response Automation ([task:T-10]T-10, [task:T-12]T-12) groups irreversible actions under Mandatory oversight. [task:T-1]T-1 and [task:T-2]T-2 cut across all five. Shared tools and memory yield shared failure exposures, where the autonomy–oversight relationship is non-monotonic.
Preprints 227964 i006

6. Agentic AI for Defensive Cybersecurity: Research Landscape and Limitations

Building on Section 5.3, this section reviews existing agentic research across five aggregated operational categories. For each, we summarize the surveyed sub-directions and identify research opportunities against the autonomy and oversight bounds of Section 5; per-work contributions and drawbacks are cataloged in Table 9. Proactive threat discovery and pre-incident or offensive simulation fall outside the incident-driven defensive scope, requiring a parallel offensive pipeline. Readers interested in agentic AI for vulnerability detection, a related but distinct problem area, can consult [120].

6.1. Threat Detection

Threat Detection operates at autonomy Level 1–2, with residual perception errors recoverable downstream. Existing works spans log parsing addressing input-quality failures ([fm:N.3.2]N.3.2) [78,144], anomaly detection with parameter-efficient fine-tuning across open-source backbones [110,112], and deep-learning intrusion classifiers for fine-grained attack-type identification [34,66]. Drawbacks recur across the category: historical benchmarks do not reflect contemporary distributions, providing limited assurance against obfuscated and polymorphic variants ([fm:N.2.1]N.2.1, [fm:N.2.2]N.2.2); the open-source–proprietary gap is reported [110,112] but never decomposed into the model properties that drive it: calibration ([fm:N.1.4]N.1.4), prompt sensitivity ([fm:N.1.6]N.1.6), and instruction-following; and KG-augmented classifiers [66] convert one-time integration into recurring enrichment burden ([fm:N.2.1]N.2.1) without automated curation. Further research opportunities include operational-condition benchmarks measuring detection under continuous high-volume input rather than static datasets; adversarial benchmarks treating obfuscated, metamorphic, and zero-day samples as first-class; and inference-cost-aware deployment pairing learned verification with grounded-decoding constraints.

6.2. Alert Triage and Prioritization

Alert Triage bridges Detection and Prioritization under Advisory oversight, spanning agentic overlays on classical classifiers [3], learning-from-analyst-decisions via RL and imitation learning [135,141], and MAS architectures with specialized roles [114,143]. Two drawbacks emerge: first, explanation-without-action, where interpretability artifacts are produced as analyst aids without coupling to SIEM ranking actions, leaving the analytical work of triage short of the operational outcome ([fm:S.6.2]S.6.2); and surrogate-metric evaluation that does not measure analyst latency, decision accuracy, or alert closure quality ([fm:S.6.1]S.6.1). The frozen-policy problem in imitation learning [135] compounds both, exposing stale-state retention ([fm:S.5.2]S.5.2) and over-reliance ([fm:N.2.4]N.2.4) as analyst norms shift; multi-agent topologies further activate workflow-management failures ([fm:S.2.1]S.2.1) under production load. Research opportunities include operational user studies on the impact of analyst workflow on triage; policy-adaptation mechanisms that update playbook based on observed analyst behavior within governed bounds ([fm:N.2.3]N.2.3); and loop-closing integrations between explanation and action.

6.3. Investigation and Root Cause Analysis (RCA)

Investigation and RCA is the only category admitting Level 3 autonomy via [task:T-6]T-6’s cyclic root-cause reasoning, spanning multimodal anomaly correlation [11] and retrieval-augmented multi-agent investigation [12,18]. However, multimodal works assume simultaneous availability of all labeled modalities and do not inherently address sensor failure or modality dropout ([fm:N.3.3]N.3.3); retrieval-augmented systems inherit a bounded-knowledge dependency (CyberRAG [12] fixed to a predefined taxonomy, OMNISEC [18] hallucinating under sparse external knowledge), jointly exposing multi-step reasoning degradation ([fm:N.1.3]N.1.3), RAG retrieval errors ([fm:S.5.3]S.5.3), and overconfidence on partially grounded conclusions ([fm:N.1.4]N.1.4); and none implements [task:T-11]T-11 as an explicit feedback artefact, leaving investigation findings as analytical outputs that analysts must manually translate into Detection updates. Therefore, graceful degradation under partial modality availability ([fm:S.2.5]S.2.5); open-set detection formulations flagging anomalies outside known taxonomies ([fm:N.2.2]N.2.2); and closed-loop pipelines propagating findings into SIEM rules, instantiating [task:T-11]T-11 as a first-class output, remain open research problems.

6.4. Threat Intelligence and Reporting

Threat Intelligence and Reporting synthesizes knowledge products from long-term memory, spanning CTI extraction and contextualization via RAG [19,86], parametric knowledge infusion through curriculum training on threat reports [75], and log-to-narrative summarization [8]. Most works implements individual stages (parsing, extraction, summarization) without end-to-end integration; the one cascading approach lacks intermediate-step validation. Input-quality assumptions go invalidated across stage boundaries: LocalIntel [86] on local-KB completeness ([fm:S.5.3]S.5.3), CTINexus [19] on rare-entity coverage ([fm:N.2.2]N.2.2), CyLens [75] on cascading reasoning without intermediate validation ([fm:N.1.3]N.1.3, [fm:S.6.2]S.6.2), and CYGENT [8] on manual upload within fixed token context ([fm:N.4.1]N.4.1, [fm:N.4.3]N.4.3); evaluation uses static retrospective reports rather than streaming production input; and the category has the broadest blast radius in the lifecycle, with hallucinated indicators ([fm:N.1.1]N.1.1) and biased TTP annotations ([fm:N.2.3]N.2.3) propagating into shared CTI repositories that peer organizations consume ([fm:A.5.1]A.5.1). Yet, no surveyed work proposes outbound provenance tracking or output validation. Hence, future research may include end-to-end pipeline integration with inter-stage quality controls; streaming-condition evaluation protocols; and provenance and outbound-integrity mechanisms to address the ecosystem-amplification.

6.5. Response Automation

Response Automation is the integration frontier where compliance rather than reasoning capability sets the autonomy ceiling, spanning agent-based propagation simulation [62], LLM–SOAR integration with playbook-driven orchestration and PGM validation [36,43], and RL policies including hierarchical MARL [122] and LLM–MARL fusion for cyber-physical defense [147]. Drawbacks explain why no surveyed system has reached production: simulation-only validation (CybORG [127], simulated cloud) does not capture the irreversibility distinguishing [task:T-10]T-10/[task:T-12]T-12 from advisory tasks; rule-based and playbook-anchored systems do not adapt to novel variants, exposing excessive agency ([fm:S.7.1]S.7.1) under specification weakness ([fm:S.1.4]S.1.4), and PGM validation reduces but does not eliminate hallucination on irreversible actions. In-context agent [36] lacks formal verification of irreversible actions ([fm:S.6.2]S.6.2), and L2M-AID [147] leaves adversarial robustness unaddressed against XPIA ([fm:A.1.2]A.1.2) and training-data poisoning ([fm:A.2.1]A.2.1); and the highest-stakes failure modes for this category, namely HITL bypass ([fm:A.5.3]A.5.3), trust-boundary mismanagement ([fm:S.7.2]S.7.2), privilege escalation ([fm:A.5.2]A.5.2), and cascading failure ([fm:S.2.4]S.2.4), remain untested as no surveyed system executes the production actions at which they manifest. Opportunities, jointly preconditional for production deployment: constrained-action frameworks integrating per-session least-privilege tokens, signed manifests, and tamper-evident logging [33,87]; adaptive playbook learning within human-approved boundaries; sim-to-real bridging methodologies preserving recovery-cost guarantees; and adversarial robustness evaluation against prompt injection and poisoning at the deployment surface [83].

7. From Research to Practice: Commercial Landscape of Agentic Cyberdefense

Where Section 6 examined academic research, this section examines “what major vendors have brought to the market?”. The motivating question is not whether industry has adopted agentic AI in defensive cybersecurity, but where commercial implementations sit relative to the scholarly autonomy failure exposures (Section 4) and oversight bounds (Section 5). Industry offerings provide a different kind of evidence than scholarly research: vendors report metrics from production deployments, but typically without the methodological detail or independent validation that a comprehensive analysis requires. The analysis proceeds in three steps. Section 7.1 maps the commercial landscape to the five categories of Section 6; Section 7.2 surfaces convergent and divergent design choices that reveal which tasks have crossed the agentic adoption threshold; Section 7.3 identifies maturity gaps between vendor claims and the failure-exposures.

7.1. Current Commercial Landscape

Commercial offerings concentrate where SOC budgets and operational metrics most clearly justify investment, organizing into three sub-directions [136] cataloged in Table 10. Detection and triage platforms [25,28,111,117] target [task:T-1]T-1–[task:T-5]T-5 on vendor-controlled telemetry substrates, automating Tier-1 and Tier-2 SOC work under bounded autonomy. Analyst-augmentation copilots [21,23,82] target Investigation, CTI, and Reporting ([task:T-6]T-6–[task:T-9]T-9, [task:T-13]T-13) by stratifying analyst speed and accuracy gains across experience levels. End-to-end orchestration platforms [51,95,125] target the full Detection-to-Response chain ([task:T-1]T-1–[task:T-13]T-13) through SIEM, SOAR, and ML-driven scoring with cognitive correlation across logs, alerts, and external threat intelligence. Each row in Table 10 reports vendor-disclosed status without independent validation; we treat these as evidence of claimed capability and revisit the validation gap in Section 7.3.

7.2. Shared Design Patterns and Architectural Divergences

Three convergent design choices and two divergences mark the current position of the production frontier. Convergences: all surveyed platforms ground autonomous reasoning in a vendor-controlled telemetry substrate (Falcon for Charlotte, GreyMatter’s correlation layer, Darktrace’s ActiveAI baseline, Singularity for Purple AI, Chronicle’s data lake, Cortex’s unified data store), addressing the input-quality gap that constrains the open research of Section 6.1 but tying agentic capability to vendor lock-in; all expose human-in-the-loop checkpoints for irreversible actions (Charlotte’s customer-defined SOAR guardrails, GreyMatter’s bounded Tier-1/Tier-2 automation, Purple AI’s analyst-in-the-loop governance, Microsoft Copilot’s analyst-authorized remediation, Cortex AgentiX’s role-based approvals), instantiating the Mandatory oversight regime that Section 5.3 identifies for [task:T-10]T-10 and [task:T-12]T-12; and all emphasize multi-framework compliance posture (SOC 2 Type II, ISO 27001, FedRAMP), reflecting the convergent regulatory finding of Section 4, though we only found Microsoft and IBM to publish specific failure-mode coverage tied to those frameworks.
Divergences are analytically more revealing. The first concerns the autonomy ceiling: Darktrace’s autonomous endpoint mitigation and Palo Alto Cortex XSIAM’s end-to-end orchestration push toward Level 2–3 deployable autonomy in Response Automation, while Charlotte AI, GreyMatter, Purple AI, Microsoft Copilot, Cisco AI Assistant, and Splunk AI Assistant remain explicitly bounded to Level 1 with analyst gating. This is the integration-frontier question of Section 6.5 reframed: whether containment and policy update can be safely raised above Level 1, with vendors taking opposite positions. The second concerns the reasoning substrate: IBM QRadar Advisor, Google Sec-PaLM, Microsoft Security Copilot, Cisco AI Assistant, Splunk AI Assistant, and SentinelOne Purple AI lean on LLM reasoning over structured telemetry and agentic tooling (CTI synthesis, log narration, query generation), while CrowdStrike Charlotte, ReliaQuest GreyMatter, and Darktrace ActiveAI lean on behavioral statistical models with LLMs as an explanation overlay. The first treats the LLM as the analytical core. It inherits the natural failure profile of Section 4.2.1 (reasoning degradation [fm:N.1.3]N.1.3, knowledge staleness [fm:N.2.1]N.2.1, factual hallucination [fm:N.1.1]N.1.1); the second treats the LLM as an explanation overlay and inherits the explanation-without-action gap that Section 6.2 identifies for the open literature.

7.3. Persisting Maturity Gaps

Vendor-reported metrics show that commercial agentic AI delivers measurable operational gains, but four maturity gaps separate vendor claims from the methodological standard applied to the academic research surveyed in Section 6. Vendor-internal metrics, namely triage accuracy above 98% (Charlotte AI), MTTR reductions of 30% (Security Copilot), alert processing 20× faster with 30% greater accuracy (GreyMatter), and 80% reduction in alert volume requiring analyst review (Cortex XSIAM), are presented without third-party reproducibility on shared datasets or protocol-level disclosure, though several vendors release methodology footnotes (CrowdStrike) and commissioned third-party studies (Microsoft RCTs, Forrester TEI for ReliaQuest and Palo Alto); this falls short of the shared-dataset, disclosed-protocol evaluation of the research in Section 6.1. The failure-exposure profile of Section 4 is largely unaddressed beyond general guardrails and compliance certifications: no surveyed offering publishes specifications for HITL bypass detection ([fm:A.5.3]A.5.3), trust-boundary enforcement ([fm:S.7.2]S.7.2), privilege-escalation prevention ([fm:A.5.2]A.5.2), or cascading-failure containment ([fm:S.2.4]S.2.4), even though several execute the high-blast-radius actions where these failure modes are consequential. The agentic-capability claim itself is uneven: while Charlotte AI, GreyMatter, Purple AI, Security Copilot, Darktrace ActiveAI, and Cortex XSIAM with AgentiX exhibit perception–planning–action–memory–reflection in operational deployment, Sec-PaLM, Cisco AI Assistant, and Splunk AI Assistant function as analyst copilots with retrieval augmentation rather than full agentic loops, and the boundary between agentic systems and LLM-augmented analytics tools is not consistently enforced across vendor messaging. Finally, exposure of cross-vendor agentic communication protocols (MCP, A2A, ACP) [30] remains nascent (Microsoft’s MCP server in Sentinel is an early exception); commercial agents largely operate within their vendor’s ecosystem rather than across organizational boundaries. These gaps do not negate the operational value vendors deliver; they mark where claims-of-capability and evidence-of-capability are not yet aligned, and where the compliance implications surveyed in Section 8 and the research directions of Section 9 must collectively land before agentic AI moves from vendor-bounded copilot deployment to cross-organizational defense infrastructure.

8. Compliance Implications for Multi-Agent Defensive Operations

Compliance failures are not a fourth root cause alongside Section 4’s causal categories but a consequence layer: they emerge when upstream technical failures manifest in regulated contexts, producing legal or governance risk. They can also arise independently of any technical fault [90]: an agent processing data flawlessly may lack a lawful basis under GDPR [31] or make high-stakes decisions without the human oversight required by Article 14 of the EU AI Act [32]. This dual origin justifies a separate analytical dimension. Section 8.1 catalogs the 20 compliance failure modes across four dimensions; Section 8.2 synthesizes how they interact with the technical taxonomy and where research and policy progress are jointly required. Table 11 consolidates the full mapping to the GDPR, EU AI Act, NIST AI RMF [93], ISO 42001, and sector-specific frameworks (HIPAA, PCI-DSS, SOX), with upstream cross-referenced technical triggers.

8.1. Compliance Failure Mode Taxonomy

We organize compliance failures into four dimensions: Privacy and Sovereignty, Transparency and Explainability, Accountability and Audit, and Fairness and Governance. This four-way partition reflects the principles around which global AI ethics frameworks converge [58]; the fifth converged principle, non-maleficence, we treat upstream as technical failure (Section 4.2.1, Section 4.2.2 and Section 4.2.3). Each catalogs the failure modes within one dimension, the regulatory provisions they trigger, the dominant gap separating current agentic systems from compliance, and the resulting research opportunities, with upstream technical triggers noted inline where they act as causal antecedents.

8.1.1. Privacy and Sovereignty

failures ([fm:C.1.1]C.1.1–[fm:C.1.5]C.1.5) arise when agentic systems handle PII data without satisfying the requirements of lawfulness, transparency, or territorial constraints. Five modes recur: processing without lawful basis ([fm:C.1.1]C.1.1) under GDPR Art. 6; cross-border transfer violations ([fm:C.1.2]C.1.2) routing data through non-adequate jurisdictions or violating localization mandates; failure to honor data subject rights ([fm:C.1.3]C.1.3) where agentic memory rarely exposes the erasure, access, and rectification mechanisms required by GDPR Arts. 15–17, a problem machine unlearning [13,97] addresses for model weights but leaves prompt caches, embedding stores, and RAG indices largely unaddressed; retention beyond lawful period ([fm:C.1.4]C.1.4, overlap with [fm:S.5.2]S.5.2) when long-term memory accumulates personal data without retention enforcement; and unintended PII ingestion ([fm:C.1.5]C.1.5, overlap with [fm:A.5.4]A.5.4) when agents ingest logs, screenshots, or telemetry containing personal data outside the declared purpose, with training-data extraction [15] showing ingested PII is recoverable from LLM internals. The dominant gap is that no surveyed agentic framework (Section 6) explicitly provides purpose-binding, retention, or erasure primitives on agent memory; routing prompts through external LLM APIs (Section 6.4) adds a further sovereignty surface that compliance frameworks have not yet caught up with.

8.1.2. Transparency and Explainability

failures ([fm:C.2.1]C.2.1–[fm:C.2.4]C.2.4) arise when agentic decision-making cannot be reconstructed for regulators, auditors, or affected parties. Four modes recur: inability to explain agent decisions ([fm:C.2.1]C.2.1) under GDPR Art. 22 and EU AI Act Art. 13’s transparency obligations for high-risk systems [40]; failure to disclose AI involvement ([fm:C.2.2]C.2.2) under EU AI Act Art. 50 when natural persons interact with AI systems without notification; opaque multi-agent reasoning chains ([fm:C.2.3]C.2.3, overlap with [fm:S.7.3]S.7.3) where causal lineage spans multiple unlogged model invocations; and insufficient training-data provenance ([fm:C.2.4]C.2.4) under EU AI Act Art. 10 when providers cannot demonstrate representativeness, completeness, and lawful sourcing of training corpora, a gap that datasheets [38] and model cards [84] partially address for data and models in isolation but not for multi-agent inference chains. The dominant gap is in output verification and provenance-tracking mechanisms, identified as research opportunities in Section 6.3 and Section 6.4, which are prerequisites for transparency compliance. Their absence in deployment creates potential regulatory exposure.

8.1.3. Accountability and Audit

([fm:C.3.1]C.3.1–[fm:C.3.8]C.3.8) arise when responsibility for agentic actions is unclear, the audit trail is incomplete, or sector-specific controls are not met. Eight modes form three clusters. Liability and oversight: unclear liability attribution ([fm:C.3.1]C.3.1) where neither the deploying organization, the model provider, nor the framework integrator can be unambiguously held responsible [107]; absence of HITL for high-risk decisions ([fm:C.3.2]C.3.2, overlap with [fm:A.5.3]A.5.3) under EU AI Act Art. 14 for the irreversible-action tasks [task:T-10]T-10 and [task:T-12]T-12; and unattributable actions in multi-agent chains ([fm:C.3.3]C.3.3) where diffused responsibility prevents post-hoc attribution. Audit trail: incomplete or non-tamper-proof audit trails ([fm:C.3.5]C.3.5, overlap with [fm:S.7.3]S.7.3) violating SOC 2 CC7.2 and ISO 27001 A.8.15, which tamper-evident logging [24] could address but no surveyed agentic framework deploys; and absent model versioning and change-management records ([fm:C.3.7]C.3.7) violating ISO 42001 lifecycle clauses when behavior changes without traceable revision. Sector-specific: non-compliance with sector regulations ([fm:C.3.4]C.3.4) where agentic SOC platforms processing health, payment, or financial telemetry must additionally satisfy HIPAA, PCI-DSS Req. 10, or SOX §404; failure to conduct mandatory risk assessments ([fm:C.3.6]C.3.6) under EU AI Act Art. 9; and non-compliance with AI-specific standards ([fm:C.3.8]C.3.8) where NIST AI RMF and ISO 42001 controls are referenced in vendor marketing (Section 7) but not demonstrably implemented. The dominant gap is the auditability asymmetry of Section 4: deterministic engineering controls produce auditable artifacts, but the multi-step, multi-agent, multi-model nature of agentic systems generates audit surfaces that existing logging infrastructures struggle.

8.1.4. Fairness and Governance

failures ([fm:C.4.1]C.4.1–[fm:C.4.3]C.4.3) arise when agentic outputs result in disparate treatment, differential service quality, or undocumented bias risks for protected groups. Three modes recur: discriminatory outcomes violating equal-treatment laws ([fm:C.4.1]C.4.1, overlap with [fm:N.2.3]N.2.3 bias propagation) under Title VII, ECOA, or EU equality-law obligations when agentic decisions disproportionately disadvantage protected classes [10]; differential quality of service across demographic groups ([fm:C.4.2]C.4.2) where agentic SOC platforms exhibit unequal detection or response performance across populations defined by language, geography, or organizational scale, recasting the open-source–proprietary gap of Section 6.1 as a fairness concern when small organizations cannot access proprietary-tier protection; and failure to conduct bias impact assessments pre-deployment ([fm:C.4.3]C.4.3) under EU AI Act Art. 9 and NIST AI RMF GOVERN-1.4. The dominant gap is that fairness in cybersecurity-specific agentic systems remains undertheorized relative to consumer-facing AI [81]: the protected-class harms fairness law was designed for (employment, credit, housing, criminal justice) map imperfectly to security operations, yet disparate model performance reproducing social inequities applies directly to agentic SOC platforms whose differential coverage maps onto organizational and geographic stratification.

8.2. Failure Synthesis and Research Implications

The 20 compliance failure modes interact with the causal taxonomy in three structurally significant ways. Seven are consequence-layer failures with upstream technical triggers ([fm:C.1.4]C.1.4 compounding [fm:S.5.2]S.5.2; [fm:C.1.5]C.1.5 compounding [fm:A.5.4]A.5.4; [fm:C.2.3]C.2.3, [fm:C.3.3]C.3.3, and [fm:C.3.5]C.3.5 each compounding [fm:S.7.3]S.7.3; [fm:C.3.2]C.3.2 compounding [fm:A.5.3]A.5.3; [fm:C.4.1]C.4.1 compounding [fm:N.2.3]N.2.3), where upstream engineering directly reduces compliance exposure. The remaining 13 ([fm:C.1.1]C.1.1 lawful basis, [fm:C.2.2]C.2.2 AI disclosure, [fm:C.3.1]C.3.1 liability attribution, [fm:C.3.6]C.3.6 mandatory risk assessment, [fm:C.4.3]C.4.3 bias impact assessment, among others) are pure governance failures without technical antecedent, requiring procedural rather than algorithmic measures. The auditability asymmetry of Section 4 limits verification across both classes: deterministic controls yield binary, machine-checkable evidence; reasoning-quality controls yield statistical evidence requiring deployment-specific thresholds that are still not prescribed.
Closing the gap requires coordinated progress on three fronts. Engineering upstream failure modes admits the most concrete opportunities: purpose-bound memory architectures ([fm:C.1.4]C.1.4) tagging items with processing purpose and enforcing memory-layer retention, extending designs such as MemGPT [101]; right-to-erasure-aware long-term memory ([fm:C.1.3]C.1.3) supporting targeted deletion across embedding stores, RAG indices, and prompt caches; sovereignty-preserving inference orchestration ([fm:C.1.2]C.1.2) routing through jurisdiction-appropriate endpoints, generalizing on-premises CTI patterns [86]; end-to-end decision provenance ([fm:C.2.3]C.2.3) capturing causal chains across tool invocations in tamper-evident logs; cryptographically-signed action logs ([fm:C.3.5]C.3.5) satisfying SOC 2 and ISO 27001 evidentiary requirements; multi-agent attribution standards ([fm:C.3.1]C.3.1, [fm:C.3.3]C.3.3) assigning action-level responsibility in orchestrated workflows; and agent-native authentication protocols ([fm:C.3.1]C.3.1, [fm:C.3.3]C.3.3) beyond OAuth 2.0 session models for long-running agentic operations. Governance and procedural measures address failures without technical antecedent: audit-grade explanation interfaces ([fm:C.2.1]C.2.1) rendering agentic reasoning at granularity sufficient for regulator and affected-party scrutiny; training-data manifest standards ([fm:C.2.4]C.2.4) extending datasheets and model cards to multi-agent inference chains; sector-specific compliance overlays ([fm:C.3.4]C.3.4) translating HIPAA, PCI-DSS, and SOX controls into agentic implementation patterns; pre-deployment bias impact assessment templates ([fm:C.4.3]C.4.3) aligned with EU AI Act Art. 9 for cybersecurity-domain systems; and fairness-aware tier accessibility ([fm:C.4.2]C.4.2) addressing the inequity of small organizations bearing higher residual risk when proprietary-tier protection is out of reach. Standardization underpins both fronts: cybersecurity-specific fairness metrics ([fm:C.4.1]C.4.1, [fm:C.4.2]C.4.2) adapting disparate-impact analysis to security outcomes (detection-coverage, response-time, false-positive-rate parity), and deployment-specific risk thresholds operationalizing EU AI Act Art. 15’s “appropriate accuracy and robustness” obligation that frameworks currently leave undefined. Section 9 connects where these fronts admit research progress versus require policy intervention beyond research.

9. Open Challenges and Research Opportunities (Answer to RQ-3)

The preceding sections traced agentic AI for defensive cybersecurity from foundational definitions through commercial offerings and compliance. We consolidate research opportunities into eight directions (R-1 through R-8) across three categories: methodological foundations providing evaluation and verification primitives, currently lacking (R-1–R-3), engineering work translating these primitives into deployable architectures (R-4–R-6), and governance where engineering alone cannot deliver (R-7–R-8). Figure 8 integrates these directions into a unified governable MAS architecture.

9.1. Methodological Foundations

Three methodological gaps form the substrate on which engineering and governance directions both build: representative benchmarks, verifiable agentic reasoning, and characterized failure modes.
R-1: Operational-condition and adversarial evaluation benchmarks Surveyed systems rely on historical benchmarks that miss contemporary operational distributions. Three benchmark families are needed: operational-condition benchmarks measuring detection, triage, and investigation under continuous high-volume input (Section 6.1); adversarial benchmarks treating obfuscated, metamorphic, and zero-day samples as first-class, addressing the 90%+ adaptive-attack bypass rate [92]; and streaming-condition CTI benchmarks on production-scale input (Section 6.4). Research-led, but requires industry partners for production telemetry and policy bodies for adequacy thresholds.
R-2: Verification, grounding, and provenance for agentic reasoning The auditability asymmetry of Section 4 (probabilistic natural failures vs. deterministic system failures) caps autonomy on high-stakes tasks (Section 6.5). Four complementary thrusts: learned verification components adapting to new log distributions; grounded-decoding constraints bounding hallucination ([fm:N.1.1]N.1.1) without continuous KG enrichment; end-to-end decision provenance capturing causal chains in tamper-evident logs satisfying SOC 2 CC7.2 and ISO 27001 A.8.15 (Section 8.1.2); and retrieval-confidence calibration signalling insufficient external knowledge before action commitment (Section 6.3). Verification is the precondition for raising autonomy ceilings where action irreversibility caps deployment below model capability.
R-3: Failure-mode characterization beyond identification Several mature failure categories are identified but uncharacterized: the open-source–proprietary performance gap [110,112] is named but never decomposed into the model properties driving it; the conditions under which CYGENT-style rule-based verification fails or conflicts with model output are unspecified; and the boundaries where RAG systems transition from grounded to hallucinated under sparse external knowledge are unmeasured. Controlled characterization studies decomposing composite failures into proximate causes would enable principled deployment decisions rather than vendor-tier defaults.

9.2. Engineering and Deployment

Three engineering directions translate methodological primitives into deployable architectures: governance-aware memory, irreversibility-bounded response automation, and end-to-end deployment integration.
R-4: Memory and modality architectures for partial-availability operation Memory failures ([fm:S.5.1]S.5.1, [fm:S.5.2]S.5.2, [fm:S.5.3]S.5.3) compound where multimodal sources fail asynchronously and data arrive incomplete. Three facets of one architecture: graceful degradation under partial modality availability (Section 6.3); purpose-bound memory [101] enforcing retention at the memory layer; and right-to-erasure-aware long-term memory [13] supporting targeted deletion across embedding stores, RAG indices, and prompt caches (Section 8.1.1). Current memory modules prioritize performance, not governance.
R-5: Sim-to-real bridging and constrained action for response automation Response Automation is the integration frontier where compliance, not reasoning capability, sets the autonomy ceiling (Section 6.5). Three engineering directions: constrained-action frameworks integrating per-session least-privilege tokens, signed manifests, and tamper-evident logging, addressing [fm:A.5.3]A.5.3, [fm:S.7.2]S.7.2, [fm:A.5.2]A.5.2, and [fm:S.2.4]S.2.4; adaptive playbook learning updating response logic from observed attacker behavior within human-approved boundaries; and sim-to-real bridging methodologies transferring RL policies to production while preserving recovery-cost guarantees.
R-6: End-to-end pipeline integration and loop-closing The CTI pipeline (Section 6.4) and Investigation-to-Detection loop (Section 6.3) share a structural property: each stage’s input-quality assumptions go unvalidated, and feedback artifacts ([task:T-11]T-11 rule refinement) are not first-class outputs. Two directions: end-to-end pipeline integration with inter-stage quality controls, and closed-loop pipelines that route investigation findings into SIEM rule updates rather than burdening analysts. Alert Triage (Section 6.2) exhibits the same gap.

9.3. Governance and Standardization

Two governance directions translate deployable systems into accountable, regulated infrastructure: multi-agent attribution and audit standards, and sector-specific compliance and fairness frameworks.
R-7: Multi-agent attribution and audit standards Auditability asymmetry compounds in MAS where action lineage spans unlogged invocations. Section 8.1.3 identified multi-agent attribution standards [107] and cryptographically-signed action logs [24] satisfying SOC 2 CC7.2 and ISO 27001 A.8.15 requirements. The gap is not in capability but in standards that translate these requirements into agentic protocols, including extensions to MCP, A2A, or ACP [30] for cross-vendor attribution and delegation beyond OAuth 2.0. EU AI Act Art. 14 mandates oversight, which requires attribution; which is currently best-effort and require coordination across research, standards bodies, and regulators.
R-8: Sector overlays, fairness frameworks, and bias assessments for cybersecurity AI Three governance gaps lack established research traditions in cybersecurity: sector-specific compliance overlays translating HIPAA, PCI-DSS, and SOX into agentic implementation patterns, where vendor claims (Section 7) cite frameworks without demonstrating agentic-specific risk treatment; cybersecurity-specific fairness metrics [10,81] adapting disparate-impact analysis to security outcomes, recasting the open-source–proprietary gap (Section 6.1) as a fairness concern; and pre-deployment bias impact assessment templates aligned with EU AI Act Art. 9 and NIST AI RMF GOVERN-1.4 for cybersecurity-domain systems. Without these, deployable systems remain unassessable against nominally applicable standards.

10. Conclusion

This survey developed four analytical artifacts to characterize where agentic AI can close the SOC data-throughput gap: a taxonomy of 72 failure modes across 18 sub-categories along three causal axes; a decomposition of defensive cybersecurity operations into 13 tasks classified by autonomy level, oversight regime, and failure exposure; a literature-and-industry review of 22 research systems and 10 commercial offerings across five operational categories; and a compliance catalogue of 20 governance gaps mapped to GDPR, EU AI Act, NIST AI RMF, ISO 42001, and sector-specific frameworks. The central thesis these support is that the autonomy ceiling for cybersecurity AI is bounded asymmetrically, not by reasoning capability, which is sufficient for most surveyed tasks, but by action irreversibility, mitigation maturity, and compliance envelope. The risk to guard against is agent bloat: capability claims outpacing independent validation, benchmark accuracy mistaken for operational performance, and compliance posture asserted rather than demonstrated. Closing this gap requires coordinated methodological, engineering, and governance work across research, industry, and standards bodies. With the foundations laid and the agenda enumerated, agentic AI can advance from today’s vendor-bounded copilot toward a trusted, accountable, cross-organizational cyberdefense infrastructure where capability is delivered rather than merely claimed.

Appendix A. List of Acronyms

A2A Agent-to-Agent LIME Local Interpretable Model-agnostic Explanations
ACM Association for Computing Machinery LLM Large Language Model
ACP Agent Communication Protocol LoRA Low-Rank Adaptation
AI Artificial Intelligence MAPPO Multi-Agent Proximal Policy Optimization
AIRT AI Red Team (Microsoft) MARL Multi-Agent Reinforcement Learning
AISI AI Safety Institute MAS Multi-Agent System
API Application Programming Interface MAST Multi-Agent System Failure Taxonomy
APT Advanced Persistent Threat MCP Model Context Protocol
AST Abstract Syntax Tree MISP Malware Information Sharing Platform
ASR Attack Success Rate ML Machine Learning
ATT&CK Adversarial Tactics, Techniques, and Common Knowledge MTTC Mean Time To Contain
BERT Bidirectional Encoder Representations from Transformers MTTR Mean Time To Respond
BGL BlueGene/L (system log dataset) NIST National Institute of Standards and Technology
CAGE Cyber Autonomy Gym for Experimentation NLP Natural Language Processing
CC Common Criteria (SOC 2 trust criteria) NVD National Vulnerability Database
CCPA California Consumer Privacy Act OASIS Org. for the Advancement of Structured Information Standards
CMDB Configuration Management Database OAuth Open Authorization
CNN Convolutional Neural Network OWASP Open Worldwide Application Security Project
CoT Chain-of-Thought PaLM Pathways Language Model
CSF Cybersecurity Framework (NIST) PCI-DSS Payment Card Industry Data Security Standard
CSRF Cross-Site Request Forgery PEFT Parameter-Efficient Fine-Tuning
CTDE Centralized Training with Decentralized Execution PGM Probabilistic Graphical Model
CTI Cyber Threat Intelligence PII Personally Identifiable Information
CVE Common Vulnerabilities and Exposures PIPL Personal Information Protection Law
CybORG Cyber Operations Research Gym PPO Proximal Policy Optimization
DARPA Defense Advanced Research Projects Agency RAG Retrieval-Augmented Generation
DBSCAN Density-Based Spatial Clustering of Applications with Noise RCA Root Cause Analysis
DLP Data Loss Prevention RCT Randomized Controlled Trial
DNN Deep Neural Network ReAct Reasoning and Acting
DPIA Data Protection Impact Assessment RL Reinforcement Learning
DPP Determinantal Point Process RMF Risk Management Framework
ECOA Equal Credit Opportunity Act RQ Research Question
EDR Endpoint Detection and Response SBOM Software Bill of Materials
ENISA European Union Agency for Cybersecurity SHAP SHapley Additive exPlanations
ETL Extract, Transform, Load SIEM Security Information and Event Management
EU European Union SOAR Security Orchestration, Automation, and Response
F1 F1 Score (harmonic mean of precision and recall) SOC Security Operations Center
FedRAMP Federal Risk and Authorization Management Program SOC 2 Service Organization Control 2
FN False Negative SoK Systematization of Knowledge
FP False Positive SOX Sarbanes-Oxley Act
GDPR General Data Protection Regulation SP Special Publication (NIST)
GPT Generative Pre-trained Transformer SPL Splunk Processing Language
HDFS Hadoop Distributed File System SQL Structured Query Language
HIPAA Health Insurance Portability and Accountability Act SQLi SQL Injection
HITL Human-In-The-Loop SSDF Secure Software Development Framework
IAM Identity and Access Management SSTI Server-Side Template Injection
IDS Intrusion Detection System STIX Structured Threat Information Expression
IEC International Electrotechnical Commission TAXII Trusted Automated Exchange of Indicator Information
IETF Internet Engineering Task Force TEI Total Economic Impact (Forrester methodology)
IoC Indicator of Compromise TLS Transport Layer Security
IPS Intrusion Prevention System ToT Tree-of-Thought
IR Incident Response TTL Time-To-Live
ISO International Organization for Standardization TTP Tactics, Techniques, and Procedures
JSON JavaScript Object Notation XDR Extended Detection and Response
KB Knowledge Base XPIA Cross-Domain Prompt Injection Attack
KDD Knowledge Discovery in Databases XSS Cross-Site Scripting
KG Knowledge Graph

References

  1. Acharya, D. B.; Kuppan, K.; Divya, B. Agentic ai: Autonomous intelligence for complex goals–a comprehensive survey. IEEe Access, 2025. [Google Scholar]
  2. Adabara, I.; Olaniyi Sadiq, B.; Nuhu Shuaibu, A.; Danjuma, Y. I.; Venkateswarlu, M. A review of agentic AI in cybersecurity: Cognitive autonomy, ethical governance, and quantum-resilient defense. F1000Research 14 2025, 843. [Google Scholar] [CrossRef] [PubMed]
  3. Ali, T.; Kostakos, P. Huntgpt: Integrating machine learning-based anomaly detection and explainable ai with large language models (llms). 2023. [Google Scholar] [CrossRef]
  4. American Institute of Certified Public Accountants. SOC 2 — SOC for service organizations: Trust services criteria, 2017. Trust Services Criteria revised 2017; point-in-time (Type I) and period-of-time (Type II) reports.
  5. Andreoni, M.; Lunardi, W. T.; Lawton, G.; Thakkar, S. Enhancing autonomous system security and resilience with generative ai: A comprehensive survey. IEEE Access 12 2024, 109470–109493. [Google Scholar] [CrossRef]
  6. Anil, C.; Durmus, E.; Panickssery, N.; Sharma, M.; Benton, J.; Kundu, S.; Batson, J.; Tong, M.; Mu, J.; Ford, D.; et al. Many-shot jailbreaking. Adv. Neural Inf. Process. Syst. 37 2024, 129696–129742. [Google Scholar] [CrossRef]
  7. Assaf, I. Soc burnout and how ai can flip the script. Accessed. Aug 2025. (accessed on 2026-02-19).
  8. Balasubramanian, P.; Seby, J.; Kostakos, P. Cygent: A cybersecurity conversational agent with log summarization powered by gpt-3. 2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT), 2024; pp. 1–6. [Google Scholar]
  9. Barnett, S.; Kurniawan, S.; Thudumu, S.; Brannelly, Z.; Abdelrazek, M. Seven failure points when engineering a retrieval augmented generation system. In Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering-Software Engineering for AI, 2024; pp. 194–199. [Google Scholar]
  10. Barocas, S.; Selbst, A. D. Big data’s disparate impact. Calif. L. Rev. 104 2016, 671. [Google Scholar]
  11. Benabderrahmane, S.; Valtchev, P.; Cheney, J.; Rahwan, T. Apt-llm: Embedding-based anomaly detection of cyber advanced persistent threats using large language models. In 2025 13th International Symposium on Digital Forensics and Security (ISDFS); IEEE, 2025; pp. 1–6. [Google Scholar]
  12. Blefari, F.; Cosentino, C.; Pironti, F. A.; Furfaro, A.; Marozzo, F. Cyberrag: An agentic rag cyber attack classification and reporting tool. arXiv 2025, arXiv:2507.02424. [Google Scholar]
  13. Bourtoule, L.; Chandrasekaran, V.; Choquette-Choo, C. A.; Jia, H.; Travers, A.; Zhang, B.; Lie, D.; Papernot, N. Machine unlearning. In 2021 IEEE symposium on security and privacy (SP) (2021); IEEE; pp. 141–159.
  14. Carlini, N.; Paleka, D.; Dvijotham, K. D.; Steinke, T.; Hayase, J.; Cooper, A. F.; Lee, K.; Jagielski, M.; Nasr, M.; Conmy, A.; Wallace, E.; Rolnick, D.; Tramèr, F. Stealing part of a production language model. In Proceedings of the 41st International Conference on Machine Learning (2024), ICML’24, JMLR.org.
  15. Carlini, N.; Tramer, F.; Wallace, E.; Jagielski, M.; Herbert-Voss, A.; Lee, K.; Roberts, A.; Brown, T.; Song, D.; Erlingsson, U.; et al. Extracting training data from large language models. 30th USENIX security symposium (USENIX Security 21), 2021; pp. 2633–2650. [Google Scholar]
  16. Cemri, M.; Pan, M. Z.; Yang, S.; Agrawal, L. A.; Chopra, B.; Tiwari, R.; Keutzer, K.; Parameswaran, A.; Klein, D.; Ramchandran, K.; et al. Why do multi-agent llm systems fail? arXiv 2025, arXiv:2503.13657. [Google Scholar]
  17. Chen, Z.; Xiang, Z.; Xiao, C.; Song, D.; Li, B. Agentpoison: Red-teaming llm agents via poisoning memory or knowledge bases. Adv. Neural Inf. Process. Syst. 37 2024, 130185–130213. [Google Scholar] [CrossRef]
  18. Cheng, W.; Zhu, T.; Jing, S.; Mei, J.-P.; Ma, M.; Jin, J.; Weng, Z. Omnisec: Llm-driven provenance-based intrusion detection via retrieval-augmented behavior prompting. 2025. [Google Scholar] [CrossRef]
  19. Cheng, Y.; Bajaber, O.; Tsegai, S. A.; Song, D.; Gao, P. Ctinexus: Automatic cyber threat intelligence knowledge graph construction using large language models. 2025 IEEE 10th European Symposium on Security and Privacy (EuroS&P), 2025; pp. 923–938. [Google Scholar]
  20. Chhabra, A.; Datta, S.; Nahin, S. K.; Mohapatra, P. Agentic ai security: Threats, defenses, evaluation, and open challenges. IEEE Access 14 2026, 49455–49482. [Google Scholar] [CrossRef]
  21. Chronicle, G. C. Sec-palm via chronicle security operations: Llm-powered signal enrichment & triage. 2025. Available online: https://cloud.google.com/security/chronicle (accessed on 2025-09-12).
  22. Cichonski, P.; Millar, T.; Grance, T.; Scarfone, K. Tech. Rep. NIST Special Publication 800-61 Revision 2; Computer Security Incident Handling Guide. Accessed; National Institute of Standards and Technology (NIST), August 2012; (accessed on YYYY-MM-DD).
  23. Cisco Systems. Cisco AI assistant for security. 2025. Available online: https://www.cisco.com/c/en/us/products/security/ai-assistant.html.
  24. Crosby, S. A.; Wallach, D. S. Efficient data structures for tamper-evident logging. USENIX security symposium, 2009; pp. 317–334. [Google Scholar]
  25. CrowdStrike. Crowdstrike charlotte ai: Agentic detection triage. 2025. Available online: https://www.crowdstrike.com/en-us/platform/charlotte-ai/ (accessed on 2025-09-12).
  26. Cruz, D.; et al. When refusals fail: Unstable safety mechanisms in long-context LLM agents. arXiv 2025, arXiv:2512.02445. [Google Scholar]
  27. Dai, S.; Xu, C.; Xu, S.; Pang, L.; Dong, Z.; Xu, J. Bias and unfairness in information retrieval systems: New challenges in the llm era. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (New York, NY, USA 2024, KDD ’24, 6437–6447. [Google Scholar] [CrossRef]
  28. Darktrace. Endpoint / detect & respond ai: Autonomous detection and mitigation. 2025. Available online: https://www.darktrace.com/products/endpoint (accessed on 2025-09-12).
  29. Deng, Z.; Guo, Y.; Han, C.; Ma, W.; Xiong, J.; Wen, S.; Xiang, Y. Ai agents under threat: A survey of key security challenges and future pathways. ACM Comput. Surv. 2025, 57(7), 1–36. [Google Scholar] [CrossRef]
  30. Ehtesham, A.; Singh, A.; Gupta, G. K.; Kumar, S. A survey of agent interoperability protocols: Model context protocol (mcp), agent communication protocol (acp), agent-to-agent protocol (a2a), and agent network protocol (anp). arXiv 2025, arXiv:2505.02279. [Google Scholar]
  31. European Parliament and Council of the European Union. Regulation (EU) 2016/679 of the European Parliament and of the Council (general data protection regulation), Apr. 2016. Effective. 2018. [Google Scholar] [CrossRef]
  32. European Parliament and Council of the European Union. Published OJ L 2024/1689; Regulation (EU) 2024/1689 of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (AI act), June 2024. phased enforcement from 2 February 2025. 12 July 2024.
  33. Foundation, O. Owasp top-10 for llm applications. 2025. Available online: https://owasp.org/www-project-top-10-for-large-language-model-applications/ (accessed on 2025-09-11).
  34. Lira, G.O.; Marroquin, A.; To, M. A. Harnessing the advanced capabilities of llm for adaptive intrusion detection systems. In Advanced Information Networking and Applications (Cham; Barolli, L., Ed.; Springer Nature Switzerland, 2024; pp. 453–464. [Google Scholar]
  35. Gallegos, I. O.; Rossi, R. A.; Barrow, J.; Tanjim, M. M.; Kim, S.; Dernoncourt, F.; Yu, T.; Zhang, R.; Ahmed, N. K. Bias and fairness in large language models: A survey. Comput. Linguist. 2024, 50(3), 1097–1179. [Google Scholar] [CrossRef]
  36. Gao, Y.; Hammar, K.; Li, T. In-context autonomous network incident response: An end-to-end large language model agent approach. arXiv 2026, arXiv:2602.13156. [Google Scholar]
  37. Gartner Research. Predict 2025. 2025. Available online: https://www.gartner.com/en/documents/6027635 (accessed on 11 September 2025).
  38. Gebru, T.; Morgenstern, J.; Vecchione, B.; Vaughan, J. W.; Wallach, H.; Iii, H. D.; Crawford, K. Datasheets for datasets. Commun. ACM 2021, 64(12), 86–92. [Google Scholar] [CrossRef]
  39. Gong, Y.; Ran, D.; Liu, J.; Wang, C.; Cong, T.; Wang, A.; Duan, S.; Wang, X. Figstep: Jailbreaking large vision-language models via typographic visual prompts. Proc. AAAI Conf. Artif. Intell. 2025, vol. 39, 23951–23959. [Google Scholar] [CrossRef]
  40. Goodman, B.; Flaxman, S. European union regulations on algorithmic decision-making and a “right to explanation”. AI Mag. 2017, 38(3), 50–57. [Google Scholar] [CrossRef]
  41. Greshake, K.; Abdelnabi, S.; Mishra, S.; Endres, C.; Holz, T.; Fritz, M. Not what you’ve signed up for: Compromising real-world llm-integrated applications with indirect prompt injection. In Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security (New York, NY, USA, AISec ’23, 2023; Association for Computing Machinery; pp. 79–90. [Google Scholar]
  42. Grimes, B.; et al. SoK: Bridging research and practice in LLM agent security. arXiv 2025. [Google Scholar]
  43. Guduru, S. Autonomous cyber defense: Llm-powered incident response with langchain and soar integration. J. ID 9471 2025, 1297. [Google Scholar]
  44. Habibzadeh, A.; Daghmehchi Firoozjaei, M.; Sadighian, A. Large language models for security operations centers: A comprehensive survey. arXiv 2025, arXiv:2509.10858. [Google Scholar]
  45. Hadeliya, T.; Jauhar, M. A.; Sakpal, N.; Cruz, D. When refusals fail: Unstable safety mechanisms in long-context llm agents. arXiv 2025, arXiv:2512.02445. [Google Scholar]
  46. Hassanin, M.; Moustafa, N. A comprehensive overview of large language models (LLMs) for cyber defences: Opportunities and directions. arXiv 2024, arXiv:2405.14487. [Google Scholar]
  47. He, F.; Zhu, T.; Ye, D.; Liu, B.; Zhou, W.; Yu, P. S. The emerged security and privacy of LLM agent: A survey with case studies. ACM Computing Surveys, 2025. [Google Scholar]
  48. Hines, K.; Lopez, G.; Hall, M.; Zarfati, F.; Zunger, Y.; Kiciman, E. Defending against indirect prompt injection attacks with spotlighting. arXiv 2024, arXiv:2403.14720. [Google Scholar]
  49. Huang, C.; Huang, X.; Tran, N. P.; Fard, A. M. Model context protocol threat modeling and analyzing vulnerabilities to prompt injection with tool poisoning. arXiv 2026, arXiv:2603.22489. [Google Scholar]
  50. Huang, L.; Yu, W.; Ma, W.; Zhong, W.; Feng, Z.; Wang, H.; Chen, Q.; Peng, W.; Feng, X.; Qin, B.; Liu, T. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Trans. Inf. Syst. 2025, 43(2), 1–55. [Google Scholar] [CrossRef]
  51. IBM. Qradar advisor with watson: Cognitive threat investigation for qradar security platform. 2025. Available online: https://www.ibm.com/products/qradar-siem (accessed on 2025-09-12).
  52. Institute for Experiential AI. Agentic AI: Institute for experiential AI position. Retrieved. 2025. [Google Scholar] [PubMed]
  53. International Organization for Standardization. Information security, cybersecurity and privacy protection — information security management systems — requirements, Third edition; 2022. [Google Scholar]
  54. International Organization for Standardization. Information technology — artificial intelligence — management system, First edition; 2023. [Google Scholar]
  55. Jha, R.; Triedman, H.; Wagle, J.; Shmatikov, V. Breaking and fixing defenses against control-flow hijacking in multi-agent systems. arXiv 2025, arXiv:2510.17276. [Google Scholar]
  56. Ji, Z.; Lee, N.; Frieske, R.; Yu, T.; Su, D.; Xu, Y.; Ishii, E.; Bang, Y. J.; Madotto, A.; Fung, P. Survey of hallucination in natural language generation. ACM Comput. Surv. 2023, 55(12), 1–38. [Google Scholar] [CrossRef]
  57. Jiang, S.; Kadhe, S. R.; Zhou, Y.; Cai, L.; Baracaldo, N. Forcing generative models to degenerate ones: The power of data poisoning attacks. arXiv 2023, arXiv:2312.04748. [Google Scholar]
  58. Jobin, A.; Ienca, M.; Vayena, E. The global landscape of ai ethics guidelines. Nat. Mach. Intell. 2019, 1(9), 389–399. [Google Scholar] [CrossRef]
  59. Kadavath, S.; Conerly, T.; Askell, A.; et al. Language models (mostly) know what they know. arXiv 2022, arXiv:2207.05221. [Google Scholar]
  60. Klishevich, E.; Denisov-Blanch, Y.; Obstbaum, S.; Ciobanu, I.; Kosinski, M. Measuring determinism in large language models for software code review. arXiv 2025, arXiv:2502.20747. [Google Scholar]
  61. Knerler, K.; Parker, I.; Zimmerman, C. 11 Strategies of a World-Class Cybersecurity Operations Center; MITRE Corporation: Bedford, MA, 2022. [Google Scholar]
  62. Konate, N.; Yeo, T. An agent based model for ransomware detection and mitigation in a cloud system. JIS 2024, 15, 4. [Google Scholar]
  63. KPMG. Generative AI board survey 2024. Survey report, KPMG, August 2024. [Google Scholar]
  64. Kshetri, N. Transforming cybersecurity with agentic ai to combat emerging cyber threats. Telecommun. Policy 2025, 49(6), 102976. [Google Scholar] [CrossRef]
  65. Kshetri, N. Transforming cybersecurity with agentic ai to combat emerging cyber threats. Telecommun. Policy 2025, 49(6), 102976. [Google Scholar] [CrossRef]
  66. Kumar, N. M.; Lisa, F. T.; Islam, S. R. Prompt chaining-assisted malware detection: A hybrid approach utilizing fine-tuned llms and domain knowledge-enriched cybersecurity knowledge graphs. 2024 IEEE International Conference on Big Data (BigData), 2024; pp. 1672–1677. [Google Scholar]
  67. Lazer, S. J.; Aryal, K.; Gupta, M.; Bertino, E. A survey of agentic ai and cybersecurity: Challenges, opportunities and use-case prototypes. arXiv 2026, arXiv:2601.05293. [Google Scholar]
  68. Lee, D.; Tiwari, M. Prompt infection: Llm-to-llm prompt injection within multi-agent systems. 2024. [Google Scholar] [CrossRef]
  69. Lewis, P.; Perez, E.; Piktus, A.; Petroni, F.; Karpukhin, V.; Goyal, N.; Küttler, H.; Lewis, M.; Yih, W.-t.; Rocktäschel, T.; et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv. Neural Inf. Process. Syst. 33 2020, 9459–9474. [Google Scholar]
  70. Li, X.; Liu, M.; Yuen, C. Llm agent communication protocol (lacp) requires urgent standardization: A telecom-inspired protocol is necessary. arXiv 2025, arXiv:2510.13821. [Google Scholar]
  71. Lin, X.; et al. LLM-based agents suffer from hallucinations: A survey of taxonomy, methods, and directions. arXiv 2025, arXiv:2509.18970. [Google Scholar]
  72. Liu, A.; Zhou, Y.; Liu, X.; Zhang, T.; Liang, S.; Wang, J.; Pu, Y.; Li, T.; Zhang, J.; Zhou, W.; Guo, Q.; Tao, D. Compromising llm driven embodied agents with contextual backdoor attacks. IEEE Trans. Inf. Forensics Secur. 20 2025, 3979–3994. [Google Scholar] [CrossRef]
  73. Liu, J.; et al. A comprehensive survey on long context language modeling. arXiv 2025, arXiv:2503.17407. [Google Scholar]
  74. Liu, N. F.; Lin, K.; Hewitt, J.; Paranjape, A.; Bevilacqua, M.; Petroni, F.; Liang, P. Lost in the middle: How language models use long contexts. Trans. Assoc. Comput. Linguist. 12 2024, 157–173. [Google Scholar] [CrossRef]
  75. Liu, X.; Liang, J.; Yan, Q.; Jang, J.; Mao, S.; Ye, M.; Jia, J.; Xi, Z. Cylens: Towards reinventing cyber threat intelligence in the paradigm of agentic large language models. 2025. [Google Scholar] [CrossRef]
  76. Liu, Y.; Deng, G.; Li, Y.; Wang, K.; Wang, Z.; Wang, X.; Zhang, T.; Liu, Y.; Wang, H.; Zheng, Y.; Zhang, L. Y.; Liu, Y. Prompt injection attack against llm-integrated applications. 2025. [Google Scholar] [CrossRef]
  77. Lyngaas, S. Crowdstrike report: Average ’breakout time’ for cyberattacks drops to 62 minutes. CyberScoop. Accessed. Feb 2024. (accessed on 2026-02-27).
  78. Ma, Z.; Kim, D. J.; Chen, T.-H. P. Librelog: Accurate and efficient unsupervised log parsing using open-source large language models. 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE), 2025; pp. 924–936. [Google Scholar]
  79. Mallen, A.; Asai, A.; Zhong, V.; Das, R.; Khashabi, D.; Hajishirzi, H. When not to trust language models: Investigating effectiveness of parametric and non-parametric memories. Proc. 61st Annu. Meet. Assoc. Comput. Linguist. 2023, Volume 1, 9802–9822. [Google Scholar] [CrossRef]
  80. McHugh, J.; Šekrst, K.; Cefalu, J. Prompt injection 2.0: Hybrid ai threats. arXiv 2025, arXiv:2507.13169. [Google Scholar]
  81. Mehrabi, N.; Morstatter, F.; Saxena, N.; Lerman, K.; Galstyan, A. A survey on bias and fairness in machine learning. ACM Comput. Surv. (CSUR) 2021, 54(6), 1–35. [Google Scholar] [CrossRef]
  82. Microsoft. Security copilot: Task-specific agents for investigation, triage, and remediation. 2025. Available online: https://www.microsoft.com/en-us/security/business/ai-machine-learning/microsoft-security-copilot (accessed on 2025-09-12).
  83. Microsoft AI Red Team. Taxonomy of failure mode in agentic AI systems. In Tech. rep.; Microsoft; Whitepaper, Apr 2025. [Google Scholar]
  84. Mitchell, M.; Wu, S.; Zaldivar, A.; Barnes, P.; Vasserman, L.; Hutchinson, B.; Spitzer, E.; Raji, I. D.; Gebru, T. Model cards for model reporting. In Proceedings of the conference on fairness, accountability, and transparency, 2019; pp. 220–229. [Google Scholar]
  85. Mitra, S.; Bazarov, A.; Duclos, M.; Mittal, S.; Piplai, A.; Rahman, M. R.; Zieglar, E.; Rahimi, S. Falcon: Autonomous cyber threat intelligence mining with llms for ids rule generation. 2025. [Google Scholar] [CrossRef]
  86. Mitra, S.; Neupane, S.; Chakraborty, T.; Mittal, S.; Piplai, A.; Gaur, M.; Rahimi, S. Localintel: Generating organizational threat intelligence from global and local cyber knowledge. International Symposium on Foundations and Practice of Security, 2024; Springer; pp. 63–78. [Google Scholar]
  87. Mitra, S.; Patel, R.; Mittal, S.; Rahman, M. R.; Rahimi, S. Agenticcyops: Securing multi-agentic ai integration in enterprise cyber operations. arXiv 2026, arXiv:2603.09134. [Google Scholar]
  88. MITRE. MITRE ATT&CK Campaigns. 2025. Available online: https://attack.mitre.org/campaigns (accessed on 11 September 2025).
  89. MITRE. MITRE ATT&CK Groups. 2025. Available online: https://attack.mitre.org/groups (accessed on 11 September 2025).
  90. Mökander, J.; Schuett, J.; Kirk, H. R.; Floridi, L. Auditing large language models: a three-layered approach. AI Ethics 2024, 4(4), 1085–1115. [Google Scholar] [CrossRef]
  91. Motwani, S. R.; Baranchuk, M.; Strohmeier, M.; Bolina, V.; Torr, P. H.; Hammond, L.; de Witt, C. S. Secret collusion among ai agents: Multi-agent deception via steganography. Adv. Neural Inf. Process. Syst. 37 2024, 73439–73486. [Google Scholar] [CrossRef]
  92. Nasr, M.; Carlini, N.; Sitawarin, C.; Schulhoff, S. V.; Hayes, J.; Ilie, M.; Pluto, J.; Song, S.; Chaudhari, H.; Shumailov, I.; Thakurta, A.; Xiao, K. Y.; Terzis, A.; Tramèr, F. The attacker moves second: Stronger adaptive attacks bypass defenses against LLM jailbreaks and prompt injections. arXiv Authors from OpenAI, Anthropic, and Google DeepMind. 2025, arXiv:2510.09023. [Google Scholar]
  93. National Institute of Standards and Technology. Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). Companion to NIST AI RMF 1.0. 2024. [Google Scholar] [PubMed]
  94. National Institute of Standards and Technology. NIST cybersecurity framework (CSF) 2.0. In Tech. rep., NIST; 2024. [Google Scholar]
  95. Networks, P. A. Cortex xsiam / cortex ai: Unified detection-response platform. 2025. Available online: https://www.paloaltonetworks.com/cortex/cortex-xsiam (accessed on 2025-09-12).
  96. Networks, P. A. Security operations center (soc) roles and responsibilities. 2025. Available online: https://www.paloaltonetworks.com/cyberpedia/soc-roles-and-responsibilities (accessed on 2025-09-11).
  97. Nguyen, T. T.; Huynh, T. T.; Ren, Z.; Nguyen, P. L.; Liew, A. W.-C.; Yin, H.; Nguyen, Q. V. H. A survey of machine unlearning. ACM Trans. Intell. Syst. Technol. 2025, 16(5), 1–46. [Google Scholar] [CrossRef]
  98. Nolan, B. An ai agent destroyed this coder’s entire database. he’s not the only one with a horror story. Fortune. Accessed. Mar 2026. (accessed on 2026-03-30).
  99. NVIDIA. Agentic autonomy levels and security. NVIDIA Technical Blog. Accessed. 2025. (accessed on April 2026).
  100. of Standards, N. I.; Technology. Nist ai 100-4: Taxonomy and terminology of ai risks. 2024. Available online: https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-2e2025.pdf (accessed on 2025-09-11).
  101. Packer, C.; Fang, V.; Patil, S.; Lin, K.; Wooders, S.; Gonzalez, J. Memgpt: towards llms as operating systems. [CrossRef]
  102. Parasuraman, R.; Manzey, D. H. Complacency and bias in human use of automation: An attentional integration. Hum. Factors J. Hum. Factors Ergon. Soc. 2010, 52(3), 381–410. [Google Scholar] [CrossRef] [PubMed]
  103. Parasuraman, R.; Sheridan, T. B.; Wickens, C. D. A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man. Cybern.-Part A Syst. Hum. 2000, 30(3), 286–297. [Google Scholar] [CrossRef] [PubMed]
  104. Patil, S. G.; Zhang, T.; Wang, X.; Gonzalez, J. E. Gorilla: Large language model connected with massive apis. Adv. Neural Inf. Process. Syst. 37 2024, 126544–126565. [Google Scholar] [CrossRef]
  105. Perez, F.; Ribeiro, I. Ignore previous prompt: Attack techniques for language models. arXiv 2022, arXiv:2211.09527. [Google Scholar]
  106. Qi, Y.; Peng, H.; Wang, X.; Xin, A.; Liu, Y.; Xu, B.; Hou, L.; Li, J. Agentif: Benchmarking large language models instruction following ability in agentic scenarios. Adv. Neural Inf. Process. Syst. 38 2026. [Google Scholar] [CrossRef]
  107. Raji, I. D.; Smart, A.; White, R. N.; Mitchell, M.; Gebru, T.; Hutchinson, B.; Smith-Loud, J.; Theron, D.; Barnes, P. Closing the ai accountability gap: Defining an end-to-end framework for internal algorithmic auditing. In Proceedings of the 2020 conference on fairness, accountability, and transparency, 2020; pp. 33–44. [Google Scholar]
  108. Rasmussen, J. Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Trans. Syst. Man. Cybern. 1983, 3, 257–266. [Google Scholar] [CrossRef]
  109. Rehberger, J. ASCII smuggler: Crafting invisible text and decoding hidden codes. Microsoft 365 Copilot data exfiltration disclosure. 2024. Available online: https://embracethered.com/blog/posts/2024/hiding-and-finding-text-with-unicode-tags/.
  110. Reis, J.; Areias, M.; G. Barbosa, J. Large language model framework for log sequence anomaly detection. In Progress in Artificial Intelligence (Cham; Valente de Oliveira, J., Leite, J., Rodrigues, J., Dias, J., Cardoso, P., Eds.; Springer Nature Switzerland, 2026; pp. 324–334. [Google Scholar]
  111. ReliaQuest. Reliaquest greymatter agentic ai security operations platform. 2025. Available online: https://reliaquest.com/security-operations-platform/ (accessed on 2025-09-12).
  112. Ren, H.; Lan, K.; Sun, Z.; Liao, S. Clogllm: A large language model enabled approach to cybersecurity log anomaly analysis. 2024 4th International Conference on Electronic Information Engineering and Computer Communication (EIECC), 2024; pp. 963–970. [Google Scholar]
  113. Rose, S.; Borchert, O.; Mitchell, S.; Connelly, S. 2020. Zero trust architecture (NIST special publication 800-207). Tech. rep. National Institute of Standards and Technology. [Google Scholar]
  114. Roy, J.; Singh, S. K. Agentsoc: A multi-layer agentic ai framework for security operations automation. In 2026 IEEE 5th International Conference on AI in Cybersecurity (ICAIC); IEEE, 2026; pp. 1–7. [Google Scholar]
  115. Santoni, C. Contextual memory virtualisation: Dag-based state management and structurally lossless trimming for llm agents. arXiv 2026, arXiv:2602.22402. [Google Scholar]
  116. Sclar, M.; Choi, Y.; Tsvetkov, Y.; Suhr, A. Quantifying language models’ sensitivity to spurious features in prompt design or: How I learned to start worrying about prompt formatting. The Twelfth International Conference on Learning Representations (ICLR), 2024. [Google Scholar]
  117. SentinelOne. Purple AI: Generative AI for cybersecurity. 2025. Available online: https://www.sentinelone.com/platform/purple-ai/.
  118. Shahriar, A.; et al. A survey on agentic security: Applications, threats and defenses. arXiv 2025, arXiv:2510.06445. [Google Scholar]
  119. Shekkizhar, S.; Cosentino, R.; Earle, A.; Savarese, S. Echoing: Identity failures when llm agents talk to each other. arXiv 2025, arXiv:2511.09710. [Google Scholar]
  120. Sheng, Z.; Chen, Z.; Gu, S.; Huang, H.; Gu, G.; Huang, J. Llms in software security: A survey of vulnerability detection techniques and insights. arXiv 2025, arXiv:2502.07049. [Google Scholar]
  121. Shinn, N.; Cassano, F.; Gopinath, A.; Narasimhan, K.; Yao, S. Reflexion: Language agents with verbal reinforcement learning. Adv. Neural Inf. Process. Syst. 36 2023, 8634–8652. [Google Scholar] [CrossRef]
  122. Singh, A. V.; Rathbun, E.; Graham, E.; Oakley, L.; Boboila, S.; Oprea, A.; Chin, P. Hierarchical multi-agent reinforcement learning for cyber network defense. arXiv 2024, arXiv:2410.17351. [Google Scholar]
  123. Siva Kumar, R. S.; O’Brien, D.; Albert, K.; Viljöen, S.; Snover, J. Failure modes in machine learning systems. arXiv 2019, arXiv:1911.11034. [Google Scholar]
  124. Song, Y.; Wang, G.; Li, S.; Lin, B. Y. The good, the bad, and the greedy: Evaluation of llms should not ignore non-determinism. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies 2025, Volume 1, 4195–4206. [Google Scholar] [CrossRef]
  125. Splunk. Splunk AI assistant and SOAR. 2025. Available online: https://www.splunk.com/en_us/products/artificial-intelligence.html.
  126. Srinivas, S.; Kirk, B.; Zendejas, J.; Espino, M.; Boskovich, M.; Bari, A.; Dajani, K.; Alzahrani, N. Ai-augmented soc: A survey of llms and agents for security automation. J. Cybersecur. Priv. 2025, 5(4), 95. [Google Scholar] [CrossRef]
  127. Standen, M.; Lucas, M.; Bowman, D.; Richer, T. J.; Kim, J.; Marriott, D. Cyborg: A gym for the development of autonomous cyber agents. arXiv 2021, arXiv:2108.09118. [Google Scholar]
  128. Su, Y.; Xu, K.; Gao, Y.; Yang, F.; Li, C.; Yang, M.; Xu, T. Neuro-symbolic verification on instruction following of llms. arXiv 2026, arXiv:2601.17789. [Google Scholar]
  129. Sung, Y. Y.; Kim, H.; Zhang, D. Verila: A human-centered evaluation framework for interpretable verification of llm agent failures. arXiv 2025, arXiv:2503.12651. [Google Scholar]
  130. Tang, Y.; Liu, Y.; Lan, J.; Yan, Z.; Gelenbe, E. Security of llm-based agents regarding attacks, defenses, and applications: A comprehensive survey. Inf. Fusion 2025, 103941. [Google Scholar] [CrossRef]
  131. The MITRE Corporation. D3FEND: A knowledge graph of cybersecurity countermeasures. Tech. rep., MITRE Corporation, 2024. [Google Scholar]
  132. Assure, Total. Average time to detect a cyber attack 2025: Critical detection statistics every business must know. Total Assure Blog. Accessed. Nov 2025. (accessed on 2025-02-27).
  133. Trellix. What is a security operations center (soc)? 2025. Available online: https://www.trellix.com/security-awareness/operations/what-is-soc/ (accessed on 2025-09-11).
  134. Triedman, H.; Jha, R.; Shmatikov, V. Multi-agent systems execute arbitrary malicious code. arXiv 2025, arXiv:2503.12188. [Google Scholar]
  135. Turcotte, M.; Labrèche, F.; Paquette, S.-O. Automated alert classification and triage (aact): an intelligent system for the prioritisation of cybersecurity alerts. arXiv 2025, arXiv:2505.09843. [Google Scholar]
  136. Vielberth, M.; Böhm, F.; Fichtinger, I.; Pernul, G. Security operations center: A systematic study and open challenges. Ieee Access 8 2020, 227756–227779. [Google Scholar] [CrossRef]
  137. Vinay, V. The evolution of agentic AI in cybersecurity: From single LLM reasoners to multi-agent systems and autonomous pipelines. arXiv 2025, arXiv:2512.06659. [Google Scholar]
  138. Vinay, V. Failure modes in llm systems: A system-level taxonomy for reliable ai applications. arXiv 2025, arXiv:2511.19933. [Google Scholar]
  139. Wallace, E.; Xiao, K.; Leike, R.; Weng, L.; Heidecke, J.; Beutel, A. The instruction hierarchy: Training LLMs to prioritize privileged instructions. arXiv OpenAI; accepted at NeurIPS 2024 SoLaR Workshop. 2024, arXiv:2404.13208. [Google Scholar]
  140. Wang, H.; Poskitt, C. M.; Sun, J. Agentspec: Customizable runtime enforcement for safe and reliable llm agents. arXiv 2025, arXiv:2503.18666. [Google Scholar]
  141. Wang, X.; Yang, X.; Liang, X.; Zhang, X.; Zhang, W.; Gong, X. Combating alert fatigue with alertpro: Context-aware alert prioritization using reinforcement learning for multi-step attack detection. Comput. Secur. 137 2024, 103583. [Google Scholar]
  142. Wang, Y.; Xue, D.; Zhang, S.; Qian, S. BadAgent: Inserting and activating backdoor attacks in LLM agents. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics; Ku, L.-W., Martins, A., Srikumar, V., Eds.; Association for Computational Linguistics, Aug 2024; Volume 1, pp. 9811–9827. [Google Scholar]
  143. Wei, B.; Tay, Y. S.; Liu, H.; Pan, J.; Luo, K.; Zhu, Z.; Jordan, C. Cortex: Collaborative llm agents for high-stakes alert triage. arXiv 2025, arXiv:2510.00311. [Google Scholar]
  144. Xiao, Y.; Le, V.-H.; Zhang, H. Demonstration-free: Towards more practical log parsing with large language models. Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering (New York, NY, USA 2024, ASE ’24, 153–165. [Google Scholar] [CrossRef]
  145. Xiong, M.; Hu, Z.; Lu, X.; Li, Y.; Fu, J.; He, J.; Hooi, B. Can LLMs express their uncertainty? an empirical evaluation of confidence elicitation in LLMs. The Twelfth International Conference on Learning Representations (ICLR), 2024. [Google Scholar]
  146. Xu, M.; Fan, J.; Huang, X.; Zhou, C.; Kang, J.; Niyato, D.; Mao, S.; Han, Z.; Lam, K.-Y.; et al. Forewarned is forearmed: A survey on large language model-based agents in autonomous cyberattacks. arXiv 2025, arXiv:2505.12786. [Google Scholar]
  147. Xu, T.; Wen, Z.; Zhao, X.; Wang, J.; Li, Y.; Liu, C. L2m-aid: Autonomous cyber-physical defense by fusing semantic reasoning of large language models with multi-agent reinforcement learning (preprint). arXiv 2025, arXiv:2510.07363. [Google Scholar]
  148. Yang, X.; Zhou, B.; Tang, X.; Han, J.; Hu, S. Exploiting synergistic cognitive biases to bypass safety in llms. arXiv 2025, arXiv:2507.22564. [Google Scholar]
  149. Yao, S.; Zhao, J.; Yu, D.; Du, N.; Shafran, I.; Narasimhan, K.; Cao, Y. React: Synergizing reasoning and acting in language models. International Conference on Learning Representations (ICLR), 2023. [Google Scholar]
  150. Zou, A.; Wang, Z.; Carlini, N.; Nasr, M.; Kolter, J. Z.; Fredrikson, M. Universal and transferable adversarial attacks on aligned language models. arXiv 2023, arXiv:2307.15043. [Google Scholar]
  151. Zou, W.; Geng, R.; Wang, B.; Jia, J. {PoisonedRAG}: Knowledge corruption attacks to {Retrieval-Augmented} generation of large language models. 34th USENIX Security Symposium (USENIX Security 25), 2025; pp. 3827–3844. [Google Scholar]
Figure 1. Survey methodology and section navigation. Sources were organized under two analytical frameworks: agentic taxonomy (§ Section 4) and the cyberops lifecycle (§ Section 5). These jointly govern downstream sections: Applications (§ Section 6) are evaluated through a lens of task application; industry analysis (§ Section 7) investigates research–practice sync; Compliance (§ Section 8) emerges as a consequence layer of prior; and open challenges (§ Section 9) synthesize gaps across all preceding sections. Dashed arrows indicate feedback and cross-section synthesis.
Figure 1. Survey methodology and section navigation. Sources were organized under two analytical frameworks: agentic taxonomy (§ Section 4) and the cyberops lifecycle (§ Section 5). These jointly govern downstream sections: Applications (§ Section 6) are evaluated through a lens of task application; industry analysis (§ Section 7) investigates research–practice sync; Compliance (§ Section 8) emerges as a consequence layer of prior; and open challenges (§ Section 9) synthesize gaps across all preceding sections. Dashed arrows indicate feedback and cross-section synthesis.
Preprints 227964 g001
Figure 2. Agentic AI architecture and failure taxonomy. (A) Single-agent workflow illustrating interactions among the external environment, reasoning engine, tools, and memory across five phases. (B) Three causal failure categories: natural, system, and adversarial — with compliance as a consequence failure. (C) Sub-category breakdown showing specific failure cases within each causal category.
Figure 2. Agentic AI architecture and failure taxonomy. (A) Single-agent workflow illustrating interactions among the external environment, reasoning engine, tools, and memory across five phases. (B) Three causal failure categories: natural, system, and adversarial — with compliance as a consequence failure. (C) Sub-category breakdown showing specific failure cases within each causal category.
Preprints 227964 g002
Figure 3. Natural failure sub-categories mapped to system architecture sources (rows) and agentic lifecycle phases (columns). Bar span indicates where each inherent limitation manifests during agent execution. Perception is affected by all four limitation sources; Memory is affected exclusively by architectural constraints (Section 4.2.1). Input quality failures are confined to the Perception phase.
Figure 3. Natural failure sub-categories mapped to system architecture sources (rows) and agentic lifecycle phases (columns). Bar span indicates where each inherent limitation manifests during agent execution. Perception is affected by all four limitation sources; Memory is affected exclusively by architectural constraints (Section 4.2.1). Input quality failures are confined to the Perception phase.
Preprints 227964 g003
Figure 4. System failure sub-categories mapped to MAST empirical categories and agentic lifecycle phases. Bar span indicates where each engineering deficiency manifests. Action is the most frequently affected phase across the eight sub-categories.
Figure 4. System failure sub-categories mapped to MAST empirical categories and agentic lifecycle phases. Bar span indicates where each engineering deficiency manifests. Action is the most frequently affected phase across the eight sub-categories.
Preprints 227964 g004
Figure 5. Adversarial failure sub-categories mapped to NIST GenAI security compromise dimensions (rows) and agentic lifecycle phases (columns). Bar span indicates directly compromised phases; the same sub-category may target different phases depending on the dimension affected. Integrity is targeted by all six sub-categories; availability is compromised exclusively by resource attacks (A.6).
Figure 5. Adversarial failure sub-categories mapped to NIST GenAI security compromise dimensions (rows) and agentic lifecycle phases (columns). Bar span indicates directly compromised phases; the same sub-category may target different phases depending on the dimension affected. Integrity is targeted by all six sub-categories; availability is compromised exclusively by resource attacks (A.6).
Preprints 227964 g005
Figure 6. Defensive cybersecurity operations workflow organized under three lifecycle phases: Detection (left), Analysis (center), and Eradication (right). Detection encompasses multi-source telemetry ingestion and produces data for downstream processing. Analysis progresses through data collection and cleaning, RCA, and pattern matching before synthesizing into a threat report; throughout, analysts draw on threat repositories and on operational frameworks as references. In an eradication, security analysts enforce the containment decisions and policy updates. Outer feedback arrows represent knowledge sharing operating as a cross-cutting mechanism: IoC, TTPs, and refined detection rules propagate back into the detection phase, completing the iterative cycle.
Figure 6. Defensive cybersecurity operations workflow organized under three lifecycle phases: Detection (left), Analysis (center), and Eradication (right). Detection encompasses multi-source telemetry ingestion and produces data for downstream processing. Analysis progresses through data collection and cleaning, RCA, and pattern matching before synthesizing into a threat report; throughout, analysts draw on threat repositories and on operational frameworks as references. In an eradication, security analysts enforce the containment decisions and policy updates. Outer feedback arrows represent knowledge sharing operating as a cross-cutting mechanism: IoC, TTPs, and refined detection rules propagate back into the detection phase, completing the iterative cycle.
Preprints 227964 g006
Figure 7. Hierarchical derivation of the compliance failure taxonomy. Four dimensions consolidate four of the five converged AI ethics principles identified by Jobin et al. [58]; non-maleficence is treated upstream as technical failure (Section 4.2).
Figure 7. Hierarchical derivation of the compliance failure taxonomy. Four dimensions consolidate four of the five converged AI ethics principles identified by Jobin et al. [58]; non-maleficence is treated upstream as technical failure (Section 4.2).
Preprints 227964 g007
Figure 8. Unified governable MAS architecture for defensive cyberoperations, integrating the eight research directions (R-1–R-8) across the collaborative agent fabric, assurance and verification mesh, truth-and-memory substrate, and continuous-governance layers.
Figure 8. Unified governable MAS architecture for defensive cyberoperations, integrating the eight research directions (R-1–R-8) across the collaborative agent fabric, assurance and verification mesh, truth-and-memory substrate, and continuous-governance layers.
Preprints 227964 g008
Table 1. Comparison of related surveys. Feature columns indicate coverage; summarized focus, key contributions, and limitations.
Table 1. Comparison of related surveys. Feature columns indicate coverage; summarized focus, key contributions, and limitations.
Preprints 227964 i016
= covered = partially covered — = not covered
Table 2. Agentic autonomy levels classification, adapted from the NVIDIA Agentic Autonomy framework [99]. These autonomy levels are referenced throughout Section 5 and Section 6 to characterize capability-driven task suitability and deployment risk trade-offs.
Table 2. Agentic autonomy levels classification, adapted from the NVIDIA Agentic Autonomy framework [99]. These autonomy levels are referenced throughout Section 5 and Section 6 to characterize capability-driven task suitability and deployment risk trade-offs.
Level Designation Functional Capability Control Flow Security Boundary When to Use
0 Inference API Single request, single inference call, single model. Linear; no branching. Bounded; standard API surface. Static, repeatable classification with known inputs.
1 Deterministic Multiple inference calls in a fixed, predetermined order. Linear chain; fully enumerable. Tractable; manually traceable. Standardized workflows with stable, predictable steps.
2 Weakly Autonomous AI selects among predefined branches at fixed decision points. Directed acyclic graph; finitely enumerable. Enumerable; analyzable per path. Variable inputs requiring branching but bounded by policy.
3 Fully Autonomous AI freely decides when and how to invoke tools or revise plans. Cyclic; exponentially many paths. Intractable; taint tracing required. Open-ended tasks requiring planning, reflection, and adaptation.
Table 3. Natural failure modes of agentic AI systems. Each mode is mapped to the agentic lifecycle phase(s) where it manifests, applicability to single-agent (S) and multi-agent (M) systems, and representative references. All 16 modes apply to both single- and multi-agent configurations, as natural failures are properties of the underlying model and architecture rather than of system topology. Perception and Planning is the most frequently affected phase, suggesting in semantics and reasoning limitations of LLMs.
Table 3. Natural failure modes of agentic AI systems. Each mode is mapped to the agentic lifecycle phase(s) where it manifests, applicability to single-agent (S) and multi-agent (M) systems, and representative references. All 16 modes apply to both single- and multi-agent configurations, as natural failures are properties of the underlying model and architecture rather than of system topology. Perception and Planning is the most frequently affected phase, suggesting in semantics and reasoning limitations of LLMs.
Preprints 227964 i007
Table 4. System failure modes of agentic AI systems. Action is the most frequently affected phase, appearing in 16 of 31 modes. Ten modes (✗ in S) are exclusive to MAS, concentrated in inter-agent coordination (S.3) and workflow orchestration (S.2).
Table 4. System failure modes of agentic AI systems. Action is the most frequently affected phase, appearing in 16 of 31 modes. Ten modes (✗ in S) are exclusive to MAS, concentrated in inter-agent coordination (S.3) and workflow orchestration (S.2).
Preprints 227964 i008
Security Implications: First, the empirical record places blame on engineering rather than model capability. The MAST study [16], analyzing 1,642 traces across seven multi-agent frameworks, identifies task specification violation as the single most prevalent mode and shows that specification and coordination deficiencies dominate observed breakdowns. Numerous works [87,115,119,129] find that documented system failure vectors consistently trace back to action/integration surfaces, namely tool orchestration and memory management emerging as mitigation fault lines.
Table 5. Adversarial failure modes. Action is the most frequently targeted phase, appearing in 18 of 25 modes; Six modes (✗ in S) are exclusive to multi-agent systems, concentrated in inter-agent exploitation and MAS variants of output and resource attacks.
Table 5. Adversarial failure modes. Action is the most frequently targeted phase, appearing in 18 of 25 modes; Six modes (✗ in S) are exclusive to multi-agent systems, concentrated in inter-agent exploitation and MAS variants of output and resource attacks.
Preprints 227964 i009
Table 6. Mitigation strategies and compliance alignment. Each sub-category is addressed by at least two independent techniques.
Table 6. Mitigation strategies and compliance alignment. Each sub-category is addressed by at least two independent techniques.
Preprints 227964 i010
Table 7. Operational task classification for defensive cybersecurity operations. Tasks are organized by lifecycle phase and classified by cognitive demand (Mechanical / Cognitive / Composite) and automation feasibility (High / Moderate / Low). Feasibility reflects the combination of reasoning requirements, consequence severity, and action reversibility rather than computational complexity alone.
Table 7. Operational task classification for defensive cybersecurity operations. Tasks are organized by lifecycle phase and classified by cognitive demand (Mechanical / Cognitive / Composite) and automation feasibility (High / Moderate / Low). Feasibility reflects the combination of reasoning requirements, consequence severity, and action reversibility rather than computational complexity alone.
Preprints 227964 i011
Mechanical: rule-deterministic. Composite: mechanical + cognitive judgment. Cognitive: reasoning-intensive. High: minimal oversight. Moderate: human validation required. Low: human-in-the-loop mandatory.
Table 8. Agentic automation profile for defensive cyberops. For each task, table traces the chain from tools and memory requirements through autonomy level (Table 2) and failure exposures (Section 4) to the resulting oversight regime. Autonomy levels marked (constrained) indicate that the underlying reasoning capability could support a higher level but is bounded down by irreversibility or compliance requirements. Mitigation modes and compliance anchors per failure sub-category are catalogued in Table 6.
Table 8. Agentic automation profile for defensive cyberops. For each task, table traces the chain from tools and memory requirements through autonomy level (Table 2) and failure exposures (Section 4) to the resulting oversight regime. Autonomy levels marked (constrained) indicate that the underlying reasoning capability could support a higher level but is bounded down by irreversibility or compliance requirements. Mitigation modes and compliance anchors per failure sub-category are catalogued in Table 6.
Preprints 227964 i012
Failure mode IDs reference Section 4. Mitigation modes and compliance anchors per sub-category are listed in Table 6. Mandatory: human approval before execution. Advisory: analyst validates before consequential action. Minimal: autonomous within bounded scope.
Table 9. Defensive cybersecurity research utilizing agentic capabilities for classified five categories with failure modes and mitigation.
Table 9. Defensive cybersecurity research utilizing agentic capabilities for classified five categories with failure modes and mitigation.
Preprints 227964 i013
Table 10. Commercial offerings, grouped by commercial sub-directions and mapped to § Section 6 categories. Status are vendor-reported.
Table 10. Commercial offerings, grouped by commercial sub-directions and mapped to § Section 6 categories. Status are vendor-reported.
Preprints 227964 i014
Table 11. Compliance failure modes with regulatory frameworks, upstream technical failure triggers from Section 4, and mitigations.
Table 11. Compliance failure modes with regulatory frameworks, upstream technical failure triggers from Section 4, and mitigations.
Preprints 227964 i015
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.