Preprint
Article

This version is not peer-reviewed.

Evidence-Grounded Hybrid Agentic AI for Trustworthy AI Risk Communication Assessment in SEC Form 10-K Disclosures

Submitted:

18 November 2026

Posted:

19 November 2026

You are already at the latest version

Abstract
Public companies increasingly communicate risks related to artificial intelligence (AI), machine learning, automation, algorithmic decision-making, data privacy, security, bias, and regulatory uncertainty in annual risk-factor disclosures. However, assessing whether these AI-risk and trustworthy-AI communication claims are specific, evidence-grounded, or largely boilerplate remains difficult because Form 10-K Item 1A disclosures combine forward-looking risk language, legal disclaimers, product descriptions, governance statements, and uncertain regulatory developments. This study develops an evidence-grounded hybrid agentic AI framework for assessing AI risk communication in SEC Form 10-K disclosures. The task is framed as textual support assessment rather than an independent determination of a company's actual AI risk exposure, legal compliance, product safety, or trustworthiness. Using a corpus of 160 Form 10-K filings collected from SEC EDGAR, we identify 101 filings with AI-related Item 1A risk-factor language and construct an 80-claim manually annotated gold sample across 48 companies. We compare five approaches: a transparent rule-based baseline, a TF-IDF retrieval baseline, a single-prompt large language model (LLM) baseline, a pure multi-agent reasoning baseline, and the proposed hybrid agentic adjudication method. The hybrid method achieves the strongest performance on trustworthiness-dimension classification and evidence-support assessment, with 0.725 dimension accuracy, 0.667 dimension macro-F1, 0.750 support accuracy, and 0.734 support macro-F1. We further add an explainability and auditability analysis using claim-level audit traces and a SHAP-based structured-feature surrogate for supported versus non-supported evidence labels. The findings suggest that evidence-grounded hybrid agentic AI can support auditable analysis of trustworthy-AI risk communication, while also showing that direct LLM prompting can be poorly calibrated for evidence-support judgments.
Keywords: 
;  ;  ;  ;  ;  ;  ;  
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.