Submitted:
03 June 2026
Posted:
04 June 2026
You are already at the latest version
Abstract
Keywords:
I. Introduction
- Horizon: a high-recall search over the document pool surfaces candidates without committing to their relevance.
- Warrant: an LLM agent explicitly evaluates each candidate via structured function calls, applying a Result Relevance Rule and a Knowledge Gap Recognition Rule.
- Commitment: only warrant-approved passages enter the CommitmentStore, which serves as the exclusive context for answer generation.
II. Related Work
A. Retrieval-Augmented Generation
B. Adaptive and Corrective RAG
C. RAG Evaluation
D. Epistemic Foundations
III. A Taxonomy of RAG Failure Modes
IV. Pool-Gated Retrieval Architecture
A. Overview

B. Stage 1 — Horizon (High-Recall Pool Search)
- retrieve_knowledge(query): issue a precision search against the Pool (threshold θW > θH; top-k = 5). Returns full document content and metadata.
- commit_facts(doc_ids, reason): commit one or more retrieved documents to the CommitmentStore with an explicit justification.
- declare_knowledge_gap(query, reason): register a confirmed absence in the CommitmentStore with an explanation.
D. Stage 3 — Commitment and Answer Generation
V. Implementation
A. Package Structure
- Pool: document store with Horizon search (cosine similarity over Pandas DataFrame) and precision retrieval. Supports save/load for persistence.
- WarrantGate: implements the LLM Warrant loop using OpenAI function-calling. Enforces the KGRR by blocking repeated queries for confirmed gaps.
- CommitmentStore: holds Committed Facts and Knowledge Gaps. Exposes as_context() for answer generation and summary() for inspection.
- PGRAgent: orchestrates the full H→W→C pipeline and returns a PGRResult with the answer, CommitmentStore, and provenance trace.
- PGRResult: encapsulates the full reasoning episode, including horizon_count, committed facts, and gaps.
B. LLM Integration
C. Design Decisions
VI. Experimental Evaluation
A. Setup
VIII. Conclusion
References
- P. Lewis et al., “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,” Advances in Neural Information Processing Systems (NeurIPS), vol. 33, pp. 9459–9474, 2020.
- A. Asai, Z. Wu, Y. Wang, A. Sil, and H. Hajishirzi, “Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection,” in Proc. International Conference on Learning Representations (ICLR), 2024.
- S.-Y. Yan, Q. Gu, Y. Zhu, and Z. Ling, “Corrective Retrieval Augmented Generation,” arXiv preprint arXiv:2401.15884, 2024.
- L. Gao, X. Ma, J. Lin, and J. Callan, “Precise Zero-Shot Dense Retrieval without Relevance Labels,” in Proc. Annual Meeting of the Association for Computational Linguistics (ACL), pp. 1762–1777, 2023.
- A. Raudaschl, “RAG-Fusion: A New Take on Retrieval-Augmented Generation,” arXiv preprint arXiv:2402.03367, 2024.
- Y. Gao et al., “Retrieval-Augmented Generation for Large Language Models: A Survey,” arXiv preprint arXiv:2312.10997, 2023.
- M. H. Kim, “Epistemic Architecture of Accountable Artificial Agents: Justified Acceptance Paths and the Horizon-Warrant-Commitment Framework,” PhilSci Archive 29762, 2026.
- K. Formal, C. Piwowarski, B. Piwowarski, and S. Clinchant, “SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking,” in Proc. ACM SIGIR, pp. 2288–2292, 2021.
- Z. Jiang, F. F. Xu, L. Gao, Z. Sun, Q. Liu, J. Dwivedi-Yu, Y. Yang, J. Callan, and G. Neubig, “Active Retrieval Augmented Generation,” in Proc. EMNLP, pp. 7969–7992, 2023.
- S. Es, J. James, L. Espinosa-Anke, and S. Schockaert, “RAGAS: Automated Evaluation of Retrieval Augmented Generation,” in Proc. EACL (System Demonstrations), pp. 150–158, 2024.
- A. I. Goldman, “What Is Justified Belief?,” in G. S. Pappas (Ed.), Justification and Knowledge. D. Reidel, pp. 1–23, 1979.
- E. L. Gettier, “Is Justified True Belief Knowledge?,” Analysis, vol. 23, no. 6, pp. 121–123, 1963.
| ID | Failure Mode | Description |
| F-1 | Similarity ≠ Relevance | High cosine score does not imply semantic relevance; topic-adjacent passages are injected without entity verification. |
| F-2 | Chunk Boundary Truncation | Fixed-size chunking severs logical units (cause–effect, conditional) across chunk boundaries. |
| F-3 | Over-retrieval | Large top-k injects noisy or contradictory passages, increasing hallucination risk. |
| F-4 | Under-retrieval | Strict thresholds or small top-k silently omit necessary passages; the system proceeds without them. |
| F-5 | Context Contamination | Passages from different time periods, sources, or entities co-occur in a single context window. |
| F-6 | Absence Hallucination | When no passage exists for a queried entity, the LLM silently draws on parametric knowledge without disclosure. |
| F-7 | Attribution Opacity | No causal link exists between a generated sentence and the specific passage that warranted it. |
| F-8 | No Feedback Loop | Retrieval failures are not recorded; the system cannot adapt within or across turns. |
| Metric | Naive RAG | PGR (ours) | Notes |
| Correct Crestwood fact cited | Yes | Yes | Both systems cite 88% |
| Northgate employment figure fabricated | No* | No | *gpt-5.2 declined; weaker models fabricate |
| Absence structurally declared | No | Yes | KG registered in CommitmentStore |
| Audit trail (source + query + score) | No | Yes | Full H→W→C provenance logged |
| Committed facts | — | 1 | crestwood.edu/outcomes (score 0.488) |
| Knowledge gaps registered | 0 | 1 | Northgate employment rate |
| Retrieve calls (Warrant loop) | — | 2 | Crestwood + Northgate; loop terminated |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).