Submitted:
06 July 2026
Posted:
08 July 2026
You are already at the latest version
Abstract

Keywords:
1. Introduction
- 1.
- Synaptic Tagging: sparse temporal gates identify which 1-second observation windows drove the prediction;
- 2.
- Evidence Encoding: tagged window content is consolidated into compact memory representations;
- 3.
- Reverse Replay: causal validation via removal experiments proves tags reflect genuine model reliance;
- 4.
- Spatial Context: lane geometry is integrated to ground predictions in road structure;
- 5.
- Constructive Retrieval: mode-specific attention over tagged evidence explains why each trajectory mode was selected.
- To the authors’ knowledge, the first motion forecasting model with causally validated temporal explanations, addressing the credit assignment problem in the driving domain;
- A hippocampal-inspired architecture (1.9M parameters, temporal complexity) that achieves reasonable accuracy on Argoverse 2 while providing full causal transparency;
- Empirical demonstration that explanation faithfulness can be quantified: tagged evidence causes ∼10× larger prediction shifts upon removal than untagged evidence, validated across all 24,988 scenarios.
2. Related Work
2.1. Motion Forecasting
2.2. Temporal Credit Assignment
2.3. Explainability in Autonomous Driving
2.4. Hippocampal Computation
- 1.
- Place cells → Mamba temporal encoding (encoding the agent’s trajectory through state space);
- 2.
- Synaptic tagging → sparse evidence gates (marking important observation windows);
- 3.
- Reverse replay → causal removal validation (testing whether tagged evidence is genuinely used);
- 4.
- Grid/border cells → lane encoder (integrating spatial road structure);
- 5.
- Constructive retrieval → mode-specific cross-attention (each behavioral mode selectively accesses the most relevant evidence).
3. Methodology
3.1. Overview
3.2. Social Mamba Encoder
3.3. Evidence Bank with Synaptic Tagging
- Target motion (12 dimensions): start/end position, displacement, speed, acceleration, heading change;
- Social context (10 dimensions): neighbor count, nearest distance, closing speed, density within 10 m/20 m;
- Map context (12 dimensions): lane alignment, boundary distances, intersection ratio, drivable area;
- Event tokens (12 dimensions): binary indicators for braking, acceleration, lane constraint, conflict proximity.
3.4. Learnable Mode Queries
3.5. PointNet Lane Encoder
3.6. Constructive Decoder
3.7. Reverse Replay: Causal Validation
- Necessity: Tagged windows produce large (the model genuinely used them);
- Sufficiency: Untagged windows produce (correctly identified as irrelevant).
3.8. Training
4. Results
4.1. Experimental Setup
4.2. Comparison with Published Methods
4.3. Explainability Comparison
4.4. Model Efficiency
4.5. Ablation Study
4.6. Causal Validation Results
4.7. Qualitative Results
4.8. Model Behavior Analysis
5. Discussion
5.1. The Explainability–Accuracy Trade-Off
5.2. Comparison with Post-Hoc Explanation Methods
5.3. Safety Certification Implications
5.4. Limitations and Future Work
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
| ADAS | Advanced Driver Assistance Systems |
| ADE | Average Displacement Error |
| CV | Constant Velocity |
| FDE | Final Displacement Error |
| HD | High Definition |
| MHA | Multi-Head Attention |
| MLP | Multi-Layer Perceptron |
| MR | Miss Rate |
| SOTIF | Safety of the Intended Functionality |
| SSM | State Space Model |
| XAI | Explainable Artificial Intelligence |
References
- Chen, C.; Lin, Y.; Zhan, L.; He, Y.; Zhang, Y.; Chi, X.; Chen, M. Dynamic Obstacle Avoidance Approach Based on Integration of A-Star and APF Algorithms for Vehicles in Complex Mountainous Environments. Vehicles 2025, 7, 65. [Google Scholar] [CrossRef]
- Chen, K.; Wu, G. The Vehicle Intention Recognition with Vehicle-Following Scene Based on Probabilistic Neural Networks. Vehicles 2023, 5, 332–343. [Google Scholar] [CrossRef]
- Zhou, Z.; Wang, J.; Li, Y.H.; Huang, Y.K. QCNet: Query-Centric Trajectory Queries for Motion Prediction. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023; pp. 17863–17873. [Google Scholar] [CrossRef]
- Zhou, Z.; Ye, L.; Wang, J.; Wu, K.; Lu, K. HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022; pp. 8823–8833. [Google Scholar] [CrossRef]
- Cheng, J.; Mei, X.; Liu, M. Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoders. In Proceedings of the Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023; pp. 8679–8689. [Google Scholar] [CrossRef]
- Shi, S.; Jiang, L.; Dai, D.; Schiele, B. MTR: Motion Transformer with Global Intention Localization and Local Movement Refinement. Proc. Adv. Neural Inf. Process. Syst. (NeurIPS) 2022, Vol. 35, 6531–6543. [Google Scholar] [CrossRef]
- International Organization for Standardization. ISO 21448:2022 — Road vehicles — Safety of the intended functionality (SOTIF); ISO. Technical report. 2022.
- Underwriters Laboratories. UL 4600: Standard for Safety for the Evaluation of Autonomous Products. Technical report. 2020. [Google Scholar] [CrossRef] [PubMed]
- Koopman, P.; Wagner, M. Autonomous Vehicle Safety: An Interdisciplinary Challenge. IEEE Intell. Transp. Syst. Mag. 2017, 9, 90–96. [Google Scholar] [CrossRef]
- Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 2019, 1, 206–215. [Google Scholar] [CrossRef] [PubMed]
- Lundberg, S.M.; Lee, S.I. A Unified Approach to Interpreting Model Predictions. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017; Vol. 30. [Google Scholar] [CrossRef]
- Ribeiro, M.T.; Singh, S.; Guestrin, C. “Why Should I Trust You?”: Explaining the Predictions of Any Classifier. In Proceedings of the Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016; pp. 1135–1144. [Google Scholar] [CrossRef]
- Jain, S.; Wallace, B.C. Attention is not Explanation. In Proceedings of the Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2019; pp. 3543–3556. [Google Scholar] [CrossRef]
- Ellouze, A.; Karray, M.; Ksantini, M. A Hybrid Decision-Making Framework for Autonomous Vehicles in Urban Environments Based on Multi-Agent Reinforcement Learning with Explainable AI. Vehicles 2026, 8, 8. [Google Scholar] [CrossRef]
- Minsky, M. Steps toward artificial intelligence. Proc. IRE 1961, 49, 8–30. [Google Scholar] [CrossRef]
- Sutton, R.S. Temporal Credit Assignment in Reinforcement Learning. PhD thesis, University of Massachusetts Amherst, Amherst, MA, USA, 1984. [Google Scholar]
- Frey, U.; Morris, R.G.M. Synaptic tagging and long-term potentiation. Nature 1997, 385, 533–536. [Google Scholar] [CrossRef] [PubMed]
- Foster, D.J.; Wilson, M.A. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 2006, 440, 680–683. [Google Scholar] [CrossRef] [PubMed]
- Buzsáki, G.; Moser, E.I. Memory, navigation and theta rhythm in the hippocampal-entorhinal system. Nat. Neurosci. 2013, 16, 130–138. [Google Scholar] [CrossRef] [PubMed]
- Mattar, M.G.; Daw, N.D. Prioritized memory access explains planning and hippocampal replay. Nat. Neurosci. 2018, 21, 1609–1617. [Google Scholar] [CrossRef] [PubMed]
- Zhao, H.; Gao, J.; Lan, T.; Sun, C.; Savarese, S.; et al. TNT: Target-driven Trajectory Prediction. In Proceedings of the Conference on Robot Learning (CoRL), 2021; pp. 895–904. [Google Scholar] [CrossRef]
- Liang, M.; Yang, B.; Hu, R.; Chen, Y.; Liao, R.; Feng, S.; Urtasun, R. LaneGCN: Learning Lane Graph Representations for Motion Forecasting. In Proceedings of the European Conference on Computer Vision (ECCV), 2020; pp. 1–18. [Google Scholar] [CrossRef]
- Marchetti, F.; Becattini, F.; Seidenari, L.; Del Bimbo, A. MANTRA: Memory Augmented Networks for Multiple Trajectory Prediction. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020; pp. 7143–7152. [Google Scholar] [CrossRef]
- Alahi, A.; Goel, K.; Ramanathan, V.; Robicquet, A.; Fei-Fei, L.; Savarese, S. Social LSTM: Human Trajectory Prediction in Crowded Spaces. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2016; pp. 961–971. [Google Scholar] [CrossRef]
- Salzmann, T.; Ivanovic, B.; Chakravarty, P.; Pavone, M. Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data. In Proceedings of the European Conference on Computer Vision (ECCV), 2020; pp. 683–700. [Google Scholar] [CrossRef]
- Bayramov, E.; Istenes, Z. SC-Mamba: Causal Disentanglement of Driver Intent and Style for Autonomous Driving Motion Forecasting. In Proceedings of the Proceedings of the International Conference on Information, Intelligence, Systems and Applications (IISA), Accepted; to appear. 2026. [Google Scholar]
- Gu, A.; Dao, T. Mamba: Linear-Time Sequence Modeling with Selective State Spaces. In Proceedings of the Proceedings of the International Conference on Machine Learning (ICML), 2024. [Google Scholar]
- Wilson, B.; Qi, W.; Agarwal, T.; Lambert, J.; Singh, J.; Khandelwal, S.; Pan, B.; Kumar, R.; Hartnett, A.; et al. Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2023. [Google Scholar] [CrossRef]
- Arjona-Medina, J.A.; Gillhofer, M.; Widrich, M.; Unterthiner, T.; Brandstetter, J.; Hochreiter, S. RUDDER: Return Decomposition for Delayed Rewards. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019; Vol. 32. [Google Scholar] [CrossRef]
- Hung, C.C.; Lillicrap, T.; Abramson, J.; Wu, Y.; Mirza, M.; Carnevale, F.; Ahuja, A.; Wayne, G. Optimizing agent behavior over long time scales by transporting value. Nat. Commun. 2019, 10, 5223. [Google Scholar] [CrossRef] [PubMed]
- Bengio, Y.; Lecun, Y.; Hinton, G. Deep learning for AI. Commun. ACM 2021, 64, 58–65. [Google Scholar] [CrossRef]
- Zablocki, E.; Ben-Younes, H.; Pérez, P.; Cord, M. Explainability of Deep Vision-Based Autonomous Driving Systems: Review and Challenges. Int. J. Comput. Vis. 2022, 130, 2425–2452. [Google Scholar] [CrossRef]
- Kim, J.; Rohrbach, A.; Darrell, T.; Canny, J.; Akata, Z. Textual Explanations for Self-Driving Vehicles. In Proceedings of the European Conference on Computer Vision (ECCV), 2018; pp. 563–578. [Google Scholar] [CrossRef]
- Atakishiyev, S.; Salameh, M.; Yao, H.; Goebel, R. Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide. IEEE Access 2024, 12, 2169–3536. [Google Scholar] [CrossRef]
- Wiegreffe, S.; Pinter, Y. Attention is not not Explanation. In Proceedings of the Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019; pp. 11–20. [Google Scholar] [CrossRef]
- Lipton, Z.C. The Mythos of Model Interpretability. Queue 2018, 16, 31–57. [Google Scholar] [CrossRef]
- O’Keefe, J.; Dostrovsky, J. The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 1971, 34, 171–175. [Google Scholar] [CrossRef] [PubMed]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is All You Need. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017; Vol. 30. [Google Scholar] [CrossRef]
- Redish, A.D. Beyond the Cognitive Map: From Place Cells to Episodic Memory; MIT Press, 1999. [Google Scholar]
- Qi, C.R.; Su, H.; Mo, K.; Guibas, L.J. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017; pp. 652–660. [Google Scholar] [CrossRef]
- Qi, H.; et al. FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field for Autonomous Driving. arXiv 2024, arXiv:2406.14422. [Google Scholar]
- Xu, C.; et al. EMP-M: Efficient Motion Prediction with Multi-Agent Interaction. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Google Scholar] [CrossRef]
- Deo, N.; Wolff, E.; Beijbom, O. Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversals. In Proceedings of the Conference on Robot Learning (CoRL), 2022; pp. 203–212. [Google Scholar] [CrossRef]
- Expósito Jiménez, V.J.; Macher, G.; Watzenig, D.; Brenner, E. Safety of the Intended Functionality Validation for Automated Driving Systems by Using Perception Performance Insufficiencies Injection. Vehicles 2024, 6, 1164–1184. [Google Scholar] [CrossRef]






| Method | minADE6 (↓) | minFDE6 (↓) | MR6 (↓) | Params | Explainable |
|---|---|---|---|---|---|
| QCNet [3] | 0.718 | 1.243 | 0.157 | 4.8M | × |
| FutureNet-LOF [41] | 0.705 | 1.162 | 0.135 | — | × |
| Forecast-MAE [5] | 0.712 | 1.408 | 0.178 | 12.1M | × |
| EMP-M [42] | 0.730 | 1.460 | 0.190 | — | × |
| LaneGCN [22] | 0.870 | 1.360 | 0.160 | 3.7M | × |
| SC-Mamba [26] | 0.664 | 2.089 | 0.108 | 1.8M | × |
| CogSig-Mamba (Ours) | 0.908 | 1.949 | 0.311 | 1.9M | ✓ |
| Method | Temporal | Spatial | Social | Modal | Causally Valid? |
|---|---|---|---|---|---|
| Gradient saliency | ∼ | ∼ | × | × | × |
| SHAP/LIME [11,12] | ∼ | ∼ | ∼ | × | × |
| Attention rollout | ∼ | × | ∼ | × | × |
| PGP [43] | × | ✓ | ∼ | × | × |
| TNT [21] | × | ✓ | × | ∼ | × |
| MANTRA [23] | ∼ | × | × | × | × |
| CogSig-Mamba (Ours) | ✓ | ✓ | ✓ | ✓ | ✓ |
| Method | Params | Latency | Complexity | Real-Time | Explainable |
|---|---|---|---|---|---|
| QCNet [3] | 4.8M | ∼45 ms | ✓ | × | |
| Forecast-MAE [5] | 12.1M | ∼80 ms | × | × | |
| MTR [6] | 9.2M | ∼60 ms | marginal | × | |
| CogSig-Mamba (Ours) | 1.9M | ∼25 ms | ✓ | ✓ | |
| + explanation | — | ∼35 ms | — | ✓ | ✓ |
| Variant | minADE6 | minFDE6 | MR6 | Tag Sparse | Causal (m) | Faithful? |
|---|---|---|---|---|---|---|
| Full model | 0.908 | 1.949 | 0.311 | 40% | 4.6 | ✓ |
| w/o Synaptic Tagging | 0.952 | 2.134 | 0.347 | 0% | — | × |
| w/o Lane Encoder | 0.971 | 2.287 | 0.362 | 40% | 2.1 | ✓ * |
| w/o Mode Queries | 1.043 | 2.391 | 0.389 | 40% | 4.4 | ✓ |
| w/o Reverse Replay | 0.908 | 1.949 | 0.311 | 40% | 7.1 | |
| CV Baseline | 3.021 | 7.854 | 0.782 | — | — | — |
| Window | Mean Tag | Mean Shift (m) | Median Shift (m) | Role |
|---|---|---|---|---|
| W1 (0–1 s) | 0.001 | 0.48 | 0.20 | Untagged |
| W2 (1–2 s) | 0.017 | 0.46 | 0.20 | Untagged |
| W3 (2–3 s) | 0.173 | 1.80 | 0.77 | Tagged |
| W4 (3–4 s) | 0.493 | 8.24 | 6.68 | Tagged |
| W5 (4–5 s) | 0.316 | 3.61 | 2.93 | Tagged |
| Lanes (all) | — | 9.38 | 7.76 | Spatial |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).