Submitted:
05 June 2026
Posted:
09 June 2026
You are already at the latest version
Abstract
Keywords:
1. Introduction
From Words-as-Attention to Attention as Synaptic Gain During Precise Inference of CO
The Bayesian Brain and the ATS Through Marr’s Levels of Analysis
Computational Level of Analysis: Inferring Latent CO States Through Bayes Theorem
Algorithmic level of analysis: updating beliefs about CO states through marginal message passing
Neural (implementational) Level of Analysis
Summary of the Model
2. Materials and Methods
Participants
Optional Stopping for Sample Size Definition
Procedure
Stimuli
Experimental Task
Data Processing and Analysis
3. Results
Behavioral Results
Computational Model Results
Construct validity: Bayesian Model Selection
Discussion
Expanding the Words-as-Attention Assumption to a Formal Active Inference Framework and Neural Implementation
From External Validation to a Computational Phenotyping Role of the ATS
Future directions
Limitations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Pennebaker, J.W.; Mehl, M.R.; Niederhoffer, K.G. Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annu. Rev. Psychol. 2003, 54, 547–577. [Google Scholar] [CrossRef]
- Murray, H.A. Thematic Apperception Test manual.
- Konopka, A.E. Encoding actions and verbs: Tracking the time-course of relational encoding during message and sentence formulation. J. Exp. Psychol. Learn. Mem. Cogn. 2019, 45, 1486–1510. [Google Scholar] [CrossRef]
- Wheeldon, L.R.; Konopka, A. Grammatical Encoding for Speech Production; 2023. [Google Scholar] [CrossRef]
- Levelt, W.J.M. Speaking: From Intention to Articulation; The MIT Press, 1989. [Google Scholar]
- Garrett, M.F. The Analysis of Sentence Production11The research reported here was supported in part by NIMH grant HD 05/68-02,03,04. Some of the work was done in collaboration with S. R. Shattuck and her contribution is gratefully acknowledged. This paper was written while the author was a Senior Research Fellow of the Australian-American Educational Foundation (Fulbright-Hayes program) at Monash University, Melbourne. In Psychology of Learning and Motivation; Bower, G.H., Ed.; Academic Press, 1975; Volume 9, pp. 133–177. [Google Scholar]
- Konopka, A.E.; Brown-Schmidt, S. Message Encoding. In The Oxford Handbook of Language Production; Goldrick, M., Ferreira, V.S., Miozzo, M., Eds.; Oxford University Press, 2014; p. 0. [Google Scholar]
- Flower, L.; Hayes, J.R. A Cognitive Process Theory of Writing. Coll. Compos. Commun. 1981, 32, 365–387. [Google Scholar] [CrossRef]
- Hayes, J.R.; Berninger, V.W.; Arfe, B.; Dockrell, J.; Berninger, V. Cognitive Processes in Writing: A Framework. In Writing Development in Children with Hearing Loss, Dyslexia, or Oral Language Problems: Implications for Assessment and Instruction; Oxford University Press, 2014; p. 0. [Google Scholar]
- Hayes, J.R. Modeling and remodeling writing. Writ. Commun. 2012, 29, 369–388. [Google Scholar] [CrossRef]
- Alamargot, D.; Chanquoy, L. Through Model. Writing 2001 Volume 9.
- Thomas, G.; Doris, G.; Rainer, O.; Wiebke, P. düsseldorf university press; Berlin, Boston, 2021. [Google Scholar]
- Purcell, J.J.; Turkeltaub, P.E.; Eden, G.F.; Rapp, B. Examining the central and peripheral processes of written word production through meta-analysis. Front Psychol. 2011, 2, 239. [Google Scholar] [CrossRef] [PubMed]
- Olive, T. Working memory in writing; 2011; pp. 485–503. [Google Scholar]
- van Galen, G.P. Handwriting: Issues for a psychomotor theory. Hum. Mov. Sci. 1991, 10, 165–191. [Google Scholar] [CrossRef]
- Baaijen, V.M.; Galbraith, D. Discovery Through Writing: Relationships with Writing Processes and Text Quality. Cogn. Instr. 2018, 36, 199–223. [Google Scholar] [CrossRef]
- Galbraith, D.; Baaijen, V. Conflict in writing: Actions and objects. In Writing(s) at the Crossroads: The process-product interface; Cislaru, G., Ed.; John Benjamins Publishing Company: Amsterdan, 2015; pp. 253–276. [Google Scholar]
- Gleitman, L.R.; January, D.; Nappa, R.; Trueswell, J.C. On the give and take between event apprehension and utterance formulation. J. Mem. Lang. 2007, 57, 544–569. [Google Scholar] [CrossRef]
- Ünal, E.; Ji, Y.; Papafragou, A. From Event Representation to Linguistic Meaning. Top. Cogn. Sci. 2021, 13, 224–242. [Google Scholar] [CrossRef]
- Papafragou, A.; Grigoroglou, M. The role of conceptualization during language production: evidence from event encoding. Lang. Cogn. Neurosci. 2019, 34, 1117–1128. [Google Scholar] [CrossRef]
- Limongi, R.; Silva, A.M.; Mackinley, M.; Ford, S.D.; Palaniyappan, L. Active Inference, Epistemic Value, and Uncertainty in Conceptual Disorganization in First-Episode Schizophrenia. Schizophr. Bull. 2023, 49, S115–s124. [Google Scholar] [CrossRef]
- Pennebaker, J.W.; Chung, C.K.; Frazee, J.; Lavergne, G.M.; Beaver, D.I. When small words foretell academic success: the case of college admissions essays. PLoS ONE 2014, 9, e115844–e115844. [Google Scholar] [CrossRef] [PubMed]
- Just, M.A.; Carpenter, P.A. A capacity theory of comprehension: individual differences in working memory. Psychol. Rev. 1992, 99, 122–149. [Google Scholar] [CrossRef] [PubMed]
- Pennebaker, J.W.; King, L.A. Linguistic styles: language use as an individual difference. J. Pers. Soc. Psychol. 1999, 77, 1296–1312. [Google Scholar] [CrossRef]
- Chung, C.; Pennebaker, J.W. The psychological functions of functions words. In Social Communication; Fiedler, K., Ed.; Psychological Press: NY, 2007; pp. 343–359. [Google Scholar]
- Kahn, J.H.; Tobin, R.M.; Massey, A.E.; Anderson, J.A. Measuring Emotional Expression with the Linguistic Inquiry and Word Count. Am. J. Psychol. 2007, 120, 263–286. [Google Scholar] [CrossRef] [PubMed]
- Tausczik, Y.R.; Pennebaker, J.W. The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods. J. Lang. Soc. Psychol. 2009, 29, 24–54. [Google Scholar] [CrossRef]
- Boyd, R.; Ashokkumar, A.; Seraj, S.; Pennebaker, J. Dev. Psychom. Prop. LIWC-22 2022.
- Pennebaker, J.W.; Boyd, R.; Jordan, K.; Blackburn, K. The development and psychometric properties of LIWC2015; University of Texas at Austin: Austin, TX, 2015. [Google Scholar]
- Silva, A.M.; Limongi, R.; MacKinley, M.; Palaniyappan, L. Small Words That Matter: Linguistic Style and Conceptual Disorganization in Untreated First-Episode Schizophrenia. Schizophr. Bull. Open 2021, 2, 1–10. [Google Scholar] [CrossRef]
- Pennebaker, J.W. The Secret Life of Pronouns: What Our Words Say About Us; Bloomsbury Press: New York, 2011. [Google Scholar]
- Boyd, R.L.; Ashokkumar, A.; Seraj, S.; Pennebaker, J.W. The Development and Psychometric Properties of LIWC2015; University of Texas at Austin: Austin, TX, 2015. [Google Scholar]
- Markowitz, D.M. Analytic thinking as revealed by function words: What does language really measure? Appl. Cogn. Psychol. 2023, 37, 643–650. [Google Scholar] [CrossRef]
- Marr, D. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information; Freeman: New York, 1982. [Google Scholar]
- Boyd, R.L.; Markowitz, D.M. Verbal behavior and the future of social science. 2025, 411–433. [Google Scholar] [CrossRef] [PubMed]
- Griffin, Z.M.; Bock, K. What the eyes say about speaking. Psychol. Sci. 2000, 11, 274–279. [Google Scholar] [CrossRef] [PubMed]
- Lengyel, M. Marr's three levels of analysis are useful as a framework for neuroscience. J. Physiol. 2024, 602, 1911–1914. [Google Scholar] [CrossRef]
- Bechtel, W.; Shagrir, O. The Non-Redundant Contributions of Marr's Three Levels of Analysis for Explaining Information-Processing Mechanisms. Top. Cogn. Sci. 2015, 7, 312–322. [Google Scholar] [CrossRef]
- Pezzulo, G.; Parr, T.; Friston, K. The evolution of brain architectures for predictive coding and active inference. Philos. Trans. R. Soc. B Biol. Sci. 2022, 377, 20200531. [Google Scholar] [CrossRef]
- Parr, T.; Pezzulo, G.; Friston, K.J. Active Inference: The Free Energy Principle in Mind, Brain, and Behavior; MIT Press: Cambridge, MA, 2022. [Google Scholar]
- Hipolito, I.; Ramstead, M.J.D.; Convertino, L.; Bhat, A.; Friston, K.; Parr, T. Markov blankets in the brain. Neurosci. Biobehav. Rev. 2021, 125, 88–97. [Google Scholar] [CrossRef]
- Parr, T.; Friston, K.J. The Anatomy of Inference: Generative Models and Brain Structure. Front. Comput. Neurosci. 2018, 12, 1–23. [Google Scholar] [CrossRef]
- Friston, K.J.; Parr, T.; de Vries, B. The graphical brain: Belief propagation and active inference. Netw. Neurosci. 2017, 1, 381–414. [Google Scholar] [CrossRef]
- Friston, K.J. The history of the future of the Bayesian brain. Neuroimage 2012, 62, 1230–1233. [Google Scholar] [CrossRef]
- Friston, K. The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 2010, 11, 127–138. [Google Scholar] [CrossRef]
- Friston, K.J. Hierarchical Models in the Brain. PLoS Comput Biol. 2008, 4. [Google Scholar] [CrossRef]
- Smith, R.; Friston, K.J.; Whyte, C.J. A step-by-step tutorial on active inference and its application to empirical data. J. Math. Psychol. 2022, 107, 102632. [Google Scholar] [CrossRef]
- Parr, T.; Friston, K.J. Attention or salience? Curr. Opin. Psychol. 2019, 29, 1–5. [Google Scholar] [CrossRef]
- Mirza, M.B.; Adams, R.A.; Friston, K.; Parr, T. Introducing a Bayesian model of selective attention based on active inference. Sci. Rep. 2019, 9, 13915. [Google Scholar] [CrossRef]
- Parr, T.; Friston, K.J. Working memory, attention, and salience in active inference. Sci. Rep. 2017, 7, 14678. [Google Scholar] [CrossRef]
- Feldman, H.; Friston, K.J. Attention, uncertainty and free-energy. Front Hum. Neurosci. 2010, 4, 1–23. [Google Scholar] [CrossRef]
- Friston, K. The free-energy principle: a rough guide to the brain? Trends Cogn. Sci. 2009, 13, 293–301. [Google Scholar] [CrossRef] [PubMed]
- Mirza, M.B.; Cullen, M.; Parr, T.; Shergill, S.; Moran, R.J. Contextual perception under active inference. Sci. Rep. 2021, 11, 16223. [Google Scholar] [CrossRef] [PubMed]
- Parr, T.; Markovic, D.; Kiebel, S.J.; Friston, K.J. Neuronal message passing using Mean-field, Bethe, and Marginal approximations. Sci. Rep. 2019, 9, 1–18. [Google Scholar] [CrossRef] [PubMed]
- Rouder, J.N. Optional stopping: No problem for Bayesians. Psychon. Bull. Rev. 2014, 21, 301–308. [Google Scholar] [CrossRef] [PubMed]
- Tendeiro, J.N.; Kiers, H.A.L.; van Ravenzwaaij, D. Worked-out examples of the adequacy of Bayesian optional stopping. Psychon. Bull. Rev. 2022, 29, 70–87. [Google Scholar] [CrossRef]
- Team, J. JASP (Version 0.18) [Computer software]; https://jasp-stats.org/: 2024.
- Jeffreys, H. Theory of Probability; Oxford University Press: Oxford, 1961. [Google Scholar]
- Peirce, J.W. PsychoPy Psychophys. Softw. Python 2007.
- Smith, R.; Kuplicki, R.; Feinstein, J.; Forthman, K.L.; Stewart, J.L.; Paulus, M.P.; Tulsa, i.; Khalsa, S.S. A Bayesian computational model reveals a failure to adapt interoceptive precision estimates across depression, anxiety, eating, and substance use disorders. PLoS Comput. Biol. 2020, 16, e1008484. [Google Scholar] [CrossRef]
- Friston, K.J.; Litvak, V.; Oswal, A.; Razi, A.; Stephan, K.E.; van Wijk, B.C.M.; Ziegler, G.; Zeidman, P. Bayesian model reduction and empirical Bayes for group (DCM) studies. Neuroimage 2016, 128, 413–431. [Google Scholar] [CrossRef]
- Zeidman, P.; Jafarian, A.; Seghier, M.L.; Litvak, V.; Cagnan, H.; Price, C.J.; Friston, K.J. A guide to group effective connectivity analysis, part 2: Second level analysis with PEB. Neuroimage 2019, 200, 12–25. [Google Scholar] [CrossRef]
- Zeidman, P.; Friston, K.; Parr, T. A primer on Variational Laplace (VL). Neuroimage 2023, 279, 120310. [Google Scholar] [CrossRef]
- Rigoux, L.; Stephan, K.E.; Friston, K.J.; Daunizeau, J. Bayesian model selection for group studies - revisited. Neuroimage 2014, 84, 971–985. [Google Scholar] [CrossRef] [PubMed]
- Haines, N.; Kvam, P.D.; Irving, L.; Smith, C.T.; Beauchaine, T.P.; Pitt, M.A.; Ahn, W.-Y.; Turner, B.M. A tutorial on using generative models to advance psychological science: Lessons from the reliability paradox. Psychol. Methods 2025, No Pagination Specified-No Pagination Specified. [Google Scholar] [CrossRef]
- Limongi, R.; Skelton, A.B.; Tzianas, L.H.; Silva, A.M. Increasing the Construct Validity of Computational Phenotypes of Mental Illness Through Active Inference and Brain Imaging. Brain Sci. 2024, 14, 1278. [Google Scholar] [CrossRef] [PubMed]




| Condition | Mean | SD | Range | ||
| Min | Max | ||||
| ATS | Speaking | 52.03 | 28.77 | 4.6 | 99 |
| Writing | 78.99 | 22.1 | 6.2 | 99 | |
| Number of Words | Speaking | 97.75 | 55.83 | 7.0 | 216 |
| Writing | 56.97 | 19.44 | 8.0 | 97 | |
| 95% Credible Interval | ||||
| Parameter | Mean | SD | Lower | Upper |
| Intercept | 65.55 | 3.69 | 57.98 | 72.78 |
| Speaking | -13.12 | 1.82 | -16.81 | -9.48 |
| Writing | 13.12 | 2.00 | 8.42 | 16.44 |
| 95% Credible Interval | ||||
| Estimate | SE | Lower | Upper | |
| Intercept | 0.01 | 0.18 | -0.33 | 0.38 |
| Speaking | -0.81 | 0.19 | -1.26 | -0.44 |
| Writing | 0.81 | 0.19 | 0.44 | 1.26 |
| Subject | AP |
| 1 | 0.66 |
| 2 | 0.53 |
| 3 | 0.53 |
| 4 | 0.61 |
| 5 | 0.5 |
| 6 | 0.53 |
| 7 | 0.66 |
| 8 | 0.61 |
| 9 | 0.66 |
| 10 | 0.66 |
| 11 | 0.53 |
| 12 | 0.5 |
| 13 | 0.61 |
| 14 | 0.5 |
| 15 | 0.61 |
| 16 | 0.72 |
| 17 | 0.66 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).