Submitted:
03 October 2025
Posted:
06 October 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Bayesian Modeling Methodology
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
| HR | Heart rate |
| RR | Respiration rate |
| HRV | Heart rate variability |
| EEG-WL | Electroencephalogram based workload estimates |
Appendix A
Appendix A.1: Normal-Normal Conjugacy Derivations
Appendix A.2: Hierarchical Pooling Methodology
| Parameter | Group Level Posterior Estimates | Individual Level Posterior Estimates |
|---|---|---|
| Posterior form | ||
| Mean | ||
| Variance | ||
| Hyperparameter for between-group variability | ||
| Hyperparameter for within-group variability |
References
- Parnell KJ 1, Banks VA 1, Allison CK 2, Plant KL 1, Beecroft P 3, Stanton NA 1 1 U of S, et al. Designing flight deck applications: combining insight from end-users and ergonomists. 2021 May;353–65.
- Kahneman, D. Attention and effort. Englewood Cliffs, New Jersey: Prentice-Hall, Inc; 1973. 246 p. (Prentice-Hall series in experimental psychology).
- Robert, J. Hockey G. Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework. Biol Psychol. 1997 Mar 21;45(1):73–93.
- Szalma JL, Claypoole VL. Vigilance and Workload in Automated Systems: Patterns of Association, Dissociation, and Insensitivity. In: Human Performance in Automated and Autonomous Systems. CRC Press; 2019.
- Bainbridge, L. Ironies of automation. Automatica. 1983 Nov 1;19(6):775–9.
- Hancke, T. Ironies of Automation 4.0. IFAC-Pap. 2020 Jan 1;53(2):17463–8.
- Parasuraman R, Sheridan TB, Wickens CD. A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern - Part Syst Hum. 2000 May;30(3):286–97.
- Svoboda A, Boril J, Bauer M, Costa PCG, Blasch E. Information Overload in Tactical Aircraft. In: 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC) [Internet]. 2019 [cited 2024 Aug 2]. p. 1–5. Available from: https://ieeexplore.ieee.org/abstract/document/9081763.
- Edwards T, Homola J, Mercer J, Claudatos L. Multifactor interactions and the air traffic controller: The interaction of situation awareness and workload in association with automation. IFAC-Pap. 2016 Jan 1;49(19):597–602.
- Endsley MR, Kiris EO. The Out-of-the-Loop Performance Problem and Level of Control in Automation. Hum Factors. 1995 June 1;37(2):381–94.
- Naranji E, Sarkani S, Mazzuchi T. Reducing Human/Pilot Errors in Aviation Using Augmented Cognition and Automation Systems in Aircraft Cockpit. AIS Trans Hum-Comput Interact. 2015 Jan;7(2):71–96.
- Chen JYC, Barnes MJ, Harper-Sciarini M. Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design. IEEE Trans Syst Man Cybern Part C Appl Rev. 2011 July;41(4):435–54.
- Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In: Hancock PA, Meshkati N, editors. Advances in Psychology [Internet]. North-Holland; 1988 [cited 2024 July 23]. p. 139–83. (Human Mental Workload; vol. 52). Available from: https://www.sciencedirect.com/science/article/pii/S0166411508623869.
- Estes, S. The Workload Curve: Subjective Mental Workload. Hum Factors. 2015 Nov 1;57(7):1174–87.
- Dehais F, Lafont A, Roy R, Fairclough S. A Neuroergonomics Approach to Mental Workload, Engagement and Human Performance. Front Neurosci [Internet]. 2020 Apr 7 [cited 2024 July 22];14. Available from: https://www.frontiersin.org/journals/neuroscience/articles/10.3389/fnins.2020.00268/full.
- Orphanidou, C. A review of big data applications of physiological signal data. Biophys Rev. 2019 Feb 1;11(1):83–7.
- Zhang T, Yang J, Liang N, Pitts BJ, Prakah-Asante K, Curry R, et al. Physiological Measurements of Situation Awareness: A Systematic Review. Hum Factors. 2023 Aug 1;65(5):737–58.
- Alaimo A, Esposito A, Orlando C, Simoncini A. Aircraft Pilots Workload Analysis: Heart Rate Variability Objective Measures and NASA-Task Load Index Subjective Evaluation. Aerospace. 2020 Sept;7(9):137.
- Mansikka H, Virtanen K, Harris D. Comparison of NASA-TLX scale, modified Cooper-Harper scale and mean inter-beat interval as measures of pilot mental workload during simulated flight tasks. Ergonomics. 2019 Feb;62(2):246–54.
- Adams JA, Webber CE. Monte Carlo Model of Tracking Behavior. Hum Factors. 1963 Feb 1;5(1):81–102.
- Johannsen G, Rouse WB. Mathematical Concepts for Modeling Human Behavior in Complex Man-Machine Systems. Hum Factors. 1979 Dec 1;21(6):733–47.
- Jurewicz KA, Neyens DM. Bayesian Approach to Multimodal Data in Human Factors Engineering. In: Gaw N, Pardalos PM, Gahrooei MR, editors. Multimodal and Tensor Data Analytics for Industrial Systems Improvement [Internet]. Cham: Springer International Publishing; 2024 [cited 2025 Mar 11]. p. 357–71. [CrossRef]
- Hoff PD. A First Course in Bayesian Statistical Methods [Internet]. New York, NY: Springer; 2009 [cited 2025 May 16]. (Springer Texts in Statistics). Available from: http://link.springer.com/10.1007/978-0-387-92407-6.
- Cowles, MK. Applied Bayesian Statistics: With R and OpenBUGS Examples. Springer Science & Business Media; 2013. 238 p.
- Alambeigi H, McDonald AD. A Bayesian Regression Analysis of the Effects of Alert Presence and Scenario Criticality on Automated Vehicle Takeover Performance. Hum Factors. 2023 Mar 1;65(2):288–305.
- DinparastDjadid A, Lee JD, Domeyer J, Schwarz C, Brown TL, Gunaratne P. Designing for the Extremes: Modeling Drivers’ Response Time to Take Back Control From Automation Using Bayesian Quantile Regression. Hum Factors. 2021 May 1;63(3):519–30.
- Wei R, McDonald AD, Mehta RK, Garcia A. Active Inference Models of AV Takeovers: Relating Model Parameters to Trust, Situation Awareness, and Fatigue. Hum Factors. 2024 Nov 1;00187208241295932.
- Biondi FN, McDonnell AS, Mahmoodzadeh M, Jajo N, Balasingam B, Strayer DL. Vigilance Decrement During On-Road Partially Automated Driving Across Four Systems. Hum Factors. 2024 Sept 1;66(9):2179–90.
- Neyens DM, Boyle LN, Schultheis MT. The Effects of Driver Distraction for Individuals With Traumatic Brain Injuries. Hum Factors. 2015 Dec 1;57(8):1472–88.
- Boskemper MM, Bartlett ML, McCarley JS. Measuring the Efficiency of Automation-Aided Performance in a Simulated Baggage Screening Task. Hum Factors. 2022 Sept 1;64(6):945–61.
- Driggs J, Vangsness L. Judgments of Difficulty (JODs) While Observing an Automated System Support the Media Equation and Unique Agent Hypotheses. Hum Factors. 2025 Apr 1;67(4):347–66.
- Huang J, Choo S, Pugh ZH, Nam CS. Evaluating Effective Connectivity of Trust in Human–Automation Interaction: A Dynamic Causal Modeling (DCM) Study. Hum Factors. 2022 Sept 1;64(6):1051–69.
- Schmid D, Stanton NA. Exploring Bayesian analyses of a small-sample-size factorial design in human systems integration: the effects of pilot incapacitation. Hum-Intell Syst Integr. 2019 Dec;1(2–4):71–88.
- Zhang X, Mahadevan S. Bayesian neural networks for flight trajectory prediction and safety assessment. Decis Support Syst. 2020 Apr 1;131:113246.
- Berka C, Levendowski ,Daniel J., Cvetinovic ,Milenko M., Petrovic ,Miroslav M., Davis ,Gene, Lumicao ,Michelle N., et al. Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset. Int J Human–Computer Interact. 2004 June 1;17(2):151–70.
- Berka C, Johnson R, Whitmoyer M, Behneman A, Popovic D, Davis G. Biomarkers for Effects of Fatigue and Stress on Performance: EEG, P300 and Heart Rate Variability. Proc Hum Factors Ergon Soc Annu Meet. 2008 Sept 1;52(3):192–6.
- Johnson RR, Popovic DP, Olmstead RE, Stikic M, Levendowski DJ, Berka C. Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model. Biol Psychol. 2011 May 1;87(2):241–50.
- Akintola AA, van de Pol V, Bimmel D, Maan AC, van Heemst D. Comparative Analysis of the Equivital EQ02 Lifemonitor with Holter Ambulatory ECG Device for Continuous Measurement of ECG, Heart Rate, and Heart Rate Variability: A Validation Study for Precision and Accuracy. Front Physiol [Internet]. 2016 Sept 21 [cited 2025 May 19];7. Available from: https://www.frontiersin.org/journals/physiology/articles/10.3389/fphys.2016.00391/full.
- Liu Y, Zhu,Shai H., Wang,Guo H., Ye,Fei, and Li PZ. Validity and Reliability of Multiparameter Physiological Measurements Recorded by the Equivital Lifemonitor During Activities of Various Intensities. J Occup Environ Hyg. 2013 Feb 1;10(2):78–85.
- Celka P, Vesin J m., Vetter R, Grueter R, Thonet G, Pruvot E, et al. Parsimonious Modeling of Biomedical Signals and Systems: Applications to the Cardiovascular System. In: Nonlinear Biomedical Signal Processing [Internet]. John Wiley & Sons, Ltd; 2000 [cited 2025 Apr 3]. p. 92–132. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1109/9780470545379.ch4.
- Dudley, RM. Central Limit Theorems for Empirical Measures. Ann Probab. 1978;6(6):899–929.
- Glickman ME, van Dyk DA. Basic Bayesian Methods. In: Ambrosius WT, editor. Topics in Biostatistics [Internet]. Totowa, NJ: Humana Press; 2007 [cited 2025 Apr 3]. p. 319–38. [CrossRef]
- Bernardo JM, Smith AFM. Bayesian Theory. John Wiley & Sons; 2009. 612 p.
- Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian Data Analysis. 3rd ed. New York: Chapman and Hall/CRC; 2013. 675 p.
- Lin L, Hedayat,A. S, Sinha,Bikas, and Yang M. Statistical Methods in Assessing Agreement: Models, Issues, and Tools. J Am Stat Assoc. 2002 Mar 1;97(457):257–70.
- Zhang B, Ren H, Huang G, Cheng Y, Hu C. Predicting blood pressure from physiological index data using the SVR algorithm. BMC Bioinformatics. 2019 Feb 28;20(1):109.
- Quer G, Gouda P, Galarnyk M, Topol EJ, Steinhubl SR. Inter- and intraindividual variability in daily resting heart rate and its associations with age, sex, sleep, BMI, and time of year: Retrospective, longitudinal cohort study of 92,457 adults. PLoS ONE. 2020 Feb 5;15(2):e0227709.
- Stevenson M, Sergeant E, Heuer C, Nunes T, Marshall J, Sanchez J, et al. epiR: Tools for the Analysis of Epidemiological Data. R package version 2.0.xx. 2025. Available from: https://CRAN.R-project.org/package=epiR.
- Borghini G, Vecchiato G, Toppi J, Astolfi L, Maglione A, Isabella R, et al. Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices. In: 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society [Internet]. 2012 [cited 2024 June 19]. p. 6442–5. Available from: https://ieeexplore.ieee.org/abstract/document/6347469.
- Gevins A, Smith ME. Neurophysiological measures of cognitive workload during human-computer interaction. Theor Issues Ergon Sci [Internet]. 2003 Jan 1 [cited 2024 June 19]; Available from: https://www.tandfonline.com/doi/abs/10.1080/14639220210159717.
- Hopstaken JF, van der Linden D, Bakker AB, Kompier MAJ. The window of my eyes: Task disengagement and mental fatigue covary with pupil dynamics. Biol Psychol. 2015 Sept 1;110:100–6.
- Lee YH, Liu BS. Inflight Workload Assessment: Comparison of Subjective and Physiological Measurements. Aviat Space Environ Med. 2003 Oct 1;74(10):1078–84.
- Harrivel AR, Stephens CL, Milletich RJ, Heinich CM, Last MC, Napoli NJ, et al. Prediction of Cognitive States during Flight Simulation using Multimodal Psychophysiological Sensing. In: AIAA Information Systems-AIAA Infotech @ Aerospace [Internet]. American Institute of Aeronautics and Astronautics; [cited 2025 May 28]. Available from: https://arc.aiaa.org/doi/abs/10.2514/6.2017-1135.
- Zhou T, Cha JS, Gonzalez G, Wachs JP, Sundaram CP, Yu D. Multimodal Physiological Signals for Workload Prediction in Robot-assisted Surgery. J Hum-Robot Interact. 2020 Jan 30;9(2):12:1-12:26.
- Verma GK, Tiwary US. Multimodal fusion framework: A multiresolution approach for emotion classification and recognition from physiological signals. NeuroImage. 2014 Nov 15;102:162–72.
- Wilson GF, Russell CA. Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks. Hum Factors. 2003 Dec 1;45(4):635–44.





| Automation Status | Workload | n | HR Posterior Mean | HR Posterior SD | RR Posterior Mean | RR Posterior SD |
WL Posterior Mean | WL Posterior SD |
|---|---|---|---|---|---|---|---|---|
| Off | Low | 4776 | 88.3 | 0.112 | 15.0 | 0.040 | 0.544 | 0.002 |
| Off | High | 4948 | 89.8 | 0.152 | 14.9 | 0.055 | 0.579 | 0.003 |
| On | Low | 4819 | 89.6 | 0.112 | 12.3 | 0.040 | 0.560 | 0.002 |
| On | High | 5027 | 92.1 | 0.109 | 12.8 | 0.039 | 0.588 | 0.002 |
| Participant | Automation Status | N-Back Level | n | HR Post Mean | HR Post SD | RR Post Mean | RR Post SD | WL Post Mean | WL Post SD |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Off | Low | 623 | 76.0 | 3.10 | 13.4 | 1.89 | 0.519 | 0.057 |
| High | 714 | 73.6 | 3.81 | 14.0 | 1.36 | 0.617 | 0.041 | ||
| On | Low | 709 | 74.2 | 2.91 | 12.5 | 1.45 | 0.545 | 0.044 | |
| High | 756 | 77.5 | 2.81 | 13.8 | 1.49 | 0.561 | 0.045 | ||
| 2 | Off | Low | 1209 | 99.2 | 2.23 | 18.2 | 1.59 | 0.511 | 0.048 |
| High | 1433 | 118 | 3.11 | 18.1 | 2.32 | 0.532 | 0.070 | ||
| On | Low | 1124 | 102 | 2.31 | 17.3 | 1.89 | 0.554 | 0.057 | |
| High | 1072 | 99.6 | 2.36 | 18.4 | 2.11 | 0.527 | 0.064 | ||
| 3 | Off | Low | 1066 | 102 | 2.37 | 12.1 | 1.94 | 0.524 | 0.059 |
| High | 942 | 92.4 | 3.47 | 14.8 | 2.21 | 0.572 | 0.067 | ||
| On | Low | 1292 | 106 | 2.15 | 6.17 | 1.77 | 0.559 | 0.053 | |
| High | 1252 | 111 | 2.19 | 6.84 | 1.41 | 0.599 | 0.043 | ||
| 4 | Off | Low | 998 | 77.9 | 2.45 | 15.5 | 1.31 | 0.467 | 0.040 |
| High | 1007 | 80.3 | 3.18 | 14.8 | 1.52 | 0.474 | 0.046 | ||
| On | Low | 958 | 77.9 | 2.50 | 14.5 | 1.74 | 0.466 | 0.053 | |
| High | 967 | 80.6 | 2.49 | 13.8 | 1.72 | 0.478 | 0.052 | ||
| 5 | Off | Low | 881 | 77.1 | 2.61 | 14.8 | 1.44 | 0.720 | 0.044 |
| High | 852 | 75.5 | 3.62 | 11.6 | 1.33 | 0.751 | 0.040 | ||
| On | Low | 736 | 70.7 | 2.85 | 12.3 | 1.52 | 0.704 | 0.046 | |
| High | 980 | 81.6 | 2.47 | 12.5 | 1.51 | 0.770 | 0.046 |
| Participant | MAPE | CCC | CPI | |
|---|---|---|---|---|
| HR | 1 | 8.24 | 0.766 | 0.660 |
| 2 | 8.15 | 0.897 | 0.853 | |
| 3 | 9.11 | 0.820 | 0.733 | |
| 4 | 9.25 | 0.904 | 0.806 | |
| 5 | 10.1 | 0.801 | 0.710 | |
| RR | 1 | 28.1 | 0.354 | 0.707 |
| 2 | 18.0 | 0.681 | 0.533 | |
| 3 | 10.9 | 0.181 | 0.853 | |
| 4 | 50.8 | 0.196 | 0.763 | |
| 5 | 28.4 | 0.651 | 0.363 | |
| WL | 1 | 37.4 | 0.648 | 0.807 |
| 2 | 24.5 | 0.610 | 0.323 | |
| 3 | 33.6 | 0.817 | 0.663 | |
| 4 | 37.7 | 0.853 | 0.567 | |
| 5 | 28.4 | 0.676 | 0.747 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).