Submitted:
01 May 2024
Posted:
02 May 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Literature Review
2.1. Adaptive Interfaces And Driver Assistance Systems:
2.2. Mental Workload Assessment Methods:
2.3. Relationship between Physiological Measures and Driver Cognitive States:
3. Review Methodology
4. Result
4.1. Investigating Methos, Features and Results. Part-1:
4.2. Analysing Type, Parameters, Tool and Task. Part-2:
4.3. Studies and Applications. Part-3:
4.4. Investigation Physiological Parameters. Part-4:
4.5. Computational Tools. Part-5:
5. Discussion
6. Conclusion and Future Work
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviation
| Abbreviation | Meaning |
| ACC | Adaptive Cruise Control |
| A# | Article number |
| ADASs | Advanced Driver Assist Systems |
| AVP | Automated Valet Parking |
| CA | Collision Avoidance |
| CHF | Congestive Heart Failure |
| CLM | Conventional Lane Merge |
| CVD | cardiovascular disease |
| DBMHGS | Driving Behaviour Model in Haptic Guidance System |
| DiR | Delays in Response |
| DMQ | Decision-Making Questionnaire |
| DRT | Detection Response Task |
| DS | Driving Simulator |
| EMG | Electromyography |
| FaTt | Field & Track test |
| FCA | Forward Collision Avoidance |
| FFT | Fast Fourier Transform |
| HMI | Human Machine Interface |
| HMM | Hidden Markov Model |
| HR | Heart Rate |
| IVIS | In-Vehicle Infotainment System |
| JLM | Joint Lane Merge |
| LF | Low Frequency |
| LKA | Lane-Keeping Assistance |
| LOO | Leave-one-out |
| LR | Literature Review |
| MANCOVA | Multivariate Analysis of Covariance |
| MAT | Mathematical Arithmetic Task |
| ML | Machine learning |
| MMDRT | Measured Maximum Driver Torque |
| MWL | Mental Workload |
| NNM | Neural Network Model |
| OSPAN | Operation Span |
| PA | Participants' Accuracies |
| PCA | Principal Component Analysis |
| RMSE | Root Mean Square Error |
| RMSSD | Root-mean-square of the Successive Differences |
| ROC | Receiver Operation Curve |
| RR | Respiratory Rate |
| SA | Situation Awareness scores |
| SALSA | Sacramento Area Latino Study on Aging |
| SDNN | Standard Deviation of N–N Intervals |
| Sw&AdT | Shapiro-Wilk and Anderson-Darling tests |
| TOR | Take-Over Request |
| VLP | Vehicle Lateral Position |
| VS | Vehicular Signals |
References
- Chen, W.; Sawaragi, T.; Hiraoka, T. Adaptive multi-modal interface model concerning mental workload in take-over request during semi-autonomous driving. SICE J. Control. Meas. Syst. Integr. 2021, 14, 10–21. [CrossRef]
- Roesener, C., Sauerbier, J., Zlocki, A., Fahrenkrog, F., Wang, L., Várhelyi, A., ... & Lanati, J. (2017, June). A comprehensive evaluation approach for highly automated driving. In 25th International Technical Conference on the Enhanced Safety of Vehicles (ESV) National Highway Traffic Safety Administration.
- Tientcheu, S.I.N.; Du, S.; Djouani, K. Review on Haptic Assistive Driving Systems Based on Drivers’ Steering-Wheel Operating Behaviour. Electronics 2022, 11, 2102. [CrossRef]
- Figalová, N.; Chuang, L.L.; Pichen, J.; Baumann, M.; Pollatos, O. Ambient Light Conveying Reliability Improves Drivers’ Takeover Performance without Increasing Mental Workload. Multimodal Technol. Interact. 2022, 6, 73. [CrossRef]
- Kajiwara, Y.; Murata, E. Effect of Behavioral Precaution on Braking Operation of Elderly Drivers under Cognitive Workloads. Sensors 2022, 22, 5741. [CrossRef]
- Perozzi, G.; Oudainia, M.R.; Sentouh, C.; Popieul, J.-C.; Rath, J.J. Driver Assisted Lane Keeping with Conflict Management Using Robust Sliding Mode Controller. Sensors 2022, 23, 4. [CrossRef]
- Eichelberger, A.H.; McCartt, A.T. Toyota drivers' experiences with Dynamic Radar Cruise Control, Pre-Collision System, and Lane-Keeping Assist. J. Saf. Res. 2016, 56, 67–73. [CrossRef]
- Park, D.; Yoon, W.C.; Lee, U. Cognitive States Matter: Design Guidelines for Driving Situation Awareness in Smart Vehicles. Sensors 2020, 20, 2978. [CrossRef]
- Murtaza, M.; Cheng, C.-T.; Fard, M.; Zeleznikow, J. Preparing drivers for the future: Evaluating the effects of training on drivers’ performance in an autonomous vehicle landscape. Transp. Res. Part F: Traffic Psychol. Behav. 2023, 98, 280–296. [CrossRef]
- Murtaza, M.; Cheng, C.-T.; Fard, M.; Zeleznikow, J. Assessing Training Methods for Advanced Driver Assistance Systems and Autonomous Vehicle Functions: Impact on User Mental Models and Performance. Appl. Sci. 2024, 14, 2348. [CrossRef]
- Marquart, G.; Cabrall, C.; de Winter, J. Review of Eye-related Measures of Drivers’ Mental Workload. Procedia Manuf. 2015, 3, 2854–2861. [CrossRef]
- Chen, W.; Sawaragi, T.; Hiraoka, T. Comparing eye-tracking metrics of mental workload caused by NDRTs in semi-autonomous driving. Transp. Res. Part F: Traffic Psychol. Behav. 2022, 89, 109–128. [CrossRef]
- Yoon, S. H., & Ji, Y. G. (2019). Non-driving-related tasks, workload, and takeover performance in highly automated driving contexts. Transportation research part F: traffic psychology and behaviour, 60, 620-631.
- Ko, S.M.; Ji, Y.G. How we can measure the non-driving-task engagement in automated driving: Comparing flow experience and workload. Appl. Ergon. 2018, 67, 237–245. [CrossRef]
- Li, X.; Vaezipour, A.; Rakotonirainy, A.; Demmel, S.; Oviedo-Trespalacios, O. Exploring drivers’ mental workload and visual demand while using an in-vehicle HMI for eco-safe driving. Accid. Anal. Prev. 2020, 146, 105756. [CrossRef]
- Sriranga, A.K.; Lu, Q.; Birrell, S. A Systematic Review of In-Vehicle Physiological Indices and Sensor Technology for Driver Mental Workload Monitoring. Sensors 2023, 23, 2214. [CrossRef]
- Islam, M.R.; Barua, S.; Ahmed, M.U.; Begum, S.; Aricò, P.; Borghini, G.; Di Flumeri, G. A Novel Mutual Information Based Feature Set for Drivers’ Mental Workload Evaluation Using Machine Learning. Brain Sci. 2020, 10, 551. [CrossRef]
- Cardone, D.; Perpetuini, D.; Filippini, C.; Mancini, L.; Nocco, S.; Tritto, M.; Rinella, S.; Giacobbe, A.; Fallica, G.; Ricci, F.; et al. Classification of Drivers’ Mental Workload Levels: Comparison of Machine Learning Methods Based on ECG and Infrared Thermal Signals. Sensors 2022, 22, 7300. [CrossRef]
- Biondi, F., Coleman, J. R., Cooper, J. M., & Strayer, D. L. (2017). Heart rate detection for driver monitoring systems. In Transportation Research Board 96th Annual Meeting Washington DC, United States.
- Lu, K.; Dahlman, A.S.; Karlsson, J.; Candefjord, S. Detecting driver fatigue using heart rate variability: A systematic review. Accid. Anal. Prev. 2022, 178, 106830. [CrossRef]
- Piechulla, W., Mayser, C., Gehrke, H., & König, W. (2003). Reducing drivers’ mental workload by means of an adaptive man–machine interface. Transportation Research Part F: Traffic Psychology and Behaviour, 6(4), 233-248.
- Li, G.; Chung, W.-Y. Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier. Sensors 2013, 13, 16494–16511. [CrossRef]
- Makhtar, A.K.; Sulaiman, M.I. Development of Heart Rate Monitoring System to Estimate Driver’s Mental Workload Level. IOP Conf. Series: Mater. Sci. Eng. 2020, 834, 012057. [CrossRef]
- Diaz-Piedra, C.; Sebastián, M.V.; Di Stasi, L.L. EEG Theta Power Activity Reflects Workload among Army Combat Drivers: An Experimental Study. Brain Sci. 2020, 10, 199. [CrossRef]
- Wang, Y.-C.; Wang, C.-C.; Yao, Y.-H.; Wu, W.-T. Identification of a High-Risk Group of New-Onset Cardiovascular Disease in Occupational Drivers by Analyzing Heart Rate Variability. Int. J. Environ. Res. Public Heal. 2021, 18, 11486. [CrossRef]
- Wang, J. S., Chung, P. C., Wang, W. H., & Lin, C. W. (2010, October). Driving conditions recognition using heart rate variability indexes. In 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (pp. 389-392). IEEE.
- Mahachandra, M., Sutalaksana, I. Z., & Suryadi, K. (2012, July). Sensitivity of heart rate variability as indicator of driver sleepiness. In 2012 Southeast Asian Network of Ergonomics Societies Conference (SEANES) (pp. 1-6). IEEE.
- Ma, J.; Feng, X. Analysing the Effects of Scenario-Based Explanations on Automated Vehicle HMIs from Objective and Subjective Perspectives. Sustainability 2023, 16, 63. [CrossRef]
- Persson, A.; Jonasson, H.; Fredriksson, I.; Wiklund, U.; Ahlstrom, C. Heart Rate Variability for Classification of Alert Versus Sleep Deprived Drivers in Real Road Driving Conditions. IEEE Trans. Intell. Transp. Syst. 2020, 22, 3316–3325. [CrossRef]
- Shakouri, M.; Ikuma, L.H.; Aghazadeh, F.; Nahmens, I. Analysis of the sensitivity of heart rate variability and subjective workload measures in a driving simulator: The case of highway work zones. Int. J. Ind. Ergon. 2018, 66, 136–145. [CrossRef]




| A# | Methods | Result | Features |
|---|---|---|---|
| 1 | DS, AOSPAN, PASAT and NASA-TLX | HFS improved driving, steering wheel operation performance. Reduced response time, mental workload | heart rate, P300 wave, pupillary response, blink, and eye movement |
| 2 | F&Tt, AdaptIVe from SAE level 2-4 | There are notable safety consequences between the duration of 2s to 17s when the vehicle nears an obstacle in the same lane. | |
| 11 | LR, NASA-TLX, RSME, questionnaires, ISA method | workload increases, Blink duration and gaze variability decreased. | blinks, fixations, saccades, Pupillometry |
| 12 | DS, NASA-TLX, MWL, KNN, PCA, PLM Classifiers | The accuracy of mental workload K-NN was 88.9% | eye-tracking metrics |
| 13 | DS, NASA-TLX, NDRT, Protocol (IRB), TOR | NDRT type has a significant effect on workload | Gaze on time, fixation time, hands-on time, and takeover time |
| 14 | DS, NDRT, TOR, RBs F-test, MANOVA | significant impact of the experimental condition on gaze-on time, road-fixation time, and take-over time, but not on hands-on time. | Driver reaction time, gaze-on time, road-fixation time, take-over time |
| 15 | DS, Friedman test | The HMI for eco-safe driving could promote eco-safe driving behaviours without overburdening drivers. | Brake force, acceleration, Eye blinks, pupil size. |
| 16 | LR, PRISMA, MWL | HR and HRV were found to be more sensitive to changes in MWL, while LF & HF components of HRV were considered better indicators. | HR, HRV, RR |
| 17 | F&Tt, EEG, VS, ML & MWL score | SVM performed the best in both MWL and event classification tasks, achieved a high accuracy of 94% | EEG and vehicular signals |
| 3 | LR, HMM, NNM, DBMHGS | Haptic feedback have enhanced driving performance, reduced response time, and lowered MWL | Response time, function, location, |
| 4 | DS, F&Tt, EEG, NDRT & TOR | Ambient in-vehicle lighting improves drivers' take-over performance. | 10 (TORs) to evaluate the influence of ambient in-vehicle lighting |
| 5 | DS, ML, random forest and naive Bayes methods | Coping skills can be predicted with 70% accuracy from left foot posture near intersections. | left foot posture, braking |
| 18 | DS, ML, ECG, HRV, HRV+IR thermal imaging | IR+HRV accuracy 73.1%, DST 75% | MWL, HRV, IR |
| 6 | DS, ADASs, HMI, LKA | LKA improve 9.4% and reduced conflict by 65.38%. Steering workload reduced by 86.13%. | lateral acceleration, road curvature, and MMRDT |
| 19 | F&Tt, HRV, MWI, DRT, NASA-TLX, IVIS, OSPAN | Younger drivers showed a larger increase in heart rate compared to older drivers. AHR was higher during the OSPAN task. | Average heart rate (AHR) |
| 20 | LR, HRV, alert and fatigued drivers | HRV-based fatigue detection accuracy 44% to 100%. | HRV, EEG, N1 Sleep stage, Fatigue |
| 21 | F&Tt, ECG, EMG, NASA-TLX | Reduction of MWL in adaptive telephone condition for experienced drivers. | ECG, EMG, HRV |
| 22 | DS, HRV, FFT, ROC, LOO, SVM, | The SVM performance of 95% accuracy, sensitivity and specificity outperforming the FFT-based results. | drowsiness, Alert, Age, Sex, Heart disease, Hypertensive |
| 23 | Arduino Kit, HRV, MWL, MAT, NASA-TXL | AHR reading for MWL was 67 BPM for no task and 78 for MAT task | heart rate (BPM) |
| 7 | cohort study, Telephone interviews | 9 in 10 respondents wanted ACC and FCA. 71% wanted LKA. Males were more likely to have LKA than females | ACC, FCA, LKA. MantelHaenszel-Pearson/ Chi-square analysis |
| 24 | DS, theta-EEG, MWL, terrain complexities | Real-time monitoring of cognitive states and improving road safety in military and civilian contexts. | theta EEG, MWL, combat and non-combat driving scenarios |
| 25 | Cohort study, HRV, CVD, SDNN, RMSSD | SDNN and LF levels are, independent predictors of CVD and hypertensive disease, also useful for predicting 8-year CVD risk. | hypertensive disease, congestive heart failure, CHF |
| 26 | Dataset, HRV, K-NN, PCA | The HRV-parameter-based recognition strategy achieved the best performance among three recognition methods. | HRV |
| 27 | DS, HRV, EEG, RMSSD | These biological signals can be considered in developing sleepiness detection system. | HRV, EEG |
| 28 | AVP,UX, and MWL | Scenario-based explanations improved situational trust, UX, and MWL of drivers. | situational trust, user experience, MWL, reaction time, return times |
| 8 | LR, SA, DMQ, ANOVA, cognitive States | There were no significant correlations between driving experience and SA or DMQ scores. | mental model, workload, memory |
| 29 | DS, HRV, K-NN, SVM | Random forest classifier achieved the best binary classification performance. | RMSSD, NN50, pNN50, mean NN, and SSD1. AdaBoost, random forest |
| 30 | DS, RMSSD, MANCOVA, NASA-TLX | There were weak correlations between heart rate variability measures. | CML, JLM, HRV, LF, HF, RR, |
| 9 | DS,ADAS, RMSE | Vehicle trajectory analysis revealed that training helped minimize serpentine driving behavior and improve vehicle control. | PA,DiR,VLP |
| 10 | DS, AV, Sw&AdT | Video-based training yielded better performance outcomes, more accurate mental models, and a deeper understanding of ADAS. | LKA, CA, ACC |

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).