Submitted:
10 February 2025
Posted:
11 February 2025
Read the latest preprint version here
Abstract
Keywords:
1. Introduction
2. Materials and methods
2.1. Search Strategy
2.2. Selection Criteria and Screening
2.2.1. Inclusion Criteria
- Utilises eye tracking technology in conjunction with machine learning techniques.
- Investigates productivity with a focus on reading comprehension, text highlighting, or screen usage.
- Addresses eye metrics such as fixations and saccades, or issues related to eye strain and fatigue.
2.2.2. Exclusion Criteria
- Focuses solely on eye diseases or other clinical eye conditions.
- Involves populations with neurodivergent characteristics or addresses neurodivergent conditions.
- Includes non-human participants.
- Studies that do not focus on reading stimuli or working at a computer.
2.2.3. Screening
2.3. Data Extraction, Data Items and Quality Appraisal
2.4. Quality assessment
2.5. Effect Measures
2.6. Data Synthesis
3. Results
3.1. Eye Metric Classification
3.1.1. Classification of Eye Movements
3.1.2. Eye Movement Patterns During Reading
3.1.3. Synthetic Eye Tracking Data Generation
3.2. Measuring Comprehension
3.2.1. Multiple Choice Questions
3.2.2. Behavioural metrics derived from eye movements
3.3. Measuring Attention
3.3.1. Machine Learning Methods
3.3.2. Statistical Methods
3.4. Typography and Typesetting
3.4.1. Font
3.4.2. Text Spacing
3.4.3. Perceptual Span in Reading
4. Discussion
4.1. General Interpretation of the Results
4.2. Limitations of the Evidence
4.3. Limitations of the Review Processes
4.4. Practice, Policy, and Future Research
4.4.1. Practice
4.4.2. Policy
4.4.3. Future Research
Author Contributions
Funding
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Kaur K, Gurnani B, Nayak S, Deori N, Kaur S, Jethani J, et al. Digital Eye Strain: A Comprehensive Review. Ophthalmology and Therapy. 2022;11(5):1655–80. [CrossRef]
- Hijazi H, Gomes M, Castelhano J, Castelo-Branco M, Praça I, de Carvalho P, Madeira H. Dynamically predicting comprehension difficulties through physiological data and intelligent wearables. Scientific Reports. 2024;14(1). [CrossRef]
- Prasse P, Reich DR, Makowski S, Ahn S, Scheffer T, Jäger LA. SP-EyeGAN: Generating Synthetic Eye Movement Data with Generative Adversarial Networks. Zurich Open Repository and Archive (University of Zurich). 2023 May. [CrossRef]
- Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. [CrossRef]
- Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Educ Inf. 2018;34(4):285-91. [CrossRef]
- Skaramagkas V, Giannakakis G, Ktistakis E, Manousos D, Karatzanis I, Tachos N, Tripoliti E, Marias K, Fotiadis DI, Tsiknakis M. Review of Eye Tracking Metrics Involved in Emotional and Cognitive Processes. IEEE Rev Biomed Eng. 2023;16:260-77. Epub 2023 Jan 5. [CrossRef] [PubMed]
- Popat M, Goyal D, Raj V, Jayabalan N, Hota C. Eye movement tracking for computer vision syndrome using deep learning techniques. In: 2024 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). 2024. p. 317-322. [CrossRef]
- Startsev M, Agtzidis I, Dorr M. 1D CNN with BLSTM for automated classification of fixations, saccades, and smooth pursuits. Behav Res Methods. 2019 Apr;51(2):556-72. [CrossRef] [PubMed]
- Hybrid model of eye movement behavior recognition for virtual workshop. ResearchGate. 2020. [CrossRef]
- Han Y-J, Kim W, Park J-S. Efficient eye-blinking detection on smartphones: A hybrid approach based on deep learning. Mobile Information Systems. 2018;2018:6929762. [CrossRef]
- Chang Y, He C, Zhao Y, Lu T, Gu N. A High-Frame-Rate Eye-Tracking Framework for Mobile Devices. IEEE Access. 2021 May. [CrossRef]
- Liao W-H, Chang C-W, Wu Y-C. Classification of reading patterns based on gaze information. In: 2017 IEEE International Symposium on Multimedia (ISM); 2017. p. 595-600. [CrossRef]
- Hassan A, Fan W, Hu X, Wang W, Li H. LSTM-based eye-movement trajectory analysis for reading behavior classification. SPIE. 2022 Apr;12247:73–73. [CrossRef]
- Emoto J, Hirata Y. Lightweight convolutional neural network for image processing method for gaze estimation and eye movement event detection. IPSJ Transactions on Bioinformatics. 2020;13(0):7–15. [CrossRef]
- Hohenstein S, Matuschek H, Kliegl R. Linked linear mixed models: A joint analysis of fixation locations and fixation durations in natural reading. Psychon Bull Rev. 2017 Jun;24(3):637–651. [CrossRef] [PubMed] [PubMed Central]
- Lin Z, Liu Y, Wang H, Liu Z, Cai S, Zheng Z, Zhou Y, Zhang X. An eye tracker based on webcam and its preliminary application evaluation in Chinese reading tests. Biomed Signal Process Control. 2022 Feb;74:103521. [CrossRef]
- Hofmann MJ, Remus S, Biemann C, Radach R, Kuchinke L. Language models explain word reading times better than empirical predictability. Front Artif Intell. 2022 Feb;4. [CrossRef]
- Prasse P, Reich DR, Makowski S, Scheffer T, Jäger LA. Improving cognitive-state analysis from eye gaze with synthetic eye-movement data. Computers & Graphics. 2024 Mar;119:103901. [CrossRef]
- Malmaud J, Levy R, Berzak Y. Bridging information-seeking human gaze and machine reading comprehension. In: Proceedings of the 24th Conference on Computational Natural Language Learning. Online; 2020. p. 142-152. [CrossRef]
- Ariasi N, Hyönä J, Kaakinen JK, Mason L. An eye-movement analysis of the refutation effect in reading science text. Journal of Computer Assisted Learning. 2017;33(3):202-221. [CrossRef]
- Wallot S, O’Brien B, Coey C, Kelty-Stephen D. Power-law fluctuations in eye movements predict text comprehension during connected text reading. Cognitive Science Society. Annual Conference. Proceedings (Online). 2015;2583-2588.
- Lenhart P, Thaqi E, Castner N, Kasneci E. Old or Modern? A computational model for classifying poem comprehension using microsaccades. In: Proceedings of the 2023 Symposium on Eye Tracking Research and Applications (ETRA ’23); 2023. p. 49. [CrossRef]
- Babanova K, Revazov A, Chernozatonskiy K, Pikunov A, Anisimov V. An application of eye movement parameters collected from mass market devices for the estimation of a text comprehension. Journal of Eye Movement Research. 2023;16(2). [CrossRef]
- Southwell R, Gregg J, Bixler R, D’Mello SK. What eye movements reveal about later comprehension of long connected texts. Cognitive Science. 2020;44(10):e12905. [CrossRef]
- Ahn S, Kelton C, Balasubramanian A, Zelinsky G. Towards predicting reading comprehension from gaze behavior. In: Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 2020. p. 32. [CrossRef]
- Fan K, Cao J, Meng Z, Zhu J, Ma H, Ng AC, Ng T, Qian W, Qi S. Predicting the reader’s English level from reading fixation patterns using the Siamese convolutional neural network. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2022;30:1071–1080. [CrossRef]
- Rivu R, Abdrabou Y, Abdelrahman Y, Pfeuffer K, Kern D, Neuert C, Buschek D, Alt F. Did you understand this? Leveraging gaze behavior to assess questionnaire comprehension. In: Proceedings of the ACM Symposium on Eye Tracking Research and Applications (ETRA ’21 Short Papers). ACM; 2021. [CrossRef]
- Cho, Y. Rethinking eye-blink: Assessing task difficulty through physiological representation of spontaneous blinking. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). ACM; 2021. [CrossRef]
- Southwell R, Mills C, Caruso M, D’Mello SK. Gaze-based predictive models of deep reading comprehension. User Modeling and User-Adapted Interaction. 2023;33(3):687–725. [CrossRef]
- Kaakinen JK, Ballenghein U, Tissier G, Baccino T. Fluctuation in cognitive engagement during reading: Evidence from concurrent recordings of postural and eye movements. J Exp Psychol Learn Mem Cogn. 2018 Oct;44(10):1671-7. Epub 2018 Feb 1. [CrossRef] [PubMed]
- Chakraborty P, Ahmed S, Yousuf MA, Azad AKM, Alyami SA, Moni MA. A Human-Robot Interaction System Calculating Visual Focus of Human’s Attention Level. IEEE Access. 2021;9:93409-21. [CrossRef]
- Bixler R, D’Mello S. Automatic Gaze-Based Detection of Mind Wandering with Metacognitive Awareness. In: Ricci F, Bontcheva K, Conlan O, Lawless S, editors. User Modeling, Adaptation and Personalization. UMAP 2015. Lecture Notes in Computer Science, vol 9146. Springer, Cham; 2015. [CrossRef]
- Bafna T, Bækgaard P, Hansen JP. Mental fatigue prediction during eye-typing. PLoS One. 2021 Feb 22;16(2):e0246739. [CrossRef]
- Sood E, Tannert S, Frassinelli D, Bulling A, Vu NT. Interpreting attention models with human visual attention in machine reading comprehension. Proceedings of the 24th Conference on Computational Natural Language Learning. 2020;12–25. [CrossRef]
- Rahnuma T, Jothiraj SN, Kuvar V, Faber M, Knight RT, Kam JWY. Gaze-based detection of thoughts across naturalistic tasks using a PSO-optimized random forest algorithm. Bioengineering. 2024;11(8):760. [CrossRef]
- Ding L, Terwilliger J, Parab A, Wang M, Fridman L, Mehler B, Reimer B. CLERA: A unified model for joint cognitive load and eye region analysis in the wild. ACM Trans Comput Hum Interact. 2023 Dec;30(6):84. [CrossRef]
- Shilaskar S, Bhatlawande S, Gadad T, Ghulaxe S, Gaikwad R. Student eye gaze tracking and attention analysis system using computer vision. In:2023 7th International Conference on Computing Methodologies and Communication (ICCMC); 2023. p. 889-95. [CrossRef]
- Chen J, Zhang L, Qian W. Cognitive differences between readers attentive and inattentive to task-related information: an eye-tracking study. Aslib J Inf Manag. 2023;75(5):917-39. [CrossRef]
- Ren H, Yan T, Chen X, Lyu R, Liu Y. Intelligent Chinese typesetting model based on information importance can enhance text readability. Int J Hum Comput Interact. 2024;1-20. [CrossRef]
- Wei Y, Fu X. Effects of English capitals on reading performance of Chinese learners: Evidence from eye tracking. In: 2019 International Conference on Asian Language Processing (IALP); 2019. p. 108-14. [CrossRef]
- Schotter ER, Stringer C, Saunders E, Cooley FG, Sinclair G, Emmorey K. The role of perceptual and word identification spans in reading efficiency: Evidence from hearing and deaf readers. J Exp Psychol Gen. 2024 Oct;153(10):2359-77. [CrossRef]
- Chiu T, Drieghe D. The role of visual crowding in eye movements during reading: Effects of text spacing. Attention, Perception, and Psychophysics. 2023;85(8):2834-58. [CrossRef]
- Jordan TR, McGowan VA, Kurtev S, Paterson KB. A further look at postview effects in reading: An eye-movements study of influences from the left of fixation. J Exp Psychol Learn Mem Cogn. 2016 Feb;42(2):296-307. [CrossRef]
- Bicknell K, Levy R, Rayner K. Ongoing cognitive processing influences precise eye-movement targets in reading. Psychological Science. 2020;31(4):351-62. [CrossRef]
- Norberg KA, Perfetti C, Helder A. Word-to-text integration and antecedent accessibility: Eye-tracking evidence extends results of ERPs. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2022 Apr;48(4):598-617. [CrossRef]
- Grootjen JW, Thalhammer P, Kosch T. Your eyes on speed: using pupil dilation to adaptively select speed-reading parameters in virtual reality. Proc ACM Hum Comput Interact. 2024 Sep;8(MHCI):284. [CrossRef]



Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).