Submitted:
19 May 2025
Posted:
20 May 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
1.1. Objectives
1.2. Related Works
2. Methodology
2.1. Procedures and Participants
2.2. Instruments
2.3. Data Analysis
2.4. GenAI Usage Statement
3. Results
3.1. Proportion of Students by Program
3.2. Proportion of Students by Semester
3.3. Memorizing Content
3.4. Ability to Find Errors in LLMs-Generated Code
4. Discussion
4.1. AI as Threat or Ally? The Impact of Educational Trajectories on Students’ Confidence Toward AI Integration
4.2. Rethinking Evidence: Machine Learning and the Replicability Challenge in Cognitive and Behavioral Neuroscience
5. Conclusion
References
- Adewale, M. D. , Azeta, A., Abayomi-Alli, A., & Sambo-Magaji, A. (2024). “Impact of artificial intelligence adoption on students' academic performance in open and distance learning: A systematic literature review”, Heliyon, v. 10, n. 22, e40025. [CrossRef]
- Ahmed, M. , Seraj, R., & Islam, S. M. S. (2020). “The k-means Algorithm: A Comprehensive Survey and Performance Evaluation,” Electronics, v. 9, n. 8, p. 1295. [CrossRef]
- Asio, J. M. R. , & Suero, A. N. (2024). “Artificial Intelligence Anxiety, Self-Efficacy, and Self-Competence among Students: Implications to Higher Education Institutions”, Education Policy and Development, v. 2, n. 2, p. 82-93.
- Carvalho, D. , Ferro, M., Corrêa, F., Faria, V., Lima, L., Souza, A., & Gromato, M. (2024). “Um Estudo Sobre a Percepção e Atitude dos Usuários de Sistemas Computacionais em Relação à Inteligência Artificial”, In Anais do V Workshop sobre as Implicações da Computação na Sociedade, pp. 13-23. Porto Alegre: SBC. [CrossRef]
- Chan, C. K. Y. , & Hu, W. (2023). “Students’ voices on generative AI: perceptions, benefits, and challenges in higher education”, International Journal of Educational Technology in Higher Education, v. 20, p. 43. [CrossRef]
- Cumming, G. (2008). “Replication and P intervals: P values predict the future only vaguely, but confidence intervals do much better”, Perspect. Psychol. Sci. 3, 286–300. [CrossRef]
- Ferreira, R. , Freitas, E., Cabral, L., Dawn, F., Rodrigues, L., Rakovic, M., Raniel, J., & Gašević, D. (2024). “Words of Wisdom: A Journey through the Realm of NLP for Learning Analytics – A Systematic Literature Review”, Journal of Learning Analytics, v. 11, n. 3, p. 82–105. [CrossRef]
- Franco, V. R. (2021). “Aprendizado de Máquina e Psicometria: Inovações Analíticas na Avaliação Psicológica”, Avaliação Psicológica, 20(3), a-c. [CrossRef]
- Guo, D. , Zhu, Q., Yang, D., Xie, Z., Dong, K., Zhang, W., Chen, G., Bi, X., Wu, Y., Li, Y. K., Luo, F., Xiong, Y., & Liang, W. (2024). “DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence”, ArXiv. [CrossRef]
- Hamerly, G., & Elkan, C. (2003). “Learning the k in k-means,” In Proceedings of the 17th International Conference on Neural Information Processing Systems (NIPS'03), v. 17, p. 281–288.
- Hunter, J. D. (2007). Matplotlib: A 2D Graphics Environment. Computing in Science & Engineering, 9(3), 90–95. [CrossRef]
- Hwang, G.-J. , Xie, H., Wah, B. W., & Gašević, D. (2020). “Vision, challenges, roles and research issues of Artificial Intelligence in Education”, Computers and Education: Artificial Intelligence, v. 1, 100001. [CrossRef]
- Jošt, G. , Taneski, V., & Karakatič, S. (2024). “The impact of Large Language Models on programming education and student learning outcomes,” Applied Sciences, v. 14, n. 10, p. 4115. [CrossRef]
- McDermott, M. B. A. , Wang, S., Marinsek, N., Ranganath, R., Ghassemi, M., Foschin, L., et al. (2019). “Reproducibility in machine learning for health”, ArXiv. [CrossRef]
- McKinney, W. (2010). “Data Structures for Statistical Computing in Python. Proceedings of the 9th Python in Science Conference”, 51–56. [CrossRef]
- Marrone, R. , Zamecnik, A., Joksimovic, S. et al. (2024). “Understanding Student Perceptions of Artificial Intelligence as a Teammate. Tech Know Learn”. [CrossRef]
- Nkedishu, V. C. , & Okonta, V. (2024). “Unpacking Optimism versus Concern: Tertiary Students' Multidimensional Views on the Rise of Artificial Intelligence (AI),” International Research Journal of Multidisciplinary Scope, v. 5, p. 362-377.
- Orrù, G. , Monaro, M., Conversano, C., Gemignani, A., & Sartori, G. (2020). “Machine learning in psychometrics and psychological research”, Frontiers in Psychology, 10. [CrossRef]
- Pedregosa, F. , Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O.,... & Duchesnay, É. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
- Pinto, P. H. R. , Araujo, V. M. U. D., Ferreira Junior, C. D. S., Goulart, L. L., Aguiar, G. S., Beltrão, J. V. C., Lira, P. D. D., Mendes, S. J. F., Monteiro, F. D. L. V., & Avelino, E. L. (2023). “Assessing the Psychological Impact of Generative AI on Computer and Data Science Education: An Exploratory Study”, Preprints. [CrossRef]
- Pinto, P. H. R. (2025). LLMs Dataset UFPB [Data set]. Kaggle. [CrossRef]
- Sarker, I.H. Machine Learning: Algorithms, Real-World Applications and Research Directions. SN COMPUT. SCI. 2, 160 (2021). [CrossRef]
- Szucs, D. , and Ioannidis, J. P. A. (2017). “Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature”, PLoS Biol. 15:e2000797. [CrossRef]
- Silva, M. , Seixas, E., Ferro, M., Viterbo, J., Seixas, F., & Salgado, L. (2024). “Ética e Responsabilidade na Era da Inteligência Artificial: Um Survey com Estudantes de Computação”, In Anais do XXXII Workshop sobre Educação em Computação, (pp. 854-865). Porto Alegre: SBC. [CrossRef]
- Tu, Xinming, et al. “What Should Data Science Education Do with Large Language Models?” Harvard Data Science Review, vol. 6, no. 1, 19 Jan. 2024. [CrossRef]
- United States Congress. (2023). “Artificial Intelligence Literacy Act of 2023 (H.R.6791),” Bill introduced in the U.S. House of Representatives, 118th Congress, 1st Session. Available at: https://www.congress.gov/bill/118th-congress/house-bill/6791/text.
- Velastegui-Hernandez, D. C. , Rodriguez-Pérez, M. L., & Salazar-Garcés, L. F. (2023). “Impact of Artificial Intelligence on learning behaviors and psychological well-being of college students”, Salud, Ciencia y Tecnología - Serie de Conferencias, v. 2, p. 582. [CrossRef]
- Wang, Y.-M. , Wei, C.-L., Lin, H.-H., Wang, S.-C., & Wang, Y.-S. (2022). “What drives students’ AI learning behavior: a perspective of AI anxiety,” Interactive Learning Environments, v. 32, n. 6, p. 2584–2600. [CrossRef]
- Zhao, W. X. , Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., Du, Y., Yang, C., Chen, Y., Chen, Z., Jiang, J., Ren, R., Li, Y., Tang, X., Liu, Z., Liu, P., Nie, J.-Y., & Wen, J.-R. (2024). arXiv:2303.18223v15 [cs.CL]. [CrossRef]
- Zhou, X. , Fang, L., & Rajaram, K. (2025). “Exploring the digital divide among students of diverse demographic backgrounds: A survey of UK undergraduates”, Journal of Applied Learning & Teaching, 8(1). [CrossRef]





Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).