Preprint Essay Version 1 Preserved in Portico This version is not peer-reviewed

Assessing the Current Performance of ChatGPT and the Implications in the Academic and Scientific Community: Failures, Misuse, and Challenges

Version 1 : Received: 16 August 2023 / Approved: 16 August 2023 / Online: 16 August 2023 (09:59:35 CEST)

How to cite: Pech-Rodríguez, W.J.; Armendáriz-Mireles, E.N.; Calles-Arriaga, C.A.; Rodríguez-Garcia, J.A.; Rocha-Rangel, E. Assessing the Current Performance of ChatGPT and the Implications in the Academic and Scientific Community: Failures, Misuse, and Challenges. Preprints 2023, 2023081188. https://doi.org/10.20944/preprints202308.1188.v1 Pech-Rodríguez, W.J.; Armendáriz-Mireles, E.N.; Calles-Arriaga, C.A.; Rodríguez-Garcia, J.A.; Rocha-Rangel, E. Assessing the Current Performance of ChatGPT and the Implications in the Academic and Scientific Community: Failures, Misuse, and Challenges. Preprints 2023, 2023081188. https://doi.org/10.20944/preprints202308.1188.v1

Abstract

Herein are reported the main pros and cons of using the conversational Artificial Intelligence (AI) called “ChatGPT” as a tool to write essays in the academic and scientific community. Also, selected mathematical and scientific problems were solved to determine the effectiveness of this platform. To this end, a systematic case study was designed and conducted to obtain data generated by the chatbot that was further analyzed. Six different topics were chosen for the essay evaluation, and the introduction section was created using this AI. Meanwhile, six mathematical problems related to integrals, z-transform, Laplace transform, and resolution of ordinary differential equations were solved. Furthermore, a scientific problem associated with the structural properties of material was also solved. After data analysis, we concluded that the conversational platform could quickly create written essays with well-structured words. Nonetheless, in almost all cases, the chatbot only used basic information to complete the introduction, and no critical writing was obtained. For the mathematical case study, we observed that under the current status of the ChatGPT, this platform has no ability or skills to solve complex equations. Thus, significant changes need to be conducted to improve the performance of ChatGPT for mathematical solutions.

Keywords

ChatGPT; Artificial intelligence; chatbot; Open AI; Digital engineering.

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.