Version 1
: Received: 20 June 2023 / Approved: 20 June 2023 / Online: 22 June 2023 (11:37:00 CEST)
How to cite:
Kleespies, M.W.; Schneider, S.; Emge, D.; Feucht, V.; Hacke, J.; Wenzel, V.; Dierkes, P.W. How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints2023, 2023061607. https://doi.org/10.20944/preprints202306.1607.v1
Kleespies, M.W.; Schneider, S.; Emge, D.; Feucht, V.; Hacke, J.; Wenzel, V.; Dierkes, P.W. How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints 2023, 2023061607. https://doi.org/10.20944/preprints202306.1607.v1
Kleespies, M.W.; Schneider, S.; Emge, D.; Feucht, V.; Hacke, J.; Wenzel, V.; Dierkes, P.W. How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints2023, 2023061607. https://doi.org/10.20944/preprints202306.1607.v1
APA Style
Kleespies, M.W., Schneider, S., Emge, D., Feucht, V., Hacke, J., Wenzel, V., & Dierkes, P.W. (2023). How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints. https://doi.org/10.20944/preprints202306.1607.v1
Chicago/Turabian Style
Kleespies, M.W., Volker Wenzel and Paul Wilhelm Dierkes. 2023 "How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature" Preprints. https://doi.org/10.20944/preprints202306.1607.v1
Abstract
The artificial intelligence chatbot ChatGPT can answer questions and solve tasks posed by the user within seconds. Using an exemplary task, this study investigates the reliability and con-sistency of the answers given by ChatGPT. For this purpose, it was analyzed whether the an-swers differ when a question is asked repeatedly and whether selected content categories and associated word combinations coincide with those from scientific literature. ChatGPT was asked 400 times, how the connectedness between humans and nature can be increased. The responses were classified into a categorization system and the most frequently occurring word combina-tions for each category were extracted. These word combinations were used for a search of re-lated scientific literature. In addition, the Normalized Mutual Information (NMI) between the 400 individual responses was calculated. The results show that the phrases used by ChatGPT within the categories are also found in the scientific literature, however, the number of mentions between scientific literature and ChatGPT differs. In addition, the NMI suggested that there are large differences between the categories mentioned in the individual answers. These results in-dicate that ChatGPT currently still has difficulties in answering complex questions and cannot yet replace scientific literature research or academic writing.
Keywords
ChatGPT; connectedness between humans and nature; literature search; literature review; Nor-malized Mutual Information (NMI); artificial intelligence
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
,
,
,
,
,
,
