Submitted:
29 June 2023
Posted:
29 June 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
- ➢
- Publication Trends: How has research output related to ChatGPT evolved over time? Which are the prominent publication venues and journals that feature research on ChatGPT?
- ➢
- Citation Analysis: How has ChatGPT been referenced in scholarly literature? Which papers, authors, countries and journals have made significant contributions to the understanding and advancement of ChatGPT?
- ➢
- Collaborative Networks: Who are the key contributors and collaborators in the ChatGPT research landscape? What patterns of collaboration and co-authorship exist among researchers, institutions and countries working on ChatGPT-related topics?
- ➢
- Application Domains: In which primary domains has ChatGPT found an application? How are researchers leveraging its capabilities in fields such as customer support, content generation, and virtual assistance?
- ➢
- Future Directions: Based on the keyword analysis related to ChatGPT's scholarly footprint, what emerging keywords and potential research area for future research can be identified? What challenges and opportunities lie ahead in enhancing ChatGPT's capabilities and impact?
2. Methodology
2.1. Data Extraction
2.2. Data Analysis
3. Findings
3.1. Types of Documents Published and the Thematic Area of Research
3.2. Most Cited Documents, Authors, Countries and Journals
3.3. Collaboration Network of Author, Institution and Countries
3.4. Sankey Diagram (Three-Field Plot)
3.5. Keyword Analysis
4. Discussion
5. Conclusions
References
- Carvalho, I.; Ivanov, S. ChatGPT for tourism: applications, benefits and risks. Tourism Review, 2023; ahead-of-print. [Google Scholar] [CrossRef]
- Hassani, H.; Silva, E.S. The Role of ChatGPT in Data Science: How AI-Assisted Conversational Interfaces Are Revolutionizing the Field. Big Data and Cognitive Computing 2023, 7, 62. [Google Scholar] [CrossRef]
- Sohail, S.S.; Farhat, F.; Himeur, Y.; Nadeem, M.; Madsen, D.Ø.; Singh, Y.; Atalla, S.; Mansoor, W. The Future of GPT: A Taxonomy of Existing ChatGPT Research, Current Challenges, and Possible Future Directions. Current Challenges, and Possible Future Directions (April 8, 2023), 2023. [Google Scholar]
- Dwivedi, Y.K.; Kshetri, N.; Hughes, L.; Slade, E.L.; Jeyaraj, A.; Kar, A.K.; Baabdullah, A.M.; Koohang, A.; Raghavan, V.; Ahuja, M. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 2023, 71, 102642. [Google Scholar] [CrossRef]
- Wood, D.A.; Achhpilia, M.P.; Adams, M.T.; Aghazadeh, S.; Akinyele, K.; Akpan, M.; Allee, K.D.; Allen, A.M.; Almer, E.D.; Ames, D. The ChatGPT Artificial Intelligence Chatbot: How Well Does It Answer Accounting Assessment Questions? Issues in Accounting Education 2023, 1–28. [Google Scholar] [CrossRef]
- Ray, P.P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems 2023, 3, 121–154. [Google Scholar] [CrossRef]
- Sallam, M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. In Proceedings of the Healthcare; 2023; p. 887. [Google Scholar] [CrossRef]
- Lo, C.K. What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences 2023, 13, 410. [Google Scholar] [CrossRef]
- Ivanov, S.; Soliman, M. Game of algorithms: ChatGPT implications for the future of tourism education and research. Journal of Tourism Futures, 2023; ahead-of-print. [Google Scholar] [CrossRef]
- Baumgartner, C. The potential impact of ChatGPT in clinical and translational medicine. Clinical and translational medicine 2023, 13. [Google Scholar] [CrossRef]
- Farhat, F.; Sohail, S.S.; Madsen, D.Ø. How trustworthy is ChatGPT? The case of bibliometric analyses. Cogent Engineering 2023, 10, 2222988. [Google Scholar] [CrossRef]
- Gilson, A.; Safranek, C.W.; Huang, T.; Socrates, V.; Chi, L.; Taylor, R.A.; Chartash, D. How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education 2023, 9, e45312. [Google Scholar] [CrossRef]
- Dave, T.; Athaluri, S.A.; Singh, S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Frontiers in Artificial Intelligence 2023, 6, 1169595. [Google Scholar] [CrossRef]
- Khosravi, H.; Shafie, M.R.; Hajiabadi, M.; Raihan, A.S.; Ahmed, I. Chatbots and ChatGPT: A Bibliometric Analysis and Systematic Review of Publications in Web of Science and Scopus Databases. arXiv preprint arXiv:2304.05436, arXiv:2304.05436 2023.
- Levin, G.; Brezinov, Y.; Meyer, R. Exploring the use of ChatGPT in OBGYN: a bibliometric analysis of the first ChatGPT-related publications. Archives of Gynecology and Obstetrics 2023. [Google Scholar] [CrossRef]
- Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research 2021, 133, 285–296. [Google Scholar] [CrossRef]
- Farhat, F.; Athar, M.T.; Ahmad, S.; Madsen, D.Ø.; Sohail, S.S. Antimicrobial resistance and machine learning: past, present, and future. Frontiers in Microbiology 2023, 14, 1717. [Google Scholar] [CrossRef] [PubMed]
- Aria, M.; Cuccurullo, C. bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics 2017, 11, 959–975. [Google Scholar] [CrossRef]
- Van Eck, N.J.; Waltman, L. Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics 2010, 84, 523–538. [Google Scholar] [CrossRef]
- Biswas, S. ChatGPT and the future of medical writing. 2023, 307, e223312. [CrossRef]
- Thorp, H.H. ChatGPT is fun, but not an author. Science 2023, 379, 313. [Google Scholar] [CrossRef] [PubMed]
- Stokel-Walker, C. ChatGPT listed as author on research papers: many scientists disapprove. Nature 2023, 613, 620–621. [Google Scholar] [CrossRef]
- van Dis, E.A.M.; Bollen, J.; Zuidema, W.; van Rooij, R.; Bockting, C.L. ChatGPT: five priorities for research. Nature 2023, 614, 224–226. [Google Scholar] [CrossRef]
- Editorial. Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature 2023, 613, 612. [Google Scholar] [CrossRef] [PubMed]
- Else, H. Abstracts written by ChatGPT fool scientists. Nature 2023, 613, 423. [Google Scholar] [CrossRef]
- Shen, Y.; Heacock, L.; Elias, J.; Hentel, K.D.; Reig, B.; Shih, G.; Moy, L. ChatGPT and other large language models are double-edged swords. 2023, 307, e230163. [CrossRef]
- Stokel-Walker, C. AI bot ChatGPT writes smart essays — should academics worry? Nature 2022. [Google Scholar] [CrossRef] [PubMed]
- Stokel-Walker, C.; Van Noorden, R. What ChatGPT and generative AI mean for science. Nature 2023, 614, 214–216. [Google Scholar] [CrossRef] [PubMed]
- Liebrenz, M.; Schleifer, R.; Buadze, A.; Bhugra, D.; Smith, A. Generating scholarly content with ChatGPT: ethical challenges for medical publishing. The Lancet Digital Health 2023, 5, e105–e106. [Google Scholar] [CrossRef] [PubMed]
- Patel, S.B.; Lam, K. ChatGPT: the future of discharge summaries? The Lancet Digital Health 2023, 5, e107–e108. [Google Scholar] [CrossRef] [PubMed]
- Pavlik, J.V. Collaborating With ChatGPT: Considering the Implications of Generative Artificial Intelligence for Journalism and Media Education. Journalism and Mass Communication Educator 2023. [Google Scholar] [CrossRef]
- Salvagno, M.; Taccone, F.S.; Gerli, A.G. Can artificial intelligence help for scientific writing? Critical care 2023, 27, 1–5. [Google Scholar]
- Gordijn, B.; Have, H. ChatGPT: evolution or revolution? Medicine, Health Care and Philosophy, 2023. [Google Scholar] [CrossRef]
- The Lancet Digital, H. ChatGPT: friend or foe? The Lancet Digital Health 2023, 5, e102. [Google Scholar] [CrossRef]
- Lund, B.D.; Wang, T. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News 2023, 40, 26–29. [Google Scholar] [CrossRef]
- Kitamura, F.C. ChatGPT is shaping the future of medical writing but still requires human judgment. 2023, 307, e230171. [CrossRef]
- Wang, F.-Y.; Miao, Q.; Li, X.; Wang, X.; Lin, Y. What does ChatGPT say: The DAO from algorithmic intelligence to linguistic intelligence. IEEE/CAA Journal of Automatica Sinica 2023, 10, 575–579. [Google Scholar] [CrossRef]
- Farhat, F.; Sohail, S.S.; Siddiqui, F.; Irshad, R.R.; Madsen, D.Ø. Curcumin in Wound Healing—A Bibliometric Analysis. Life 2023, 13, 143. [Google Scholar] [CrossRef]
- Hassani, H.; Silva, E.S.; Unger, S.; TajMazinani, M.; Mac Feely, S. Artificial Intelligence (AI) or Intelligence Augmentation (IA): What Is the Future? AI 2020, 1, 143–155. [Google Scholar] [CrossRef]















| Description | Results |
|---|---|
| Timespan | 2022-2023 (Nov. 2022 to May 2023) |
| Sources (Journals, Books, etc.) | 341 |
| Documents | 533 |
| Annual Growth Rate % | 17566.67 |
| Total citations | 1362 |
| Self-Citations | 824 |
| Self-Citations % | 60.5 |
| Average citations per doc | 2.546 |
| References | 11244 |
| DOCUMENT CONTENTS | |
| Total Keywords | 1998 |
| Keywords Plus (ID) | 1371 |
| Author's Keywords (DE) | 882 |
| AUTHORS | |
| Authors | 1434 |
| Authors of single-authored docs | 159 |
| Single-authored docs | 182 |
| Single-authored docs % | 34.14 |
| Co-Authors per Doc | 3.08 |
| Authors collaboration % | 88.91 |
| COUNTRIES | |
| Countries | 87 |
| Single-country docs | 420 |
| Multiple-country docs | 113 |
| Countries collaboration % | 21.2 |
| INSTITUTIONS | |
| Institutions | 1195 |
| Institutions collaboration % | 6.44 |
| Journal | Article Count |
Citation Count |
Average Citation per Article (ACPA) | H-Index | Publisher |
|---|---|---|---|---|---|
| Annals Of Biomedical Engineering | 28 | 46 | 1.64 | 150 | Springer Netherlands |
| Nature | 17 | 367 | 21.58 | 1331 | Nature Publishing Group |
| Library Hi Tech News | 12 | 20 | 1.66 | 22 | Emerald Group Publishing Ltd. |
| Medical Teacher | 6 | 3 | 0.5 | 131 | Informa Healthcare |
| Radiology | 6 | 100 | 16.66 | 320 | Radiological Society of North America Inc. |
| Accountability In Research | 5 | 11 | 2.2 | 35 | Taylor and Francis Ltd. |
| Annals Of Surgical Oncology | 5 | 1 | 0.2 | 192 | Springer New York |
| IEEE/CAA Journal of Automatica Sinica | 5 | 19 | 3.8 | 67 | IEEE Advancing Technology for Humanity |
| JMIR Medical Education | 5 | 39 | 7.8 | 23 | JMIR Publications Inc. |
| Journal of Chemical Education | 5 | 0 | 0 | 95 | American Chemical Society |
| Country | Article Count |
Total Citations | Average Citation per Article (ACPA) |
|---|---|---|---|
| United States | 173 | 391 | 2.26 |
| India | 48 | 50 | 1.04 |
| United Kingdom | 47 | 153 | 3.25 |
| China | 43 | 73 | 1.69 |
| Australia | 38 | 76 | 2 |
| Canada | 23 | 25 | 1.08 |
| Italy | 23 | 67 | 2.91 |
| Germany | 21 | 59 | 2.80 |
| South Korea | 15 | 33 | 2.2 |
| France | 14 | 57 | 4.07 |
| Authors | Article Count |
Total Citations | Average Citation per Article | Affiliation | Country of Origin |
|---|---|---|---|---|---|
| Wang F.Y. | 9 | 23 | 2.55 | Institute of Automation Chinese Academy of Sciences | China |
| Wu H. | 7 | 16 | 2.28 | Duke University School of Medicine | USA |
| Cheng K. | 6 | 12 | 2 | Zhengzhou University | China |
| He Y. | 6 | 16 | 2.66 | The University of North Carolina at Chapel Hill | USA |
| Kleebayoon A. | 6 | 0 | 0 | Joesph Ayobabalola University | Nigeria |
| Teixeira Da Silva J.A. | 6 | 5 | 0.83 | Miki-cho Post Office, Kagawa | Japan |
| Wiwanitkit V. | 6 | 0 | 0 | Chandigarh University | India |
| Ali M.J. | 5 | 8 | 1.6 | L.V. Prasad Eye Institute India | India |
| Gu S. | 5 | 15 | 3 | Duke University School of Medicine | USA |
| Lu Y. | 5 | 10 | 2 | Zhengzhou University | China |
| Organization | Article Count |
Total Citations | Average Citation per Article | Country of Origin |
|---|---|---|---|---|
| Duke University | 14 | 32 | 2.28 | USA |
| Chinese Academy of Sciences | 9 | 23 | 2.55 | China |
| Chandigarh University | 8 | 02 | 0.25 | India |
| Johns Hopkins School of Medicine | 7 | 08 | 1.14 | USA |
| Tianjin Medical University | 7 | 16 | 2.28 | China |
| University of Chinese Academy of Sciences | 7 | 23 | 3.28 | China |
| Beijing Sport University | 6 | 16 | 2.66 | China |
| University of Toronto | 6 | 03 | 0.5 | Canada |
| Zhengzhou University | 6 | 12 | 2 | China |
| Monash University | 6 | 06 | 1 | Australia |
| No. | Title | Total Citation | Article Type | Journal | Country of First Author | Reference |
|---|---|---|---|---|---|---|
|
1 |
ChatGPT is fun, but not an author | 93 |
Editorial |
Nature |
USA |
[21] |
|
2 |
ChatGPT listed as author on research papers: many scientists disapprove | 88 |
Note |
Nature |
UK |
[22] |
|
3 |
ChatGPT: five priorities for research | 63 |
Note |
Nature |
Netherlands |
[23] |
|
4 |
Tools such as ChatGPT threaten transparent science; here are our ground rules for their us | 61 |
Editorial |
Nature |
USA |
[24] |
|
5 |
Abstracts written by ChatGPT fool scientists | 57 |
Note |
Nature |
USA |
[25] |
|
6 |
ChatGPT and Other Large Language Models Are Double-edged Swords | 47 |
Editorial |
Radiology |
USA |
[26] |
|
7 |
AI bot ChatGPT writes smart essays — should professors worry? | 43 |
Note |
Nature |
UK |
[27] |
|
8 |
ChatGPT and the Future of Medical Writing | 33 |
Note |
Radiology |
USA |
[20] |
|
9 |
What ChatGPT and generative AI mean for science | 33 | Note | Nature | UK | [28] |
|
10 |
How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment | 33 |
Article |
JMIR Medical Education |
USA |
[12] |
| 11 | Generating scholarly content with ChatGPT: ethical challenges for medical publishing | 29 |
Note |
The Lancet Digital Health | Switzerland | [29] |
| 12 | ChatGPT: the future of discharge summaries? | 28 | Note | The Lancet Digital Health | UK | [30] |
| 13 | Collaborating With ChatGPT: Considering the Implications of Generative Artificial Intelligence for Journalism and Media Education | 28 | Article | Journalism and Mass Communication Educator | USA | [31] |
| 14 | “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy | 24 | Article | International Journal of Information Management | India | [4] |
| 15 | Can artificial intelligence help for scientific writing? | 21 | Article | Critical Care | Belgium | [32] |
| 16 | ChatGPT: evolution or revolution? | 19 | Editorial | Medicine, Health Care and Philosophy | Ireland | [33] |
| 17 | ChatGPT: friend or foe? | 18 | Editorial | The Lancet Digital Health | [34] | |
| 18 | Chatting about ChatGPT: how may AI and GPT impact academia and libraries? | 16 | Review | Library Hi Tech News | USA | [35] |
| 19 | ChatGPT Is Shaping the Future of Medical Writing But Still Requires Human Judgment | 15 | Editorial | Radiology | Brazil | [36] |
| 20 | What Does ChatGPT Say: The DAO from Algorithmic Intelligence to Linguistic Intelligence | 15 | Review | IEEE/CAA Journal of Automatica Sinica | China | [37] |
| No. | Keyword 1 | Keyword 2 | Co-Occurrence |
|---|---|---|---|
| 1 | Artificial intelligence | ChatGPT | 117 |
| 2 | Artificial intelligence | Human | 102 |
| 3 | Human | ChatGPT | 38 |
| 4 | Artificial intelligence | Natural language processing | 33 |
| 5 | Human | Article | 32 |
| 6 | Artificial intelligence | Machine learning | 29 |
| 7 | Artificial intelligence | Article | 28 |
| 8 | ChatGPT | Natural language processing | 27 |
| 9 | Artificial Intelligence | Chatbot | 27 |
| 10 | ChatGPT | Chatbot | 27 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).