Version 1
: Received: 7 March 2024 / Approved: 8 March 2024 / Online: 8 March 2024 (14:42:50 CET)
How to cite:
Pavlik, E. J.; Ramaiah, D.; Rives, T.; Swiecki-Sikora, A.; Land, J. Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant. Preprints2024, 2024030522. https://doi.org/10.20944/preprints202403.0522.v1
Pavlik, E. J.; Ramaiah, D.; Rives, T.; Swiecki-Sikora, A.; Land, J. Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant. Preprints 2024, 2024030522. https://doi.org/10.20944/preprints202403.0522.v1
Pavlik, E. J.; Ramaiah, D.; Rives, T.; Swiecki-Sikora, A.; Land, J. Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant. Preprints2024, 2024030522. https://doi.org/10.20944/preprints202403.0522.v1
APA Style
Pavlik, E. J., Ramaiah, D., Rives, T., Swiecki-Sikora, A., & Land, J. (2024). Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant. Preprints. https://doi.org/10.20944/preprints202403.0522.v1
Chicago/Turabian Style
Pavlik, E. J., Allison Swiecki-Sikora and Jamie Land. 2024 "Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant" Preprints. https://doi.org/10.20944/preprints202403.0522.v1
Abstract
1) Background: When women receive a diagnosis of a gynecologic malignancy, they can have questions about their diagnosis or treatment that can result in voice queries to virtual assistants. Recent advancement in artificial intelligence (AI) has transformed the landscape of medical information accessibility. The Google virtual assistant (VA) outperformed Siri, Alexa, and Cortana in voice queries presented prior to the explosive implementation of AI in early 2023. The efforts presented here focus on determining if advances in AI in the last 12 months improved the accuracy of Google VA responses related to gynecologic oncology. (2) Methods: Previous questions were utilized to form a common basis for queries prior to 2023 and responses in 2024. Correct answers were obtained from the UpToDate medical resource. Responses related to gynecologic oncology were obtained using Google VA, as well as the generative AI chatbots Google Bard/Gemini and Microsoft Bing-Copilot. (3) Results: The AI narrative responses varied in length and positioning of answers within the response. Google Bard/Gemini achieved an 87.5% accuracy rate, while Microsoft Bing-Copilot reached 83.3%. In contrast, the Google VA’s accuracy in audible responses improved from 18% prior to 2023 to 63% in 2024. (4) Conclusion: While the accuracy of the Google VA has improved in the last year, it underperformed Google Bard/Gemini and Microsoft Bing-Copilot so that there is considerable room for further improved accuracy.
Keywords
accuracy; virtual assistants; Google; Google Bard/Gemini; Microsoft Bing-Copilot; gynecologic; oncology
Subject
Medicine and Pharmacology, Oncology and Oncogenics
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
