Version 1
: Received: 30 January 2024 / Approved: 31 January 2024 / Online: 31 January 2024 (10:59:08 CET)
How to cite:
Rao, S. Assessing the Alignment of AI-Generated Evaluations with Human Judgment: A Case Study in an Entrepreneurship Pitch Competition. Preprints2024, 2024012211. https://doi.org/10.20944/preprints202401.2211.v1
Rao, S. Assessing the Alignment of AI-Generated Evaluations with Human Judgment: A Case Study in an Entrepreneurship Pitch Competition. Preprints 2024, 2024012211. https://doi.org/10.20944/preprints202401.2211.v1
Rao, S. Assessing the Alignment of AI-Generated Evaluations with Human Judgment: A Case Study in an Entrepreneurship Pitch Competition. Preprints2024, 2024012211. https://doi.org/10.20944/preprints202401.2211.v1
APA Style
Rao, S. (2024). Assessing the Alignment of AI-Generated Evaluations with Human Judgment: A Case Study in an Entrepreneurship Pitch Competition. Preprints. https://doi.org/10.20944/preprints202401.2211.v1
Chicago/Turabian Style
Rao, S. 2024 "Assessing the Alignment of AI-Generated Evaluations with Human Judgment: A Case Study in an Entrepreneurship Pitch Competition" Preprints. https://doi.org/10.20944/preprints202401.2211.v1
Abstract
Amidst the rapid advancements in artificial intelligence (AI) applications, determining the alignment between AI evaluations and human judgment remains crucial, especially in sectors like finance, healthcare, and education. This study delves into a unique scenario—a teenage entrepreneur pitch competition, mirroring real-world challenges faced by these young innovators. The objective was to assess the congruence between evaluations by ChatGPT, an AI model, and human judges. The results indicate a remarkable alignment between AI and human evaluations across several criteria. The implications of this study are far-reaching, highlighting AI's potential in ensuring unbiased and reliable evaluations in pitch competitions and beyond. However, navigating the juncture of AI and human judgment mandates continued research and ethical considerations.
Keywords
AI evaluations; Human judgment; Pitch competition; ChatGPT; Entrepreneurial evaluations
Subject
Social Sciences, Other
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
