Review
Version 1
Preserved in Portico This version is not peer-reviewed
Unraveling the Mysteries of AI Chatbots
Version 1
: Received: 10 May 2023 / Approved: 12 May 2023 / Online: 12 May 2023 (07:47:13 CEST)
A peer-reviewed article of this Preprint also exists.
Bridgelall, R. (2024). Unraveling the mysteries of AI chatbots. Artificial Intelligence Review, 57(4), 89. Bridgelall, R. (2024). Unraveling the mysteries of AI chatbots. Artificial Intelligence Review, 57(4), 89.
Abstract
This primer provides an overview of the rapidly evolving field of generative artificial intelligence, specifically focusing on large language models like ChatGPT (OpenAI) and Bard (Google). Large language models have demonstrated unprecedented capabilities in responding to natural language prompts. The aim of this primer is to demystify the underlying theory and architecture of large language models, providing intuitive explanations for a broader audience. Learners seeking to gain insight into the technical underpinnings of large language models must sift through rapidly growing and fragmented literature on the topic. This primer brings all the main concepts into a single digestible document. Topics covered include text tokenization, vocabulary construction, token embedding, context embedding with attention mechanisms, artificial neural networks, and objective functions in model training. The primer also explores state-of-the-art methods in training large language models to generalize on specific applications and to align with human intentions. Finally, an introduction to the concept of prompt engineering highlights the importance of effective human-machine interaction through natural language in harnessing the full potential of artificial intelligence chatbots. This comprehensive yet accessible primer will benefit students and researchers seeking foundational knowledge and a deeper understanding of the inner workings of existing and emerging artificial intelligence models. The author hopes that the primer will encourage further responsible innovation and informed discussions about these increasingly powerful tools.
Keywords
Generative Artificial Intelligence; Large Language Models; ChatGPT; Bard; Transformer Architecture; Prompt Engineering
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment
