Version 1
: Received: 3 April 2024 / Approved: 4 April 2024 / Online: 4 April 2024 (06:06:55 CEST)
How to cite:
Hannon, B.; Kumar, Y.; Li, J.J.; Morreale, P. Chef Dalle: Transforming Cooking with Multimodal AI. Preprints2024, 2024040334. https://doi.org/10.20944/preprints202404.0334.v1
Hannon, B.; Kumar, Y.; Li, J.J.; Morreale, P. Chef Dalle: Transforming Cooking with Multimodal AI. Preprints 2024, 2024040334. https://doi.org/10.20944/preprints202404.0334.v1
Hannon, B.; Kumar, Y.; Li, J.J.; Morreale, P. Chef Dalle: Transforming Cooking with Multimodal AI. Preprints2024, 2024040334. https://doi.org/10.20944/preprints202404.0334.v1
APA Style
Hannon, B., Kumar, Y., Li, J.J., & Morreale, P. (2024). Chef Dalle: Transforming Cooking with Multimodal AI. Preprints. https://doi.org/10.20944/preprints202404.0334.v1
Chicago/Turabian Style
Hannon, B., J. Jenny Li and Patricia Morreale. 2024 "Chef Dalle: Transforming Cooking with Multimodal AI" Preprints. https://doi.org/10.20944/preprints202404.0334.v1
Abstract
In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's adaptability. Chef Dalle showcases potential appli-cations ranging from home kitchens to grocery stores and restaurant menu customization, ad-dresses accessibility, promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
