Submitted:
11 July 2026
Posted:
15 July 2026
You are already at the latest version
Abstract
Keywords:
1. Introduction
- 1.
- Novel System Architecture: We present a comprehensive architecture that combines LLMs with external service APIs to create a fully functional conversational agent for sustainable travel planning. The architecture is modular, scalable, and designed for eventual deployment in production environments.
- 2.
- Technical Implementation Details: We provide detailed technical specifications of the system implementation, including prompt engineering strategies, context management approaches, API integration patterns, and sustainability calculation methodologies. These details contribute practical knowledge to the growing field of LLM based agent development.
- 3.
- Systematic Evaluation: We conduct rigorous evaluation of system performance across multiple dimensions: functional correctness, intent recognition accuracy, entity extraction completeness, API integration reliability. Demonstrating that the system meets established targets for TRL 4 validation.
- 4.
- Lessons Learned and Future Directions: We offer practical insights from implementing and testing the system, identifying both technical challenges (prompt consistency, API reliability, carbon footprint estimation accuracy) and opportunities for enhancement (multimodal inputs, real time pricing, booking integration), contributing to the knowledge base for AI driven sustainable tourism applications [36,37].
2. Materials and Methods
2.1. System Architecture Overview
2.2. Frontend: Conversational Interface
2.2.1. Technology Selection
2.2.2. Interface Design Principles
2.3. AI Model Integration
2.3.1. Prompt Engineering Methodology
- System Prompt (Role Definition): Establishes the agent’s role, personality, and core behavioral constraints.
- Task Instructions (Dynamic): Specifies current objectives based on conversation state, such as information gathering ("Ask the user about their preferred travel dates"), itinerary generation ("Create a comprehensive 5 day itinerary for Barcelona"), or modification handling ("Update the accommodation to match the user’s budget constraint").
- Context Injection: Includes conversation history (truncated to most recent 50 turns or 100,000 tokens), previously collected user preferences stored in structured format (JSON), and relevant external data (recent flight search results, destination information).
- Output Constraints: Defines format requirements (itineraries in Markdown with day by day information, including schedules and activities), sustainability prioritization rules (prefer trains over flights for sort distances, highlight eco certified accommodations), and content restrictions (avoid promoting environmentally harmful activities).
- Ensuring a consistent Markdown format for itineraries, so that daily information (schedules, activities) is clear and easy to read.
- Balancing conversational friendliness with efficiency to avoid unnecessarily long exchanges.
- Handling ambiguous or incomplete user inputs gracefully with clarifying questions.
- Prioritizing sustainability without adopting preachy or judgmental tones that might alienate users.
- Maintaining factual accuracy while acknowledging uncertainty when appropriate.
2.3.2. Function Calling Implementation
- search_complete_flights: Queries the Amadeus API for available flights. This integration provides access to real time flight information, including availability, pricing, and estimated emissions. Using actual flight data, the system ensures that users receive accurate and up to date travel options while raising awareness about the environmental impact of each flight. This enables users to make informed and sustainable choices when selecting their itineraries.
- create_itinerary: Generates a complete itinerary based on user preferences and the instructions provided in the system prompt. The function organizes travel elements such as destinations, activities, and dates, ensuring that the final plan aligns with the user’s goals and sustainability considerations.
- modify_itinerary: Updates specific itinerary components based on user requests, maintaining consistency across dependent elements (e.g., adjusting activity schedules when travel dates change).
2.4. Natural Language Processing Pipeline
2.4.1. Intent Classification
- InitiateTrip: User wants to start planning a new trip ("I’d like to plan a vacation").
- ProvidePreference: User specifies preferences regarding destination, dates, budget, transportation, or activities.
- RequestItinerary: User asks to generate complete travel plan ("Show me the full itinerary").
- ModifyItinerary: User wants to change specific aspects of generated plan.
- GeneralQuery: User has questions about destinations, sustainability, or travel advice.
2.4.2. Named Entity Recognition
- Destinations: Geographic entities including cities, countries, regions (e.g., "Barcelona", "Catalonia", "Spain", "Mediterranean coast").
- Temporal Expressions: Date ranges, relative dates, durations (e.g., "January 5 10", "next weekend", "for five days", "early March").
- Numerical Values: Passenger counts, budget amounts, durations in days.
- Transportation Preferences: Mode specifications (airplane, train, bus, car, bicycle, walking) with qualifiers.
- Activity Interests: Types of desired experiences (museums, hiking, beaches, local cuisine, cultural events).
2.5. Sustainable Recommendation Strategies
2.6. Evaluation Metrics
- Functional Correctness (FC): This metric measures whether the agent successfully completed the main task required by each test scenario. A scenario was considered functionally correct when the system produced an itinerary, modification, recommendation, or answer that matched the user’s stated goal and respected the relevant constraints, such as destination, dates, number of travelers, budget, and transport preferences. FC was calculated as the percentage of scenarios completed without major task failure.
- Intent Recognition Accuracy (IRA): IRA evaluates the system’s ability to correctly identify the user’s communicative intention. For each user message, the detected intent was compared with a manually assigned reference label from the intent categories defined in the natural language processing pipeline, including InitiateTrip, ProvidePreference, RequestItinerary, ModifyItinerary, and GeneralQuery. The metric was computed as the proportion of correctly classified intents over the total number of evaluated intent instances.
- Entity Extraction Completeness (EEC): EEC measures how completely the system identified the information required for travel planning from the user’s messages. The evaluation considered destination names, temporal expressions, passenger numbers, budget values, transportation preferences, and activity interests. For each scenario, extracted entities were compared against a manually defined reference set, and completeness was calculated as the percentage of required entities correctly captured by the system.
- Response Coherence (RC): RC assesses the clarity, consistency, and contextual appropriateness of the agent’s natural language responses. Responses were rated on a five point scale, where 1 indicated an incoherent or irrelevant answer and 5 indicated a clear, well structured, contextually consistent response. The final RC value corresponds to the mean score across the evaluated responses.
- API Integration Reliability (AIR): AIR measures the reliability of external service coordination, especially calls to the Amadeus flight API. A tool interaction was counted as successful when the API request was completed, valid data were returned, and the agent incorporated the retrieved information into the response without breaking the dialogue flow. AIR was calculated as the percentage of successful API interactions over the total number of attempted API calls.
- Sustainability Integration (SI): SI evaluates the extent to which sustainability criteria were explicitly incorporated into itinerary generation and recommendation explanations. The assessment considered whether the system included carbon footprint information where available, prioritized lower emission transport alternatives when feasible, suggested eco friendly accommodation or activities, and explained sustainability trade offs in a user understandable way. SI was rated on a five point scale, where 1 indicated no meaningful sustainability consideration and 5 indicated systematic and well explained sustainability integration.
- Average Response Time and Itinerary Generation Time: These latency metrics quantify the system’s responsiveness during interaction. Response time was measured from the moment a user message was submitted until the agent returned a complete answer. Average response time summarizes general conversational responsiveness, while itinerary generation time focuses specifically on complete itinerary construction involving reasoning, tool use, and structured output generation. For both metrics, the reported values correspond to the 95th percentile, reflecting performance under near worst case conditions rather than only average behavior.
3. Results
3.1. System Performance Overview
3.2. Natural Language Understanding Performance
3.2.1. Intent Classification Results



3.2.2. Entity Extraction Performance
- Numeric: "1000 euros", "$1500", "1k"
- Qualitative: "budget friendly", "not too expensive", "mid range"
- Contextual: "around what the flights will cost"
User: "We’re interested in culture and outdoor activities."
Agent: "Great! When you mention culture, are you more interested in museums and historical sites, or local traditions and food experiences? And for outdoor activities, are you thinking hiking, water sports, or something else?"
3.2.3. Context Maintenance Evaluation
Turn 8: "What about the hotel options?"
Turn 12: "Can we change it to something cheaper?"
System: Correctly identified "it" as referring to hotel from Turn 8
Agent: "Understood. I’ll prioritize flight options now. Since you mentioned earlier an interest in sustainable travel, I’ll focus on direct flights which have lower emissions than connections, and I’ll show you the carbon footprint for each option."
Turn 10 (Planning phase): User asks: "What’s the local cuisine like in Barcelona?"
Agent: Provides information about Catalan cuisine
Turn 11: "Thanks! Now back to the itinerary—what about accommodations?"
Agent: Seamlessly returns to itinerary planning without losing state
3.3. External Service Integration Results
3.3.1. Amadeus API Performance
Agent: "I’m experiencing high demand accessing flight information right now. I can provide general flight options between Madrid and Barcelona (typically 1h 15m, prices from 50 150), or we can wait a moment and try again for specific availability."
| Metric | Value | Notes |
|---|---|---|
| Total API Calls | 34 | Across 12 test scenarios |
| Successful Responses | 32 | 94.1% success rate |
| Failed Calls (Timeout) | 1 | Recovered via retry |
| Failed Calls (Rate Limit) | 1 | Handled by fallback |
| Average Response Time | 1.8s | SD: 0.4s |
| 95th Percentile Response Time | 2.6s | Within acceptable range |
| Cache Hit Rate | 23.5% | 8/34 requests served from cache |
| CO2 Data Availability | 100% | All flights included emissions |
Agent: "I found 3 direct flight options for your dates:
1. Flight IB3201 Departs 08:30, 89, 92kg CO2e
2. Flight VY2105 Departs 11:15, 76, 88kg CO2e
3. Flight UX7043 Departs 18:45, 94, 95kg CO2e
For comparison, taking the train (3h journey) would emit approximately 12kg CO2e per person, about 87% less than flying."
3.3.2. Simulated Service Performance
3.4. Itinerary Generation Quality
3.4.1. Structure and Completeness
- Transportation: 100% included with mode, duration, pricing, and CO2 emissions
- Accommodation: 100% included with sustainability certifications and eco practices
- Daily Activities: 100% included with timing, descriptions, and environmental impact notes
- Dining Recommendations: 95.8% included (1 itinerary omitted due to user declining)
- General Sustainability Tips: 100% included at itinerary end
3.4.2. Chronological Coherence
- Meal timing (breakfast, lunch, dinner at appropriate hours)
- Activity duration and transitions (sufficient time for travel between locations)
- Operating hours (museum visits during open times)
- Logical geographic routing (minimizing backtracking)
Day 2: Barcelona
09:00 12:00: Sagrada Família guided tour
12:30 14:00: Lunch at nearby organic restaurant Cal Pep
14:30 17:00: Gothic Quarter walking tour
17:30 19:00: Free time for shopping/rest
19:30 21:30: Dinner at farm to table restaurant Granja Petitbo
3.4.3. Personalization Quality
- Accommodation: 2 3 star hotels or guesthouses (40 80/night)
- Activities: Free walking tours, public parks, municipal museums
- Dining: Local cafeterias, markets, budget friendly traditional restaurants
- Mountain excursions (Montserrat, Pyrenees foothills)
- Coastal walks (Mediterranean path sections)
- Parks and gardens (Parc de la Ciutadella, Montjuïc)
3.5. Sustainable Recommendations Quality
- Train recommended over flight for Madrid Barcelona
- Eco certified accommodations listed first with sustainability features highlighted
- Walking/cycling tours prioritized over motorized alternatives
Agent: "While the direct flight is faster (1h 15m vs 3h by train) and costs about the same, the train journey produces 87% less carbon emissions per person. The train also offers comfortable seating, WiFi, and scenic views of the Spanish countryside."
Agent: "Park Güell can be extremely crowded during summer afternoons. I recommend visiting early morning (08:00 09:30) when it’s quieter and you’ll have a better experience while reducing pressure on the site."
3.5.1. Educational Value
Agent: "I notice your itinerary currently includes a flight. Just so you’re aware, this represents about 65% of your total trip emissions. If time allows, the train is a comfortable alternative that would reduce your carbon footprint by about 180kg. However, I understand time constraints are important—what works best for your schedule?"
3.6. Performance and Efficiency Metrics
3.6.1. Response Latency
- Multiple LLM inference passes (initial generation, formatting, validation)
- Response structuring and formatting
3.6.2. Token Usage and Cost Analysis
3.7. Error Analysis and System Limitations
3.7.1. Functional Failures
3.7.2. Entity Extraction Errors
- Budget expressions (8 errors): Qualitative descriptions ("moderate budget", "mid range") not mapped to numeric ranges.
- Activity interests (9 errors): Vague terms ("culture", "relaxation") not clarified through follow up questions.
- Temporal expressions (6 errors): Relative dates ("mid month", "around holidays") without specific anchoring.
- Dietary restrictions (4 errors): Implicit restrictions ("I don’t eat meat" not extracted as vegetarian).
- Other (7 errors): Miscellaneous edge cases.
3.7.3. Limitations Identified
- 1.
- Real time Pricing Absence: Simulated accommodation and activity pricing does not reflect market rates. Future integration with booking platforms necessary for production deployment.
- 2.
- Availability Checking: System cannot verify actual availability of hotels or activities. Generated itineraries assume availability without confirmation.
- 3.
- Multi destination Complexity: Performance degrades for trips involving 4+ distinct destinations, with reduced personalization quality and increased generation time (mean 18.3s vs. 8.5s for single destination).
- 4.
- Language Limitation: System tested only in Spanish. Multi language support requires additional prompt engineering and potentially fine tuned models.
- 5.
- Visual Content Absence: No integration of images, maps, or visual itinerary representations despite Gemini’s multimodal capabilities. Planned for future TRL phases.
4. Discussion
4.1. Key Findings and Implications
4.2. Practical Implications for Industry
4.3. Environmental Impact Considerations
4.4. Future Research Directions
- Real world validation: Deployment studies with actual users (TRL 5 6) to evaluate behavioral impact and system usability in realistic settings.
- End to end booking integration: Extension of the system to support full transaction flows, including reservation, payment, and confirmation handling.
- Multimodal interaction: Incorporation of visual and spatial information to improve travel planning experience and engagement.
- Personalization mechanisms: Development of long term user modeling approaches while ensuring privacy preserving data handling.
- Overtourism Management: Developing predictive models that assess destination capacity and recommend alternative timing or locations when popular sites experience pressure, contributing to more equitable tourism distribution [17].
5. Conclusion
References
- Celata, F.; Romano, A. Overtourism and online short-term rental platforms in Italian cities. J. Sustain. Tour. 2022, 30(5), 1020–1039. [Google Scholar] [CrossRef]
- Butler, Richard; Dodds, Rachel. Overcoming overtourism: a review of failure. Tour. Rev. 2022, 77, 35–53. [Google Scholar] [CrossRef]
- Ilieva, G.; Yankova, T.; Klisarova-Belcheva, S. Effects of Generative AI in Tourism Industry. Information 2024, 15, 671. [Google Scholar] [CrossRef]
- Dwivedi, Y. K.; Kshetri, N.; Hughes, L.; Slade, E. L.; Jeyaraj, A.; Kar, A. K.; Baabdullah, A. M.; Koohang, A.; Raghavan, V.; Ahuja, M.; Albanna, H.; Albashrawi, M. A.; Al-Busaidi, A. S.; Balakrishnan, J.; Barlette, Y.; Basu, S.; Bose, I.; Brooks, L.; Buhalis, D.; Wright, R. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int. J. Inf. Manag. 2023, 71, 102642. [Google Scholar] [CrossRef]
- Gursoy, D.; Li, Y.; Song, H. ChatGPT and the hospitality and tourism industry: an overview of current trends and future research directions. J. Hosp. Mark. Manag. 2023, 32, 579–592. [Google Scholar] [CrossRef]
- Prasanna, A.; Pushparaj, P.; Kushwaha, B.P. Conversational AI in Tourism: A systematic literature review using TCM and ADO framework. J. Hosp. Tour. Manag. 2025, 64, 101310. [Google Scholar] [CrossRef]
- Gupta, P.; Jiao, C.; Yeh, Y.T.; Mehri, S.; Eskenazi, M.; Bigham, J.P. InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing; Association for Computational Linguistics: Abu Dhabi, United Arab Emirates, 2022; pp. 505–525. [Google Scholar] [CrossRef]
- Young, S.; Gašić, M.; Thomson, B.; Williams, J.D. POMDP-Based Statistical Spoken Dialog Systems: A Review. Proc. IEEE 2013, 101, 1160–1179. [Google Scholar] [CrossRef]
- Vicente-Martínez, P.; Soria-Olivas, E.; Esteve-Mompó, I.; Sánchez-Montañés, M.; García Escrivà, M. Á.; William-Secin, E. Design and Evaluation of an AI-Based Conversational Agent for Travel Agencies: Enhancing Training, Assistance, and Operational Efficiency. AI 2026, 7, 123. [Google Scholar] [CrossRef]
- Mich, L.; Garigliano, R. ChatGPT for e-Tourism: A technological perspective. Inf. Technol. Tour. 2023, 25, 1–12. [Google Scholar] [CrossRef]
- Carvalho, I.; Ivanov, S. ChatGPT for tourism: Applications, benefits and risks. Tour. Rev. 2024, 79, 290–303. [Google Scholar] [CrossRef]
- Cai, D.; Li, H.; Law, R. Anthropomorphism and OTA chatbot adoption: A mixed methods study. J. Travel Tour. Mark. 2022, 39, 228–255. [Google Scholar] [CrossRef]
- Kim, J.H.; Kim, J.; Kim, C.; Kim, S. Do you trust ChatGPTs? Effects of the ethical and quality issues of generative AI on travel decisions. J. Travel Tour. Mark. 2024, 41, 779–801. [Google Scholar] [CrossRef]
- Coker, K.K.; Thakur, R. Alexa, may I adopt you? The role of voice assistant empathy and user-perceived risk in customer service delivery. J. Serv. Mark. 2023, 38, 301–311. [Google Scholar] [CrossRef]
- Banerjee, A.; Banik, P.; Wörndl, W. A review on individual and multistakeholder fairness in tourism recommender systems. Front. Big Data 2023, 6, 1168692. [Google Scholar] [CrossRef] [PubMed]
- Wang, P. Analysis and prediction of tourism consumption behavior based on big data. In Proceedings of the 2023 International Conference on Ambient Intelligence, Knowledge Informatics and Industrial Electronics (AIKIIE); IEEE: Ballari, India, 2023; pp. 1–5. [Google Scholar] [CrossRef]
- Tzitziou, G.; et al. Tourist Flow Projection in Response to Weather Variability for Sustainable Tourism and Management. In Artificial Intelligence Applications and Innovations. AIAI 2024 IFIP WG 12.5 International Workshops. AIAI 2024. IFIP Advances in Information and Communication Technology; Maglogiannis, I., Iliadis, L., Karydis, I., Papaleonidas, A., Chochliouros, I., Eds.; Springer: Cham, 2024; vol 715. [Google Scholar] [CrossRef]
- Çelik, M. Necati; Çevirgen, Aydın. The Role of Accommodation Enterprises in the Development of Sustainable Tourism. J. Tour. Serv. 2021, 12, 181–198. [Google Scholar] [CrossRef]
- OECD. Artificial Intelligence and tourism: G7/OECD policy paper. In OECD Tourism Papers 2024; OECD Publishing: Paris, France, 2024; Volume 2024/02. [Google Scholar] [CrossRef]
- Duangsuwan, S.; Prapruetdee, P. Drone-Enabled AI Edge Computing and 5G Communication Network for Real-Time Coastal Litter Detection. Drones 2024, 8, 750. [Google Scholar] [CrossRef]
- Ivanov, S.; Soliman, M. Game of algorithms: ChatGPT implications for the future of tourism education and research. J. Tour. Futur. 2023, 9, 214–221. [Google Scholar] [CrossRef]
- Singh, H.; Verma, N.; Wang, Y.; Bharadwaj, M.; Fashandi, H.; Ferreira, K.; Lee, C. Personal Large Language Model Agents: A Case Study on Tailored Travel Planning. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track; Association for Computational Linguistics: Miami, Florida, US, 2024; pp. 486–514. [Google Scholar] [CrossRef]
- Chen, A.; Ge, X.; Fu, Z.; Xiao, Y.; Chen, J. TravelAgent: An AI Assistant for Personalized Travel Planning. arXiv 2024, arXiv:2409.08069. [Google Scholar] [CrossRef]
- Yao, S.; Zhao, J.; Yu, D.; Du, N.; Shafran, I.; Narasimhan, K.; Cao, Y. ReAct: Synergizing reasoning and acting in language models. International Conference on Learning Representations, 2023; ICLR: Virtual. [Google Scholar]
- Li, G.; Hammoud, H.A.A.K.; Itani, H.; Khizbullin, D.; Ghanem, B. CAMEL: Communicative agents for "mind" exploration of large language model society. In Advances in Neural Information Processing Systems; NeurIPS: New Orleans, LA, USA, 2023; pp. 51991–52008. [Google Scholar]
- Hong, S.; Zhuge, M.; Chen, J.; Zheng, X.; Cheng, Y.; Wang, J.; Zhang, C.; Wang, Z.; Yau, S.K.S.; Lin, Z.; Zhou, L.; Ran, C.; Xiao, L.; Wu, C.; Schmidhuber, J. MetaGPT: Meta programming for a multi agent collaborative framework. The Twelfth International Conference on Learning Representations, 2024; ICLR: Vienna, Austria. [Google Scholar]
- Xie, J.; Zhang, K.; Chen, J.; Zhu, T.; Lou, R.; Tian, Y.; Xiao, Y.; Su, Y. TravelPlanner: A benchmark for real world planning with language agents. In Proceedings of the 41st International Conference on Machine Learning; PMLR: Vienna, Austria, 2024; Vol. 235, pp. 54590–54613. [Google Scholar]
- Yñiguez, Rocío; Buitrago, Eva; Puig-Cabrera, Miguel; Santos, Margarida; Santos, José. Artificial Intelligence and Sustainable Tourism Planning: A Hetero-Intelligence Methodology Proposal. Tour. Manag. Stud. 2024, 20(SI), 45–59. [Google Scholar] [CrossRef]
- Husom, E.J.; Goknil, A.; Shar, L.K.; Sen, S. The Price of Prompting: Profiling Energy Use in Large Language Models Inference. arXiv 2024, arXiv:2407.16893. [Google Scholar] [CrossRef]
- Ren, S.; Tomlinson, B.; Black, R.W.; Torrance, A.W. Reconciling the contrasting narratives on the environmental impact of large language models. Sci. Rep. 2024, 14, 26310. [Google Scholar] [CrossRef] [PubMed]
- Barbierato, E.; Gatti, A. Toward green AI: A methodological survey of the scientific literature. IEEE Access 2024, 12, 23989–24013. [Google Scholar] [CrossRef]
- Siddik, Abu Bakkar; Forid, Md. Shak; Yong, Li; Du, Anna Min; Goodell, John W. Artificial intelligence as a catalyst for sustainable tourism growth and economic cycles. Technol. Forecast. Soc. Change 2025, 210, 123875. [Google Scholar] [CrossRef]
- Google AI for Developers. Gemini models. Available online: https://ai.google.dev/gemini-api/docs/models/gemini (accessed on 15 April 2026).
- Amadeus for Developers. API Guides. Available online: https://developers.amadeus.com/self-service/apis-docs/guides/developer-guides/ (accessed on 10 May 2026).
- Amadeus for Developers. Flight APIs Tutorial. Available online: https://developers.amadeus.com/self-service/apis-docs/guides/developer-guides/resources/flights/ (accessed on 10 May 2026).
- Jogarao, Malla; Lakshmanna, B. C.; Naidu, S. T. AI-Enabled Circular Economy Management for Sustainable Smart Cities: Integrating Artificial Intelligence in Resource Optimization and Waste Reduction, Smart Cities and Circular Economy: The Future of Sustainable Urban Development; Kandpal, Vinay, Santibanez-Gonzalez, Ernesto DR, Chatterjee, Prasenjit Manoj Kumar, Eds.; 2024. [Google Scholar]
- Dua, Gurwinder. Enhancing Sustainable Development Through Blockchain and Artificial Intelligence: Optimizing the Supply Chain and Mitigating Environmental Footprints. 2025. [Google Scholar] [CrossRef]
- Chainlit Documentation. Building production ready conversational AI. Available online: https://docs.chainlit.io/ (accessed on 15 September 2023).
- Moore, R.J.; Arar, R. Conversational UX Design: An Introduction. In Studies in Conversational UX Design. Human–Computer Interaction Series.; Moore, R., Szymanski, M., Arar, R., Ren, G.J., Eds.; Springer: Cham, 2018. [Google Scholar] [CrossRef]
- White, J.; Fu, Q.; Hays, S.; Sandborn, M.; Olea, C.; Gilbert, H.; Elnashar, A.; Spencer Smith, J.; Schmidt, D.C. A prompt pattern catalog to enhance prompt engineering with ChatGPT. arXiv 2023, arXiv:2302.11382. [Google Scholar]
- Reynolds, L.; McDonell, K. Prompt programming for large language models: Beyond the few-shot paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems; ACM: Yokohama, Japan, 2021; pp. 1–7. [Google Scholar] [CrossRef]
- Thaler, R.H.; Sunstein, C.R. Nudge Improv. Decis. About Health Wealth Happiness. [CrossRef]
- Boes, Kim; Buhalis, Dimitrios; Inversini, Alessandro. Smart tourism destinations: Ecosystems for tourism destination competitiveness. Int. J. Tour. Cities 2016, 2, 108–124. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention is all you need. In Advances in Neural Information Processing Systems; NeurIPS: Long Beach, CA, USA, 2017; pp. 5998–6008. [Google Scholar]

| Metric | Score | Target | Status |
|---|---|---|---|
| Functional Correctness (FC) | 92.4% | ≥90% | ✓ |
| Intent Recognition Accuracy (IRA) | 95.8% | ≥90% | ✓ |
| Entity Extraction Completeness (EEC) | 89.2% | ≥85% | ✓ |
| Response Coherence (RC) | 4.6/5.0 | ≥4.0 | ✓ |
| API Integration Reliability (AIR) | 94.1% | ≥90% | ✓ |
| Sustainability Integration (SI) | 4.8/5.0 | ≥4.0 | ✓ |
| Average Response Time (95th %ile) | 3.2s | <5.0s | ✓ |
| Itinerary Generation Time (95th %ile) | 12.8s | <15.0s | ✓ |
| Actual | Init | Pref | ReqIt | Mod | Conf | Query |
|---|---|---|---|---|---|---|
| InitiateTrip | 12 | 0 | 0 | 0 | 0 | 0 |
| ProvidePreference | 0 | 48 | 0 | 1 | 0 | 2 |
| RequestItinerary | 0 | 0 | 15 | 0 | 0 | 0 |
| ModifyItinerary | 0 | 1 | 0 | 18 | 0 | 0 |
| ConfirmBooking | 0 | 0 | 0 | 0 | 8 | 0 |
| GeneralQuery | 0 | 2 | 0 | 0 | 0 | 35 |
| Entity Category | Mentioned | Extracted | Accuracy |
|---|---|---|---|
| Destinations | 61 | 59 | 96.7% |
| Dates/Temporal | 78 | 72 | 92.3% |
| Passenger Count | 45 | 43 | 95.6% |
| Transportation | 52 | 48 | 92.3% |
| Activities/Interests | 67 | 58 | 86.6% |
| Budget | 37 | 29 | 78.4% |
| Dietary/Accessibility | 23 | 20 | 87.0% |
| Overall | 363 | 329 | 89.2% |
| Operation Type | Mean (s) | 95th %ile (s) | Max (s) |
|---|---|---|---|
| Simple Response | 1.8 | 2.4 | 3.1 |
| Information Query | 2.3 | 3.2 | 4.2 |
| Flight Search | 3.9 | 5.1 | 6.8 |
| Itinerary Generation | 8.5 | 12.8 | 15.2 |
| Itinerary Modification | 4.2 | 6.3 | 8.1 |
| Overall Average | 3.2 | 5.4 | 15.2 |
| Operation | Input(Mean) | Output(Mean) | Total | Cost/Op | Est. CO2e/Op(g) |
|---|---|---|---|---|---|
| Simple Response | 450 | 120 | 570 | $0.00008 | 0.03–2.70 |
| Information Query | 680 | 280 | 960 | $0.00013 | 0.08–6.30 |
| Flight Search | 890 | 350 | 1240 | $0.00017 | 0.09–7.87 |
| Itinerary Generation | 2100 | 1800 | 3900 | $0.00070 | 0.49–40.48 |
| Itinerary Modification | 1500 | 600 | 2100 | $0.00030 | 0.16–13.49 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).