Submitted:
03 December 2024
Posted:
04 December 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Digital Twins and Cultural Heritage
2.1. Defining Digital Twins for Cultural Heritage
2.2. Heritage Digital Twins
2.3. Digital Twins and Ontologies
3. The RHDTO Model
3.1. RHDTO General Classes
3.2. Reactive Aspects of Heritage Digital Twins
4. Artificial Intelligence and Cultural Heritage
4.1. Artificial Intelligence for Proccessing Cultural Documentation
4.2. Artifical Intelligence and Ontologies
4.3. Artificial Intelligence and Heritage Digital Twins
5. Implementing AI-Powered Heritage Digital Twins
5.1. Artificial Intelligence and Documentation
5.2. Artificial Intelligence and Decider Components
5.3. Embedding Physics-Based Models
6. Extending the RHDTO Model
- HC15 AI Component (Subclass of: CRMdig:D14 Software)
- HC16 Simulation or Prediction (Subclass of: CRM:E5 Event)
- HP16 uses algorithm (Domain: HC15 AI Component; Range: CRMdig:D14 Software)
- HP17 was trained using (Domain: HC15 AI Component; Range: CRM:E31 Document)
- HP18 analysed (Domain: HC15 AI Component; Range: HC2 Heritage Digital Twin)
- HP19 extracted knowledge (Domain: HC15 AI Component; Range: HC2 Heritage Digital Twin).
- HP20 performed (Domain: HC15 AI Component; Range: HC16 Simulation or Prediction).
- HP21 relies on (Domain: HC10 Decider; Range: HC15 AI Component).
6.1. Why Artifical Intelligences Cannot Be (E39) Actors (and Probably Never Should)
7. Case Study: Arnolfo di Cambio’s Tower in Florence
7.1. Extracting Knowledge from Documentation
7.2. Artificial Intelligence and the Reactive Components of Heritage Digital Twins
8. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- European Commission, Destination Earth. Available online: https://destination-earth.eu (accessed on 21 October 2024).
- Jones, D.; Snider, C.; Nassehi, A.; Yon, J.; Hicks, B. Characterising the Digital Twin: A Systematic Literature Review. CIRP Journal of Manufacturing Science and Technology 2020, 29, 36–52. [CrossRef]
- Semeraro, C.; Lezoche, M.; Panetto, H.; Dassisti, M. Digital Twin Paradigm: A Systematic Literature Review. Computers in Industry 2021, 130, 103469. [CrossRef]
- Schrotter, G.; Hürzeler, C. The Digital Twin of the City of Zurich for Urban Planning. PFG—Journal of Photogrammetry, Remote Sensing and Geoinformation Science 2020, 88, 99–112. [CrossRef]
- Caprari, G.; Castelli, G.; Montuori, M.; Camardelli, M.; Malvezzi, R. Digital Twin for Urban Planning in the Green Deal Era: A State of the Art and Future Perspectives. Sustainability 2022, 14, 6263. [CrossRef]
- Li, L.; Aslam, S.; Wileman, A.; Perinpanayagam, S. Digital Twin in Aerospace Industry: A Gentle Introduction. IEEE Access 2022, 10, 9543–9562. [CrossRef]
- Grieves, M. Digital Twin: Manufacturing Excellence Through Virtual Factory Replication. White paper 2014, 1, 1–7.
- Drechsler, W. The Contrade, the Palio and the Ben Comune: Lessons from Siena. Trames 2006, 10, 99–125.
- Palio di Siena. Available online: https://en.wikipedia.org/wiki/Palio_di_Siena (accessed on 21 November 2024).
- Paradis, T. W. Living the Palio: A Story of Community and Public Life in Siena, Italy; Paradis: Indianapolis, USA, 2019.
- Artusi, L. Calcio Fiorentino. History, art and memoirs of the historical game. From its origins to the present day. Scribo Edizioni: Florence, Italy, 2016.
- Calcio Storico Fiorentino. Available online: https://en.wikipedia.org/wiki/Calcio_storico_fiorentino (accessed on 21 November 2024).
- Niccolucci, F. Technologies, Standards and Business Models for the Formation of Virtual Collections of 3D Replicas of Museum Objects: The 3D-COFORM Project. In 2010 IST-Africa Conference; Durban, South Africa, 2010; pp. 1-8.
- Lovell, L.J.; Davies, R.J.; Hunt, D.V.L. The Application of Historic Building Information Modelling (HBIM) to Cultural Heritage: A Review. Heritage 2023, 6, 6691–6717. [CrossRef]
- Industry Foundation Classes (IFC). Available online: https://www.buildingsmart.org/standards/bsi-standards/industry-foundation-classes/ (accessed on 21 November 2024).
- Niccolucci, F.; Felicetti, A.; Hermon, S. Populating the Data Space for Cultural Heritage with Heritage Digital Twins. Data 2022, 7, 105. [CrossRef]
- Niccolucci, F.; Markhoff, B.; Theodoridou, M.; Felicetti, A.; Hermon, S. The Heritage Digital Twin: A Bicycle Made for Two. The Integration of Digital Methodologies into Cultural Heritage Research. arXiv 2023. [CrossRef]
- Niccolucci, F.; Felicetti, A. Digital Twin Sensors in Cultural Heritage Ontology Applications. Sensors 2024, 24, 3978. [CrossRef]
- Boje, C.; Guerriero, A.; Kubicki, S.; Rezgui, Y. Towards a Semantic Construction Digital Twin: Directions for Future Research. Automation in Construction 2020, 114, 103179. [CrossRef]
- Albers, L.; Große, P.; Wagner, S. Semantic Data-Modeling and Long-Term Interpretability of Cultural Heritage Data—Three Case Studies. In Digital Cultural Heritage; Kremers, H., Ed.; Springer International Publishing: Cham, 2020; pp. 239–253 ISBN 978-3-030-15198-0.
- CIDOC CRM. Available online: https://cidoc-crm.org/ (accessed on 21 November 2024).
- ECHOES—European Cloud for Heritage OpEn Science. Available online: https://www.echoes-eccch.eu (accessed on 21 November 2024).
- The Ariadne Impact; Richards, J.D., Niccolucci, F., Eds.; Archeolingua: Budapest, 2019; ISBN 978-615-5766-31-2. [CrossRef]
- International Data Aggregation for Archaeological Research and Heritage Management: the ARIADNE Experience; Aspöck, E.; Richards, J., Eds.; Internet Archaeology, Special Issue 64; 2023. https://intarch.ac.uk/journal/issue64/index.html.
- ARIADNE Research Infrastructure. Available online: https://www.ariadne-research-infrastructure.eu (accessed on 21 November 2024).
- Competence Centre for the Conservation of Cultural (4CH). Available online: https://www.4ch-project.eu (accessed on 21 November 2024).
- Doerr, M.; Stead, S.; Theodoridou, M. Definition of the CRMdig. An Extension of CIDOC-CRM to Support Provenance Metadata. 2022. Available online: https://cidoc-crm.org/sites/default/files/CRMdigv4.0.pdf (accessed on 21 November 2024).
- Kritsotaki, A.; Hiebel, G.; Theodoridou, M.; Doerr, M.; Rousakis, Y. Definition of the CRMsci. 2017. Available online: https://cidoc-crm.org/crmsci/ModelVersion/version-1.2.3 (accessed on 21 November 2024).
- Bruseker, B.; Doerr, M.; Theodoridou, M. Report on the Common Semantic Framework. PARTHENOS Project, 2017. Available online: https://www.parthenos-project.eu/Download/Deliverables/D5.1_Common_Semantic_Framework_Appendices.pdf (accessed on 21 November 2024).
- Meghini, C.; Bartalesi, V.; Metilli, D. Representing Narratives in Digital Libraries: The Narrative Ontology. Semantic Web 2021, 12, 241–264. Available online: https://www.semantic-web-journal.net/content/representing-narratives-digital-libraries-narrative-ontology (accessed on 21 November 2024).
- The MINGEI Project. Available at: https://www.mingei-project.eu/ (accessed on 21 November 2024).
- Brandt, A.K. Beethoven’s Ninth and AI’s Tenth: A Comparison of Human and Computational Creativity. Journal of Creativity 2023, 33, 100068. [CrossRef]
- Rizk, R.; Rizk, D.; Rizk, F.; Kumar, A. A Hybrid Capsule Network-Based Deep Learning Framework for Deciphering Ancient Scripts with Scarce Annotations: A Case Study on Phoenician Epigraphy. In Proceedings of the 2021 IEEE International Midwest Symposium on Circuits and Systems (MWSCAS); IEEE: Lansing, MI, USA, August 9 2021; pp. 617–620. [CrossRef]
- Magnani, M.; Clindaniel, J. Artificial Intelligence and Archaeological Illustration. Advances in Archaeological Practice 2023, 11, 452–460. [CrossRef]
- Cobb, P.J. Large Language Models and Generative AI, Oh My!: Archaeology in the Time of ChatGPT, Midjourney, and Beyond. Advances in Archaeological Practice 2023, 11, 363–369. [CrossRef]
- Argyrou, A.; Agapiou, A. A Review of Artificial Intelligence and Remote Sensing for Archaeological Research. Remote Sensing 2022, 14, 6000. [CrossRef]
- Mishra, M.; Barman, T.; Ramana, G.V. Artificial Intelligence-Based Visual Inspection System for Structural Health Monitoring of Cultural Heritage. Journal of Civil Structural Health Monitoring 2024, 14, 103–120. [CrossRef]
- Cao, J.; Zhang, Z.; Zhao, A.; Cui, H.; Zhang, Q. Ancient Mural Restoration Based on a Modified Generative Adversarial Network. Heritage Science 2020, 8, 7. [CrossRef]
- White Paper on Artificial Intelligence. A European Approach to Excellence and Trust; European Commission, Ed.; COM(2020) 65 final; European Commission: Brussels, Belgium, 2020.
- Nikolinakos, N. Th. A European Approach to Excellence and Trust: The 2020 White Paper on Artificial Intelligence. In EU Policy and Legal Framework for Artificial Intelligence, Robotics and Related Technologies—The AI Act; Law, Governance and Technology Series; Springer International Publishing: Cham, 2023; Vol. 53, pp. 211–280 ISBN 978-3-031-27952-2.
- Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Creating Harmonized Rules on Artificial Intelligence and Amending Regulations (Artificial Intelligence Regulation); European Parliament: Brussels, Belgium, 2024. http://data.europa.eu/eli/reg/2024/1689/oj.
- Pasikowska-Schnass, M.; Young-Shin L. Artificial intelligence in the Context of Cultural Heritage and Museums: Complex Challenges and New Opportunities. Technical Report PE 747.120; European Parliamentary Research Service: Brussels, Belgium, 2023. https://www.europarl.europa.eu/thinktank/en/document/EPRS_BRI(2023)747120.
- Münster, S.; Maiwald, F.; Di Lenardo, I.; Henriksson, J.; Isaac, A.; Graf, M.M.; Beck, C.; Oomen, J. Artificial Intelligence for Digital Heritage Innovation: Setting up a R&D Agenda for Europe. Heritage 2024, 7, 794–816. [CrossRef]
- Directorate-General for Communications Networks; Content and Technology; Izsak, K.; Terrier, A.; Kreutzer, S.; Strähle, T.; Roche, C.; Moretto, M.; Sorensen, S.; Hartung, M.; et al. Opportunities and Challenges of Artificial Intelligence Technologies for the Cultural and Creative Sectors; Publications Office of the European Union: Luxembourg, 2022. https://op.europa.eu/en/publication-detail/-/publication/359880c1-a4dc-11ec-83e1-01aa75ed71a1/language-en.
- Felicetti, A.; Williams, D.; Galluccio, I.; Tudhope, D.; Niccolucci, F. NLP Tools for Knowledge Extraction from Italian Archaeological Free Text. In Proceedings of the 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018); IEEE: San Francisco, CA, USA, October 2018; pp. 1–8. [CrossRef]
- Bombini, A.; Alkhansa, A.; Cappelli, L.; Felicetti, A.; Giacomini, F.; Costantini, A. A Cloud-Native Web Application for Assisted Metadata Generation and Retrieval: THESPIAN-NER. Applied Sciences 2022, 12, 12910. [CrossRef]
- Bombini, A.; Castelli, L.; Felicetti, A.; Niccolucci, F.; Reccia, A.; Taccetti, F. Towards the Creation of AI-Powered Queries Using Transfer Learning on NLP Model—The THESPIAN-NER Experience. In Image Analysis and Processing. ICIAP 2022 Workshops; Mazzeo, P.L., Frontoni, E., Sclaroff, S., Distante, C., Eds.; Lecture Notes in Computer Science; Springer International Publishing: Cham, 2022; Vol. 13374, pp. 266–277 ISBN 978-3-031-13323-7. [CrossRef]
- Tzitzikas, Y.; Mountantonakis, M.; Fafalios, P.; Marketakis, Y. CIDOC-CRM and Machine Learning: A Survey and Future Research. Heritage 2022, 5, 1612–1636. [CrossRef]
- Longo, L.; Brcic, M.; Cabitza, F.; Choi, J.; Confalonieri, R.; Ser, J.D.; Guidotti, R.; Hayashi, Y.; Herrera, F.; Holzinger, A.; et al. Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions. Information Fusion 2024, 106, 102301. [CrossRef]
- Pansoni, S.; Tiribelli, S.; Paolanti, M.; Di Stefano, F.; Frontoni, E.; Malinverni, E.S.; Giovanola, B. ARTIFICIAL INTELLIGENCE AND CULTURAL HERITAGE: DESIGN AND ASSESSMENT OF AN ETHICAL FRAMEWORK. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 2023, XLVIII-M-2–2023, 1149–1155. [CrossRef]
- Gîrbacia, F. An Analysis of Research Trends for Using Artificial Intelligence in Cultural Heritage. Electronics 2024, 13, 3738. [CrossRef]
- Jayasinghe, S.C.; Mahmoodian, M.; Sidiq, A.; Nanayakkara, T.M.; Alavi, A.; Mazaheri, S.; Shahrivar, F.; Sun, Z.; Setunge, S. Innovative Digital Twin with Artificial Neural Networks for Real-Time Monitoring of Structural Response: A Port Structure Case Study. Ocean Engineering 2024, 312, 119187. [CrossRef]
- Zayed, S.M.; Attiya, G.M.; El-Sayed, A.; Hemdan, E.E.-D. A Review Study on Digital Twins with Artificial Intelligence and Internet of Things: Concepts, Opportunities, Challenges, Tools and Future Scope. Multimedia Tools and Applications 2023, 82, 47081–47107. [CrossRef]
- D’Amico, R.D.; Sarkar, A.; Karray, M.H.; Addepalli, S.; Erkoyuncu, J.A. Knowledge Transfer in Digital Twins: The Methodology to Develop Cognitive Digital Twins. CIRP Journal of Manufacturing Science and Technology 2024, 52, 366–385. [CrossRef]
- Seng, K.P.; Ang, L.M.; Ngharamike, E. Artificial Intelligence Internet of Things: A New Paradigm of Distributed Sensor Networks. International Journal of Distributed Sensor Networks 2022, 18, 155014772110628. [CrossRef]
- Emmert-Streib, F. Defining a Digital Twin: A Data Science-Based Unification. Machine Learning and Knowledge Extraction 2023, 5, 1036–1054. [CrossRef]
- Ritto, T.G.; Rochinha, F.A. Digital Twin, Physics-Based Model, and Machine Learning Applied to Damage Detection in Structures. Mechanical Systems and Signal Processing 2021, 155, 107614. [CrossRef]
- Sinibaldi, G. The Palazzo Vecchio in Florence; La Libreria dello Stato: Rome, Italy, 1950.
- Palazzo Vecchio in Florence. Available online: https://en.wikipedia.org/wiki/Palazzo_Vecchio (accessed on 21 November 2024).
- Villani, G. Villani’s Chronicle; Being Selections from the First Nine Books of the Croniche Fiorentine; Selfe R.E., Tr.; Wicksteed, Ph.H., Ed.; Archibald Constable & Co.: London, 1906; First published 1322.
- Vasari, G. The Lives of the Painters, Sculptors and Architects; Gaunt, W., Ed.; Dent: London, UK, 1963; First published 1550.
- Azzara, R.M.; Tanganelli, M.; Trovatelli, F.; Vettori, N. Results from the Seismometric Continuous Monitoring of an Ancient Bell Tower: The Arnolfo Tower, Palazzo Della Signoria, Florence, Italy. In Structural Analysis of Historical Constructions; Endo, Y., Hanazato, T., Eds.; RILEM Bookseries; Springer Nature Switzerland: Cham, 2024; Vol. 47, pp. 165–178 ISBN 978-3-031-39602-1. [CrossRef]
- Dal Zilio, L.; Giardini, D.; Carbonell, R.; Wiemer, S. Harnessing the Potential of Digital Twins in Seismology. Nature Reviews Earth & Environment 2023, 4, 510–512. [CrossRef]
- Barrow-Green, J. The Three-Body Problem. In The Princeton Companion to Mathematics; Gowers, T., Barrow-Green, J., Leader, I., Eds.; Princeton University Press: Princeton, NJ, USA, 2008; pp. 726–728.



| Extension name | Used for | Reference | Class symbol | Property symbol |
|---|---|---|---|---|
| CRM | General use | [21] | E | P |
| CRMdig | Digital objects | [27] | D | L |
| CRMsci | Scientific analyses | [28] | S | O |
| CRMpe | Digital Interoperability | [29] | PE | PP |
| RHDTO | Heritage Digital Twins | [16,17,18] | HC | HP |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).