Submitted:
04 December 2024
Posted:
05 December 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Related Works
2.1. Motivations
3. Open Branching
- Traditional Branches (100% Physical): Conventional bank branches offer face-to-face interaction with customers. They rely on human advisors and physical documentation, with minimal technological integration. Most legacy banking institutions still operate traditional branches as their default format, such as Wells Fargo in the U.S. and CaixaBank in Spain.
-
Hybrid Branches ("Phygital"): These branches blend physical and digital experiences. Customers can interact with staff while also utilizing self-service kiosks, interactive screens, or augmented reality tools for services like financial planning or account management. Examples of banks that have adopted a Hybrid approach include:
-
Self-Service Digital Branches: Focused on automation, these branches provide interactive teller machines (ITMs), advanced ATMs, and digital kiosks for transactions and support. They reduce human involvement while maintaining a physical presence. Among the Self-Service Digital Branches, we find:
- −
- BBVA’s "intelligent branches" use ITMs and kiosks for fully automated customer service [29].
- −
- UniCredit in Italy has deployed advanced ATMs for complex transactions such as loan management [30].
- −
- ICICI Bank in India operates "Digital Lite" branches that function almost entirely through self-service kiosks [31].
-
Paperless Branches: In this configuration, physical branches operate without paper, relying entirely on digital tools like electronic contracts and biometric authentication. These branches streamline processes but still maintain a physical footprint. Examples of paperless branches include:
-
Virtualized Physical Branches: Here, physical spaces are complemented by remote interactions through video consultations or virtual reality (VR). These branches serve customers who visit in person but leverage virtual tools to enhance the experience. Some examples of virtualized physical branches are:
-
Virtual Branches (100% Digital): Entirely online, these branches eliminate physical spaces and offer banking services through video calls, AI-powered chatbots, and immersive virtual reality platforms. Customers can access services from anywhere without visiting a physical location. Examples of fully virtual banks are:
4. Case Study
- Implementation of the branch operator: The first step involves the introduction of a human operator who acts as an intermediary between the customer and branch services. This operator ensures a personalized interaction, supporting the customer in a traditional manner.
- Integration of the virtual assistant (WoX Edge): The second step involves the virtual assistant WoX Edge, which interacts with customers autonomously, responding to their requests while maintaining service standards and improving operational efficiency.
- Activation of the metaverse channel: The final step involves integrating the metaverse, allowing customers to access the virtual branch from anywhere via a headset, expanding the possibilities for interacting with banking services.
- Integration of WoX Edge into the metaverse: Designing and implementing the voice assistant within the virtual context.
- Intuitive interaction via UI: Users interact with the assistant through a simple interface, utilizing the keyboard.
- Access to banking services in the metaverse: WoX Edge ensure an innovative and seamless experience in accessing banking services.
- Rigorous testing: Comprehensive tests are conducted to verify the proper functioning of the assistant and the entire virtual banking system.
4.1. Architectural Details
4.2. Knowledge Base
- Login: Includes use cases accessible only after authentication.
- Operations: Gathers use cases related to card transactions at an informational level.
- Accounts: Comprises all questions related to current accounts.
- Insurance: Includes use cases concerning insurance products offered by banks.
- Cards: Collects use cases related to information on costs and card activations.
- Loans, Mortgages, Leasing: Includes informational use cases for these three product categories.
- Topic: Related to the macro-category of use cases.
- Question: Includes training phrases that will be submitted to the NLP engine to manage and understand user input.
- Answer: Provides a unique response for the questions indicated in the previous column.
- Context: A technical variable to set a dialogue context based on the specific request of the customer.
4.3. The Hardware Component of WoX Edge
4.4. Backend WoX Edge
- Speech-to-text: An AI-based engine for transcribing speech into text format from .wav audio files. Initially Google’s cloud service was used, but during the course of the project an on-premise version based on Python technology was tested.
- NLP: An AI engine that enables it to understand the user’s request, received in text form from the previous form, regardless of the wording of the sentence.
- Text-to-speech: A speech synthesis module that converts a text string containing the answer to be provided to the user into a .wav audio file. Again, Google’s cloud service was complemented by an on-premise solution based on Microsoft’s text-to-speech, which yielded satisfactory results.
- Backend for implementing the OB standard: Developed in Java Enterprise Edition and Spring Boot.
- API design tools: Swagger.
- DBMS: MySQL.
- Hardware: Customization of the Raspberry PI prototyping board.
4.5. System Operation
4.6. Test
- An NPC object is added to the scene to represent the 3D virtual assistant and facilitate the initial interaction with the user.
- Actions are defined based on whether the user chooses to use the chatbot service or not.
- When the user agrees to use the service, a 2D UI is created, which will be used to input and send their requests and questions.
- After the user submits a question through the text input, the doPost function is called to handle an HTTP POST request using a REST API. This allows the user to receive the chatbot’s response and interact with it.
- Interaction with NPC, click on the "NO" button.
- Interaction with NPC, click on the "YES" button.
5. Discussion
6. Conclusions
- Improved CX: Through interactive virtual spaces, customers can access personalized and innovative banking services.
- Unlimited access to banking services: Customers can manage accounts in real time and receive personalized assistance without time or location limitations.
- Integration between bank and customer in the metaverse: Enables contact with the bank within advanced digital environments.
- Banks and financial institutions (public and private): To better understand how to integrate traditional banking services with advanced technologies. This could help improve CX, attract new generations of digital users, and increase the efficiency of services.
- Fintech startups and technology companies: To identify opportunities to develop new solutions and tools that meet the needs of an increasingly digital banking market.
- Researchers: To explore the effects and implications of these technologies within the financial sector.
- Customers and end users: To experience an innovative and flexible digital banking system, allowing continuous access to services without geographical or time limitations.
- Diversification of payment methods: OB could lead to the development of new payment methods.
- Adoption of digital currencies: The possibility of using digital currencies for transactions in both the virtual and physical worlds.
Funding
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Li, B.; Xu, Z. Insights into financial technology (FinTech): a bibliometric and visual study. Financial innovation 2021, 7, 1–28. [CrossRef]
- Iyelolu, T.V.; Agu, E.E.; Idemudia, C.; Ijomah, T.I. Legal innovations in FinTech: Advancing financial services through regulatory reform. Finance & Accounting Research Journal 2024, 6, 1310–1319.
- Agarwal, S.; Zhang, J. FinTech, lending and payment innovation: A review. Asia-Pacific Journal of Financial Studies 2020, 49, 353–367. [CrossRef]
- EY-GLOBALFINTECH. Global FinTech Adoption Index 2019. https://assets.ey.com/content/dam/ey-sites/ey-com/en_gl/topics/banking-and-capital-markets/ey-global-fintech-adoption-index.pdf, 2019.
- Europea, C. Direttiva del Consiglio Europeo. https://eur-lex.europa.eu/resource.html?uri=cellar:e09b163c-1687-11ee-806b-01aa75ed71a1.0009.02/DOC_1&format=PDF, 2023.
- Europea, C. Regolamento del Parlamento Europeo e del Consiglio. https://eur-lex.europa.eu/resource.html?uri=cellar:04cc5bd5-196f-11ee-806b-01aa75ed71a1.0010.02/DOC_1&format=PDF, 2023.
- Gounari, M.; Stergiopoulos, G.; Pipyros, K.; Gritzalis, D. Harmonizing open banking in the European Union: an analysis of PSD2 compliance and interrelation with cybersecurity frameworks and standards. International Cybersecurity Law Review 2024, 5, 79–120. [CrossRef]
- Premchand, A.; Choudhry, A. Open banking & APIs for transformation in banking. In Proceedings of the 2018 international conference on communication, computing and internet of things (IC3IoT). IEEE, 2018, pp. 25–29.
- Murinde, V.; Rizopoulos, E.; Zachariadis, M. The impact of the FinTech revolution on the future of banking: Opportunities and risks. International review of financial analysis 2022, 81, 102103. [CrossRef]
- Fiore, V. Trasformazione digitale nel settore bancario: strategie innovative per un nuovo presidio territoriale. https://www.ilsole24ore.com/art/trasformazione-digitale-settore-bancario-strategie-innovative-un-nuovo-presidio-territoriale-AFbRduuB, 2023.
- Bucci, P. L’intelligenza artificiale conquista l’industria dei servizi finanziari. Dalla valutazione dei rischi alla personalizzazione della relazione con il cliente, banche e assicurazioni abbracciano l’AI per migliorare l’efficienza operativa e l’intercanalità. https://www.datamanager.it/2024/06/finance-lai-ridefinisce-gli-investimenti/, 2024.
- Gentile, C.; Spiller, N.; Noci, G. How to sustain the customer experience:: An overview of experience components that co-create value with the customer. European management journal 2007, 25, 395–410. [CrossRef]
- Vergallo, R.; Mainetti, L. The role of technology in improving the Customer Experience in the banking sector: A systematic mapping study. IEEE Access 2022, 10, 118024–118042. [CrossRef]
- Banca d’Italia. https://www.bancaditalia.it/?dotcache=refresh.
- Vidyasoft. WoX Edge. https://www.vidyasoft.it/prodotti.
- Schueffel, P. Taming the beast: A scientific definition of fintech. Journal of Innovation Management 2016, 4, 32–54. [CrossRef]
- Komulainen, H.; Makkonen, H. Customer experience in omni-channel banking services. Journal of Financial Services Marketing 2018, 23, 190–199. [CrossRef]
- Barbu, C.M.; Florea, D.L.; Dabija, D.C.; Barbu, M.C.R. Customer experience in fintech. Journal of Theoretical and Applied Electronic Commerce Research 2021, 16, 1415–1433. [CrossRef]
- Balmaceda Castro, I.; Rusu, C.; Aciar, S. Customer eXperience in e-learning: a systematic mapping study. In Proceedings of the International Conference on Human-Computer Interaction. Springer, 2020, pp. 158–170.
- Lemon, K.N.; Verhoef, P.C. Understanding customer experience throughout the customer journey. Journal of marketing 2016, 80, 69–96. [CrossRef]
- PwC. Experience is everything: Here’s how to get it right. https://www.pwc.de/de/consulting/pwc-consumer-intelligence-series-customer-experience.pdf, 2019.
- Mckinsey. PSD2: Taking advantage of open-banking disruption. https://www.mckinsey.com/industries/financial-services/our-insights/psd2-taking-advantage-of-open-banking-disruption, 2018.
- PwC. The future of financial services. https://www.pwc.co.uk/assets/pdf/2020-vision-future-of-financial-services.pdf, 2020.
- Kumar, K.N.; Balaramachandran, P.R. Robotic process automation-a study of the impact on customer experience in retail banking industry. Journal of Internet Banking and Commerce 2018, 23, 1–27.
- Stefanelli, V.; Manta, F. Digital Financial Services and Open Banking Innovation: Are Banks Becoming ‘invisible’? Global Business Review 2023, p. 09721509231151491. [CrossRef]
- Cho, S.; Lee, Z.; Hwang, S.; Kim, J. Determinants of bank closures: what ensures sustainable profitability in mobile banking? Electronics 2023, 12, 1196. [CrossRef]
- BNP PARIBAS. https://www.bnpparibascardif.com/en/article/-/article/smart-phygital-transforming-store-into-experience, 2018.
- DEUTSCHE BANK. https://investor-relations.db.com/files/documents/annual-reports/2023/Human-Capital-Report-2022.pdf, 2022.
- BBVA. https://shareholdersandinvestors.bbva.com/wp-content/uploads/2022/03/Annual-Report-2021.pdf, 2021.
- UniCredit. https://www.unicredit.it/it/privati/servizi-digitali/tutti-i-servizi/self-service.html, 2022.
- ICICI. https://www.icicibank.com/sme/digital-lite, 2023.
- ING RESEARCH. https://www.ing.com/Investors/Financial-performance/Quarterly-results/2020.htm, 2020.
- CAIXABANK. https://www.caixabank.com/en/shareholders-investors/economic-financial-information/annual-half-year-statements.html, 2022.
- INTESA SANPAOLO. https://group.intesasanpaolo.com/en/newsroom/press-releases/2024/11/at-salone-dei-pagamenti—intesa-sanpaolo-and-mastercard-togethe#, 2022.
- HSBC. https://www.privatebanking.hsbc.com/wih/investments-Insights/other-investment-insights/the-metaverse-how-the-next-big-wave-in-technology-is-attracting-long-term-investments/, 2023.
- BANK of America. https://promotions.bankofamerica.com/digitalbanking/mobilebanking/erica, 2021.
- DBS BANK. https://www.dbs.com/metaverse/index.html, 2023.
- INTESA SANPAOLO. https://group.intesasanpaolo.com/en/newsroom/press-releases/2023/06/intesa-sanpaolo-presents-isybank–the-group-s-new-digital-bank, 2023.
- Vidyasoft. https://www.vidyasoft.it.
- d’Italia, B. Banca d’Italia. https://www.bancaditalia.it/media/notizia/fintech-milano-hub-call-for-proposals-2021-elenco-progetti-ammessi/?com.dotmarketing.htmlpage.language=102.
- Caione, A.; Fiore, A.; Mainetti, L.; Manco, L.; Vergallo, R. WoX: model-driven development of web of things applications. In Managing the Web of Things; Elsevier, 2017; pp. 357–387.
- Mainetti, L.; Manco, L.; Patrono, L.; Vergallo, R. A Cloud Architecture for Managing IoT-aware Applications According to Knowledge Processing Rules. Journal of Communications Software and Systems 2016, 12, 45–52. [CrossRef]
- Fiore, A.; Caione, A.; Mainetti, L.; Manco, L.; Vergallo, R. Top-down delivery of iot-based applications for seniors behavior change capturing exploiting a model-driven approach. Journal of Communications Software and Systems 2018, 14, 60–67.
- Mainetti, L.; Manco, L.; Patrono, L.; Sergi, I.; Vergallo, R. Web of topics: An iot-aware model-driven designing approach. In Proceedings of the 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT). IEEE, 2015, pp. 46–51.
- Caione, A.; Fiore, A.; Mainetti, L.; Manco, L.; Vergallo, R. Rapid prototyping Internet of Things solutions through a model-driven approach: A case study in AAL. In Proceedings of the 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech). IEEE, 2017, pp. 1–6.
- Mainetti, L.; Panarese, P.; Vergallo, R. WoX+: A meta-model-driven approach to mine user habits and provide continuous authentication in the smart city. Sensors 2022, 22, 6980. [CrossRef]
- Panarese, P.; Meraglia, E.; Vergallo, R.; Mainetti, L. Enhancing Voice Assistants: A Proactive Approach. In Proceedings of the 2021 6th International Conference on Smart and Sustainable Technologies (SpliTech). IEEE, 2021, pp. 1–4.
- Mainetti, L.; Manco, L.; Patrono, L.; Secco, A.; Sergi, I.; Vergallo, R. An ambient assisted living system for elderly assistance applications. In Proceedings of the 2016 IEEE 27th annual international symposium on personal, indoor, and mobile radio communications (PIMRC). IEEE, 2016, pp. 1–6.
- Caione, A.; Fiore, A.; Mainetti, L.; Manco, L.; Vergallo, R. Exploiting an IoT local middleware for the orchestration of mobile device sensors to detect outdoor and indoor user positioning. In Proceedings of the 2017 25th International Conference on Software, Telecommunications and Computer Networks (SoftCOM). IEEE, 2017, pp. 1–5.
- Nüesch, R.; Alt, R.; Puschmann, T. Hybrid customer interaction. Business & Information Systems Engineering 2015, 57, 73–78.
- decentraland-ecs. https://github.com/decentraland/decentraland-ecs-utils, 2021.
- @dcl/ui-scene-utils. https://github.com/decentraland/decentraland-ui-utils, 2021.
- Raspberry PI. https://www.raspberrypi.com.
- d’Italia, B. Banca d’Italia. https://www.bancaditalia.it/pubblicazioni/mercati-infrastrutture-e-sistemi-di-pagamento/approfondimenti/2024-047/N.47-MISP.pdf, 2024.










| Use Cases | Reference Legislation |
|---|---|
Operations without customer identification (no login) or potential new customer.
|
|
Alternative customer identification operations (with login) for home banking access (examples, not exhaustive).
|
|
Informative operations requested by a customer holding a passive current account (login required).
|
|
Transactional operations requested by a customer holding a passive current account (login required).
|
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).