An Artificial Intelligence (AI) Framework To Predict Operational Excellence: UAE Case Study

The integration of artificial intelligence (AI) into the European Foundation for Quality Management (EFQM) business excellence model is a promising approach to improve the efficiency and effectiveness of excellence in organizations. This research paper’s integrated framework follows the ISO/IEC 23053 standard in addressing some of the concerns related to time and cost associated with the EFQM model, achieving higher EFQM scores, hence operational excellence. A case study involving a UAE government organization serves as a sample to train the AI framework. Historical EFQM results from different years are used as training data. The AI framework utilizes the unsupervised machine learning technique known as k-means clustering (with k=2). This technique follows the ISO/IEC 23053 standard to predict EFQM output total scores based on criteria and sub-criteria inputs. The research paper's main output is a novel AI framework that can predict EFQM scores for organizations at an early stage. If the predicted EFQM score is not high enough, then the AI framework provides feedback to decision makers regarding the criteria that need reconsideration. Continuous use of this integrated framework helps organizations attain operational excellence. This framework is considered valuable for decision makers as it provides early predictions of EFQM total scores and identifies areas that require improvement before officially applying for the EFQM excellence award. This approach can be considered as an innovative contribution and enhancement to knowledge body and organizational practices.

Keywords:

Subject: Computer Science and Mathematics - Artificial Intelligence and Machine Learning

1. Introduction

1.1. Theoretical Background

Organizations primarily focused on quality and Total Quality Management (TQM) measures to improve their operations before the emergence of business excellence models like the Malcolm Baldrige and the European Foundation for Quality Management (EFQM). These approaches were foundational in promoting a culture of continuous improvement and customer satisfaction. However, business excellence has become a prominent topic in the past few decades, and various models and frameworks have been developed to assess and enhance organizational performance beyond just quality [1].

Figure 1 shows the evolution of quality management concept. Quality inspection (Quality 1.0, 1900s) represented the early days of quality management and inspected finished products to identify defects. Quality was associated with the physical properties of products [2]. The quality control (Quality 1.0, 1920s) emphasized product inspection. During the production process, it introduced more systematic methods for defect identification and correction [2]. Later, quality assurance (Quality 2.0, 1950s) included both product and process quality. This stage witnessed the emergence of ISO standards, which provided guidelines for ensuring consistent quality in manufacturing and other industries. In 1980s, Total Quality Management (TQM, Quality 3.0, 1980s) included not only product and process quality but also the entire organization’s culture and operations. It focused on customer satisfaction, continuous improvement, and employee involvement. During this era, various ISO standards were developed, and business excellence models like EFQM gained prominence [2]. In 2017, Quality 4.0 (2017) represents the latest stage in the evolution of quality management, accompanying the fourth industrial revolution (Industry 4.0). It extends the principles of TQM to include not only product, process, and company aspects but also integrates customer and supplier needs. Quality 4.0 leverages technologies such as artificial intelligence (AI) and machine learning (ML) to improve quality management practices.

This research paper introduces a novel integrated AI framework following ISO/IEC 23053 standard to predict EFQM scores, hence enhancing operational excellence. This research has great implications on organizations aiming to improve their processes and overall performance.

2. Materials and Methods

2.1. Concepts Overview

The European Foundation for Quality Management (EFQM) has played a vital role in the field of business excellence and quality management. EFQM was established in 1992 in European countries as a business excellence model. It was initially created to enhance and assess quality management practices in organizations. Over the years, EFQM was updated and revised in 1999 and 2003 [3]. These updates likely reflected the evolving understanding of quality management principles and practices.

EFQM continued changing to adapt different business environments and management paradigms. It underwent crucial modifications in 2010 and 2013 [5]. EFQM’s influence extended far beyond Europe to be recognized and adopted not only within Europe but also in other regions of the world, including the Middle East, Asia, South America, and South Africa. This global reach is evidence to the model’s adaptability and applicability in diverse cultural and industry contexts.

EFQM’s versatility is evident in its application across various industries, including education [4] information technology [6], healthcare [7], and more. This adaptability reflects its effectiveness as a business excellence model with wide applicability. Applying the EFQM model has positive effect on the sustainability of stakeholders within organizations [7]. This come along with the broader objective of business excellence models, which aim to drive overall organizational improvement and long-term success.

EFQM is adopted by numerous global organizations as a business model success and this goes back to its success and rapid evolution. Furthermore, it is recognized as a valuable framework for achieving excellence and continuous improvement.

EFQM has evolved over the years to stay relevant and effective in supporting organizations in their excellence journey. Its global acceptance and application across a wide range of industries represent its enduring value in the field of quality management and business excellence [9]. EFQM model experienced massive evolution which is summarized in the following figure.

Figure 2. EFQM evolution summary.

The EFQM model appears to have incorporated additional criteria and elements to better address contemporary challenges and organizational needs as shown in Figure 3. The criteria in this modified EFQM model in 2013 include leadership, people, strategy, partnership and resources, processes, people results, customer results, society results, and key results

Learning, creativity, and innovation are added to the EFQM model. It highlights the importance of continuous learning, creativity, and innovation in achieving excellence and competitiveness in today’s dynamic business environment. The inclusion of "Learning, Creativity, and Innovation" shows the recognition that organizations must adapt and innovate to stay competitive and address evolving customer and market demands. This modification goes along with the broader trends in business management, focusing on the need for organizations to be agile and forward thinking.

This modified EFQM model provides a more comprehensive framework for assessing and enhancing organizational excellence, considering a wider range of factors that contribute to sustained success and innovation.

European Foundation for Quality Management (EFQM) is a business excellence model where the organizations applying it meet the sustainability of the stakeholders [8]. It can be used in different sectors like education [4] and information technology [6] health care [7], construction [27].

EFQM framework is made up of the following main principles as described in [28];
Result orientation;
Customer orientation;
Leadership and consistency of objectives;
Management by processes and facts;
Development and involvement of people;
Development of partnerships;
Social responsibility of the organizations.

To implement these principles, we need three phases: Initiation, realization and maturity [27]. EFQM is divided into 2 categories, which are enablers and results. Enablers’ criteria are responsible for key activities management. The results criteria are responsible for the way the results of an organization are achieved. The criteria include leadership, strategy, people, alliances, resources, processes, products and services [7]. EFQM can be also applied to many domains like the education [4], banking, hotels, public sectors [9], and construction like the case done in Turkey [27].

Most EFQM papers referred to in this paper were held in Spain, published in 2015 and 2023 and mostly applied in the healthcare and education sectors as shown in Figure 4.

Artificial Intelligence (AI) is a field of computer science and technology that emphasizes on creating systems and machines that can perform jobs requiring human intelligence. These tasks include reasoning, problem-solving, learning, perception, language understanding, and decision-making [8]. AI research began in the 1950s with the target of creating machines that can mimic human intelligence. Early AI systems were rule-based and relied on explicit programming to simulate human reasoning. However, these systems did not work well in complex real-world problems. Therefore, machine learning- a subset of AI- emerged in the 1970s. It introduced a paradigm shift by emphasizing on the ability of machines to learn from data and enhance their performance without being explicitly programmed.

Machine learning’s fundamental concept is to allow computers to learn and adapt from data. This is achieved through various algorithms that can specify patterns, make predictions, and make decisions relative to the data they are provided [12]. Machine learning allows machines to develop their own programs based on previously learned examples. This is achieved through training on large datasets, where the machine learns the underlying patterns and relationships in the data [8]. Machine learning is widely applied in terrorism prediction [10], cancer prediction [13], and sports result prediction [14]. These applications leverage the ability of machine learning algorithms to find hidden patterns and correlations in data. Machine learning techniques are classified into categories: supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning as shown in Figure 5 [12].

Machine learning continues to advance rapidly and has become a basic tool in various fields, including healthcare, finance, natural language processing, computer vision, and autonomous systems. Its potential to extract valuable patterns from data makes it a powerful technology with a wide range of applications.

Recently machine learning has spread over many applications and industries. It can be found in web search, siris, pricing prediction, transportation, crime prediction, and healthcare [30]. Unfortunately, few papers talked about using AI in predicting EFQM scores. Therefore, this paper comes out with a framework combining AI techniques into the EFQM model. In this framework, k-means unsupervised machine learning technique is adopted.

Unsupervised leaning works on finding common input points in the data as the previously trained. Clustering of inputs is a good description of this process where the inputs are correlated based on their statistical properties.

Unsupervised data learning method do not need any labeled output to train the algorithm. It is more subjective since human will not interfere as in supervised learning [32]. The main objective of unsupervised learning is to learn more about data by identifying patterns found in the data itself. In other words, it learns by itself an input pattern and compares it with the following input patterns.

The K-means clustering is a simple and powerful unsupervised machine learning technique that works with most industries [33]. It groups similar inputs together to form meaningful clusters. Therefore, clustering is the process of dividing data into groups or clusters sharing the same characteristics and minimizing data distances within the same cluster [33].

In this research paper, K-means clustering (k=2) which is an unsupervised machine learning technique is applied and accuracy score values are calculated.

Literature review shows the injection of AI into different fields and Table 1 represents some of these papers.

Integrating AI following ISO/IEC 23053 into business excellence models represents a crucial need in academia and the marketplace. This integrated framework has the potential to drive efficiency, cost savings, innovation, and competitive benefits for organizations, making it a valuable area of study and application.

After applying AI in many industries like medicine to predict breast cancer [23], and in dental education [35], and its massive use during the Covid 19 pandemic, appeared the crucial need for AI to be ISO certified. Therefore, ISO/IEC 23053 standard for AI has emerged to fulfill the necessity of standardization and to regulate and certify AI techniques.

The International Organization for Standardization (ISO), an independent, nongovernmental international organization, has begun to develop standards around AI along with the International Electrotechnical Commission (IEC) through Subcommittee 42 of the two organizations’ Joint Technical Committee (JTC) 1. The ISO/IEC JTC 1/SC 42 process is in its early stages and has produced a number of drafts currently being developed in committee around AI topics including ISO/IEC WD 22989: Artificial intelligence concepts and terminology, and ISO/IEC WD 23053: framework for artificial intelligence (AI) systems using machine learning (ML). This ISO framework is built on previous ISO standards such as ISO/IEC 22989. It digs deeper into machine learning. It also reshapes AI related concepts into a framework and explains how machine learning algorithms are developed. This standard is widely used among experts and non-practitioners. This standard has many advantages:

It makes more advanced use of AI [36];
Machine learning features like accuracy and explainability are interpreted and set in an international frame [37];
It gives AI standardization for policing software explored [38].

Therefore, ISO/IEC 23053 emerged to give standardization for machine learning of AI. The ISO/IEC 23053 includes stages like: task (problem definition), model, data, software tools and techniques [25]. Moreover, ISO/IEC 23053 designed the machine learning framework consisting of AI system life cycle and machine learning pipeline as shown in Figure 5 previously. ISO/ IEC 23053 standard adds regulations to the properties of AI like risk management, security, explainability, and fairness [25].

AI is adopted worldwide and in various industries like health [15] manufacturing [16], and marketing [24]. It was proved valuable during the COVID 19 pandemic. The emergence of ISO/IEC 23053 is indeed significant, as it provides a standardized framework for AI, which is crucial for ensuring the responsible and effective use of AI technologies. ISO/IEC 23053 also introduces a machine learning framework that includes the AI system life cycle and machine learning pipeline. This framework likely helps decision makers in organizations structure their AI projects and ensures that they follow a systematic approach from problem definition to deployment.

Figure 6 consists of AI life cycle along with machine learning ML pipeline as described by the new ISO/ IEC 23053 standard. This standard adds some properties and regulations to AI concerning risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness and fairness. Figure 5 shows that AI life cycle is made up of seven stages which are inception, design and development, verification and validation, deployment, operation and monitoring, re-evaluate, and retirement. These stages are mapped into this paper’s research framework. Moreover, the ML pipeline cycle consists of six stages, which are data acquisition, data preparation, modeling, verification and validation, model deployment and operation.

ISO/IEC 23053 includes several important aspects that should be considered throughout the AI life cycle and ML pipeline, like risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness, and fairness [23]. These aspects are crucial for responsible and ethical AI development and deployment.

ISO/IEC 23053 seeks to promote responsible and ethical AI development and deployment. This standardization effort helps establish a common framework for AI development that can be adopted by organizations and industries to ensure the reliability, safety, and fairness of AI systems.

After reviewing literature papers about business excellence models (EFQM), artificial intelligence and machine learning, gaps are introduced. The main gap lies in integrating artificial intelligence into EFQM business excellence model to enhance operational excellence. Few papers were found studying the effect of artificial intelligence on operational excellence. Some papers mentioned the AI effect on economy, and marketing. Dirican C. stated the effects of artificial intelligence on business and economy. He also mentioned the human replacement by robots. The AI invasion will result in higher rate of unemployment, which will affect the economy [17]. So, this research paper’s framework:

Enriches the knowledge body by injecting AI into business excellence models (EFQM);
Enhances operational excellence;
Is applied to any sector worldwide;
Saves time and money before applying to EFQM excellence award.

2.2. Research Methodology

AI is injected into business excellence model (EFQM) to predict future EFQM results. This integrated framework enhances operational excellence in public and private organizations.

Figure 7 shows the outline adopted in this journal paper. EFQM scores were collected and arranged into datasets. These datasets will be the input of an AI framework (using k-means clustering where k=2). The AI model used is following the ISO/ IEC 23053 standard. The datasets will train the algorithm to predict future results. Using this framework contributes to the knowledge body and enhances the operational excellence in any organization.

After preparing the datasets, python is used to train, test, and validate the predicted EFQM score results then accuracy scores are calculated for the k-means clustering used.

The design science research methodology is the methodology used in this paper research. Wieringa explained the design science methodology as it is the creation and search for artifacts in context. Artifacts communicate with any difficulties found in the context or overall environment to ensure continuous improvement [39]. The two types of research problems in design science are design problems and knowledge questions.

Design problem research aims to create an artifact that will improve a problem context, taking into account stakeholder goals. Multiple solutions for a specific design research problem are possible and the effectiveness of these solutions is evaluated with respect to stakeholder goals. Knowledge question research attempts to answer an analytical or empirical knowledge question about an artifact without necessarily changing the artifact itself. Knowledge questions can have multiple answers and involve a level of uncertainty. The answers to a knowledge question have to be evaluated by truth, which is independent from the stakeholders’ goals [39]. Analytical knowledge questions are answered by analyzing concepts, while empirical knowledge questions are answered by collecting and analyzing data [40].

The framework of the design science research methodology is represented in Figure 8 [39]. As shown, the design science framework includes a social context, which consists of stakeholders such as users and operators. In my paper, the social context is any organization following the EFQM scoring standard. The goals are set based on stakeholder (any government/ private entity) requirements and the outcome of the research is consequently used by the stakeholders. The framework also includes the knowledge context consisting of the current knowledge of the design, specifications and practical experience. This knowledge context is used as an input to the design research on existing designs or existing answers to knowledge questions. An example is the input of operational excellence given by any organization to predict future results using AI techniques. The results of the design science may enrich the knowledge context with new answers, new problem-solving knowledge and new designs. In my research, this is shown in the output of the AI predicted results. The following figure shows the design science methodology framework in general and Figure 9 shows the design science methodology as it is applied to my research. Figure 10 shows the research methodology flowchart

2.3. The integrated AI framework

Figure 11 shows the state machine diagram. It represents the integration of AI with EFQM to achieve operational excellence. This framework also follows the ISO/ IEC 23053 standard in its stages. It starts with the data acquisition state, data preparation, modelling, verification and validation, operation and monitoring, comparison, feedback, and retirement states. Each of these stages is fully discussed in Figure 12, Figure 13 and Figure 14. Figure 11 shows AI and ML techniques (k-means clustering k=2) that are mapped with ISO / IEC 23053 standard to form an intelligent framework to predict operational excellence. Decision makers inject EFQM input results into the framework. The k-means clustering technique used in the framework applies the ISO/IEC 23053 standard as follows: the data acquisition state, data is collected and cleaned. While, the design and development modelling stage in ML life cycle refers to the modelling phase of the above framework. Data in this stage is trained. The verification and validation phase of AI life cycle is applied to test and validate the data. In the model deployment phase, the unsupervised ML k-means clustering is applied where k=2. Accuracy results are calculated to validate results. K-means clustering is following the ISO/IEC 23053 standard in the model deployment phase. In the operation phase, the accuracy of the AI system is monitored and the final score is returned. Two outputs are resulted either “High” or “Low”. If the output is “High”, then operational excellence is achieved where the AI model can be in the retirement phase, else the output will be “Low”, and then the AI model is in the re-evaluation phase. When the output is low, the framework searches for lowest score criteria in the comparison state and returns the inputs with the same lowest score. In the feedback state, the AI framework gives suggestions to improve the organization’s weakness points. Now, the framework moves into the termination state. Decision makers can inject input scores again into the framework until the output is high and operational excellence is achieved.

Despite all AI benefits, however, it faces certain ethical, moral, social, and security obstacles. So, ISO developed standards to maintain healthy development of AI [41]. AI drawbacks can affect human privacy and development [41]. Solution of such problem can be the integration of ISO 26000 at early stages of the AI system. In the above framework social responsibility shows when social results are measured and evaluated. Some suggestions are given to improve social results such as enhancing social perceptions and performance indicators. Furthermore, AI showed reproducibility, selecting, and reporting biases [42]. AI systems can misbehave towards unreliable data making them unsafe and untrustworthy. ISO 24028 is also used to ensure AI trustworthiness [42].

3. Results and Discussions

3.1. Old EFQM Model Results

In this section, EFQM is embedded in an AI framework to predict future operational excellence final scores. The training database consists of 196 rows containing nine EFQM input dimensions for the framework. This framework takes these EFQM input dimensions from decision makers in an organization and predicts the total EFQM score as either ‘High’ or ‘Low’. Organizations with low outputs will try to enhance their scores by enhancing the lowest EFQM inputs until the organizations reach a ‘High’ final scoring achieving operational excellence. This framework uses K-means clustering (K=2) which is an unsupervised machine learning algorithm.

Figure 15 shows the descriptive statistics generated by SPSS software to calculate the row count, minimum, maximum, mean, and standard deviation of the data set used. This dataset has 196 rows using old EFQM.

Figure 16 shows the SPSS correlation results of the old EFQM dimensions and total score. It is noticed that ‘People Results’ and ‘Society Results’ dimensions are the most correlated to the final total score. However, the ‘Partnership Resources’ dimension has the least effect on the final score.

Figure 17 is a Google Colab heat map simulation showing the same results. The highest correlation is between ’Society Results’ dimension and ‘People Results’ and ‘Customer Results’ dimensions with values 0.6 and 0.5 respectively.

Figure 18 shows the elbow chart simulated from Google Colab when old EFQM is used. The best number of clusters should be chosen just when the graph starts to be steady. Therefore, the best number of clusters k for this dataset is between 2 and 6. However, Figure 19 shows the accuracy to be 86.73 (k=2).

The framework of this research paper takes EFQM results from an organization (196 rows dataset) and injects it with k-means unsupervised machine learning to predict operational excellence. The k-value used is 2 due to accuracy problems. The algorithm is implemented via Google Colab, which is used to design a code to train, test, and predict operational excellence given a dataset. First, libraries are defined. Then the 196-row database is imported and read. After the code is run, a link will appear for decision makers to use which will forward them into a new tab where they will be asked to train then test the model. The output is classified as ‘High’ if the final score is greater or equal 500; otherwise, it is ‘Low’. The algorithm generates a graphical user interface webpage to train, then test the data as shown in Figure 20.

First, data is trained using the imported dataset with k-value =2 as Figure 20 and Figure 21 show. Then, decision makers need to test the model by importing the input EFQM dimensions’ criteria. Final scores are predicted and either message of ‘High’ or “Low” is generated. If the result is “high”, the webpage shows a message that you reached operational excellence as shown in Figure 22; else, it returns the inputs with the lowest score and gives suggestions to decision makers to improve their final score as shown in Figure 23.

Now, the case of more than 2 dimensions having the same lowest input score is studied, and is shown in Figure 24 and Figure 25. Leadership, people results, and society results have the same lowest input score =10. The output returns the lowest three dimensions with recommendation for each to improve.

3.2. New EFQM Model Results

Figure 26 shows the elbow diagram when new EFQM is used to choose the suitable k value for k-means clustering algorithm, which is where the curve starts to decrease, and before it is steady. In this case, k can be chosen to be between 2 and 5. K=2 is chosen for accuracy issues. Figure 27 shows the correlation between new EFQM dimensions. This figure shows that new EFQM dimensions are more correlated to each other than the old EFQM dimensions. There are many strong correlations (0.9) as between ‘Organizational Culture and Leadership’ and ‘Purpose, Vision & Strategy’. Figure 28 shows very low accuracy when using the new EFQM model and applying the k-means clustering. This value remained low even when k value is changed.

4. Conclusion

4.1. Significance

The basic significance of this research is to improve the operational excellence in public and private organizations. This research is innovative since it adds to the knowledge body a new concept of injecting AI following the ISO/IEC 23053 standard into EFQM leading to operational excellence. This can be of great value for organizations seeking to enhance their performance and attain recognition in the field of quality management.

4.2. Future Studies

This research paper guides the way for future studies. Benchmarking between different business excellence models can be studied when using different machine learning techniques. Quality 4.0, or new EFQM can be also used to predict operational excellence using different AI techniques. The model can be applied to different industries worldwide, then benchmarking can be done.

Author Contributions

All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data used for training and testing the k-means unsupervised machine learning obtained from confidential UAE government entity.

Acknowledgments

A special thank you for all hidden soldiers who participated in this research paper. Starting with my supervisors who offered help throughout the whole paper. Ms. Omnia M. Al Mutasim for her continuous technical support in AI techniques.

Conflicts of Interest

The authors declare no conflict of interest.

References

Sila, I. Investigating changes in TQM’s effects on corporate social performance and financial performance over time. Total Quality Management Business Excellence 2020, 31, 210–229. [Google Scholar] [CrossRef]
Liu, H.C.; Liu, R.; Gu, X.; Yang, M. From total quality management to Quality 4.0: A systematic literature review and future research agenda. Frontier of Engineering Management 2023, 10, 191–205. [Google Scholar] [CrossRef]
Sadeh, E.; Arumugam, V.C.; Malarvizhi, C.A. Integration of EFQM framework and quality information systems. Total Quality Management & Business Excellence 2013, 24, 188–209. [Google Scholar] [CrossRef]
Laurett, R.; Mendes, L. EFQM model’s application in the context of higher education: A systematic review of the literature and agenda for future research. International Journal of Quality & Reliability Management 2019, 36, 257–285. [Google Scholar] [CrossRef]
Quintero-Garzón, M.L.; Carrión-García, A.; Jordá-Rodríguez, M.A.; Rodríguez-Córdoba, M. Corporate social responsibility and the EFQM excellence model as a frame work for integration of management systems in organizations. Ingeniería y competitividad 2015, 17, 9–22. [Google Scholar] [CrossRef]
Arezki, S.; Elhissi, Y. Toward an IT Governance Maturity Self-assessment model using EFQM and COBIT. In Proceedings of the International Conference on Geo informatics and Data Analysis - ICGDA ’18, 20 April 2018.
Pimentel, L.; Ramos Pires, A. The impact of EFQM awards on organizational management. 20th Excellence in Services University of Verona International Conference, Verona, Italy, 2017.
Asif, M.; Searcy, C.; Garvare, R.; Ahmad, N. Including sustainability in business excellence models. Total Quality Management & Business Excellence 2011, 22, 773–786. [Google Scholar] [CrossRef]
Rosak-Szyrocka, J.; Roszak, M. The role of the EFQM model in precepting quality in Polish enterprises. Multidisciplinary Aspects of Production Engineering MAPE 2019, 2, 399–406. [Google Scholar] [CrossRef]
Soliman, G.M.; Abou-El-Enien, T.H. Terrorism Prediction Using Artificial Neural Network. Rev. d’Intelligence Artif. 2019; 33, 81–87. [Google Scholar] [CrossRef]
Keshtegar, A. ; Ghasemi, M. ; Hosseini, A. ; Ahang, A, F. ; Ghaffari, H. The impact of business intelligence on enablers of EFQM excellence model with mediating role of knowledge sharing ARTICLE INFO 48. International Journal of Human Capital in Urban Management, 2021. [CrossRef]
Nassif, A.B.; Shahin, I.; Attili, I.; Azzeh, M.; Shaalan, K. Speech recognition using deep neural networks: a systematic revie. IEEE Access 2019, 1–1. [Google Scholar] [CrossRef]
Cruz, J.A.; Wishart, D.S. Applications of machine learning in cancer prediction and prognosis. Cancer informatics 2006, 2, 117693510600200030. [Google Scholar] [CrossRef]
Bunker, R.P.; Thabtah, F. A machine learning framework for sport result prediction. Applied Computing and Informatic, ScienceDirect 2019, 15. [Google Scholar] [CrossRef]
Schwalbe, N.; Wahl, B. Artificial intelligence and the future of global health. The Lancet, Elsevier 2020, 395, 1579–158. [Google Scholar] [CrossRef]
Gao, N.; Liu, Y.; Mai, Y. WITHDRAWN: Manufacturing service innovation platform based on 5G network and machine learning. 2020,103448. [CrossRef]
Dirican, C. The impacts of robotics artificial intelligence on business and economics. Procedia - Social Sciences and Behavioral 2015, 195, 564–573. [Google Scholar] [CrossRef]
Masum, A.K.M.; Beh, L.S.; Azad, M.A.K.; Hoque, K. Intelligent human resource information system (i-HRIS): a holistic decision support framework for HR excellence. Int. Arab J. Inf. Technol. 2018, 15, 121–130. [Google Scholar]
Bag, S.; Pretorius, J.H.C.; Gupta, S.; Dwivedi, Y.K. Role of institutional pressures and resources in the adoption of big data analytics powered artificial intelligence, sustainable manufacturing practices and circular economy capabilities. Technological Forecasting and Social Change 2021, 163, 120420. [Google Scholar] [CrossRef]
Griner, T.E.; Thompson, M.; High, H.; Buckles, J. Artificial intelligence forecasting census and supporting early decision. Nursing Administration Quarterly 2020, 44, 316–328. [Google Scholar] [CrossRef] [PubMed]
Rizvi, A.T.; Haleem, A.; Bahl, S.; Javaid, M. Artificial intelligence (AI) and its applications in Indian manufacturing: a review. Current Advances in Mechanical Engineering: Select Proceedings of ICRAMERD 2020, 2021. [CrossRef]
Arpaci, I.; Huang, S.; Al-Emran, M.; Al-Kabi, M.N.; Peng, M. Predicting the COVID-19 infection with fourteen clinical features using machine learning classification algorithms. Multimedia Tools and Applications 2021, 80, 11943–11957. [Google Scholar] [CrossRef] [PubMed]
Zhang, Y.; Weng, Y.; Lund, J. Applications of explainable artificial intelligence in diagnosis and surgery. Diagnostics 2022, 12, 237. [Google Scholar] [CrossRef]
Huang, M.H.; Rust, R.T. A strategic framework for artificial intelligence in marketing. Journal of the Academy of Marketing Science, Springer 2021, 49, 30–50. [Google Scholar] [CrossRef]
Cotton, P. ; Patel, M.; Wei, W. Information technology — artificial intelligence — artificial intelligence concepts and terminology. ISO/IEC 22989:2022(E), 2022.
Quintero-Garzón, M.L.; Carrión-García, A.; Jordá-Rodríguez, M.A.; Rodríguez-Córdoba, M. Corporate social responsibility and the EFQM excellence model as a framework for integration of management systems in organizations. Ingeniería y competitividad 2015, 17, 9–22. [Google Scholar] [CrossRef]
Hıdıroğlu, D. Self- assessment performance measurement in construction Companies: An Application of the EFQM Excellence Model on Processes and Customer stages. Procedia Computer Science 2019, 158, 844–851. [Google Scholar] [CrossRef]
Suárez, E.; Calvo-Mora, A.; Roldán, J.L; Periáñez-Cristóbal, R. Quantitative research on the EFQM excellence model: A systematic literature review (1991–2015). European Research Management Business Economics, 2017; 23, 147–156. [Google Scholar] [CrossRef]
Fonseca, L. Relationship between ISO 9001 certification maturity and EFQM business excellence model results. Quality Innovation Prosperity 2015, 19, 85–102. [Google Scholar] [CrossRef]
Mukherjee, A.; Pal, A.; Misra, P. Data analytics in ubiquitous sensor- based health information systems. In Proceeding of 6th International Conference Next Generation Mobile Application Services Technology (NGMAST), 12 September 2012. [Google Scholar] [CrossRef]
Franc, V.; Hlavac, V. Multi-class support vector machine. 2002 International Conference on Pattern Recognition, Quebec City, QC, Canada, 11 August 2002. [CrossRef]
Rojas, R. Unsupervised learning and clustering algorithms in neural networks. Springer, 1996, 99–121. [CrossRef]
Sharma, P. The most comprehensive guide to k-means clustering you’ll ever need. 2019. URL: https://www. Analytics vidhya. com/blog/2019/08/comprehensive guide-k-means-clustering.
Meng, S.; Zhang, X.; Xu, M.; Pignatari, M.; Gallino, R.; Heil, M. 3rd International Conference on Automation, Control and Robotics Engineering (CACRE 2018). 2018 3rd International Conference on Automation, Control and Robotics Engineering (CACRE 2018), 2018.
Thurzo, A.; Strunga, M.; Urban, R.; Surovková, J.; Afrashtehfar, K.I. Impact of artificial intelligence on dental education: a review and guide for curriculum update. EducationSciences 2023, 13, 150. [Google Scholar] [CrossRef]
Stark, L.; Greene, D.; Hoffmann, A.L. Critical perspectives on governance mechanisms for AI/ML systems. The cultural life of machine learning: An incursion into critical AI studies, 2021, 257-280. [CrossRef]
Trenta, F.; Battiato, S.; Ravì, D. An Explainable Medical Imaging Framework for Modality Classifications Trained Using Small Datasets. International Conference on Image Analysis and Processing. Cham: Springer International Publishing, 2022. [CrossRef]
Bertassi, E. Considerations on Predictive Policing Software. Bulletin-Volume 2018, 3. [Google Scholar]
Wieringa, R. J. Design science methodology for information systems and software engineering. Springer, 2014. [CrossRef]
Wieringa, R. Relevance and problem choice in design science. In International Conference on Design Science Research in Information Systems, Berlin, Heidelberg: Springer Berlin Heidelberg, Germany, 4 June 2010. [CrossRef]
Zhao, W. Artificial Intelligence and ISO 26000 (Guidance on Social Responsibility). In AI and Learning Systems-Industrial Applications and Future Directions. IntechOpen, 2021. [CrossRef]
Tidjon, N.L; Khomh, F. Never trust, always verify: a roadmap for Trustworthy AI? arXiv preprint arXiv:2206.11981, 2022. [CrossRef]
Thirumalai, C. ; Duba, A. ; Reddy, R. Decision making system using machine learning and Pearson for heart attack. 2017 International conference of Electronics, Communication and Aerospace Technology (ICECA). IEEE, 20 April 2017.
Abedelgadir, M.I.O.; Mohammad, R. Operational excellence and performance measurement tool for organization self-assessment in the Sudanese aviation industry. Journal of Advanced Research in Business and Management Studies 2023, 30, 34–44. [Google Scholar] [CrossRef]
Jaeger, A.; Matyas, K. Transformation of the EFQM approach from business towards operations excellence. Production Engineering 2016, 10, 277–291. [Google Scholar] [CrossRef]
Ahire, S.L.; Landeros, R.; Golhar, D.Y. Total quality management: A literature review and an agenda for future research. Production Operations Management 1995, 4, 277–306. [Google Scholar] [CrossRef]
AurelMihail, T.I.T.U.; Stanciu, A.; Tarnu, L. Improving the quality of the decision-making process for management and implementation of shared artificial intelligence platforms. In Proceedings of the international management conference, Faculty of Management, Academy of Economic Studies, Bucharest, Romania; 2020. [Google Scholar]
Lee, C.; Kim, H.; Lee, S. Analysis of safety considerations for application of artificial intelligence in marine software systems. Journal of the Korean Society of Navigation and Port Studies 2022, 46, 269–279. [Google Scholar]
Cortes, L.L.; Silva, C.F. Artificial intelligence models for crime prediction in urban spaces. Machine Learning and Applications: An International Journal (MLAIJ) 2021, 8. [Google Scholar] [CrossRef]
Wahyudi, R.E.; Permanasari, V.Y. Analysis of the quality of nursing services according to hospital accreditation 2012 Version, Reviewed from Baldrige Malcolm Criteria in Pasar Minggu Jakarta Selatan Hospital in 2017. KnE Life Sciences 2017, 4, 232. [Google Scholar] [CrossRef]
Ghufli, A.A. Implementation of business excellence model: A case study of UAE public sector organization. PhD paper, Faculty of Humanities University of Manchester, 2012.
Goonan, K.J.; Stoltz, P.K. Leadership and management principles for outcomes-oriented organizations. Medical Care Supply 2004, 42, 31–38. [Google Scholar] [CrossRef]
Schlesinger, M. I.; Hlavác, V. Supervised and unsupervised learning in ten lectures on statistical and structural pattern recognition. Springer Science & Business Media, 2013.
Hong, S.J.; Choi, D.; Chae, J. Exploring different airport users’ service quality satisfaction between service providers and air travelers. Journal of Retailing and Consumer Services 2020, 52. [Google Scholar] [CrossRef]
Brueckner, J.K.; Flores-Fillol, R. Market structure and quality determination for complementary products: Alliances and service quality in the airline industry. International Journal of Industrial Organization 2020, 68, 102557. [Google Scholar] [CrossRef]
Kiraz, A.; Açikgöz, N. A fuzzy-logic-based approach to the EFQM model for performance enhancement. Sādhanā 2021, 46. [Google Scholar] [CrossRef]
Lee, S.; Choi, K.S.; Kang, H.Y.; Cho, W.; Chae, Y.M. Assessing the factors influencing continuous quality improvement implementation: Experience in Korean hospitals. International Journal of Quality Health Care 2002, 14. [Google Scholar] [CrossRef] [PubMed]
Liu, L.T.; Wang, S.; Britton, T.; Abebe, R. Reimagining the machine learning life cycle to improve educational outcomes of students. Proceedings of the National Academy of Sciences 2023, 120, e2204781120. [Google Scholar] [CrossRef]
Mejbel, M.K.; Abdullah, S.A.; Hussein, I.A. Evaluating the performance of people in the central bank of Iraq (Cbi) According to the European excellence model. Int.J. Prof. Bus. Rev. 2023, 8, 1. [Google Scholar] [CrossRef]
Metaxas, I.N.; Koulouriotis, D.E. Business excellence measurement: a literature analysis (1990–2016). Total Quality Management & Business Excellence 2019, 30, 1189–1218. [Google Scholar] [CrossRef]
Miller, J.; Parast, M.M. Learning by applying: The case of the Malcolm Baldrige national quality award. IEEE Transactions on Engineering Management 2018, 66, 337–353. [Google Scholar] [CrossRef]
Minkman, M.; Ahaus, K.; Huijsman, R. Performance improvement based on integrated quality management models: what evidence do we have? A systematic literature review. International journal for quality in health care 2007, 19, 90–104. [Google Scholar] [CrossRef]
Nenadál, J. The New EFQM Model: What is Really New and Could Be Considered as a suitable tool with respect to Quality 4.0 concept? Quality Innovation Prosperity 2020, 24, 17–28. [Google Scholar] [CrossRef]
Parasuraman, A.; Zeithmal, V.A.; Berry, L. SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing 1988, 64, 12–40. [Google Scholar]
Parasuraman, A.; Zeithaml, V.A.; Berry, L.L. Reassessment of expectations as a comparison standard in measuring service quality: implications for further research. Journal of marketing 1994, 58, 111–124. [Google Scholar] [CrossRef]
Zhao, W. Improving social responsibility of artificial intelligence by Using ISO 26000. IOP Publishing Ltd IOP Conference Series: Materials Science and Engineering, 3rd International Conference on Automation, Control and Robotics Engineering (CACRE 2018), Chengdu, China, 19-22 July 2018.
Zhang, Q.; Yang, L.T.; Chen, Z.; Li, P. A survey on deep learning for big data. Information Fusion, Elsevier 2018, 42, 146–157. [Google Scholar] [CrossRef]

Figure 1. Evolution of Quality [2].

Figure 3. EFQM Framework 2013 [11].

Figure 4. EFQM papers classified by countries, publication year, and sector.

Figure 5. Machine learning algorithms [12].

Figure 6. ISO / IEC 23053 AI life cycle [23].

Figure 7. Outline for predicting operational excellence.

Figure 8. Design science framework.

Figure 9. Design science framework applied to this paper.

Figure 10. Research methodology flowchart.

Figure 11. State machine diagram of the AI integrated framework.

Figure 12. Data acquisition, data preparation, and modelling states.

Figure 13. Verification and validation, operation and monitoring states.

Figure 14. Comparison, feedback, and retirement states.

Figure 15. SPSS descriptive statistics for old EFQM (196rows).

Figure 16. SPSS correlation of EFQM dimensions and the total score.

Figure 17. Google Colab simulation for studying EFQM input correlation.

Figure 18. Elbow diagram to determine k value in old EFQM.

Figure 19. Accuracy for 196 rows dataset.

Figure 20. Train the model.

Figure 21. Model trained output message.

Figure 22. ‘High’ output.

Figure 23. ‘Low’ output.

Figure 24. Three equal ‘Low’ inputs.

Figure 25. Three ‘Low’ outputs.

Figure 26. Elbow diagram for determining k value for new EFQM.

Figure 27. The heat map for new EFQM dimension correlation.

Figure 28. Accuracy for new EFQM model.

Table 1. Summary Literature Review of AI into Different Industries.

Name of paper	Country/Year	Author/ Publisher	General Description	Applied Area/Field	Strengths of applied technique/ Method	Challenges/ Limitation
1-The Impacts of Robotics, Artificial Intelligence on Business and Economics [17].	Turkey, 2015	(Dirican C., 2015), Elsevier	Injecting AI concepts into economical concepts	Economics	Enhance different economical perspectives.	Increased unemployment
2- Decision Making System using Machine Learning and Pearson for Heart Attack [41].	India, 2017	(Thirumalai C., et al., 2017), IEEE	Using machine learning to predict heart attacks of patients. SPSS used for data validation	Healthcare	Get predicted medical results from scanning directly on phone application, so helps in decision making	N/A
3- Intelligent human resource information system (i-HRIS): A holistic decision support framework for HR excellence [18].	Malaysia, 2018	(Masum M., et al., 2018), Researchgate	Integrating intelligent HR with intelligent decision making with knowledge discovery database	Human Resources, Artificial intelligence.	Improve structured, semi-structured, and unstructured HR decision making process.	Data can be used to predict suitable AI techniques to be used. The model can be broader by using wireless protocols.
4- Artificial intelligence and the future of global health [15].	USA, 2020	(Schwalbe N., and Wah B., 2020), Elsevier	AI into global health categories	Healthcare	Accelerate sustainability. Improved health outcomes	No ethical considerations
5-Role of institutional pressures and resources in the adoption of big data analytics powered artificial intelligence, sustainable manufacturing practices and circular economy capabilities [19].	South Africa, 2020	(Bag S., et al, 2020), Elsevier	Description of reasons why firms use AI into manufacturing.	Manufacturing	Enhance sustainable manufacturing and develop circular economy.	Low skill level
6-A strategic framework for artificial intelligence in marketing [24].	Taiwan, USA, 2020	(Huang M., and Rust R., 2020), Springer	Injecting AI techniques into strategic marketing planning	Marketing	Enhance strategic marketing process	Biased, less human intervention
7- Artificial Intelligence Forecasting Census and Supporting Early Decisions [20].	USA, 2020	(Griner T., et al., 2020), Wolters Kluwer Health	Alex is an AI technique that helps nurses for occupancy prediction and decision making.	Healthcare, Nursing.	Enhance operational excellence, and safety	N/A
8-Manufacturing service innovation platform based on 5 G network and machine learning [16]	China, 2020	(Gao N., et al., 2020), Elsevier	Using AI to organize innovation and achieve organizational excellence	Manufacturing, services.	Enhance customer satisfaction, service innovation, and organizational performance.	N/A
9- Artificial Intelligence (AI) and Its Applications in Indian Manufacturing: A Review [21]	India, 2021	(Rizvi A., et al., 2021), Springer	AI integrated into manufacturing firms in India	Manufacturing	Improve quality and reduce errors	High installation cost and maintenance.
10- Predicting the COVID-19 infection with fourteen clinical features using machine learning classification algorithms [22].	China, 2021	(Arpaci I., Huang S., Al-Emran M., Al-Kabi M, 2021), Springer	AI model is used to predict COVID 19 from 14 criteria with limited testing resources	Medicine, Healthcare	Predict COVID 19 cases ahead of time when RT-PCT kids are limited.	Low sample size. Unavailable data about COVID 19 symptoms in predicting the infection.
11- Applications of Explainable Artificial Intelligence in Diagnosis and Surgery [23].	China, UK,2022	(Zhang, Y.;Weng, Y.; Lund, J.,2022), Diagnostics	Apply AI in surgeries	Medicine, Healthcare	Usage of AI in surgeries	N/A
12-Impact of Artificial Intelligence on Dental Education: A Reviewand Guide for Curriculum Update [35].		(Thurzo, A.; Strunga, M.; Urban, R.; Surovková, J.; Afrashtehfar, K.I., 2023), Education Sciences	Usage of AI in dentistry	Medicine , Dentistry	Usage of AI in new fields in medicine.	N/A

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.

MDPI Initiatives

Important Links

Choose an area of interest and we will send you notifications of new preprints at your preferred frequency.

Disclaimer