Submitted:
24 June 2026
Posted:
25 June 2026
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Methodology
2.1. Data Sources and Research Subjects
2.1.1. Qualitative Research Data
2.1.2. Quantitative Research Data
2.2. Core Methods and Mathematical Models
2.2.1. Grounded Theory
2.2.2. Covariance-Based Structural Equation Modeling
2.2.3. XGBoost Regression Model
2.2.4. SHAP-Based Explainability Analysis Framework
3. Grounded Theory Coding Results and Research Hypotheses
3.1. Grounded Theory Coding Results
3.1.1. Open Coding
3.1.2. Axial Coding
3.1.3. Selective Coding
3.1.4. Saturation Test
3.2. Measurement Scale Development
3.3. Research Hypotheses
3.3.1. Hypotheses on the Direct Effects of Risk Dimensions on Overall Quality Performance Loss
3.3.2. Hypotheses on Chain Transmission Relationships Among Risk Dimensions
3.3.3. Hypotheses on the Domain-Wide Penetrating Effects of Personnel Capability Matching Risk
4. Empirical Results and Analysis
4.1. Data Quality and Common Method Bias Tests
4.2. Measurement Model Evaluation
4.2.1. Exploratory Factor Analysis
4.2.2. Reliability and Convergent Validity
4.2.3. Discriminant Validity
4.3. Structural Model and Hypothesis Testing
4.3.1. Overall Model Fit
4.3.2. Direct Effect Testing
4.3.3. Mediation Effect Testing
4.3.4. Total Effect Decomposition
4.4. XGBoost Regression Results and SHAP Analysis
4.4.1. Predictive Performance of the XGBoost Model
4.4.2. SHAP Global Feature Importance Analysis
4.4.3. Directional Interpretation Based on SHAP
4.4.4. Risk-Dimension-Level SHAP Aggregation Analysis
4.4.5. Comparison and Complementarity Between CB-SEM and SHAP Results
5. Discussion
5.1. Main Findings
5.2. Theoretical Contributions
5.3. Managerial Implications
6. Conclusions and Future Research
6.1. Conclusions
6.2. Limitations and Future Research
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
| Latent variable (code) | Observed variable (code) | Measurement item |
| Process design risk (A) | Loss of model semantics (A1) | During the conversion of enterprise MBD-based 3D models across different software platforms, geometric features or PMI annotations are often lost. |
| Design intent interpretation deviation (A2) | Process engineers may misinterpret the functional intent of design drawings, resulting in process plans that deviate from design requirements. | |
| Detachment of physical properties (A3) | Digital process planning may place excessive emphasis on toolpath generation while neglecting the influence of machining parameters on the residual stress of parts. | |
| Missing key parameters (A4) | Control limits for key process parameters, such as heat-treatment temperature and holding time, are not clearly specified in digital process documents. | |
| Distortion of simulation boundary conditions (A5) | The boundary conditions of virtual machining simulation, such as machine-tool stiffness, differ substantially from the actual operating conditions on the shop floor. | |
| Detachment of verification conditions (A6) | The boundary settings for simulation verification do not cover extreme operating conditions, leading to unanticipated interference, collision, or out-of-tolerance problems in actual production. | |
| Collaboration risk (B) | System data incompatibility (B1) | Engineering changes in the PLM system cannot be synchronized with the MES system in real time, resulting in data inconsistencies on the shop floor. |
| Version synchronization delay (B2) | After design drawings are updated, inadequate version control of shop-floor CNC programs may cause the programs in use to remain inconsistent with updated engineering requirements. | |
| Distortion of outsourced models (B3) | The 3D models provided by external suppliers are not standardized or compliant with relevant specifications, leading to misinterpretation in process design and inconsistencies with actual machining requirements. | |
| Data format barriers (B4) | The data formats used by external suppliers are incompatible with the enterprise’s internal systems, requiring manual conversion, which may reduce collaboration efficiency and introduce manual errors. | |
| Execution risk (C) | Equipment accuracy degradation (C1) | After long-term operation of CNC equipment, wear of core components may lead to latent degradation in machining accuracy. |
| Underlying control failure (C2) | Transient failures may occur in the machine-tool servo system, while the CNC system neither issues alarms nor performs automatic compensation. | |
| Failure of condition monitoring (C3) | Key machining process parameters during production, such as spindle load and cutting temperature fluctuations, lack effective real-time monitoring and anomaly-warning mechanisms. | |
| Lagged control response (C4) | CNC machining parameters cannot be adaptively adjusted in response to deviations in the workpiece state. | |
| Inspection risk (D) | Inspection accuracy drift (D1) | Due to long-term high-frequency use or insufficient calibration, coordinate measuring machines may experience drift in measurement accuracy. |
| Algorithmic fitting misjudgment (D2) | The recognition algorithms of visual inspection systems may generate false or missed detections for small defects or edge features on complex surfaces. | |
| Discontinuity in data collection (D3) | Incomplete collection of human, machine, material, method, and environment data on the shop floor may lead to discontinuities in digital quality records. | |
| Failure of root-cause traceability (D4) | When quality defects occur, it is difficult to identify the specific process responsible for the defect through the digital traceability chain. | |
| Loss of data access control (D5) | Insufficient access control over shop-floor terminal devices may create the risk of unauthorized export of key process data. | |
| Unauthorized modification of records (D6) | Quality inspection records can be modified in the system without proper authorization, undermining the authenticity of quality data. | |
| Personnel risk (E) | Unfamiliarity with software operation (E1) | Some employees are not proficient in operating digital process-planning software, such as UG/NX. |
| Lack of pre-job certification (E2) | Some employees have not obtained the required qualification certification for operating digital equipment before taking their posts. | |
| Fatigue-induced negligence errors (E3) | In digital production, operators may fail to identify and respond to equipment abnormalities in a timely manner, or may make recording errors due to fatigue and negligence. | |
| Non-compliant step-skipping operation (E4) | To improve efficiency, some employees violate operating rules by bypassing the error-proofing verification steps embedded in the system. | |
| Overall loss (Y) | Internal quality loss (Y1) | Overall, the effectiveness of internal quality control on the shop floor is below expectations, and internal quality losses, such as rework, repair, and nonconforming product disposition, still occur relatively frequently. |
| External quality feedback (Y2) | After products are transferred to subsequent processes or finally delivered, external feedback on assembly coordination failures or quality problems related to manufacturing process deviations may still occur. | |
| Batch quality fluctuation (Y3) | The robustness of the digitalized manufacturing process is insufficient, and key quality characteristics show substantial fluctuations across production batches. |
References
- Singh, A.; Madaan, G.; Hr, S.; Kumar, A. Smart Manufacturing Systems: A Futuristics Roadmap towards Application of Industry 4.0 Technologies. Int. J. Comput. Integr. Manuf. 2023, 36, 411–428. [Google Scholar] [CrossRef]
- Ribeiro Da Silva, E.H.D.; Shinohara, A.C.; De Lima, E.P.; Angelis, J.; Machado, C.G. Reviewing Digital Manufacturing Concept in the Industry 4.0 Paradigm. Procedia CIRP 2019, 81, 240–245. [Google Scholar] [CrossRef]
- Cataldo, S.D.; Lee, S.; Macii, E.; Vogel-Heuser, B. Leading Information and Communication Technologies for Smart Manufacturing: Facing the New Challenges and Opportunities of the 4th Industrial Revolution. Proc. IEEE 2021, 109, 320–325. [Google Scholar] [CrossRef]
- Pacini, A.; Lupi, F.; Lanzetta, M. Semantically Enriched CAD Models for Digital Manufacturing: A Systematic Review of Model-Based Definition. J. Intell. Manuf. 2026. [Google Scholar] [CrossRef]
- Hu, Y.; Jia, Q.; Yao, Y.; Lee, Y.; Lee, M.; Wang, C.; Zhou, X.; Xie, R.; Yu, F.R. Industrial Internet of Things Intelligence Empowering Smart Manufacturing: A Literature Review. IEEE Internet Things J. 2024, 11, 19143–19167. [Google Scholar] [CrossRef]
- Abdel-Aty, T.A.; Negri, E. Conceptualizing the Digital Thread for Smart Manufacturing: A Systematic Literature Review. J. Intell. Manuf. 2024, 35, 3629–3653. [Google Scholar] [CrossRef]
- Ramprasath, P.; Bonthu, M.G. Data Integrity Failures in Pharmaceutical Digital Twins and Continuous Manufacturing: An Alcoa + + Framework Integrating Human Factors and Simulation Vulnerabilities. J. Pharm. Innov. 2026, 21, 553. [Google Scholar] [CrossRef]
- Mabkhot, M.M.; Kalawsky, R.S.; Liaqat, A. Introducing the Manufacturing Digital Passport (MDP): A New Concept for Realising Digital Thread Data Sharing in Aerospace and Complex Manufacturing. Systems 2025, 13, 700. [Google Scholar] [CrossRef]
- Eskue, N.; Macali, A. Ensuring Data Accuracy, Completeness, and Interpretation in Advanced Manufacturing. Appl. Sci. 2026, 16, 2409. [Google Scholar] [CrossRef]
- Huang, S.; Simani, S.; Lu, N.; Jiang, B. Virtual Node-Based Risk Assessment for Hidden and Cascading Failures in Production Lines. IEEE Trans. Reliab. 2025, 74, 5531–5543. [Google Scholar] [CrossRef]
- Silesian University of Technology; Organization and Management Department; Economics and Informatics Institute; Wolniak; R.; Grebski, W. Penn State Hazletonne, Pennsylvania State University The Usage of Statistical Process Control (SPC) in Industry 4.0 Conditions. Sci. Pap. Silesian Univ. Technol. Organ. Manag. Ser. 2023, 2023, 259–268. [Google Scholar] [CrossRef]
- Pongboonchai-Empl, T.; Antony, J.; Garza-Reyes, J.A.; Komkowski, T.; Tortorella, G.L. Integration of Industry 4.0 Technologies into Lean Six Sigma DMAIC: A Systematic Review. Prod. Plan. Control 2024, 35, 1403–1428. [Google Scholar] [CrossRef]
- Aichouni, A.B.E.; Silva, C.; Ferreira, L.M.D.F. A Systematic Literature Review of the Integration of Total Quality Management and Industry 4.0: Enhancing Sustainability Performance through Dynamic Capabilities. Sustainability 2024, 16, 9108. [Google Scholar] [CrossRef]
- Wu, Z.; Liu, W.; Nie, W. Literature Review and Prospect of the Development and Application of FMEA in Manufacturing Industry. Int. J. Adv. Manuf. Technol. 2021, 112, 1409–1436. [Google Scholar] [CrossRef]
- Sarkar, A.; Goswami, S.S. A Systematic Review of MCDM Techniques for Decision-Making in Smart Manufacturing Systems under Industry 4.0. Manag. Sci. Adv. 2026, 3, 290–306. [Google Scholar] [CrossRef]
- Tian, H.; Sun, Y.; Chen, C.; Zhang, Z.; Liu, T.; Zhang, T.; He, J.; Yu, L. A Novel FMECA Method for CNC Machine Tools Based on D-GRA and Data Envelopment Analysis. Sci. Rep. 2024, 14, 26596. [Google Scholar] [CrossRef] [PubMed]
- Renosori, P.; Oemar, H.; Fauziah, S. Combination of FTA and FMEA Methods to Improve Efficiency in the Manufacturing Company. Acta Logist. 2023, 10, 487–495. [Google Scholar] [CrossRef]
- Wang, K.; Liu, C.; Lu, Y. Ensemble Bayesian Network for Root Cause Analysis of Product Defects via Learning from Historical Production Data. J. Manuf. Syst. 2024, 75, 102–115. [Google Scholar] [CrossRef]
- Liu, Y.; Li, H. A High Reliability Based Evidential Reasoning Approach. PLoS ONE 2025, 20, e0317438. [Google Scholar] [CrossRef] [PubMed]
- Su, C.-J.; Chen, I.-F.; Tsai, T.-R.; Wang, T.-H.; Lio, Y. Support Vector Machines and Model Selection for Control Chart Pattern Recognition. Mathematics 2025, 13, 592. [Google Scholar] [CrossRef]
- Zheng, H.; Gao, X.; Yang, M.; Yang, X.; Li, Y.; Ding, Y. Complex Product Quality Prediction Method Based on an Improved Light Gradient Boosting Machine. Appl. Intell. 2025, 55, 248. [Google Scholar] [CrossRef]
- Su, X.; Liu, Y.; Li, J. Quality Prediction Using Multiscale Convolutional VAEs for Thin Plate Parts. Sci. Rep. 2026, 16, 5499. [Google Scholar] [CrossRef] [PubMed]
- Ko, J.H.; Yin, C. A Review of Artificial Intelligence Application for Machining Surface Quality Prediction: From Key Factors to Model Development. J. Intell. Manuf. 2026, 37, 775–798. [Google Scholar] [CrossRef]
- Ebni, M.; Hosseini Bamakan, S.M.; Qu, Q. Digital Twin Based Smart Manufacturing; from Design to Simulation and Optimization Schema. Procedia Comput. Sci. 2023, 221, 1216–1225. [Google Scholar] [CrossRef]
- Sarstedt, M.; Adler, S.J.; Ringle, C.M.; Cho, G.; Diamantopoulos, A.; Hwang, H.; Liengaard, B.D. Same Model, Same Data, but Different Outcomes: Evaluating the Impact of Method Choices in Structural Equation Modeling. J. Prod. Innov. Manag. 2024, 41, 1100–1117. [Google Scholar] [CrossRef]
- Muaz, M.; Sajid, S.; Schulze, T.; Liu, C.; Klasen, N.; Drescher, B. Explainable AI for Correct Root Cause Analysis of Product Quality in Injection Moulding. J. Manuf. Process. 2025, 145, 371–380. [Google Scholar] [CrossRef]
- Marín Díaz, G. Comparative Analysis of Explainable AI Methods for Manufacturing Defect Prediction: A Mathematical Perspective. Mathematics 2025, 13, 2436. [Google Scholar] [CrossRef]
- Eslamifar, A.; Mehrmanesh, H.; Mehrani, A. Model of Quality and Safety Management Based on the Industry 4.0 Approach. J. Resour. Manag. Decis. Eng. 2025, 4, 1–8. [Google Scholar] [CrossRef]
- Dash, G.; Paul, J. CB-SEM vs PLS-SEM Methods for Research in Social Sciences and Technology Forecasting. Technol. Forecast. Soc. Change 2021, 173, 121092. [Google Scholar] [CrossRef]
- Cheung, G.W.; Cooper-Thomas, H.D.; Lau, R.S.; Wang, L.C. Reporting Reliability, Convergent and Discriminant Validity with Structural Equation Modeling: A Review and Best-Practice Recommendations. Asia Pac. J. Manag. 2024, 41, 745–783. [Google Scholar] [CrossRef]
- Gaskin, J.E.; Lowry, P.B.; Rosengren, W.; Fife, P.T. Essential Validation Criteria for Rigorous Covariance-based Structural Equation Modelling. Inf. Syst. J. 2025, 35, 1630–1661. [Google Scholar] [CrossRef]
- Igartua, J.-J.; Hayes, A.F. Mediation, Moderation, and Conditional Process Analysis: Concepts, Computations, and Some Common Confusions. Span. J. Psychol. 2021, 24, e49. [Google Scholar] [CrossRef] [PubMed]
- Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 13 2016; ACM: San Francisco California USA; pp. 785–794. [Google Scholar]
- Lundberg, S.M.; Erion, G.; Chen, H.; DeGrave, A.; Prutkin, J.M.; Nair, B.; Katz, R.; Himmelfarb, J.; Bansal, N.; Lee, S.-I. From Local Explanations to Global Understanding with Explainable AI for Trees. Nat. Mach. Intell. 2020, 2, 56–67. [Google Scholar] [CrossRef] [PubMed]
- Hennink, M.; Kaiser, B.N. Sample Sizes for Saturation in Qualitative Research: A Systematic Review of Empirical Tests. Soc. Sci. Med. 2022, 292, 114523. [Google Scholar] [CrossRef] [PubMed]
- Chiarini, A. Industry 4.0, Quality Management and TQM World. A Systematic Literature Review and a Proposed Agenda for Further Research. TQM J. 2020, 32, 603–616. [Google Scholar] [CrossRef]
- Gangwani, K.K.; Bhatia, M.S. Enhancing Quality Performance through Blockchain Technology: An Organization Information Processing Theory Perspective. J. Enterp. Inf. Manag. 2025, 38, 1536–1557. [Google Scholar] [CrossRef]
- Roth, M.; Rezaei Aderiani, A.; Morse, E.; Wärmefjord, K.; Söderberg, R. Closing Gaps in the Digital Thread with the Quality Information Framework (QIF) Standard for a Seamless Geometry Assurance Process. Comput.-Aided Des. 2025, 182, 103860. [Google Scholar] [CrossRef]
- Münch, C.; Marx, E.; Benz, L.; Hartmann, E.; Matzner, M. Capabilities of Digital Servitization: Evidence from the Socio-Technical Systems Theory. Technol. Forecast. Soc. Change 2022, 176, 121361. [Google Scholar] [CrossRef]
- Tehseen, S.; Ramayah, T.; Sajilan, S. Testing and Controlling for Common Method Variance: A Review of Available Methods. J. Manag. Sci. 2017, 4, 142–168. [Google Scholar] [CrossRef]
- Afthanorhan, A.; Ghazali, P.L.; Rashid, N. Discriminant Validity: A Comparison of CBSEM and Consistent PLS Using Fornell & Larcker and HTMT Approaches. J. Phys. Conf. Ser. 2021, 1874, 012085. [Google Scholar] [CrossRef]
- Tempelaar, D.; Rienties, B.; Nguyen, Q. Subjective Data, Objective Data and the Role of Bias in Predictive Modelling: Lessons from a Dispositional Learning Analytics Application. PLoS ONE 2020, 15, e0233977. [Google Scholar] [CrossRef] [PubMed]
- Pasi, B.N.; Mahajan, S.K.; Rane, S.B. Strategies for Risk Management in Adopting Industry 4.0 Concept in Manufacturing Industries. J. Sci. Technol. Policy Manag. 2023, 14, 563–591. [Google Scholar] [CrossRef]
- Huang, J.; You, J.-X.; Liu, H.-C.; Song, M.-S. Failure Mode and Effect Analysis Improvement: A Systematic Literature Review and Future Research Agenda. Reliab. Eng. Syst. Saf. 2020, 199, 106885. [Google Scholar] [CrossRef]
- Barraza De La Paz, J.V.; Rodríguez-Picón, L.A.; Morales-Rocha, V.; Torres-Argüelles, S.V. A Systematic Review of Risk Management Methodologies for Complex Organizations in Industry 4.0 and 5.0. Systems 2023, 11, 218. [Google Scholar] [CrossRef]
- Tunca, B. Hybrid Use of Structural Equation Modeling and Machine Learning: Literature Review and Future Potential. 2025. [Google Scholar] [CrossRef]







| Variable type | Variable name | Variable symbol | Item code | Number of items |
| Quality risk variables | Process design and transformation risk | A | A1–A6 | 6 |
| Data flow and collaboration risk | B | B1–B4 | 4 | |
| Production execution and process control risk | C | C1–C4 | 4 | |
| Quality inspection and data traceability risk | D | D1–D6 | 6 | |
| Personnel capability matching risk | E | E1–E4 | 4 | |
| Quality performance loss variable | Overall quality performance loss | Y | Y1–Y3 | 3 |
| Statistical variable | Category | Frequency | Percentage (%) |
| Manufacturing sector | Aerospace | 157 | 37.38 |
| Defense and military equipment | 126 | 30.00 | |
| High-end machine tools/precision equipment | 93 | 22.14 | |
| Other equipment manufacturing | 44 | 10.48 | |
| Respondent position type | Process design and planning personnel | 91 | 21.67 |
| Production/workshop management personnel | 60 | 14.29 | |
| On-site operation and execution personnel | 134 | 31.90 | |
| Quality inspection and control personnel | 99 | 23.57 | |
| Digital system operation and maintenance/data management personnel | 36 | 8.57 | |
| Relevant work experience | 3 years or less | 68 | 16.19 |
| 4–6 years | 169 | 40.24 | |
| 7–10 years | 125 | 29.76 | |
| More than 10 years | 58 | 13.81 | |
| Main routine participation links | MBD modeling and process design | 201 | 47.86 |
| Cross-departmental data collaborative circulation | 229 | 54.52 | |
| Production-site execution and process control | 279 | 66.43 | |
| Digital quality inspection and data traceability | 267 | 63.57 | |
| Full-process quality system management | 150 | 35.71 |
| Hyperparameter | Code name | Search range | Description |
| Number of decision trees | n_estimators | 100, 200, 300, 500, 800 | Number of regression trees in the XGBoost ensemble model |
| Maximum tree depth | max_depth | 2, 3, 4, 5, 6 | Maximum depth of a single tree, used to control model complexity |
| Learning rate | learning_rate | 0.01, 0.03, 0.05, 0.08, 0.10 | Contribution weight of each tree to the final prediction |
| Subsample ratio | subsample | 0.6, 0.7, 0.8, 0.9, 1.0 | Proportion of samples randomly selected for training each tree |
| Feature subsample ratio | colsample_bytree | 0.6, 0.7, 0.8, 0.9, 1.0 | Proportion of features randomly selected for training each tree |
| Minimum child weight | min_child_weight | 1, 2, 3, 5, 7 | Minimum sum of instance weights required for a child node to be further split |
| Minimum loss reduction for splitting | gamma | 0, 0.01, 0.05, 0.1, 0.2 | Minimum loss reduction required to make a further split on a leaf node |
| L1 regularization coefficient | reg_alpha | 0, 0.001, 0.01, 0.05, 0.1 | Controls model sparsity and reduces overfitting |
| L2 regularization coefficient | reg_lambda | 0.5, 1, 2, 5, 10 | Controls model complexity and enhances generalization ability |
| Original interview excerpt | Initial concept | Initial category |
| “The MBD model transferred from the design stage sometimes shows missing geometric features when imported into our process software, or the three-dimensional PMI annotations, such as tolerances and roughness, are lost or unclear.” | Missing geometric features in the model; loss of three-dimensional PMI annotations | Loss of model semantics |
| “The dimensions measured using the three-coordinate measuring machine were clearly qualified, but because the process parameters were not properly set, the residual stress inside the part was not released. The part soon experienced fatigue fracture after installation.” | Focusing only on geometric dimensional conformity; neglecting physical performance indicators; residual internal stress | Detachment of physical properties |
| “The cutting simulation in the software uses the standard machine tool and tool library, which differs greatly from the aging condition and clamping method of the actual workshop equipment. The simulation appears fine, but tool interference and collision can easily occur during machining.” | Idealized simulation boundary conditions; neglect of actual equipment conditions; gap between virtual and real operating conditions | Distortion of simulation boundary conditions |
| “The data interfaces between upstream and downstream systems were not fully connected. The MES program issuing process was delayed, and the workers did not notice it, so they called a discarded NC program from the previous local version.” | Heterogeneous system interfaces not fully connected; delay in data issuing; incorrect invocation of an outdated program | Version synchronization delay |
| “After several years of use, the guideway accuracy of the high-end five-axis machine tool deteriorated. However, the control system did not issue an alarm, and the machining trajectory deviated slightly by several hundredths of a millimeter, which could not be detected by the naked eye.” | Hidden degradation of equipment accuracy; no early warning from the underlying control system; slight deviation of the machining trajectory | Equipment accuracy degradation |
| “Key parameters such as heat-treatment furnace temperature and spindle load sometimes fluctuate greatly. When the system monitoring is disconnected or data acquisition is delayed, hidden defects such as burns and microcracks are likely to occur.” | Instantaneous fluctuation of key parameters; blind spots in data acquisition; no early warning from the monitoring system | Failure of condition monitoring |
| “If the three-coordinate measuring machine and online visual inspection equipment are not calibrated for a long time, accuracy drift may occur. Sometimes the algorithm fitting has errors, leading to missed detection or misclassification, where nonconforming products are judged as qualified.” | Fitting errors in vision algorithms; uncalibrated inspection equipment; release of nonconforming products | Algorithmic fitting misjudgment |
| “On-site data on processes, equipment, and personnel are incompletely collected, and QR-code binding is not standardized. When quality problems are found later, it is sometimes impossible to determine which machine tool or which operator was responsible.” | Incomplete collection of production elements; non-standardized identification-code binding; inability to trace root causes backward | Failure of root-cause traceability |
| Main category | Subcategory | Included initial categories | Category connotation |
| Process design and transformation risk | Design–manufacturing data transfer risk | Loss of model semantics; design intent interpretation deviation | When the MBD model is parsed across heterogeneous software platforms, geometric features and PMI data may be lost. In addition, process engineers may have cognitive deviations in interpreting design intent, resulting in defective input at the source of manufacturing. |
| Data flow and collaboration risk | Virtual–physical disconnection and data version disorder | System data incompatibility; Version synchronization delay | Due to data-interface barriers among the PLM system, MES, and shop-floor equipment, engineering changes may not be issued in real time, causing operators to mistakenly invoke outdated three-dimensional models or NC programs. |
| Production execution and process control risk | Intelligent manufacturing equipment and flexible tooling defects | Equipment accuracy degradation; underlying control failure | High-end CNC equipment may undergo latent accuracy degradation, such as guideway wear and thermal drift, due to long-term high-load operation. Alternatively, transient failures may occur in the underlying servo-control logic, while the CNC system fails to trigger alarms or compensation mechanisms, resulting in microscopic deviations in the machining trajectory. |
| Quality inspection and data traceability risk | Digital inspection system reliability risk | Inspection accuracy drift; Algorithmic fitting misjudgment | Automated inspection equipment, such as online visual inspection systems and coordinate measuring machines, may experience accuracy drift due to long-term high-frequency use or lack of regular calibration. In addition, image-recognition algorithms may have fitting limitations, leading to missed detection or misjudgment of marginal quality defects. |
| Latent variable | Abbreviation (code) | Observed variable (code) |
| Process design and transformation risk | Process design risk (A) | Loss of model semantics (A1) |
| Design intent interpretation deviation (A2) | ||
| Detachment of physical properties (A3) | ||
| Missing key parameters (A4) | ||
| Distortion of simulation boundary conditions (A5) | ||
| Detachment of verification conditions (A6) | ||
| Data flow and collaboration risk | Collaboration risk (B) | System data incompatibility (B1) |
| Version synchronization delay (B2) | ||
| Distortion of outsourced models (B3) | ||
| Data format barriers (B4) | ||
| Production execution and process control risk | Execution risk (C) | Equipment accuracy degradation (C1) |
| Underlying control failure (C2) | ||
| Failure of condition monitoring (C3) | ||
| Lagged control response (C4) | ||
| Quality inspection and data traceability risk | Inspection risk (D) | Inspection accuracy drift (D1) |
| Algorithmic fitting misjudgment (D2) | ||
| Discontinuity in data collection (D3) | ||
| Failure of root-cause traceability (D4) | ||
| Loss of data access control (D5) | ||
| Unauthorized modification of records (D6) | ||
| Personnel capability matching risk | Personnel risk (E) | Unfamiliarity with software operation (E1) |
| Lack of pre-job certification (E2) | ||
| Fatigue-induced negligence errors (E3) | ||
| Non-compliant step-skipping operation (E4) | ||
| Overall quality performance loss | Overall loss (Y) | Internal quality loss (Y1) |
| External quality feedback (Y2) | ||
| Batch quality fluctuation (Y3) |
| Latent variable | Items | Factor loading range | Cross-loading status |
| Process design risk (A) | A1–A6 | 0.792–0.883 | No obvious cross-loading |
| Collaboration risk (B) | B1–B4 | 0.787–0.872 | No obvious cross-loading |
| Execution risk (C) | C1–C4 | 0.835–0.891 | No obvious cross-loading |
| Inspection risk (D) | D1–D6 | 0.837–0.886 | No obvious cross-loading |
| Personnel risk (E) | E1–E4 | 0.818–0.897 | No obvious cross-loading |
| Overall loss (Y) | Y1–Y3 | 0.783–0.801 | No obvious cross-loading |
| Latent variable | Items | Standardized factor loading | Cronbach’s α | CR | AVE |
| Process design risk (A) | A1–A6 | 0.744–0.876 | 0.918 | 0.92 | 0.657 |
| Collaboration risk (B) | B1–B4 | 0.729–0.863 | 0.885 | 0.888 | 0.665 |
| Execution risk (C) | C1–C4 | 0.790–0.902 | 0.915 | 0.916 | 0.733 |
| Inspection risk (D) | D1–D6 | 0.828–0.900 | 0.945 | 0.945 | 0.742 |
| Personnel risk (E) | E1–E4 | 0.786–0.880 | 0.898 | 0.901 | 0.694 |
| Overall loss (Y) | Y1–Y3 | 0.810–0.888 | 0.88 | 0.882 | 0.713 |
| Overall scale | — | — | 0.903 | — | — |
| Variable | Process design risk (A) | Collaboration risk (B) | Execution risk (C) | Inspection risk (D) | Personnel risk (E) | Overall loss (Y) |
| Process design risk (A) | 0.811 | |||||
| Collaboration risk (B) | 0.233 | 0.815 | ||||
| Execution risk (C) | 0.12 | 0.239 | 0.856 | |||
| Inspection risk (D) | 0.127 | 0.128 | 0.31 | 0.861 | ||
| Personnel risk (E) | 0.221 | 0.22 | 0.24 | 0.294 | 0.833 | |
| Overall loss (Y) | 0.416 | 0.39 | 0.38 | 0.399 | 0.473 | 0.844 |
| Fit index | RMSEA | RMR | GFI | AGFI | CFI | TLI | IFI | |
| Recommended threshold | < 3 | < 0.08 | < 0.08 | > 0.90 | > 0.90 | > 0.90 | > 0.90 | > 0.90 |
| Model value | 1.204 | 0.022 | 0.058 | 0.939 | 0.926 | 0.992 | 0.991 | 0.992 |
| Hypothesis | Path relationship | Standardized path coefficient | S.E. | C.R. | P value | Conclusion |
| H1 | Process design risk (A) → Overall loss (Y) | 0.264 | 0.049 | 5.764 | *** | Supported |
| H2 | Collaboration risk (B) →Overall loss (Y) |
0.203 | 0.055 | 4.279 | *** | Supported |
| H3 | Execution risk (C) → Overall loss (Y) |
0.173 | 0.046 | 3.694 | *** | Supported |
| H4 | Inspection risk (D) → Overall loss (Y) |
0.209 | 0.046 | 4.512 | *** | Supported |
| H5 | Personnel risk (E) →Overall loss (Y) |
0.269 | 0.053 | 5.592 | *** | Supported |
| H6 | Process design risk (A) → Collaboration risk (B) | 0.195 | 0.051 | 3.575 | *** | Supported |
| H7 | Collaboration risk (B) → Execution risk (C) |
0.197 | 0.063 | 3.648 | *** | Supported |
| H8 | Execution risk (C) → Inspection risk (D) |
0.254 | 0.051 | 4.94 | *** | Supported |
| H9 | Personnel risk (E) → Process design risk (A) |
0.223 | 0.054 | 4.201 | *** | Supported |
| H10 | Personnel risk (E) → Collaboration risk (B) |
0.177 | 0.052 | 3.241 | ** | Supported |
| H11 | Personnel risk (E) → Execution risk (C) |
0.197 | 0.059 | 3.696 | *** | Supported |
| H12 | Personnel risk (E) →Inspection risk (D) |
0.234 | 0.057 | 4.519 | *** | Supported |
| No. | Indirect effect transmission path | Total indirect effect | Bootstrap 95% confidence interval | Pvalue | Conclusion |
| 1 | Personnel risk (E) → Overall loss (Y) |
0.207 | [0.162, 0.307] | < 0.001 | Significant |
| 2 | Process design risk (A) → Overall loss (Y) | 0.048 | [0.023, 0.094] | < 0.001 | Significant |
| 3 | Collaboration risk (B) → Overall loss (Y) | 0.045 | [0.022, 0.096] | < 0.001 | Significant |
| 4 | Execution risk (C) → Overall loss (Y) |
0.053 | [0.025, 0.093] | < 0.001 | Significant |
| 5 | Personnel risk (E) → Inspection risk (D) |
0.081 | [0.036, 0.113] | < 0.001 | Significant |
| 6 | Process design risk (A) → Inspection risk (D) | 0.013 | [0.004, 0.024] | < 0.001 | Significant |
| Independent variable |
Direct effect |
Indirect effect |
Total effect | Proportion of indirect effect (%) |
| Personnel risk (E) | 0.269 | 0.207 | 0.476 | 43.5 |
| Process design risk (A) | 0.264 | 0.048 | 0.312 | 15.4 |
| Collaboration risk (B) | 0.203 | 0.045 | 0.247 | 18.2 |
| Execution risk (C) | 0.173 | 0.053 | 0.226 | 23.5 |
| Inspection risk (D) | 0.209 | — | 0.209 | — |
| Dataset | R2 | RMSE | MAE |
| Training set | 0.6931 | 0.6513 | 0.5356 |
| Test set | 0.3611 | 1.0244 | 0.8593 |
| Five-fold cross-validation |
— | 0.9635 | — |
| Rank | Item code | Risk connotation | Dimension | Mean |SHAP| |
| 1 | E2 | Lack of pre-job certification | Personnel risk | 0.124 |
| 2 | E4 | Non-compliant step-skipping operation | Personnel risk | 0.110 |
| 3 | C2 | Underlying control failure | Execution risk | 0.098 |
| 4 | A5 | Distortion of simulation boundary conditions | Process design risk | 0.093 |
| 5 | B1 | System data incompatibility | Collaboration risk | 0.083 |
| 6 | D5 | Loss of data access control | Inspection risk | 0.067 |
| 7 | C3 | Failure of condition monitoring | Execution risk | 0.064 |
| 8 | B4 | Data format barriers | Collaboration risk | 0.057 |
| 9 | A6 | Detachment of verification conditions | Process design risk | 0.056 |
| 10 | A3 | Detachment of physical properties | Process design risk | 0.052 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).