Submitted:
15 June 2023
Posted:
15 June 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Literature Review
3. Methodology
4. Case Study
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Imeni, M.; Edalatpanah, S.A. Resilience: Business Sustainability Based on Risk Management. In; 2023; pp. 199–213.
- Taherdoost, H.; Madanchian, M. Multi-Criteria Decision Making (MCDM) Methods and Concepts. Encyclopedia 2023, 3, 77–87. [Google Scholar] [CrossRef]
- Wątróbski, J.; Jankowski, J.; Ziemba, P.; Karczmarczyk, A.; Zioło, M. Generalised Framework for Multi-Criteria Method Selection. Omega (Westport) 2019, 86, 107–124. [Google Scholar] [CrossRef]
- Khazaei, M.; Ramezani, M.; Padash, A.; DeTombe, D. The Quantification Role of BWM in Problem Structuring Methods: SYRCS Methodology BT - Advances in Best-Worst Method.; Rezaei, J., Brunelli, M., Mohammadi, M., Eds.; Springer International Publishing: Cham, 2022; pp. 252–271. [Google Scholar]
- Horita, M.; Maemura, Y. Supporting Community Decisions BT - Handbook of Group Decision and Negotiation. In; Kilgour, D.M., Eden, C., Eds.; Springer International Publishing: Cham, 2021; ISBN 978-3-030-49629-6. [Google Scholar]
- Pluchinotta, I.; Salvia, G.; Zimmermann, N. The Importance of Eliciting Stakeholders’ System Boundary Perceptions for Problem Structuring and Decision-Making. Eur J Oper Res 2022, 302, 280–293. [Google Scholar] [CrossRef]
- Laouris, Y. Managing Large-Scale Societal Change. In; Márquez, F.P.G., Ed.; IntechOpen: Rijeka, 2022; ISBN 978-1-80355-981-0. [Google Scholar]
- Skolfield, J.K.; Escobedo, A.R. Operations Research in Optimal Power Flow: A Guide to Recent and Emerging Methodologies and Applications. Eur J Oper Res 2022, 300, 387–404. [Google Scholar] [CrossRef]
- Silal, S.P. Operational Research: A Multidisciplinary Approach for the Management of Infectious Disease in a Global Context. Eur J Oper Res 2021, 291, 929–934. [Google Scholar] [CrossRef] [PubMed]
- Weber, G.-W.; Thomas, J.J.; Saucedo, J.A.M.; Fiore, U.; Litvinchev, I.; Vasant, P. Preface: Special Issue on Modeling, Simulation, and Optimization in Operational Research. Journal of the Operations Research Society of China 2022, 10, 685–688. [Google Scholar] [CrossRef]
- Sinuany-Stern, Z. Foundations of Operations Research: From Linear Programming to Data Envelopment Analysis. Eur J Oper Res 2023, 306, 1069–1080. [Google Scholar] [CrossRef]
- Doumpos, M.; Zopounidis, C.; Gounopoulos, D.; Platanakis, E.; Zhang, W. Operational Research and Artificial Intelligence Methods in Banking. Eur J Oper Res 2023, 306, 1–16. [Google Scholar] [CrossRef]
- Bellenguez, O.; Brauner, N.; Tsoukiàs, A. Is There an Ethical Operational Research Practice? And What This Implies for Our Research? EURO Journal on Decision Processes 2023, 11, 100029. [Google Scholar] [CrossRef]
- Conlon, M.; Molloy, O. Modelling a Computed Tomography Service Using Mixed Operational Research Methods. Journal of Simulation 2023, 1–13. [Google Scholar] [CrossRef]
- Raeesi, R.; Sahebjamnia, N.; Mansouri, S.A. The Synergistic Effect of Operational Research and Big Data Analytics in Greening Container Terminal Operations: A Review and Future Directions. Eur J Oper Res 2022. [Google Scholar] [CrossRef]
- Azar, A.; Sorourkhah, A. Designing a Model for Three-Dimensional Robustness Analysis: A Case Study of Iran Khodro Machine Tools Industries Company. Indian J Sci Technol 2015, 8. [Google Scholar] [CrossRef]
- Grieco, L.; Utley, M.; Crowe, S. Operational Research Applied to Decisions in Home Health Care: A Systematic Literature Review. Journal of the Operational Research Society 2021, 72, 1960–1991. [Google Scholar] [CrossRef]
- Howlett, M. Dealing with the Dark Side of Policy-Making: Managing Behavioural Risk and Volatility in Policy Designs. Journal of Comparative Policy Analysis: Research and Practice 2020, 22, 612–625. [Google Scholar] [CrossRef]
- Fathi, M.R.; Maleki, M.H.; Sobhani, S.M.; Koksal, C.D. Future Study of Operations Research Based on Scenario Planning and Soft Systems Methodology. foresight 2020, 22, 223–249. [Google Scholar] [CrossRef]
- Kogetsidis, H. Dealing with Complexity – the Contribution of Problem Structuring Methods to Management Science. International Journal of Organizational Analysis 2023. [Google Scholar] [CrossRef]
- Shafaghsorkh, O.; Ayough, A. Application of Soft Operations Research Methods in Healthcare: A Systematic Review. Journal of Industrial Engineering and Management Studies 2022, 9, 136–147. [Google Scholar] [CrossRef]
- Novani, S.; Cyntiawati, C.; Kijima, K.; Hasyimi, V.; Trianto, A.S.; Mayangsari, L.; Alamanda, D.T.; Anggadwita, G. Empowering Digital Creative Ecosystem Using Problem Structuring Method and a Service Science Perspective: A Case Study in Cimahi and Bandung, Indonesia. Asia Pacific Management Review 2022. [Google Scholar] [CrossRef]
- Smith, C.M.; Shaw, D. The Characteristics of Problem Structuring Methods: A Literature Review. Eur J Oper Res 2019, 274, 403–416. [Google Scholar] [CrossRef]
- Morrill, N. O.R. Support for Planning under Uncertainty. Impact 2021, 2021, 13–15. [Google Scholar] [CrossRef]
- Logullo, Y.; Bigogno-Costa, V.; da Silva, A.C.S.; Belderrain, M.C. A Prioritization Approach Based on VFT and AHP for Group Decision Making: A Case Study in the Military Operations. Production 2022, 32. [Google Scholar] [CrossRef]
- Lami, I.M.; Todella, E. A Multi-Methodological Combination of the Strategic Choice Approach and the Analytic Network Process: From Facts to Values and Vice Versa. Eur J Oper Res 2023, 307, 802–812. [Google Scholar] [CrossRef]
- Françozo, R.V.; Belderrain, M.C.N. A Problem Structuring Method Framework for Value-Focused Thinking. EURO Journal on Decision Processes 2022, 10, 100014. [Google Scholar] [CrossRef]
- Lami, I.M.; Tavella, E. On the Usefulness of Soft OR Models in Decision Making: A Comparison of Problem Structuring Methods Supported and Self-Organized Workshops. Eur J Oper Res 2019, 275, 1020–1036. [Google Scholar] [CrossRef]
- Carter, M.W.; Busby, C.R. How Can Operational Research Make a Real Difference in Healthcare? Challenges of Implementation. Eur J Oper Res 2023, 306, 1059–1068. [Google Scholar] [CrossRef]
- Franco, L.A.; Rouwette, E.A.J.A. Problem Structuring Methods: Taking Stock and Looking Ahead BT - The Palgrave Handbook of Operations Research. In; Salhi, S., Boylan, J., Eds.; Springer International Publishing: Cham, 2022; ISBN 978-3-030-96935-6. [Google Scholar]
- Bérard, C.; Cloutier, L.M.; Cassivi, L. The Effects of Using System Dynamics-Based Decision Support Models: Testing Policy-Makers’ Boundaries in a Complex Situation. J Decis Syst 2017, 26, 45–63. [Google Scholar] [CrossRef]
- Castellini, M.A.; Paucar-Caceres, A. A Conceptual Framework for Integrating Methodologies in Management: Partial Results of a Systemic Intervention in a Textile SME in Argentina. Syst Res Behav Sci 2019, 36, 20–35. [Google Scholar] [CrossRef]
- Curto, R.; Norese, M.F.; Rolando, D. A Multi-criteria Decision Aid Perspective That Guides an Incremental Development of Knowledge and Fosters Relationships and Decisions. EURO Journal on Decision Processes 2022, 10, 100023. [Google Scholar] [CrossRef]
- Estellita Lins, M.P.; Netto, S.O.A.; de Castro Lobo, M.S. Multimethodology Applied to the Evaluation of Healthcare in Brazilian Municipalities. Health Care Manag Sci 2019, 22, 197–214. [Google Scholar] [CrossRef]
- Leong, C.; Soon, D.W.X.; Ong, C.; Howlett, M. Problems in Applying Soft OR Methods to Climate Actions: Lessons from Two Cases of Governmental Use. npj Climate Action 2023, 2, 1. [Google Scholar] [CrossRef]
- Christie, J.S.; Mingers, J.; Kotiadis, K. Using Problem Structuring Methods with Quantitative OR: Six Methodological Designs. In Proceedings of the 64th Annual Conference of the Operational Research Society (OR64); University of Warwick, Coventry, UK; 2022. [Google Scholar]
- Lane, D.C. Fons et Origo: Reflections on the 60th Anniversary of Industrial Dynamics. Syst Dyn Rev 2022, 38, 292–324. [Google Scholar] [CrossRef]
- Pessôa, L.A.M.; Lins, M.P.E.; da Silva, A.C.M.; Fiszman, R. Integrating Soft and Hard Operational Research to Improve Surgical Centre Management at a University Hospital. Eur J Oper Res 2015, 245, 851–861. [Google Scholar] [CrossRef]
- Lamé, G.; Jouini, O.; Stal-Le Cardinal, J. Combining Soft Systems Methodology, Ethnographic Observation, and Discrete-Event Simulation: A Case Study in Cancer Care. Journal of the Operational Research Society 2020, 71, 1545–1562. [Google Scholar] [CrossRef]
- Valafar, M.-A.; Hamidi, N.; Alborzi, M.; Iranban, S. Systematic Structuring of the Business Domain of Local Mobile Apps Stores Using Soft Systems Methodology (SSM). Journal of System Management 2020, 6, 135–154. [Google Scholar] [CrossRef]
- Elias, A.A. Multi-Stakeholder Participation for Achieving Sustainable Development Goals: A Systems Thinking Approach. In Environmental Sustainability and Agenda 2030; Tauringana, V., Moses, O., Eds.; Advances in Environmental Accounting & Management; Emerald Publishing Limited, 2022; Vol. 10, pp. 45–65 ISBN 978-1-80262-879-1, 978-1-80262-880-7.
- Weck, M.; Humala, I.; Tamminen, P.; Ferreira, F.A.F. Supporting Sustainable Development Using Multiple Criteria Decision Aid: Towards an Age-Friendly Smart Living Environment BT - Multiple Criteria Decision Making for Sustainable Development: Pursuing Economic Growth, Environmental Protection and Social Co. In; Doumpos, M., Ferreira, F.A.F., Zopounidis, C., Eds.; Springer International Publishing: Cham, 2021; ISBN 978-3-030-89277-7. [Google Scholar]
- de Morais Correia, L.M.A.; da Silva, J.M.N.; dos Santos Leite, W.K.; Lucas, R.E.C.; Colaço, G.A. A Multi-criteria Decision Model to Rank Workstations in a Footwear Industry Based on a FITradeoff-Ranking Method for Ergonomics Interventions. Operational Research 2022, 22, 3335–3371. [Google Scholar] [CrossRef]
- Santoro, S.; Pluchinotta, I.; Pagano, A.; Pengal, P.; Cokan, B.; Giordano, R. Assessing Stakeholders’ Risk Perception to Promote Nature Based Solutions as Flood Protection Strategies: The Case of the Glinščica River (Slovenia). Science of The Total Environment 2019, 655, 188–201. [Google Scholar] [CrossRef]
- Vik, M.B.; Finnestrand, H.; Flood, R.L. Systemic Problem Structuring in a Complex Hospital Environment Using Viable System Diagnosis – Keeping the Blood Flowing. Syst Pract Action Res 2022, 35, 203–226. [Google Scholar] [CrossRef] [PubMed]
- Cardoso-Grilo, T.; Monteiro, M.; Oliveira, M.D.; Amorim-Lopes, M.; Barbosa-Póvoa, A. From Problem Structuring to Optimization: A Multi-Methodological Framework to Assist the Planning of Medical Training. Eur J Oper Res 2019, 273, 662–683. [Google Scholar] [CrossRef]
- Qiu, P.; Sorourkhah, A.; Kausar, N.; Cagin, T.; Edalatpanah, S.A. Simplifying the Complexity in the Problem of Choosing the Best Private-Sector Partner. Systems 2023, 11. [Google Scholar] [CrossRef]
- Amoozad Mahdiraji, H.; Turskis, Z.; Jafarnejad, A.; Rezayar, A. Non-Cooperative Two-Echelon Supply Chains with a Focus on Social Responsibility. Technological and Economic Development of Economy 2019, 25, 1162–1187. [Google Scholar] [CrossRef]
- Junior, A. de L.C.; Belderrain, M.C.N.; Junior, M.M.C. State Aviation Risk Assessment Level Determination Using Hierarchical Fuzzy Inference System Based on Cognitive Maps. Journal of Artificial Intelligence and Systems 2021, 3, 1–15. [Google Scholar] [CrossRef]
- Afsar, B.; Silvennoinen, J.; Miettinen, K. A Systematic Way of Structuring Real-World Multi-objective Optimization Problems BT - Evolutionary Multi-Criterion Optimization.; Emmerich, M., Deutz, A., Wang, H., Kononova, A. V, Naujoks, Li, K., Miettinen, K., Yevseyeva, I., Eds.; Springer Nature Switzerland: Cham, 2023; pp. 593–605. [Google Scholar]
- Schotten, P.C.; Morais, D.C. Problem Structuring and Strategic Sorting Model for Financial Organizations. European Journal of Business and Management Research 2023, 8, 100–111. [Google Scholar] [CrossRef]
- Li, P.; Edalatpanah, S.A.; Sorourkhah, A.; Yaman, S.; Kausar, N. An Integrated Fuzzy Structured Methodology for Performance Evaluation of High Schools in a Group Decision-Making Problem. Systems 2023, 11. [Google Scholar] [CrossRef]
- Vieira, F.C.; Ferreira, F.A.F.; Govindan, K.; Ferreira, N.C.M.Q.F.; Banaitis, A. Measuring Urban Digitalization Using Cognitive Mapping and the Best Worst Method (BWM). Technol Soc 2022, 71, 102131. [Google Scholar] [CrossRef]
- Lami, I.M.; Todella, E. A Multi-Methodological Combination of the Strategic Choice Approach and the Analytic Network Process: From Facts to Values and Vice Versa. Eur J Oper Res 2023, 307, 802–812. [Google Scholar] [CrossRef]
- Aubert, A.H.; McConville, J.; Schmid, S.; Lienert, J. Gamifying and Evaluating Problem Structuring: A Card Game Workshop for Generating Decision Objectives. EURO Journal on Decision Processes 2022, 10, 100021. [Google Scholar] [CrossRef]
- Khajeh, F.; Shahbandarzadeh, H. Modeling Factors Affecting the Interests of the Container Terminal Using Fuzzy Cognitive Map and Fuzzy DEMATEL. Journal of Modelling in Management ahead-of-print. 2022. [Google Scholar] [CrossRef]
- Eghbali Amooghin, A.; Mohammadzadeh Salteh, H.; Salehi, M.; Nonahal nahr, A. akbar Determining the Importance of the Variables Influencing Financial Reporting Quality Using the Fuzzy Analytic Hierarchy Process. International Journal of Nonlinear Analysis and Applications 2023, 14, 1683–1696. [Google Scholar] [CrossRef]
- Jing, D.; Imeni, M.; Edalatpanah, S.A.; Alburaikan, A.; Khalifa, H.A. Optimal Selection of Stock Portfolios Using Multi-Criteria Decision-Making Methods. Mathematics 2023, 11. [Google Scholar] [CrossRef]
- Mardani, A.; Jusoh, A.; MD Nor, K.; Khalifah, Z.; Zakwan, N.; Valipour, A. Multiple Criteria Decision-Making Techniques and Their Applications – a Review of the Literature from 2000 to 2014. Economic Research-Ekonomska Istraživanja 2015, 28, 516–571. [Google Scholar] [CrossRef]
- Cubukcu, C.; Cantekin, C. Using a Combined Fuzzy-AHP and Topsis Decision Model for Selecting the Best Firewall Alternative. Journal of Fuzzy Extension and Applications 2022, 3, 192–200. [Google Scholar] [CrossRef]
- Duc, D.A.; Hang, D.T.; Tam, P.M.; Hue, T.T.; Van Loi, T.; Lien, L.T.; Dat, L.Q. Lecturers’ Research Capacity Assessment Using an Extension of Generalized Fuzzy Multi-Criteria Decision-Making Approach. International Journal of Fuzzy Systems 2020, 22, 2652–2663. [Google Scholar] [CrossRef]
- El-Morsy, S. Stock Portfolio Optimization Using Pythagorean Fuzzy Numbers. Journal of Operational and Strategic Analytics 2023, 1, 8–13. [Google Scholar] [CrossRef]
- Mingers, J. Soft OR Comes of Age—but Not Everywhere! Omega (Westport) 2011, 39, 729–741. [Google Scholar] [CrossRef]
- Ebrahimi, E.; Fathi, M.R.; Sobhani, S.M. A Modification of Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) through Fuzzy Similarity Method (A Numerical Example of the Personnel Selection). Journal of Applied Research on Industrial Engineering 2022. [Google Scholar] [CrossRef]
- Dhurkari, R.K. MCDM Methods: Practical Difficulties and Future Directions for Improvement. RAIRO - Operations Research 2022, 56, 2221–2233. [Google Scholar] [CrossRef]
- Cock, J.; Jiménez, D.; Dorado, H.; Oberthür, T. Operations Research and Machine Learning to Manage Risk and Optimize Production Practices in Agriculture: Good and Bad Experience. Curr Opin Environ Sustain 2023, 62, 101278. [Google Scholar] [CrossRef]
- Leong, C.; Howlett, M. Soft OR as a Response to Inherent Vices: Problem Structuring to Offset Policy Volatility. EURO Journal on Decision Processes 2022, 10, 100019. [Google Scholar] [CrossRef]
- Yearworth, M. Problem Structuring in OR Practice. In Proceedings of the Paper presented at the 64 th Annual Conference of the OR Society (OR64); Warwick, UK; 2022. [Google Scholar]
- Yearworth, M.; White, L. The Construction of Wicked Problems. In Proceedings of the 22nd Conference of the International Federation of Operational Research Societies (IFORS 2021); Seoul, Korea; 2021. [Google Scholar]
- Gomes Júnior, A. de A.; Schramm, V.B.; Schramm, F. Problem Structuring Methods in Social-Ecological Systems. Syst Pract Action Res 2022. [Google Scholar] [CrossRef]
- Laouris, Y.; Romm, N.R.A. Structured Dialogical Design as a Problem Structuring Method Illustrated in a Re-Invent Democracy Project. Eur J Oper Res 2022, 301, 1072–1087. [Google Scholar] [CrossRef]
- Venugopal, R.; Veeramani, C.; Edalatpanah, S.A. Analysis of Fuzzy DEMATEL Approach for Financial Ratio Performance Evaluation of NASDAQ Exchange. In; 2022; pp. 637–648.
- Ocampo, L.A.; Himang, C.M.; Kumar, A.; Brezocnik, M. A Novel Multiple Criteria Decision-Making Approach Based on Fuzzy DEMATEL, Fuzzy ANP and Fuzzy AHP for Mapping Collection and Distribution Centers in Reverse Logistics. Advances in Production Engineering & Management 2019, 14, 297–322. [Google Scholar] [CrossRef]
- Sarkar, M.R.; Masud, S.R.; Hossen, M.I.; Goh, M. A Comprehensive Study on the Emerging Effect of Artificial Intelligence in Agriculture Automation. In Proceedings of the 2022 IEEE 18th International Colloquium on Signal Processing and Applications, CSPA 2022 - Proceeding; 2022; pp. 419–424. [Google Scholar]
- Li, Y.; Liang, C.; Ye, F.; Zhao, X. Designing Government Subsidy Schemes to Promote the Electric Vehicle Industry: A System Dynamics Model Perspective. Transp Res Part A Policy Pract 2023, 167, 103558. [Google Scholar] [CrossRef]
- Sadeghi, M.E.; Nozari, H.; Khajezadeh Dezfoli, H.; Khajezadeh, M. Ranking of Different of Investment Risk in High-Tech Projects Using TOPSIS Method in Fuzzy Environment Based on Linguistic Variables. Journal of Fuzzy Extension and Applications 2021, 2, 226–238. [Google Scholar] [CrossRef]
- Duran, V.; Topal, S.; Smarandache, F. An Application of Neutrosophic Logic in the Confirmatory Data Analysis of the Satisfaction with Life Scale. Journal of Fuzzy Extension and Applications 2021, 2, 262–282. [Google Scholar] [CrossRef]
- Tayal, D.K.; Yadav, S.K.; Arora, D. Personalized Ranking of Products Using Aspect-Based Sentiment Analysis and Plithogenic Sets. Multimed Tools Appl 2023, 82, 1261–1287. [Google Scholar] [CrossRef]




| Sub-Problems | Effectiveness | Time Consumption | Ease of Implementation | Financial Burden |
|---|---|---|---|---|
| Students’ low motivation | 7 | 1 | 9 | 9 |
| Professors’ low motivation | 8 | 3 | 7 | 9 |
| Theory-based training | 9 | 5 | 7 | 8 |
| Retaining qualified personnel | 7 | 6 | 6 | 5 |
| Insufficient equipment | 8 | 5 | 5 | 7 |
| Uncollaborative management | 2 | 6 | 6 | 3 |
| Low-efficiency units | 3 | 8 | 3 | 6 |
| Internal advertising | 3 | 9 | 2 | 4 |
| External advertising | 8 | 8 | 4 | 5 |
| Sub-Problems | Ci | Ranks |
|---|---|---|
| Students’ low motivation | 7 | 7 |
| Professors’ low motivation | 8 | 5 |
| Theory-based training | 9 | 6 |
| Retaining qualified personnel | 7 | 8 |
| Insufficient equipment | 8 | 3 |
| Uncollaborative management | 2 | 9 |
| Low-efficiency units | 3 | 1 |
| Internal advertising | 3 | 2 |
| External advertising | 8 | 4 |
| Units | Input 1 | Input 2 | Output 1 | Output 2 | Output 3 |
|---|---|---|---|---|---|
| 1 | 0/500 | 0/900 | 0/889 | 0/185 | 1/000 |
| 2 | 0/143 | 0/500 | 0/667 | 0/282 | 1/000 |
| 3 | 0/050 | 0/700 | 0/333 | 0/580 | 0/500 |
| 4 | 1/000 | 1/000 | 1/000 | 0/185 | 1/000 |
| 5 | 0/111 | 0/600 | 0/556 | 0/321 | 1/000 |
| 6 | 0/125 | 0/700 | 0/778 | 0/496 | 0/500 |
| 7 | 0/043 | 0/400 | 0/333 | 1/000 | 0/333 |
| 8 | 0/083 | 0/600 | 0/444 | 0/461 | 0/500 |
| 9 | 0/143 | 0/500 | 0/444 | 0/241 | 1/000 |
| 10 | 0/091 | 0/400 | 0/333 | 0/282 | 1/000 |
| 11 | 0/083 | 0/800 | 0/667 | 0/539 | 0/500 |
| 12 | 0/050 | 0/800 | 0/556 | 0/901 | 0/333 |
| 13 | 0/059 | 0/400 | 0/444 | 0/509 | 0/500 |
| 14 | 0/500 | 0/800 | 1/000 | 0/259 | 1/000 |
| 15 | 0/100 | 0/600 | 0/444 | 0/262 | 1/000 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).