Submitted:
13 May 2025
Posted:
15 May 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
- RQ1: How can a Living Lab-based educational model be systematically developed and implemented to effectively integrate collaborative problem-solving, computational thinking, and collaborative communication within elementary informatics education for sustainable community engagement?
- RQ2: What methodologies accurately evaluate the effectiveness of the Living Lab-based educational model in enhancing elementary students’ collaborative problem-solving, computational thinking, and collaborative communication competencies?
2. Literature Review
2.1. Integrating CPS, CC, and CT
2.2. Limitations of Existing Educational Approaches
2.3. Theoretical Foundations of the Living Lab-based Collaborative Problem-Solving Educational Model
3. Materials and Methods
3.1. Competency Classification through Natural Language Processing
3.2. Building Living Lab-based Collaborative Problem-Solving educational model
3.2.1. Designing Educational Activities Based on Factor Analysis of CPS, CC, and CT
3.2.2. Refining the Living Lab Model through Educational Community Design
3.3. Final Living Lab Framework and Evaluation Methodology
3.4. Research Participants and Sample Selection
4. Results
4.1. Pre- and Post-Test Comparisons within Control and Experimental Groups
4.2. Multiple Regression Analysis
5. Discussion
5.1. Interpretation of Findings
5.2. Theoretical Implications
5.3. Practical Implications
5.4. Policy Implications
5.5. Future Research Directions
6. Conclusions
Appendix A
| Competency | Variable | M | SD | Skewness | Kurtosis |
|---|---|---|---|---|---|
| CPS | Establishing collaborative methods | 3.43 | 0.96 | -0.35 | -0.39 |
| Applying problem-solving strategies | 3.48 | 0.85 | 0.15 | -0.86 | |
| Fair participation and feedback | 3.54 | 0.88 | 0.16 | -1.38 | |
| ICT usage | 3.43 | 0.86 | 0.11 | -0.66 | |
| CC | Information gathering | 3.49 | 0.95 | -0.02 | -1.16 |
| Listening | 3.35 | 0.96 | 0.13 | -0.91 | |
| Creative communication | 3.34 | 1.06 | -0.22 | -0.84 | |
| Understanding others’ perspectives | 3.44 | 0.89 | 0.06 | -0.74 | |
| CT | Problem comprehension | 3.49 | 0.94 | -0.51 | 0.03 |
| Abstraction | 3.43 | 0.91 | -0.01 | -0.60 | |
| Algorithmic procedures | 3.37 | 0.99 | 0.04 | -0.97 | |
| Automation | 3.49 | 0.92 | 0.03 | -0.82 |
Appendix B
| Design Principle | Description |
|---|---|
| Observation | Students explore their school or community, identifying areas for improvement [43]. They select a specific issue to investigate [44]. Learners determine the types of data needed to address their chosen problem [45]. They collect and measure relevant information, including opinions from peers or community members [46]. |
| Recognizing Patterns | By analyzing collected data, students identify emerging pattern, test initial hypotheses, and predict possible trends [47]. Students examine how identified patterns relate to their selected problem [48,49]. They visually map connections between patterns and viable solutions. |
| Forming Patterns | Learners reflect on the significance of collected data, documenting insights and refining problem definitions [47,50]. Students generate diverse ideas to solve the issue recording multiple possibilities and evaluating their feasibility [51]. |
| Abstraction | Small-group discussions allow learners to merge overlapping concepts and refine solutions [52]. Feedback loops ensure iterative improvements. Students focus on essential components of the problem [53,54]. They design simplified algorithms to capture key solution principles [55,56]. |
| Expressing through Play | Learners use creative play to represent problem states and transitions [57,58]. Algorithmic thinking is applied to plan sequential steps toward a solution. Students form specialized teams based on IT applications [16], identifying areas where additional knowledge is required. |
| Implementation | With teacher guidance, learners create an expert map, identifying professionals who can provide insights. Through direct communication or virtual meetings, students collaborate with specialists to refine their project ideas [59,60]. |
| Evaluation | Students assess whether their proposed solution effectively addresses the problem [61,62]. Feedback is collected from peers, teachers, and community stakeholders [63,64]. Learners examine broader ethical and societal considerations related to IT. Findings are synthesized into presentations highlighting computational solutions and social responsibilities [65,66]. |
References
- Schwab, K. The Fourth Industrial Revolution; Crown Currency, New York: 2017.
- Brynjolfsson, E., McAfee, A. The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies. W. W. Norton & Co, New York, NY, USA: 2014 pp. 306. 978-0-393-23935-5.
- Shenkoya, T. , Kim, E. Sustainability in Higher Education: Digital Transformation of the Fourth Industrial Revolution and Its Impact on Open Knowledge. Sustainability 2023, 15, 2473. [Google Scholar] [CrossRef]
- Leopold, T.A., Ratcheva, V.S., Zahidi, S. The Future of Jobs Report 2018: Insight Report Centre for the New Economy and Society. Technical report, World Economic Forum. 2018. 978-1-944835-18-7.
- Di Battista, A., Grayling, S., Hasselaar, E., Leopold, T., & Li, R., Rayner, M., Zahidi, S. The Future of Jobs Report 2023. World Economic Forum. 2023. 978-2-940631-96-4.
- Al-Dokhny, A. , Alismaiel, O., Youssif, S., Nasr, N., & Drwish, A., Samir, A. Can Multimodal Large Language Models Enhance Performance Benefits Among Higher Education Students? An Investigation Based on the Task–Technology Fit Theory and the Artificial Intelligence Device Use Acceptance Model. Sustainability 2024, 16, 10780. [Google Scholar] [CrossRef]
- Fei, N. , Lu, Z., Gao, Y. Towards artificial general intelligence via a multimodal foundation model. Nat Commun 2022, 13, 3094. [Google Scholar] [CrossRef]
- MoE. The National Framework for the Elementary and Secondary Curriculum. Technical report, Ministry of Education. 2022.
- Seong, J.E. , Jeong, S.H., Han, K.Y. Analysis of Living Lab Cases in R&D Initiatives for Solving Societal Problems and Challenges. Journal of Science and Technology Studies. [CrossRef]
- Seong, J. , Han, K., Song, W., Kim, M. Current Status and Tasks of Campus Living Labs as a New Model for Innovation. The Journal of Social Science. [CrossRef]
- Chapagain, M.R.; Mikkelsen, B.E. Is a Living Lab Also a Learning Lab?—Exploring Co-Creational Power of Young People in a Local Community Food Context. Youth 2023, 3, pp–753. [Google Scholar] [CrossRef]
- OECD PISA 2015 Collaborative Problem-Solving Framework. OECD Publishing, Paris: 2017. [CrossRef]
- Fiore, S., Graesser, A., Greiff, S., Griffin, P., Gong, B., Kyllonen, P., Massey, C., O’Neil, H., Pellegrino, J., Rothman, R., Soulé, H., von Davier, A. Collaborative Problem Solving: Considerations for the National Assessment of Educational Progress. National Center for Education Statistics, Alexandria, VA: 2017.
- Tongal, A. , Yıldırım, F.S., Özkara, Y., Say, S., Erdoğan, Ş. Examining Teachers’ Computational Thinking Skills, Collaborative Learning, and Creativity Within the Framework of Sustainable Education. Sustainability 2024, 16, 9839. [Google Scholar] [CrossRef]
- McComb, S. , Kennedy, D. Team Communication in Theory and Practice. In: McComb, S., Kennedy, D. (Eds.), Computational Methods to Examine Team Communication: When and How to Change the Conversation. Springer International Publishing, Cham: Switzerland, 2020; pp. 1–16. [CrossRef]
- Johnson, D.W., Johnson, R.T. Learning Together and Alone: Cooperative, Competitive, and Individualistic Learning. Allyn and Bacon: 1999. 978-0-205-28771-0.
- Wing, J.M. Computational Thinking. Communications of the ACM. [CrossRef]
- Grover, S. , Pea, R. Computational Thinking in K–12: A Review of the State of the Field. Educational Researcher. [CrossRef]
- Grover, S. , Pea, R. Computational Thinking: A Competency Whose Time Has Come. Computer Science Education: Perspectives on Teaching and Learning in School. [CrossRef]
- Lee, I. , Martin, F., & Denner, J., Coulter, B., Allan, W., Erickson, J., & Malyn-Smith, J., Werner, L. Computational Thinking for Youth in Practice. ACM Inroads. [CrossRef]
- Seong, J.E. , Jeong, S.H., Han, K.Y. Analysis of Living Lab Cases in R&D Initiatives for Solving Societal Problems and Challenges. Journal of Science and Technology Studies. [CrossRef]
- Lozano, A. , López, R., Pereira, F.J., Blanco Fontao, C. Impact of Cooperative Learning and Project-Based Learning through Emotional Intelligence: A Comparison of Methodologies for Implementing SDGs. Int. J. Environ. Res. Public Health 2022, 19, 16977. [Google Scholar] [CrossRef] [PubMed]
- Seong, J. , Han, K., Song, W., Kim, M. Current Status and Tasks of Campus Living Labs as a New Model for Innovation. The Journal of Social Science. [CrossRef]
- He, Z. , Wu, X., Wang, Q., Huang, C. Developing Eighth-Grade Students’ Computational Thinking with Critical Reflection. Sustainability 2021, 13, 11192. [Google Scholar] [CrossRef]
- Peng, J. , Yuan, B., Sun, M., Jiang, M., & Wang, M. Computer-Based Scaffolding for Sustainable Project-Based Learning: Impact on High- and Low-Achieving Students. Sustainability 2022, 14, 12907. [Google Scholar] [CrossRef]
- Zhai, X. , Chu, X., Chai, C.S., Jong, M.S.Y., Istenic, A., Spector, M., Liu, J.-B., & Yuan, J., Li, Y. A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity 2021, 2021, 8812542. [Google Scholar] [CrossRef]
- Lakatos, E.S. Pacurariu, R.L. Bîrgovan, A.L. Cioca, L.I. Szilagy, A.; Moldovan, A.; Rada, E.C. A Systematic Review of Living Labs in the Context of Sustainable Development with a Focus on Bioeconomy. Earth 2024, 5, 812–843. [Google Scholar] [CrossRef]
- ROGERS, Steven, et al. Experiential and authentic learning in a Living Lab: the role of a campus-based Living Lab as a teaching and learning environment. Journal of Learning Development in Higher Education 2023, 28. [Google Scholar] [CrossRef]
- Leminen, S. , Westerlund, M., Nyström, A. G. Living Labs as Open-Innovation Networks: A New Approach to Innovation Management. Technol. Innov. Manag. Rev. [CrossRef]
- Son, J. , Kim, T. Competency Analysis of Elementary Interdisciplinary Informatics Education Focused on Improving Collaborative Problem Solving Ability for the 2022 Revised Educational Curriculum. The Journal of Korean Association of Computer Education. [CrossRef]
- Huang, A. Similarity measures for text document clustering. InProceedings of the sixth new zealand computer science research student conference (NZCSRSC2008), Christchurch, New Zealand; 2008. 4. pp. 9-56.
- Chowdhury, Gobinda G. Introduction to modern information retrieval. Facet publishing: 2010.
- Singhal, Amit. Modern information retrieval: A brief overview. IEEE Data Eng. Bull. 2001, 24(4), pp. 35-43.
- Denzin, N.K. The Research Act: A Theoretical Introduction to Sociological Methods (1st ed.). Routledge: 2009. [CrossRef]
- Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncol Nurs Forum. [CrossRef]
- Heale R, Forbes D. Understanding triangulation in research. Evid Based Nurs. 16(4), 98. [CrossRef]
- OECD. PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving. OECD Publishing: 2017. 978-92-64-28182-0.
- Sung, J. Assessing young Korean children’s computational thinking: A validation study of two measurements. Educ Inf Technol 2022, 27, pp–12969. [Google Scholar] [CrossRef]
- Novıana, Ayu, et al. Development and validation of collaboration and communication skills assessment instruments based on project-based learning. Journal of Gifted Education and Creativity. [CrossRef]
- Ryō, Y, Komyunitī, D. The Age of Community Design. Chūkō Shinsho: Tokyo: 2012. 978-89-70-59653-2.
- Delbecq, Andre L., Andrew H. Van de Ven. A group process model for problem identification and program planning. The journal of applied behavioral science. [CrossRef]
- Ahrens,A. , Zascerinska, J.Principles of Sampling in Educational Research in Higher Education. Society, Integration, Education: Proceedings of the International Scientific Conference 2015, 1, 25–35. [Google Scholar] [CrossRef]
- Yin, R.K. Case Study Research and Applications: Design and Methods. SAGE Publications: 2017. 978-15-06-33618-3.
- Glover, A. , Stewart, S. Using a Blended Distance Pedagogy in Teacher Education to Address Challenges in Teacher Recruitment. Teaching Education. [CrossRef]
- Creswell, J.W., Plano Clark, V.L. Designing and Conducting Mixed Methods Research. SAGE Publications: 2017. 978-14-83-34698-4.
- Mariani, M.M. , Machado, I., Magrelli, V., Dwivedi, Y.K. Artificial Intelligence in Innovation Research: A Systematic Review, Conceptual Framework, and Future Research Directions. Technovation 2023, 122, 102623. [Google Scholar] [CrossRef]
- Wing, J.M. Computational Thinking. Communications of the ACM. [CrossRef]
- Jonassen, D. Learning to Solve Problems: A Handbook for Designing Problem-Solving Learning Environments. Learning to Solve Problems: A Handbook for Designing Problem-Solving Learning Environments 2010, 1, 1–437. [Google Scholar] [CrossRef]
- Council, N.R. Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century. The National Academies Press, Washington, DC: 2012. [CrossRef]
- Engler, J. O. , Abson, D. J., von Wehrden, H. Navigating cognition biases in the search of sustainability. Ambio 2019, 48, 605–618. [Google Scholar] [CrossRef]
- Daniel, M.-F. , Belghiti, K., Auriac Slusarczyk, E. Philosophy for Children and the Incidence of Teachers’ Questions on the Mobilization of Dialogical Critical Thinking in Pupils. Creative Education 2017, 8, pp–870. [Google Scholar] [CrossRef]
- Schwartz, D.L. , Bransford, J. A Time for Telling. Cognition and Instruction 1998, 16, 475–522. [Google Scholar] [CrossRef]
- Wing, J.M. Computational Thinking and Thinking about Computing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 2008, 366, 3717–3725. [Google Scholar] [CrossRef]
- Brandt, E. , Foverskov, M. Rehearsing and Performing in Design and Living Labs: Situated, Relational, and Embodied Participatory Design Roles in Partnerships. In: Proceedings of the Participatory Design Conference. ACM, New York, NY, USA, 2024. pp. 98–111. [CrossRef]
- Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C. Introduction to Algorithms. MIT Press: 2022 978-02-62-04630-5.
- Di Eugenio, B. , Fossati, D., Green, N. Intelligent Support for Computer Science Education: Pedagogy Enhanced by Artificial Intelligence, 2022. [Google Scholar] [CrossRef]
- Root-Bernstein, R. Arts and crafts as adjuncts to STEM education to foster creativity in gifted and talented students. Asia Pacific Education Review 2015, 16, 203–212. [Google Scholar] [CrossRef]
- Behnamnia, N. , Kamsin, A., Ismail, M.A.B., Hayati, A. The Effective Components of Creativity in Digital Game-Based Learning Among Young Children: A Case Study. Children and Youth Services Review 2020, 116. [Google Scholar] [CrossRef]
- Normore, A, Mitch J, Larry L, eds. Handbook of Research on Strategic Communication, Leadership, and Conflict Management in Modern Organizations, 2019. [CrossRef]
- Resta, P. , Laferrière, T. Technology in Support of Collaborative Learning. Educational Psychology Review. [CrossRef]
- Black, P. ,Wiliam, D. Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice. [CrossRef]
- Boud, D. , Cohen, R., Sampson, J. Peer Learning and Assessment. Assessment and Evaluation in Higher Education. [CrossRef]
- Webb, Mary E. Challenges for IT-enabled formative assessment of complex 21st century skills. Technology, knowledge and learning 2018, 23, 441–456. [Google Scholar] [CrossRef]
- Fishman, B. , Dede, C.,& Means, B. Teaching and technology: New tools for new times. Handbook of research on teaching 2016, 5, 1269–1334. [Google Scholar] [CrossRef]
- Dewey, J. Experience and education. In The educational forum 1986, September 50(3). pp. 241-252. Taylor & Francis Group. [CrossRef]
- Acar, S. , Dumas, D., Organisciak, P., Berthiaume, K. Measuring original thinking in elementary school: Development and validation of a computational psychometric approach. Journal of Educational Psychology. [CrossRef]





| Stage | Description |
|---|---|
| Text Preprocessing | Tokenization: Divide the text into words, phrases, etc. |
| Lemmatization: Convert words to their base or root form. | |
| Stopword Removal: Remove common words not essential for understanding the context. | |
| Feature Extraction | Vectorization: Transform text into vector models by evaluating word importance. |
| Semantic Similarity Measurement | Cosine Similarity Measurement: Measure cosine of angles between vectors in multidimensional space. |
| Clustering | Hierarchical Clustering: Build hierarchical clusters. |
| Mapping to Definitions | Remapping to Competencies: Remap clusters based on similarity scores. |
| Expert Review | Two experts reviewed and validated competency mappings. |
| Element | Description |
|---|---|
| Participation | Participant opinions are integrated, with active involvement in executing plans through formal democratic decision-making processes, enhancing participant accountability. |
| Empowerment | Members proactively express their views and formulate alternatives on critical decisions that directly or indirectly impact their futures. |
| Resource Practical Use | Effective use of human, natural, cultural, and social resources to vitalize the community and increase the value of local assets. |
| Network | Effective exchange and distribution of resources and information among experts, administration, local communities, and schools, enhancing community dynamism and facilitating the realization of ideal plans through synergy. |
| Sustainability | Emphasis on social, economic, environmental, and cultural sustainability to ensure long-term community development. |
| Competency | Factor | Grp. | Pre-test Mean | Post-test Mean | p-value |
|---|---|---|---|---|---|
| CPS | Factor 1 | Control | 3.30 | 3.44 | .268 |
| Exp. | 3.54 | 3.69 | .229 | ||
| Factor 2 | Control | 3.41 | 3.45 | .703 | |
| Exp. | 3.44 | 3.93 | <.001*** | ||
| Factor 3 | Control | 3.54 | 3.65 | .343 | |
| Exp. | 3.52 | 3.87 | .020* | ||
| Factor 4 | Control | 3.45 | 3.86 | .012* | |
| Exp. | 3.40 | 3.82 | .002** | ||
| CC | Factor 5 | Control | 3.55 | 3.86 | .029* |
| Exp. | 3.45 | 3.76 | .055 | ||
| Factor 6 | Control | 3.32 | 3.47 | .184 | |
| Exp. | 3.43 | 3.89 | .001*** | ||
| Factor 7 | Control | 3.32 | 3.54 | .091 | |
| Exp. | 3.31 | 3.81 | .006** | ||
| Factor 8 | Control | 3.51 | 3.58 | .525 | |
| Exp. | 3.31 | 3.67 | .018* | ||
| CT | Factor 9 | Control | 3.40 | 3.50 | .364 |
| Exp. | 3.41 | 3.82 | .005** | ||
| Factor 10 | Control | 3.46 | 3.67 | .113 | |
| Exp. | 3.52 | 3.78 | .058 | ||
| Factor 11 | Control | 3.28 | 3.49 | .039* | |
| Exp. | 3.49 | 3.77 | .026* | ||
| Factor 12 | Control | 3.55 | 3.63 | .571 | |
| Exp. | 3.37 | 3.78 | .001*** |
| Dep. Var.a | Predictor | p-value | ||
|---|---|---|---|---|
| Collab. methods | Problem comprehension | .208 | .021* | .431 |
| Creative communication | .187 | .013* | ||
| Automation | .200 | .012* | ||
| Understanding others’ perspectives | .160 | .031* | ||
| PS application | Problem comprehension | .080 | < .001*** | .462 |
| Automation | .073 | .009** | ||
| Participation and feedback | Problem comprehension | .216 | .024* | .352 |
| Abstraction | .165 | .033* | ||
| Listening skills | .153 | .049* | ||
| ICT usage | Problem comprehension | .355 | < .001*** | .427 |
| Information gathering | .215 | .011* | ||
| Abstraction | .151 | .037* |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).