The subsequent sections elaborate on the study’s methodology to provide a clear understanding of the sustainability education research.
6.1. Study Participants and Procedure
The sample for the study is purposive and convenience-based, consisting of pre-service teachers aged 19 to 24 years, enrolled in the Elementary Education program at the Faculty of Education of one of the Slovenian universities. The selection of a sample of young future teachers is of crucial importance for understanding the impact of advanced technologies in education about sustainability. Their unique role as mediators of knowledge and influencers on future generations makes their perspectives and experiences extremely important for research and development of sustainable educational strategies. Understanding how these technologies affect their awareness and readiness to lead sustainable initiatives is essential for designing effective approaches to empower youth for a sustainable future. The study engaged 112 participants, with 95 actively exploring sustainable practices, while 17 participants withdrew, citing either a lack of interest in sustainability or resistance to integrating new technologies in education.
The quasi-experimental study [
12] was grounded in the integration of new technologies in research-based learning on the topic of sustainability. Both qualitative and quantitative research methods were employed based on the results. Prior to the intervention, participants individually responded to an open-ended question:
“How can I contribute to improving environmental sustainability?”. This was followed by group work, where participants explored the research question in six different ways, while the control group did not explore the topic.
Participants were divided into seven groups within the study program, each group comprising approximately an equal number of individuals. Within these groups, participants were further randomly assigned into pairs or trios, based on their method of researching the theme of sustainability. Participants were limited to 15 minutes to explore the topic. For clarity, the breakdown of tasks and groups is presented in the form of a table (
Table 1).
This study leverages the AlphaMini robot, integrated with OpenAI’s ChatGPT, as a cutting-edge tool for sustainability education. The AlphaMini, known for its humanoid design and capability to engage in complex interactions, was enhanced with four key AI models to facilitate a seamless educational experience in the Slovenian language. These models include speech synthesis, speech recognition, a chatbot interface for ChatGPT integration, and voice activity detection. Each component plays a crucial role in enabling the robot to understand and communicate effectively with users, thereby making sustainability education more interactive and engaging. The speech synthesis model allows the AlphaMini to articulate responses in clear, natural Slovenian, making the educational content accessible and understandable. Concurrently, the speech recognition model enables the robot to accurately interpret spoken Slovenian, ensuring a smooth two-way communication flow. These models are foundational for creating an interactive learning environment where participants can freely converse with the robot about sustainability topics. By integrating the chatbot functionality with ChatGPT, the AlphaMini was equipped to engage in detailed discussions about sustainable energy. This setup allowed the robot to access a vast repository of information on sustainability, which it could then communicate in an educational context. The integration facilitates dynamic, informative conversations, where learners can ask complex questions and receive knowledgeable answers that foster a deeper understanding of sustainability. The voice activity detection model is crucial for the robot to identify when a participant is speaking, allowing for more natural and responsive interactions. This technology ensures that the AlphaMini can recognize speech inputs accurately, minimizing errors and enhancing the overall user experience. The customization of the AlphaMini with these AI models enabled it to function as an effective educational tool, particularly in the context of sustainability education. The robot’s ability to understand and speak Slovenian opened up new possibilities for engaging young learners in discussions about sustainable energy practices. Through interactive dialogues, the AlphaMini could convey complex concepts in an accessible manner, encouraging learners to think critically about their environmental impact and the importance of sustainable practices. This innovative educational approach underscores the potential of integrating advanced technologies, like ChatGPT with humanoid robots, to foster engaging, informative, and impactful learning experiences. By leveraging the AlphaMini robot and custom AI technologies, this study offers insights into using technology to promote sustainable energy awareness among young learners.
After completing the research phase, where participants employed various methods to study the theme of sustainability, they were asked to respond again to the initial question: “How can I contribute to improving environmental sustainability?”. This repeated reflection was crucial for assessing how different research methods effected the participants’ understanding and perception of sustainable practices. Analyzing the responses provided insight into how educational strategies and the use of various tools contribute to the development of knowledge and awareness of environmental issues. Additionally, it enabled the evaluation of the effectiveness of new technologies methods in promoting critical thinking and active engagement of participants in the topic of sustainability.
During the research process, four researchers conducted systematic observations to assess the role of 21 competences, defined by [
46] in the Digital Competence Framework for Citizens. The DigCompEdu model has already proven to be useful for the scientific analysis of digital competencies [
11]. These observations took place in an educational setting where participants worked with various advanced and traditional learning methods. The researchers utilized qualitative observation techniques and note-taking to document the interactions of participants with educational tools. A particular focus was placed on observing if and how individual employed basic knowledge, skills and attitudes according to DigiComp 2.2. The process of researchers’ observation involved a thorough analysis of the observations and recorded notes, enabling the researchers to assess which specific competences participants utilized in their work. The findings from these observations were then systematized and quantified in the form of table showing a cross-section of all skills identified by all participating researchers, showcasing the usage of different types of knowledges, skills and attitudes according to the chosen learning or teaching methods. The table includes a detailed analysis of the application of individual competences across various modes of work. In addition to observing which competencies participants developed, the study also focused on the extent to which these identified competencies were represented. The competencies according to the DigComp 2.2 framework encompass elements that can be fully developed in digital environments. However, certain knowledge, skills, and attitudes can also be partly cultivated in analog learning environments. In such cases, the competencies are not referred to as defined by DigComp 2.2, but rather to basic or foundational knowledge skills, and attitudes. These foundational elements, although not specifically digital, lay the groundwork for the further development towards fully-fledged digital competencies. Understanding and developing these fundamental elements is crucial for bridging the gap between analog and digital learning, thus facilitating a more holistic and balanced educational experience.
6.2. Measures
In line with the main goal of the research, a written method was used for data collection, where participants responded to a pre-prepared question on a paper, both before and after the intervention. The collected responses were then analyzed to understand the effect of various technological approaches and traditional methods on the sustainability practices and awareness of young people and to examine the effects of different methods on the variability of participants’ responses.
The responses received were classified within the following categories:
Carbon footprint reduction (use of public transport, walking, cycling, reducing car usage, use of electric vehicles).
Sustainable usage and recycling (recycling of waste, use of products for multiple uses, reducing plastic usage, buying second-hand clothes).
Resource conservation (saving water and electricity, turning off lights, closing water during tooth brushing).
Sustainable food and agriculture (buying locally produced food, growing own food, using natural fertilizers, reducing meat consumption).
Awareness and education (educating others about sustainability, training on sustainability topics, participating in cleaning actions, supporting sustainable organizations).
Energy efficiency and renewable sources (using renewable energy sources, energy-efficient devices, digitalization to reduce paper usage).
Sustainable waste management (composting, proper waste segregation, reducing food waste).
Once categorized, responses were analyzed to determine common themes and variances in participants’ understanding of sustainability. This analysis was instrumental in identifying the effect of different learning methods on participants’ perceptions and knowledge.
Through a process of observation, the researchers identified new literacies, knowledge, skills and attitudes are essential to successfully utilize contemporary technologies in contributing to environmental sustainability and shaping a sustainable future. The observed knowledge, skills and attitudes are identified in
Table 2 based on the definition of [
46].
The study assessed both comprehensive competencies developed in digital environments as per the DigComp 2.2 framework and fundamental knowledge, skills and attitudes cultivated in analog settings, laying the groundwork for a nuanced understanding of educational measures in both digital and analog learning contexts. Accordingly, the study introduced two distinct measures, with ‘fundamental’ covering fundamental knowledge, skills, and attitudes developed in analog learning environments and ‘comprehensive’ focusing on specific digital competencies outlined in the DigComp 2.2 framework [
46].
6.3. Data Analysis
Responses were gathered immediately before and after the intervention to assess the change in participants’ perspectives. Each response was anonymized and logged into a secure database for analysis. Is was ensured that the anonymity of responses was maintained throughout the study to uphold ethical standards and participant confidentiality. Prior to the analysis, the obtained responses were reviewed and, where necessary, further anonymized, thereby maintaining the integrity and confidentiality of the collected information. The responses were organized according to the research method employed by each group. Subsequently, the responses were categorized into different categories based on the given answers. This process of qualitative coding involved assigning individual text segments to relevant categories, which facilitated the identification of patterns and themes. The data were quantified, providing a statistical foundation for the findings.
To compare differences in pre- and post-test results based on the participants’ work methods, a repeated measures ANOVA was used due to its suitability for comparing the same participants across different conditions over time. This was crucial to understand how participants’ perceptions evolved pre- and post-intervention. In the analysis of within-subject effects, the Greenhouse-Geisser correction was used to adjust degrees of freedom in the F-test. This was a crucial adjustment to account for potential violations of sphericity in the repeated measures ANOVA, thereby assuring the accuracy of p-values and the reliability of conclusions. The Bonferroni test was chosen for its conservative nature in correcting for multiple comparisons, thereby reducing the likelihood of false positive findings.
To discern specific differences among various research methods following the ANOVA, a post-hoc Tukey HSD (Honestly Significant Difference) test was used for pairwise comparisons between groups when ANOVA indicated significant differences. It was used to control the Type I error rate across multiple comparisons. The Tukey HSD test provided mean differences, standard errors, significance levels, and 95% confidence intervals for each pair of research methods. This approach was crucial in identifying statistically significant differences between specific pairs of research methods, ensuring the conclusions drawn from these comparisons were statistically sound.
Building on the systematic observations conducted by the researchers, the subsequent data analysis process was meticulously structured to ensure the integrity and validity of the findings. Following the completion of the observation phase, the researchers embarked on a comprehensive coding procedure. This involved categorizing the data based on the key components of digital competence (
Table 2). The coding process was guided by predefined criteria aimed at identifying distinct patterns of components of digital competence use among the participants. A thematic analysis was conducted on the coded data to extract meaningful insights. This allowed for the identification of prevalent trends and unique instances of literacy usage, providing a nuanced understanding of how different literacies were applied in various educational contexts. The quantification of these findings was carefully executed to maintain statistical rigor. Frequency analysis was used to determine the prevalence of each literacy type across different learning methods, and cross-tabulation helped in understanding the relationships between observed knowledge, skills, and attitudes. The final step involved the synthesis of these quantitative insights into a comprehensive table, which effectively illustrates the spectrum of observed components of digital competence in diverse educational settings. This table serves as a visual representation of the complex interplay between advanced teaching tools and the development of new literacies among youth, thus contributing valuable empirical evidence to the field of educational technology and sustainability education.