Preprint
Article

This version is not peer-reviewed.

Blended Learning and Flipped Classroom in Higher Engineering Education: Case Study and Students’ Perception in the Post-COVID-19 Period

Submitted:

03 June 2024

Posted:

04 June 2024

You are already at the latest version

Abstract
The period of the COVID-19 pandemic resulted in a rapid development of innovative education methods, in particular using e-learning and remote work tools. The effects of this development are also post-pandemic changes in formal teaching regulations, in particular in higher education, allowing classes and lectures to be carried out with Blended Learning or Flipped Classroom methods. This paper provides information about a case study of implementing ICT technologies with elements of the mentioned methods in one of the subjects at a technical university. The implemented tools and solutions in the field of e-learning and interactivity are presented, along with information regarding their perception by students during two academic years in the post-COVID-19 period. The analysis of results of these information and student evaluations indicates their generally positive approach to such innovations in the educational path, and at the same time shows significant challenges for teachers to increase the attractiveness and effectiveness of the teaching process and the development of practical, technical skills of students.
Keywords: 
;  ;  ;  ;  ;  ;  

1. Introduction

The COVID-19 pandemic period from 2020-2022 presented significant challenges, but it also brought some positive changes in social activities, particularly in work and education [1,2]. Remote work using the internet became possible and even popular in many technical and technological industries. Higher education institutions had to conduct lectures, classes, and laboratories remotely as well. After the first few weeks of adjustment to the new situation in companies and universities, authorities and administrators were forced to act and change their working and teaching approaches. They also made new work tools available to employees and teachers. Over time, these activities evolved into organized and comprehensive support, including quick courses and training [3,4,5]. This is particularly relevant to the fields of study at technical universities, which are in the focus of research and analysis in this paper. In many cases, these new circumstances were perceived as an opportunity to introduce innovations in teaching and to develop new added values related to the skills of using new software and hardware tools both by students and teachers [6,7,8,9]. The author of this paper has experience in implementing interactive elements as part of classes conducted in the Blended Learning (BL) and Flipped Classroom (FC) formulas, as presented in publications [10,11]. Additionally, in [12] he proposed a modified BL method and described a case study on its introduction in the education of building automation engineers at AGH University of Krakow (AGH University), Poland. A new organizational structure for this method was presented in the paper, along with a discussion of tools for active distance learning that were introduced during the COVID-19 lockdown period.
However, since the pandemic has ended, the external factors that previously determined the organization and conduct of remote classes and lectures have disappeared. As a result, the AGH University authorities have reverted to the traditional model of organizing classes in technical fields. This includes requiring teachers to conduct exercises and laboratories in person, with face-to-face (F2F) interaction with students in classrooms. Nevertheless, it is possible to conduct some classes remotely using e-learning, BL, and FC methods. This is particularly applicable to computer-based classes and laboratories that utilize ICT networks as a tool and element of the educational process. Therefore, it is necessary to redefine modern university education, especially in technical fields, and verify the application possibilities of e-learning methods in the hybrid learning framework. The process of evolution should consider the opportunities presented by university regulations, the availability and familiarity with tools and software that support remote and online work and learning, as well as the preparedness and acceptance of new methods and approaches to the educational process both by students and teachers [13,14,15,16].
This paper presents BL and FC elements that the author has permanently implemented as part of lectures and laboratory classes in the hybrid teaching convention for master’s (2nd degree) studies during the last two academic years (2022/2023 and 2023/2024) in the post-COVID-19 period. Moreover, the paper presents the results of surveys conducted among students at the end of the semester of classes in the last two years. The surveys aimed to gather information about students’ perception of innovative teaching methods, particularly in terms of diversity and the use of e-learning elements. The following Section 4 discusses the survey results and students’ responses, analyzing both positive and negative opinions, as well as pros and cons factors related to the implementation of BL and FC methods. The conclusions presented in this paper are a valuable contribution to the ongoing discussion on the development of hybrid education in higher education [16,17,18,19,20]. It is noteworthy that these conclusions are based on a specific case study from a technical university.
The remainder of this paper is organized as follows: Section 2 provides a discussion of related works, indicating application trends of selected BL and FC methods. Then, Section 3 presents the innovative elements of the BL and FC methods implemented by the author, along with a presentation of selected e-learning and interactivity tools. A discussion of the survey results and student feedback regarding the proposed innovative learning elements is provided in Section 4, and then Section 5 presents the conclusions and future works.

3. Materials and Methods

During the COVID-19 pandemic, the author of this paper introduced many different tools and techniques of assigned work, and with them he developed and implemented several innovative approaches to the implementation of teaching classes, both in the form of lectures and laboratory exercises. On their basis, a modified BL approach was proposed, which, together with the first experiences of its implementation, was described in paper [12]. Using the experience gained during the pandemic and the changes in the organization of teaching mentioned in Section 2, which were also introduced at the alma mater AGH University and the Faculty of Electrical Engineering, Automatics, Informatics and Biomedical Engineering, the author decided to continue and further development of innovative teaching paths in a hybrid format, with various interactive elements of BL and FC methods. In particular, these are interactive video materials, tutorials, and webinars, as well as platforms for interactive collaboration of student groups participating in laboratory or design classes, presented in paper [10] at a conference devoted to e-learning in industrial electronics. These methods and tools are now a permanent element of the curriculum and educational path of all subjects taught by the author at the master’s degree studies in Electrical Engineering, specializing in Industrial and Building Automation.
In order to discuss the students’ approach and perception of these changes and innovations, in this paper the author selected one of the subjects titled “Building Automation - Implementation in Smart Networks” in which some techniques of the BL and FC methods were introduced in the organization of lectures and laboratory exercises. Subject taught during master’s studies (2nd degree). It should be noted that, with the consent of the faculty authorities, lectures for this subject are conducted entirely in the form of online meetings, and laboratories are conducted entirely in stationary form - F2F meetings at laboratory with technical stands [72,73].

3.1. Organizational Changes and Tools

The first and principal rule of hybrid teaching organization is to prepare and provide students with a complete course of the subject on the LMS Moodle platform (named UPEL at the AGH University) and to open a dedicated channel on the MS Teams application for the subject. Both tools are available to all AGH University employees and students who use dedicated accounts in the domain agh.edu.pl. The UPEL course provides electronic (PDF files) instructions for 6 laboratory exercises, most of them with additional information materials (articles, users’ guides) or instructional materials in the form of webinars, video tutorials. For all exercises, there are also links to enable students to submit reports in PDF format, with descriptions and laboratory records. A view of aforementioned selected parts of the UPEL course is shown in Figure 1.
Figure 1 also shows a link to the lab class schedule and links to the quiz and colloquium conducted remotely. The mid-semester quiz (colloquium 1) to verify students’ knowledge is organized asynchronously, with a specific time slot for students to take the quiz/test. The hours of availability of the quiz for solving are agreed each time with the course participants. Interestingly, students usually request access during the late afternoon and evening. In contrast, colloquium 2 summarizing at the end of the semester is organized in the formula of a traditional F2F conversation and practical verification of knowledge at laboratory stations, which enables verification of engineering skills and theoretical knowledge in application. Each such conversation is conducted with a group of 3-4 students by two laboratory instructors.
Other parts of the UPEL course are the materials related to the lectures. While the lectures themselves are conducted online synchronously on a dedicated MS Teams channel, lecture presentations (slides in PDF format) are made available to students as part of the UPEL course, along with additional teaching materials, partly also discussed during lecture meetings. This block is called “Supporting materials - instead of bibliography” and they include detailed technical information on various building automation technologies discussed during lectures and laboratory exercises. Figure 2 presents parts of the UPEL course described in the paragraph.
All elements of the UPEL course related to lectures have been designed and implemented to provide maximum support to students in the process of independent learning, studying, and exploring issues presented during online lecture meetings. Therefore, in particular, the supporting materials contain numerous indications, markings, and minor comments to guide the learning process. These are tools supporting the BL method. Moreover, it should be emphasized that all lecture meetings conducted online are, with the consent and approval of students, recorded and made available to course participants in video file format within the MS Teams channel and cloud resources related to the dedicated course channel. In this way, students have a full spectrum of sources of substantive and technical information related to the subject program, enabling them to learn effectively, directed by the teacher.

3.2. Innovative Elements of Classes and Lectures

As mentioned earlier, the positive effects of implementing some tools and solutions from BL and FC teaching methods during the COVID-19 pandemic, observed by the author of this paper and described in publications [10,12], prompted their permanent implementation in the educational path. However, in accordance with the principles of the Kaizen method [74,75,76] and the possibilities of its application in teaching, it was decided to implement two innovative approaches and tools.
The first of them are the previously mentioned instructions for laboratory exercises with interactive elements, as an element of the BL method. In practice, for two exercises, a new element of the instructions was introduced - a reference to company technical online tutorials, with instructions on programming selected functions of building automation modules. Moreover, tutorials are provided originally in English, directly from the company’s website. As a result, completing the next steps in the exercises required reading a short instructional video and using it to enter appropriate settings and operating parameters for devices at laboratory stands. The educational goal of this approach is to develop students’ skills in critical and creative use of publicly available training materials, technical tutorials, in the implementation of programming procedures and integration of building automation functions [77]. An example of such an instruction is shown in Figure 3.
The second innovative approach is organization of two lectures in the FC formula. For this purpose, fully interactive video materials were prepared using scripts of the H5P tool of the UPEL platform (Moodle) [24,77,78]. For the first lecture, the author recorded two approximately 40-minute tutorials, each with several interactive links to additional information and a summary with review questions. Selected views from a video tutorial recorded by the author with interactive elements are shown in Figure 4.
For the second lecture, video materials were prepared based on YouTube recordings from the channel of technical seminars organized by the AGH University. As previously, the materials have been supplemented with interactive elements of H5P scripts with notes, explanations, and links to other source materials. Selected views from the video with interactive elements are shown in Figure 5.
All these materials can be viewed by students on their own before lecture meetings organized in the form of an open online problem discussion on the MS Teams channel.
The theoretical and substantive knowledge acquired by students during lectures and laboratory classes is verified by two colloquia conducted during the semester. The first colloquium in the form of a quiz on the UPEL platform is solved by students in a given time in an asynchronous format. The test/quiz uses various question organization formats, with graphic and interactive elements. Example formats are shown in Figure 6.
The second test, more extensive thematically and including verification of practical skills from the laboratories, is carried out at the end of the semester, in the form of an interview and short tasks at laboratory stations. The weight of the assessment of the second test, summarizing the semester, is greater in the algorithm for calculating the final grade for the subject.
All innovative teaching methods, tools and techniques described in this section are the result of their gradual, phased implementation over the last three years. After the first year, still directly related to the period of the COVID-19 pandemic, the author conducted a short survey to obtain students’ opinions regarding the innovations introduced. Their results were presented and discussed in two publications [10,12]. Due to the positive results of these opinions and the decisions of the university authorities enabling the implementation of didactics with e-learning tools as well as BL methods, it was decided to continue the changes and innovations also in the following years after the pandemic.

4. Results and Discussion

The continuation of the introduced solutions required an in-depth analysis of the impact of new methods and tools on the teaching process as well as the approach of students to the learning process organized in this way [70,79]. Therefore, the author decided to conduct extended surveys among students of the previously mentioned subject “Building Automation - Implementation in Smart Networks” after the second and third year of their implementation (two and three years after pandemic). As a result, both after the second and third year of implementation of the BL and FC methods, after completing the entire course in a semester, students received access to a voluntary, anonymous online survey (Google Forms) with six series of single-choice questions. 18 students (out of 20 participants in the classes – 90% of students) took part in the survey after the second year (2022), and 12 students (out of 26 participants in the classes – 46% of students) in the third year (2023).

4.1. Survey Results—Students’ Answers and Assessments

Due to the different number of respondents in 2022 and 2023, the survey results were summarized and compared in percentage terms. The first category of issues that students were asked about was the level of lecturer’s involvement and the assessment of his knowledge transfer skills. The obtained results are shown in Table 2.
The positive results of the assessment of the lecturer’s involvement in the process of transferring knowledge and the increase in its attractiveness are noteworthy. In both years, 100% of the answers were Excellent and Very good. What is particularly important, as indicated by positive responses, students feel that they are get interested in the subject and the issues presented during lectures. Moreover, from their own experience during the meetings, they assess that the time devoted to them was effectively used by the lecturer.
The decrease in definitely positive responses observed in 2022 in favor of positive and neutral ones in 2023 may indicate a change in students’ opinions but may also be the result of a decrease in the percentage of evaluators in relation to all course evaluators. However, the lecturer, the author of this paper, should keep them in mind when planning to update the lecture content and methods of conducting lectures with elements of BL and FC methods, especially to diversify the formula of lecture meetings.
The second category of issues and questions in the student survey concerned the organization of the entire course and elements of innovative learning/teaching methods as well as e-learning in lectures and laboratory classes. The results of this part of the survey, divided into subcategories: (i) organization and form of lectures, (ii) e-learning and FC, (iii) course content and organization (lectures and laboratory), are provided in Table 3, Table 4 and Table 5.
Considering results form Table 3 it is worth noting the very high percentage of Definitely yes responses regarding the issue of flexibility in organizing lecture meetings. These meetings are held online, with several FC lectures and online discussions. Students appreciate the lack of the need to be physically present at a lecture, and the lecturer observes a significantly higher attendance of students than in previous years with the stationary format of lectures (lectures are optional and master’s students, often already working). Importantly, their participation in online meetings was active - students asked questions, discussed, and answered short interactive tests and surveys during lectures (tools Slido, Socrative, Poll Everywhere). However, it should be borne in mind that such results may be of a varied nature, depending on the stage of education - first and second cycle studies and the expectations and requirements of students [59,69].
The second important issue that was the goal to be achieved by the lecturer was the correlation of lecture content with the technical topics covered during laboratory classes. As indicated by students’ evaluations from both years, this goal was rather achieved, although, as for most of the analyzed issues, in 2023 there was a decrease in the percentage of best answers in favor of positive and neutral ones (8% - 1 out of 12 respondents). Moreover, the overall assessment in all analyzed issues is rather positive - no negative answers No and Definitely no. Other aspects regarding students’ opinions on the implemented elements of the BL and FC methods are summarized in Table 4. Due to the diversity of the proposed tools and solutions, the survey questions focused on the most significant ones.
The results clearly indicate that the inclusion of elements of e-learning and hybrid learning is generally accepted by students. However, it can be noticed that the representative group of respondents from 2023 mentioned above is not as enthusiastic as the previous one and there are more Yes answers compared to the previous year with Definitely yes answers. Such opinions may also be the result of the fact that the innovative elements proposed by the teacher are not commonly used in other subjects and students approach them with distance, without being convinced of their effectiveness in teaching. At the same time, however, in additional comments (analysis in Section 4.2) they emphasize that such methods and elements should become the standard of modern didactic implementation paths [80].
Table 5 presents the results of students’ opinions regarding the most important issues regarding the organization of education in the subject as a whole, such as: selected information about the subject syllabus, class schedule and support of the UPEL platform.
Among the issues analyzed in this part of survey, the most important and directly related to the subject of this paper is the aspect of support and organization of the course on the UPEL platform, which is assessed very positively in both analyzed academic years. Other organizational issues are assessed in a diverse manner, clearly dependent on the subjective feelings of each student. Hence, there are single negative opinions, with a clear predominance of general positive or very positive opinions. It should be emphasized that every year the instructor conducts a similar survey and a short discussion with students summarizing the semester of classes and lectures. The feedback is analyzed and in the following year new solutions are proposed or those already implemented are improved.

4.2. Survey Results—Short Summary of Students’ Impressions and Comments

Innovation in teaching is a challenge in itself. It always carries the risk of surprise and inefficiency, and at the same time requires additional involvement of the teacher during the preparation of lectures and classes and, of course, of the students during their implementation. Hence, it is very important to evaluate the effects of innovative approaches in education and to collect and analyze feedback from course participants. Table 6 contains elements of students’ opinions and even self-assessments related to their feelings about the impact of the education process in the subject in question on the growth of their knowledge and skills and regarding the requirements placed on them.
The difficulty in responding to the issues presented in Table 6 is the need for students to take a critical, conscious look at their own skills and share information about their change, even in an anonymous format. However, as the results indicate, the respondents rose to the challenge, with the vast majority of them indicating a low and medium level of knowledge before the course and a satisfactory level after its completion. What is also noteworthy is the positive and satisfying feeling regarding the requirements for completing the course with positive results.
An important supplement to the survey was the opportunity for students to write down additional comments, both positive and negative. Over the two years analyzed in this paper, positive comments included, among others (selected ones):
“The diversity of classes. Laboratory classes were conducted using modern technologies, hence the material learned and practiced is up to date (in line with current technological trends) and will be useful in the future. (...) The form of classes differs significantly from standard classes conducted at universities (definitely a plus!).”
“Concise, engaging lectures showing current trends in a given technology and preparing for potential work in the profession.”
“During the laboratories, the instructions included some own work, instead of hand-to-hand guidance. Thanks to this, you could do more yourself, instead of mindlessly following the instructions.”
“The positive aspects certainly include remote lectures, due to the fact that most of the year I work professionally, which in fact forces me to miss some lectures. The remote form allows you to connect and stay up to date with the material being studied, so the question “what’s up” you are actually learning in these studies” is a simple answer. Flipped classroom - in my opinion, it should be a standard in studies (as part of lectures). The lecturer can prepare the substantive material once and for all (...), and the student works on the material on his own so like many courses available on platforms like Udemy [81].”
“Remote, recorded lectures + flipped classroom, structured course structure at UPEL, additional materials.”
In turn, the negative comments and remarks included (selected ones):
“Personally, I think that in such subjects the number of laboratory hours should be greater than lecture hours (although I guess the instructor may not have any influence on this). Learning is much more effective when you do something, not just listen about it.”
“The instructions on the UPEL platform were sometimes inconsistent with the instructions on the computers at the laboratory stations - later, problems appeared when preparing reports made according to the instructions on the UPEL.”
“I would suggest greater intervention in laboratory exercises, where the instructor approaches the station and partially checks the student’s preparation, asks why the instructions lead this way, and what if it was done differently. This would certainly encourage more diligent preparation for classes.”
“What problems does an integrator encounter on site and how to deal with them? It would be great to see a practical flipped and methodology for solving the challenge/fault.”
“A lot of reports to complete during the semester (maybe some other form of consolidating knowledge and skills from exercises?).”
Several general conclusions can be drawn from the comments and remarks presented by students. First of all, the 2nd degree master’s students appreciate the opportunity to participate in remote, online lectures, which gives them the opportunity to combine the implementation of the study program with professional work. This formula is also appreciated by the author of this paper - a lecturer, as it ensures greater attendance at lectures [80]. However, as students point out, an important element in limiting such lectures is the variety of methods and tools used to transmit knowledge. Hence their systematic implementation by the lecturer is needed and will be provided in coming years.
Another important issue is innovation in the organization and implementation of laboratory exercises, where students expect interaction, instructions leading to small challenges rather than leading them “by hand”, often in the format of “clicking” subsequent settings, algorithms on a computer with integration software. This is quite a challenge from the instructor’s point of view, and the answer to it is the implementation of interactive elements in the instructions, the use of video instructions from webinars, etc. Of course, this is just one of the elements of planned organizational changes in work at laboratory stand in the coming years, in accordance with the principle of “small steps”.
The last general conclusion concerns the need to maintain the uniformity of the materials provided and made available, both for substantive learning and laboratory exercise instructions. As students’ comments indicate, any discrepancies are irritating to them. It should be noted that when switching to the digital form of materials and instructions, the risk of differences in the versions of their files and texts is significant and requires special attention of the teacher conducting classes and lectures.

5. Conclusions

The paper describes experiences resulting from the implementation of innovative elements of BL and FC methods as part of a subject related to building automation systems, carried out at the 2nd degree of master’s studies at a technical university, majoring in electrical engineering. In particular, the paper focuses on the presentation of tools and methods introduced into the educational path using e-learning techniques and the analysis of feedback collected from students from two subsequent years of the discussed subject.
The results of students’ opinions and assessments presented in the paper indicate that their perception of innovative teaching methods, also with elements of online work (hybrid mode), is generally positive. However, the comments and criticisms discussed in previous section indicate that the effective permanent implementation of such an approach into the teaching process requires special attention and commitment of lecturers and teachers. The selected tools of BL and FC methods should offer diversity and, at the same time, consistency in the transfer of substantive knowledge, closely related to practical skills acquired in the laboratory. Moreover, as students point out, an important issue is to link the topics covered in the subject with current industry trends, technological changes, etc. The latter are relatively difficult due to the need for additional hardware and software investments in the laboratory. Therefore, lecturers and teachers should strive to present universal solutions, the mastery of which by students will allow them to effectively carry out projects and tasks also in technologies other than those they can learn during classes [59]. This is especially important in the dynamically changing market of building automation systems, smart home and building systems, and the Internet of Things. An interesting solution to increase the competences of student engineers may be the introduction of peer work and assessment, or peer mentoring discussed in [82]. However, the results of the analysed case study clearly indicate that students at technical universities are generally favourable towards the implementation of BL and FC methods in the teaching process. At the same time, they are aware that by mastering e-learning tools and remote work rules, they develop additional skills needed in their future professional careers [51,80,83].
In future works, the author intends to focus primarily on changes in the organization of laboratory exercises, with the implementation of problem tasks to be carried out at stations of various home and building automation technologies. Possibilities of using the FC method are being considered, with the development of materials for students to prepare for laboratory classes independently. Next, based on the laboratory exercise instructions with indication of problem tasks, students will strive to solve problems related to programming functions of automation devices and functional integration of a larger system application on their own and/or with the help of the teacher. Additionally, the author has already started implementing selected elements of peer assessment and is going to include elements of peer mentoring in the teaching process, also with online group work [82,84]. Moreover, a system of surveying and collecting feedback from students will be gradually developed and implemented also in other subjects.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data and datasheets presented in the tables and figures in this study are available upon request from the corresponding author. The data are not publicly available due to privacy.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Iivari, N.; Sharma, S.; Ventä-Olkkonen, L. Digital Transformation of Everyday Life – How COVID-19 Pandemic Transformed the Basic Education of the Young Generation and Why Information Management Research Should Care? Int J Inf Manage 2020, 102183. [Google Scholar] [CrossRef] [PubMed]
  2. Dwivedi, Y.K.; Hughes, D.L.; Coombs, C.; Constantiou, I.; Duan, Y.; Edwards, J.S.; Gupta, B.; Lal, B.; Misra, S.; Prashant, P.; et al. Impact of COVID-19 Pandemic on Information Management Research and Practice: Transforming Education, Work and Life. Int J Inf Manage 2020, 102211. [Google Scholar] [CrossRef]
  3. de Moura Oliveira, P.B.; Soares, F. How We Turned Fully Digital Due to Covid-19: Two Control Engineering Teaching Experiences. In Proceedings of the 2021 4th International Conference of the Portuguese Society for Engineering Education (CISPEE), IEEE, June 21 2021; pp. 1–5. [Google Scholar]
  4. Kaden, U. COVID-19 School Closure-Related Changes to the Professional Life of a K–12 Teacher. Educ Sci (Basel) 2020, 10, 165. [Google Scholar] [CrossRef]
  5. Alcaraz, R.; Martinez-Rodrigo, A.; Zangroniz, R.; Rieta, J.J. Blending Inverted Lectures and Laboratory Experiments to Improve Learning in an Introductory Course in Digital Systems. IEEE Transactions on Education 2020, 63, 1–11. [Google Scholar] [CrossRef]
  6. Jinwen Zhu A Hybrid Online-Education Strategy for Delivering Engineering and Technology Courses. In Proceedings of the 2010 International Conference on Networking and Digital Society; IEEE, May 2010; Vol. 2, pp. 448–451.
  7. Cueva, A.; Inga, E. Information and Communication Technologies for Education Considering the Flipped Learning Model. Educ Sci (Basel) 2022, 12, 207. [Google Scholar] [CrossRef]
  8. Antonino-Daviu, J.A.; Dunai, L. Educational Experiences on Virtual Teaching of Electric Motors Condition Monitoring Courses. In Proceedings of the 2021 IEEE 8th International Conference on e-Learning in Industrial Electronics (ICELIE), IEEE, October 13 2021; pp. 1–6. [Google Scholar]
  9. Martinez, P.J.; Aguilar, F.J.; Ortiz, M. Transitioning From Face-to-Face to Blended and Full Online Learning Engineering Master’s Program. IEEE Transactions on Education 2020, 63, 2–9. [Google Scholar] [CrossRef]
  10. Ozadowicz, A. Interactivity — A Key Element of Blended Learning with Flipped Classroom Approach. In Proceedings of the 2022 IEEE 9th International Conference on e-Learning in Industrial Electronics (ICELIE), IEEE, October 17 2022; pp. 1–6. [Google Scholar]
  11. Noga, M.; Ożadowicz, A.; Grela, J. Modern, Certified Building Automation Laboratories AutBudNet – Put “Learning by Doing” Idea into Practice. Electrical Review 2012, 137–141. [Google Scholar]
  12. Ożadowicz, A. Modified Blended Learning in Engineering Higher Education during the COVID-19 Lockdown—Building Automation Courses Case Study. Educ Sci (Basel) 2020, 10, 292. [Google Scholar] [CrossRef]
  13. Pichardo, J.I.; López-Medina, E.F.; Mancha-Cáceres, O.; González-Enríquez, I.; Hernández-Melián, A.; Blázquez-Rodríguez, M.; Jiménez, V.; Logares, M.; Carabantes-Alarcon, D.; Ramos-Toro, M.; et al. Students and Teachers Using Mentimeter: Technological Innovation to Face the Challenges of the COVID-19 Pandemic and Post-Pandemic in Higher Education. Educ Sci (Basel) 2021, 11, 667. [Google Scholar] [CrossRef]
  14. Al-Freih, M. From the Adoption to the Implementation of Online Teaching in a Post-COVID World: Applying Ely’s Conditions of Change Framework. Educ Sci (Basel) 2022, 12, 757. [Google Scholar] [CrossRef]
  15. Aidoo, B.; Macdonald, M.A.; Vesterinen, V.-M.; Pétursdóttir, S.; Gísladóttir, B. Transforming Teaching with ICT Using the Flipped Classroom Approach: Dealing with COVID-19 Pandemic. Educ Sci (Basel) 2022, 12, 421. [Google Scholar] [CrossRef]
  16. Ntim, S.; Opoku-Manu, M.; Addai-Amoah Kwarteng, A. Post COVID-19 and the Potential of Blended Learning in Higher Institutions: Exploring Students and Lecturers Perspectives on Learning Outcomes in Blended Learning. European Journal of Education and Pedagogy 2021, 2, 49–59. [Google Scholar] [CrossRef]
  17. Sri, S.; Haningsih, S.; Rohmi, P. The Pattern of Hybrid Learning to Maintain Learning Effectiveness at the Higher Education Level Post-COVID-19 Pandemic. European Journal of Educational Research 2022, 11, 243–257. [Google Scholar] [CrossRef]
  18. Peimani, N.; Kamalipour, H. Online Education in the Post COVID-19 Era: Students’ Perception and Learning Experience. Educ Sci (Basel) 2021, 11, 633. [Google Scholar] [CrossRef]
  19. Saboowala, R.; Manghirmalani Mishra, P. Readiness of In-Service Teachers Toward a Blended Learning Approach as a Learning Pedagogy in the Post-COVID-19 Era. Journal of Educational Technology Systems 2021, 50, 9–23. [Google Scholar] [CrossRef]
  20. Singh, J.; Steele, K.; Singh, L. Combining the Best of Online and Face-to-Face Learning: Hybrid and Blended Learning Approach for COVID-19, Post Vaccine, & Post-Pandemic World. Journal of Educational Technology Systems 2021, 50, 140–171. [Google Scholar] [CrossRef]
  21. Bechter, C.; Swierczek, F. Digital Storytelling in a Flipped Classroom for Effective Learning. Educ Sci (Basel) 2017, 7, 61. [Google Scholar] [CrossRef]
  22. Meinel, C.; Schweiger, S. A Virtual Social Learner Community—Constitutive Element of MOOCs. Educ Sci (Basel) 2016, 6, 22. [Google Scholar] [CrossRef]
  23. Mohammad, N.M.; Sara, F.; Zahra, T.; Mojtaba, H. The Study of the Teacher’s Role and Student Interaction in e-Learning Process. In Proceedings of the 4th International Conference on e-Learning and e-Teaching (ICELET 2013), IEEE, February 2013; pp. 130–134. [Google Scholar]
  24. Moore, J. Efficacy of Multimedia Learning Modules as Preparation for Lecture-Based Tutorials in Electromagnetism. Educ Sci (Basel) 2018, 8, 23. [Google Scholar] [CrossRef]
  25. Delgado Algarra, E.J.; Bernal Bravo, C.; Morales Cevallos, M.B.; López Meneses, E. Pedagogical and Technical Analyses of Massive Open Online Courses on Artificial Intelligence. Applied Sciences 2024, 14, 1051. [Google Scholar] [CrossRef]
  26. Simkova, M.; Stepanek, J. Effective Use of Virtual Learning Environment and LMS. Procedia Soc Behav Sci 2013, 83, 497–500. [Google Scholar] [CrossRef]
  27. You, J.W. Identifying Significant Indicators Using LMS Data to Predict Course Achievement in Online Learning. Internet High Educ 2016, 29, 23–30. [Google Scholar] [CrossRef]
  28. Bradley, N.; Jadeski, L.; Newton, G.; Ritchie, K.; Merrett, S.; Bettger, W. The Use of a Learning Management System (LMS) to Serve as the Virtual Common Space of a Network for the Scholarship of Teaching and Learning (SoTL) in an Academic Department. Educ Sci (Basel) 2013, 3, 136–146. [Google Scholar] [CrossRef]
  29. Sanganyado, E.; Nkomo, S. Incorporating Sustainability into Engineering and Chemical Education Using E-Learning. Educ Sci (Basel) 2018, 8, 39. [Google Scholar] [CrossRef]
  30. Okaz, A.A. Integrating Blended Learning in Higher Education. Procedia Soc Behav Sci 2015, 186, 600–603. [Google Scholar] [CrossRef]
  31. Klentien, U.; Wannasawade, W. Development of Blended Learning Model with Virtual Science Laboratory for Secondary Students. Procedia Soc Behav Sci 2016, 217, 706–711. [Google Scholar] [CrossRef]
  32. Singh, A.; Rocke, S.; Pooransingh, A.; Ramlal, C.J. Improving Student Engagement in Teaching Electric Machines Through Blended Learning. IEEE Transactions on Education 2019, 62, 297–304. [Google Scholar] [CrossRef]
  33. Yang, S.; Newman, R. Rotational Blended Learning in Computer System Engineering Courses. IEEE Transactions on Education 2019, 62, 264–269. [Google Scholar] [CrossRef]
  34. Batanero-Ochaíta, C.; Fernández-Sanz, L.; Rivera-Galicia, L.F.; Rueda-Bernao, M.J.; López-Baldominos, I. Estimation of Interaction Time for Students with Vision and Motor Problems When Using Computers and E-Learning Technology. Applied Sciences 2023, 13, 10978. [Google Scholar] [CrossRef]
  35. Weber, A.M.; Greiff, S. ICT Skills in the Deployment of 21st Century Skills: A (Cognitive) Developmental Perspective through Early Childhood. Applied Sciences 2023, 13, 4615. [Google Scholar] [CrossRef]
  36. Collado-Valero, J.; Rodríguez-Infante, G.; Romero-González, M.; Gamboa-Ternero, S.; Navarro-Soria, I.; Lavigne-Cerván, R. Flipped Classroom: Active Methodology for Sustainable Learning in Higher Education during Social Distancing Due to COVID-19. Sustainability 2021, 13, 5336. [Google Scholar] [CrossRef]
  37. Alammary, A.S. Blended Learning Delivery Methods for a Sustainable Learning Environment: A Delphi Study. Sustainability 2024, 16, 3269. [Google Scholar] [CrossRef]
  38. Kumar, A.; Malhotra, S.; Katoch, A.; Sarathkar, A.; Manocha, A. Webinars: An Assistive Tool Used by Higher Education Educators during Covid19 Case Study. 2020 12th International Conference on Computational Intelligence and Communication Networks (CICN) 2020. [CrossRef]
  39. Sobaih, A.E.E.; Hasanein, A.M.; Abu Elnasr, A.E. Responses to COVID-19 in Higher Education: Social Media Usage for Sustaining Formal Academic Communication in Developing Countries. Sustainability 2020, 12, 6520. [Google Scholar] [CrossRef]
  40. Perusall Team Perusall - Interactive Education Platform. Available online: https://www.perusall.com (accessed on 24 April 2024).
  41. Banks, L.; Kay, R. Exploring Flipped Classrooms in Undergraduate Nursing and Health Science: A Systematic Review. Nurse Educ Pract 2022, 64, 103417. [Google Scholar] [CrossRef] [PubMed]
  42. Dabney, B.W.; Eid, F. Beyond Bloom’s: Fink’s Taxonomy as a Catalyst for Meaningful Learning in Nursing Education. Teaching and Learning in Nursing 2023. [CrossRef]
  43. Barry, D.M.; Kanematsu, H.; Ogawa, N.; McGrath, P. Technologies for Teaching during a Pandemic. Procedia Comput Sci 2021, 192, 1583–1590. [Google Scholar] [CrossRef] [PubMed]
  44. Manca, S. Snapping, Pinning, Liking or Texting: Investigating Social Media in Higher Education beyond Facebook. Internet High Educ 2020, 44, 100707. [Google Scholar] [CrossRef]
  45. Fernández-Caramés, T.M.; Fraga-Lamas, P. Towards Next Generation Teaching, Learning, and Context-Aware Applications for Higher Education: A Review on Blockchain, IoT, Fog and Edge Computing Enabled Smart Campuses and Universities. Applied Sciences 2019, 9, 4479. [Google Scholar] [CrossRef]
  46. Avila, S.R.; Castillo, E.V. Model to Support the Learning Process and Generation of Knowledge Using Collaborative Tools. In Proceedings of the 2021 IEEE 1st International Conference on Advanced Learning Technologies on Education & Research (ICALTER), IEEE, December 16 2021; pp. 1–4. [Google Scholar]
  47. Padlet Team Padlet. Available online: https://padlet.com (accessed on 7 November 2023).
  48. Muir, T.; Wang, I.; Trimble, A.; Mainsbridge, C.; Douglas, T. Using Interactive Online Pedagogical Approaches to Promote Student Engagement. Educ Sci (Basel) 2022, 12, 415. [Google Scholar] [CrossRef]
  49. Kim, H.J.; Yi, P.; Hong, J.I. Students’ Academic Use of Mobile Technology and Higher-Order Thinking Skills: The Role of Active Engagement. Educ Sci (Basel) 2020, 10, 47. [Google Scholar] [CrossRef]
  50. Gallardo-Guerrero, A.-M.; Maciá-Andreu, M.-J.; Conde-Pascual, E.; Sánchez-Sáez, J.-A.; Zurita-Ortiz, B.; García-Tascón, M. From Flipped Classroom to Personalised Learning as an Innovative Teaching Methodology in the Area of Sports Management in Physical Activity and Sport Sciences. Sustainability 2022, 14, 7714. [Google Scholar] [CrossRef]
  51. Costello, G.R.; Davis, K.R.; Crocco, O.S. Learning by Doing: Student & Faculty Reflections on a Collaborative Model for Conducting and Publishing Mixed Methods Research in a Graduate Course. Innov High Educ 2022, 47, 1067–1084. [Google Scholar] [CrossRef] [PubMed]
  52. Autodesk Tinkercad Autodesk. Available online: https://www.tinkercad.com (accessed on 11 December 2023).
  53. Marinoni, Giorgio.; Van’t Land, Hilligje.; Jensen, Trine.; Asociación Internacional de Universidades. The Impact of COVID-19 on Higher Education around the World IAU Global Survey Report; International Association of Universities: Paris, 2020; ISBN 9789290022121.
  54. Guidi, E.; Jensen, T.; Marinoni, G. Shaping Teaching & Learning and Internationalization beyond the Pandemic; International Association of Universities: Paris, 2023; ISBN 978-92-9002-218-3. [Google Scholar]
  55. Aramburuzabala, P.; Culcasi, I.; Cerrillo, R. Service-Learning and Digital Empowerment: The Potential for the Digital Education Transition in Higher Education. Sustainability 2024, 16, 2448. [Google Scholar] [CrossRef]
  56. Djidu, H.; Mashuri, S.; Nasruddin, N.; Sejati, A.E.; Rasmuin, R.; Ugi, L.E.; Arua, A. La Online Learning in the Post-Covid-19 Pandemic Era: Is Our Higher Education Ready for It? Jurnal Penelitian dan Pengkajian Ilmu Pendidikan: e-Saintika 2021, 5, 139–151. [Google Scholar] [CrossRef]
  57. Neuwirth, L.S.; Jović, S.; Mukherji, B.R. Reimagining Higher Education during and Post-COVID-19: Challenges and Opportunities. Journal of Adult and Continuing Education 2021, 27, 141–156. [Google Scholar] [CrossRef]
  58. Ewing, L.-A. Rethinking Higher Education Post COVID-19. In The Future of Service Post-COVID-19 Pandemic, Rapid Adoption of Digital Service Technology; Jungwoo, L., Spring H., H., Eds.; Springer, 2021; Vol. 1 ISBN 978-981-33-4125-8.
  59. Boskovic, D.; Husremovic, D.; Muslic, M.; Kapo, A. Teachers and Students as Promoters or Repressors of Sustainable Education: Navigating the Blended Learning Landscape. Sustainability 2023, 15, 16812. [Google Scholar] [CrossRef]
  60. Cobo-Rendón, R.; Bruna Jofre, C.; Lobos, K.; Cisternas San Martin, N.; Guzman, E. Return to University Classrooms With Blended Learning: A Possible Post-Pandemic COVID-19 Scenario. Front Educ (Lausanne) 2022, 7. [Google Scholar] [CrossRef]
  61. Robson, L.; Gardner, B.; Dommett, E.J. The Post-Pandemic Lecture: Views from Academic Staff across the UK. Educ Sci (Basel) 2022, 12, 123. [Google Scholar] [CrossRef]
  62. Benito, Á.; Dogan Yenisey, K.; Khanna, K.; Masis, M.F.; Monge, R.M.; Tugtan, M.A.; Vega Araya, L.D.; Vig, R. Changes That Should Remain in Higher Education Post COVID-19: A Mixed-Methods Analysis of the Experiences at Three Universities. Higher Learning Research Communications 2021, 11, 51–75. [Google Scholar] [CrossRef]
  63. Prensky, M. Digital Natives, Digital Immigrants Part 1. On the Horizon 2001, 9, 1–6. [Google Scholar] [CrossRef]
  64. Hung, L.N.Q. EFL Students’ Perceptions of Online Flipped Classrooms during the Covid-19 Pandemic and Beyond. International Journal of Learning, Teaching and Educational Research 2022, 21, 460–476. [Google Scholar] [CrossRef]
  65. Buschetto Macarini, L.A.; Cechinel, C.; Batista Machado, M.F.; Faria Culmant Ramos, V.; Munoz, R. Predicting Students Success in Blended Learning—Evaluating Different Interactions Inside Learning Management Systems. Applied Sciences 2019, 9, 5523. [Google Scholar] [CrossRef]
  66. Guàrdia, L.; Maina, M.; Mancini, F.; Martinez Melo, M. Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective. Applied Sciences 2023, 13, 2450. [Google Scholar] [CrossRef]
  67. Thai, N.T.T.; De Wever, B.; Valcke, M. Providing Feedback during the Online Phase of a Flipped Classroom Design: Fostering Sustainable Learning Performance While Considering Study Time Management. Sustainability 2024, 16, 3089. [Google Scholar] [CrossRef]
  68. Rahmani, A.; Samira Zitouni, K. Blended Learning and Flipped Classroom’s Application during Post Pandemic. Arab World English Journal 2022, 13, 451–461. [Google Scholar] [CrossRef]
  69. Basitere, M.; Rzyankina, E.; Le Roux, P. Reflection on Experiences of First-Year Engineering Students with Blended Flipped Classroom Online Learning during the COVID-19 Pandemic: A Case Study of the Mathematics Course in the Extended Curriculum Program. Sustainability 2023, 15, 5491. [Google Scholar] [CrossRef]
  70. Tobarra, L.; Robles-Gómez, A.; Pastor, R.; Hernández, R.; Duque, A.; Cano, J. Students’ Acceptance and Tracking of a New Container-Based Virtual Laboratory. Applied Sciences 2020, 10, 1091. [Google Scholar] [CrossRef]
  71. Cobo-Rendón, R.; Bruna Jofre, C.; Lobos, K.; Cisternas San Martin, N.; Guzman, E. Return to University Classrooms With Blended Learning: A Possible Post-Pandemic COVID-19 Scenario. Front Educ (Lausanne) 2022, 7. [Google Scholar] [CrossRef]
  72. Barletta, V.S.; Cassano, F.; Marengo, A.; Pagano, A.; Pange, J.; Piccinno, A. Switching Learning Methods during the Pandemic: A Quasi-Experimental Study on a Master Course. Applied Sciences 2022, 12, 8438. [Google Scholar] [CrossRef]
  73. Fernández-Caramés, T.M.; Fraga-Lamas, P. Use Case Based Blended Teaching of IIoT Cybersecurity in the Industry 4. 0 Era. Applied Sciences 2020, 10, 5607. [Google Scholar] [CrossRef]
  74. Wiid, P. Kaizen and Education. In Agile and Lean Concepts for Teaching and Learning; Springer Singapore: Singapore, 2019; pp. 63–92. [Google Scholar]
  75. Kregel, I. Kaizen in University Teaching: Continuous Course Improvement. International Journal of Lean Six Sigma 2019, 10, 975–991. [Google Scholar] [CrossRef]
  76. Gallenkämper, J.; Heim, B.; Kreuzer, J.; Rupp, F.; von Stockhausen, P.; Viet, N. Kaizen Teaching and the Learning Habits of Engineering Students in a Freshman Mathematics Course. Cent Eur J Oper Res 2016, 24, 1009–1030. [Google Scholar] [CrossRef]
  77. Ester, P.; Morales, I.; Herrero, L. Micro-Videos as a Learning Tool for Professional Practice during the Post-COVID Era: An Educational Experience. Sustainability 2023, 15, 5596. [Google Scholar] [CrossRef]
  78. Shahnia, F.; Yengejeh, H.H. Various Interactive and Self-Learning Focused Tutorial Activities in the Power Electronic Course. IEEE Transactions on Education 2019, 62, 246–255. [Google Scholar] [CrossRef]
  79. Simonova, I.; Faltynkova, L.; Kostolanyova, K. New Blended Learning Enriched after the COVID-19 Experience? Students’ Opinions. Sustainability 2023, 15, 5093. [Google Scholar] [CrossRef]
  80. Stoian, C.E.; Fărcașiu, M.A.; Dragomir, G.-M.; Gherheș, V. Transition from Online to Face-to-Face Education after COVID-19: The Benefits of Online Education from Students’ Perspective. Sustainability 2022, 14, 12812. [Google Scholar] [CrossRef]
  81. Udemy Inc. UDEMY - Courses on Demand. Available online: https://www.udemy.com/ (accessed on 22 April 2024).
  82. Seery, C.; Andres, A.; Moore-Cherry, N.; O’Sullivan, S. Students as Partners in Peer Mentoring: Expectations, Experiences and Emotions. Innov High Educ 2021, 46, 663–681. [Google Scholar] [CrossRef]
  83. Strzelecki, A. Students’ Acceptance of ChatGPT in Higher Education: An Extended Unified Theory of Acceptance and Use of Technology. Innov High Educ 2024, 49, 223–245. [Google Scholar] [CrossRef]
  84. Gunning, T.; Adachi, C.; Tai, J. Peer and Collaborative Assessment. In Technology-Enhanced Learning and the Virtual University; Sankey Michael David and Huijser, H. and F.R., Ed.; Springer Nature Singapore: Singapore, 2023; pp. 353–373. [Google Scholar]
Figure 1. Elements of the UPEL course for lab classes: (a) labs schedule and exercise instruction sections; (b) exercise reports and colloquiums sections (original view in Polish with additional comments and explanations in English).
Figure 1. Elements of the UPEL course for lab classes: (a) labs schedule and exercise instruction sections; (b) exercise reports and colloquiums sections (original view in Polish with additional comments and explanations in English).
Preprints 108209 g001
Figure 2. Elements of the UPEL course for lectures: (a) lecture presentation section and selected lecture slide with links to websites with additional information; (b) section “Supporting materials - instead of bibliography” and selected material with markings highlighting important issues for students (original view in Polish with additional comments and explanations in English).
Figure 2. Elements of the UPEL course for lectures: (a) lecture presentation section and selected lecture slide with links to websites with additional information; (b) section “Supporting materials - instead of bibliography” and selected material with markings highlighting important issues for students (original view in Polish with additional comments and explanations in English).
Preprints 108209 g002
Figure 3. Video tutorial as a part of lab exercise instruction with reference to webinar slides.
Figure 3. Video tutorial as a part of lab exercise instruction with reference to webinar slides.
Preprints 108209 g003
Figure 4. Interactive video tutorial as a part of lecture in FC approach (original view in Polish with additional comments and explanations in English).
Figure 4. Interactive video tutorial as a part of lecture in FC approach (original view in Polish with additional comments and explanations in English).
Preprints 108209 g004
Figure 5. Interactive video information materials as a part of lecture in FC approach (original view in Polish with additional comments and explanations in English).
Figure 5. Interactive video information materials as a part of lecture in FC approach (original view in Polish with additional comments and explanations in English).
Preprints 108209 g005
Figure 6. Selected online quiz questions with graphic and interactive elements (to be dragged and completed): (a) fragment of application code for a LonWorks network node; (b) functional block with network variables (original view in Polish).
Figure 6. Selected online quiz questions with graphic and interactive elements (to be dragged and completed): (a) fragment of application code for a LonWorks network node; (b) functional block with network variables (original view in Polish).
Preprints 108209 g006
Table 1. Students and faculty staff preferences regarding learning modality based on [62].
Table 1. Students and faculty staff preferences regarding learning modality based on [62].
University / Group Face-to-Face Hybrid Online
The NorthCap University
Students
Faculty staff
42% 52% 6%
14% 82% 6%
Istanbul Bilgi University
Students
Faculty staff
38% 49% 13%
26% 67% 7%
Universidad Latina de Costa Rica
Students
Faculty staff
23% 65% 12%
9% 85% 6%
Overall Sample (All universities)
Students
Faculty staff
31% 57% 12%
15% 79% 6%
Table 2. Assessment of issues related to the organization of lectures and the lecturer himself.
Table 2. Assessment of issues related to the organization of lectures and the lecturer himself.
Issues / Questions 2022 2023
Exc. * V.g. Sat. Fair Low Exc. V.g. Sat. Fair Low
Level of lecturer’s involvement 83% 17% 0% 0% 0% 50% 50% 0% 0% 0%
D.Yes Yes Neut. No D.No D.Yes Yes Neut. No D.No
The lecturer is an effective lecturer 67% 33% 0% 0% 0% 42% 50% 8% 0% 0%
Lecture presentations were clear
and well structured
56% 33% 11% 0% 0% 25% 67% 8% 0% 0%
The lecturer interested the students
in the subject of the course
83% 17% 0% 0% 0% 50% 50% 0% 0% 0%
The lecturer used the time
of lecture meetings effectively
72% 22% 6% 0% 0% 58% 34% 8% 0% 0%
The lecturer introduced elements
of interactivity in contact
between the student and the lecturer
72% 28% 0% 0% 0% 50% 42% 8% 0% 0%
* Abbreviations group 1: Exc. – Excellent; V.g. – Very good; Sat. – Satisfactory; abbreviations group 2: D.Yes – Definitely yes; Neut. – Neutral; D.No – Definitely no.
Table 3. Assessment of issues related to the organization and form of lectures.
Table 3. Assessment of issues related to the organization and form of lectures.
Issues / Questions 2022 2023
D.Yes * Yes Neut. No D.No D.Yes Yes Neut. No D.No
The form of lectures was varied 56% 39% 6% 0% 0% 42% 50% 8% 0% 0%
The lecturer provided flexibility
in organizing lecture meetings
83% 11% 6% 0% 0% 75% 25% 0% 0% 0%
The topics and content of the lectures
correlated with the topics
of the laboratories
67% 33% 0% 0% 0% 50% 42% 8% 0% 0%
The Flipped Classroom
with videos was useful
67% 22% 11% 0% 0% 67% 25% 8% 0% 0%
* Abbreviations: D.Yes – Definitely yes; Neut. – Neutral; D.No – Definitely no.
Table 4. Assessment of issues related to the use of e-learning and flipped classroom elements.
Table 4. Assessment of issues related to the use of e-learning and flipped classroom elements.
Issues / Questions 2022 2023
D.Yes * Yes Neut. No D.No D.Yes Yes Neut. No D.No
Video lectures (Flipped Classroom)
were interactive, engaging students
in the learning process
67% 33% 0% 0% 0% 17% 67% 16% 0% 0%
The video materials in selected laboratory exercise instructions were useful 67% 28% 6% 0% 0% 42% 58% 0% 0% 0%
Laboratory exercise instructions
with interactive elements (video,
visualizations) supported the learning
process and implementation of exercises
78% 11% 11% 0% 0% 33% 42% 25% 0% 0%
The colloquium in the form of an online quiz/test allowed you to effectively demonstrate your knowledge 72% 28% 0% 0% 0% 33% 50% 17% 0% 0%
* Abbreviations: D.Yes – Definitely yes; Neut. – Neutral; D.No – Definitely no.
Table 5. Assessment of issues related to the content and organization of the entire course.
Table 5. Assessment of issues related to the content and organization of the entire course.
Issues / Questions 2022 2023
D.Yes * Yes Neut. No D.No D.Yes Yes Neut. No D.No
The learning objectives
were clearly formulated
72% 28% 0% 0% 0% 42% 58% % 0% 0%
The course content was well organized 67% 22% 6% 5% 0% 42% 50% 8% 0% 0%
The laboratory and lecture activities
were well planned
67% 17% 16% 0% 0% 33% 42% 25% 0% 0%
The amount of lab practice
was appropriate
72% 22% 0% 6% 0% 42% 42% 8% 0% 0%
The time for carrying out
the laboratory exercises was adequate
67% 28% 5% 0% 0% 50% 50% 0% 0% 0%
The instructions for the laboratory
exercises were clear, useful
and understandable
61% 28% 11% 0% 0% 8% 42% 42% 8% 0%
The UPEL course provided access
to necessary materials and instructions
78% 22% 0% 0% 0% 75% 25% 0% 0% 0%
The structure of the UPEL course
was clear and usable
78% 22% 0% 0% 0% 58% 42% 0% 0% 0%
* Abbreviations: D.Yes – Definitely yes; Neut. – Neutral; D.No – Definitely no.
Table 6. Students’ opinions on the impact of the educational process with innovative elements on their development.
Table 6. Students’ opinions on the impact of the educational process with innovative elements on their development.
Issues / Questions 2022 2023
Exc. * V.g. Sat. Fair Low Exc. V.g. Sat. Fair Low
Your skill/knowledge level
at the start of the course
5% 0% 50% 39% 6% 0% 0% 33% 58% 9%
Your skill/knowledge level
at the end of the course
17% 72% 11% 0% 0% 0% 58% 42% 0% 0%
Level of skill/knowledge
required to complete the course
11% 67% 22% 0% 0% 0% 33% 58% 0% 0%
The impact of the course
on your skills/your knowledge
44% 39% 11% 6% 0% 8% 33% 58% 0% 0%
* Abbreviations: Exc. – Excellent; V.g. – Very good; Sat. – Satisfactory.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2026 MDPI (Basel, Switzerland) unless otherwise stated