Entropy has a Great Potential to Steer Education above and Beyond

1. Introduction

As a thermodynamic and information-theoretic concept, the idea of entropy has influenced new innovations in a wide range of fields, including artificial intelligence. To provide a comprehensive review of entropy applications can sometimes prove to be impossible. Furthermore, the motivations behind incorporating entropy into knowledge areas such as information theory, queueing theory, engineering, and computation were examined (Cunha, 2020).

In the past decades newer versions of entropy have come to Approximate entropy and Ergodic theory (Arbabi et al., 2017; Montesinos et al., 2018), directional entropy (Burget, 2018), detecting nonlinearity in short and noisy time series, polynomial entropy (Zunino$\&$ Kulp, 2017), entropy as an arrow of time (Gomes & Carneiro,2021), transfer entropy(Donglai et al., 2018; Zhang & Shang, 2020), they’re all entropy-like quantities proposed by researchers to tackle new challenges in time series analysis, cellular automata, chaos, synchronization, multiscale analysis, etc. For an in-depth account, including historical information, please consult the excellent review (Manish, 2020) and its references.

In information theory(Akundi et al., 2023), Shannon entropy quantifies the uncertainty or randomness of a set of symbols or data, and reads as:

$$H=-{\sum }_{i=1}^{n}p\left(i\right)lnp\left(i\right)$$

(1)

Here $p\left(i\right)$ denotes the probability of symbol $i$.

Entropy is a concept (Akundi et al., 2023), that has different interpretations in various fields. It is widely used in different research areas, such as assessing system robustness, vulnerability, and complexity.

The current paper is organized as follows: Section two is concerned with some entropy applications to education. Some challenging open problems are proposed in section three. Section four is concerned with conclusion combined with the next phase of research.

2. Entropy Applications to Education

(Akundi et al., 2023 ) highlighted the potential for developing assessment tools in the field of education using the concept of entropy. Several studies have explored the application of entropy in classroom assessment, such as evaluating essay content, building classification models, adaptive student assessment techniques, and assessing learner understanding based on free text answers. These approaches leverage entropy to measure the importance of words, compute information content, and determine the level of student understanding.

In the given context, (Akundi et al., 2023 ), knowledge refers to the skills and information acquired through experience and education. The model introduces the concept of entropy, which measures the average information produced based on the probability distribution of keywords in student text recordings. This helps quantify the familiarity and understanding of knowledge gained by students through activities and interactions in a classroom.

Thus, the text introduces the concept of text entropy ($TE$(Akundi et al., 2023), calculated based on keyword occurrences in a text.

This introduces:

$$T{E}_1=-\sum p_{i}ln{p}_i$$

(2)

$$T{E}_{S_n}=-\sum p_{i}ln{p}_i$$

(3)

Where, $i$ is a specific keyword descriptor.

$T{E}_1$ defines the entropy calculated based on keyword occurrences in the instructor’s knowledge base; and $T{E}_{S_n}$ refers to the entropy calculated based on keyword occurrences from text recording of a student $n.$

(2) and (3) represent the calculation of $TE$, where the summation is taken over the probability distribution of specific keywords. The text also mentions the importance of inter-individual interactions in complex systems like classrooms and presents a conceptual view of factors considered in formulating assessment models for different classroom settings.

In the context of classroom structures(Akundi et al., 2023), inter-individual interactions are crucial for creating meaningful structures, as stated by Vetromille-Castro. These interactions serve as the driving force behind the existence of complex systems, with classrooms being an example of such systems. Figure 1 (Akundi et al., 2023), provides a conceptual overview of the factors considered in formulating assessment models for different classroom settings, including the Traditional Classroom Setting, Peer-Based Classroom Setting, and Self-Organized Flipped Classroom Setting.

On another separate note, (Akundi et al., 2023), the assessment model for a traditional classroom setting is designed based on the following assumptions: the classroom is divided into two hierarchical levels, with instructors at a higher level and students at a lower level. The entropy, which measures the uncertainty of keyword occurrences, is expected to be lower for instructors compared to students due to their higher knowledge in the subject. The interactions considered in this model are limited to interactions between instructors and students. This can be portrayed by Figure 2 (c.f., Akundi et al., 2023 ).

The assessment model for a peer-based learning structure(Akundi et al., 2023), assumes a hierarchical organization with instructors at the highest level, followed by peers, and then students. Entropy, which measures the uncertainty in knowledge, is lower for instructors compared to peers, and lower for peers compared to students. This is because keywords with higher occurrence in their knowledge have lower entropy. The model is based on the understanding that instructors possess more knowledge than peers, who in turn possess more knowledge than students in each subject. This can be visualized by Figure 3(c.f., (Akundi et al., 2023 ))

In a wider view, the entropy-based classroom structural assessment framework(Akundi et al., 2023, is a method used to analyze and evaluate the observed structure of a classroom. It considers factors such as interaction patterns among students, their knowledge, the number of students, and the types of classroom interfaces. By gathering data on student communication and interaction patterns, this framework provides a conceptual framework for assessing the overall structure and dynamics of a classroom environment. The reader is encouraged to consult Figure 4(Akundi et al., 2023).

The development of private universities has provided opportunities for individuals to enhance their qualifications and skills. However, educational managers face challenges in determining the appropriate strategies for university development in a competitive environment. To address this, the study utilizes the Entropy method to assign weights to criteria (Wang et al. 2022) followed by the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) to rank private universities based on their performance. Additionally, statistical techniques like Spearman’s rank correlation coefficient and ANOVA are employed to evaluate correlations and compare criteria between groups of universities (Wang et al. 2022), respectively, creating an objective assessment environment for universities to establish development strategies.

In principles, the research problem addressed in(Wang et al. 2022) was to assess the effectiveness of resources and training in private universities in today’s competitive environment.

Multi-Criteria Decision Making (MCDM) (Wang et al. 2022), is a field that involves considering both quantitative and qualitative factors to make refined decisions. MCDM is based on fuzzy set (Wang et al. 2022), and aims to quantify standards, calculate total scores based on criteria weights, and provide decision-makers with a solid and accurate basis for making choices. TOPSIS evaluates options by measuring their distance from both the positive optimal solution (PIS) and the negative optimal solution (NIS), with the selected alternative being the one closest to the PIS and farthest from the NIS. For a more visualized illustration, the reader can consult Figure 5(Wang et al. 2022).

In their study (Wang et al. 2022), the main focus was primarily on evaluating the operational model of private universities based on two criteria:

• Teaching effectiveness, which refers to the measure of how well educational instruction is delivered and how effectively students learn and acquire knowledge.
• Revenue efficiency, on the other hand, pertains to the effectiveness of financial resources and expenditures in generating income for the educational institution, particularly through tuition fees.

In Figure 2, the formulas presented represent mathematical calculations used to assess teaching effectiveness and revenue efficiency, although the specific details and interpretations of the formulas are not provided in the given context. See Figure 6

Sustainable development goals encompass environmental, economic, social, and cultural aspects. Higher education plays a crucial role in promoting sustainable development and empowering individuals to strive for a sustainable future. This study focuses on the quality of the higher education system in Morocco (Fahim et al., 2021), aiming to implement sustainable higher education reform.

The research utilizes a structured approach involving SWOT(strengths, weaknesses, opportunities, and threats) analysis, the analytic hierarchy process (AHP), and the entropy method to assess key factors, rank variables, and establish a SWOT matrix for decision-making and monitoring the quality of the education system. The findings highlight the need for various changes in higher education reform, such as effective budget planning, skilled experts, internationalization, improved infrastructure, curriculum reform, and up-to-date training.

Figure 7. The SWOT framework considers both the organization’s internal capabilities and the external environment to guide decision-making and planning for organizational development(Fahim et al., 2021).

Figure 7. The SWOT framework considers both the organization’s internal capabilities and the external environment to guide decision-making and planning for organizational development(Fahim et al., 2021).

The main objective of the undertaken study (Fahim et al., 2021), was to create a framework for measuring the quality of higher education institutions (HEIs) and providing recommendations for sustainability. The researchers used a combination of SWOT analysis, Analytic Hierarchy Process (AHP), and Entropy to develop a hybrid approach. This approach helped identify key factors influencing the quality of higher education reform and determine their priority through a stepwise strategic planning process. See Figure 8, Figure 9 and Figure 10 ((Fahim et al., 2021).

To this end, The study presented in (Fahim et al., 2021),has yielded significant results and suggests the potential for further exploration using various MCDM approaches. Future research could benefit from incorporating fuzzy multicriteria models and expert input through questionnaire development, as well as considering advanced MCDM models like COMET(Characteristic objects method) or SPOTIS.

3. Open Problems

• Following (Akundi et al., 2023), is it possible to propose an entropy-based assessment framework for a classroom the structural setting’s analysis and assessment, considering factors like interaction patterns, knowledge of the actors, number of actors, and types of classroom interfaces. The question is still open.
• The proposed model (Wang et al., 2022), does not consider operational efficiency comprehensively or evaluate the impact of scientific research activities, which vary among universities. Additionally, the analysis does not cover all private universities and does not consider factors like reputation, establishment time, or location that can influence rankings. This proposes an open problem that needs to be addressed and applied to various international educational settings.
• Having Shannon’s entropy (c.f., Equation(1)) would be the very basic entropy to employ. On another strong note, the use of Ismail’s innovative entropy forms (Mageed, 2022, 2023(a), 2023(b), 2023(c)) would add more to the stellar fusion of the educational profile on all settings. This is based on the variety of the involved parameters, especially, the information-theoretic parameter $q(q\in \left(0.5, 1\right))$ that fine tunes LRIs(long-range interactions), while $q(q\notin \left(0.5, 1\right))$ is a unique descriptor of SRIs(short-range interactions). Both LRIs and SRIs will have a significant impact on all educational setting and performance.

4. Closing Moments

This report provides updates on the state of education. There remain numerous obstacles to overcome to expand and unearth fresh findings and broaden the scope of entropy’s application in this field. There are several advancements that can be made to broaden the field in which entropy is applicable. The reader will be able to obtain knowledge from an overview thanks to the survey’s report on the most recent developments in entropy applications. Subsequent scholars can think about examining the significance of other ideas like chaos and complexity. More intriguingly, it’s possible that the entropic applicability’s range is constrained and cannot be expanded to encompass additional domains of knowledge. Entropy ideas will surely find more applications in the field of education. Apart from maximizing the applications, greater emphasis must be placed on resolving the proposed open problems and exploring entropic applications related to emotional intelligence.