Higher education teaching staff members need to build a scientifically accurate and comprehensive understanding of the function of the brain in learning to optimize teaching and achieve excellent student learning. An international consortium developed a professional development six-module course on educational neuroscience and online community of practice applying design thinking. A mixed methods research design was employed to investigate the attitudes of thirty-two (N=32) participating academics using a survey comprising eleven closed and open questions. Data analysis methods included descriptive statistics, correlation, generalized additive model and grounded theory. The overall evaluation demonstrated a notable satisfaction level with regard to the quality of the course. Given the power of habits, mentoring and peer interactions are recommended to ensure the effective integration of theoretical neuroscientific evidence into teaching practice.

The Pandemic in 2019 forced a digital adaptation with direct consequences on all educational stakeholders. On behalf of teachers and trainers, while many regarded these changes with some scepticism, others embraced the opportunity to integrate technology into their teaching methods and as learning resources. As translation trainers, it is essential to follow and understand the translation market. Thus, the exponential changes that digital technology has brought to this sector over the years impose constant shifts in teaching and learning methods and resources. In fact, translators require vast competencies, amongst which is the flexibility to adapt. In translation training Project-Based Learning (PBL) has been established as an essential teaching and learning method, as it has proven to foster the development of competencies as it simulates the translator's work environment. Thus, the need to adapt new strategies reinforced PBL and its benefits. PBL, however, similar to a freelance translator, places the student in the centre of the learning process, where self-regulation becomes essential, as it is necessary to analyse the market/situation and be flexible enough to adapt to the context accordingly. As of 2018-2019, technical translation courses at ISCAP have implemented PBL as their main teaching and learning method. At the same time, a study on student self-regulation began. The purpose was to understand student perception on their own self-regulation competence and its development or lack thereof after one year of PBL. Results indicate that PBL is seen as a useful simulation of the translation labour market and that it does enhance many essential competences, amongst which is student self-regulation.

This article presents the research results on developing professional capital in Lithuanian schools during the national project "Time for leaders". The longitudinal national initiative aimed to develop professional capital as the synergy of human, social and decisional components (Hargreaves and Fullan, 2019) of schools through the various cooperation-based learning experiences of educational professionals. The article provides an overview of project interventions (activities that stimulated cooperative learning of educational professionals) in the light of cooperative learning principles. The assessment of change over two project years in education professionals' perceptions of professional capital is presented using Cohen's d effect size measure. The measurement sample consisted of teachers (n1=5105; n2=4683) and school leaders (n1=439; n2=405) from 189 schools in 30 Lithuanian municipalities. The findings show a statistically significant medium positive change in professional capital. The most considerable change was estimated in the social and decisional capital dimensions and the relatively smallest - in the field of human capital.

Despite continued efforts by educators, UN declarations and numerous international agreements, progress is still limited in handling major global challenges such as ecosystem collapse, accelerating climate change, poverty and inequity. The capacity to collaborate globally on addressing these issues remains weak. This systematic review of research on global learning for sustainable development (GLSD) aims to clarify the diverse directions research on GLSD has taken, to present the historical development of the research area, and highlight emerging research issues. The review summarises key findings of the English language literature in the period 1994-2020 identified with the search terms “global learning” and “sustainable development”, sustainability or GLSD, respectively. The review documented a gradually growing knowledge base, mostly authored by scholars located in the global North. Conclusions point to what we might achieve if we could learn from one another in new ways, moving beyond Northern-centric paradigms. It is also time to re-evaluate core assumptions that underlie education for sustainable development more generally, such as a narrow focus on formal learning institutions. The review provides a benchmark for future reviews of research on GLSD, reveals the emerging transformative structure of this transdisciplinary field, and offers reference points for further research

In Taiwan, peanuts are classified by hand. The kernel quality is judged based on the appearance of peanuts. The identification takes considerable time and labor. Fatigue can induce misrecogni-tion or grade cognition instability due. Peanut defects are generally divided into health, underde-velopment, insect bite, and rupture. This study employed two imaging methods push-boom FX10 and Snapshot. Deep learning was used to detect peanut defects. A push-broom instrument was used for testing. There were 1,560 peanuts, including 240 good and 240 bad ones. There were a total of 1,080 good peanuts and bad peanuts in the test set data, the band selection was used, and a CNN model was built. Based on the results from three methods, 3DCNN could classify with 97%accuracy. The Snapshot was used to achieve the real-time design of a lightweight CNN model. Finally, five bands were selected using PCA, and the screening could be accurate and efficient. The maximum overall accuracy was about 98.5%. Kappa was 97.3% with real-time recognition. This will be a major advantage in the future practical application and commercialization processes. This technique can reduce labor costs, achieve intelligent detection and intelligent grading, and bring breakthroughs to smart agriculture for other crops as well.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

This paper presents a case study analyzing which learning cognitive strategies are employed by students who play digital games in both in-school and out-of-school learning contexts. As a Case Study, it falls within the qualitative research category. The researcher integrated themselves to the subjects' learning facility for data-gathering, following all recommended ethical protocols for research involving underage subjects. The following data collection instruments were used: research diary, questionnaire, and interviews, conducted with teenagers who play digital games during formal learning activities. Analysis involved data-crossing and checking our data against existing studies and theories, as well as a cartographic production. Data indicates that digital games enhance student usage of cognitive strategies and favor competencies and abilities-based learning over formal learning contents.

Biofilms are congregations of bacteria on a surface, and they grow into obstacles for the functionalities of any device or machinery involves anything biological. Biofilms are developed through a biochemical system known as ‘Quorum Sensing’ that accounts for the chemical signaling that direct either biofilm formation or inhibition. Computational models that relate chemical and structural features of compounds to their performance properties have been used to aide in the discovery of active small molecules for many decades. These quantitative structure-activity relationship (QSAR) models are also important for predicting the activity of molecules that can have a range of effectiveness in biological systems. This study uses QSAR methodologies combined with and different machine learning algorithms to predict and assess the performance of several different compounds acting in Quorum Sensing. Through computational probing of the quorum sensing molecular interaction, new design rules can be elucidated for countering biofilms.

This study assesses the development of professional skills in university students using serious games (SG), from a sustainability perspective. The Sustainable Development Goals (SDGs) were set by the United Nations’ 2030 Agenda for Sustainable Development. Universities are strategic agents in the transformation process towards sustainability. This way, they should be committed to promoting such sustainable values in the students through curricular sustainability, implementing active methodologies and SG for that purpose. Transversal skills are essential for the development of future graduates. The objective of this study was to assess which professional skills should be developed through the SG called The Island, to improve the degree of student satisfaction with the incorporation of a sustainable curriculum. The data were obtained using a questionnaire, and then analysed using linear regression models, with their inference estimated through the goodness of fit and ANOVA. The first results indicated that the implementation of the SG promoted a strengthening of the students' sustainable curriculum through the development of those skills. It was concluded that the key to success in education for sustainable development is improving the development of strategic thinking, collaborative thinking, and self-awareness, in addition to encouraging systemic, critical, and problem-solving thinking.

The urgency to develop vaccines against Covid-19 is putting pressure on the long and expensive development timelines which are normally required for development of lifesaving vaccines. There is a unique opportunity to take advantage of new technologies, smart and flexible design of clinical trials, and evolving regulatory science to speed up vaccine development against Covid-19 and transform vaccine development altogether.

Crack inspection is important to monitor the structural health of pavement structures and to facilitate an easier rehabilitation process. Currently, pavement crack inspection is conducted manually, which is inefficient and costly at the same time. For solving the problem, this work has developed a robotic system for automated data collection and analysis in real-time. The robotic system navigates on the pavement and collects visual images from the surface. A deep learning-based semantic segmentation framework named RCDNet was proposed and implemented on the onboard computer of the robot to identify cracks from the visual images. Simulation results show that the deep learning model obtained 96.29% accuracy for predicting the images. The proposed robotic system was tested on both indoor and outdoor environments and was observed that it can complete inspecting a 3m × 2m grid within 10 minutes and a 2.5m × 1m grid within 6 minutes. This outcome shows that the proposed robotic method can drastically reduce the time of manual inspection. Furthermore, a severity map based on the results from visual images was also generated to provide an idea of which locations should be paid more attention to repair in a test grid.

The sudden outbreak of the COVID-19 pandemic challenged education systems worldwide to quickly pivot their teaching-learning processes from in-person to virtual modes in order to control the spread of the virus. In a short period of time, teachers were forced to adopt new remote teaching methods to ensure the continuation of education. This paper examines how teachers in Pakistan leveraged mobile technology as an alternative teaching strategy to provide access to education during these unprecedented times. Through in-depth individual interviews with selected teachers, the study explores the potential of mobile technology to transform traditional teaching methods into interactive learning environments. The findings highlight the importance of embracing new pedagogical possibilities offered by mobile technology and the need for effective teacher professional development in the post-pandemic era. The study offers valuable insights into how mobile technology can be effectively utilized in education, even in the most challenging circumstances.

The objective of this research is to establish a better understanding of the current landscape of digital learning research and sustainable development by using CiteSpace. First, we retrieved published publications from the Web of Science (2004–2022). Following that, we examined the primary research strengths and important subjects of digital learning from two perspectives: collaboration networks (including collaborative networks across countries, institutions, and authors) and co-citation networks. We examined the co-citation network from three perspectives: cluster analysis, the most active citers, top references. Furthermore, referenced journals, popular themes, and rising trends were examined. These findings indicate the primary study subjects in the field of digital learning, the most intriguing research literature, and each period's emerging research hotspots. Finally, we proposed further study ideas for future paths.

Machine learning (ML) has a large capacity to learn and analyze a large volume of data. This study aimed to train different algorithms to discriminate between healthy and pathologic corneal images by evaluating digitally processed spectral-domain optical coherence tomography (SD-OCT) corneal images. A set of 22 SD-OCT images belonging to a random set of corneal pathologies was compared to 71 healthy corneas (control group). A binary classification method was applied; three approaches of ML were used. Once all images were analyzed, representative areas from every digital image were also processed and analyzed for a statistical feature comparison between healthy and pathologic corneas. The best performance was obtained from transfer learning - support vector machine (TL-SVM) (AUROC = 0.94, SPE 88%, SEN 100%) and transfer learning – random forest (TL- RF) method (AUROC = 0.92, SPE 84%, SEN 100%), followed by convolutional neural network (CNN) (AUROC = 0.84, SPE 77%, SEN 91%) and random forest (AUROC = 0.77, SPE 60%, SEN 95%). The highest diagnostic accuracy in classifying corneal images was achieved with the TL-SVM and the TL-RF models. In image classification, CNN was a strong predictor. This pilot experimental study developed a systematic mechanized system to discern pathologic from healthy corneas.

An accurate and timely precipitation forecast is essential for water resources management in hydropower, irrigation, and reservoir control. The conventional methods are limited by their inability to capture the high precipitation variability in time and space. In the present work, a wavelet-based deep learning approach is adopted to forecast precipitation using the lagged monthly rainfall, local climate variables, and global teleconnections such as IOD, PDO, NAO, and Nino 3.4 as predictors. The method was tested and validated over the Krishna River Basin in India. Overall, the forecasting accuracy was higher using the wavelet-based hybrid models than the single-scale models. The proposed multi-scale model was then applied to the different climatic regions of the country, and it was shown that the model could forecast the rainfall at reasonable accuracy for different climate zones of the country.

The Wester coastal Delta zone of the Netherlands is the relatively more crowded area of the country where ten of the seventeen million people live. The governmental prognosis is that this number of people will increase steadily in the coming decennia, unless the threat of climate-change seawater level rising. This is the picture in more Delta zones globally what makes the topic of resiliency for these delta-areas of importance. Approaches of resiliency are often dominated by governmental rescue planning and believe in technology solutions, while in the process the behaviour of people can make the difference in overcoming climate-change impact disasters. In the struggle against high water storming and flooding, the Dutch people prove this by developing societal resilient behaviour in a broad spectrum of activities. Post-PhD research on Dutch resilient behaviour in the in 1016-flooded Zaanstreek-Waterland area near the city of Amsterdam confirms that. Recently research by questionnaire among citizens in this region shows that people have favour for shared responsibility with government and related professional organizations. The Dutch examples of societal resiliency carried by people also show a action-learning perspective intertwined with governmental contingency planning. Therewith the Dutch practice shows a positive cross-fertilization of practice and knowledge development.

The use of digital twins for the development of Autonomous Maritime Surface Vessels (AMSVs) has enormous potential to resolve the increasing need for water-based navigation and safety at the seas. Aiming at the problem of lack of broad and integrated digital twin implementations with live data along with the absence of a digital twin-driven framework for AMSV design and development, an application framework for the development of a fully autonomous vessel using an integrated digital twin in a 3D simulation environment has been presented. Our framework has four layers to ensure that the simulation and the real-world boat as well as the environment are as close as possible. Åboat, an experimental research platform for maritime automation and autonomous surface ship applications, equipped with two trolling electric motors, cameras, LiDARs, IMU and GPS has been used as the case study to provide a proof of concept. Åboat and its sensors, alongwith the environment have been replicated in a 3D simulation environment. Using the proposed application framework, we develop obstacle detection and path planning systems based on machine learning which leverage live data from a 3D simulation environment to mirror the complex dynamics of the real world.

With limited state budget, developed nation public higher education have increased their fees making education expensive for most developing nation students. Some developing nations have set up regional low-cost education hubs to attract developed nation universities to offer their reputable degree programs. However, the intense competition for student enrolment in both has led to the marketisation of education. Students as paying customers need to experience satisfying stress-free teaching and learning to sustain enrolment. With employers increasingly unhappy with the quality of human capital, has the marketisation of higher education led to nominal human capital development? Can substantive human capital be developed in the new normal of marketisation of higher education? An adaptation of randomised control trials was used to measure learning outcomes desired by future employers for two teaching and learning approaches namely students as customers (n=497) and employers as customers (n=355). Findings show both approaches have good learning outcomes with the latter generally more superior. However, the former leads to nominal learning outcomes. This research extends the literature on achieving substantive learning outcomes conducive to employability. Implications for student satisfaction, lecturer professionalism, employability and quality assurance are discussed.

This paper presents a practical case illustrating how the Sustainable Development Goals (SDGs) of the 2030 Agenda have been designed and articulated in the context of the University of the Basque Country (UPV/EHU). Even though there is a widespread formal adherence of universities to the SDGs, there is a lack of solid commitment to go beyond the compartmentalization of their implementation and to contribute to a holistic approach. The EHUagenda 2030 is a roadmap to move towards an integrated, verifiable and pragmatic contribution to this international agenda. It describes the UPV/EHU's contribution to 12 of the 17 SDGs, with the addition of its own commitment to linguistic and cultural diversity (SDG 17 + 1), along with the three sectoral plans: the Equality Campus, the Inclusion Campus and the Planet Campus. It also describes the refocus of its education model IKD i3; i3 is ikaskuntza x ikerketa x iraunkortasuna, Basque for learning x research x sustainability. Additionally, it includes the UPV/EHU’s Panel of Sustainable Development Indicators, which addresses the technical aspects of monitoring the implementation of the SDGs. The systematic methodology used in this process (mapping; mainstreaming; diagnosis and definition and, finally, estimation) and presented in this paper could be replicated in other universities yet to embark on this integration. The steps and findings presented here can also be applied to other organizations and help the integration process.

In Data Science we are concerned with the integration of relevant sciences in observed and empirical contexts. This results in the unification of analytical methodologies, and of observed and empirical data contexts. Given the dynamic nature of convergence, described are the origins and many evolutions of the Data Science theme. The following are covered in this article: the rapidly growing post-graduate university course provisioning for Data Science; a preliminary study of employability requirements, and how past eminent work in the social sciences and other areas, certainly mathematics, can be of immediate and direct relevance and benefit for innovative methodology, and for facing and addressing the ethical aspect of Big Data analytics, relating to data aggregation and scale effects. Associated also with Data Science is how direct and indirect outcomes and consequences of Data Science include decision support and policy making, and both qualitative as well as quantitative outcomes. For such reasons, the importance is noted of how Data Science builds collaboratively on other domains, potentially with innovative methodologies and practice. Further sections point towards some of the most major current research issues.

Experiential learning can facilitate the development of transferrable skills necessary for success in attaining tenure and promotion in academia. In this article, we discuss the benefits of designing and implementing an individualized professional development experience or practicum. By doing this, we describe the experiential learning component of the Accomplishing Career Transitions (ACT) Program of the American Society for Cell Biology. The ACT program aims to assist postdoctoral trainees and junior faculty from backgrounds underrepresented in STEM as they strive to transition into tenure-track positions and ultimately attain tenure at research-intensive or teaching-intensive academic institutions.

Background: The purpose of this study is to carry out bioinformatic analysis of lncRNA data obtained as a result of genomic analysis of kidney tissue samples taken from rats with nephrotoxicity induced by methotrexate (MTX) and from rats without pathology and modeling with tree-based machine learning method. Another aim of the study is to identify potential biomarkers for the diagnosis of nephrotoxicity and to provide a better understanding of the nephrotoxicity formation process by providing the interpretability of the model with explainable artificial intelligence methods as a result of the modeling. Methods: To identify potential indicators of drug-induced nephrotoxicity, 20 female Wistar Albino rats were separated into two groups: nephrotoxicity and control. Kidney tissue samples were collected from the rats, and genomic, histological, and immunohistochemical analyses were performed. The data set obtained as a result of genomic analysis was modeled with Random Forest (RF), one of the tree-based methods. Modeling results were evaluated with sensitivity (Se), specificity (Sp), balanced accuracy (B-Acc), negative predictive value (Npv), accuracy (Acc), positive predictive value (Ppv), and F1-score performance metrics. The Local Interpretable Model-Agnostic Annotations (LIME) method was used to determine the lncRNAs that could be biomarkers for nephrotoxicity by providing the interpretability of the RF model. Results: The outcomes of the histological and immunohistochemical analyses done in the study supported the conclusion that MTX use caused kidney injury. According to the results of the bioinformatics analysis, 52 lncRNAs showed different expression in the groups. As a result of modeling with RF for lncRNAs selected with Boruta variable selection, the B-Acc, Acc, Sp, Se, Npv, Ppv, and F1-score were 88.9%, 90%, 90.9%, 88.9%, 90.9%, 88.9% and 88.9%. respectively. lncRNAs with id rnaXR_591534.3 rnaXR_005503408.1, rnaXR_005495645.1, rnaXR_001839007.2, rnaXR_005492056.1 and rna_XR_005492522.1 the lncRNAs with the highest variable importance values produced from RF modeling can be used as nephroxicity biomarker candidates. Also, according to the LIME results, the high level of lncRNAs with id rnaXR_591534.3 and rnaXR_005503408.1 especially increased the possibility of nephrotoxicity. Conclusions: With the possible biomarkers obtained as a result of the analyses made within the scope of this study, it can be ensured that the procedures for the diagnosis of drug-induced nephrotoxicity can be carried out easily, quickly and effectively.

With technological transformations such as big data, blockchain, artificial intelligence, and cloud computing, digital techniques are penetrating the field of finance. Digital finance is a resource-saving and environmentally friendly innovative financial service. It shows great green attributes and can drive the flow of financial resources towards environmentally friendly enterprises, thereby promoting green and low-carbon development. This paper investigates the effects of digital finance on green and low-carbon cyclic development and the mechanism. First, the level of green and low carbon cyclic development in China is estimated from multiple aspects based on the panel data of 31 provinces by using the spatio-temporal range entropy weight method. Then, the working mechanism of digital finance on green and low carbon cyclic development is revealed by performing empirical tests based on panel regression models, mediating effect models, and threshold models. Finally, the effects of digital finance and conventional variables on green and low-carbon cyclic development are investigated by using a random forest model and a CatBoost model in based on the machine learning. The results show that digital finance has significant positive effects on green and low-carbon cyclic development, and technological innovation plays a key role in the effects of digital finance on green and low-carbon cyclic development; meanwhile, the driving effect of digital finance on green and low carbon cyclic development shows nonlinear features with increasing “marginal effect”; besides, both digital finance and conventional factors have significant impacts on green and low carbon cyclic development. This study provides an empirical basis and path reference for digital finance to achieve “carbon peak, carbon neutralization” in China.

Individual investors often struggle to predict stock prices due to the limitations imposed by the computational capacities of personal laptop Graphics Processing Units (GPUs) when running intensive deep learning models. This study proposes solving these GPU constraints by integrating deep learning models with technical analysis methods. This integration significantly reduces analysis time and equips individual investors with the ability to identify stocks that may yield potential gains or losses in an efficient manner. Thus, a comprehensive buy and sell algorithm, compatible with average laptop GPU performance, is introduced in the study. This algorithm offers a lightweight analysis method that emphasizes factors identified by technical analysis methods, thereby providing a more accessible and efficient approach for individual investors. To evaluate the efficacy of this approach, we analyzed the performance of eight deep learning models: LSTM (4 layers), CNN, BiLSTM (4 layers), CNN Attention, BiGRU CNN BiLSTM Attention, BiLSTM Attention CNN, CNN BiLSTM Attention, and CNN Attention BiLSTM. These models were used to predict stock prices for Samsung Electronics and Celltrion Healthcare. The CNN Attention BiLSTM model displayed superior performance among these models, with the lowest validation mean absolute error value. In addition, an experiment was conducted using WandB Sweep to determine the optimal hyperparameters for four individual hybrid models. These optimal parameters were then implemented in each model to validate their back-testing rate of return. The CNN Attention BiLSTM hybrid model emerged as the highest-performing model, achieving an approximate rate of return of 5 percent. Overall, this study offers valuable insights into the performance of various deep learning and hybrid models in predicting stock prices. These findings can assist individual investors in selecting appropriate models that align with their investment strategies, thereby increasing their likelihood of success in the stock market.

The combination of new-generation information technology and manufacturing technology has resulted in major and profound impact on future development paradigm of manufacturing. It is challenging for existing methods to conduct a multidimensional trend exploration related to machine tool domain, which is the basis of virtually everything in manufacturing. In this paper, we proposed an integrating approach framework combined topic models, bibliometric, trend analysis and patent analysis to mine insightful information about future development from multi-source data related to machine tool, such as papers, grants, patents and news. Specifically, papers and grants provided two different perspectives to explore the current focuses and future trends in machine tool research. Furthermore, the future technology development of machine tool was investigated through patents analysis. Finally, news related to machine tool industry in recent years was analyzed to analyze future machine tool business mode. The integration of the above various analytical methods and the multi-dimensional mining of literatures enabled the analysis of the future development of machine tool domain systematically from multi-perspectives which include research, technology development and industry. The conclusions obtained in this paper is beneficial to different communities of machine tool in terms of determining the research directions for researchers, identifying industry opportunities for corporations and developing reasonable industry policy for policy makers.

Rationale: Major depressive disorder (MDD) is characterized by signaling aberrations in interleukin (IL)-6, IL-10, beta-endorphins as well as mu (MOR) and kappa (KOR) opioid receptors. Here we examined whether these biomarkers may aid in the classification of unknown subjects into the target class MDD.Methods: The aforementioned biomarkers were assayed in 60 first-episode, drug-naïve depressed patients and 30 controls. We analyzed the data using joint principal component analysis (PCA) performed on all subjects to check whether subjects cluster by classes; support vector machine (SVM) with 10-fold validation; and linear discriminant analysis (LDA) and SIMCA performed on calibration and validation sets and we computed the figures of merit and learnt from the data. Results: PCA shows that both groups were well separated using the first three PCs, while correlation loadings show that all 5 biomarkers have discriminatory value. SVM and LDA yielded an accuracy of 100% in validation samples. Using SIMCA there was a highly significant discrimination of both groups (model-to-model distance=87.5); all biomarkers showed a significant discrimination and modeling power, while 10% of the patients were identified as outsiders and no aliens could be identified.Discussion: We have delineated that MDD is a distinct class with respect to neuro-immune and opioid biomarkers and that future unknown subjects can be authenticated as having MDD using this SIMCA fingerprint. Precision psychiatry should employ SIMCA a) to authenticate patients as belonging to the claimed target class and identify other subjects as outsiders, members of another class or aliens; and b) to acquire knowledge through learning from the data by constructing a biomarker fingerprint of the target class.

The fourth Industrial Revolution, well-known as “Industry 4.0”, based on the integration of information and communication technologies, has introduced significant improvements in manufacturing. However, vision systems still experience various impracticalities in dealing with the effect of complex lighting on the systems platform. Therefore, a machine vision system for automatic identification of pen parts under varying lighting conditions at a digital learning factory is proposed. The developed vision system presents a straightforward approach by effectively minimizing the environmental lighting effect on the identification process. First, the obtained information of the designed vision framework is exported to a program, where a reduction of non-uniform illumination is achieved through the implementation of Retinex image enhancement techniques. Then, the color-based Fuzzy C-means (FCM) algorithm, including improved mark watershed segmentation, is employed for pen parts object classification. Finally, the position features of the selected pen part are reported. The process applied to a total number of 210 upper pen parts (caps) and 241 lower pen parts (tubes) images under different lighting scenarios. Results indicate that average parts identification precision for cap and tube parts is different and equals to 98.64% and 95.26%, respectively. The present methodology provides a promising scheme that can be feasibly adapted for other industrial Color-based object recognition applications.

This article seeks to strengthen efforts in technological developments based on the classification of PET plastic that positively impacts sustainable development and contributes to suitable solutions in collection centers in Mexico. Three experiment designs and machine learning tools for data processing were developed. For the experimentation, three factors were considered: the bottle's size, the amount of liquids inside the bottle, and the label on the bottle. The first experiment was to identify the distance of the sensor from post-consumer PET bottles. The second experiment was to determine the detection ability of the sensor with different levels of liquids inside the bottles, and the third was to determine the detection ability on the bottle labels. A digital lux meter on a microcontroller was developed to monitor illuminance on post-consumer PET plastic when it contains liquid as it passes through a conveyor belt for processing at an average rate of three bottles per second. With the implemented methodology, liquids were satisfactorily detected inside the transparent PET bottles when they had beverages between 25% and 100% of their capacity. Finally, this paper highlights that it is possible to implement an affordable design to identify bottles with liquids for collection centers.

Mountain and pastoralist societies around the world have for centuries sustained their livelihoods and cultures by accumulating specialist knowledge about their local and regional socio-ecological environments. Developing traditional knowledge and customary practices takes time, sometimes spanning across generations. As macro-level changes to social and natural environment are now taking place, such as globalization and climate change, local communities could potentially also benefit from complementary, suitably adapted educational opportunities for sustainable development. However, access to education has often required moving to urban centres, which can weaken community structures and cohesion, and could also foster increased dependence on external specialists, providers or decision-makers. Careful introduction of emerging Educational Technologies could alleviate and possibly reverse such trends as mobile Internet access spreads to remote areas. This paper examines the role of education in sustainable development and specifically explores the potential for two educational innovations, open badges and blockchain, to provide a new construct for transformation in sustainable development amongst mountain and pastoralist societies. These technologies could not only facilitate education through online distance learning, but also allow geographically remote populations to highlight the value of their traditional knowledge and to engage more comprehensively in their changing worlds.

Background: The Stability Index estimation algorithm was derived and applied to develop and implement a balance ability diagnosis system that can be used at daily life. Methods: The system integrated an approach based on sensory function interaction, called the clinical test of sensory interaction with balance (CTSIB). The piezo-resistive force mat was fabricated, and a Stability Index prediction algorithm was developed and applied using the center of pressure (CoP) variables. The Stability Index prediction algorithm derived a CoP variable for 103 elderly people by Nintendo Wii Balance Board (WBB) to predict the Stability Index of the Balance System (Biodex SD). And, the accuracy was confirmed through the correlation between the real and predicted value. Results: As a result of testing with the test-set, the linear regression model confirmed that the r value ranged between 0.943 to 0.983. To confirm the similarity between the WBB and flexible force mat, each measured CoP value was input and calculated into the developed regression model, and the result of the correlation coefficient validation ​​confirmed an r value of 0.96. Conclusion: The system developed in this study will be applicable to the daily life of the home in the form of a floor mat.

The Coronavirus (COVID-19) pandemic has created big challenges and opportunities in Higher Education (HE). In this situation, several universities worldwide have responded with digital methods and hybrid classes in a short period of time. The aim of this paper is to show how the universities have adapted teaching methods to digital platforms in the academic year 2020–21. This case study is based on the experience of 37 postgraduate communication students in the course Business and Communication from a Communication Programme. The objective of this course was to promote the 17 sustainable development goals (SDGs) in business and following the Principles for Responsible Management Education (PRME) of the United Nations. To do this, the students provided different solutions related to the SDGs and developed a communication strategy to inform and engage the stakeholders in the companies analyzed in a hybrid class. The results show that using this methodology and working in digital platforms, students have learned the importance of SDGs through implementing specific solutions linked to the corporate social responsibility (CSR) strategy. Based on this analysis, they also developed a communication strategy showing how companies can improve society with specific actions through the lens of the SDG perspective.

Incorporating substantial sustainable development issues into teaching and learning is the ultimate task of Education for Sustainable Development (ESD). The purpose of our study is to identify the confused students who have failed to master the skill(s) given by the tutors as a homework using Intelligent Tutoring System (ITS). We have focused ASSISTments, an ITS in this study and scrutinized the skill-builder data using machine learning techniques and methods. We used seven candidate models that include: Naïve Bayes (NB), Generalized Linear Model (GLM), Logistic Regression (LR), Deep Learning (DL), Decision Tree (DT), Random Forest (RF), and Gradient Boosted Trees (XGBoost). We trained, validated and tested learning algorithms, performed stratified cross-validation and measured the performance of the models through various performance metrics i.e., ROC (Receiver Operating Characteristic), Accuracy, Precision, Recall, F-Measure, Sensitivity & Specificity. We found GLM, DT & RF are high accuracies achieving classifiers. However, other perceptions such as detection of unexplored features that might be related to the forecasting of outputs can also boost the accuracy of the prediction model. Through machine learning methods, we identified the group of students which were confused attempting the homework exercise and can help students foster their knowledge, and talent to play a vital role in environmental development.

Sensors available on mobile devices allow the automatic identification of Activities of Daily Living (ADL). This paper describes an approach for the creation of a framework for the identification of ADL, taking in account several concepts, including data acquisition, data processing, data fusion, pattern recognition, and machine learning. These concepts can be mapped in a module of the framework, including the use and creation of several algorithms. For the development of a framework that works in several conditions, e.g., without Internet connection, these algorithms should take in account the hardware and software limitations of the mobile devices to run all main tasks locally. The main purpose of this paper is related to the presentation the sensors, algorithms, and architecture of the proposed approach.

Deep learning is an emerging area of machine learning (ML) research. It comprises multiple hidden layers of artificial neural networks. The deep learn- ing methodology applies nonlinear transformations and model abstractions of high level in large databases. The recent advancements in deep learning architec- tures within numerous fields have already provided significant contributions in artificial intelligence. This article presents a state of the art survey on the contri- butions and the novel applications of deep learning. The following review chron- ologically presents how and in what major applications deep learning algorithms have been utilized. Furthermore, the superior and beneficial of the deep learning methodology and its hierarchy in layers and nonlinear operations are presented and compared with the more conventional algorithms in the common applica- tions. The state of the art survey further provides a general overview on the novel concept and the ever-increasing advantages and popularity of deep learning.

The use of drones for various applications has become increasingly popular in recent years, and machine learning has played a significant role in this trend. In this paper, we provide a comprehensive survey of the classification and application of machine learning in drones. The paper begins with an overview of the different types of machine learning algorithms and their applications in drones, including supervised learning, unsupervised learning, and reinforcement learning. Next, we present a detailed analysis of various real-world applications of machine learning in drones, such as object recognition, route planning, obstacle avoidance, search area optimization, and autonomous search. The paper also discusses the challenges and limitations of using machine learning in drones, such as data privacy, data quality, and computational requirements. Finally, the paper concludes with a discussion of the future directions of machine learning in drones and its potential impact on various industries and fields. This paper provides a valuable resource for researchers, practitioners, and students interested in the intersection of machine learning and drones.

Machine learning (ML) has found increasing use in research on energy conversion and storage technologies, in particular, so-called sustainable technologies. While often ML is used to directly optimize the parameters or phenomena of interest in the space of features, in this perspective, we focus on using ML to construct objects and methods that help in or enable the modeling of the underlying phenomena. We highlight the need for machine learning from very sparse and unevenly distributed numeric data in multidimensional spaces in these applications. After a brief introduction of some common regression-type machine learning techniques, we will focus on more advanced ML techniques which use these known methods as building blocks of more complex schemes and thereby allow working with extremely sparse data and also allow generating insight. Specifically, we will highlight the utility of using representations with sub-dimensional functions by combining the high-dimensional model representation ansatz with machine learning methods like neural networks or Gaussian process regressions in applications ranging from heterogeneous catalysis to nuclear energy.

Federated learning techniques aim to train and build machine learning models based on distributed datasets across multiple devices, avoiding data leakage. The main idea is to perform training on remote devices or isolated data centers without transferring data to centralized repositories, thus mitigating privacy risks. Data analytics in education, in particular learning analytics, is a promising scenario to apply this approach to address the legal and ethical issues related to processing sensitive data. Indeed, given the nature of the data to be studied (personal data, educational outcomes, data concerning minors), it is essential to ensure that the conduct of these studies and the publication of the results provide the necessary guarantees to protect the privacy of the individuals involved and the protection of their data. In addition, the application of quantitative techniques based on the exploitation of data on the use of educational platforms, student performance, use of devices, etc., can account for educational problems such as the determination of user profiles, personalized learning trajectories, or early dropout indicators and alerts, among others. This paper presents the application of federated learning techniques to two learning analytics problems: dropout prediction and unsupervised student classification. The experiments allow us to conclude that the proposed solutions achieve comparable results from the performance point of view with the centralized versions, avoiding centralizing the data for training the models.

We study the brain segmentation by dividing the brain into multiple tissues. Given possible brain segmentation by deep, machine learning can be efficiently exploited to expedite the segmentation process in the clinical practice. To accomplish segmentation process, a MRI and tissues transfer using generative adversarial networks is proposed. Given the better result, we propose the transfer model using GAN. For the case of the brain tissues, white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF) are segmented. Empirical results show that this proposed model significantly improved segmentation results compared to the stat-of-the-art results. Furthermore, a dice coefficient (DC) metric is used to evaluate the model performance.

In recent years, online learning has become one of the most popular methods of educational delivery due to advances in technology, which has been made even more evident in the COVID-19 lockdown period. Online education has evolved into a distinct field of study within the educational system over the last few years. It is also important to note that parallel with the growth in this field, there has also been an increase in the number of scholarly journals that regularly publish research in this field, reflecting the importance of this field in the modern day. In spite of the fact that online learning offers a wide range of educational options, from short courses to full-time degrees, as well as being accessible, flexible, environmentally friendly, and affordable, there are also certain challenges associated with this educational approach. These challenges include the lack of social interaction, technical errors, a lack of hands-on training, and difficulties in assessing students. It is, therefore, imperative to ask the crucial question of whether online learning can replace traditional classroom learning or whether it can supplement it in hybrid models with it, as well as what factors and conditions are likely to determine this in the short- and long-term, as well as how it will be blended together in the future. The purpose of this commentary is to provide a brief summary of the current status of both learning models, as well as their pros and cons, in order to answer the question that was posed above.

The popularity of deep reinforcement learning (DRL) methods in economics have been exponentially increased. DRL through a wide range of capabilities from reinforcement learning (RL) and deep learning (DL) for handling sophisticated dynamic business environments offers vast opportunities. DRL is characterized by scalability with the potential to be applied to high-dimensional problems in conjunction with noisy and nonlinear patterns of economic data. In this work, we first consider a brief review of DL, RL, and deep RL methods in diverse applications in economics providing an in-depth insight into the state of the art. Furthermore, the architecture of DRL applied to economic applications is investigated in order to highlight the complexity, robustness, accuracy, performance, computational tasks, risk constraints, and profitability. The survey results indicate that DRL can provide better performance and higher accuracy as compared to the traditional algorithms while facing real economic problems at the presence of risk parameters and the ever-increasing uncertainties.

There is only a very short reaction time for people to find the best way out of a building in a fire outbreak. Software applications can be used to assist the rapid evacuation of victims; however, this is an arduous task, which requires an understanding of advanced technologies. Since well-known pathway algorithms (such as, Dijkstra, Bellman-Ford and A*) can lead to serious problems over performance, we decided to make use of deep reinforcement learning techniques. A wide range of strategies including a random initialization of replay buffer and transfer learning were assessed in three projects involving schools of different sizes. The results showed the proposal was viable and that in most cases the performance of transfer learning was superior. In addition, the study raised challenges that had to be faced in the future.

Sparse reward long horizon task is a major challenge for deep reinforcement learning algorithm. One of the key barriers is data-inefficiency. Even in the simulation environment, it usually takes weeks to training the agent. In this study, a data-efficiency training framework is proposed, where a curriculum learning is design for the agent in the simulation scenario. Different distributions of the initial state are set for the agent to get more informative reward during the whole training process. A fine-tuning of the parameters in the output layer of the neural network for value function is conduct to bridge the gap between sim-to-real. An experiment of UAV maneuver control is conducted in the proposed training framework to verify the method more efficient. We demonstrate that data-efficiency is different for the same data in different training stages.

This article discusses the comparison between digital and traditional face-to-face coaching within the scope of shadow education institutions. While analyzing the differences and similarities between the two educational models, both their advantages and disadvantages are thoroughly discussed. In this context, interviews were conducted with students and teachers who receive education in both face-to-face and digital coaching, and the positive and negative aspects of both institutions, suitable and unsuitable courses, the future situation, and the effects on students' academic achievements were revealed. According to the results obtained from the research, it is noteworthy that students who do not receive education in digital coaching have prejudices against digitalization. Additionally, no significant difference was found between the academic achievements of students receiving education in digital coaching and those receiving education in face-to-face coaching.

Obstructive Sleep Apnea (OSA) is nowadays one of the respiratory pathologies with a higher in-cidence globally in developed countries. This situation led to an increase in the demand for medical appointments and diagnostic studies related to that condition, especially those based on poly-somnographies and cardiorespiratory polygraphies. These studies are limited in resources, causing long waiting lists with the subsequent impact on the patients’ health. Furthermore, it is necessary to mention that OSA’s symptomatology is not very specific, and it is typically present in the general population (excessive sleepiness, snore, etc.). In this regard, this paper proposes a novel intelligent clinical decision support system for the diagnosis of OSA which could be used to help medical teams, both in primary care settings and in units specialized in respiratory pathologies. The aim of the proposed system is to help discriminate the patients suspected of suffering from the pathology from those who are not. To this end, two types of information sets of heterogeneous nature are consid-ered. The first one encompasses objective data, related to the patient's health profile with infor-mation usually available in electronic health records. The second type comprises subjective data, referred to the symptomatology reported by the patient in a previous interview. To process the first group of information, a Machine Learning classification algorithm is used, Bagged Trees in this case. For processing the second information set, related with the symptomatology of the patient, a col-lection of expert systems based on fuzzy inferential systems arranged in cascade are employed. As a result, the system is able to determine two risk indicators related to the patient's risk of suffering from OSA: the Statistical Risk and the Symbolic Risk respectively. Subsequently, by interpreting both risk indicators mentioned it will be possible to determine the severity of the patients’ health, proposing a preliminary evaluation on their condition. For the initial tests of the system, a software artifact has been built using a dataset with 4,978 selected patients, suspected of suffering from OSA, from the Álvaro Cunqueiro Hospital in Vigo. The results obtained are promising, demonstrating the potential usefulness of this type of tools in medical diagnosis. Once the system has been validated with new data from clinical environments, it is considered as possible to obtain a relevant improvement in the quality of the healthcare services, and a reduction in the associated costs.

Despite the importance of few-shot learning, the lack of labeled training data in the real world, makes it extremely challenging for existing machine learning methods as this limited data set does not represent the data variance well. In this research, we suggest employing a generative approach using variational autoencoders (VAEs), which can be used specifically to optimize few-shot learning tasks by generating new samples with more intra-class variations. The purpose of our research is to increase the size of the training data set using various methods to improve the accuracy and robustness of the few-shot face recognition. Specifically, we employ the VAE generator to increase the size of the training data set, including the basic and the novel sets while utilizing transfer learning as the backend. Based on extensive experimental research, we analyze various data augmentation methods to observe how each method affects the accuracy of face recognition. We conclude that the face generation method we proposed can effectively improve the recognition accuracy rate to 96.47% using both the base and the novel sets.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today's Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals.

During the COVID-19 outbreak, most university courses have been offered on online platforms. A sudden shift from face-to-face classroom learning to online formats could influence the learning effectiveness of classes. This study aims to investigate differences in the learning effectiveness of online and face-to-face lecture courses. It also explores factors that impact the effectiveness of online instruction. These factors include interactions among learners, interactions between learners and the instructor, the quality of online platforms, learners’ ability to use devices and follow instructions, and learners’ situational challenges. The study participants were 261 university students at King Mongkut’s University of Technology Thonburi in Bangkok, Thailand. All participants were enrolled in at least one lecture course, such as history, humans and the environment, the environment and development, or general philosophy, during the 2019 academic year. A questionnaire was distributed to participants after they completed these courses in May 2020. Paired simple t-test analyses were used to compare the effectiveness of online and face-to-face classes, and a multiple regression analysis was used to identify factors that impact the learning effectiveness of online classes. The results show that online classes are less effective than face-to-face courses. The multiple regression analysis also revealed that the effectiveness of online learning was significantly impacted by learners’ ability to interact with classmates during class, their ability to interact with instructors after the class, the quality of online platforms, and disturbances or distractions in learners’ environments.

Fruit quality is a critical factor in the produce industry, affecting producers, distributors, consumers, and the economy. High-quality fruits are more appealing, nutritious, and safe, boosting consumer satisfaction and revenue for producers. Artificial Intelligence can aid in assessing the quality of the fruit using images. This paper presents a general machine-learning model for assessing fruit quality using deep image features. The model leverages the learning capabilities of the recent successful networks for image classification called Vision Transformers (ViT). The ViT model is built and trained with a combination of various fruit datasets and learned to distinguish between good and rotten fruit images. The general model demonstrated impressive results in accurately identifying the quality of various fruits such as Apples (with a 99.50% accuracy), Cucumbers (99%), Grapes (100%), Kakis (99.50%), Oranges (99.50%), Papayas (98%), Peaches (98%), Tomatoes (99.50%), and Watermelons (98%). However, it showed slightly lower performance in identifying Guavas (97%), Lemons (97%), Limes (97.50%), mangoes (97.50%), Pears (97%), and Pomegranates (97%).

Modelling both long and short-term user interests from historical data is crucial for accurate recommendations. However, unifying these metrics across multiple application domains can be challenging, and existing approaches often rely on complex, intertwined models which can be difficult to interpret. To address this issue, we propose a lightweight, plug-and-play interest enhancement module that fuses interest vectors from two independent models. After analyzing the dataset, we identify deviations in the recommendation performance of long and short-term interest models. To compensate for these differences, we use feature enhancement and loss correction during training. In the fusion process, we explicitly split long-term interest features with longer duration into multiple local features. We then use a shared attention mechanism to fuse multiple local features with short-term interest features to obtain interaction features. To correct for bias between models, we introduce a comparison learning task that monitors the similarity between local features, short-term features, and interaction features. This adaptively reduces the distance between similar features. Our proposed module combines and compares multiple independent long-term and short-term interest models on multiple domain datasets. As a result, it not only accelerates the convergence of the models but also achieves outstanding performance in challenging recommendation scenarios.

Over the past decade, research in the field of Deep Learning has brought about novel improvements in image generation and feature learning; one such example being a Generative Adversarial Network. However, these improvements have been coupled with an increasing demand on mathematical literacy and previous knowledge in the field. Therefore, in this literature review, I seek to introduce Generative Adversarial Networks (GANs) to a broader audience by explaining their background and intuition at a more foundational level. I begin by discussing the mathematical background of this architecture, specifically topics in linear algebra and probability theory. I then proceed to introduce GANs in a more theoretical framework, along with some of the literature on GANs, including their architectural improvements and image-generation capabilities. Finally, I cover state-of-the-art image generation through style-based methods, as well as their implications on society.

This study evaluated the using of machine vision in combination with deep learning to identify weeds in real-time for wheat production system. PMAS-Arid Agriculture university research farm were selected for collection of images (6000 total images) of weeds and wheat crops under different weather condition. During growing season, the database was constructed to identify the weeds. For this study two framework were used TensorFlow and PyTorch under CNNs and Deep learning. Deep learning perfromed better with in PyTourch value as compared to another model in Tensorflow. comparing with other networks such as YOLOv4, we concluded that our network reaches a better result between speed and accuracy. Specifically, the maximum precision of weed and wheat plants were 0.89 and 0.91 respectively with 9.43 ms and 12.38 ms inference time per image (640 × 640) NVIDIA RTX2070 GPU.

Tremendous progress has been witnessed in artificial intelligence within the domain of neural network backed deep learning systems and its applications. As we approach the post Moore’s Law era, the limit of semiconductor fabrication technology along with a rapid increase in data generation rates have lead to an impending growing challenge of tackling newer and more modern machine learning problems. In parallel, quantum computing has exhibited rapid development in recent years. Due to the potential of a quantum speedup, quantum based learning applications have become an area of significant interest, in hopes that we can leverage quantum systems to solve classical problems. In this work, we propose a quantum deep learning architecture; we demonstrate our quantum neural network architecture on tasks ranging from binary and multi-class classification to generative modelling. Powered by a modified quantum differentiation function along with a hybrid quantum-classic design, our architecture encodes the data with a reduced number of qubits and generates a quantum circuit, loading it onto a quantum platform where the model learns the optimal states iteratively. We conduct intensive experiments on both the local computing environment and IBM-Q quantum platform. The evaluation results demonstrate that our architecture is able to outperform Tensorflow-Quantum by up to 12.51% and 11.71% for a comparable classic deep neural network on the task of classification trained with the same network settings. Furthermore, our GAN architecture runs the discriminator and the generator purely on quantum hardware and utilizes the swap test on qubits to calculate the values of loss functions. In comparing our quantum GAN, we note our architecture is able to achieve similar performance with 98.5% reduction on the parameter set when compared to classical GANs. With the same number of parameters, additionally, QuGAN outperforms other quantum based GANs in the literature for up to 125.0% in terms of similarity between generated distributions and original data sets.

The conventional machine learning (ML) algorithms are continuously advancing and evolving at a fast-paced by introducing the novel learning algorithms. ML models are continually improving using hybridization and ensemble techniques to empower computation, functionality, robustness, and accuracy aspects of modeling. Currently, numerous hybrid and ensemble ML models have been introduced. However, they have not been surveyed in a comprehensive manner. This paper presents the state of the art of novel ML models and their performance and application domains through a novel taxonomy.

This paper presents a new method : HIVEC to learn latent vector representations of graphs in a manner that captures the semantic dependencies of sub-structures. The representations can then be used in machine learning algorithms for tasks such as graph classification, clustering etcetera. The method proposed is unsupervised and uses the information of co-occurrence of sub-structures. It introduces a notion of hierarchical embeddings that allows us to avoid repetitive learning of sub-structures for every new graph. As an alternative to deep learning methods, the edit distance similarity between sub-structures is also used to learn vector representations. We compare the performance of these methods against previous work.

The COVID-19 pandemic has led to the growth of hybrid and online learning environments and the trend to introduce more technology into the classroom. One such change would be the use of smart synchronous hybrid learning environments (SSHLE), which are settings with both in-person and online students concurrently, and in which technology plays a key role in sensing, analyzing, and reacting throughout the teaching and learning process. These changing environments and the incorporation of new technologies can place a greater orchestration load on participants and a reduction in teacher agency. In this context, the aim of this paper is to analyse the orchestration load and teacher agency in different SSHLEs. The NASA-TLX model was used to measure the orchestration load in several scenarios. Questionnaires and interviews were used to measure teacher agency. The results obtained indicate that the orchestration load of the teacher tends to be high (between 60 and 70 points out of 100 of the NASA-TLX workload), especially when they lack experience in synchronous hybrid learning environments, and the orchestration load of the students tends to have average values (between 50 and 60) in the SSHLEs analysed. Meanwhile, the teacher agency does not appear to be altered but shows potential for improvement.

A common challenge in real-world classification scenarios with sequentially appending target domain data is insufficient training datasets during the training phase. Therefore, conventional deep learning and transfer learning classifiers are not applicable especially when individual classes are not represented or are severely underrepresented at the outset. Domain Generalization approaches reach their limits when domain shifts become too large, making them occasionally unsuitable as well. In many (technical) domains, however, it is only the defect/ worn/ reject classes that are insufficiently represented, while the non-defect class is often available from the beginning. The proposed classification approach addresses such conditions and is based on a CNN encoder. Following a contrastive learning approach, it is trained with a modified triplet loss function using two datasets: Besides the non-defective target domain class (= 1st dataset), a state-of-the-art labeled source domain dataset that contains highly related classes (e.g., a related manufacturing error or wear defect) but originates from a (highly) different domain (e.g., different product, material, or appearance) (= 2nd dataset) is utilized. The approach learns the classification features from the source domain dataset while at the same time learning the differences between the source and the target domain in a single training step, aiming to transfer the relevant features to the target domain. The classifier becomes sensitive to the classification features and – by architecture – robust against the highly domain-specific context. The approach is benchmarked in a technical and a non-technical domain and shows convincing classification results. In particular, it is shown that the domain generalization capabilities and classification results are improved by the proposed architecture, allowing for larger domain shifts between source and target domains.

Deep learning has achieved lots of successes in many fields, but when trainable sample are extremely limited, deep learning often under or overfitting to few samples. Meta-learning was proposed to solve difficulties in few-shot learning and fast adaptive areas. Meta-learner learns to remember some common knowledge by training on large scale tasks sampled from a certain data distribution to equip generalization when facing unseen new tasks. Due to the limitation of samples, most approaches only use shallow neural network to avoid overfitting and reduce the difficulty of training process, that causes the waste of many extra information when adapting to unseen tasks. Euclidean space-based gradient descent also make meta-learner's update inaccurate. These issues cause many meta-learning model hard to extract feature from samples and update network parameters. In this paper, we propose a novel method by using multi-stage joint training approach to post the bottleneck during adapting process. To accelerate adapt procedure, we also constraint network to Stiefel manifold, thus meta-learner could perform more stable gradient descent in limited steps. Experiment on mini-ImageNet shows that our method reaches better accuracy under 5-way 1-shot and 5-way 5-shot conditions.

We introduce a modelling framework for the investigation of on-line machine learning processes in non-stationary environments. We exemplify the approach in terms of two specific model situations: In the first, we consider the learning of a classification scheme from clustered data by means of prototype-based Learning Vector Quantization (LVQ). In the second, we study the training of layered neural networks with sigmoidal activations for the purpose of regression. In both cases, the target, i.e. the classification or regression scheme, is considered to change continuously while the system is trained from a stream of labeled data. We extend and apply methods borrowed from statistical physics which have been used frequently for the exact description of training dynamics in stationary environments. Extensions of the approach allow for the computation of typical learning curves in the presence of concept drift in a variety of model situations. First results are presented and discussed for stochastic drift processes in classification and regression problems. They indicate that LVQ is capable of tracking a classification scheme under drift to a non-trivial extent. Furthermore, we show that concept drift can cause the persistence of sub-optimal plateau states in gradient based training of layered neural networks for regression.

At the beginning of 2020, with the onset of the pandemic, the traditional learning environment for learners drastically changed globally. Since then, most students/teachers have started and practiced distance and virtual learning/teaching. Thus, a technological breakthrough in virtual learning has followed. In connection with this, many countries worldwide have commenced allocating additional financing and funds for educational institutions' technological improvement and development. The long-term stay in distance learning has revealed and highlighted new problems students face: their knowledge level has decreased, they lack socialization skills, and they face psychological and physical health problems. Due to this negative impact on students, a need to research and evaluate how much the EU countries allocated to solve the distance learning-caused problems and what programs or models they prepared has emerged and encouraged further studies. The research has found that many countries increased their allocations very minimally, e.g., 0.0.1%, but some increased their available budgets to 32%. Notably, most countries did not separate distance learning exit funding from distance learning preparation funding. Based on the problems the countries saw, only a few states identified withdrawal from distance learning as a problem. Considering this, we set ourselves the goal to evaluate exit models from distance learning and allocated funding amounts. The following objectives were planned to achieve the goal: · to evaluate the global practice of exit from distance learning; · to determine the scope of funding for pandemic management; · to evaluate the amounts of funding allocated to manage pandemic-caused consequences and the GDP ratio. Research methods: mathematical-statistical analysis, empirical analysis, and analysis of scientific literature.

Reinforcement Learning (RL) has demonstrated considerable potential in solving challenges across various domains, notably in autonomous driving. Nevertheless, implementing RL in autonomous driving comes with its own set of difficulties, such as the overestimation phenomenon, extensive learning time, and sparse reward problems. Although solutions like Hindsight Experience Replay (HER) have been proposed to alleviate these issues, the direct utilization of RL in autonomous vehicles remains constrained due to the intricate fusion of information and the possibility of system failures during the learning process. In this paper, we present a novel RL-based autonomous driving system technology that combines Obstacle Dependent Gaussian (ODG) RL, Soft Actor-Critic (SAC), and meta-learning algorithms. Our approach addresses key issues in RL, including the overestimation phenomenon and sparse reward problems, by incorporating prior knowledge derived from the ODG algorithm. We evaluated our proposed algorithm on official F1 circuits, using high-fidelity racing simulations with complex dynamics. The results demonstrate exceptional performance, with our method achieving up to 89% faster learning speed compared to existing algorithms in these environments.

This review paper delves into using micro-credentials in higher education ecosystems as a digital enablers. Micro-credentials, which are digital credentials that attest to a learner’s mastery of a specific skill or knowledge area, are becoming more popular in higher education. The paper examines the successful implementation of micro-credential frameworks in higher education, using case studies to demonstrate the advantages of micro-credentials. The review emphasizes the agility and flexibility of microcredentials, which enable learners to acquire new skills quickly and respond to changes in the job market. In addition, the paper discusses the digital nature of micro-credentials and how they allow institutionsto provide targeted, skills-based training that isrelevant to employers. It also explores how micro-credentials are delivered through online platforms, making them convenient and easily accessible for learners. The review underscores the significance of digital infrastructure, connectivity, and public utility for promoting micro-credentials. The paper argues that micro-credentials function as a digital enabler for higher edu- cation ecosystems, allowing learners to acquire targeted training and enabling institutions to expand their offerings and reach more students. The paper concludes by highlighting the potential for micro-credentials to help bridge the skills gap and equip learners with the skills necessary to succeed in today’s digital economy.

Tuberculosis (TB) disease still remain a major global threat due to the growing number of drug-resistant species and global warming. Despite the fact that there are new molecular diagnostic approaches, however, majority of developing countries and remote clinics depends on conventional approaches such as Tuberculin test, microscopic examinations and radiographic imaging (Chest X-ray). These techniques are hindered by several challenges which can lead to miss-diagnosis especially when interpreting large number of sample cases. Thus, in order to reduce workload and prevent miss-diagnosis, scientists incorporated computer-aided technology for detection of medical images known as Computer aided Detection (CADe) or Diagnosis (CADx). The use of AI-powered techniques has shown to improve accuracy, sensitivity, specificity. In this review, we discussed about the epidemiology, pathology, diagnosis and treatment of tuberculosis. The review also provides background information on Artificial Intelligence (AI), Machine Learning (ML), Deep Learning (DL), Transfer Learning (TL) and their applications in detection of tuberculosis from both microscopic slide images and X-ray images. The review also proposed an IoT/AI powered system which allows transfer of results obtained from DL models with end users through internet networks. The concept of futuristic diagnosis, limitations of current techniques and open research issues are also discussed.

The use of Information Communication Technologies (ICT) in education brings up new possibilities of promoting the learning and health experiences. In this sense, education contexts of 21st century must consider these two areas of knowledge, especially their integration. This article presents learning practices developed with mobile devices and games, in order to improve learning and well-being in children and adolescents undergoing cancer treatment in non-formal educational setting. The methodology is based on qualitative case studies with content-based data analysis, involving informal interviews and observation methods. The study considers data from 5 patients who participated in the research between 2015 and 2019. The results demonstrate a positive influence of the practices with mobile technologies and games in terms of learning and in the well-being feeling of patients during the treatment.

Artificial Intelligence (AI) is becoming increasingly important, especially in the medical field. While AI has been used in medicine for some time, its growth in the last decade has been remarkable. Specifically, Machine Learning (ML) and Deep Learning (DL) techniques in medicine have been increasingly adopted thanks to the growing abundance of health-related data, improved suitability of such techniques for managing large data-sets, and more computational power. The Italian scientific community has been instrumental in advancing this research area. This article aims to conduct a comprehensive investigation of the ML and DL methodologies and applications used in medicine by the Italian research community in the last five years.

Documenting cultural heritage by using artificial intelligence (AI) is crucial for preserving the memory of the past and a key point for future knowledge. However, modern AI technologies make use of statistical learners that lead to self-empiricist logic, which, unlike human minds, use learned non-symbolic representations. Nevertheless, it seems that it is not the right way to progress in AI. If we want to rely on AI for these tasks, it is essential to understand what lies behind these models. Among the ways to discover AI there are the senses and the intellect. We could consider AI as an intelligence. Intelligence has an essence, but we do not know whether it can be considered “something” or “someone”. Important issues in the analysis of AI concern the structure of symbols -operations with which the intellectual solution is carried out- and the search for strategic reference points, aspiring to create models with human-like intelligence. For many years, humans, seeing language as innate, have carried out symbolic theories. Everything seems to have skipped with the advent of Machine Learning. In this paper, after a long analysis of history, the rule-based and the learning-based vision, we propose KERMIT as a unit of investigation for a possible meeting point between the different learning theories. Finally, we propose a new vision of knowledge in AI models based on a combination of rules, learning and human knowledge.

Using data-driven models to solve predictive maintenance problems has been prevalent for original equipment manufacturers (OEMs). However, such models fail to solve two tasks that OEMs are interested in: (1) Making the well-built failure prediction models working on existing scenarios (vehicles, working conditions) adaptive to target scenarios. (2) Finding out the failure causes, furthermore, determining whether a model generates failure predictions based on reasonable causes. This paper investigates a comprehensive architecture towards making the predictive maintenance system adaptive and interpretable by proposing (1) an ensemble model dealing with time-series data consisting of a long short-term memory (LSTM) neural network and Gaussian threshold to achieve failure prediction one week in advance and (2) an online transfer learning algorithm and a meta learning algorithm, which render existing models adaptive to new vehicles with limited data volumes. (3) Furthermore, the Local Interpretable Model-agnostic Explanations (LIME) interpretation tool and super-feature methods are applied to interpret individual and general failure causes. Vehicle data from Isuzu Motors, Ltd., are adopted to validate our method, which include time-series data and histogram data. The proposed ensemble model yields predictions with 100% accuracy for our test data on engine stalling problem and is more rapidly adaptive to new vehicles with smaller error following application of either online transfer learning or the meta learning method. The interpretation methods help elucidate the global and individual failure causes, confirming the model credibility.

We discuss the implementation of a suite of virtual diagnostics at the FACET-II facility currently under commissioning at SLAC National Accelerator Laboratory. The diagnostics will be used for prediction of the longitudinal phase space along the linac, spectral reconstruction of the bunch profile and non-destructive inference of transverse beam quality (emittance) using edge radiation at the injector dogleg and bunch compressor locations. These measurements will be folded in to adaptive feedbacks and ML-based reinforcement learning controls to improve the stability and optimize the performance of the machine for different experimental configurations. In this paper we describe each of these diagnostics with expected measurement results based on simulation data and discuss progress towards implementation in regular operations.

The importance of energy systems and its role in economics and politics is not hidden for anyone. This issue is not only important for the advanced industrialized countries, which are major energy consumers, but is also important for oil-rich countries. In addition to the nature of these fuels which contains polluting substances, the issue of their ending up has aggravated the growing concern. Biofuels can be used in different fields for energy production like electricity production, power production or for transportation. Various scenarios have been written about the estimated biofuels from different sources in the future energy system. The availability of biofuels for the electricity market, heating and liquid fuels is very important. Accordingly, the need for handling, modelling, decision making and future forecasting for biofuels can be one of the main challenges for scientists. Recently, machine learning and deep learning techniques have been popular in modeling, optimizing and handling the biodiesel production, consumption and its environmental impacts. The main aim of this study is to evaluate the ML and DL techniques developed for handling biofuels production, consumption and environmental impacts, both for modeling and optimization purposes. This will help for sustainable biofuel production for the future generations.

While the use of crime data has been widely advocated in the literature, its availability is often limited to large urban cities and isolated databases tend not to allow for spatial comparisons. This paper presents an efficient machine learning framework capable of predicting spatial crime occurrences, without using past crime as a predictor, and at a relatively high resolution: the U.S. Census Block Group level. The proposed framework is based on an in-depth multidisciplinary literature review allowing the selection of 188 best-fit crime predictors from socio-economic, demographic, spatial, and environmental data. Such data are published periodically for the entire United States. The selection of the appropriate predictive model was made through a comparative study of different machine learning families of algorithms, including generalized linear models, deep learning, and ensemble learning. The gradient boosting model was found to yield the most accurate predictions for violent crimes, property crimes, motor vehicle thefts, vandalism, and the total count of crimes. Extensive experiments on real-world datasets of crimes reported in 11 U.S. cities demonstrated that the proposed framework achieves an accuracy of 73 and 77% when predicting property crimes and violent crimes, respectively.

The prevalence of differential equations as a mathematical technique has refined the fields of control theory and constrained optimization due to the newfound ability to accurately model chaotic, unbalanced systems. However, in recent research, systems are increasingly more nonlinear and difficult to model using Differential Equations only. Thus, a newer technique is to use policy iteration and Reinforcement Learning, techniques that center around an action and reward sequence for a controller. Reinforcement Learning (RL) can be applied to control theory problems since a system can robustly apply RL in a dynamic environment such as the cartpole system (an inverted pendulum). This solution successfully avoids use of PID or other dynamics optimization systems, in favor of a more robust, reward-based control mechanism. This paper applies RL and Q-Learning to the classic cartpole problem, while also discussing the mathematical background and differential equations which are used to model the aforementioned system.

The world has been evolving with new technologies and advances day-by-day. With the advent of various learning technologies in every field, the research community is able to provide solution in every aspect of life with the applications of Artificial Intelligence, Machine Learning, Deep Learning, Computer Vision, etc. However, with such high achievements, it is found to lag behind the ability to provide explanation against its prediction. The current situation is such that these modern technologies are able to predict and decide upon various cases more accurately and speedily than a human, but failed to provide an answer when the question of why to trust its prediction is put forward. In order to attain a deeper understanding into this rising trend, we explore a very recent and talked-about novel contribution which provides rich insight on a prediction being made -- ``Explainability.'' The main premise of this survey is to provide an overview for researches explored in the domain and obtain an idea of the current scenario along with the advancements published to-date in this field. This survey is intended to provide a comprehensive background of the broad spectrum of Explainability.

Machine learning (ML) has emerged as a critical tool for making sense of the growing amount of genetic and genomic data available because of its ability to find complex patterns in high dimensional and heterogeneous data. While the complexity of ML models is what makes them powerful, it also makes them difficult to interpret. Fortunately, recent efforts to develop approaches that make the inner workings of ML models understandable to humans have improved our ability to make novel biological insights using ML. Here we discuss the importance of interpretable ML, different strategies for interpreting ML models, and examples of how these strategies have been applied. Finally, we identify challenges and promising future directions for interpretable ML in genetics and genomics.

The increasing trend of studying the innate softness of robotic structures and amalgamating it with the benefits of the extensive developments in the field of embodied intelligence has led to sprouting of a relatively new yet extremely rewarding sphere of technology. The fusion of current deep reinforcement algorithms with physical advantages of a soft bio-inspired structure certainly directs us to a fruitful prospect of designing completely self-sufficient agents that are capable of learning from observations collected from their environment to achieve a task they have been assigned. For soft robotics structure possessing countless degrees of freedom, it is often not easy (something not even possible) to formulate mathematical constraints necessary for training a deep reinforcement learning (DRL) agent for the task in hand, hence, we resolve to imitation learning techniques due to ease of manually performing such tasks like manipulation that could be comfortably mimicked by our agent. Deploying current imitation learning algorithms on soft robotic systems have been observed to provide satisfactory results but there are still challenges in doing so. This review article thus posits an overview of various such algorithms along with instances of them being applied to real world scenarios and yielding state-of-the-art results followed by brief descriptions on various pristine branches of DRL research that may be centers of future research in this field of interest.

Crowdsourcing is one of the new themes that has appeared in the last decade. Considering its potential, more and more organisations reach for it. It is perceived as an innovative method that can be used for problem solving, improving business processes, creating open innovations, building a competitive advantage, and increasing transparency and openness of the organisation. Crowdsourcing is also conceptualised as a source of a knowledge-based organisation. The importance of crowdsourcing for organisational learning is seen as one of the key themes in the latest literature in the field of crowdsourcing. Since 2008, there has been an increase in the interest of public organisations in crowdsourcing and including it in their activities. This article is a response to the recommendations in the subject literature, which states that crowdsourcing in public organisations is a new and exciting research area. The aim of the article is to present a new paradigm that combines crowdsourcing levels with the levels of learning. The research methodology is based on an analysis of the subject literature and exemplifications of organisations which introduce crowdsourcing. This article presents a cross-sectional study of four Polish municipal offices that use four types of crowdsourcing, according to the division by J. Howe: collective intelligence, crowd creation, crowd voting, and crowdfunding. Semi-structured interviews were conducted with the management personnel of those municipal offices. The research results show that knowledge acquired from the virtual communities allows the public organisation to anticipate changes, expectations, and needs of citizens and to adapt to them. It can therefore be considered that crowdsourcing is a new and rapidly developing organisational learning paradigm.

Continual learning (CL), a.k.a lifelong learning, is an emerging research topic that has been attracting increasing interest in the field of machine learning. With human activity recognition (HAR) playing a key role in enabling numerous real-world applications, an essential step towards the long-term deployment of such systems is to extend the activity model to dynamically adapt to changes in people’s everyday behavior. Current research in CL applied to HAR domain is still under-explored with researchers exploring existing methods developed for computer vision in HAR. Moreover, analysis has so far focused on task-incremental or class-incremental learning paradigms where task boundaries are known. This impedes the applicability of such methods for real-world systems. To push this field forward, we build on recent advances in the area of continual learning and design a lifelong adaptive learning framework using Prototypical Networks, LAPNet-HAR, that processes sensor-based data streams in a task-free data-incremental fashion and mitigates catastrophic forgetting using experience replay and continual prototype adaptation. Online learning is further facilitated using contrastive loss to enforce inter-class separation. LAPNet-HAR is evaluated on 5 publicly available activity datasets in terms of its ability to acquire new information while preserving previous knowledge. Our extensive empirical results demonstrate the effectiveness of LAPNet-HAR in task-free CL and uncover useful insights for future challenges.

In this paper, various machine learning techniques are discussed. These algorithms are used for many applications which include data classification, prediction, or pattern recognition. The primary goal of machine learning is to automate human assistance by training an algorithm on relevant data. This paper should also serve as a collection of various machine learning terminology for easy reference.

Deep reinforcement learning is one of the research hotspots in artificial intelligence and has been successfully applied in many research areas, however, the low training efficiency and high demand for samples are problems that limit the application To address these problems, a hierarchical episodic control model extending episodic memory to the domain of hierarchical reinforcement learning is proposed in this paper. The model is theoretically justified and employs a hierarchical implicit memory planning approach for counterfactual trajectory value estimation. Starting from the final step and recursively moving back along the trajectory, a hidden plan is formed within the episodic memory. Experience is aggregated both along trajectories and across trajectories, and the model is updated using a multi-headed backpropagation similar to bootstrapped neural networks. This model extends the parameterized episodic memory framework to the realm of hierarchical reinforcement learning and is theoretically analyzed to demonstrate its convergence and effectiveness. Experiments conducted in Four Room, Mujoco, and UE4-based active tracking , highlight that the hierarchical episodic control model effectively enhances training efficiency. It demonstrates notable improvements in both low-dimensional and high-dimensional environments, even in cases of sparse rewards.

Federated learning (FL) has become a burgeoning and attractive research area, which provides a collaborative training scheme for distributed data sources with privacy concerns. Most existing FL studies focus on taking unimodal data, such as images and text, as the model input and resolving the heterogeneity challenge, i.e., the non-identically distributed (non-IID) challenge caused by data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been proposed to improve the system performance by utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic – multimodal federated learning (MFL) and perform a literature review on the state-of-art MFL methods. Furthermore, we categorize multi-modal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

Introduction: Dental students use of online material to supplement their learning has been studied but it is unclear whether educators are aware of the findings of this research. This study aimed to investigate dental students use of online content as a learning tool from an educator’s perspective. Methods: Educators in the Dublin Dental University Hospital were invited to complete an online survey based on dental students' use of online learning. Quantitative descriptive statistical analyses were carried out as appropriate on the data collected. A focus group with interested survey participants was held to gain a deeper insight into educator’s opinions on this topic. The transcript from this discussion was analyzed by deductive and inductive coding methods. Results: From a sample of 20 educators, this study found that educators were not aware that students rely on Google and YouTube for educational videos more than university websites. Most educators believed that students are likely to refer to online videos to prepare for dental procedures that they have not done before. The same amount also believed that teachers should incorporate videos into their learning. However, 30% of educators have not uploaded or recommended online videos to their students. Most educators believed they have discussed accuracy and/or relevancy of online content with their students. Interestingly, only 20% believed that students would discuss a contradictory video with their lecturers. The focus group participants expressed concern over the accuracy of online content. They felt that this along with a lack of time were the main reasons that deter them from referring students to online videos. Conclusions: Dental educators are unaware that students access online dental content through Google and YouTube more often than through official academic platforms. Educators are concerned about the accuracy of online dental content. Many believe that they direct their students on how to determine the accuracy of online content which contrasts with other researchers’ findings. More communication is needed between educators and dental students to address each other’s concerns and enhance student’s learning.

Sentiment analysis of public opinion expressed in social networks has been developed into various applications, especially in English. Hybrid approaches are potential models for reducing sentiment errors on increasingly complex training data. This paper aims to test some hybrid deep learning models' reliability in some domains' Vietnamese language. Our research questions are to determine whether it is possible to produce hybrid models that outperform the Vietnamese language. Hybrid deep sentiment-analysis learning models are built and tested on reviews and feedback of the Vietnamese language. The hybrid models outperformed the accuracy of Vietnamese sentiment analysis on Vietnamese datasets. It contributes to the growing body of research on Vietnamese NLP, providing insights and directions for future studies in this area.

The demand for explainable and transparent models increases with the continued success of reinforcement learning. In this article, we explore the potential of generating shallow decision trees (DT) as simple and transparent surrogate models for opaque deep reinforcement learning (DRL) agents. We investigate three algorithms for generating training data for axis-parallel and oblique DTs with the help of DRL agents ("oracles") and evaluate these methods on classic control problems from OpenAI Gym. The results show that one of our newly developed algorithms, the iterative training, outperforms traditional sampling algorithms, resulting in well-performing DTs that often even surpass the oracle from which they were trained. Even higher dimensional problems can be solved with surprisingly shallow DTs. We discuss the advantages and disadvantages of different sampling methods and insights into the decision-making process made possible by the transparent nature of DTs. Our work contributes to the development of not only powerful but also explainable RL agents and highlights the potential of DTs as a simple and effective alternative to complex DRL models.

In this paper, we have investigated the impact of an early learning assessment on students' motivation for improving their performance throughout the semester. An observation analysis was conducted on an entry level mechanical engineering course in which students are enrolled in during their first semester of engineering work. This study analyzes the effect that a first exam, with an average below a passing grade, has on student's outcome in the course. It was hypothesized that students were motivated to achieve their desired grade outcomes following inadequate performance on the first exam. This was investigated by diving into the results of the course and referencing initial performance to the remaining exam and assessment outcomes. Students were placed into grade bands ranging from 0 to 100 in 20% increments. Their results were tracked and it was shown that for the second mechanics exam, averages jumped 43.333%, 35.35%, and 30.055% for grade bands of 0 to 20, 20 to 40, and 40 to 60 respectively. Assessment grades increased as well with the remaining assessments being averaged to a score of 91.095%. Variables contributing to student performance came from both with-in and outside the classroom. Learning communities, material differentiation, and student and professor adaptation all contributed to the rise in performance. It was concluded that the internal and external variables acted in combination with one another to increase student dedication to achieve success.

Machine learning methods have widely been applied to detect anomalies in machine and cutting tool behavior during lathe or milling. However, detecting anomalies in the workpiece itself did not get the same attention by researchers. That is why in this article, the authors present a pub-licly available multivariate time series dataset which was recorded during milling of 16MnCr5. Due to artificially introduced, though realistic anomalies in the workpiece the dataset can be ap-plied for anomaly detection. By using a convolutional autoencoder as a first model good results in detecting the location of the anomalies in the workpiece were achieved. Furthermore, milling tools with two different diameters where used which led to a dataset eligible for transfer learn-ing. The objective of this article is to provide researchers with a real-world time series dataset of the milling process which is suitable for modern machine learning research topics like anomaly detection and transfer learning.

While machine learning models are powering more and more everyday devices, there is a growing need for explaining them. This especially applies to the use of Deep Reinforcement Learning in solutions that require security, such as vehicle motion planning. In this paper, we propose a method of understanding what the RL agent’s decision is based on. The method relies on conducting statistical analysis on a massive set of state-decisions samples. It indicates which input features have an impact on the agent’s decision and the relationships between decisions, the significance of the input features, and their values. The method allows us for determining whether the process of making a decision by the agent is coherent with human intuition and what contradicts it. We applied the proposed method to the RL motion planning agent which is supposed to drive a vehicle safely and efficiently on a highway. We find out that making such analysis allows for a better understanding agent’s decisions, inspecting its behavior, debugging the ANN model, and verifying the correctness of input values, which increases its credibility.

Globally, zoonotic diseases have been on the rise in recent years. Predictive modelling approaches have been successfully used in the literature to identify the underlying causes of these zoonotic diseases. We examine the latest research in the field of predictive modeling that verifies the growth of zoonotic pathogens and assesses the factors associated with their spread. The results of our survey indicate that popular mathematical models can successfully be used in modeling the growth rate of these pathogens under varying storage temperatures. Additionally, some of them are used for the assessment of the inactivation of these pathogens based on various conditions. Based on the results of our study, machine learning models and deep learning are commonly used to detect pathogens within food items and to predict the factors associated with the presence of the pathogens.

COVID-19 has a severe risk of spreading rapidly, the quick identification of which is essential. In this regard, chest radiology images have proven to be a practical screening approach for COVID-19 affected patients. This study proposes a deep learning-based approach using Densenet-121 to detect COVID-19 patients effectively. We have trained and tested our model on the COVIDx dataset and performed both 2-class and 3-class classification, achieving 96.49% and 93.71% accuracy, respectively. By successfully utilizing transfer learning, we achieve comparable performance to the state-of-the-art method while using 15x fewer model parameters. Moreover, we performed an interpretability analysis using Grad-CAM to highlight the most significant image regions at test time. Finally, we developed a website that takes chest radiology images as input and detects the presence of COVID-19 or pneumonia and a heatmap highlighting the infected regions. Source code for reproducing results and model weights are available.

Background: Risk of metastatic recurrence of breast cancer after initial diagnosis and treatment depends on the presence of a number of risk factors. Although most univariate risk factors have been identified using classical methods, machine-learning methods are also being conducted to tease out non-obvious contributors to a patient’s individual risk of developing late distant metastasis. Bayesian-network algorithms may predict not only risk factors but also interactions among these risks, which consequently lead to metastatic breast cancer. We proposed to apply a previously developed machine-learning method to predict risk factors of 5-, 10- and 15-year metastasis. Methods: We applied a previously validated algorithm named the Markov Blanket and Interactive risk factor Learner (MBIL) on the electronic health record (EHR)-based Lynn Sage database (LSDB) from the Lynn Sage Comprehensive Breast Cancer at Northwestern Memorial Hospital. This algorithm provided an output of both single and interactive risk factors of 5-, 10-, and 15-year metastasis from LSDB. We individually examined and interpreted the clinical relevance of these interactions based on years to metastasis and the reliance on interactivity between risk factors. Results: We found that with lower alpha values (low interactivity score), the prevalence of variables with an independent influence on long term metastasis was higher (i.e., HER2, TNEG). As the value of alpha increased to 480, stronger interactions were needed to define clusters of factors that increased the risk of metastasis (i.e., ER, smoking, race, alcohol usage). Conclusion: MBIL identified single and interacting risk factors of metastatic breast cancer, many of which were supported by clinical evidence. These results strongly recommend the development of further large data studies with different databases to validate the degree to which some of these variables impact metastatic breast cancer in the long term.

Many works have recently identified the need to combine deep learning with extreme learning to strike a performance balance with accuracy especially in the domain of multimedia applications. Considering this new paradigm, namely convolutional extreme learning machine (CELM), we present a systematic review that investigates alternative deep learning architectures that use extreme learning machine (ELM) for a faster training to solve problems based on image analysis. We detail each of the architectures found in the literature, application scenarios, benchmark datasets, main results, advantages, and present the open challenges for CELM. We follow a well structured methodology and establish relevant research questions that guide our findings. We hope that the observation and classification of such works can leverage the CELM research area providing a good starting point to cope with some of the current problems in the image-based computer vision analysis.

Hateful and abusive speech presents a major challenge for all online social media platforms. Recent advances in Natural Language Processing and Natural Language Understanding allow more accurate detection of hate speech in textual streams. This study presents a multimodal approach to hate speech detection by combining Computer Vision and Natural Language processing models for abusive context detection. Our study focuses on Twitter messages and, more specifically, on hateful, xenophobic and racist speech in Greek aimed at refugees and migrants. In our approach we combine transfer learning and fine-tuning of Bidirectional Encoder Representations from Transformers (BERT) and Residual Neural Networks (Resnet). Our contribution includes the development of a new dataset for hate speech classification, consisting of tweet ids, along with the code to obtain their visual appearance, as they would have been rendered in a web browser. We have also released a pre-trained Language Model trained on Greek tweets, which has been used in our experiments. We report a consistently high level of accuracy (accuracy score=0.970, f1-score=0.947 in our best model) in racist and xenophobic speech detection.

The exponential growth of biomedical data in recent years urged the application of numerous machine learning techniques to address emerging problems in biology and clinical research. By enabling automatic feature extraction, selection and generation of predictive models, these methods can be used to efficiently study complex biological systems. Machine learning techniques are frequently integrated with bioinformatic methods, as well as curated databases and biological networks, to enhance training and validation, identify the best interpretable features, and enable feature and model investigation. Here, we review recently developed methods that incorporate machine learning within the same framework with techniques from molecular evolution, protein structure analysis, systems biology and disease genomics. We outline the challenges posed for machine learning, and in particular, deep learning in biomedicine and suggest unique opportunities for machine learning techniques integrated with established bioinformatics approaches to overcome some of these challenges.

Education setting evolved from historical open learning system to traditional classroom set-up to distance learning modality. Teaching-Learning practice is transformed with an evolution of teaching-learning materials. With technological advancement in progressive manner and it’s increasing use in academic setting, distance learning has been the on-demand and on-debate topic in current educational discourse. Comparatively fresh topic in Nepali academic setting, this paper intended to analyze the perception of Nepali students towards online modality in Nepali academic setting. This paper further analyzed the student’s preference towards distance learning in current Nepali academic setting. Research findings were analyzed based on data collected through literature review, interview with students and professor and quantitative data collection through use of google form. Study identified opportunities as revenue generation; continuation of academic career from any part of country; increase learning outcome among jobholders. Study identified challenges as unequal access and quality of internet facilities; affordability of laptops/computers; limited interaction; and frequent disturbances. Seeing the better prospects, study strongly supported the need of shift in academic shift from traditional setting to non-traditional setting in Nepali context to meet the global needs of competitive and quality education.

Identifying dust aerosols from passive satellite images is of great interest for many applications. In this study, we developed 5 different machine-learning (ML) and deep-learning (DL) based algorithms, including Logistic Regression, K Nearest Neighbor, Random Forest (RF), Feed Forward Neural Network (FFNN), and Convolutional Neural Network (CNN), to identify dust aerosols in the daytime satellite images from the Visible Infrared Imaging Radiometer Suite (VIIRS) under cloud-free conditions on a global scale. In order to train the ML and DL algorithms, we collocated the state-of-the-art dust detection product from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) with the VIIRS observations along the CALIOP track. The 16 VIIRS M-band observations with the center wavelength ranging from deep blue to thermal infrared, together with solar-viewing geometries and pixel time and locations, are used as the predictor variables. Four different sets of training input data are constructed based on different combinations of VIIRS pixel and predictor variables. The validation and comparison results based on the collocated CALIOP data indicates that the FFNN method based on all available predictor variables is the best performing one among all methods. It has an averaged dust detection accuracy of about 81 %, 89 % and 85 % over land, ocean and whole globe, respectively, compared with collocated CALIOP. When applied to off-track VIIRS pixels, the FFNN method retrieves geographical distributions of dust that are in good agreement with on-track results as well as CALIOP statistics. For further evaluation, we compared our results based on the ML and DL algorithms to NOAA’s Aerosol Detection Product (ADP) , which is a product that classifies dust, smoke and ash using physical-based methods. The comparison reveals both similarity and differences. Overall, this study demonstrates the great potential of ML and DL methods for dust detection and proves that these methods can be trained on the CALIOP track and then applied to the whole granule of VIIRS granule.

Deep learning machines are computational models composed of multiple processing layers of adaptive weights to learn representations of data with multiple levels of abstraction. Their structure is mainly reflecting the intuitive plausibility of decomposing a problem into multiple levels of computation and representation since it is believed that higher layers of representation allow a system to learn complex functions. Surprisingly, after decades of research, from learning and design perspectives these models are still deployed in a heuristic manner. In this paper, deep learning feed-forward machines are modeled from a statistical mechanics point of view as disordered physical systems where its macroscopic behavior is determined in terms of the interactions defined between the basic constituent of these models, namely, the artificial neuron. They are viewed as the equilibrium states of a theoretical body that is subject to the law of increase of the entropy. The study of the changes in energy of the body when passing from one equilibrium state to another is used to understand the structure and role of the phase space of the system, the stability of the equilibrium states, and the resulting degree of disorder. It is shown that the topology of these models is strongly linked to their stability and resulting level of disorder. Furthermore, the proposed theoretical characterization permit to assess the thermodynamic efficiency with which information can be processed by these models, and to provide a practical methodology to quantitatively estimate and compare their expected learning and generalization capabilities. These theoretical results provides new insights to the theory of deep learning and their implications are shown to be consistent through a set of benchmarks designed to experimentally assess their validity.

In the Agriculture sector, control of plant leaf diseases is crucial as it influences the quality and production of plant species with an impact on the economy of any country. Therefore, automated identification and classification of plant leaf disease at an early stage is essential to reduce economic loss and to conserve the specific species. Previously, to detect and classify plant leaf disease, various Machine Learning models have been proposed; however, they lack usability due to hardware incompatibility, limited scalability and inefficiency in practical usage. Our proposed DeepLens Classification and Detection Model (DCDM) approach deal with such limitations by introducing automated detection and classification of the leaf diseases in fruits (apple, grapes, peach and strawberry) and vegetables (potato and tomato) via scalable transfer learning on A.W.S. SageMaker and importing it on AWS DeepLens for real-time practical usability. Cloud integration provides scalability and ubiquitous access to our approach. Our experiments on extensive image data set of healthy and unhealthy leaves of fruits and vegetables showed an accuracy of 98.78% with a real-time diagnosis of plant leaves diseases. We used forty thousand images for the training of deep learning model and then evaluated it on ten thousand images. The process of testing an image for disease diagnosis and classification using AWS DeepLens on average took 0.349s, providing disease information to the user in less than a second.

Using machine learning or deep learning to solve the problem of garbage recognition and classification is an important application in computer vision, but due to the incomplete establishment of garbage datasets and the poor performance of complex network models on smart terminal devices, the existing garbage classification models The effect is not good.This paper presents a waste classification and identification method base on transfer learning and lightweight neural network. By migrating the lightweight neural network MobileNetV2 and rebuild it, The reconstructed network is used for feature extraction, and the extracted features are introduced into the SVM to realize the identification of 6 types of garbage. The model was trained and verified by using 2527 pieces of garbage labeled data in the TrashNet dataset, which ultimately resulted in a classification accuracy of 98.4% of the method, which proves that the method can effectively improve the classification accuracy and time and overcome the problem of weak data and less labeling. The over-fitting phenomenon encountered by small data sets in deep learning makes the model robust.

In this brief letter we report our initial results on the application of deep-learning to the massive MIMO channel estimation challenge. We show that it is possible to estimate wireless channels and that the possibility of mitigating pilot-contamination with deep-learning is possible given that the leaning model underwent an extensive training-phase and that it has been presented with a large number of different channel conditions.

If students do not fully apply themselves, then they may be considered responsible for the result of being inadequately prepared. +- Nevertheless, student outcomes are more likely to reflect a combination of both effort and systematic problems with overall course architecture. Deficiencies in course design result in inadequate preparation that adversely and directly impacts students’ productivity upon entering the workforce. Such an impact negatively influences students' ability to maintain gainful employment and provide for their families, which inevitably contributes to the development of issues concerning their psychological well-being. It is well-documented that incorporating active learning strategies in course design and delivery can enhance student learning outcomes. Despite the benefit of implementing active learning techniques, rarely in the real world will it be possible for techniques to be used in isolation of one another. Therefore, the purpose of this proposed study is to determine the interactive effects of two active learning strategies because, at a minimum, technique-pairs more accurately represent the application of active learning in the natural educational setting. There is a paucity of evidence in the literature directed toward investigating the interactive effects of multiple active learning techniques that this study is aimed at filling. The significance of this research is that, by determining the interactive effects of paired active learning strategies, other research studies on the beneficial effects of using particular active learning technique-pairs will be documented contributing to the literature so that ultimately classroom instruction may be customized according to the determination of optimal sequencing of strategy-pairs for particular courses, subjects, and desired outcomes that maximize student learning.

Plasma technology shows tremendous potential for revolutionizing oncology research and treatment. Reactive oxygen and nitrogen species, electromagnetic emissions generated through gas plasma jets, have attracted significant attention due to their selective cytotoxicity towards cancer cells. To leverage the full potential of plasma medicine, researchers have explored the use of mathematical models and various subsets of machine learning, such as reinforcement learning, and deep learning. This review emphasizes the significant application of AI algorithms in the adaptive plasma system, paving the way for precision and dynamic cancer treatment. Realizing the full potential of AI in plasma medicine, requires research efforts, data sharing and interdisciplinary collaborations. Unravelling the complex mechanisms, developing real-time diagnostics, and optimizing AI models will be crucial to harness the true power of plasma technology in oncology. The integration of personalized and dynamic plasma therapies, alongside AI and diagnostic sensors, presents a transformative approach to cancer treatment with the potential to improve outcomes globally.

Attitude control of a novel regional truss-braced wing aircraft with low stability characteristics is addressed in this paper using Reinforcement Learning (RL). In recent years, RL has been increasingly employed in challenging applications, particularly, autonomous flight control. However, a significant predicament confronting discrete RL algorithms is the dimension limitation of the state-action table and difficulties in defining the elements of the RL environment. To address these issues, in this paper, a detailed mathematical model of the mentioned aircraft is first developed to shape an RL environment. Subsequently, Q-learning, the most prevalent discrete RL algorithm will be implemented in both the Markov Decision Process (MDP), and Partially Observable Markov Decision Process (POMDP) frameworks to control the longitudinal mode of the air vehicle. In order to eliminate residual fluctuations that are a consequence of discrete action selection, and simultaneously track variable pitch angles, a Fuzzy Action Assignment (FAA) method is proposed to generate continuous control commands using the trained Q-table. Accordingly, it will be proved that by defining an accurate reward function, along with observing all crucial states (which is equivalent to satisfying the Markov Property), the performance of the introduced control system surpasses a well-tuned Proportional–Integral–Derivative (PID) controller.