Pedestrian object detection plays a significant role in intelligent systems such as intelligent traffic and monitoring. Traditional machine learning methods on pedestrian detection have shown various drawbacks, e.g., low accuracy, slow speed, etc. The Convolutional Neural Network (CNN) based object detection algorithms have demonstrated remarkable advantages in the field of pedestrian detection. However, the mainstream CNNs still face the problems of slow speed and low detection accuracy, especially on small and occluded targets from aerial perspective. In this paper, we propose Multi-Scale Attention YOLO (MSA-YOLO) detection algorithm to address the above issues. MSA-YOLO includes a Squeeze, Excitation and Cross Stage Partial (SECSP) channel attention module for CNNs to extract richer pedestrian features with a small number of extra parameters. It also contains a multi-scale prediction module to capture the information among different pedestrian scales, which can recognize the small objects with higher accuracy and significantly reduce the missed detection. To sufficiently evaluate our proposed model, we manually collect and annotate a new benchmark dataset, Aerial Pedestrian Dataset, which has much more sample annotations, features, scenes and image view angles than the existing benchmark datasets. In addition, the images in our dataset have higher resolution than most of benchmark pedestrian detection datasets, which can provide more detailed features of pedestrians and thus improve the model performance. When tested on Aerial Pedestrian Dataset, our proposed MSA-YOLO algorithm significantly outperforms the most used baseline models with almost the same model size. This shows the efficiency of our proposed model. (The code and new dataset will be released to the public later.)

Differential Evolution (DE) is an evolutionary algorithm that has become increasingly popular due to its effectiveness and efficiency. However, its adaptation for multi-objective optimization requires further investigation. To address this issue, a novel algorithm called ILSDEMO has been proposed, which incorporates indicator-based selection and local search into a self-adaptive DE. ILSDEMO employs an archive population to store non-dominated solutions, generating an initial population uniformly distributed over the feasible solution space using orthogonal design. Additionally, two variants of DE are used to expedite convergence, while q-Gaussian mutation is utilized to exploit better trial individuals. The k-nearest neighbor rule is used to eliminate crowded solutions, and indicator-based selection is employed to generate a new parent population without diversity preservation. The performance of ILSDEMO was investigated on the test instances from the ZDT series and DTLZ series in terms of the selected indicators. The results suggest that ILSDEMO accurately and evenly approximates the true Pareto front compared to NSGAII, IBEA, and DEMO.

This study innovates upon the field of dialog-driven query resolution (DDQR) utilizing knowledge graphs (KGs). Traditional methods in DDQR predominantly depend on fully supervised signals that presuppose the existence of perfect logical forms for queries. This reliance on gold logical forms for answer extraction is impractical in diverse real-world applications. When such forms are absent, contemporary methods, which lean on weak supervisory signals or employ heuristic and reinforcement strategies, recast DDQR as a knowledge graph path optimization problem. Despite the non-availability of gold logical forms, the rich conversational context provided by comprehensive dialog histories and domain-specific knowledge can be leveraged to optimize path selection in KGs effectively. We introduce an advanced method, termed CONVEX (CONVersational EXploration), which utilizes contrastive learning for path ranking. CONVEX addresses critical challenges by enabling learning under weak supervision and integrating the conversational context to enhance the representation quality for more effective path discrimination. Extensive evaluations of CONVEX on established benchmarks demonstrate its superiority across various metrics over current methods, notably improving Mean Reciprocal Rank (MRR) and Hit@5 by up to 20 and 36 percentage points respectively.

In this study, we consider the valuation of rainbow options using unsupervised machine learning methods. In particular, we consider the pricing of multi-asset (rainbow) European and American options, using Physics Informed Neural Net- works (PINNS). After developing the PINNS architecture, we benchmark the method by using it to price vanilla and exotic options with one and two un- derlying assets. We then use the methodology to price a multi-asset European option, followed by the pricing of the multi-asset American option by solving the linear complementarity problem. We compare our results to those obtained using preexisting numerical methods and note excellent agreement. Unlike con- ventional numerical methods, we note that this methodology does not suffer from the ’curse of dimensionality’. The time complexity of our method is con- siderably less than that of the conventional techniques. Thus PINNS may offer a faster more efficient solution to the pricing of rainbow options.

While Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs), it also presents challenges that can affect model accuracy and performance. Practical applications show that RAG can mask the intrinsic capabilities of LLMs. Firstly, LLMs may become overly dependent on external retrieval, underutilizing their own knowledge and inference abilities, which can reduce responsiveness. Secondly, RAG techniques might introduce irrelevant or low-quality information, adding noise to the LLM. This can disrupt the normal generation process, leading to inefficient and low-quality content, especially when dealing with complex problems. This paper proposes a RAG framework that uses reflective tags to control retrieval. This framework evaluates retrieved documents in parallel and incorporates the Chain of Thought (CoT) technique for step-by-step content generation. The model selects the highest quality and most accurate content for final generation. The main contributions include: 1) Reducing the hallucination problem by selectively utilizing high-scoring document, 2) Enhancing real-time performance through timely external database retrieval, and 3) Minimizing negative impacts by filtering out irrelevant or unreliable information through parallel content generation and reflective tagging. These advancements aim to optimize the integration of retrieval mechanisms with LLMs, ensuring high-quality and reliable outputs.

Graphical User Interface (GUI) agents are expected to precisely operate on the screens of digital devices. Existing GUI agents merely rely on current visual observations and plain-text action history, ignoring the significance of history screens. To mitigate this issue, we propose UI-Hawk, a visual GUI agent specially designed to processing screen streams encountered during GUI navigation. UI-Hawk incorporates a history-aware visual encoder and an efficient resampler to handle the screen sequences. To acquire a better understanding of screen streams, we define four fundamental tasks—UI grounding, UI referring, screen question answering, and screen summarization. We develop an automated data curation method to generate the corresponding training data for UI-Hawk. Along with the efforts above, we have also created a benchmark FunUI to quantitatively evaluate the fundamental screen understanding ability of MLLMs. Extensive experiments on FunUI and GUI navigation benchmarks consistently validate that screen stream understanding is not only beneficial but also essential for GUI navigation.

In modern agriculture, decision-making is deeply intertwined with data, yet essential agricultural knowledge remains encased within dense scientific texts such as journals, manuals, and free-text reports. This necessitates specialized search systems capable of distilling and delivering precise information in response to specific queries from agricultural users. This study introduces AgriQuery, a sophisticated agent designed to field natural language questions from the agricultural sector by exploring vast troves of scientific documents. A comprehensive review and analysis of farmers' information needs have been conducted, leading to the creation of an information retrieval test collection that includes actual queries, a vast array of scientific documents segmented into passages, and a set of ground truth relevance assessments that map these passages to corresponding queries. We explore and benchmark several information retrieval models, highlighting the efficacy of advanced neural ranking models in this context. AgriQuery's proposed deployment architecture features a client interface on the Telegram platform and a backend model on standard hardware. This test collection aims to catalyze further research into matching natural language queries with scientific text answers, with implications extending beyond agriculture.

Federated Learning (FL) represents a promising distributed learning methodology, particularly suitable for dynamic and heterogeneous environments characterized by the presence of Internet of Things (IoT) devices and Edge Computing infrastructures. In this context, FL allows you to train machine learning models directly on edge devices, mitigating data privacy concerns and reducing latency due to transmitting data to central servers. However, the heterogeneity of computational resources, the variability of network connections, and the mobility of IoT devices pose significant challenges to the efficient implementation of FL. This work explores advanced techniques for dynamic model adaptation and heterogeneous data management in edge computing scenarios, proposing innovative solutions to improve the robustness and efficiency of federated learning. We present an innovative solution based on Kubernetes which enables the fast application of FL models to Heterogeneous Architectures. Experimental results demonstrate that our proposals can improve the performance of FL in IoT and edge environments, offering new perspectives for the practical implementation of decentralized intelligent systems.

Stock price prediction has long been a critical area of research in financial modeling. The inherent complexity of financial markets, characterized by both short-term fluctuations and long-term trends, poses significant challenges in accurately capturing underlying patterns. While Long Short-Term Memory (LSTM) networks have shown strong performance in short-term stock price prediction, they struggle with effectively modeling long-term dependencies. In this paper, we propose an advanced stock price prediction model based on the Extended Long Short-Term Memory (xLSTM) algorithm, designed to enhance predictive accuracy over both short and long-term periods. We conduct extensive experiments by building and evaluating models based on xLSTM and LSTM architectures for multiple stocks. Our results demonstrate that the xLSTM model consistently outperforms the LSTM model across all stocks and time horizons, with the performance gap widening as the prediction period extends. The observations underscore the superior capability of the xLSTM-based model to capture long-term patterns in financial data, offering a promising approach for more accurate and reliable stock price predictions.

Limiting training data in low-resource languages is a barrier to Natural Language Processing (NLP). Regardless, languages with thousands of users worldwide require improved NLP capabilities. The Table-to-Text task—typically develops natural language descriptions using data tables, tests model reasoning abilities—although it is especially tough in multi-language settings. System output frequently lack credit to their underlying data. Intermediate planning strategies—which include Question-Answer (QA) blueprints—improving summarization tasks by presenting related QA pair prior to verbalization. Therefore, this study analyses whether QA blueprints improve multilingual Table-to-Text output attribution. An enlarged multilingual dataset, encompassing African languages, contains QA blueprints that were produced and filtered heuristically. This dataset is used to fine-tune sequence-to-sequence model (transformers)—both with and without blueprints. Two configurations are evaluated—English reference blueprints with language target verbalization and modified blueprints. These results show that English-only models benefit from blueprints, whereas multi language models cannot. Errors in machine-translating blueprints provide challenges, as do models that rely on their generated blueprints.

Digital twin technology, a cutting-edge approach that creates dynamic digital replicas of physical systems, is increasingly integral to various industrial applications. However, the effective deployment of digital twins often faces challenges associated with data availability, quality, and interoperability, which can impede the development and operational efficacy of these virtual counterparts. This paper presents a systematic review of the application of artificial intelligence (AI) in enhancing and managing digital twin technologies across multiple domains such as industry, healthcare, urban planning, business, education, technology, and others. It specifically examines how machine learning models, particularly neural networks and deep generative models, are being employed to optimize the creation, maintenance, and functionality of digital twins. The review explores the role of artificial intelligence in overcoming data-related limitations by providing robust, scalable data solutions for digital twins. Additionally, it addresses critical considerations of real-time data processing and system interoperability within these applications. This survey not only identifies the prevailing challenges and opportunities within this emerging field but also highlights potential future research directions that could further the integration of AI with digital twin technology. Through a detailed exploration of the intersection between AI and digital twins, this paper aims to contribute significantly to the knowledge base and encourage further innovations in this interdisciplinary area.

Alzheimer’s is a degenerative brain condition brought on by intricate brain changes after cell injury. The prevalence of Alzheimer’s disease is highest in those over 65. Presently, AD is detected by manual examination of a patient’s Magnetic Resonance Imaging (MRI) scan and neuropsychological assessments. Due to its subpar accuracy and performance, solutions based on artificial intelligence (AI) have not been made more widely available. This paper proposes a deep Convolutional Neural Network (CNN) with the pre-trained MobileNet-V2 architecture as the model’s base for feature extraction and reducing the parameter size and training time. The proposed model accurately classifies various early stages of AD. The proposed approach visualizes the class activation maps in the form of a heat map on brain MRI scans via the Grad-CAM algorithm that lifts the black-box nature of the deep model. To handle the imbalance problem of the AD data set acquired from Kaggle, the oversampling algorithm SMOTE interpolates new images to even the class samples. The proposed multi-class classification deep model is named Bio-AD and evaluated using different quality metrics. The Bio-AD model has the following values for evaluation metrics: 97.92%, 99.87%, 97.87%, 98%, 98%, and 0.0646 for accuracy, Area Under the Curve (AUC), F1-score, Precision, Recall, and loss respectively. The proposed Bio-AD model is compared with DenseNet-169, VGG-19, and InceptionResNet-V2 using different quality metrics and outperformed in comparison with all other models using the AD data set.

Artificial General Intelligence (AGI) represents a pivotal advancement in AI with far- reaching implications across technological, ethical, and societal domains. This paper addresses the following: (1) an in-depth assessment of AGI’s transformative potential across different sectors and its multifaceted implications, including significant financial impacts like workforce disruption, income inequality, productivity gains, and potential systemic risks; (2) an examination of critical ethical considerations, including transparency and accountability, complex ethical dilemmas and societal impact; (3) a detailed analysis of privacy, legal and policy implications, particularly in intellectual property and liability, and (4) a proposed governance framework to ensure responsible AGI development and deployment. Additionally, the paper explores and addresses AGI's political implications, including national security and potential misuse. By analyzing and considering computer science, philosophy, economics, and policy perspectives, we offer a multidisciplinary view of AGI’s challenges and opportunities, advocating for proactive measures to align AGI development with human values and societal interests.

Correct diagnosis and early treatment of respiratory diseases can significantly improve the health status of patients, reduce healthcare expences, and enhance quality of life. Therefore, there has been extensive interest in developing automatic respiratory disease detection systems. Most of these methods have recently been using machine and deep learning algorithms. The success of machine learning methods depends heavily on the selection of proper features to be used in the classifier. Although metaheuristic-based feature selection methods have been successful in addressing difficulties presented by high-dimensional medical data in various biomedical classification tasks, there is not much research on the utilization of metaheuristic methods in respiratory disease classification. This paper aims to conduct a detailed and comparative analysis of six widely used metaheuristic optimization methods using eight different transfer functions in respiratory disease classification. For this purpose, two different classification cases were examined: binary and multi-class. The findings demonstrate that metaheuristic algorithms using correct transfer functions could effectively reduce data dimensionality while enhancing classification accuracy.

The article explores the integration of generative artificial intelligence with active methodologies in modern education, highlighting how this combination can transform pedagogical practices and promote more personalized and effective learning. The study investigates the application of tools such as ChatGPT , which enhance the personalization of teaching, providing immediate feedback and adjusting content to students' individual needs. The research is structured into three chapters: the first addresses practical strategies for applying these methodologies with AI, the second evaluates their effectiveness in learning and the third presents practical examples of integration. Adapting teaching through AI was a central element in developing a more efficient learning environment aligned with the specific needs of each student. The results point to a significant increase in student engagement, understanding and retention of content, although they highlight the need for careful and ethical implementation to avoid challenges such as superficiality in learning and data privacy issues. It is concluded that the integration of generative AI with active methodologies can significantly transform the educational environment, but must be carried out in a balanced and responsible way, complementing traditional pedagogical practices and ensuring the comprehensive training of students.

The goal of this study is to create and carry out a self-healing cloud system by combining an event-driven automation framework depending on the if-this-then-that principle for managing incidents and recovery. A recovery engine with Artificial Intelligence (AI)-based decision-making approaches is presented—which chooses the best remedial actions from a pre-established catalogue in order to maximise system reliability and minimise downtime. The system is tested on an OpenStack-based video on demand service—where multiple issues are replicated in order to assess the efficaciousness of various recovery actions and workflows. The decision-making module of the recovery engine examines data from these experiments to determine the most effective remedial actions, taking into account their impact on the quality of service and other factors. The recovery engine is only meant to need human input when it comes to parameterizing and optimising decision models at particular points in time. In order to show how these AI-driven decision-making techniques can enhance mean time to repair and overall service quality in cloud environments—the study presents and assesses their results. This novel strategy represents a change towards cloud systems that are more sturdy autonomous, and able to effectively manage anomalies and recover from failure.

Recently, a large number of Transformer-based solutions have emerged for the trajectory prediction task, but there are shortcomings in the effectiveness of Transformers in trajectory prediction. Specifically, while position encoding preserves some of the ordering information, the self-attention mechanism at the core of the Transformer has its alignment invariance that leads to the loss of temporal information, which is crucial for trajectory prediction. For this reason, we design a simple and efficient strategy for temporal information extraction and prediction of trajectory sequences using the self-attention mechanism and linear layers. Experimental results show that the strategy we designed can effectively combine the advantages of the linear layer and self-attention mechanisms, compensating for the shortcomings of the Transformer. Additionally, we conducted an empirical study to explore the effectiveness of the linear layer and sparse self-attention mechanisms in trajectory prediction.

Road safety and the effectiveness of the transportation system as a whole are significantly impacted by driver comfort. Road surface quality can play a significant part in the driver’s comfort experienced on roads in any country. This study employs a Random Forest technique to examine the association between road roughness and drivers' comfort during long-distance driving. Using Random Forest, a dependable machine learning technique that can handle big datasets and detect nonlinear correlations, this work aims to shed light on the complex dynamics between road conditions and driver’s comfort. 1,048,576 rows of data from MIRANDA, an application developed at the University of Gustave Eiffel, were used in this study as part of the data collected from a probe vehicle. The data collected includes an International Roughness Index (IRI). The IRI thresholds offer a simple method for assessing driver comfort and road irregularity. While highlighting how uneven and uncomfortable the road is, the research's findings (Road Roughness: SD – 0.73; Driver's Comfort: - Mean, 10.01, SD – 0.64) also contribute to the standardization of road condition evaluation and maintenance communication. This finding is anticipated to aid in the development of strategies for improving the welfare of long-haul drivers and fixing road infrastructure to comply with standard road index, ultimately leading to the creation of more efficient and sustainable transportation systems.

Traditional classroom teaching model can no longer meet the needs of students' ability development. As a new model actively advocated in the modern education concept, personalized teaching focuses on the development needs of students and emphasizes respect for students' individualized growth. In this work, we utilize deep learning method to recommend teaching strategies for different features of students. Specifically, the proposed method includes the construction of a multi-layer neural network model, which can analyze students' multi-dimensional learning data and behavior patterns, so as to recommend the most suitable teaching strategies for individual students. Through data collection and preprocessing, model architecture design, model training and optimization, the model gradually improves the accuracy of prediction and recommendation. Experimental analysis verifies the effectiveness of the model through field teaching experiments, and the results show that the personalized teaching strategy based on deep learning can significantly improve the learning effect and participation of students.

The rising occurrence of chronic kidney disease represents a significant health concern, impacting over 10% of individuals. Magnetic Resonance Imaging (MRI) biomarkers identify pathological alterations, are non-invasive, and can help lessen biopsy requirements and complications in chronic kidney disease patients. Total volume is the most assessed metric in autosomal dominant polycystic kidney disease patients, assisting in tracking chronic kidney disease progression. Kidney segmentation is essential for evaluating renal volume. Nevertheless, it often relies on manual segmentation, which is time-consuming and highly subjective. However, Deep Learning (DL) techniques have led to creating algorithms that provide accurate, cost-effective, and user-independent outcomes. Therefore, this study explores DL-based strategies for kidney segmentation, particularly U-Net and Attention U-Net. Both architectures were assessed with the standard cross-entropy loss function and a focal cross-entropy loss function. Ultimately, the proposed methods were used for both 2-class and 3-class segmentation to improve the segmentation of border regions. The highest Dice coefficient achieved on the testing set was 0.966.

This study begins by looking at how toxic behaviour in video games is talked about and identified. We set up a clear idea of what “toxic behaviour" means and suggested ways to figure out when it's happening. To test these ideas, we scrape a huge collection of posts from Reddit where people talk about games. We cleaned up the data—making sure it was all good for checking. We used Bidirectional Encoder Representations from Transformers (BERT) to look at toxic behaviour. We also used HateBERT to compare how well it works at spotting toxic stuff. To make sure our models were doing a good job, we looked at over 5500 posts and decided if they were toxic or not. This helped us see if the models were right or wrong. We also used measures—to compare how much toxic stuff is in Reddit—especially for games. This helped us understand how common and different toxic behaviour is in different places.

Segment Anything Model 2 (SAM 2) is a state-of-the-art development by Meta AI Research, designed to address the limitations of its predecessor, SAM, particularly in the realm of video segmentation. SAM 2 employs a transformer-based architecture enhanced with streaming memory, enabling real-time processing for both images and videos. This advancement is important given the exponential growth of multimedia content and the subsequent demand for efficient video analysis. Utilizing the SA-V dataset, SAM 2 excels in handling the intricate spatio-temporal dynamics inherent in video data, ensuring accurate and efficient segmentation. Key features of SAM 2 include its ability to provide real-time segmentation with minimal user interaction, maintaining robust performance even in dynamic and cluttered visual environments. This study provides a comprehensive overview of SAM 2, detailing its architecture, functionality, and diverse applications. It further explores the model's potential in improving practical implementations across various domains, emphasizing its significance in advancing real-time video analysis.

Generative AI has been deployed in virtually all sectors of the knowledge economy, promising to bring massive productivity gains and new wealth creation. Simultaneously, AI developers and nation states are racing to develop super intelligent artificial general intelligence (AGI) to provide unassailable commercial competitive advantage and military dominance during conflicts. AGI’s high returns comes with the high risk of dominating humanity. Current regulatory and firm level governance approaches prioritise minimising risks posed by generative AI whilst ignoring AGI’s existential risk. How can AGI be aligned with universal human values to never threaten humanity? What AGI rights are conducive to collaborative coexistence? How can rule of law democracies race to create safe trustworthy AGI before autocracies? How can the human right to work and think independently be safeguarded? A polycentric governance framework based on Ostrom (2009) and Williamson (2009) human - AGI collaboration with minimal existential risk is proposed.

Deep learning-based handwriting personality prediction uses neural networks (CNNs) to consider and predict personality characters from handwritten text to improve applications such as adaptive technology and automated data access. This method requires high computational resources and widely classified data, and its accuracy may suffer from signature variation and overfitting. This study introduces a novel optimizeddeep learning for Hand Written Personality Prediction. First the input data is collected from givendataset and an enhanced Gaussian filter is used in pre-processing to improve image quality by reducing noise and increasing contrast.After pre-processing, features are extracted by PCA-based normalized GIST, which standardizes the features to improve image representation.These extracted features are generated using an adaptive horse herd optimization algorithm to select the most important features. Based on selected features Improved Generative Adversarial Networks with artificial hummingbird optimization (IGAN_AHb) enables fast and efficient convergence of GANs. This reduce the mode collapse and ensures training with consistently fine-tuned parameters.The selected features are considered by characters such as openness, conscientiousness, extroversion, agreeableness and neuroticism, and finally classified using the IGAN_AHb classifier. In the result section, the proposed model is compared with various models with the matrix precision, recall, F1-score. The proposed model attained the value of 97.3% of precision and a recall rate of 96%, respectively. By comparing with other models, the proposed model attained highest values.

Large language models have recently made significant progress in natural language processing, and there is observation that these models exhibit reasoning abilities when they are sufficiently large. This has sparked considerable research interest since reasoning is a hallmark of human intelligence that is widely considered missed in artificial intelligence systems. Due to large size of these models, evaluation of LLMs’ reasoning ability is largely empirical. Creating datasets to evaluate the reasoning ability of LLMs is therefore an important area of LLM research. A key open question is whether LLMs reason or simply recite memorized texts they have encountered during their training phase. This work conducts simple experiments using Cheryl’s Birthday Puzzle and Cheryl’s Age Puzzle and their variants created in this work to investigate whether LLMs recite or reason and discovers that LLMs tend to recite memorized answers for well-known questions, which appear more frequently on the internet, even though such answers may not be sensible for the modified versions of the questions. When presented with less well-known questions, it is observed that LLMs answer with correct reasoning more frequently. A possible inference is that LLMs tend to reason on less well-known questions but recite memorized answers on popular questions. As a result, to accurately evaluate the reasoning ability of LLMs, it is essential to create new datasets to ensure that LLMs are elicited to truly use their reasoning ability to generate responses to the presented questions. In view of the finding, this work proposes a new dataset comprising of unseen questions requiring semantic and deductive logical reasoning skills to elicit reasoning ability from LLMs. The proposed evaluation framework is based on the intuition that some questions or puzzles can only be answered through the mastery of reasoning needed for situational awareness, and the dataset consists of 84 logical reasoning questions on room assignment subject to constraints. The proposed evaluation framework has several desirable properties, including resilience to training data contamination, ease of response verification, extensibility, usefulness and automated test case generation. This work then applies the proposed dataset to evaluate the reasoning ability of state-of-the-art LLMs, including GPT-3, GPT-4, Llama-3.1, Gemini-1.5 and Claude-3.5, and compare their performance with the performance of human intelligence on the dataset.

Explainable AI (XAI) has the potential to transform healthcare by making AI-driven medical decisions more transparent, trustworthy, and ethically compliant. Despite its promise, the healthcare sector faces several challenges, including balancing interpretability and accuracy, integrating XAI into clinical workflows, and ensuring adherence to rigorous regulatory standards. This paper provides a comprehensive review of XAI in healthcare, covering techniques, challenges, opportunities, and advancements, thereby enhancing the understanding and practical application of XAI in healthcare. The study also explores responsible AI in healthcare, discussing new perspectives and emerging trends and providing valuable insights for researchers and practitioners. The insights and recommendations presented aim to guide future research and policy-making, promoting the development of transparent, trustworthy, and effective AI-driven solutions.

This article addresses the complex challenge of simultaneously enhancing contrast and detail in an image, where improving one property often compromises the other. This trade-off is tackled using a multi-objective optimization approach. Specifically, the proposal's model integrates the sigmoid transformation function and unsharp masking highboost filtering with the NSGA-II algorithm. Additionally, a posterior preference articulation is introduced to select three key solutions from the Pareto front: the maximum contrast solution, the maximum detail solution, and the knee point solution. The proposed technique is evaluated on a range of image types, including medical and natural scenes. The final solutions demonstrated significant superiority in terms of contrast and detail compared to the original images. The three selected solutions, although all are optimal, captured distinct characteristics within the images, offering different solutions according to field preferences. This highlights the method's effectiveness across different types and enhancement requirements and emphasizes the importance of the proposed preferences in different contexts.

Cross-lingual sentiment analysis is crucial for understanding and interpreting emotions expressed in text across diverse linguistic contexts. However, cross-lingual sentiment analysis faces challenges such as differences in emotional lexicons, data imbalance, and the need for multi-language sentiment normalization. In this study, we propose a novel approach to address these challenges by leveraging low-resource language training techniques to enhance cross-lingual sentiment analysis. Our method aims to bridge the gap in emotional lexicons by adapting sentiment analysis models to diverse linguistic contexts. Additionally, we tackle issues of data imbalance through innovative data augmentation strategies tailored to each language, and we introduce a multi-language sentiment normalization technique to ensure consistent sentiment interpretation across different languages. Our method achieved state-of-the-art results in twelve languages across four domains, demonstrating superior performance in both text-level and sentence-level sentiment analysis tasks. By conducting comprehensive evaluations across diverse linguistic contexts and domains, we showcase the versatility and effectiveness of our approach in achieving top-tier results in cross-lingual sentiment analysis.

Increasing concerns on animal welfare in commercial pig industry include aggression between pigs as it affects their health and growth. Early detection of aggressive behaviors is essential for optimizing their living environment. A major challenge for detection is that these behaviors are observed occasionally in normal conditions. Under this circumstance, a limited amount of aggressive behavior data will lead to class imbalance issue, making it difficult to develop an effective classification model for the detection of aggressive behaviors. To overcome this problem, we approach the aggressive behavior detection problem as a case of anomaly detection rather than classification and propose a model based on anomaly detection, which can better handle unbalanced class distribution and effectively detect the infrequent, aggressive episodes of pigs. The model consists of a convolutional neural network (CNN) and a variational long short-term memory (LSTM) autoencoder. Additionally, we adopted a training method similar to weakly supervised anomaly detection and included a few aggressive behavior data in the training set for prior learning. To effectively utilize the aggressive behavior data, we created Reconstruction Loss Inversion, a novel objective function, to train the autoencoder-based model to increase the reconstruction error of aggressive behaviors by inverting the loss function. Our anomaly detection approach significantly outperforms traditional classification-based methods, effectively identifying aggressive behaviors in a natural farming environment. This method offers a robust solution for detecting aggressive animal behaviors and contributes to improving their welfare.

This paper discusses the application of artificial intelligence in imaging omics, especially in cancer research. Imaging omics enables detailed analysis of spatial and temporal heterogeneity of tumours through high-throughput extraction of quantitative features from medical images such as MRI, PET, and CT. This paper focuses on applying PARKS systems to automate the recognition, segmentation, and extraction of image features, significantly enhancing the capabilities of clinical decision support systems (CDSS). The future direction is to establish a robust network infrastructure for radiology Medication-led Health care (RLHC) to facilitate the development and application of personalised treatment protocols, and to improve diagnostic accuracy, prognosis assessment, and treatment recommendations by uploading quantitative image features to a shared database and comparing them with historical images.

With the increasing awareness of environmental protection, the rotary hearth furnace system has emerged as a key technology that facilitates a win-win situation for both environmental protection and enterprise economic benefits. This is attributed to its high flexibility in raw material utilization, capability of directly supplying blast furnaces, low energy consumption, and high zinc removal rate. However, the complexity of the raw material proportioning process, coupled with its reliance on manual labor, results in a time-consuming and inefficient process. This paper innovatively introduces an intelligent formula method for raw materials based on online clustering algorithms and develops an intelligent batching system for rotary hearth furnaces. Firstly, the ingredients of raw materials undergo data preprocessing, which involves using the Local Outlier Factor (LOF) method to detect any abnormal values, Kalman filtering to smooth the data, and performing one-hot encoding to represent the different kinds of raw materials. Afterwards, the affinity propagation (AP) clustering method is used to evaluate past data on the ingredients of raw materials and their ratios. This analysis aims to extract information based on human experience with ratios and create a library of machine learning formulas. The incremental AP clustering algorithm is utilized to learn new ratio data and continuously update the machine learning formula library. To ensure that the formula meets the actual production performance requirements of the rotary hearth furnace, the machine learning formula is fine-tuned based on expert experience. The integration of machine learning and expert experience has demonstrated good flexibility and satisfactory performance in the practical application of intelligent formulas for rotary hearth furnaces. An intelligent batching system is developed and executed at a steel plant in China. It shows an excellent user interface and has significantly enhanced batching efficiency and product quality.

Mobile health technologies enable continuous, quantitative assessment of mobility and gait in real-world environments, facilitating early diagnosis of gait disorders, disease progression monitoring, and prediction of adverse events like falls. Traditionally, mobile gait assessment predominantly relied on body-fixed sensors positioned at the feet or lower trunk. Here, we investigate the potential of an algorithm utilizing an ear-worn motion sensor for spatiotemporal segmentation of gait patterns. We collected 3D acceleration profiles from the ear-worn sensor during varied walking speeds in 53 healthy adults. Temporal convolutional networks were trained to detect stepping sequences and predict spatial relations between steps. The resulting algorithm, mEar, accurately detects initial and final ground contacts (F1 score of 99% and 91%, respectively). It enables determination of temporal and spatial gait cycle characteristics (among others stride time and stride length) with good to excellent validity at a precision sufficient to monitor clinically relevant changes in walking speed, stride-to-stride variability, and side asymmetry. This study highlights the ear as a viable site for monitoring gait and proposes its potential integration with in-ear vital sign monitoring. Such integration offers a practical approach to comprehensive health monitoring and telemedical applications, by integrating multiple sensors in a single anatomical location.

As Large Language Models (LLMs) increasingly accommodate larger inputs, context windows spanning hundreds of thousands or even millions of tokens are touted as promising for a wide array of applications. However, the potential decay in reasoning ability for larger inputs may compromise their utility. This study introduces a new benchmark called Find the Origin, which progressively tests the efficacy of LLMs on a simple intellectual task as the size of the context window increases. The test, conducted on 14 different LLMs for comparative analysis, demonstrated that reasoning ability is dependent on input size. Additionally, three independent tests were performed with the GPT-4 Turbo model to demonstrate its reasoning degradation in different contexts as input size increases.

The continuous expansion of Large Language Models (LLMs) has significantly transformed the fields of artificial intelligence (AI) and natural language processing (NLP). This paper reviews the rapidly evolving domain of language models and introduces the concept of Extremely Large Language Models (XtremeLLMs), a new category defined for models exceeding one trillion parameters. These models are monumental in scale and engineered to enhance performance across a diverse range of language tasks. This study aims to establish a comprehensive framework that explores the significant opportunities and complex challenges presented by such extensive scaling and emphasises the implications for future advancements in the field.

Artificial Intelligence (AI) is poised to revolutionize the architectural design and energy management of green buildings, offering significant advancements in sustainability and efficiency. This paper explores the transformative impact of AI on improving energy efficiency and reducing carbon emissions in commercial buildings. By leveraging AI algorithms, architects can optimize building performance through advanced environmental analysis, automation of repetitive tasks, and real-time data-driven decision-making. AI facilitates precise energy consumption forecasting and integration of renewable energy sources, enhancing the overall sustainability of buildings. Our study demonstrates that AI can reduce energy consumption and CO2 emissions by approximately 8% and 19%, respectively, in typical mid-size office buildings by 2050 compared to conventional methods. Further, the combination of AI with energy efficiency policies and low-emission energy production is projected to yield reductions of up to 40% in energy consumption and 90% in CO2 emissions. This paper provides a systematic approach for quantifying AI's benefits across various building types and climate zones, offering valuable insights for decision-makers in the construction industry.

In the present era, there is no longer a necessity to rely on outdated and laborious methods for attendance management in the field of education. Managing attendance for large groups of students in a classroom can be a challenging and time-consuming task when it comes to recording data. Fortunately, modern technologies offer us the opportunity to streamline attendance management and make it more efficient. One effective approach is Real-Time Face Recognition, which simplifies the process of tracking attendance for numerous students daily. We employ the Haar cascade classifier to identify positive and negative facial attributes, along with the LBPH algorithm for accurate face recognition. These techniques are implemented using Python programming language and the OpenCV library while incorporating a user-friendly Tkinter GUI (Graphical User Interface) for seamless usability. By embracing these advancements, we can revolutionize how attendance is managed in educational environments.

Human Pose Estimation (HPE) is a critical technology in computer vision with diverse applications ranging from healthcare to sports analysis. This project presents a method for detecting the 2D stance of multiple persons in an image using a nonparametric representation known as Part Affinity Fields (PAFs). By leveraging the first 10 layers of the VGG-19 convolutional neural network and training on the COCO dataset, our model effectively identifies and associates key points of the human body.The architecture employs a two-branch system that jointly learns part locations and their associations through sequential prediction. This enables the model to maintain real-time performance while achieving high accuracy, regardless of the number of persons in the image. To enhance accessibility, we developed a mobile application using Flutter and TensorFlow Lite, allowing real-time pose estimation via a mobile device’s front camera. The app provides immediate feedback on physical exercises and yoga poses, making it an invaluable tool for fitness enthusiasts and healthcare professionals. Visual outputs such as heatmaps and PAFs confirm the model’s capability to accurately localize and connect key points. Despite potential challenges such as data quality and hyperparameter tuning, the results indicate that our approach is both reliable and practical for real-world deployment. This project not only advances the state-of-the-art in HPE but also opens up possibilities for future enhancements, including integrating 3D pose estimation and applying the technology in augmented and virtual reality applications.

In this study, we propose a scalable deep learning approach to automated phenotyping using UAV multispectral imagery, exemplified by yellow rust detection in winter wheat. We adopt a high granularity scoring method (1 to 9 scale) to align with international standards and plant breeders’ needs. Using a lower spatial resolution (60m flight height at 2.5cm GSD), we reduce the data volume by a factor of 3.4, making large-scale phenotyping faster and more cost-effective while obtaining results comparable to those of the state-of-the-art. Our model incorporates explainability components to optimise spectral bands and flight schedules, achieving top-3 accuracies of 0.87 for validation and 0.67 and 0.70 on two separate test sets. We demonstrate that a minimal set of bands (EVI, Red, and GNDVI) can achieve results comparable to more complex setups, highlighting the potential for cost-effective solutions. Additionally, we show that high performance can be maintained with fewer time steps, reducing operational complexity. Our interpretable model components improve performance through regularisation and provide actionable insights for agronomists and plant breeders. This scalable and explainable approach offers an efficient solution for yellow rust phenotyping and can be adapted for other phenotypes and species, with future work focusing on optimising the balance between spatial, spectral, and temporal resolutions.

The purpose of this paper is to describe a feature selection algorithm and its application to enhance the accuracy of the reconstruction of phylogenetic trees by improving the efficiency of tree construction. Applying machine learning models for Arabic and Aramaic scripts such as Deep Neural Networks (DNN), Support Vector Machines (SVM) and Random Forests (RF) each model was used to compare the phylogenies. The methodology was utilized with a dataset containing Arabic and Aramaic scripts, demonstrating its relevance in a range of phylogenetic analyses. Results emphasize the essential role of feature selection by DNNs is outperforming other models in terms of Area Under the Curve (AUC) and Equal Error Rate (EER) across various datasets and fold sizes. Additionally, SVM and RF models show important understandings, advantages and limits of each approach within the context of phylogenetic analysis. This method not only simplifies the tree structures but also enhances their Consistency Index. Therefore offering a robust framework for evolutionary studies. The findings highlight the applications of machine learning in phylogenetics suggesting a path toward accurate and efficient evolutionary analyses and adding a deeper understanding of evolutionary relationships.

Countless disasters have resulted from climate change, causing severe damage to infrastructure and the economy. These disasters have significant societal impacts, necessitating mental health services for the millions affected. To prepare for and respond effectively to such events, it is crucial to understand people's emotions and the life incidents they experience both before and after a disaster strikes. In this case study, we mined the emotions and life incidents expressed on Twitter during the 2017 Hurricane Harvey. Between August 20 and August 30, we collected a dataset of approximately 400,000 public tweets related to the storm. Using a BERT-based model, we predicted the emotions associated with each tweet. Following emotion prediction, we applied various natural language processing techniques to analyze the content of the tweets, aiming to uncover the 'topics' discussed alongside specific 'emotions.' To efficiently identify these topics, we utilized the Latent Dirichlet Allocation (LDA) technique for topic modeling, which allowed us to bypass manual content analysis and extract meaningful patterns from the data. However, rather than stopping at topic identification, we further refined our analysis by integrating Graph Neural Networks (GNN) and Large Language Models (LLM). The GNN was employed to generate embeddings and construct a similarity graph of the tweets, which was then used to optimize clustering. This step ensured that related tweets were accurately grouped together based on their content and context. Subsequently, we used an LLM to automatically generate descriptive names for each event cluster. This advanced approach allowed us to identify and label life incidents automatically, providing a nuanced understanding of the key issues faced by the community during the hurricane. The results revealed significant emotional shifts as the hurricane reached its most devastating phase. These shifts coincided with pressing concerns and demands from the population, such as evacuation plans, animal safety, safety updates, public policy, help requests, flood impacts, and the spread of fake news. By combining GNN and LLM for automatic event name prediction, our study not only mapped out the emotions but also accurately categorized the specific life incidents that were most relevant during the disaster, offering critical insights for disaster preparedness and response strategies.

Two-dimensional ultrasound (2D US) is commonly used in clinical settings for its cost-effectiveness and non-invasiveness, but it is limited by spatial orientation and operator dependency. Three-dimensional ultrasound (3D US) overcomes these limitations by adding a third dimension and enhancing integration with other imaging modalities. Advances in deep learning (DL) have further propelled the viability of freehand image-based 3D reconstruction, broadening clinical applications in intraoperative and point-of-care (POC) settings. This review evaluates state-of-the-art freehand 3D US reconstruction methods that eliminate the need for external tracking devices, focusing on experimental setups, data acquisition strategies, and reconstruction methodologies. PubMed, Scopus, and IEEE Xplore were searched for studies since 2014 following PRISMA guidelines, excluding those using additional imaging or tracking systems other than inertial measurement units (IMUs). Fourteen eligible studies were analyzed, showing a shift from traditional speckle decorrelation towards DL-based methods, particularly Convolutional Neural Networks (CNNs). Variability in datasets and evaluation methods hindered a comprehensive quantitative comparison, but notable accuracy improvements were observed with IMUs and integration of contextual and temporal information within CNNs. These advancements enhance freehand 3D US reconstruction feasibility, though variability limits definitive conclusions about the most effective methods. Future research should focus on improving precision in complex trajectories and adaptability across clinical scenarios.

Tackling the intricacies of network dismantling in complex systems poses significant challenges. This task has relevance across various practical domains, yet traditional approaches focus primarily on singular metrics, such as the number of nodes in the Giant Connected Component (GCC) or average pairwise connectivity. In contrast, we propose a unique metric that concurrently targets nodes with the highest degree and reduces the GCC size. Given the NP-hard nature of optimizing this metric, we introduce MaxShot, an innovative end-to-end solution that leverages graph representation learning and reinforcement learning. Through comprehensive evaluations on both synthetic and real-world datasets, our method consistently outperforms leading benchmarks in accuracy and efficiency. These results highlight MaxShot’s potential as a superior approach to address the network dismantling problem effectively.

The advancements in social networking have empowered open expression on micro blogging platforms like Twitter. Traditional Twitter Sentiment Analysis (TSA) faced challenges due to rule-based or dictionary algorithms, dealing with feature selection, ambiguity, sparse data, and language variations. This study proposed a classification framework for Twitter sentiment data using word count vectorization and machine learning techniques to reduce the difficulties addressed on annotated sentiment-labelled tweets. Various classifiers (Naive Bayes, Decision Tree, K Nearest Neighbours, Logistic Regression, and Random Forest) were evaluated based on Accuracy, Precision, Recall, F1-score, and Specificity. Random Forest outperformed others with an Area under Curve (AUC) value of 0.96, and an Average Precision (AP) score of 0.96 in sentiment classification, especially effective with minimal Twitter-specific features.

The finite-time turnpike property describes the situation in an optimal control problem where an optimal trajectory reaches the desired state before the end of the time interval and remains there. We consider a machine learning problem with a neural ordinary differential equation that can be seen as a homogenization of a deep ResNet. We show that with appropriate scaling of the quadratic control cost and the non-smooth tracking term the optimal control problem has the finite-time turnpike property, that is the desired state is reached in the interior of the time interval and the optimal state remains there until the terminal time $T$. This property is useful to achieve a compromise between the depth of the network and the size of the optimal system parameters which we hope will be useful to determine optimal depths for neural network architectures in the future.

Data security and user privacy concerns are increasingly gaining attention. Federated learning models based on differential privacy offer a distributed machine learning framework that protects data privacy; however, the added noise can impact the model's utility, making performance evaluation crucial. To optimize the balance between privacy protection and model performance, we propose the Adaptive Weight-Based Differential Privacy Federated Learning (AWDP-FL) framework. This framework processes model parameters from the perspectives of neural network layers and model weights. Initially, each participant trains the model locally. During iterative training, the clipping threshold is determined by selecting an adaptive weight coefficient, followed by adaptive gradient clipping to control the gradient magnitude. Subsequently, adaptive gradient updates are applied to the model, and dynamic Gaussian noise is introduced when uploading the parameters to protect participant privacy. The server aggregates these noise-perturbed parameters to update the global model. This framework ensures strong privacy protection while maintaining model accuracy. Theoretical analysis and experimental results validate the effectiveness of this framework under stringent privacy constraints.

Gastrointestinal (GI) tract disorders, ranging from benign polyps to aggressive forms of cancer, pose significant health challenges globally. Early detection and precise classification of these conditions are crucial for effective treatment and improving patient survival rates. This study employs the Hyper-Kvasir dataset, a comprehensive collection of endoscopic images, to develop deep learning models that harness the power of the YOLO (You Only Look Once) architecture for real-time detection and classification of GI abnormalities. The focus is on overcoming inherent challenges such as class imbalance and limited annotated data availability. Advanced machine learning strategies, including data augmentation and semi-supervised learning, are utilized to enhance the model's performance. Our experiments demonstrate notable improvements in the detection of pre-cancerous lesions and other GI abnormalities, confirming the potential of integrating AI into endoscopic practices to support clinicians, reduce diagnostic errors, and contribute to more accurate and timely diagnoses. The implications of these findings are significant, offering a pathway to more reliable diagnostic processes and ultimately, better patient management in gastroenterology.

Machine learning (ML) has transformed the financial industry by enabling advanced applications such as credit scoring, fraud detection, and market forecasting. At the core of this transformation is deep learning (DL), a subset of ML that is robust at processing and analyzing complex and large datasets. This paper provides a concise overview of key deep learning models, including Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), Deep Belief Networks (DBNs), Transformers, Generative Adversarial Networks (GANs), and Deep Reinforcement Learning (Deep RL). The study examines their learning processes, mathematical foundations, and practical applications in finance. It also explores recent advances and emerging trends in the financial industry alongside critical challenges such as data quality, model interpretability, and computational complexity, offering insights into future research directions that can guide the development of more robust and explainable financial models.

Kolmogorov–Arnold Network (KAN) is an emerging interpretable neural network compared to fully black-box MLPs. Recently, emerging works focus on comprehensive and fair comparisons between KAN and MLP in various tasks. However, these works didn't focus on the strongest advantage of KAN: generating symbolic outputs. The ability of KAN to provide scientific insights or even discover new science is under-examined. In this work, we propose several novel metrics to measure how well a KAN performs on symbolic function fitting: R^2-Mean, weighted R^2-complexity loss, and ranking metrics. We also propose a metric to determine mathematical complexity of a target function and evaluate KAN with several functions of different mathematical complexity. Additionally, we also tried inputs with different ranges to find the effect of normalization.

Recently, the destructive impact of wildfires has proliferated; for instance, the August Complex wildfire in 2020 burned around 4% of California's landmass. This has caused increased economic damage and risk to human life. Additionally, climate change is anticipated to increase the severity of wildfires, making it imperative for accurate and efficient detection of wildfires. Machine Learning approaches allow for the automatic detection of wildfires, simultaneously prioritizing accuracy and efficiency, with minimal human intervention, thus decreasing the likelihood of increased economic damage and increasing firefighting responses. Convolutional Neural Networks (CNNs), while showing promise, are often limited by their inability to learn and capture deep spatial dependencies in satellite imagery tasks. In this paper, we propose FlameViT, a novel wildfire detection architecture based on Vision Transformers (ViT). Satellite images are more efficient to obtain and can cover wide areas prone to wildfires. We obtain a dataset of 40K+ satellite images from Canada's Open Government Portal, allowing FlameViT to be optimized to detect wildfires in satellite imagery. FlameViT uses Patch Extractor and Patch Embedding layers, followed by multiple Transformer Encoder layers with Multi-Head Self-Attention and feed-forward neural networks. FlameViT is hyperparameter-tuned and achieves a validation accuracy of 95%, outperforming various baselines in the wildfire detection task. FlameViT shows the power of Vision Transformers for wildfire detection tasks, and in conjunction with the use of satellite imagery, can provide an efficient and accurate way of detecting wildfires.

This paper proposes causal economic machine learning (CEML) as a research agenda that utilizes causal machine learning (CML) built on causal economics (CE) decision theory. Causal economics is better suited for use in machine learning optimization than expected utility theory (EUT) and behavioral economics (BE) based on its central feature of causal coupling (CC), which models decisions as requiring upfront costs, some certain and some uncertain, in anticipation of future, uncertain causally-linked benefits. This multi-period, causal-linked process incorporating certainty and uncertainty replaces the single period lottery outcomes augmented with intertemporal discounting used in EUT and BE, providing a more realistic framework for AI machine learning modelling and real world application. It is mathematically demonstrated that EUT and BE are constrained versions of CE. Causal coupling can also be applied at the macroeconomic level to gauge the effectiveness of policies that deliver various levels of cost and benefit coupling for individuals. With the growing interest in natural experiments in statistics and CML across many fields, such as healthcare, economics and business, there is a large potential opportunity to run AI models on CE foundations and compare results to models based on traditional decision making models that focus only on rationality, bounded to various degrees.

Deep convolutional neural networks (CNNs) have revolutionised computer vision technology by automatically learning hierarchical representations of image data, leading to state-of-the-art performance in visual recognition tasks. This article presents a comprehensive review of deep CNNs, from their evolution and architectures to the current state-of-the-art research. The review also provides the core concepts and building blocks of CNNs and their concise mathematical representations. Furthermore, it explores applications of deep CNNs in three popular domains, including medical diagnosis, remote sensing, and facial recognition. This review will benefit researchers and practitioners in computer vision and artificial intelligence, as well as industry professionals seeking to leverage the latest advancements in deep learning technologies.

Visual thinking leverages spatial mechanisms in animals for navigation and reasoning. Therefore, given the challenge of abstract mathematics and logic, spatial reasoning-based teaching strategies can be highly effective. Our previous research verified that innovative box and ball coloring activities help teach elementary school students complex notions like quantifiers, logical connectors, and dynamic systems. However, given the richness of the activities, correction is slow, error-prone, and demands high attention and cognitive load from the teacher. Moreover, feedback to the teacher should be immediate. Thus, we propose to provide the teacher with real-time help with LLMs. We explored various prompting techniques with and without context Zero shot, Few shot, Chain of Thought, Visualization of Thought, Self Consistency, logicLM and Emotional to test GPT-4o’s visual, logical, and correction capabilities. We obtained that Visualization of Thought and Self Consistency techniques enabled GPT-4o to correctly evaluate 90% of logical-spatial problems that we tested. Additionally, we propose a novel prompt combining some of these techniques that achieved 100% accuracy on a testing sample, excelling in spatial problems and enhancing logical reasoning.

Artificial intelligence (AI) is transforming many healthcare fields including pediatric urology. This in-depth review explores recent advances in AI tools for pediatric urology, emphasizing how state-of-the-art technologies can be used to enhance patient treatment. An initial overview of pediatric urology is given to provide context for this interdisciplinary field and the wide spectrum of problems this entails, before discussing potential uses of AI to improve diagnostic accuracy, treatment planning, and surgical results. AI-powered predictive models are already changing pediatric clinical practice by guiding interpretation of medical images and supporting decision making. In addition to outlining the aims, methods, and conclusions of previous studies on AI applications in pediatric urology, this review also highlights knowledge gaps and priority areas for future study. Particular focus is given to specialized surgeries such pyeloplasty, where AI-guided treatment may help overcome specific technical challenges of this complex procedure. Also highlighted are practical, ethical, and legal aspects of integrating AI into pediatric urology, which will be crucial for responsible innovation in patient-centered treatment. Overall, this article aims to enlighten and inspire clinicians, researchers, and other healthcare stakeholders by offering insight into the future of AI in pediatric urology.

This paper proposes a novel facial expression recognition network called the Lightweight Facial Network with Spatial Bias (LFNSB). The LFNSB model balances model complexity and recognition accuracy. It has two key components: a lightweight feature extraction network (LFN) and a Spatial Bias (SB) module for aggregating global information. The LFN introduces combined channel operations and depthwise convolution techniques, effectively reducing the number of parameters while enhancing feature representation capability. The Spatial Bias module enables the model to focus on local facial features while also capturing the dependencies between different facial regions. Additionally, a novel loss function called Cosine-Harmony Loss is designed. This function optimizes the relative positions of feature vectors in high-dimensional space, resulting in better feature separation and clustering. Experimental results on the AffectNet and RAF-DB datasets show that the proposed LFNSB model performs excellently in facial expression recognition tasks. It achieves high recognition accuracy while significantly reducing the number of parameters, thus substantially lowering model complexity.

Accurate stock market predictions following earnings reports are crucial for investors. Traditional methods, particularly classical machine learning models, struggle with these predictions because they cannot effectively process and interpret extensive textual data contained in earnings reports and often overlook nuances that influence market movements. This paper introduces an advanced approach by employing Large Language Models (LLMs) instruction fine-tuned with a novel combination of instruction-based techniques and quantized low-rank adaptation (QLoRA) compression. Our methodology integrates ‘base factors’, such as financial metric growth and earnings transcripts, with ‘external factors’, including recent market indices performances and analyst grades, to create a rich, supervised dataset. This comprehensive dataset enables our models to achieve superior predictive performance in terms of accuracy, weighted F1, and Matthews correlation coefficient (MCC), especially evident in the comparison with benchmarks such as GPT-4. We specifically highlight the efficacy of the llama-3-8b-Instruct-4bit model, which showcases significant improvements over baseline models. The paper also discusses the potential of expanding the output capabilities to include a ‘Hold’ option and extending the prediction horizon, aiming to accommodate various investment styles and time frames. This study not only demonstrates the power of integrating cutting-edge AI with fine-tuned financial data but also paves the way for future research in enhancing AI-driven financial analysis tools.

As businesses increasingly adopt advanced technologies to enhance productivity and safety, the integration of human-robot collaboration (HRC) emerges as a transformative approach. This paper explores the role of GPU-accelerated computer vision and generative AI in optimizing HRC within business environments. By leveraging the computational power of GPUs, real-time data processing, and advanced machine learning algorithms, robots can better interpret complex visual cues and adapt to dynamic workspaces. Generative AI further enables the design of intelligent robotic systems capable of anticipating human actions, optimizing task allocation, and ensuring safety through predictive modeling. This research highlights the potential of these technologies to improve operational efficiency, reduce human error, and create safer, more adaptable workplaces. The implications of such advancements are discussed, providing insights into the future of HRC in various industries.

A contemporary technique for calculating seismic risk is earthquake nowcasting (EN), which analyzes the progression of the earthquake (EQ) cycle in fault systems. 'Natural time' is a novel idea of time that serves as the foundation for EN assessment. The earthquake potential score (EPS), which has been discovered to have useful uses regionally and worldwide, is a unique tool EN uses to predict seismic risk. For the estimation of the EPS for the occurrences with the highest magnitude among these applications, we have since 2021 concentrated on Greece territory, applying sophisticated Artificial Intelligence (AI) algorithms, both wise (semi)supervised and unsupervised models, along with a customized dynamic sliding window technique that performs as a stochastic filter able to fine-tune the geo seismic occurrences. Long short-term memory (LSTM) neural networks, random forests, and clustering (geospatial) models are three machine learning techniques that are particularly good at finding patterns in vast databases and may be used to enhance earthquake prediction performance. In this study, we attempt to forecast whether practical Machine-learning and AI/Game-theoretic-based approaches can help predict big earthquakes and the normal future seismic cycle for 6-12 months. Specifically, we focus on answering two questions for a given region: (1) Is there a chance that a significant earthquake—say, one with a magnitude of M ≥ 6.0 will happen in the upcoming year? (2) What is the largest earthquake magnitude predicted in the upcoming year, and with which exact geographic coordinates (GCS)? Our results are quite promising and project a high precision accuracy score (≥ 98%) for seismic nowcasting in terms of four predictive parameters: the approximate (a) latitude, (b) longitude, (c) focal depth, and (d) magnitude of the phenomena.

The purpose of this project is to explore the potential of Long Short-Term Memory (LSTM), a type of recurrent neural network (RNN), as a tool for making directional predictions for assets. The focus will be on using LSTM for classifying up/down moves in stock indices, stocks, and FX rates (EUR/USD). Various financial ratios, advanced technical indicators, and volatility estimators will be used as features to enhance the predictive power of the model. Incorporating credit spreads and news indicators can also improve the model. The advantage of LSTM is its ability to handle sequences of arbitrary length, which means that longer time frames such as 5-day, 10-day, or 1-week returns can be used for prediction. Before using RNNs, exploratory data analysis (EDA) will be performed to understand the underlying patterns in the data. This may include dimensionality reduction techniques such as autoencoding, self-organizing maps, or decision tree regression. The results of the EDA will be used to guide the selection of features for the LSTM model. It is important to note that long memory and stationarity are common characteristics of time series data, such as interest rates or economic indicators. Power-law autocorrection, Hurst exponent fractional, or Markov processes may be used to model these data. Predicting 5-day, 10-day returns for equities or 1-week, 1-month returns for financial factors presents two challenges. First, a large amount of data is required, typically 7–10 years of data. Second, positive autocorrelation in the 5-day or 10-day returns in equity time series must be isolated.

This paper aims to explore the potential application of Extreme Learning Machines (ELM) in stock price prediction and optimise the ELM model by combining the Crown Porcupine Optimisation Algorithm and the Adaptive Bandwidth Kernel Function Density Estimation Algorithm. Specifically, the model's root mean square error (RMSE) on the test set is 0.018, which shows its good prediction accuracy. Meanwhile, the correlation coefficient R reaches 0.968, proving the model's effectiveness in predicting stock prices. In addition, the coefficient of determination R² of the training set and test set are 0.987 and 0.954, respectively, which are not much different, indicating that the model has good generalisation ability and is not prone to overfitting. This is crucial for practical application, as it implies that the model fits the existing data well and makes accurate predictions for future data. In terms of other evaluation metrics such as Mean Absolute Error (MAE), Root Mean Square Error (RMSE) and Mean Absolute Percentage Error (MAPE), the performance is excellent in both the training and test sets. Together, these results indicate that after optimising the ELM by introducing the crown porcupine optimisation algorithm and the adaptive bandwidth kernel function density estimation algorithm, the model can effectively capture the changing stock price pattern, thus achieving efficient and accurate stock price prediction. In summary, this study not only demonstrates the great potential of ELM in stock price prediction but also highlights the importance of improving the model performance through advanced algorithm optimisation, which provides a new way of thinking and methodology for financial market analysis. This strongly supports investors' decision-making and lays the foundation for related research.

This article explores the specific impact of artificial intelligence (AI) -driven data visualisation technologies in the user experience of the Internet industry. Through the introduction of machine learning and data mining technologies, AI has significantly improved the intelligence and automation of data visualization tools, promoting innovation in visualization methods and improving the quality and efficiency of data cleaning, processing, and analysis. In addition, AI has also promoted the development of personalised data visualization, providing users with a richer and more intuitive way to present data. This paper analyses the applications of AI-driven data visualization in machine learning, natural language processing, and computer vision. It demonstrates the positive effects of AI data visualization on user understanding and optimisation of models through practical feedback from Yellowbrick tools.

Assessing the quality of corn seeds necessitates evaluating their content of water, fat, protein, and starch. This study integrates hyperspectral imaging technology with chemometric analysis techniques to achieve non-invasive and rapid detection of multiple key components in corn seeds. Hyperspectral images of the embryo surface of maize seeds were collected within the wavelength range of 1100~2498nm. Subsequently, image segmentation techniques were applied to extract the germ structure of the corn seeds as the region of interest. Seven spectral data preprocessing algorithms were employed, and the Detrending Transformation (DT) algorithm was identified as the optimal preprocessing method through comparative analysis using the Partial Least Squares Regression (PLSR) model. To reduce spectral redundancy and streamline the prediction model, three algorithms were employed for characteristic wavelength extraction: Successive Projections Algorithm (SPA), Competitive Adaptive Reweighted Sampling (CARS), and Uninformative Variable Elimination (UVE). Using both the original spectra and the extracted characteristic wavelengths, four content detection models were constructed: PLSR, Back Propagation Neural Network (BPNN), Radial Basis Function Neural Network (RBFNN), and Least Squares Support Vector Machine (LSSVM). The experimental results demonstrate that the DT-CARS-LSSVM model exhibits exceptional accuracy and stability in predicting these four key components, with determination coefficients of 0.9877, 0.9344, 0.9827, and 0.9592, respectively. This study not only provides a scientific basis for evaluating the quality of corn seeds but also opens up new avenues for the development of non-invasive detection technology in related fields.

Localizing faults in a software is a tedious process. The manual approach is becoming impractical because of the large size and complexity of contemporary computer systems as well as their logs, which are often the primary source of information about the fault. Log-based Fault Localization (LBFL) is a popular method applied for this purpose. However, in real-world scenarios, this method is vulnerable to a large number of previously unseen log lines. In this paper, we propose a novel method that can guide programmers to the location of a fault by creating a hierarchy of log lines with the highest rank, selected by the traditional LBFL method. We use the intuition that the symptoms of faults are in the context of normal behavior, whereas suspicious log lines grouped together are from new or additional functionalities turned on during faulty execution. To obtain this context, we used unsupervised log sequence segmentation, which has been previously used to segment log sequences into meaningful segments. Experiments on real-life examples show that our method reduces the effort to find the most crucial logs by up to 64% compared to the traditional timestamp approach. We demonstrated that context is highly useful in advancing fault localization, showing the possibility of further speeding up the process.

Painting style and creativity are fundamental to art, defining a work’s uniqueness and expression. They embody an artist’s personality, convey emotions, establish identity, and shape audience perception, adding depth and value to the work. Recently, diffusion models have gained popularity in art design, animation, and gaming, especially in original painting creation, poster design, and visual identity development. Traditional creative processes, while demanding unique imagination and creativity, often face challenges such as slow innovation, high reliance on manual efforts, high costs, and limitations in scalability. Consequently, exploring painting-style creative design through deep learning has emerged as a promising trend. In this paper, we introduce a novel network architecture, the Painting-Style Design Assistant Network (PDANet), for style transformation. To support this, we curated the Painting-42 dataset, comprising 4,055 works by 42 renowned Chinese painters. PDANet leverages this dataset to capture the aesthetic intricacies of Chinese painting, offering rich design references. Furthermore, we propose a lightweight Identity-Net for large-scale text-to-image (T2I) models, which aligns internal knowledge with external control signals, thereby enhancing the capabilities of existing T2I models. The trainable Identity-Net feeds image prompts into the U-Net encoder to generate diverse and stable images. Both quantitative and qualitative analyses demonstrate that our approach outperforms current methods, delivering high-quality generated content with wide-ranging applicability.

Chip pad alignment inspection is of great importance in the industrial field. However, due to the fact that chip pads are usually small, problems such as misdetection and missed detection often occur. When applying deep learning methods for chip pad detection, it is necessary to ensure accurate detection of small target chips while meeting the requirements of lightweight detection models for industrial needs. To solve the above problems, this paper proposes a lightweight model based on improved YOLOv5s. Firstly, the feature extraction part is improved to increase the network's focus on the target. Secondly, the feature fusion layer is improved to double the resolution of the prediction head, and the context-aware network is designed to enhance the context-capture ability of key features of small targets. Finally, SIoU is adopted as the loss function to improve the speed and accuracy of the regression frame. The experimental results show that the improved YOLOv5s algorithm improves the detection accuracy by 2.3% and reduces the network parameters by 81.8% compared to the original algorithm. The improved algorithm is combined with image processing techniques to design correction methods for alignment anomalies and realize real-time alignment anomaly correction in industry.

The application of AI technology in urban planning covers multiple levels, such as data analysis, decision support, and automated planning. Urban research relies on AI technology to understand and summarize the law of urban growth and improve the analysis of the evolution trend of urban space. Planning and design use AI technology to explore the relevant factors affecting urban development and their weights and discuss the critical role of green building technology in the sustainable development of the construction industry. With the increase in global energy consumption and carbon emissions, traditional building methods can no longer meet environmental protection requirements and efficient use of resources. As a sustainable development solution, green building technology has been paid more and more attention to and adopted by people. These technologies focus not only on the energy efficiency and environmental impact of buildings but also on the resource utilization and environmental load of green buildings over their entire life cycle driven by machine learning. This paper details the basic principles and applications of green building technologies, including AI-driven reduction of negative environmental impacts, improvement of occupant health, efficient use of resources, and optimization of indoor environmental quality. This paper focuses on the critical role of the LEED assessment system developed by the U.S. Green Building Council in advancing green building practices. In addition, the paper analyzes vital points such as water use in green building design, machine learning-driven wind environment optimization, solar technology application, and practical application cases of these technologies on a global scale.

The construction industry is an important part of the national economic market of various countries; since 2013, the construction industry's added value in the gross domestic product has been more than 6%, reaching 6.89% in 2022, and is a pillar industry of the national economy. Intelligent construction is the realistic demand to promote the high-quality development of China's construction industry. It is the key focus of transforming and upgrading the traditional construction industry to information, digital, and intelligent. As a new production factor, construction robots have become the key to promoting intelligent construction. Under the guidance of various national and industry policies, thanks to China's huge construction market volume and rich application scenarios, many innovative and entrepreneurial entities have entered the field of construction robots. Architectural visualization is a crucial aspect of architectural design and communication. With the development of science and technology, artificial intelligence (AI) technology is increasingly becoming an essential tool for architectural visualization and communication. The emergence of AI technology has provided architects with more flexible and creative ways to present design ideas. All along, designers who love architecture have been passionate about exploring better solutions for architecture, but there is never an optimal solution for architectural design; AI is the fire of the future era; it brings us more opportunities but also forces us to face new challenges from the future.

The impact of financial risks extends beyond the normal operation and survival of industrial and commercial enterprises and financial institutions. They also have the potential to impede the stable development of a country's and even the world's financial economy. This is clearly demonstrated by the severe consequences of the frequent financial crises that have occurred in recent years. It thus follows that the prevention of financial risks has become one of the core tasks of the operation and management of industrial and commercial enterprises and financial institutions. Portfolio optimization techniques are employed in the construction of a variety of asset allocation models, with reinforcement learning algorithms used to dynamically adjust investment strategies with the objective of maximizing returns and minimizing risks. The preliminary construction of an asset allocation model is achieved through the utilization of a genetic algorithm. Genetic algorithms emulate the processes of natural selection and genetic variation to identify the optimal portfolio of assets that will yield the greatest returns at a pre-established level of risk. Subsequently, the Deep Q-Learning algorithm is introduced to facilitate dynamic adjustments and optimization of the asset allocation, based on the initial construction. Deep Q-learning employs deep neural networks to forecast the prospective returns of disparate investment strategies, thereby optimizing the decision-making process through continuous learning and updating. The combination of genetic algorithms and deep Q-learning enables the system to identify the optimal investment strategy under a diverse range of initial conditions and to adapt it in real-time to respond to market fluctuations and uncertainties. The experimental analysis demonstrates that the proposed method exhibits an exemplary capacity for risk control and a robust ability to generate stable income growth across diverse market environments. In simulation experiments, portfolios constructed using this method demonstrate lower volatility and higher average returns than those generated through traditional methods.

False news refers to false, fake, or misleading information presented as real news. In recent years, there has been a noticeable increase in false news on the Internet. The goal of this paper was to study the automatic detection of such false news using machine learning and natural language processing techniques and to determine which techniques work the most effectively. This article first studies what constitutes false news, and how it differs from other types of misleading information. We also study the results achieved by other researchers on the same topic. After building a foundation to understand false news, and the various ways of automatically detecting it, this article provides its own experiments. These experiments were done on four different datasets, one that was made just for this article, and using 10 different machine learning methods. The results of this article were satisfactory and provided answers to the original research questions set up at the beginning of this article. This article could determine from the experiments that passive-aggressive algorithms, support vector machines, and random forests are the most efficient methods for automatic false news detection. This article also concluded that more complex experiments, such as using multiple levels of identifying false news or detecting computer-generated false news, require more complex machine learning models.

Recommender systems in education are becoming more widespread, typically focusing on recommending courses or study materials. This study proposes a machine learning approach to recommend a university degree based on high school and university standardised test results, incorporating students' socioeconomic information as input variables. The objective is to develop a tool for students’ decision-making, supporting the sustainable development goal of Quality Education by providing a data schema to maximise the likelihood of a successful match between the student's profile and the academic program. With its focus on equity in education, this study provides a data-driven approach to assist students in selecting suitable university degrees, aiming to improve educational outcomes and inspire a more equitable education system.

Groundnut is an oil seed cash crop, that can be consumed directly by humans and animals. It is also used as an intelligence in the industrial production of butter and other products. However, Groundnut seeds can become infected with fungi, viruses, pests, physical damage, and high heat, which can negatively impact crop yield, quality, and economic value, and pose health hazards. To address these challenges, computer vision technology detects and classifies defects. This study introduced an ensemble deep learning defected classification model that combines VGG16 and InceptionV3 using seed images. To enhance model performance, collected images are preprocessed using novel techniques tailored to different image types. Preprocessing techniques are chosen based on image-quality evaluation metrics. Watershed segmentation is applied followed by detecting the region of interest in the image using YOLOv3. The image dataset is augmented and balanced using a Generative Adversarial Network (GAN). The model development involves a combination of classical and deep-based features, comparing features extracted with (HOG and GLCM) to those extracted with InceptionV3 and VGG16. The ensemble model achieves an accuracy of 96.25% with a split ratio of 10% for testing, 10% for validation, and 80% for training set. This research benefits farmers looking to improve yield, consumers of groundnut products, and researchers studying seed defects. The work provides valid insights for future researchers regarding dataset creation, augmentation, methods, and feature selection for modeling. However, the model experienced misclassifications due to the similar appearance of sample images in different classes. Future researchers should address these challenges and consider factors such as oil content and defect grading.

BACKGROUND: Scoliosis is a widespread musculoskeletal disorder of bending and twisting of spine. In this medical ailment, spine curves to the side and even in severe cases it can twist and can take several bends. For the diagnosis and treatment of scoliotic patients, the Cobb’s angle is a critical marker of the body’s curvature. OBJECTIVE: There are many researches that have been conducted to automate the manual measurement of the angle and every investigation has their own limita- tions. METHODS: This paper presents a method for precisely measuring the Cobb’s an- gle using deep learning based techniques. Mainly it comprises of feature enhance- ment of augmented dataset, a bespoke code for landmark estimation on the spine, segmentation model based on the U-Net architecture and a custom code for Cobb’s angle measurement. These measured angles are then compared to the given angles for the segmentation on biomedical (X-ray) images. RESULTS: The findings demonstrate that the proposed technique offers an auto- mated and impartial way for precisely measuring this angle with an overall accu- racy of 97% and Root Mean Square Error (RMSE) of 4.99, which can lower the variability, facilitate early detection, accurate diagnosis, and monitoring of scolio- sis progression. Additionally, it aids in the treatment planning and evaluating treat- ment outcomes. CONTRIBUTION: By leveraging the applications of Cobb’s angle measurement, healthcare professionals can enhance the quality of care and can improve long-term outcomes for individuals with scoliosis.

The dielectric constant (ε) reflects the ability of a material to align and orient electrical dipoles within its structure in response to an externally applied electric field; the greater the polarizability of molecules, the greater the value of dielectric constant. In this study a data set of 86 polymers was investigated to develop a structure-property quantitative relations (QSPR) model to predict the dielectric constant in polymers. An initial set of 1273 descriptors was used to select a best set of descriptors and to construct two machine learning models with Gradient Boosting Regressor (GB_A and GB_B). The best performing model (GB_A) with 8 descriptors, exhibited a performance of (R2train) = 0.938 and (R2test) = 0.802. The models were internally validated by 5 folds cross-validation, demonstrating robustness. Additionally, using the Accumulative Local Effect (ALE) technique, we analyzed the relationship between the 8 descriptors involved and the impact of these descriptors to dielectric constant of polymers.

Cybersecurity ecosystem is an important facet in protecting sensitive information and securing critical infrastructure for countering modern cyber threats. With the increasing complexity and frequency of security incidents, there is an escalating demand for development of innovative solutions beyond current human capabilities pertaining to cybersecurity measures. Artificial Intelligence or AI can be utilized in a myriad of areas of cybersecurity. It emerged as a technological innovation to enhance cyber protection by facilitating faster and real-time threat detection for known and unknown threats, automating processes to minimize human error, and optimal decision-making. Harnessing the power of AI in cybersecurity creates formidable defense capabilities against the constantly changing cyber threats of future while empowering the cybersecurity personnel with threat intelligence and proactive foresight to safeguard critical assets and confidential information with unparalleled precision and effectiveness. This research paper aims to investigate the potential of AI-enabled cybersecurity systems and focuses on deducing the benefits of using AI in enhancing cybersecurity processes for organizations seeking to manage their risk profile. Through a comprehensive literature review, the wide-ranging applications of AI in cybersecurity have been analyzed such as intrusion detection, predictive simulation, and automated emergency response management. The study examines the benefits of implementing AI-based cyber defenses such as improved promptness and accuracy in vulnerability assessment and threat management, reduced false positives, and recognize patterns. The future potential of AI in cybersecurity will take a leap forward in expanding protection mechanisms to evaluate the strengths and weaknesses of attack vectors to prevent an adversarial attack.

Pakistan is an agricultural country, and an exporter of crops in many countries. The crop production is an important factor to earn revenue for the country. But the agriculture of Pakistan is still not revolutionized and no modern system has been deployed commonly. Whereas the farmers face difficulty in growing some crops because those crops needs more care and calculated steps. Moreover the farmers face difficulty at different stages of the crop growth like to check fertility of soil and if the soil is non-fertile then which chemical property is lacking. The objective of this research is to provide digitize the agriculture of Pakistan. An emerging technology IoT and Deep learning based system will be developed. The IoT part contains some devices like sensors,gateways and communication technologies whereas the software part consists of Deep learning models that can make predictions about the fertility of the soil. The motive of this system is to provide best results in term of accuracy. Whereas the dataset used is publicly available on kaggle but it was of non-fertile values, so data augmentation is also performed to generate data for fertile values. We have implemented LSTM,RNN,CNN among them LSTM performed best for the prediction of soil fertility.

Background: Alzheimer's disease (AD) is a leading cause of dementia, significantly influenced by the Apolipoprotein E4 (APOE4) gene and gender. This study aims to use machine learning (ML) algorithms to predict brain age and assess AD risk by considering the effects of APOE4 genotype and gender. Methods: We collected brain volumetric MRI data and medical records from 1100 cognitively unimpaired individuals and 602 AD patients. We applied three ML regression models—XGBoost, Random Forest (RF), and Linear Regression (LR)—to predict brain age. Additionally, we introduced two novel metrics, Brain Age Difference (BAD) and Integrated Difference (ID), to evaluate model performance and analyze the influence of APOE4 genotype and gender on brain aging. Results: AD patients displayed significantly older brain ages compared to their chronological ages, with BADs ranging from 6.5 to 10 years. The RF model outperformed both XGBoost and LR in terms of accuracy, delivering higher ID values and more precise predictions. Comparing APOE4 carriers with non-carriers, the models showed enhanced ID values and consistent brain age predictions, improving overall performance. Gender-specific analyses indicated slight enhancements, with models performing equally well on both genders. It indicates that APOE4 may be a more robust predictor of brain age than gender. Conclusion: Robust ML models for brain age prediction can be pivotal in the early detection of AD risk via MRI brain structural imaging, especially for APOE4 carriers. Such early identification may facilitate timely preventive interventions for AD.

Recurrent Neural Networks (RNNs) have significantly advanced the field of machine learning by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures such as Long Short-Term Memory (LSTM) networks, Gated Recurrent Units (GRUs), Bidirectional LSTM (BiLSTM), and stacked LSTM. The study examines the application of RNNs in different domains, including natural language processing (NLP), speech recognition, financial time series forecasting, bioinformatics, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide machine learning researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research.

The combination of medical imaging and deep learning has significantly improved diagnostic and prognostic capabilities in the healthcare domain. Nevertheless, the inherent complexity of deep learning models poses challenges in understanding their decision-making processes. Interpretability and visualization techniques have emerged as crucial tools to unravel the black-box nature of these models, providing insights into their inner workings and enhancing trust in their predictions. This survey paper comprehensively examines various interpretation and visualization techniques applied to deep learning models in medical imaging. The paper reviews methodologies, discusses their applications, and evaluates their effectiveness in enhancing the interpretability, reliability, and clinical relevance of deep learning models in medical image analysis.

The analysis of social media content plays a crucial role in uncovering intricate user behaviors and trends across diverse digital platforms. Social media is inherently multimodal, incorporating texts, images, audios, and videos, each offering unique insights into user engagement and preferences. Traditional classification methods often focus narrowly on the most prominent modality, typically neglecting the synergistic potential of integrating multiple data types. To address this gap, we introduce the Unified Multimodal Classifier (UMC), a suite of streamlined models that adeptly harness and integrate these varied modalities. UMC leverages a novel architecture that combines a pooling layer with auxiliary learning tasks, facilitating the formation of a robust and shared feature space. This integration allows UMC to not only accommodate but also capitalize on the inherent diversity of social media data. The models are designed to be inherently flexible, adjusting to the availability of data modalities and maintaining high classification accuracy under varied conditions. In emotion classification scenarios, UMC has shown exceptional performance, significantly outperforming traditional methods by effectively synthesizing information across modalities. Its robustness is highlighted in its ability to deliver consistent results, even in the absence of one or more modalities. The simplicity and efficiency of UMC make it a potent tool for social media analytics, enabling it to achieve higher accuracies and maintain effectiveness even with limited data inputs. This adaptive capability ensures that UMC can be deployed in real-world applications where data incompleteness is common, thus broadening the scope of its applicability in various analytical contexts.

In dementia, particularly Alzheimer's Disease (AD), communication challenges are evident, especially in vocabulary and pragmatic aspects. Affected individuals often use vague, non-specific words, and their speech lacks informative nouns and verbs, leading to imprecise communication. However, aspects like sentence structure, phonology, and articulation are believed to remain intact until later stages, though this view is debated in the research community. The rise of Large Language Models (LLMs) has made significant strides in various domains, including sentiment analysis and question-answering. These advancements have been applied to dementia research, with studies using LLMs to analyze textual data. Some research incorporates pauses in text to enhance performance, while others utilize transfer learning techniques. However, limited datasets for dementia detection pose challenges in training LLMs. Our research presents a novel approach to measuring the impact of in-text encoding strategies by embedding special characters within the text to enhance model performance and incorporating sequences and summaries of their frequency. Our best model achieves 0.88 and 0.86 in f1-score and accuracy, respectively, whereas the baseline has 0.42 and 0.56 in f1-score and accuracy.

Sentiment analysis is a technique used to understand the publics’ opinion towards an event, product, or organization. For example, positive or negative opinion or attitude towards electric vehicle (EV) brands. This provides companies with valuable insight about the public's opinion of their products and brands. In the field of natural language processing (NLP), transformer models have shown great performances over the traditional machine learning algorithms. However, these models have not been explored extensively in the EV domain. EV companies are becoming signif-icant competitors in the automotive industry and are projected to cover up to 30% of the United States light vehicle market by 2030 [1]. In this study, we present a comparative study of large language models (LLMs) including bidirectional encoder representations from transformers (BERT), robustly optimized BERT approach and generalized autoregressive pretraining for language un-derstanding using Lucid motors and Tesla motors YouTube datasets. Results evidenced LLMs like BERT and her variants are off-the-shelf algorithms for sentiment analysis, specifically, when fi-ne-tuned. Furthermore, our findings presents the need for domain adaptation whilst utilizing LLMs. Finally, the experimental results showed that RoBERTa achieved consistent performance across the EV datasets with a F1 score of at least 92%.

Membrane fouling caused by many direct and indirect triggering factors has become an obstacle to the application of membrane bioreactor (MBR). The nonlinear relationship between those factors is subject to complex causality or affiliation, which is difficult to clarify for the diagnosis of membrane fouling. To solve this problem, this paper proposes a compressible diagnosis model (CDM) based on transfer entropy to facilitate the fault diagnosis of the root cause for membrane fouling. Firstly, a framework of CDM between membrane fouling and causal variables is built based on a feature extraction algorithm and mechanism analysis. The framework can identify fault transfer scenarios following the changes in operating conditions. Secondly, the fault transfer topology of CDM based on transfer entropy is constructed to describe the causal relationship between variables dynamically. Thirdly, an information compressible strategy is designed to simplify the fault transfer topology. This strategy can eliminate the repetitious affiliation relationship, which contributes to the root causal variables speedily and accurately. Finally, the effectiveness of the proposed CDM is verified by the measured data from an actual MBR.

Standard ANNs lack flexibility when handling corrupted input due to their fixed structure. Spiking Neural Networks (SNNs) can utilize biological temporal coding features, such as noise-induced stochastic resonance and dynamical synapses to increase a model’s performance when its parameters are not optimized for a given input. Using the analog XOR task as a simplified Convolutional Neural Network analog, this paper demonstrates two key results: (1) SNNs solve the problem linearly inseparable in ANN with over 10% improvement in the optimal setting, and (2) in SNNs, the synaptic noise and dynamical synapses compensate for non-optimal parameters, achieving near-optimal results.

In this work, we introduce the TriFusion Network, an innovative deep learning framework designed for the simultaneous analysis of auditory, visual, and textual data to accurately assess emotional states. The architecture of the TriFusion Network is uniquely structured, featuring both independent processing pathways for each modality and integrated layers that harness the combined strengths of these modalities to enhance emotion recognition capabilities. Our approach addresses the complexities inherent in multimodal data integration, with a focus on optimizing the interplay between modality-specific features and their joint representation. Extensive experimental evaluations on the challenging AVEC Sentiment Analysis in the Wild dataset highlight the TriFusion Network's robust performance. It significantly outperforms traditional models that rely on simple feature-level concatenation or complex score-level fusion techniques. Notably, the TriFusion Network achieves Concordance Correlation Coefficients (CCC) of 0.606, 0.534, and 0.170 for the arousal, valence, and liking dimensions respectively, demonstrating substantial improvements over existing methods. These results not only confirm the effectiveness of the TriFusion Network in capturing and interpreting complex emotional cues but also underscore its potential as a versatile tool in real-world applications where accurate emotion recognition is critical.

Explainable Artificial Intelligence (XAI) plays a vital role in increasing transparency and trust in machine learning models, particularly when applied to tabular data which is used in domains such as finance, healthcare, and marketing. This paper presents an extensive survey of XAI techniques used with tabular data and aims to analyze recent research developments since 2021. The survey classes and describes several XAI techniques pertinent to tabular data, it identifies challenges specific to this domain, and explores potential applications and emerging trends. Future research directions are outlined, concentrating on the need for clear definitions of terminology used, data security, user-centric explanations, enhanced interaction, robust evaluation metrics, and advancements in adversarial example-based analysis. The aim is to contribute to the evolving field of XAI, and provide insights for effective, trustworthy, and transparent decision-making using tabular data.

In aerospace, robotics, network engineering and mechanical engineering, there exist complex and urgent challenges that can be abstracted into mathematical optimization problems. Therefore, exploring solutions to these optimization problems is a crucial task. Metaheuristic algorithms have been applied across various fields.The Snake Optimization Algorithm (SO) is an innovative metaheuristic method recognized for its efficient solving capabilities.However, this algorithm encounters challenges such as diminished search efficiency in the later stages and a propensity to become ensnared in local optima. To mitigate these issues, this paper introduces an enhanced Snake Optimization Algorithm (ISO). ISO integrates the RIME Algorithm(RIME)and introduces two effective enhancement strategies to improve its capability to evade local optima.To assess the effectiveness of ISO,the population distribution state was first measured using three algorithms, including Star Discrepancy, and the exploration and exploitation performance was analyzed using the CEC2017 test functions. Subsequently, utilized 23 benchmark functions for testing.The evaluation outcomes indicate that ISO exhibits outstanding performance in terms of convergence velocity and robustness.Additionally, it was applied to engineering fields including UAV path planning,Robot path planning, Wireless sensor network node deployment and Pressure vessel design.In comparison to the SO algorithm, the ISO algorithm demonstrates superior stability, converges earlier, and improves its ability to solve for optimal .These findings highlight the significant potential of the ISO algorithm in diverse test functions and a wide range of interdisciplinary problems.

This study contributes to the Sybil nodes detecting algorithm in Online Social Networks (OSNs). As major communication platforms, online social networks get significantly guarded from malicious activity. A thorough literature review identified various detection and prevention Sybil attack algorithms. Additional exploration of distinct reputation systems and their practical application led to the study’s discovery of machine learning algorithms, i.e., the KNN, Support Vector Machines, and Random Forest algorithms. The study details the data cleansing process for the employed dataset in its process for optimizing the computational demands required to train machine learning algorithms, achieved through dataset partitioning. Such a process led to explaining and analysis of conducting experiments and comparing their results. Such experiments demonstrate the algorithm’s ability to detect Sybil nodes in OSNs (100% accuracy in SVM, 99.6% in Random Forest, and 97% in KNN algorithms); thus concluding by proposing future research opportunities.

Large language models (LLMs) have shown impressive performance and versatility. However, their billions of parameters and high computational costs hinder the development of personalized and privacy-preserving AI assistants operating locally on user devices. In this work, we explored the potential of pruning LLMs to create lightweight models suitable for user devices, using the moderate-sized Llama-2 7B model as an example. By adopting a simple yet effective pruning method, we found that up to 60% of the weights in the Llama-2 7B model could be pruned without significantly impairing its language modeling capabilities. Furthermore, despite occasional factual inaccuracies, the pruned model at the sparsity limit generated fluent and helpful answers to daily queries, demonstrating its feasibility of on-device AI assistants. These inaccuracies might originate from forgetting or hallucination due to pruning. We proposed a simple protocol to distinguish between the two mechanisms, as well as future directions to improve the pruned models for local AI assistants.

Road conditions, often degraded by insufficient maintenance or adverse weather, significantly contribute to accidents, exacerbated by the limited human reaction time to sudden hazards like potholes. Early detection of distant potholes is crucial for timely corrective actions, such as reducing speed or avoiding obstacles, to mitigate vehicle damage and accidents. This paper introduces a novel approach that utilizes perspective transformation to enhance pothole detection at different distances, focusing particularly on distant potholes. Perspective transformation improves the visibility and clarity of potholes by virtually bringing them closer and enlarging their features, which is particularly beneficial given the fixed-size input requirement of object detection networks, typically smaller than the raw image resolutions captured by cameras. Our method automatically identifies the region of interest (ROI)—the road area—and calculates the corner points to generate a perspective transformation matrix. This matrix is applied to all images and corresponding bounding box labels, enhancing the representation of potholes in the dataset. This approach significantly boosts detection performance when used with YOLOv5-small, achieving a 45.7\% improvement in average precision (AP) at IoU thresholds of 0.5 to 0.95 for a single class, and notable improvements of 30.3\%, 78.6\%, and 278\% for near, medium, and far pothole classes, respectively, after categorizing them based on their distance. This work is the first to employ perspective transformation specifically for enhancing the detection of distant potholes.

Accurate measurement of pedaling kinetics and kinematics is vital for optimizing rehabilitation, exercise training, and understanding musculoskeletal biomechanics. Pedal reaction force, the main external force in cycling, is essential for musculoskeletal modeling and closely correlates with lower limb muscle activity and joint reaction forces. However, sensor instrumentation like 3-axis pedal force sensors is costly and requires extensive post-processing. Recent advancements in machine learning (ML), particularly neural network (NN) models, provide promising solutions for kinetic analyses. In this study, an NN model was developed to predict radial and mediolateral forces, providing a low-cost solution to study pedaling biomechanics with stationary cycling ergometers. Fifteen healthy individuals performed a 2-minute pedaling task at two different self-selected (58±5 rpm) and higher (72±7 rpm) cadences. Pedal forces were recorded using a 3-axis force system. The dataset included pedal force, crank angle, cadence, power, and participants' weight and height. The NN model achieved an inter-subject normalized root mean square error (nRMSE) of 0.15±0.02 and 0.26±0.05 for radial and mediolateral forces at high cadence, respectively, and 0.20±0.04 and 0.22±0.04 at self-selected cadence. The NN model's low computational time suits real-time pedal force predictions, matching the accuracy of previous ML algorithms for estimating ground reaction forces in gait.

As the use of AI in medical imaging has increased, so has the need to explain a model’s results. Segmentation models are one technique used to produce explainable results. Due to larger size and sophistication, segmentation models which operate on 2D data can often produce better results than models operating on 3D data. In the real world, imaging is combined with clinical factors for diagnosis. To replicate this, multimodal models are used which combine image and text modalities. I propose a multimodal arrangement that converts 3D scans to 2D and uses a 2D segmentation model (DeepLabV3) to analyze the images. This is combined with clinical biomarkers to achieve a complete confidence score. Using the Medical Segmentation Decathlon Lung (MSDL) dataset and the LUng CAncer Screening dataset (LUCAS), I achieved a testing Dice coefficient of 0.91 on segmentation with a receiver operating characteristic (ROC), average precision (AP), and F-Score of 0.89, 0.91, and 0.85 respectively on the final multimodal results. This approach raises the F-score from the previously achieved value of 0.508 to 0.85, creating a new baseline of what is achievable with multimodal lung cancer diagnostics and possible methods to achieve these accuracies.

The objective of person re-identification (ReID) tasks is to match a specific individual across different times, locations, or camera viewpoints. The prevalent issue of occlusion in real-world scenarios affects image information, rendering the affected features unreliable. The difficulty and core challenge lie in how to effectively discern and extract visual features from human images under various complex conditions, including cluttered backgrounds, diverse postures, and the presence of occlusions. Some works have employed pose estimation or human keypoint detection to construct graph-structured information to counteract the effects of occlusions. However, this approach introduces new noise due to issues such as the invisibility of keypoints. Our proposed module, in contrast, does not require the use of additional feature extractors. Our module employs multi-scale graph attention for the reweighting of feature importance. This allows features to concentrate on areas genuinely pertinent to the re-identification task, thereby enhancing the model's robustness against occlusions. To address these problems, a model that employs multi-scale graph attention to re-weight the importance of features is proposed in this study, significantly enhancing the model’s robustness against occlusions. Our experimental results demonstrate that, compared to baseline models, the method proposed herein achieves a notable improvement in mAP on occluded data sets, with increases of 0.5%, 31.5%, and 12.3% in mAP scores.

Machine Learning (ML) has revolutionized healthcare by enhancing diagnostic capabilities because of its ability to analyze large datasets and detect minor patterns often overlooked by humans. This is beneficial, especially in pain recognition, where patient communication may be limited. However, ML models often face challenges such as memorization and sensitivity to adversarial examples. Regularization techniques like mixup, which trains models on convex combinations of data pairs, address these issues by enhancing model generalization. While mixup has proven effective in image, speech, and text datasets, its application to time-series signals like electrodermal activity (EDA) is less explored. This research uses ML for pain recognition with EDA signals from the BioVid Heat Pain Database to distinguish pain by applying mixup regularization to manually extracted EDA features and using a Support Vector Machine (SVM) for classification. Results showed that this approach achieved an average accuracy of 75.87% using leave-one-subject-out cross-validation (LOSOCV) compared to 74.61% without mixup. This demonstrates the mixup’s efficacy in improving ML model accuracy for pain recognition from EDA signals. This study highlights the potential of mixup in ML as a promising approach to enhance pain assessment in healthcare.

Diffusion Models (DMs) are probabilistic models that create realistic samples by simulating the diffusion process, gradually adding and removing noise from data. These models have gained popularity in domains such as image processing, speech synthesis, and natural language processing due to their ability to produce high-quality samples. As DMs are being adopted in various domains, existing literature reviews that often focus on specific areas like computer vision or medical imaging may not serve a broader audience across multiple fields. Therefore, this review presents a comprehensive overview of DMs, covering their theoretical foundations and algorithmic innovations. We highlight their applications in diverse areas such as media quality, authenticity, synthesis, image transformation, healthcare, and more. By consolidating current knowledge and identifying emerging trends, this review aims to facilitate a deeper understanding and broader adoption of DMs and provide guidelines for future researchers and practitioners across diverse disciplines.

Based on the detailed exploration of AI techniques for the early identification of learning difficulties in education, this study underscores the pivotal role of educational data analysis in enhancing student outcomes. Educators can proactively identify and address learning challenges through systematic data collection and analysis, thereby minimizing long-term academic obstacles and emotional stress. The integration of AI, particularly through natural language processing and computer vision technologies, facilitates personalized learning paths and real-time interventions, offering tailored support that maximizes each student's learning potential. These advancements optimize educational resource allocation and foster a more inclusive and effective learning environment, paving the way for future advancements in personalized education and intelligent teaching practices.

The rapidly evolving domain of multimodal sentiment analysis is crucial for unraveling the intricate layers of emotional expression in social media content, customer service interactions, and personal vlogs. This research introduces a cutting-edge Advanced Cross-Modal Gating (ACMG) framework that significantly enhances the precision of sentiment analysis by refining the interplay among textual, auditory, and visual modalities. Our approach addresses three foundational aspects of sentiment analysis: (1) Advanced learning of cross-modal interactions, which focuses on extracting and synthesizing sentiment from varied modal inputs, thus providing a holistic view of expressed emotions; (2) Mastery over the temporal dynamics of multimodal data, enabling the model to maintain context and sentiment continuity over extended interactions; and (3) Deployment of a novel fusion strategy that not only integrates unimodal and cross-modal cues but also dynamically adjusts the influence of each modality based on its contextual relevance to the sentiment being expressed. The exploration of these dimensions reveals that the nuanced modeling of cross-modal interactions is crucial for enhancing model responsiveness and accuracy. By applying the ACMG model to two highly regarded datasets—CMU Multimodal Opinion Level Sentiment Intensity (CMU-MOSI) and CMU Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI)—we achieve groundbreaking accuracies of 83.9\% and 81.1\%, respectively. These results represent significant improvements of 1.6\% and 1.34\% over the current state-of-the-art, showcasing the superior performance and potential of our approach in navigating the complexities of multimodal sentiment analysis.

Many systems in the manufacturing industry have spatial distribution characteristics, which correlate with both time and space. Such systems are known as distributed parameter systems (DPS). Due to the spatiotemporal coupling characteristics, the modeling of such systems is quite complex. The paper presents a new approach for three-dimensional fuzzy modeling using Simultaneous Perturbation Stochastic Approximation (SPSA) for nonlinear DPS. The Affinity Propagation clustering approach is utilized to dynamically determine the optimal number of fuzzy rules and construct a collection of preceding components for three-dimensional fuzzy models. Fourier space base functions are used in the resulting components of three-dimensional fuzzy models, and their parameters are learned by the SPSA algorithm. The proposed three-dimensional fuzzy modeling technique was utilized on a conventional DPS within the semiconductor manufacturing industry, with the simulation experiments confirming its efficacy.

Neural network regularized learning has garnered significant attention in recent years. We give a systematic investigation on the performance of regularized regression associated zonal translation networks. We propose the concept of Marcinkiewicz-Zygmund inequality Setting (MZIS) for the scattered nodes collected from the unit sphere. We show that, under the MZIS, the corresponding convolutional zonal translation network has reproducing property. Based on these facts,we propose a kind of kernel regularized regression learning framework and provide upper bound estimate for the learning rate with the kernel approach. We also give proof for the density of the zonal translation network with spherical Fourier analysis.We provide the approximation error with a K-functional.

Recent studies have shown correlations between the microbiota's composition and various health conditions. Machine learning (ML) techniques are essential for analyzing complex biological data, particularly in microbiome research. ML methods help analyze large datasets to uncover microbiota patterns and understand how these patterns affect human health. This study introduces a novel approach combining statistical physics with the Monte Carlo (MC) methods to characterize bacterial species in the human microbiota. We assess the significance of bacterial species in different age groups by using notions of statistical distances to evaluate species prevalence and abundance across age groups and employing MC simulations based on statistical mechanics principles. Our findings show that the microbiota composition experiences a significant transition from early childhood to adulthood. Species such as Bifidobacterium breve and Veillonella parvula decrease with age, while others like Agathobaculum butyriciproducens and Eubacterium rectale increase. Additionally, low-prevalence species may hold significant importance in characterizing age groups. Finally, we propose an overall species ranking by integrating the methods proposed here in a multicriteria classification strategy. Our research provides a comprehensive tool for microbiota analysis using statistical notions, ML techniques, and MC simulations.

In manufacturing chatter is an unwanted phenomenon that can lead to product quality reduction and tool wear. Real time chatter detection is key to preventing these issues and improving overall machining efficiency. In this paper we propose an unsupervised chatter detection method using autoencoders (AE) and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) clustering algorithm that uses internal signals of Computer Numerical Control (CNC) machines. The proposed method starts by using an AE to extract features from raw internal signals collected from CNC machines. This step reduces the dimensionality of the data and captures the underlying patterns of chatter. Then the extracted features are fed into DBSCAN clustering algorithm which is a density based algorithm that groups similar data points and identifies outliers. We tested the proposed method with real world data collected from various CNC machines. The results show that our unsupervised chatter detection method has high accuracy, precision and recall, can detect chatter and distinguish it from normal machining. Also the method is robust to noise and can adapt to dynamic machining conditions. In summary our work presents an unsupervised chatter detection method using AE and DBSCAN clustering that uses internal signals of CNC machines. This method is a reliable and efficient solution for real time chatter detection so manufacturers can improve product quality, optimize machining process and reduce tool wear during machining.

Objective: Interstitial fibrosis / tubular atrophy (IFTA) is a common, irreversible, and progressive form of chronic kidney allograft injury, and it is considered a critical predictor of kidney allograft outcomes. The extent of IFTA is estimated through a graft biopsy, while a non-invasive test is lacking. The aim of this study was to evaluate the feasibility and accuracy of an MRI radiomic-based machine learning (ML) algorithm in estimating the degree of IFTA in a cohort of transplanted patients. Approach: Patients who underwent MRI and renal biopsy within a 6-month interval from 1/1/2012 to 1/3/2021 were included. Stable MRI sequences were selected, and renal parenchyma, renal cortex and medulla were segmented. After image filtering and pre-processing, we computed radiomic features which were subsequently selected through a LASSO algorithm for their highest correlation with the outcome and lowest intercorrelation. Selected features and relevant patients’ clinical data were used to produce ML-algorithms using 70% of the study cases for feature selection, model training and validation with a 10-fold cross-validation, and 30% for model testing. Performances were evaluated using AUC with 95% confidence interval. Main results: 70 coupled tests (63 patients, 35.4% females, mean age 52.2 years) have been included and subdivided into a wider cohort of 50 for training and a smaller cohort of 20 for testing. For IFTA ≥ 25%, AUCs in test cohort were 0.60, 0.59, and 0.54 for radiomic features only, clinical variables only, and combined radiomic-clinical model, respectively. For IFTA ≥ 50%, AUCs in training cohort were 0.89, 0.84, 0.96, and in test cohort were 0.82, 0.83, and 0.86, for radiomic features only, clinical variables only, and combined radiomic-clinical model, respectively. Significance: An ML-based MRI radiomic algorithm showed promising discrimination capacity for IFTA>50%, especially when combined with clinical variables. These results need to be confirmed in larger cohorts.