Nystagmus induced by applying an intense vibratory stimulus to the skull (SVIN) indicates vestibular functional asymmetry. In unilateral vestibular loss, a 100-Hz bone-conducted vibration given to either mastoid immediately causes a primarily horizontal nystagmus. Test is performed in darkness to avoid visual fixation (VF) but there is no data about how much VF affects the often-intense SVIN. The aim is to analyze the amount of reduction of SVIN when VF is allowed during testing. Thus, all patients seen in a tertiary hospital for vertigo or dizziness with positive SVIN were included. SVIN was recorded for 10 seconds for each condition: without VF (aSVINwo) and VF (aSVINw). We obtained an aSVINwo and aSVINw as average slow-phase velocities (SPV) without and with VF. VF index (FISVIN) was calculated as the ratio of SPV. Among the 124 patients included, spontaneous nystagmus (SN) was found in 25% and the mSPV (without VF) of SN was 2.62.4º/s. Mean FISVIN was 0.270.29. FISVIN was 0 in 42 patients and >0 FISVIN <1 in 82 (mean FISVIN 0.390.02). Fixation suppression was found in all patients with SVIN in cases of peripheral vestibulopathy. FISVIN clearly delineates two populations of patients: with or without complete visual reduction of nystagmus.

This research presents the Cross-Cultural Intelligent Language Learning System (CILS), a novel approach integrating Artificial Intelligence (AI) into language education to enhance cross-cultural communication. CILS utilizes advanced AI technologies to provide adaptive, personalized learning experiences that cater to the unique linguistic and cultural backgrounds of each learner. By dynamically adjusting content and methodology, CILS significantly improves linguistic proficiency and cultural understanding, essential for effective global interactions. The implementation of CILS in platforms such as Busuu and HelloTalk has demonstrated marked improvements in engagement and communication skills among learners. Empirical studies validate the system's effectiveness in real-world settings, showing enhanced learner performance and increased intercultural competence. Additionally, the Technology Acceptance Model (TAM) applied confirms that the usability and perceived usefulness of AI-driven systems strongly influence learner acceptance and sustained use. This study not only underscores the potential of AI in transforming language education but also highlights the critical role of cultural sensitivity in designing educational technologies.

The Ayers Rock of Australia which is known for its charming colors at different time is actually the Celestial Body Ring of the planet Earth that implies the great Celestial Body Love happened on Earth long long ago. The Tasmania island of Australia which is known for the World Heart is actually in the state of face to face with the main island of Australia, which implies the image spokesperson for the inner core (the heart) of the planet Earth. In other words, with the outline of the main island of Australia, the basic key information of the inner core of the planet Earth could be easily obtained by deducing logically, just like the similarity between the fists and heart of human body. Similar to the mechanism of the blood circulation dominated by the heart of human body, it is dominated and motivated by the inner core of the Earth which forms the circulation of mantle magma between the crust and the inner core, and what leads to the formation of expanding and active area on the equatorial and middle-lower latitude area and the silent and convergent area on the North and South Pole central area. Therefore, the mantle magma whirlpools under the crust on the North and South Pole are supposed to exist logically. The walking sideways of the crabs just implies the celestial body language of the motive trend of the main island of Australia based on their similar outline.

In the early decades of the 19th century, the deaf population in the eastern US and Canada was distributed across a vast area. After the 1817 founding of the American School for the Deaf (ASD) in Hartford, CT and the subsequent establishment of schools for the deaf in New York City (NYSD), Philadelphia, and many other US states, hundreds of deaf students called these schools home for several years. After leaving school, the early American Deaf community faced a challenge: How would the community maintain its social and linguistic ties across a vast geographical area once community members had dispersed to their hometowns? In this paper we analyze the attendance registries of two large gatherings of deaf individuals in Hartford in the years 1850 and 1854. These were among the largest and earliest known gatherings of deaf adults. The demographic data included in these registries open a window onto the evolving American Deaf community of the mid-19th century. Our analyses of the attendees’ school affiliations, ages, and marital status show that the signing community that had taken root among students at schools in Hartford and New York persisted among the adult graduates of those schools in towns across the northeastern US. We compare the places of residence of ASD and NYSD alumni in 1850 and 1854 to their hometowns when they first enrolled at school. Our comparisons suggest the mid-19th-century signing community had become more urban; it was centered to a greater extent in populous cities such as New York, Boston, and Hartford than had been true when the attendees had enrolled in school. We consider how the geography of deafness in the 19th century might inform our understanding of the sources of regional variation in ASL. We also consider how early cross-regional interactions may have inhibited such regional variation.

Despite the growing capabilities of large language models, concerns exist about the biases they develop. In this paper, we propose a novel, automated mechanism for debiasing through specified dataset augmentation in the lens of bias producers that can be useful in a variety of industries, especially ones that are “restricted” and have limited data. We consider that bias can occur due to intrinsic model architecture and dataset quality. The two aspects are evaluated using two different metrics we created. We show that our dataset augmentation algorithm reduces bias as measured by our metrics.

Structured science summaries or research contributions using properties or dimensions beyond traditional keywords enhances science findability. Current methods, such as those used by the Open Research Knowledge Graph (ORKG), involve manually curating properties to describe research papers' contributions in a structured manner, but this is labor-intensive and inconsistent between the domain expert human curators. We propose using Large Language Models (LLMs) to automatically suggest these properties. However, it's essential to assess the readiness of LLMs like GPT-3.5, Llama 2, and Mistral for this task before application. Our study performs a comprehensive comparative analysis between ORKG's manually curated properties and those generated by the aforementioned state-of-the-art LLMs. We evaluate LLM performance through four unique perspectives: semantic alignment and deviation with ORKG properties, fine-grained properties mapping accuracy, SciNCL embeddings-based cosine similarity, and expert surveys comparing manual annotations with LLM outputs. These evaluations occur within a multidisciplinary science setting. Overall, LLMs show potential as recommendation systems for structuring science, but further finetuning is recommended to improve their alignment with scientific tasks and mimicry of human expertise.

How many different writers authored the huge number of texts attributed to Galen of Pergamum (129~216 AD), medical doctor and philosopher, a giant in the history of medicine? To find out which texts were his and which ones were written by others is known as the “Galenic Question”. We propose a “solution” to it through a multidisciplinary approach based: (a) on historical research and (b) on a mathematical analysis of the Greek texts. The historical approach has considered historical independent sources and anachronisms. The mathematical approach has been based on a mathematical theory concerning deep–language variables, rarely consciously controlled by any author, therefore capable of giving indications on similarity of texts, with little or no bias. The multidisciplinary approach has convinced us that at least three authors wrote the texts attributed to Galen. The first two very likely were real historical persons: (a) a certain Galen living between the end of the I century BC and the second half of the I century AD; (b) the historical Galen of Pergamum (II–III centuries AD) and (c) several unknown authors hiding under the name Galen, but surely living after Galen of Pergamum’s death.

In the field of visualization, understanding users’ analytical process is important to determine the effectiveness of a designed visualization application. To understand the users’ analytical process, numerous studies have been performed to capture and analyze user interactions. Although many studies have emphasized the importance of analyzing user interactions to understand users’ analytical reasoning processes, few have successfully linked these interactions to users’ reasoning processes. This paper introduces an approach that bridges this gap by correlating semantic user interactions with analysis decisions through an interactive wire transaction analysis system and a visual state transition matrix. With the designed analysis system, interactive analysis can be performed to evaluate financial fraud in wire transactions. It also allows the mapping of captured user interactions and analytical decisions back onto the visualization, revealing users’ distinct results. The visual state transition matrix further aids to help understanding users’ analytical flows, revealing their decision-making processes. Classification machine learning algorithms are applied to assess the effectiveness of our approach in understanding analysts’ strategies by connecting them to their decisions. From the study, we observed an average of 72% accuracy in clearly classifying the semantic user interactions. For classifying individual decisions, we observed an average of 70% classification accuracy. This emphasizes the importance of capturing semantic user interactions to understand users’ analytical processes. Overall, it is determined that the proposed approach not only enhances the understanding of analytical behaviors but also offers a robust approach for evaluating user interactions in visualization tools.

This paper proposes a novel concept within Quantum Natural Language Processing (QNLP) to encode the interpersonal metafunction of Systemic Functional Linguistics (SFL), particularly tenor, into quantum circuits by treating Japanese honorifics seriously. Because of English language bias in the literature, the incorporation of nuanced aspects of interpersonal communication evident in languages, such as the aforesaid Japanese, remains under-developed and overlooked. Utilizing lambeq, monoidal categories, and string diagrams, this study extends lambeq’s quantum computing framework to capture not only grammar but also social context—specifically the roles and relationships that define interpersonal interactions in quantum circuits. This approach represents a significant step toward that end simply by defining the honorific type h in lambeq. This innovative strategy exposes the capability of quantum circuits to model the complex structures of language, moving beyond grammar and even semantics—the horizontal, textual dimension of language—to embrace the vertical, hierarchical dimension of human communication and social interaction. Through this lens, the paper underscores the potential of QNLP to transcend traditional linguistic analysis, advocating for a broader and more nuanced understanding of language that includes not only what is said but also the social persona of the interlocutors. An algorithm for parsing Japanese grammar into pregroup diagrams containing the h type is introduced along with a codebase for other researchers to use and to which to contribute. Lastly, a toy experiment is performed to demonstrate that the circuits generated from these pregroup diagrams are suitable for Quantum Machine Learning (QML) applications.

In this paper, we present a method for estimating GPS signals from visual information captured by a monocular camera mounted on a fixed-wing Unmanned Aerial Vehicle. The main challenge in visual odometry from aerial images is the computation of scale due to irregularities in the elevation of the terrain. That is, it is not possible to accurately convert from pixels in the image to meters in space, and the error accumulates. The contribution of this work is to reduce the accumulated error by comparing the images from the camera with satellite images. The algorithm has been tested in real-time experiments, and the results show that it is possible to eliminate the accumulated error using satellite images.

This work addresses the challenge of EEG visual multiclass classification into 40 classes for Brain-Computer interface applications, by using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage, since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, performing multiclassifiers based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and Minimum-Norm Estimate algorithms are implemented to select discriminant channels and enhance EEG data. Hence, deep EEGNet and Convolutional-recurrent neural networks are implemented separately to classify EEG data of image visualization into 40 labels. By using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures, respectively. Satisfactory results obtained with this method offer a new implementation opportunity for multi-task BCI applications by utilizing a reduced number of channels (<50%), compared to those presented in the related literature where the whole set of channels is used.

As digital communication becomes increasingly integral to personal and corporate activities, phishing attacks have emerged as a prevalent threat, ingeniously mimicking legitimate sources to illicitly acquire sensitive information. This research paper details the development of a sophisticated phishing detection application utilizing the DistilBERT-based model, finetuned on a diverse array of email datasets. The application significantly enhances the precision of phishing detection mechanisms, adeptly reducing the incidence of successful phishing attacks. Initial tests have demonstrated a precision rate of over 95% in detecting phishing emails, outperforming traditional rule-based filters substantially. The application exhibits robust defences against zero-day phishing attacks through its advanced machine learning framework, which dynamically adapts to emerging phishing strategies. This paper explores the methodology of developing the DistilBERT model, evaluates its efficacy against existing solutions, and discusses its implications for future cybersecurity practices. The study’s findings underscore the potential of AI-driven tools in transforming cybersecurity measures, offering a proactive approach to thwarting phishing attempts and safeguarding sensitive data.

Background/Objectives: We defined the value of a machine learning algorithm to distinguish between the EEG response to no light or any light stimulation, and between red or green light stimulation in awake volunteers with closed eyelids. This new method of EEG analysis is visionary in the understanding of visual signal processing and will facilitate anaesthetic depth research. Methods: X-gradient boosting models were used to classify the cortical response to VEP stimulation (no light vs. any light stimulation; red vs. green light stimulation). For each of the two classifications, three scenarios were tested: training and prediction in all participants (all), training and prediction in one participant (individual), training across all but one participant with prediction in the participant left out (one out). Results: Ninety-four Caucasian adults were included. The machine learning algorithm had a very high predictive value and accuracy in differentiating between no light and any light stimulation (AUCROCall: 0.96; accuracyall: 0.94; AUCROCindividual: 0.96±0.05, accuracyindividual: 0.94±0.05; AUCROConeout: 0.98±0.04; accuracyo-neout:0.96±0.04). The machine learning algorithm was highly predictive and accurate in distinguishing between green and red colour stimulation (AUCROCall: 0.97; accuracyall: 0.91; AUCROCin-dividual: 0.98±0.04, accuracyindividual: 0.96±0.04; AUCROConeout: 0.96±0.05; accuracyoneout: 0.93±0.06). The predictive value and accuracy of both classification tasks was comparable between males and females. Conclusions: Machine learning algorithms could almost continuously and reliably differentiate between the cortical EEG responses to no light or any light stimulation and between green or red colour stimulation using VEPs in awake female and male volunteers with eyes closed. Our findings may open new possibilities for using VEPs in the intraoperative setting.

ChatGPT, a Large Language Model (LLM) utilizing Natural Language Processing (NLP), has caused concerns about its impact on job sectors, including cybersecurity. In this study, we assessed ChatGPT’s impacts in non-managerial cybersecurity roles using the NICE Framework and Technological Displacement theory. We also explored its potential in passing top cybersecurity certification exams. Findings revealed ChatGPT’s promise in streamlining some jobs, especially those requiring memorization. Moreover, we highlighted ChatGPT’s challenges and limitations, such as ethical implications, LLM limitations, and Artificial Intelligence (AI) security. The study suggests that LLMs like ChatGPT could transform the cybersecurity landscape, causing job losses, skill obsolescence, labor market shifts, and mixed socioeconomic impacts. We recommend a shift in focus from memorization to critical thinking, and collaboration between LLM developers and cybersecurity professionals.

LLMs are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as LIME, SHAP, and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task.

Background: This study addresses the burgeoning impact of Large Language Models (LLMs) such as ChatGPT on the integrity of online examinations and seeks to demonstrate latent and advanced LLM reasoning capabilities. The research devises an iterative self-reflective strategy for invoking critical thinking and higher-order reasoning in LLMs based on multimodal exam questions using visuals and text. Methods: The proposed strategy was demonstrated and evaluated on real exam questions by subject experts and the performance of ChatGPT (GPT-4) with vision was estimated on an additional dataset of 600 text descriptions of multimodal exam questions, focusing on its response to complex, visual, and textual prompts. Results: The results indicate that latent multi-hop reasoning capabilities can be invoked using the proposed self-reflective strategy, which can effectively steer ChatGPT towards correct answers by integrating critical thinking from each modality into the final response. Meanwhile, ChatGPT demonstrated considerable proficiency in being able to answer multimodal exam questions across 12 subjects. Conclusions: This work challenges findings from recent studies which claim that existing LLMs are unable to reason on complex multimodal tasks, and therefore this study underscores the need for enhanced online exam security measures like proctoring software, that can mitigate the potential misuse of AI technologies in educational settings.

This study investigates the effects of ambient illumination and negatively polarized text color on visual fatigue, exploring the issue of visual fatigue when using visual display terminals in low-illumination environments. The research methodology utilized an experimental design to collect data on changes in pupil accommodation and blink rate through an eye tracker. Partici-pants completed a reading task while exposed to various text colors and ambient light conditions to evaluate visual fatigue and cognitive performance. The study's findings suggest that text color significantly affects visual fatigue, with red text causing the highest level of visual fatigue and yellow text causing the lowest level of visual fatigue. Improvements in ambient lighting reduce visual fatigue, but the degree of improvement varies depending on the text color. Additionally, cognitive performance is better when using yellow and white text but worse when using red text. Yellow text is the most effective choice for reducing visual fatigue under negative polarity. In-creasing ambient lighting can also improve visual fatigue in low-illumination conditions. These findings will offer valuable guidance for designing visual terminal device interfaces, especially for low-illumination or night environments, to minimize visual fatigue and improve the user ex-perience.

This research study focuses on addressing practical optimization challenges in audio-visual content using advanced computational intelligence methods, with a specific emphasis on privacy-preserving issues. The research will be presented as a proposal and can be conducted based on the provided ideas. Computational intelligence encompasses various approaches, including evolutionary algorithms, learning methods, fuzzy systems, and neural networks, which have become essential tools for tackling complex engineering optimization problems due to computational expenses, dimensional complexities, and interdisciplinary integration. The research objectives include a thorough investigation of optimization challenges in audio-visual content, the delineation of problem characteristics, and the development of relevant methodologies based on these specifications. The main goals of the study, titled "Advanced Computational Intelligence Assisted Less-Expensive Privacy-Preserving Optimization," encompass the development of a metamodel-based learning algorithm integrated with evolutionary computation for privacy-preserving optimization, less-expensive signal watermarking optimization using hybrid metamodeling and evolutionary algorithms, and a closed-loop robust intelligent PID control system applied in real-time dynamic signal watermarking. Additional objectives may be defined as the research progresses and further background review is conducted.

In the extensive monitoring of maritime traffic, maritime management frequently encounters incomplete automatic identification system (AIS) data, particularly in critical static fields like vessel types. This shortfall presents substantial challenges in safety management, necessitating robust methods for data completion. Distinct from road traffic, where road width imposes constraints, maritime vessels of identical classifications often choose significantly divergent routes, deviating by several nautical miles. Sole dependence on trajectory clustering is insufficient. Addressing this issue, we segments the maritime area into spatiotemporal grids, transforming vessel paths into sequences of grid encodings. Utilizing natural language processing techniques, we integrate the Word2vec word embedding approach with our novel biLSTM self-attention chunk-max pooling net (biSAMNet) model, enhancing the classification of vessel trajectories. This method is crucial for determining static details like vessel types. Employing the Taiwan Strait as a case study and benchmarking against CNN, RNN, and methods based on the attention mechanism, our findings underscore our model’s superiority. The biSAMNet achieves an impressive vessel classification F1 score of 0.94, using only 5-dimensional word embeddings, highlighting the effectiveness of Word2vec pre-trained embedding layers. This research introduces a novel paradigm for processing vessel trajectory data, greatly enhancing the accuracy of filling in incomplete vessel type details.

Visualising textual content could be helpful to professionals as well as amateurs across several fields. However, training a text-to-image generator in the mainstream domain requires large amounts of paired text-image and data, which is too expensive to collect since labeling millions of images and videos can be tiresome. GANs like StackGAN and StyleGAN can be considered as solutions to generate images from text. But the images generated may be of low accuracy and resolution, and the entire processing can be highly time-consuming. Moreover, image generation is a notion that is still being researched. Hence, the process of developing a Video Generation model necessitates substantial research. Despite the need for such a model, modern technology has lagged behind the solutions to this problem. This proposal suggests combining two methods, Text modification for Action Definition (TexAD) and SeQuential Image Generation for Video Synthesis (SQIGen). The proposed solution synthesises a sequence of images from textual information feeds and combines these images to create a video. TexAD uses Natural Language Processing and Deep Learning techniques to process, classify and modify text data. SQIGen is an extension of the VQGAN+CLIP neural network architecture that generates a sequence of images from the modified text data

Camouflage evaluation typically involves human visual search and detection experiments that are time-consuming and expensive. Hence, there is a need for models that compute camouflage effectiveness from digital imagery. Convolutional neural networks are a powerful tool for automatic object detection and recognition. We investigated whether such a network (YOLO) can also provide a measure of camouflage effectiveness that is related to human perception. To this end, human performance measures of camouflage effectiveness such as detection time and target conspicuity were obtained in observer experiments and compared with the performance of the (standard, i.e. pre-trained) YOLO-V4-tiny algorithm. YOLO provides the probability that a detected object is correctly classified, and this is adopted as our measure of camouflage effectiveness. We compared the YOLO-predicted classification probability for a person in camouflage clothing moving through rural and urban scenes to human detection performance. Overall, camouflage effectiveness predicted by YOLO correlates with human observer performance. At close distances, YOLO’s classification performance appears sensitive to high-contrast shape-breaking elements of a camouflage pattern. This suggests that YOLO may be adapted to assess camouflage effectiveness for a wide range of applications, such as evaluating or optimizing one’s signature and predicting optimal hiding locations in a given environment. Further research is required to fully establish YOLO’s limitations and applicability for this purpose.

This paper investigates women’s empowerment and their active involvement in governance aimed at promoting sustainable development. The study focuses on examining the roles and processes of co-creation of nature-based solutions (NBS) for water management in Milan. Three research directions were explored: 1) to determine gender-based roles within local governance; 2) to detect semantic groups of NBS based on stakeholders' gender; c) to analyze gender-based linguistic and conceptual patterns of NBS. To achieve our objectives, we converted a sample of audio-video interviews of local stakeholders into textual data along with metadata indicating speakers' roles and gender. Descriptive statistics were applied to explore the governance's roles. We employed a combination of textual analysis and network analysis to identify thematic groups of NBS, and applied a word embedding approach to uncover linguistic patterns indicative of semantic sub-structures. The findings revealed significant demographic diversity. Male stakeholders perceive sustainable development as a process driven by the circular economy and the coordination of territorial authorities, while female stakeholders envision a transformative approach rooted in science, culture, and collaboration. The semantic sub-structure analysis highlighted a tendency among male governance to emphasize specialized skills, whereas female governance placed greater emphasis on problem definition rather than resolution.

The rapid expansion of China's A-share market, coupled with the burgeoning volume of financial research reports, presents a unique challenge to traditional stock price prediction methodologies. This study introduces FAST-SCAN, a novel framework designed to leverage natural language processing (NLP) and time series analysis for the efficient and accurate prediction of stock market trends. By integrating advanced sentiment analysis, primarily through the utilization of the RoBERTa model, with dynamic time series forecasting, FAST-SCAN aims to distill actionable insights from the vast corpus of financial research reports. This approach not only enhances the speed and efficiency of financial analysis but also addresses the time-sensitive nature of market-influencing factors, thereby providing a competitive edge in stock price prediction. The framework demonstrates a notable improvement in predictive performance, achieving a 20% annualized return and a 7.19% RankIC, marking a significant advancement over conventional statistical analysis methods. Through its innovative combination of NLP and predictive analytics, FAST-SCAN paves the way for a more informed and strategic approach to investment in the A-share market, emphasizing the importance of timely, data-driven decision-making in the financial industry.

This study delves into Personal Narratives (PN), which encompass both oral and written recounting of individual experiences, encompassing facts, events, people, and thoughts. Traditional emotion recognition and sentiment analysis primarily focus on broader categories like utterances or documents. Our research, however, centers on identifying Emotion Carriers (EC), which are specific segments within speech or text that elucidate the narrator's emotional state (e.g.,"losing a parent", "decision-making moments"). Extracting these ECs enriches the representation of a user's emotional state, thereby enhancing natural language understanding and the sophistication of dialogue models. While previous studies have utilized lexical attributes to identify ECs, we argue that incorporating spoken narratives offers a more nuanced view of the context and emotional state. This paper explores the integration of speech and textual embeddings at the word level, alongside both early and late fusion techniques, for improved EC detection in spoken narratives. We employ Residual Neural Networks (ResNet), initially pre-trained on diverse speech emotion datasets and subsequently fine-tuned for EC detection. Our experimental findings demonstrate that late fusion, in particular, significantly enhances EC detection capabilities.

Generalized zero-shot learning (GZSL) aims to simultaneously recognize both seen classes and unseen classes by training only on seen class samples and auxiliary semantic descriptions. Recent state-of-the-art methods infer unseen classes based on semantic information or synthesize unseen classes using generative models based on semantic information, all of which rely on the correct alignment of visual-semantic features. However, they often overlook the inconsistency between original visual features and semantic attributes. Additionally, due to the existence of cross-modal dataset biases, the visual features extracted and synthesized by the model may also mismatch with some semantic features, which could hinder the model from properly aligning visual-semantic features. To address this issue, this paper proposes a GZSL framework that enhances the consistency of visual-semantic features using self-distillation and disentanglement network (SDDN). The aim is to utilize self-distillation and disentanglement network to obtain semantically consistent refined visual features and non-redundant semantic features to enhance the consistency of visual-semantic features. Firstly, SDDN utilizes self-distillation technology to refine the extracted and synthesized visual features of the model. Subsequently, the visual-semantic features are then disentangled and aligned using a disentanglement network to enhance the consistency of the visual-semantic features. Finally, the consistent visual-semantic features are fused to jointly train a GZSL classifier. Extensive experiments demonstrate that the proposed method achieves more competitive results on four challenging benchmark datasets (AWA2, CUB, FLO, and SUN).

The Ebola virus disease (EVD) is an extremely contagious and fatal illness caused by the Ebola virus. Recently, Uganda witnessed an outbreak of EVD, which generated a lot of attention on various social media platforms. To ensure effective communication and implementation of targeted health interventions, it is crucial for stakeholders to comprehend the sentiments expressed in the posts and discussions on these online platforms. In this study, we used deep learning techniques to analyze the sentiments expressed in Ebola-related tweets during the outbreak. We explored the application of three deep learning techniques to classify the sentiments in 8,395 tweets as positive, neutral, or negative. The techniques examined included a 6-layer convolutional neural network (CNN), a 6-layer long-short-term memory model (LSTM), and an 8-layer Bidirectional Encoder Representations from Transformers (BERT) model. The study found that the BERT model outperformed both the CNN and LSTM-based models across all the evaluation metrics, achieving a remarkable classification accuracy of 95\%. These findings confirm the reported effectiveness of transformer-based architectures in tasks related to natural language processing, such as sentiment analysis.

Unmanned Underwater Vehicles (UUVs) are pivotal in ocean exploration, research, and various industrial activities such as marine mining and offshore engineering. However, traditional methods of navigating these vehicles face significant challenges, mainly due to the inefficacy of electromagnetic waves in water, leading to signal loss. To address these limitations, researchers are increasingly turned learning, an artificial intelligence technique capable of learning from data-enhancing underwater navigation, mainly through visual Simultaneous Localization and Mapping (SLAM). This paper explores integrating deep learning methodologies and sensor technologies to revolutionize underwater navigation for UUVs. Proprioceptive sensors, along with exteroceptive sensors, are crucial in accurately measuring and comprehending the underwater environment. Additionally, the paper provides detailed insights into the processes of underwater SLAM, camera-based underwater positioning systems, sonar systems for underwater navigation, and the utilization of Lidar in underwater navigation. Furthermore, it delves into applying deep learning techniques in underwater SLAM, offering a comprehensive understanding of the innovative processes driving advancements in underwater vehicle navigation. By leveraging these advancements, this research aims to improve underwater navigation systems' precision, reliability, and adaptability, thereby unlocking new frontiers in ocean exploration and industrial applications for UUVs.

In the dynamic landscape of E-commerce, the proliferation of user-generated queries regarding products highlights the critical need for advanced automatic question answering (AQA) systems. These systems are instrumental in harnessing the vast array of information available online to deliver immediate and informative responses to potential buyers. Recognizing the complexity of such queries, which often require synthesis of reviews, product specifications, and responses to similar questions, we introduce a sophisticated model, the Comprehensive E-commerce Answer Generation System (CEAGS). This model adeptly navigates the challenges posed by irrelevant data and sentiment ambiguity in user-generated content. Our approach leverages a dual-phase process of relevance determination and sentiment clarity, setting the stage for a transformative response generation mechanism. Empirical analyses reveal the superiority of CEAGS, with our relevance assessment framework outstripping existing models by a notable margin in precision metrics, and our answer generation module achieving unprecedented gains in content preservation and coherence. Notably, CEAGS marks a pioneering contribution to the E-commerce domain by integrating disparate information sources to formulate responses that are not only accurate but also contextually rich and user-centric.

The optimal structural design is imperative to minimize material consumption and reduce the environmental impact of construction. Given the complexity in the formulation of structural design problems, the process of optimization is commonly performed using artificial intelligence (AI) global optimization, such as Genetic Algorithm (GA). However, the integration of AI-based optimization together with visual programming (VP) in building information modeling (BIM) projects warrants further investigation. This study proposes a workflow by combining structure analysis, VP, BIM, and GA to optimize trusses. The methodology encompasses several steps including: (i) generation of parametric trusses in Dynamo VP; (ii) performing the finite element modeling (FEM) using Robot Structural Analysis (RSA); (iii) retrieving and evaluating the FEM results interchangeably between Dynamo and RSA; (iv) finding the best solution using GA; and (v) importing the optimized model into Revit, enabling the user to perform simulations and engineering analysis, such as life cycle assessment (LCA) and quantity surveying. The feasibility of the proposed workflow was tested on benchmark problems and compared with open literature. The outcomes of this study offer insight into the opportunities and limitations of combining VP, GA, FEA, and BIM for structural optimization applications, particularly to enhance structural efficiency and sustainability in construction.

The exploration and understanding of sentiments and emotions through textual analysis are foundational to advancements in natural language processing (NLP). While sentiment analysis, which involves discerning the polarity of text, has been extensively explored, the nuanced detection of complex emotions within textual content is still an emerging area of study. In this paper, we introduce EmoLeverage, a model leveraging Transformer architecture and enhanced with a novel Fusion Adapter module. This model aims to deepen emotion detection capabilities by drawing insights from fundamental sentiment analysis tasks, focusing exclusively on textual data. EmoLeverage sets a new standard in the field by demonstrating that deep, nuanced understanding of emotions is achievable through text alone, challenging and surpassing existing methodologies in emotion identification on key datasets. This is a significant step forward, considering the complexity of human emotions and the subtleties involved in their expression through language. By concentrating on textual input, EmoLeverage offers a promising avenue for applications where audio or visual data is not available, highlighting the versatility and potential of text-based emotional analysis. Our approach illustrates the untapped potential of leveraging sophisticated NLP techniques to enhance the detection and comprehension of a wide array of emotions from text. The success of EmoLeverage in outperforming conventional models in emotion recognition tasks underscores the model's effectiveness in parsing and understanding the intricate expressions of human emotions through linguistic cues alone. This achievement paves the way for more accurate, efficient, and nuanced emotion detection tools, potentially transforming various sectors by providing deeper insights into human emotional states through text.

Visual Sensor Networks (VSNs) have been the focus of numerous studies, emphasizing the quality of the information they generate. The primary goal of these networks is to capture data from an area, extract the pertinent information from the visual scene, and facilitate communication. However, the presence of objects in the study area can impacted the network's efficiency, linking the quality of acquired data directly to the positioning of the cameras. Strategically positioning multiple cameras in a potentially complex area, while ensuring effective communication between nodes, presents a challenging issue in VSNs applications. This paper introduces a specific method to enhance the deployment of visual sensors in indoor environments. The research addresses the theme of multi-objective optimization of VSN deployment, integrating various criteria: maximizing overall visual coverage, maximizing the observation of zones of interest, maximizing observation redundancy of zones of interest and ensuring communication connectivity for data transfers. To tackle this problem, we simulate the observed environment incorporating cameras, obstacles, and considering zones of interest. Camera positioning is performed while considering visual constraints and the scene's characteristics. The quality of positioning is evaluated based on the defined objective functions. Initially, a comparative study is conducted with a state-of-the-art approach, integrating the first three objective functions. Subsequently, we incorporate the fourth objective function to ensure data transfers. The proposed method demonstrates efficient camera network deployments in indoor areas, considering global coverage and observation redundancy. In contrast to the state-of-the-art, these results are achieved in areas with visual obstacles while ensuring communication connectivity between the different cameras.

This research presents a comprehensive framework for efficiently generating forest fire datasets from Google Earth Engine data sources. The primary contribution of this work lies in providing a methodology to swiftly extract forest fire factors without the need for permissions or access to private datasets, rendering the dataset openly accessible and shared without barriers. Furthermore, given that the remote sensing data used is a global dataset, it can be applied in any region without restrictions. In this study, Peninsular Malaysia is chosen as a case study to demonstrate the framework's effectiveness. The generated dataset includes essential variables including the climate and environment, landcover, topography, and anthropogenic factors facilitating the analysis of fire occurrences. The methodology empowers data scientists, enabling them to leverage their analytical skills on the extracted dataset without requiring specialized remote sensing knowledge. Additionally, this study also showcases the adoption of large language models, specifically GPT-4 with the Noteable plugin, as a tool for conducting preliminary analyses on the generated dataset. Sample analyses reveal that several key features, including the KBDI, LST, PDSI, climate water deficit, and precipitation, significantly impact forest fire occurrences in Peninsular Malaysia. Despite the successful application of the GPT-4 with Noteable plugin, certain limitations and challenges are identified, highlighting the necessity for further validation of the tool's applicability and limitations. This study encourages future research to (1) adopt the proposed framework in other regions, (2) explore more detailed analyses encompassing all variables, and (3) leverage machine learning for advanced forecasting.

The recent past has witnessed a growing interest in technologies for creating chatbots. Advances in Large Language Models for natural language processing are underpinning rapid progress in chatbot development, and experts predict revolutionary changes in the labour market as many manual tasks are replaced by virtual assistants in a range of business functions. As the new technology becomes more accessible and advanced, more companies are exploring the possibilities of implementing virtual assistants to automate routine tasks and improve service. This article reports on qualitative inductive research undertaken within a chatbot development team operating in a major international enterprise. The findings identify critical success factors for chatbot projects, and, based on the in-depth case study, a model is put forward to aid the manageability of chatbot implementation. The presented model can serve as an exemplar guide for researchers and practitioners working on the design, development and implementation of virtual assistants. It is flexible and applicable in a wide range of business contexts, linking strategic business goals with execution steps. It is particularly applicable for teams with no experience of chatbot implementation, reducing uncertainty and managing decisions and risks throughout the project lifecycle, thereby increasing the likelihood of project success.

With the increasingly online exposure of urban public spaces, the new concept of "Internet-celebrity cities" has emerged in China. The online internet-famous sites are the main characteristics of "Internet-celebrity cities". To fully understand online users' preferences in such kind of public spaces, this article took 27 typical riverfront internet-famous sites (RIFS) in Changsha city (China), as an example. Through the online images and review comments on social media platform "Xiaohongshu", the study analyzed users’ perception of RIFS specially on visual and emotional preferences. It revealed the following findings:(1) The popularity of RIFS had a significant head effect and there were far more positive emotions than neutral and negative emotions in review comments. (2) According to 5 different categories of RIFS: modern buildings with river views, restaurants with strong visual impact became the main attractions on commercial RIFS. The art exhibition RIFS attracted visitors to experience traditional culture and highlight their aesthetic pursuits. In the historical and cultural RIFS, people preferred to see the historical buildings with surrounding natural environment, as well as river and mountains views. Ecological Recreational RIFS showed the similar results with the uncultivated RIFS, for the main focus was on the ecological environment, a broader vision and the specific atmosphere. Moreover, the uncultivated RIFS showed more diversified attraction points. This study can provide a new perspective on the waterfront vitality and can offer a targeted and attractive manner for waterfront regeneration that are different from traditional methods.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

Background: Open AI developed ChatGPT, a language model based on the GPT architecture, designed for text-based communication. Trained on diverse internet texts, ChatGPT generates contextually appropriate responses using machine learning. It understands input through analysis and context interpretation, generating coherent and contextually relevant responses. Interaction is possible through messaging platforms. Materials and Methods: In November 2023, we utilized ChatGPT 3.5, the default version at that time, to answer questions from the Italian National Residency Program Admission Tests (SSMs) of 2021, 2022, and 2023. The questions cover clinical, diagnostic, analytical, therapeutic, and epidemiological scenarios, sometimes accompanied by images. The study compared ChatGPT's answers to the official corrections on the Italian Ministry of University and Research (MUR) website. The scoring method used for evaluation was 1 point for correct answers, 0 points for unanswered questions, and -0.25 points for incorrect answers, reflecting the SSM test scoring system. Results: In summary, ChatGPT was tested with a total of 420 questions, 140 for each test. It achieved an overall accuracy of 80.48%, providing correct answers for 338 questions and incorrect answers for 82 questions. When faced with questions containing both text and images, it answered 55% correctly and 45% incorrectly. The model's performance varied over time, with an 82.14% accuracy rate in 2021 and 2022 (115 correct out of 140) and a 77.14% accuracy rate in 2023 (108 correct out of 140). Applying thisscoring method to the SSM test, ChatGPT would have scored 105 points in 2021 and 2022, and 100 points in 2023. Conclusions: ChatGPT has exhibited above-average performance in the last three SSM tests, highlighting its robust capability to interpret clinical scenarios and offer precise diagnostic and therapeutic guidance. Despite this, some limitations persist, notably the software's inability to interpret non-textual information.

Sentiment analysis plays a crucial role in understanding customer feedback, guiding product development, and informing business decisions. This paper introduces term sentiment entropy (TSE), a novel weighting method that leverages the distribution of sentiment labels associated with words to enhance text classification accuracy. TSE complements traditional TF-IDF techniques by capturing the nuances of sentiment variation across different contexts. Experiments across diverse public datasets demonstrate TSE's potential to improve sentiment analysis performance, especially in capturing subtle sentiment shifts and adapting to specific domains. While computational cost and label quality pose challenges, TSE offers a promising avenue for refining sentiment analysis and opening new research frontiers.

Multilingual classrooms are becoming more common worldwide due to increasing mobility. Teaching foreign languages using the mother tongue in multilingual classrooms has become problematic; some of the significant concerns in Japanese language acquisition – such as the high contextuality of the language, vocabulary and kanji learning – make the direct teaching method confusing for many students, especially at the beginner and elementary levels. This article provides the preliminary results of a study carried out as a component of a more extensive empirical research project on instructional languages in classrooms teaching Japanese as a foreign language. It aims to gather, analyse and synthesise data from a survey conducted at a supranational level. The results of the first two sections of a questionnaire containing closed and open-ended questions were used for a quantitative analysis of the profile of Japanese language instructors with a focus on finding possible connections. The wide geographic distribution of the respondents (274 teachers from fifty-seven countries and regions) made it possible to collect data from a more representative sample and draw meaningful conclusions about the spread of multilingual classrooms that would be impossible in smaller-scale research. The study’s primary results show the proportion of multilingual classrooms among countries in different regions and across different educational stages, the distribution of Japanese language instructors in various educational stages depending on the highest level of formal education attained, and the proportion of part-time instructors working in different academic institutions.

Visual exploration of complex data helps interpretation, especially in the case of omics data analysis in life sciences and clinical research. Generating and analysing omics data requires bioinformatic skills, while they are interpreted by domain experts, for whom parsing large and complex data structures may be challenging. However, outcomes of visual analytics are often difficult to quantify, which emphasises precision and reproducibility, especially for research on human diseases. Here, we propose a workflow combining a reproducible computational environment with a dedicated visualisation functionality for systems biology diagrams. By linking the Galaxy with the MINERVA Platform, we visualise and explore COVID-19 transcriptomic data to demonstrate the utility of our workflow. Visualised data recapitulate findings of the original publication and offer new insights about the COVID-19 pathology. Our results offer a blueprint for quick prototyping of computational workflows that facilitate communication and exploration of complex data in biomedical research.

Artificial intelligence methods, especially artificial neural networks (ANNs), have recently been successfully used more and more frequently in the mathematical description of physical phenomena in the processing of metallic materials. Results based on measured data of phenomena in real production are often, at least locally, different or more complex than the results of established theories. In general, ANN models, which mostly work as "black boxes", allow us to improve production efficiency by themselves. The fact is, however, that a better understanding of the phenomena under consideration, which is otherwise enabled by classical mathematical approaches in the form of explicit mathematical formulas, could ensure even greater efficiency. In this article, therefore, a general concept is proposed to explain the discussed phenomena in metallic materials. The application of the concept is illustrated on the example of hot extrusion of aluminum alloy 6082, where CAE is used as an artificial neural network to model the phenomenon and predict the key parameters of the phenomenon. ChatGPT is used to explain the results according to the proposed concept. The basic idea is to enable practicing engineers to better understand the considered phenomena and results obtained by ANNs.

This study aimed to evaluate the effects of Blazepod technology when incorporated with various training regimens on the essential elements of physical fitness in volleyball, such as agility, speed, visual response time, and vertical leap. Thirty-six participants (age :17.33±0.48 y, height: 183.78±6.34 cm, weight: 77.14±5.16 kg) were in-volved in this study. In randomized design, three equal groups with two experimental groups and one control group were involved in the study over a period of six weeks: (GE1) used Blazepod technology to workout at a low level; (GE2) used Blazepod technology to workout at a higher intensity; (CG) did not employ Blazepod technology, but it adhered to the same fundamental training curriculum. We conducted agility, speed, reaction time, and vertical jump tests before, midway and after the study to determine optimal training volume, intensity, and frequency. A significant main effect of time (P0.01), and time×group interaction (P>0.001) were found for all tests. Post hoc test showed that the two experimental groups gadget significantly improved in all performance variables (P

The purpose of this paper is to explore the implementation of Retrieval-Augmented Gen- 14 eration (RAG) technology with open-source Large Language Models (LLMs). For this purpose, a 15 web-based application named PaSSER that integrates RAG with three models - Mistral:7b, 16 Llama2:7b: Orca2:7b, is developed. In its development various technologies are used, including 17 Blockchain for managing and storing assessment results of built-in testing modules. PaSSER em- 18 ploys a set of evaluation metrics for LLMs’ performance - METEOR, ROUGE, BLEU, Perplexity, 19 Cosine similarity, Pearson correlation, and F1 score. The specialized knowledge base is in the smart 20 agriculture domain. As an illustration, the paper presents results and analysis of two tests. First one 21 is assessing the performance of LLMs across different hardware configurations, the other is deter- 22 mining the model that delivers most accurate and contextually relevant responses within the RAG. 23 The paper also discusses the integration of blockchain technology with LLMs to manage and store 24 assessment results within a blockchain environment. The tests revealed that Mistral:7b demon- 25 strates the best results across most of the evaluated metrics. The discussion section comments on 26 technical and hardware considerations that affect the performance of LLMs. Future development 27 will focus in leveraging new larger pre-trained open-source LLMs, exploring different finetuning 28 approaches, and further integration with Blockchain and IPFS.

Among the most popular learning management systems available worldwide is Moodle [1]. This current study examines how learners' attitudes toward English as a foreign language (EFL) and their language proficiency are affected by Moodle's interactive language learning activities. Thirty-three undergraduate students participated in this study. We investigated the effects of engaging language learning exercises that were practiced on Moodle using an experimental re-search design. To find out if the experimental and control groups differed significantly from one another on pre- and post-measures regarding the development of language skills and attitudes toward language classrooms, a number of statistical tests were employed. We conducted data analysis using SPSS software. Results demonstrated that there were differences favoring the ex-perimental group in the language skills developments and attitudes of learners toward the lan-guage classroom. There were no apparent differences in the forming structures, speaking, or listening of the control group's learners. On the other hand, there were notable differences in the overall score, writing and reading skills, and lexical item mastery. Additionally, significant dif-ferences in the language acquisition growth of the experimental and control groups were found using an Independent Samples T-test in the post-test, with the experimental group benefiting.

In this review, we outline our current understanding of the mechanisms involved in the absorption, storage, and transport of dietary vitamin A to the eye, the trafficking of rod opsin protein to the photoreceptor outer segments, which encompasses the logistical backbone required for visual function. Two key mechanisms of this process are emphasized in this manuscript: Ocular and systemic vitamin A membrane transporters, and rhodopsin transporters. Understanding the complementary mechanisms responsible for the generation and proper transport of the retinylidene opsin to the photoreceptor outer segment will eventually shed light on the importance of genes encoded by these proteins, and their relationship on normal visual function and in the pathophysiology of retinal degenerative diseases.

The article suggests a Value Proposition (VP) framework that enables the analysis of the beneficial impact of Artificial Intelligence (AI) resources and capabilities on specific VP development activities. To develop such a framework, we examined existing management research publications to identify and extract assertions that could be used as a source of actionable insights for new growth-oriented companies. The extracted assertions were assembled into a corpus of texts that were subjected to topic modelling analysis – a machine learning approach to natural language processing that is used to identify latent themes in large corpora of text documents. The topic modeling resulted in the identification of seven topics. Each topic is defined by a set of most frequent words co-occurring in a distinctive subset of texts that could be interpreted in terms of activities constituting the core elements of the VP framework. We then examined each activity in terms of its potential to be enhanced by employing AI resources and capabilities. The interpretation of the topic modeling results led to the identification of seven topics: 1) Value created; 2) Stakeholder value propositions; 3) Foreign market entry; 4) Customer base; 5) Continuous improvement; 6) cross-border operations; and 7) Company image. The uniqueness of the adopted topic modeling approach consists in the quality of the assertions and the interpretation of the seven topics as an activity framework, i.e. in its capacity to generate actionable insights for practitioners. The additional analysis suggests that there is a potential for AI to enhance emerging the four core elements of the VP framework: Value created, Stakeholder value propositions, Foreign market entry, and Customer base. More importantly, we found that the greatest number of assertions related to activities that could be enhanced by AI are part of the Customer base topic, i.e., the topic that is most directly related to the growth potential of the companies. In addition, the VP framework suggests that a company’s customer base growth is continuously enhanced through a positive loop enabled by activities focused on the Continuous improvement of the activities and the amount of Value created, the alignment of Stakeholder value propositions, and companies’ Foreign market entry. Thus, Foreign market entry appears as a factor that helps in understanding the beneficial impact of AI on the VP development of new growth-oriented companies.

The pursuit of Artificial Intelligence (AI) that emulates human cognitive processes is a cornerstone of ethical AI development, ensuring that emerging technologies can integrate seamlessly into societal frameworks requiring nuanced understanding and decision-making. Zero-Shot Instance Retrieval (ZSIR) stands at the forefront of this endeavour, potentially providing a robust platform for AI systems, particularly large visual language models, to demonstrate and refine cognition-aligned learning without the need for direct experience. In this paper, we critically evaluate current cognition alignment methodologies within traditional zero-shot learning paradigms, using visual attributes and word embedding generated by large AI models. We propose a unified similarity function that quantifies the cognitive alignment level, bridging the gap between AI processes and human-like understanding. Through extensive experimentation, our findings illustrate that this similarity function can effectively mirror the visual-semantic gap, steering the model towards enhanced performance in zero-shot instance retrieval. This work not only benchmarks the cognition alignment of AI, but also sets a new precedent for the development of visual language models attuned to the complexities of human cognition.}

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

This study introduces a specialized Automatic Speech Recognition (ASR) system, leveraging the Whisper Large-v2 model, specifically adapted for radiological applications in French language. Our methodology focused on adapting the model to accurately transcribe medical terminology and diverse accents within the French language context, achieving a notable Word Error Rate (WER) of 17.121%. The research involved extensive data collection and preprocessing, utilizing a wide range of French medical audio content. The results demonstrate the system's effectiveness in transcribing complex radiological data, underscoring its potential to enhance medical documentation efficiency in French-speaking clinical settings. The discussion extends to the broader implications of this technology in healthcare, including its potential integration with Electronic Health Records (EHRs) and its utility in medical education. The study also explores future research directions, such as tailoring ASR systems to specific medical specialties and languages. Overall, this research contributes significantly to the field of medical ASR systems, presenting a robust tool for radiological transcription in the French language and paving the way for advanced technology-enhanced healthcare solutions.

Background: Visual acuity (VA) assessments are crucial in ophthalmology but traditionally rely on in-clinic evaluations. The emergence of telemedicine has spurred interest in creating dependable self-administered VA tests for use beyond standard clinical environments. This study evaluates the practicality and validity of a self-administered Near VA card test against traditional Snellen and Rosenbaum Pocket Vision Screener (RPVS) methods for home monitoring and enhancing clinical workflow. Methods: In a cross-sectional study a near VA card (Hadassah Self-Visual Acuity Screener-HSVA) was developed with written and videotaped instructions for self-use. Patients with a minimal best corrected VA (BCVA) of 1.0 LogMAR in at least one eye were recruited from Ophthalmology and Optometry clinics. Outcomes included mean BCVA difference between the self-administered and those obtained by the examiner, and correlations among BCVA values obtained by Snellen, RPVS, HSVA and previous distance BCVA according to the patient electronic medical records. Results: A total of 275 participants (mean age: 42.5±19.4 years, range: 18-89 years, 47% female) were included. Test-retest reliability analysis for the HSVA demonstrated very good correlation and repeatability (n=38 patients.; Rs=1.0, P

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

The recent availability of commercial platforms for behavioral analysis in zebrafish larvae based on video-tracking technologies has exponentially increased the number of studies analyzing different behaviors in this model organism to assess neurotoxicity. Among the most commonly used assays in zebrafish larvae are basal locomotor activity (BLA) and visual motor response (VMR). However, the effect of different intrinsic and extrinsic factors that can significantly alter the outcome of these assays is still not well understood. In this work we have analyzed in 143 larvae the influence of age (5-8 days post-fertilization), time of day (8:00, 10:00, 12:00, 14:00; 16:00, 18:00, and 20:00 h), and experiment (three experiments performed at different days) on BLA and VMR results (4,004 analyses for each behavior). Results from both behaviors were adjusted to a Random-Effects linear regression model using generalized least squares (GLS), including in the model the effect of the three variables, the second-way interactions between them and the three-way interaction. The results presented in this manuscript show a specific effect of all three intrinsic factors and their interactions on both behaviors, supporting the view that the most stable time period for performing these behavioral assays is from 10:00 am to 04:00 pm, with some differences depending on age of the larva and the behavioral test.

This study explores the Experience Economy dimensions within fishing tourism, adopting a data science perspective by employing web crawling for extensive data gathering on reviewer profiles from TripAdvisor. Utilizing Natural Language Processing (NLP) techniques, it scrutinizes the relationship between Experience Economy dimensions and user profiling aspects. Findings reveal "Entertainment" as the predominant dimension in tourist reviews, followed by "Aesthetic," "Educational," and "Escapist." Particularly notable are the frequent co-occurrences of "Entertainment"-"Aesthetic" and "Educational"-"Entertainment" pairs. The practical implications underscore the potential socioeconomic benefits of fishing tourism for local communities and fishermen, emphasizing the necessity for governmental support in terms of infrastructure, leadership, legislation, and financial backing to foster sustainable development in this sector. Notably, this research stands as a pioneering effort in its focus on Experience Economy dimensions and user profiling within the context of fishing tourism, drawing data from business pages and user profiles.

Today, LLMs are not good at personalization providing recommendation. They advise physicians and financial advisors to ask professionals in respective fields for help, even having user information available. Answering questions of software professionals, LLM needs to deliver in-depth answers with codes or algorithms, whereas for professionals in other fields would need definitions and main concepts. The intent of this chapter is to make LLM answer tailored to the needs of users, taking into account available information about them. To do that, we need to generalize available information about a person like her health record, maintaining the privacy of this person. We rely on meta-learning techniques to design a LLM prompt to produce a personalization prompt to obtain a suitable relevant information. Such “meta-prompt” is produced by generalization operation applied to available documents for the user. These documents need to be de-identified so that they are sufficient for personalization on one hand and will maintain user privacy on the other hand. The second neuro-symbolic technique to support personalization is abductive reasoning, acting in parallel to LLM fine-tuning. Traditional recommendation and personalization techniques as well as modern, deep learning – based are presented, and the comparison is drawn to the proposed approach. We also share the evaluation and comparative analyses of these approaches. We consider an example for how to build personalization LLM systems coming from Langchain platform. We will explore how to construct chains to form a personalization profile for a user and apply it to user search and recommendation requests.

The question of whether the early visual cortex (EVC) is involved in visual mental imagery remains a topic of debate. In this paper, I propose that the inconsistency in findings can be explained by the unique challenges associated with investigating EVC activity during imagery. During perception, the EVC processes low-level features which means that activity is highly sensitive to variation in visual details. If the EVC has the same role during visual mental imagery, any change in the visual details of the mental image would lead to corresponding changes in EVC activity. Within this context, the question should not be whether EVC is ‘active’ during imagery but how its activity relates to specific imagery properties. Studies using methods that are sensitive to variation in low-level features reveal that imagery can recruit the EVC in similar ways as perception. However, not all mental images contain a high level of visual details. Therefore, I end by considering a more nuanced view which states that imagery can recruit the EVC, but that does not mean that it always does so.

Predatory research field in science is when an emerging scientific topic destroys current topics and characterizes a main scientific change. Predatory research field can be a basic driver of scientific and technological change that generates a 'creative destruction' in science and society in contexts of knowledge-based competition and rapid changes. The prediction of proposed theory of predatory research fields is that it destroys with a fast growth other research fields. The theoretical approach is tested here in research fields of large language models (LLM) by analyzing the transformers (a deep learning architecture based on the multi-head attention mechanism) proposed in 2017 and from November 2022 started main applications in generative artificial intelligence with innovations of BERT, ChatGPT, Microsoft Copilot (launched on February 7, 2023) and other natural language processing tools driven by AI technology for engaging conversations, gain insights, automate tasks, etc., etc. Statistical evidence suggests that growth rate of transformer technologies is 80.58%, a high level compared to all other research fields in machine learning (having a growth rate of 13.83%). Moreover, predatory research field of transformers has a destructive power such that all other domains in LLM from 2021 to 2023 have a general reduction of scientific growth. The impact of transformers is much more drastic of previous radical technologies such as CNN having a temporal growth rate of 0.16%, lower than 0.38% by transformers, ceteris paribus. These analysis reveals that transformers have characteristics to generate a radical scientific and technological change in a not-too-distant future. Overall, then, the study suggests that predatory research field on emerging topics and technologies can generate path-breaking innovations and the examination here can clarify the essential elements of the science dynamics for a better theory of scientific and technological change, providing also main implications for knowledge policy to support promising research fields and technologies to guide economic and social change.

In the dynamic field of mental health care, the nuanced application of Artificial Intelligence (AI) through Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) is a pivotal innovation in patient empowerment and service optimization. This study introduces a distinctive online therapy platform that capitalizes on the synergy of NLP and ASR to offer unprecedented levels of interactive and personalized therapeutic interventions. The architecture of our system is meticulously detailed, featuring an ASR component with an impressive Word Error Rate (WER) of 14% when trained on the diverse French subsets of the Mozilla Common Voice dataset, complemented by a high-precision NLP framework skilled in processing and responding to user inputs. The evaluation of our system highlights its efficacy in enhancing therapy sessions and user satisfaction, with an emphasis on the qualitative aspects of user feedback. The paper addresses challenges such as dataset representativeness and language model refinement and articulates the strategic solutions employed to overcome them. The paper concludes with forward-looking perspectives on AI's role in mental health services, advocating for the creation of sophisticated, language-specific datasets and models to satisfy the increasing demands of online therapy, reflecting a growing commitment of patients in the management of their therapy. This research underscores the transformative impact of AI in advancing mental health care into the digital age, representing a significant evolution over existing methodologies.

Considering that cryptocurrencies are now present in practically every financial transaction because they are widely accepted as an alternate means of making payments and exchanging currencies, academics and economists have more opportunities to study cryptocurrency prices. Over the years, investors, traders and investment banks have found it difficult to predict the closing daily price of Ethereum due to its rapid price fluctuation. The daily closing price of cryptocurrency is essential to consider when trading or investing in Ethereum. This report focuses on carrying out a comparative study of the predictive capabilities of deep machine learning algorithms with a stacking ensemble modelling framework using daily historical observations of the price of Ethereum obtained from Coindesk, tweets extracted from Twitter ranging from the 1st of August 2022 to the 8th of August 2022 and other five covariates (closing price lag1, closing price lag2, noltrend, daytype and month) engineered from the closing price of Ethereum. Seven models are used to compute the forecasts for the daily closing price of Ethereum; these are the recurrent neural network, ensemble stacked recurrent neural network, gradient boosting machine, generalized linear model, distributed random forest, deep neural networks and stacked ensemble for gradient boosting machine, generalized linear model, distributed random forest and deep neural networks. The main evaluation metric used is the mean absolute error. According to MAE, RNN forecasts outperform the other model’s forecasts in this study, producing an MAE of 0.0309.

There is an anecdotal impression that teenage patients report exaggerated postoperative pain scores that do not correlate with their actual level of pain. Nurse and parental perception of teenagers' pain can be complemented by knowledge of patient pain behavior, pain catastrophizing thoughts, anxiety, and mood level. Two hundred two patients completed the study: 56.4% female, 89.6% White, 5.4% Black, and 5% other race. Patient ages ranged from 11 to 17 years (mean = 13.8, SD = 1.9). The patient, the parent, and the nurse completed multiple questionnaires on day one after laparoscopic surgery to assess patient pain. Teenagers and parents (r=0.56) have a high level of agreement, and teenagers and nurses (r=0.47) have a moderate level of agreement on pain scores (p <0.05). The correlation between patient APBQ (Adolescent Pain Behavior Questionnaire) and teenager VAS (Visual Analog Scale ) and between nurse APBQ and teenager VAS, while statistically significant (p < 0.05), is weaker (r range = 0.14-0.17). There is a moderate correlation between teenagers' pain scores and their psychological assessments of anxiety, catastrophic thoughts, and mood (r range= 0.26 – 0.39; p <0.05). A multi-modal evaluation of postoperative pain can be more informative than only assessing self-reported pain scores.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

Human language is a prime example of a complex system characterized by multiple scales of description. Understanding its origins and distinctiveness has sparked investigations with very different approaches, ranging from the Universal Grammar to statistical analyses of word usage, all of which highlight, from different angles, the potential existence of universal patterns shared by all languages. Yet, a cohesive perspective remains elusive. In this paper we address this challenge. First, we provide a basic structure of universality, and define recursion as a special case thereof. We cast generative grammars of formal languages, the Universal Grammar and the Greenberg Universals in our basic structure of universality, and compare their mathematical properties. We then define universality for writing systems and show that only those using the rebus principle are universal. Finally, we examine Zipf's law for the statistics of word usage, explain its role as a complexity attractor, and explore its relation to universal writing systems as well as its similarities with universal Turing machines. Overall, we find that there are two main kinds of universality, termed {\it mechanistic} and {\it emergent}, and unveil some connections between them.

In recent years, the implementation of artificial intelligence (AI) in accounting has grown in many domains, including auditing. AI permits auditors to evaluate large data sets and rapidly identify discrepancies and sequences in audit. This means auditors can review all of a client's transactions via a low time and effort. This entails auditing firms investing heavily in technological infrastructure as well as training their human resources to use cutting-edge AI technologies. Thus, this research sought to investigate the impact of the use of AI techniques by Jordanian external auditors in fraud risk assessment, the moderating effect of auditor size. The descriptive analytical method was used by distributing 280 questionnaires electronically to auditors employed in auditing firms operating in Jordan, The result reveals that AI techniques are extremely beneficial in fraud risk assessment at all levels, and the relationship between the use of AI techniques and the assessment of fraud risk has improved as auditor size has increased.

Bat feces were reported in ancient Chinese medicine books to have the effect of reducing heat and improving eyesight, but the mechanism of vision improvement still needs further research. To this end, we used 2,2-diphenyl-1-picrylhydrazyl (DPPH) and liquid chromatography/tandem mass spectrometry (LC/MS/MS) to analyze the antioxidant capacity of and the types of vitamins in bat feces. We hoped to screen the pharmacological components of bat feces, and to explain the role that these components may play in the treatment of visual deterioration. Our results found that bat feces had a good antioxidant capacity and mainly contain vitamins B1 (thiamine), B2 (riboflavin), B3 (nicotinamide), B3 (nicotinic acid), and B5 (pantothenic acid). Although these vitamins may help maintain the health of the optic nerve and cornea, the vitamin content of bat feces is low, but the heavy metal content is high, as shown using inductively coupled plasma mass spectrometry (ICP-MS) analysis. Therefore, we suggest that the use of bat feces as traditional Chinese medicine to improve vision should be strictly restricted.

Nollywood, based on the idea of Bollywood from India, is a series of outstanding movies that originate from Nigeria. Unfortunately, while the movies are in English, they are hard to understand for many native speakers due to the dialect of English that is spoken. In this article, we accomplish two goals: (1) create a phonetic sub-title model that is able to translate Nigerian English speech to American English and (2) use the most advanced toxicity detectors to discover how toxic the speech is. Our aim is to highlight the text in these videos which is often times ignored for lack of dialectal understanding due the fact that many people in Nigeria speak a native language like Hausa at home.

Videogames have been the focus of research since their widespread popularity, with particular emphasis on their effects on cognitive and affective abilities, especially in children and adolescents. Despite numerous correlational studies, robust evidence on the causal relationship between videogames and cognition remains scarce, hindered by the absence of a comprehensive assessment tool for gaming skills across various genres. This study aimed to develop and validate the Gaming Skill Questionnaire (GSQ) and to assess the impact of gaming skills in six different genres (Sport, First-Person Shooters, Role-Playing Games, Action-Adventure, Strategy, and Puzzle Games) on adolescents’ cognitive and affective abilities. The GSQ exhibited strong reliability and validity, highlighting its potential as a valuable tool. Gaming skills positively affected executive function, memory, overall cognition, cognitive flexibility, and emotion recognition, except for empathy. Various game genres had different effects on cognitive and affective abilities, with verbal fluency influenced mainly by sports, executive functions by action, strategy, and puzzle, and emotion recognition positively impacted by action and puzzle but negatively by sports and strategy games. Both age and gaming skills influenced cognitive flexibility, with gaming having a greater effect. These intriguing genre-specific effects on cognitive and affective functioning postulate further research with GSQ's contribution.

Structures inevitably suffer damages after an earthquake, with their severity ranging from minimal damages to non-structural elements to partial or even total collapse, possibly with loss of human lives. Thus, it is essential for engineers to understand the crucial factors that drive a structure towards suffering higher degrees of damage, so that preventative measures can be taken. In the present study, we focus on three well-known damage thresholds, namely Collapse Limit State, Ultimate Limit State and Serviceability Limit State and analyze which of the features obtained via Rapid Visual Screening, determine whether or not a given structure will cross that threshold. To this end, we use Machine Learning to perform binary classification for each damage threshold, as well as Explainability via SHAP values (acronym for SHapley Additive exPlanations) to quantify the effect of each parameter. The quantitative results obtained demonstrate the potential applicability of ML methods to re-calibrate the computation of structural vulnerability indices using data from recent earthquakes.

Effective communication in English is crucial for marketing professionals in the highly competitive global business landscape. This article emphasizes the importance of English language proficiency and the need for a tailored needs analysis for marketing professionals in the field of Business English. The comprehensive exploration of the needs analysis process outlines its methods and steps, highlighting its relevance in designing targeted language programs. By utilizing surveys, interviews, and observations, trainers and language instructors gain valuable insights into the specific challenges faced by marketing professionals, enabling them to develop customized skill-building approaches. The article also underscores the pedagogical implications of the needs analysis, stressing the significance of a personalized training program that addresses identified language gaps. Recognizing the collaborative nature of the process, the article concludes by discussing the implementation of the training program and the importance of tracking progress, ultimately displaying the tangible benefits of conducting a needs analysis in Business English for marketing professionals in terms of enhancing competitiveness and driving business growth.

Domain generalization has led to remarkable achievements in Hyperspectral Image (HSI) classification. Inspired by contrastive language-image pre-training (CLIP), the language-aware domain generalization method has been explored to learn cross-domain-invariant representation. However, existing methods face some challenges: 1) The weak capacity to extract long-range contextual information and inter-class correlation. 2) Due to the inadequacies of the large-scale pre-training for HSI data, the spatial-spectral features of HSI and linguistic features can not be straightforwardly alignment. To address the above problems, a novel network has been proposed with a CLIP framework, which consists of an image encoder, based on an encoder-only transformer to obtain the global contextual information and inter-class correlation, a frozen text encoder, and a cross-attention mechanism, named Linguistic-Interact-with-Visual Engager (LIVE), enhances the interaction between two modalities. Extensive experiments demonstrating superior performance over state-of-the-art methods in HSI Domain Generalization with a CLIP framework.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Purpose: To explore the clinical relationship between age, interocular differences in the corrected distance(CDVA) and near(CNVA) high contrast logMAR acuities, refractive errors, aniseikonia, axial lengths, pupil sizes, and higher order ocular aberrations (HOAs) on clinical measures of stereoacuity in asymptomatic, presbyopic, habitual spectacle wearers. Methods: 91 subjects underwent clinical assessment of i)subjective refractive error, ii)stereoacuity[arcsecs] at 6m&40cm(Randot Stereotests), iii)aniseikonia[%] at 6m (Awaya test,vertical and horizontal meridia) iv)higher order aberrations(Hartman-Shack aberrometer) v)eyeball length and pupil size(IOL master 700). The resultant aniseikonia(AR) was calculated for pairs of aniseikonia values using Pythagorean theorem. Results: Mean(±sd,95%CI) age of the subjects was 56.2years(±8.10,54.6-57.9). Root mean square(RMS) interocular differences(±sd,95%CI) in spherical refractive errors, axial lengths and pupil sizes were 0.66D(±0.93,0.47-0.85), 0.24mm(±0.33,0.17-0.31), 0.15mm(±0.11,0.12-0.17). Median(mode,interquartile range) values for AR were 2.8(1.0,1.3-4.0). Significant correlations(p

Children with hearing loss have been found to have significantly more behavioral and emotional challenges than their typically hearing peers, though these outcomes are variable at the individual level. Working memory deficits have been found to relate to executive functioning and overall emotion regulation, leading to behavior challenges. Language development is essential for development of social relationships and communicating one’s needs - this may lead to distress when children cannot communicate effectively. Based on prior findings in children with hearing loss and their typically hearing peers, working memory and language skills were hypothesized to be related to parent and teacher report of socioemotional functioning. Participants were 35 children with hearing loss (66% female, M = 5.17 years old, SD = ±1.97) whose language, working memory, and socioemotional functioning were evaluated during the course of treatment and educational planning. Bivariate analyses indicated that working memory was related to a number of socioemotional domains (e.g., functional communication, atypicality, withdrawal), as were language scores (e.g., social skills, inattention). The direction of these associations was such that stronger working memory and language skills were related to more regulated socioemotional functioning. A call to action of the current study includes more education with regard to profiles and presentations of children with hearing loss, and an early focus on socioemotional learning to foster the development of regulatory skills.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

This paper will argue that memory from early childhood underlies many practices and beliefs that we commonly refer to as “religious”. The consciousness of young children does not yet have certain features that characterizes adult consciousness. This paper will concentrate on four of these: (I) a reality that is recognizable; (II) a sense of temporal duration; (III) a sense of self; (IV) an experience of the world that is deeply affected by our acquaintance with (a) language. Absence of these features presumably characterizes the consciousness of infants. It also often characterizes mystical experiences. The paper will argue that the human tendency to engage in so-called religious practices and beliefs makes most sense on the assumption that adults somehow preserve the memory of their state of being in childhood.

The proliferation of deep learning in natural language processing (NLP) has led to the development and release of innovative technologies capable of understanding and generating human language with remarkable proficiency. Atinuke, a Transformer-based neural network, optimises performance across various language tasks by utilising a unique configuration. The architecture interweaves layers for processing sequential data with attention mechanisms to draw meaningful affinities between inputs and outputs. Due to the configuration of its topology and hyperparameter tuning, it can emulate human-like language by extracting features and learning complex mappings. Atinuke is modular, extensible, and integrates seamlessly with existing machine learning pipelines. Advanced matrix operations like softmax, embeddings, and multi-head attention enable nuanced handling of textual, acoustic, and visual signals. By unifying modern deep learning techniques with software design principles and mathematical theory, the system achieves state-of-the-art results on natural language tasks whilst remaining interpretable and robust.

Humans have a unique cognitive ability known as relational abstraction, which allows us to identify logical rules and patterns beyond basic perceptual characteristics. This ability represents a key difference between how humans and other animals learn and interact with the world. With current large language models rivaling human intelligence in many regards, we investigated whether relational abstraction was an emergent chat completion capacity in various models. We find that despite their impressive language processing skills, all tested language models failed the relational match-to-sample (RMTS) test, a benchmark for assessing relational abstraction. These results challenge the assumption that advanced language skills inherently confer the capacity for complex relational reasoning. The paper highlights the need for a broader evaluation of AI cognitive abilities, emphasizing that language proficiency alone may not be indicative of certain higher-order cognitive processes thought to be supported by language.

Purpose. This article examines the use of English medium instruction (EMI) for teaching Japanese as a foreign language (JFL) by non-native speakers with a focus on multilingual classrooms. The study also explores teachers’ positive and negative beliefs about using EMI in classroom settings for JFL instruction.Methods and procedure. Two hundred sixty-one non-native Japanese language teachers worldwide voluntarily participated in the survey, answering the questionnaire (Google Forms and Jotforms) used to gather data. Both qualitative and quantitative methods were employed. The research instrument was piloted before the main study and was found to be effective and adequate to elicit the desired data. The research questions aimed to identify whether there were any relationships between the use of EMI and the multilingual classroom. Findings. The results showed a clear correlation between the extensive use of EMI and the multilingual character of JFL multilingual classrooms. Translanguaging turned out to be a common practice adopted by non-native Japanese teachers regardless of the primary language of instruction. The article concludes that EMI can be a valuable tool for JFL instruction in multilingual classrooms. Based on the investigation of the teachers’ beliefs, the study results showed a changing positive attitude towards English employed in JFL classrooms. Implications for research and practice. The findings can be used further to investigate EMI in JFL instructional practices in multilingual classrooms, to improve the quality of JFL instruction, and to facilitate the integration of multilingual education into foreign language teaching. Future research can explore the effectiveness of EMI in different JFL contexts and investigate the impact of EMI on students’ language learning outcomes.

This research delves into the intricate challenges confronting the agricultural sector, with a specialized focus on mitigating infections in tomato crops, particularly powdery mildew induced by the Leveillula Taurica pathogen. Tomatoes, renowned for their nutritional richness, are vital to global food security. However, conventional methodologies for disease detection exhibit both laborious processes and limited accuracy. In response to these challenges, this study advocates for an innovative fusion of hyperspectral imaging and deep learning methodologies to detect crop disease and its severity. The systematic workflow commenced with the curation of a dataset, involving the acquisition of live images through OpenCV, followed by conversion to RGB format and subsequent feature extraction utilizing a pre-trained visual geometry group (VGG-16) model for enhanced analysis. Sequentially, RGB images were transformed into simulated hyperspectral images (SHSI) leveraging a Neural Network generator model, offering a distinctive viewpoint on spectral information. This novel approach transcends conventional constraints by delivering a three-dimensional perspective, seamlessly integrating spatial and spectral dimensions for holistic data acquisition. The SHSI is further transmuted into a 3D visualization cube comprehensive grasp of spatial and spectral aspects encompassing spectral, spatial, and Haralick features. The research concludes with severity detection, categorized as low, moderate, or high, employing a Gaussian Mixture Model (GMM) and K-means for visualization.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

Human language and social cognition are two key disciplines that have traditionally been studied as separate domains. However, emerging research from detailed studies of comparative animal behavior, human social behavior, language acquisition in children, social cognitive neuroscience, and the cognitive neuroscience of language suggest that language and social cognition are two deeply interrelated capacities of the human species. For instance, recent developmental studies on the acquisition of language in infants and young children, draw attention to the important crucial benefits associated with several different aspects of social stimulation for youngsters, including the quantity and quality of linguistic input, dyadic infant/child-to-parent verbal and non-verbal social interactions, and other important social cues integral for facilitating language learning and social bonding. Studies of the adult human brain further suggest a high degree of specialization for sociolinguistic information processing, memory retrieval, and comprehension, suggesting the function of these regions may link language with social cognition and social bonding. In effect, the social brain and social complexity hypotheses may jointly help to explain how neurotypical children and adults learn language, why autistic adults and children exhibit simultaneous deficits in language and social cognition, and why nonhuman primates and other animals with significant computational abilities do not acquire the capacity for language. But perhaps most critically, the following article argues that this and related research will allow scientists to generate a holistic profile and deeper understanding of the healthy adult social brain, while developing more innovative and effective diagnoses, prognoses, and treatments for maladies and deficits also associated with the social brain.

This study aimed to compare procedural learning skills between Spanish-speaking preschool children (ages 4 years to 4 years, 11 months) with Developmental Language Disorder (DLD) and their typically developing (TD) peers. Using the Serial Reaction Time task, participants (30 DLD and 30 TD children) respond to visual stimuli in a sequenced manner over four blocks, followed by a random order block. The task assessed reaction time (RT) and accuracy. Results showed a significant interaction between group and block for reaction time (RT) and accuracy, with children with DLD exhibiting longer RTs and accuracy deficits across blocks. In contrast, the TD group showed higher RT efficiency and accuracy in the sequential blocks and as expected, decreased performance in the random block according to the experimental manipulation. Overall, the results of this investigation suggest that there was no implicit learning in the DLD group, as indicated by the SRT task paradigms of procedural memory. These findings align with the Procedural Deficit Hypothesis (PDH), suggesting that linguistic deficits in the TD population may derive from a general dysfunction of the procedural memory system domain in the Spanish context.

Past research suggests a continuity between perception and memory, as reflected in influences of orienting of spatial attention by cues presented after a visual target offset (post-target cues) on target perception. Conducting two experiments, we tested and confirmed this claim. Our study revealed an elevated reliance on post-target cues for target detection with diminishing target visibility, leading to better performance in validly versus invalidly cued trials, indicative for contrast gain. We demonstrated this post-target cueing impact on target perception without a postcue response prompt, meaning that our results truly reflected a continuity between perception and memory rather than a task-specific impact of having to memorize the target due to a response prompt. We further showed an influence of attention by the post-target cues with cues presented away from a clearly visible target, meaning that visual interactions at the target location provided no better explanation of our results. Our results generalize prior research with liminal targets and confirm the view of a perception-memory continuum, so that visual target processing is not shielded against visuospatial orienting of attention elicited by events following offset of the visual target.

This paper offers a novel geometric and visual approach to the renowned Four Color Map Theorem and K5 non-planarity problem while unveiling their profound connection to the "kissing number" problem in 2D. We represent planar graphs through circles and tangents, simplifying complex structures and shedding light on these classic problems. Our proofs by contradiction, rooted in the kissing number concept, reveal that both the Four Color Map Theorem and K5 non-planarity are fundamentally linked, as they pivot around the concept of coloring. This study bridges the realms of geometry and graph theory, providing fresh insights and emphasizing the significance of the kissing number problem in various fields.

Language bias stands as a noteworthy concern in Visual Question Answering (VQA), wherein models tend to rely on spurious correlations between questions and answers for prediction. This prevents the models from effectively generalizing, leading to a decrease in performance. To address this bias, we propose a novel modality fusion collaborative de-biasing algorithm (CoD). In our approach, bias is considered as the model’s neglect of information from a particular modality during prediction. We employ a collaborative training approach to facilitate mutual modeling between different modalities, achieving efficient feature fusion and enabling the model to fully leverage multi-modal knowledge for prediction. Our experiments on various datasets, including VQA-CP v2, VQA v2, and VQA-VS, using different validation strategies, demonstrate the effectiveness of our approach. Notably, employing a basic baseline model resulted in an accuracy of 60.14% on VQA-CP v2.

Daylighting has been widely adopted in recent years due to its potential to improve the indoor environment in terms of visual comfort and energy-saving. One of the energy-saving techniques for energy-efficient buildings is the integration of louver systems. Louvers are considered more efficient for providing daylight in the interior as compared to other daylighting systems. Here, this paper presents the design of a louver system for conducting energy simulations for lighting and cooling requirements in office spaces. The simulation results indicate that the use of louvers in different opening configurations can lead to energy savings, particularly in the lighting aspect. The louver system in office spaces with a 50% louver opening leads to 27.0% energy savings. Further, the results are presented for different louver openings to calculate the lighting and cooling energy savings. The overall performance of the system is better in terms of providing consistent daylight, which eventually improves energy saving.

In recent years, e-commerce platforms have replaced conventional marketplaces. People are rapidly adopting internet shopping due to the convenience of making purchases from the comfort of their homes. Online review sites allow customers to share their thoughts on products and services. Customers and businesses are increasingly relying on online reviews to assess and improve the quality of products. Existing literature uses Natural language processing (NLP) to analyze customer reviews for different applications. Due to the growing importance of NLP for online customer reviews, this study attempts to provide a taxonomy of NLP applications based on existing literature. This study also examined emerging methods, data sources, and research challenges by reviewing 154 publications from 2013 to 2023 that explore state-of-the-art approaches for diverse applications. Based on existing research, the taxonomy of applications divides literature into five categories: sentiment analysis, review analysis, customer feedback and satisfaction, user profiling, and marketing and reputation management. It is interesting to note that the majority of existing research relies on Amazon user reviews. Additionally, recent research has encouraged the use of advanced techniques like Bidirectional Encoder Representations from Transformers (BERT), Long Short-Term Memory (LSTM), and ensemble classifiers. The rising number of articles published each year indicates increasing interest of researchers and continued growth. This survey additionally addresses open issues, providing future directions in online customer review analysis.

Regarding landscape preferences for highways, there is a dynamic interaction between users and the variety of natural and cultural landscape elements along the roadside, reflecting a balance between the highway and the natural environment. However, the rapid pace of urbanization has accelerated the development of highways, leading to the neglect or destruction of valuable landscapes. This highlights the need for visual preference assessments to protect aesthetic and environmental values. Currently, there is a lack of comprehensive criteria for assessing the visual preference of highway landscapes. Therefore, this study aims to review existing literature and establish complete assessment criteria. This study conducted a systematic literature review by searching for keywords in three databases: Web of Science, Scopus, and Google Scholar. The review included 22 papers published between 2013 and 2023 that met the criteria. An additional four relevant papers were included through a “snowballing” approach to supplement the research and results. The results of the study focused on the relationships between highway landscapes and users, user preferences, preference methods, and related variables. These inter-established relationships were used to complete an assessment framework, which establishes a basic reference standard for professionals.

Leveraging the open-world understanding capacity of large-scale visual-language pre-trained models has become a hot-spot in point cloud classification. Recent approaches rely on transferable visual-language pre-trained models, classifying point clouds by projecting them into 2D images and evaluating consistency with textual prompts. These methods benefit from the robust open-world understanding capabilities of visual-language pre-trained models and require no additional training. However, they face several challenges summarized as prompt ambiguity, image domain gap, view weights confusion, and feature deviation. In response to these challenges, we propose PointBLIP, a zero-training point cloud classification network based on the recently introduced BLIP-2 visual-language model. PointBLIP is adept at processing similarities between multi-images and multi-prompts. We separately introduce a novel method for point cloud zero-shot and few-shot classification, which involves comparing multiple features to achieve effective classification. Simultaneously, we enhance the input data quality for both the image and text sides of PointBLIP. In point cloud zero-shot classification tasks, we outperform state-of-the-art methods on three benchmark datasets. For few-shot classification tasks, to the best of our knowledge, we present the first zero-training few-shot point cloud method, surpassing previous works under the same conditions and showcasing comparable performance to full-training methods.

"Mem u Zin" holds a paramount status in Kurdish literature, celebrated for its profound exploration of love. Authored by the esteemed Kurdish poet and writer Ahmet Khani in the 17th century, this epic masterpiece represents the pinnacle of literary achievement within the Kurdish cultural milieu. By conducting a concise analysis of "Mem u Zin," our aim was to shed light on the underlying factors that contribute to the perceived separation of Kurdish society from perfection. We provided a comprehensive view of the linguistic obstacles encountered by the Kurds in this exploration.

In the autonomous navigation of mobile robots, precise positioning is crucial. In forest environments with weak satellite signals or in sites disturbed by complex environments, satellite positioning accuracy has difficulty in meeting the requirements of autonomous navigation positioning accuracy for robots. This article proposes a binocular vision SLAM/UWB tightly coupled localization method. The core of this algorithm is based on an Extended Kalman Filter (EKF), which utilizes the displacement increment output by binocular vision ORB-SLAM and the positioning coordinates calculated via UWB positioning as measurement information to achieve data fusion. The research utilized the constructed experimental platform to collect images and UWB ranging data in outdoor environments and experimentally validated the combined positioning method. The experimental results show that this algorithm outperforms the use of the individual UWB or visual SLAM localization methods in terms of positioning accuracy. Compared with traditional single positioning algorithms, this algorithm exhibits better practicality and stability, and can effectively suppress the impact of UWB non line of sight errors. The average error under normal line of sight conditions is 0.058 m, the root mean square error (RMSE) is 0.080, and the average error under non-line-of-sight conditions is 0.081 m, with an RMSE of 0.084. There is no significant jump or drift. Through the tightly coupled processing of binocular vision SLAM and UWB positioning, more reliable and accurate mobile robot positioning can be achieved, providing a useful reference for the autonomous navigation of mobile robots in complex environments.

Tactics, Techniques, and Procedures (TTPs) constitute the most valuable aspect of Cyber Threat Intelligence (CTI). However, TTPs are often implicit in unstructured text, necessitating manual analysis by field experts. Automating the classification of TTPs from unstructured text is a crucial task in contemporary research. MITRE ATT&CK serves as the de facto standard for studying TTPs. Existing research constructs classification datasets based on its procedural examples for tactics and techniques. However, due to a significant proportion of small sample categories, a long-tail phenomenon exists, leading to a highly imbalanced sample distribution. Consequently, more research concentrates on categories with relatively abundant samples. This paper proposes a method that combines ChatGPT data augmentation with Instruction Supervised Fine-Tuning of open large language models. This approach offers a solution for TTPs classification in few-shot learning scenarios, achieving coverage of 625 technical categories. The Precision, Recall, and F1 scores reach 86.2%, 89.9%, and 87.3%, respectively.

This study investigates effective strategies for second language education in primary schools, analyzing the efficacy of immersive and interactive methods, digital literacy tools, and mixed-method approaches. The findings reveal significant improvements in language proficiency and student engagement through these methodologies, with immersive and interactive strategies showing substantial benefits in oral proficiency and engagement, digital tools enhancing accessibility and engagement, and mixed-method approaches yielding the highest overall effectiveness. The study underscores the importance of a balanced, flexible approach to language education, integrating traditional and modern methods to cater to diverse learner needs. These strategies not only advance linguistic skills but also contribute to the broader cognitive and emotional development of young learners, emphasizing the critical role of effective language education in preparing students for a globalized world.

This comprehensive study delves into the implementation and effectiveness of the flipped classroom model in engineering EMI (English as a Medium of Instruction) courses in Taiwan. Situated within the strategic framework of Taiwan's Bilingual Nation 2023 policy, this research aims to enhance the global competitiveness of Taiwan's semiconducting manufacturing engineering sector. The study’s primary focus is on understanding the perceptions and learning outcomes of EFL (English as a Foreign Language) students in engineering courses. Through a methodical approach using descriptive statistics and chi-square tests, the study analyzes data from 33 junior engineering students specializing in mechanical and mechatronic fields. The findings highlight a significant positive influence of the flipped classroom model on various aspects of student learning, including increased engagement, heightened creativity, and enhanced problem-solving skills. Additionally, the study emphasizes the critical role of timely L1 support in facilitating effective learning in EMI settings. These outcomes not only demonstrate the flipped classroom's viability as a sustainable educational approach but also provide crucial insights for educators and policymakers. By aligning cutting-edge teaching methods with the evolving needs of engineering education, this study contributes to the discourse on educational innovation. It ultimately guides the development of future engineering programs that cater to diverse student needs and fosters the cultivation of skilled engineering professionals.

This research delves into the realm of predictive modeling within artificial intelligence (AI) and introduces an innovative ensemble approach designed to enhance prognostic precision. The proposed methodology, characterized by its ebullient nature, leverages the collective wisdom of diverse predictive models, synthesizing a comprehensive and robust framework. The pursuit of parsimony are paramount, underscoring the need for efficient model architectures that balance predictive acuracy and computational efficiency. Our study meticulously explores the amalgamation of diverse algorithms, encapsulating the intrinsic complexity of real-world phenomena. We navigate the intricate landscape of feature selection, algorithmic diversity, and model combination, fostering a holistic understanding of the prognostic process. The ebullient ensemble emerges as a dynamic solution, harnessing the synergy of constituent models while mitigating the risk of overfitting. To validate the efficacy of our approach, extensive experiments are conducted on diverse datasets, spanning domains such as healthcare, finance, and natural language processing. Comparative analyses demonstrate the superior predictive performance of our ensemble model in comparison to individual algorithms and traditional ensemble methods. Additionally, we delve into interpretability aspects, elucidating the underlying mechanisms that contribute to the model's prognostic prowess. Our research advances the frontier of predictive modeling in AI, offering a nuanced and sophisticated paradigm for prognostication. The ebullient ensemble approach stands as a testament to the synergy achievable through the amalgamation of diverse predictive models, providing a pragmatic and parsimonious avenue for enhanced prognostic acuracy in artificial intelligence applications.

Indoor comfort is a critical determinant of the holistic educational experience, significantly influencing the well-being, concentration, and performance of students within the confines of school environments. Despite the widespread implementation of heating, ventilation, and air conditioning (HVAC) systems in educational institutions, achieving satisfactory thermal conditions, acceptable acoustics, and optimal daylight levels for occupants continues to pose a considerable challenge. In this review, we specifically delves into the parameters characterizing Italian school environments, recognizing their direct impact on students’learning and concentration. The primary objectives of this review are conducting a thorough examination of the current acustic conditions in Italian schools. The initial phase of our search strategy involved retrieving data from key databases, namely, Scopus, Web of Science, ScienceDirect, PubMed, and Google Scholar. Following the elimination of duplicate articles (n = 289), a total of 135 distinct papers remained for analysis. A critical review of the existing literature is presented based on these criteria, offering guidelines and recommendations for forthcoming studies. The critical review underscores various shortcomings in the current design, deployment, and documentation of multi-domain studies, signaling the need for enhanced quality in future research efforts.

Cognitive Warfare (CogWar) is another form of warfare where the goal is to exploit cognition facets to disrupt, undermine, influence or modify human decisions. Famous examples include “Operation Gidlock” meddling with the US 2016 election, and CogWar campaigns assisting the annexation of Crimea. As Large Language Model(LLM)-based applications expand, reaching more users and their cognitive states, stealth Malicious Cognitive Behavioral Tactics (MCBT) can be embedded in trusted application sessions to systematically profile, then alter, each individual’s cognition over time. Successful MCBT can create more cases like Snowden, mass shootings, or January6. This short-form paper discusses a novel MCBT threat model, a novel kill chain, and an on-going prototype for demonstration.

We review the literature on medical discourse and attempt to build a computational model of it. Medical discourse sheds a light on communication structure of patient-doctor and other communication scenarios in healthcare and should be leveraged to facilitate and automate this communication when it is possible and practical. We propose a unified framework to represent communication discourse at the meta-level, where the subject of the communication is expressed in a language object. So far, the broad range of work on medical discourse is detached from computational discourse analysis, and we explore the possibilities of filling this gap and computationally treat the peculiarities of how information is passed between the agents in a hospital setting. We select the domain of question answering (QA) against a corpus of medical documents of diverse nature to evaluate our computational model of medical discourse. It turns out that applying specific structures obtained in medical discourse studies improves the relevance and efficiency of question answering.

This study was aimed to assess visual performance and overall satisfaction of extended depth of focus (EDOF) contact lenses (CLs) in a presbyopic population. We prospectively investigated visual acuity at all distances (0.3, 0.4, 0.5, 0.7, 1, and 5 m), higher-order aberrations (HOAs), contrast sensitivity function, and, overall satisfaction score, before and during EDOF CL wear. Binocular visual acuity at 0.3, 0.5, 0.7, 1, 2, 3, and 5 m when wearing EDOF CLs was 0.01 ± 0.14, -0.08 ± 0.02, -0.08 ± 0.02, -0.08 ± 0.00, -0.08 ± 0.00, -0.08 ± 0.02, and -0.07 ± 0.02, respectively. We found a significant improvement at near to intermediate distances (0.3, and 0.5 m), but no significant change at intermediate to far distances (0.7, 1, 2, 3, and 5 m) between before and during CL wear. The area under the log contrast sensitivity function was not significantly changed neither under photopic nor mesopic conditions (p=0.099, and p=0.689). Ocular third-order aberrations, fourth-order aberrations or total HOAs for a 4-mm pupil significantly increased. The overall satisfaction score significantly improved by wearing EDOF CLs. EDOF CLs significantly improved visual acuity at near to intermediate dis-tances, while maintaining far vision, and the effect of contrast sensitivity was minimal, suggesting its viability of presbyopic correction in such candidates.

This study presents a novel approach to enhance Large Language Models (LLMs) like Alpaca by dynamically integrating real-time information. This method addresses the issue of content hallucination and data relevancy by automatically collecting and integrating current data from credible sources into model prompts. Experiments show a significant improvement in accuracy and a decrease in content hallucination, with a manageable increase in response time. The research underscores the potential of real-time data integration in making LLMs more accurate and contextually relevant, setting a foundation for future advancements in dynamic data processing in AI.

The visual perception of leisure spaces between residences in cold regions is important for public health. To compensate for the existing researches` lack of ignoring the cold snow season`s influence, this study selected two types of outdoor leisure space environments in non-snow and snow seasons as research objects. An eye tracker combined with a Semantic Difference (SD) questionnaire was used to verify the feasibility of the application of virtual reality technology, screen out leisure gaze characteristics, and reveal the environmental factors related to leisure visual perception. In snow season, spatial aspect ratio (SAR), building elevation saturation (BS), and grass proportion in the field of view (GP) showed strong correlation to the leisure visual perception scores (W). In non-snow season, apart from the above three factors, roof height difference (RHD), tall tree height (TTH) and color contrast (HC) also influenced W obviously. The effects of factors on W were revealed in immersive virtual en-vironment (IVE) orthogonal experiments and genetic algorithm (GA) and k-nearest neighbor algorithm (KNN) were combined to optimized the environmental factors. The optimized threshold ranges in the non-snow season environment were SAR: 1.82‒2.15, RHD: 10.81 m‒20.09 m, BS: 48.53‒61.01, TTH: 14.18 m‒18.29 m, GP: 0.12‒0.15, and HC: 18.64‒26.83. In the snow season environment, the optimized threshold ranges were SAR: 2.22‒2.54, BS: 68.47‒82.34, and GP: 0.1‒0.14.

We investigated how Artificial Intelligence (AI) reveals factors shaping COVID-19 vaccine hesitancy among healthcare providers by examining their open-text comments. We conducted a longitudinal survey starting in spring of 2020 with 38,788 current and former female nurses in three national cohorts to assess how the pandemic has affected their livelihood. In January and March-April 2021 surveys, participants were invited to contribute open-text comments and answer specific questions about COVID-19 vaccine uptake. A closed-ended question in the survey identified vaccine-hesitant (VH) participants who either had no intention or were unsure of receiving a COVID-19 vaccine. We collected 1,970 comments from VH participants and trained two Machine Learning (ML) algorithms to identify behavioral factors related to VH. The first predictive model classified each comment into one of three Health Belief Model (HBM) constructs (barriers, severity, and susceptibility) related to adopting disease prevention activities. The second predictive model used the words in January comments to predict the vaccine status of VH in March-April 2021; vaccine status was correctly predicted 89% of the time. Our results showed that 35% of VH participants cited barriers, 17% severity, and 7% susceptibility to receiving a COVID-19 vaccine. Out of the HBM constructs, the VH participants citing a barrier, such as allergic reactions and side effects, had the most associated change in vaccine status from VH to later receiving a vaccine.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.