With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

The abundance of information in academic articles, reports, and studies can make it challenging for researchers to gain insights from the existing literature. To address this issue, there is a growing demand for tools that can help researchers effectively parse and analyze large volumes of data. One such tool is DataDiscoveryLab, a software system that utilizes computer vision algorithms and NLP techniques to parse academic articles into text and figures, creating three separate databases. These databases allow researchers to quickly identify articles that may be relevant to their research questions, gain a deeper understanding of the research presented, and analyze visual data. The integration of article mining and computer vision in the DataDiscoveryLab software system provides researchers with a powerful tool for navigating the vast amount of scientific literature available today. Yet, as we will discuss in the latter papers these databases’ purpose is to create a bridge between researchers’ data and practically unlimited scientific publications. Yet, in this article, we will discuss how we plan to do that, and our efforts on integrating deep learning modes. After all, unlike already existing AI models, DataDiscoveryLab can be their combination and the first Generative AI in academia that can encompass every part of the natural sciences.

This paper presents ROSGPT, an innovative concept that harnesses the capabilities of large language models (LLMs) to significantly advance human-robot interaction. We develop ROSGPT as a ROS2 package that seamlessly integrates ChatGPT with ROS2-based robotic systems. The core idea is to leverage prompt engineering with LLMs, specifically ChatGPT, utilizing its unique properties such as ability eliciting, chain-of-thought, and instruction tuning. The concept employs ontology development to convert unstructured natural language commands into structured robotic instructions specific to the application context through prompt engineering. We capitalize on LLMs' zero-shots and few-shots learning capabilities by eliciting \textit{structured} robotic commands from \textit{unstructured} human language inputs. To demonstrate the feasibility of this concept, we implemented a proof-of-concept that integrates ChatGPT with ROS2, showcasing the transformation of human language instructions into spatial navigation commands for a ROS2-enabled robot. This versatile concept can be easily adapted to various other robotic missions. ROSGPT serves as a new stride towards Artificial General Intelligence (AGI) and paves the way for the robotics and natural language processing communities to collaborate in creating novel, intuitive human-robot interactions. The open-source implementation of ROSGPT on ROS 2 is available on GitHub.

Cerebellar mutism syndrome (CMS), also known as posterior fossa syndrome, is encountered in a subset of children who have undergone an operative procedure of the posterior cranial fossa, mainly involving the vermis, and the most frequent underlying pathology is proved to be medulloblastoma. The most common characteristics of this syndrome include an often transient, although protracted, language impairment, emotional lability, along with cerebellar, and brainstem dysfunction. Nevertheless, a significant number of patients experience persistent neurological deficits and lasting neurocognitive impairment. A lot of research and clinical studies have been performed in order to better delineate this syndrome. The main obstacles in our way to highlight all aspects of this syndrome were related with an inconsistent nomenclature, poorly defined diagnostic criteria, and uncertainty surrounding risk factors and etiology. Currently, there is a combination of diagnostic criteria that are regarded as prerequisites in order to establish the diagnosis of CMS. These include language impairment and emotional lability, as proposed by the international Board of the Posterior Fossa Society in their consensus statement. Several risk factors are recognized as implicated in the pathogenesis of this syndrome, including midline tumor location, diagnosis of medulloblastoma, younger age at diagnosis, and preoperatively established language impairment. A proposed etiology of CMS includes disruption of the cerebellar outflow tracts, the cerebellar nuclei, and their efferent projections through the superior cerebellar peduncle. Specific treatment for CMS is lacking, and it continues to be directed at symptom management. Our aim is to present a comprehensive narrative review of CMS etiology, diagnosis, risk factors, clinical presentation, and clinical management. Moreover, we attempt to recognize the most widely recognized priorities of the research community in order to expand our knowledge in the era of diagnostics, prevention, and therapeutic options for patients suffering from CM, or who are at risk for development of this syndrome.

The ability to identify and rank risk is essential for efficient and effective supervision of financial service firms, such as banks and insurers. Risk ranking ensures limited resources are allocated where they are most needed. Today, automatic risk identification within insurance supervision primarily relies on quantitative metrics based on numerical data (e.g. returns). The purpose of this work is to assess whether Natural Language Processing (NLP) and cognitive networks can achieve similar automated risk ranking and identification by analysing textual data, i.e. NIDT=829 investor transcripts from Bloomberg. To this aim, this work explores and tunes 3 NLP techniques: (1) keyword extraction enhanced by cognitive network analysis; (2) valence/sentiment analysis; and (3) topic modelling. Results highlight that keyword analysis, enriched by term frequency-inverse document frequency scores and semantic framing through cognitive networks, could detect events of relevance for the insurance system like cyber-attacks or the COVID-19 pandemic. Cognitive networks were found to highlight events that related to specific financial transitions: The semantic frame of "climate" grew in size by +538% between 2018 and 2020 and outlined an increased awareness that agents and insurers expressed towards climate change. A lexicon-based sentiment analysis achieved a Pearson’s correlation of ρ=0.16 (p<0.001,N=829) between sentiment levels and daily share prices. Although relatively weak, this finding indicates that insurance jargon is insightful to support risk supervision. Topic modelling is considered less amenable to support supervision, because of a lack of results’ stability and an intrinsic difficulty to interpret risk patterns. We discuss how these automatic methods could complement existing supervisory tools in automated risk ranking.

The classification of goods involved in international trade in Brazil is based on the Mercosur Common Nomenclature (NCM). The classification of these goods represents a real challenge due to the complexity involved in assigning the correct category codes especially considering the legal and fiscal implications of misclassification. This work focuses on the training of a classifier based on Bidirectional En-coder Representations from Transformers (BERT) for the tax classification of goods with NCM codes. In particular, this article presents results from using a specific Portuguese Language tuned BERT model as well results from using a Multilingual BERT. Experimental results justify the use of these models in the classification process and also that the language specific model has a slightly better performance.

Thanks to rapid development of artificial intelligence technology in recent years, the current artificial intelligence technology is contributing to many part of society. Education, environment, medical care, military, tourism, economy, politics, etc. are having a very large impact on society as a whole. For example, in the field of education, there is an artificial intelligence tutoring system that automatically assigns tutors based on student's level. In the field of economics, there are quantitative investment methods that automatically analyze large amounts of data to find investment laws to create investment models or predict changes in financial markets. As such, artificial intelligence technology is being used in various fields. So, it is very important to know exactly what factors have an important influence on each field of artificial intelligence technology and how the relationship between each field is connected. Therefore, it is necessary to analyze artificial intelligence technology in each field. In this paper, we analyze patent documents related to artificial intelligence technology. We propose a method for keyword analysis within factors using artificial intelligence patent data sets for artificial intelligence technology analysis. This is a model that relies on feature engineering based on deep learning model named KeyBERT, and using vector space model. A case study of collecting and analyzing artificial intelligence patent data was conducted to show how the proposed model can be applied to real-world problems.

Existing implementations of game design patterns have largely been confined to theoretical or research settings. Weaknesses in these implementations have prevented game design patterns from being properly evaluated as an educational and practical development tool. This paper examines these weaknesses, describes a method of developing and applying patterns that overcome the weaknesses, and evaluates use of the method for game design education and practice. Weaknesses in existing pattern implementations are: omission of design problems, presumption of functional completeness at the level of pattern languages, narrow topical focus, and lack of a concise, repeatable method for pattern production. Several features of the proposed method were specifically built to address these weaknesses, namely the pattern template, the process for connecting patterns into a language and assessing the language’s scope, a rubric for assessing pattern confidence and interconnectivity confidence, and pattern-building exercises. This method was applied in a classroom setting. Results, as assessed by the evaluation of student work, suggest that creating patterns/pattern languages is an effective pedagogical approach. De-signs produced using designer-created patterns closely align with existing design theory and are clearly understood by students. The above results may indicate that the path to gaining wider acceptance of pattern theory as a design framework within game design is not to produce a universal pattern language but to facilitate the creation of case-specific languages, by students and professional designers, that use a shared ontology and thus can be combined easily to solve the diverse sets of problems faced by these groups.

Currently the integration of Kazakhstan into the world community requires the training of highly qualified specialists fluently speaking and having a good command of foreign language. The study is devoted to the problem of development of foreign language professional skills of students of non-linguistic specialty. The aim of the research is to identify the efficiency of integrated approach use for shaping foreign language communicative skills of non-linguistic specialty students. The methodological basis of the research was communicative approach to foreign language teaching. In the framework of the research scientific and theoretical literary sources on the problem of the development of foreign language professional skills of non-linguistic specialty students were studied and summarized; the analysis of the empirical material obtained in the questioning and testing of students. To determine the level of formation of foreign language professional competence of international relations specialty students we have developed the following components: linguistic, cognitive, pragmatic. In the course of the experimental study, the authors revealed that the use of problem-based methods such as discussion, project and case technologies, debates in the framework of integrated approach to professional foreign language teaching promote students’ motivation increase and contribute to the improvement of their foreign language professional skills. The results of the study can be used in application of CLIL technology for the formation of foreign language professional competence of non-linguistic specialty students at the university.

Electronic health records (EHRs) are becoming a vital source of data for healthcare quality improvement, research, and operations. However, much of the most valuable information contained in EHRs remains buried in unstructured text. The field of clinical text mining has advanced rapidly in recent years, transitioning from rule-based approaches to machine learning and, more recently, deep learning. With new methods come new challenges, however, especially for those new to the field. This review provides an overview of clinical text mining for those who are encountering it for the first time (e.g. physician researchers, operational analytics teams, machine learning scientists from other domains). While not a comprehensive survey, it describes the state of the art, with a particular focus on new tasks and methods developed over the past few years. It also identifies key barriers between these remarkable technical advances and the practical realities of implementation at health systems and in industry.

On review of neuroscience literature extreme capsule considered as a whiter matter tract. Nevertheless it is not clear that extreme capsule itself is a association fiber pathway or is o bottleneck for passing other association fiber. By a systematic search with investigating anatomical position, dissection, connectivity and cognitive role of extreme capsule it can be argued that extreme capsule probably is a bottleneck for passing uncinated fasciculus (UF) and inferior fronto – occipital fasciculus(IFOF), And its different role of language processing is duo to different tract that passing it.

Social media gives researchers an invaluable opportunity to gain insight into different facets of human life.Researchers put a great emphasis on categorizing the socioeconomic status (SES) of individuals to help predict various findings of interest. Forum uses, hashtags and so on are common tools of conversations grouping. On the other hand, crowdsourcing is a concept that involves gathering intelligence to group online user community based on common interest. This paper provides a mechanism to look at writings on social media and group them based on their academic background. We build upon earlier work where we analyzed online forum posts from various geographical regions in the USA and Canada and characterized the readability scores of such users. Specifically, we collected 1000 tweets from the members of the US Senate and computed the Flesch-Kincaid readability score for the Senators. Comparing the Senators’ tweets to the ones from average citizens, we note the following. 1) US Senators’ readability based on their tweets rate is much higher affirming the gap between the academic performance of US Senators and their average citizen, and 2) the immense difference among average citizen’s score compared to those of US Senators is attributed to the wide spectrum of academic attainment.

This review and meta-analysis (PROSPERO registration number: CRD42020138845) critically evaluates test-retest reliability, concurrent validity and criterion validity of different physical activity (PA) levels of three most-common used international PA questionnaires (PAQs) in national language versions of EU-28: IPAQ-SF, GPAQ, and EHIS-PAQ. In total, 4969 abstracts were read, 287 full-text articles were identified as relvant to the study objectives, and 19 studies were included in the final meta-analysis. The studies’ results and quality were evaluated using the Quality Assessment of Physical Activity Questionnaires (QAPAQ) checklist. Results indicate that only five EU-28 countries validated national language versions of selected PAQs. Meta analysis revealed that assessment of moderate-to-vigourus PA (MVPA) is the most relevant PA level outcome, since no publication bias in any of measurement properties was detected while test-retest reliability was the moderately-high (rw=0.74), and moderate for both criterion (rw=0.41) and concurrent validity (rw=0.72). Reporting of methods and results of the studies was poor with overall moderate risk of bias with total score of 0.43. In conclusion, where only self-reporting is feasible, assessment of MVPA with selected PAQs in EU-28 adult population is recommended for policymaking.

A novel method for finding linear mappings among word embeddings for several languages, taking as pivot a shared, universal embedding space, is proposed in this paper. Previous approaches learn translation matrices between two specific languages, but this method learn translation matrices between a given language and a shared, universal space. The system was first trained on bilingual, and later on multilingual corpora as well. In the first case two different training data were applied; Dinu’s English-Italian benchmark data, and English-Italian translation pairs extracted from the PanLex database. In the second case only the PanLex database was used. The system performs on English-Italian languages with the best setting significantly better than the baseline system of Mikolov et al. [1], and it provides a comparable performance with the more sophisticated systems of Faruqui and Dyer [2] and Dinu et al. [3]. Exploiting the richness of the PanLex database, the proposed method makes it possible to learn linear mappings among an arbitrary number of languages.

Objective: To evaluate the effects of left intraparietal sulcus (IPS) inhibition by repetitive transcranial magnetic stimulation (rTMS) on grip force modulation (GFM) for both hands during a unimanual task. Methods: GFM induced by manual action-verb listening was evaluated for each hand in a unimanual task, and the motor-evoked potentials (MEP) were recorded for both left and right hemispheres prior to and following the left IPS inhibition. Left IPS inhibition was obtained by rTMS (5 min of 1.0 Hz, 60% of maximal stimulator output) of the international 10–20 system P3 point. Seven healthy right-handed subjects were evaluated. Results: One-way repeated measures ANOVA found that MEP amplitude and duration increased following IPS inhibition in the left hemisphere and did not change in the right hemisphere. Language-induced modulation did not change in the left hemisphere, while it was significantly attenuated in the right hemisphere. Since IPS inhibition increased the left primary motor cortex (M1) excitability, the maintenance of language-induced modulation intensity suggests it was also attenuated. Conclusion: Left IPS inhibition increased left M1 excitability without changing right M1 excitability, while attenuating the language-induced GFM for both the left and right hands.

Software engineers from all over the world solve independently a lot of similar problems. In this condition the problem of code or even better architecture reusing becomes an issue of the day. In this paper two phase approach to determining the functional and structural likenesses of software projects is proposed. This approach combines two methods of artificial intelligence: natural language processing techniques with a novel method for comparing software projects based on ontological representation of their architecture automatically obtained from the projects source code. Additionally several similarity metrics are proposed to estimate similarity between projects.

In the extensive monitoring of maritime traffic, maritime management frequently encounters incomplete automatic identification system (AIS) data, particularly in critical static fields like vessel types. This shortfall presents substantial challenges in safety management, necessitating robust methods for data completion. Distinct from road traffic, where road width imposes constraints, maritime vessels of identical classifications often choose significantly divergent routes, deviating by several nautical miles. Sole dependence on trajectory clustering is insufficient. Addressing this issue, we segments the maritime area into spatiotemporal grids, transforming vessel paths into sequences of grid encodings. Utilizing natural language processing techniques, we integrate the Word2vec word embedding approach with our novel biLSTM self-attention chunk-max pooling net (biSAMNet) model, enhancing the classification of vessel trajectories. This method is crucial for determining static details like vessel types. Employing the Taiwan Strait as a case study and benchmarking against CNN, RNN, and methods based on the attention mechanism, our findings underscore our model’s superiority. The biSAMNet achieves an impressive vessel classification F1 score of 0.94, using only 5-dimensional word embeddings, highlighting the effectiveness of Word2vec pre-trained embedding layers. This research introduces a novel paradigm for processing vessel trajectory data, greatly enhancing the accuracy of filling in incomplete vessel type details.

Artificial intelligence methods, especially artificial neural networks (ANNs), have recently been successfully used more and more frequently in the mathematical description of physical phenomena in the processing of metallic materials. Results based on measured data of phenomena in real production are often, at least locally, different or more complex than the results of established theories. In general, ANN models, which mostly work as "black boxes", allow us to improve production efficiency by themselves. The fact is, however, that a better understanding of the phenomena under consideration, which is otherwise enabled by classical mathematical approaches in the form of explicit mathematical formulas, could ensure even greater efficiency. In this article, therefore, a general concept is proposed to explain the discussed phenomena in metallic materials. The application of the concept is illustrated on the example of hot extrusion of aluminum alloy 6082, where CAE is used as an artificial neural network to model the phenomenon and predict the key parameters of the phenomenon. ChatGPT is used to explain the results according to the proposed concept. The basic idea is to enable practicing engineers to better understand the considered phenomena and results obtained by ANNs.

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

This study explores the Experience Economy dimensions within fishing tourism, adopting a data science perspective by employing web crawling for extensive data gathering on reviewer profiles from TripAdvisor. Utilizing Natural Language Processing (NLP) techniques, it scrutinizes the relationship between Experience Economy dimensions and user profiling aspects. Findings reveal "Entertainment" as the predominant dimension in tourist reviews, followed by "Aesthetic," "Educational," and "Escapist." Particularly notable are the frequent co-occurrences of "Entertainment"-"Aesthetic" and "Educational"-"Entertainment" pairs. The practical implications underscore the potential socioeconomic benefits of fishing tourism for local communities and fishermen, emphasizing the necessity for governmental support in terms of infrastructure, leadership, legislation, and financial backing to foster sustainable development in this sector. Notably, this research stands as a pioneering effort in its focus on Experience Economy dimensions and user profiling within the context of fishing tourism, drawing data from business pages and user profiles.

Videogames have been the focus of research since their widespread popularity, with particular emphasis on their effects on cognitive and affective abilities, especially in children and adolescents. Despite numerous correlational studies, robust evidence on the causal relationship between videogames and cognition remains scarce, hindered by the absence of a comprehensive assessment tool for gaming skills across various genres. This study aimed to develop and validate the Gaming Skill Questionnaire (GSQ) and to assess the impact of gaming skills in six different genres (Sport, First-Person Shooters, Role-Playing Games, Action-Adventure, Strategy, and Puzzle Games) on adolescents’ cognitive and affective abilities. The GSQ exhibited strong reliability and validity, highlighting its potential as a valuable tool. Gaming skills positively affected executive function, memory, overall cognition, cognitive flexibility, and emotion recognition, except for empathy. Various game genres had different effects on cognitive and affective abilities, with verbal fluency influenced mainly by sports, executive functions by action, strategy, and puzzle, and emotion recognition positively impacted by action and puzzle but negatively by sports and strategy games. Both age and gaming skills influenced cognitive flexibility, with gaming having a greater effect. These intriguing genre-specific effects on cognitive and affective functioning postulate further research with GSQ's contribution.

The field of program classification, a critical aspect of software engineering, facilitates understanding and categorization of code across various applications, including anomaly detection, and code quality assessment. The advancement of cross-language program classification opens up avenues for efficient code translation among different programming languages, significantly aiding developers in rapid coding and reducing development cycles. Existing research primarily focuses on semantic code analysis, with limited emphasis on cross-linguistic challenges. To address this, we introduce an innovative neural network model, CodeSemanticsNN, which leverages a refined Syntax Structure (SS) approach. This model consists of two integral mechanisms: first, it adopts a novel SS representation that combines sequential and graph-based SS structures, enhancing semantic feature capture. Second, it employs a 'unified vocabulary' strategy to bridge the gap between diverse programming languages, facilitating efficient cross-language classification. Additionally, we have compiled a comprehensive dataset of 20,000 files spanning five programming languages, serving as a benchmark for cross-language classification. Our experiments on this dataset demonstrate that CodeSemanticsNN surpasses existing models in four key metrics: Precision, Recall, F1-score, and Accuracy.

Cardiovascular and cerebrovascular disease incidence has risen mainly due to poor control of preventable risk factors and still constitutes a significant financial and health burden worldwide. ChatGPT is an artificial intelligence language-based model developed by OpenAI. Due to the model’s unique cognitive capabilities beyond data processing and the production of high-quality text, there has been a surge of research interest concerning its role in the scientific community and contemporary clinical practice. To fully exploit ChatGPT's potential benefits and reduce its possi-ble misuse, extreme caution must be taken to ensure its implications ethically and equitably. In this article, we explore the language model's possible applications and limitations while empha-sizing its potential value for diagnosing, managing, and prognosis cardiovascular and cerebro-vascular disease.

This study leverages transformer-based models and focuses on data representation strategies in the named entity recognition task, including "single" (one sentence per vector), "merged" (multiple sentences per vector), and "context" (sentences joined with attention to context). Performance analysis reveals that models trained with a single strategy may not perform well on different data representations. A combined training procedure is proposed to address this limitation, using all three strategies to enhance the stability and adaptability of the model. The results of this approach are presented and discussed for various datasets for four languages (English, Polish, Czech, and German), demonstrating the effectiveness of the combined strategy.

In the realm of mathematics education, self-explanation stands as a crucial learning mechanism, allowing learners to articulate their comprehension of intricate mathematical concepts and strategies. As digital learning platforms grow in prominence, there are mounting opportunities to collect and utilize mathematical self-explanations. However, these opportunities are met with challenges in automated evaluation. Automatic scoring of mathematical self-explanations is crucial for preprocessing tasks, including the categorization of learner responses, identification of common misconceptions, and the creation of tailored feedback and model solutions. Nevertheless, this task is hindered by the dearth of ample sample sets. Our research introduces a semi-supervised technique using the Language Learning Model (LLM), specifically its Japanese variant, to enrich datasets for the automated scoring of mathematical self-explanations. We rigorously evaluated the quality of self-explanations across five datasets, ranging from human-evaluated originals to ones devoid of original content. Our results show that combining LLM-based explanations with mathematical material significantly improves the model's accuracy. Interestingly, there's an optimal limit to how much synthetic self-explanation data can bene-fit the system. Exceeding this limit doesn't further improve outcomes. This study thus highlights the need for careful consideration when integrating synthetic data into solutions, especially within the mathematics discipline.

This paper proposes the utilization of large language models as recommendations systems for museums. Since the aforementioned models lack the notion of context, they can’t work with temporal information that is often present in recommendations for cultural environments (e.g. special exhibitions or events). In this respect, the current work aims at enhancing the capabilities of large language models through a fine-tuning process that incorporates contextual information and user instructions. The resulting models are expected to be capable of providing personalized recommendations, aligned with user preferences and desires. More specifically, Generative Pre-trained Transformer 4, a knowledge-based large language model is fine-tuned and turned into a context-ware recommendation system, adapting its suggestions based on user input and specific contextual factors such as location, time of visit, and other relevant parameters. The effectiveness of the proposed approach is evaluated through certain user studies, which ensure an improved user experience and engagement within the museum environment.

In an era of global connectivity, language and literature education faces the challenge of navigating multilingualism, cultural diversity, and technological advancements. This paper explores the challenges and opportunities in language and literature education in the era of global connectivity. Through a qualitative research approach, interviews, focus group discussions, and classroom observations were conducted with 30 Arts and Sciences students and teachers. The findings reveal significant themes related to cultural diversity, multilingualism, and the integration of technology in language learning. The study emphasizes the importance of inclusive pedagogies, critical thinking development, and the incorporation of authentic and diverse literary works. Recommendations are provided for educators and policymakers to promote intercultural understanding and enhance language and literature education. The limitations of the study suggest areas for future research, including long-term language proficiency and diverse contextual considerations. Overall, this paper calls for ongoing innovation and collaboration to meet the evolving needs of language and literature education in an interconnected world.

Dialogue State Tracking is an essential component in multi-domain dialogue systems, aiming to accurately determine the current dialogue state based on the dialogue history. Existing research has addressed the issue of multiple mappings in dialogues by employing slot self-attention as a data-driven approach. However, learning the relationships between slots from a single sample has limitations and introduces noise. In this paper, we propose an External Slot Relation Memory-based Dialogue State Tracking model (ER-DST). By utilizing an external memory storage, we learn the relationships between slots as a dictionary of multi-domain slot relations. Additionally, we employ a small filter to discard slot information irrelevant to the current dialogue state. Experimental results on the MultiWOZ2.0 and MultiWOZ2.1 benchmarks demonstrate significant improvements while reducing the time complexity to O(n).

In recent years, the rise of advanced artificial intelligence technologies has had a profound impact on many fields, including education and research. One such technology is ChatGPT, a powerful large language model developed by OpenAI. This technology offers exciting opportunities for students and educators, including personalized feedback, increased accessibility, interactive conversations, lesson preparation, evaluation, and new ways to teach complex concepts. However, ChatGPT poses different threats to the traditional education and research system, including the possibility of cheating on online exams, human-like text generation, diminished critical thinking skills, and difficulties in evaluating information generated by ChatGPT. This study explores potential opportunities and threats that ChatGPT poses to overall education from the perspective of students and educators. Furthermore, for programming learning, we explore how ChatGPT helps students improve their programming skills. To demonstrate this, we conducted different coding-related experiments with ChatGPT, including code generation from problem descriptions, pseudocode generation of algorithms from texts, and code correction. We also verified the generated codes with an online judge system to evaluate their accuracy.

Background and Purpose: Open-source Artificial intelligence (AI) applications are fast transforming access to information and allow students to prepare assignments and offer quite accurate responses to a wide range of exam questions which are routinely used in assessments of students across the board including undergraduate dental students. This study aims to evaluate the performance ChatGPT, an AI-based application, on a wide range of dental assessments and discusses the implications for undergraduate dental education. Methods: This was an exploratory study investigating the accuracy of ChatGPT to attempt a range of recognized assessments in undergraduate dental curricula. ChatGPT was used to attempt ten items based on each of the five commonly used question formats including single-best answer (SBA) multiple-choice questions (MCQs); short answer questions (SAQs); short essay questions (SEQs); True/False questions and fill in the blanks items. In addition, ChatGPT was used to generate reflective reports based on multisource feedback (MSF); research methodology; critical appraisal of the literature. Results: ChatGPT application provided accurate responses to majority of knowledge-based assessments based on MCQs, SAQs, SEQs, Tue/False and fill in the blanks items. However, it was only able to answer text-based questions and did not allow processing of questions based on images. Responses generated to written assignments were also of good quality apart from those for critical appraisal of literature. Word count was the key limitation observed in outputs by ChatGPT as it was only able to produce reports limited to approximately 650 words. Conclusion: Notwithstanding their current limitations, AI-based applications have the potential to revolutionize virtual learning. Instead of treating it as a threat, dental educators need to adapt teaching and assessments in dental education to the benefits of the learners whilst mitigating against dishonest use of AI-based applications.

Background: This study presents a graph-based and purely structural analysis to detect echo chambers on Twitter. Echo chambers are a concern as they can spread misinformation and reinforce harmful stereotypes and biases in social networks. Methods: The study recorded the German-language Twitter stream over two months, recording about 180.000 accounts and their interactions. The study focuses on retweet interaction patterns in the German-speaking Twitter stream and found that the greedy modularity maximization and HITS metric are the most effective methods for identifying echo chambers. Results: The purely structural detection approach was able to identify an echo chamber (red community) that was focused on a few topics with a triad of Anti-Covid, right-wing populism, and pro-Russian positions (very likely reinforced by Kremlin-orchestrated troll accounts). In contrast, a blue community was much more heterogeneous and showed "normal" communication interaction patterns. Conclusions: The study highlights the effects of echo chambers as they can make political discourse dysfunctional and foster polarization in open societies. The presented results contribute to identifying problematic interaction patterns in social networks often involved in the spread of disinformation by problematic actors. It is important to note that not the content but only the interaction patterns would be used as a decision criterion, thus avoiding problematic content censorship.

“A Picture is worth a thousand words”. Given an image, humans are able to deduce various cause-and-effect captions of past, current, and future events beyond the image. The task of visual commonsense generation aims at generating three cause-and-effect captions (1) what needed to happen before, (2) what is the current intent, and (3) what will happen after for a given image. However, such a task is challenging for machines owing to two limitations: existing approaches (1) directly utilize conventional vision-language transformers to learn relationships between input modalities, and (2) ignore relations among target cause-and-effect captions but consider each caption independently. We propose Cause-and-Effect BART (CE-BART) which is based on (1) Structured Graph Reasoner that captures intra- and inter-modality relationships among visual and textual representations, and (2) Cause-and-Effect Generator that generates cause-and-effect captions by considering the causal relations among inferences. We demonstrate the validity of CE-BART on VisualCOMET and AVSD benchmarks. CE-BART achieves SOTA performances on both benchmarks, while extensive ablation study and qualitative analysis demonstrate the performance gain and improved interpretability.

This paper investigates if Corporate Social Responsibility (CSR) reports published by a selected group of Nordic companies are aligned with the Global Reporting Initiative (GRI) standards. To achieve this goal, several natural language processing, and text mining techniques were implemented and tested. We extracted strings, corpus, and hybrid semantic similarities from the reports and evaluated the models through the intrinsic assessment methodology. A quantitative ranking score based on index matching was developed to complement the semantic valuation. The final results show that Latent Semantic Analysis (LSA) and Global Vectors for Word Representation (GloVE) are the best methods for our study. Our findings will open the door to the automatic evaluation of sustainability reports which could have a strong impact on the environment.

Background: In the present study, we assessed the feasibility and success outcomes of voice prosthesis (VP) changes when performed by speech-language pathologist (SLP). Methods: Patients treated with total laryngectomy (TL) from January 2020 to December 2020 were prospectively recruited from our medical center. Patients benefited from tracheoesophageal puncture. The VP changes were performed by the senior SLP and the following data were collected for each VP change: date of placement; change or removal; VP type and size; reason for change or removal; and use of a washer for periprosthetic leakage. A patient-reported outcome questionnaire including 6 items was proposed to patients at each VP change (Appendix 1). Items were assessed with a 10-point Likert-scale. Results: Fifty-two VP changes were performed by the senior SLP during the study period. The mean duration of the SLP consultation, including patient history, examination and VP change procedure was 20 min (range: 15-30). The median prosthesis lifetime was 88 days. The main reasons for VP changes were transprosthetic (N=34; 79%) and periprosthetic (N=7; 21%) leakages, respectively. SLP successfully performed all VP changes. He did not change one VP but used a periprosthetic silastic to stop the periprosthetic leakages. In two cases, SLP needed the surgeon examination to discuss about the following indication: implant mucosa inclusion and autologous fat injection. The patient satisfaction was high according to the speed and the quality of care by the SLP. Conclusion: The delegation of VP change from the otolaryngologist-head and neck sur-geon to the speech-language pathologist (SLP) may be done without significant complications. The delegation of VP change procedure to SLP may be interesting in some rural regions with otolaryngologist shortage.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

Abstract: Understanding social media networks and group interactions are crucial to the ad-vancement of linguistic and cultural behaviour. This includes the manner in which people ac-cessed advice on health, especially during the global lockdown periods. Some people turned to social media to access information on health where most activities were curtailed with isolation rules, especially for older generations. Facebook public pages, groups and verified profiles, using "senior citizen health", "older generations", and "healthy living" keywords were analysed over a 12-month period to analyse the engagement promoting good mental health. CrowdTangle was used to source English language status updates, photo and video sharing information which resulted in an initial 116,321 posts and 6,462,065 interactions Data analysis and visualisation were used to explore large datasets, including natural language processing for “Message” content discovery, word frequency and correlational analysis and co-word clustering. Preliminary results indicate strong links to healthy aging information shared on social media which showed correla-tions to global daily confirmed case and daily death totals. The results can be used to identify public concerns early on and address mental health issues in the senior generation on Facebook.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

What does the way autistics bypass, learn, and eventually master language tell us about humans’ genetically encoded linguistic ability? In this theoretical review, we argue that autistic non-social acquisition of language, as well as autistic savant abilities, provide a strong argument for an innate, human-specific orientation toward (and mastery of) complex embedded structures. Autistic non-social language learning may represent a widening of the material processed during development beyond oral language. Structure detection and manipulation and generative production of non-linguistic embedded and chained material (savant abilities in calendar calculation, musical composition and interpretation, three-dimensional drawing) may thus represent an application of such innate mechanisms to non-standard materials. Typical language learning through exposure to the child’s mother tongue may represent but one of many possible achievements of the same capacity. The deviation from typical language development in autism may ultimately allow access to oral language, sometimes in its most elaborate forms, but also explains the possibility of the absence of its development when applied exclusively to non-linguistic structured material. Such an extension of human capacities beyond, or in parallel to, their usual limits call into question what we consider to be specific or expected in humans and, therefore, does not necessarily represent a genetic “error”. Regardless of the adaptive success or failure of non-social language learning, it is up to science and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

Differentiated instruction has been implemented in classrooms where students who come from various backgrounds require appropriate lessons that are tailored to their varied learning preferences. As the spread of coronavirus 19 (Covid-19) is becoming more rampant, online learning has been lifted up as the main platform of teaching and learning, forcing the need to shift from the conventional face-to-face classroom to online, or virtual, mode of knowledge transfer. Having such global phenomenon affecting education, how does it affect the implementation of differentiated instruction that has been practised regularly by teachers before the wake of Covid-19? Previous studies have shown how it is done in the normal classroom setting, and that the practice of differentiated instruction contributes to students’ motivation as well as academic performance. However, there is a need to explore how do teachers go about with online differentiated instruction and how does it affect the students, since online learning poses various threads to both teachers and students; and thus, one might argue the effectiveness of not only the teaching approach but also the overall teaching and learning outcomes. Borg’s framework of teacher cognition, which has been extensively used in exploring how teachers teach, can be utilized to document the practice of online differentiated instruction. This study aimed to explore the practice of online differentiated instruction by teachers and examined its impact on students’ motivation and academic performance during the Covid-19 outbreak. The participants of this study consists of 247 gifted students from a public school in Malaysia. To meet these aims, this study employed a mixed method research design, utilizing the framework of teacher cognition to explore the teachers’ practice of online differentiated through interviews; and, utilizing a survey design using a questionnaire to determine the impact of online differentiated instruction towards students’ motivation and academic performance. The findings revealed that although online differentiated instruction is feasible, however, appropriate combination of differentiation constructs need to be applied in order to achieve higher motivation and better academic performance among the students.

What does the way autistics bypass, learn, and eventually master language tell us about human linguistic ability? Here, we argue that non-social acquisition of language, in addition to representing a strong argument for nativist models of human language, may be encompassed within the human-specific orientation and mastery of complex embedded structures, of which language represents one realization. Non-social language learning could thus represent the extension of available linguistic, and non-linguistic material processed by human genetic constraints, allowing language acquisition. This deviation from typical developmental language acquisition may ultimately allow access to language, sometimes in its most elaborate forms, and also explains the possibility of the absence of its development when applied to primarily non-linguistic structured material. However, such enlargement of material-specificity does not cast doubts about its human nature. Regardless of the adaptive success or failure of non-social language learning, it is up to science, legal policies, and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

This article presents a dataset of tweets in the Urdu language. There are 1,140,824 tweets in the dataset, collected from Twitter for September and October 2020. This large-scale corpus of tweets is generated by performing pre-processing which includes removing columns containing user information, retweet’s count, followers information, duplicate tweets, removing unnecessary punctuation, links, symbols, and spaces, and finally extracting emojis if present in the tweet text. In the final dataset each tweet record contains columns for tweet id, text, and emoji extracted from the text with a sentiment score. Emojis are extracted to validate Machine Learning models used for the multilingual sentiment and behavior analysis. These are extracted using a Python script that searches for an emoji from the list of 751 most frequently used emojis. If an emoji is present in the text, a column with the emoji description and sentiment score is added.

Motivated by the #Metoo movement, we explore in this paper people’s perception of female bullying at workplace. We looked at #workplacebullying and found that 1) people were split between identifying the prevalence of workplace bullying against female and the view that such bullying simply does not exist and is a nuisance, 2) The tweets also showed the existence of psychological effects of cyberbullying, and 3) the tweets showed many intervention techniques that can minimize the effects of such bullying. We further explored the top three recurring hashtags mentioned under the #workplacebullying and found that the three top hashtags were #sexism, #feminism and #equality. Our results showed that the above hashtags represent the positive and negative approach to workplace bullying i.e. #feminism hashtag was mostly used by people who denied that workplace bullying against females exist while # sexism was mentioned as the prime cause by people who agree that such bullying exist. #equality overwhelmingly comprises of techniques to minimize workplace bullying against females.

Exploiting the linguistic knowledge of the source language for neural machine translation (NMT) has recently achieved impressive performance on many large-scale language pairs. However, since the Turkish→English machine translation task is low-resource and the source-side Turkish is morphologically-rich, there are limited resources of bilingual corpora and linguistic information available to further improve the NMT performance. Focusing on the above issues, we propose a multi-source NMT approach that models the word feature in parallel to external linguistic features by using two separate encoders to explicitly incorporate linguistic knowledge into the NMT model. We extend the word embedding layer of the knowledge-based encoder to accommodate for each word’s linguistic annotations in the context. Moreover, we share all parameters across encoders to enhance the representation ability of the NMT model on the source language. Experimental results show that our proposed approach achieves substantial improvements of up to 2.4 and 1.1 BLEU scores in Turkish→English and English→Turkish machine translation tasks, respectively, which points to a promising way to utilize the source-side linguistic knowledge for the low-resource NMT.

The known three-component reaction-diffusion system modeling competition and co-existence of different language speakers is under study. A modification of this system is proposed, which is examined by Lie symmetry method; furthermore exact solutions in the form of traveling fronts are constructed and their properties are identified. Plots of the traveling fronts are presented and the relevant interpretation describing the language shift occurred in Ukraine during the Soviet times is suggested

Background and objectives: The language-induced grip force modulation (GFM) can be used to better understand the link between the language and motor functions as an expression of the embodied language. However, the contribution of each brain hemisphere to the language-induced GFM is still unclear. Using six different action verbs as stimuli, this study evaluated the GFM of the left hand in unimanual task to characterize the left- and right-hemisphere contributions. Materials and Methods: The left-hand GFM of 20 healthy consistent right-handers subjects was evaluated using the verbs “to write”, “to hold”, “to pull”(left-lateralized central processing actions), “to draw”, “to tie”, and “to drive” (bi-hemispheric central processing actions) as linguistic stimuli. The time between the word onset and the first interval of statistical significance regarding the baseline (RT) was also measured. Results: The six verbs produced language-induced GFM. The modulation intensity was similar for the six verbs, but the RT was variable. The verbs “to draw”, “to tie”, and “to drive”, whose central processing of the described action is bihemispheric showed a longer Rt compared to the other verbs. Conclusions: The possibility that an action is performed by the left-hand does not interfere with the occurrence of GFM when this action verb is employed as linguistic stimulus. Therefore, the language-induced GFM seems mainly rely on the left hemisphere, and the engagement of the right hemisphere seems to slow down the increase in the GFM intensity.

The violation of privacy, others people or personal, is a very current problem, which concerns not only on the web but also in private life. In the years 1990 it was expected that nowadays, that any routine operation was carried out "manually", and it would be performed through mobile phones or personal computers. The problem pertains the distribution network that allows to share and bring together information and as result the network becomes unsafe, if subjected to attacks. Nowaday we put personal information on web because otherwise we are seen as “weak”. This work aims to measure and analyze how much information are shared by users of a pre-established social network and it is carried out through a set of algorithms techniques of machine learning.

The language we use to describe the past can have a strong influence on the audience’s interpretation of our story. In our experiment, we explore, using 3 different conditions, how the framing and language of an accident report can affect the audience’s proposed solutions to manage the problems found. We find that the approach used to create an accident report can have a powerful influence on the audience’s decision making. Whether we are describing an accident in a similar manner to a crime, using a systems approach or we are accepting of multiple stories which are not linear or coherent, the methods we use to capture and communicate the story have a profound impact on the actions decided upon by the reader.

Humanity, culture, societal development and language issues are mutually reinforcing much as they are intricately interwoven in a non-ceasing dynamic interrelationships within the matrix defined by language standardization or development, acquisition and use that mostly take up central place as unifying and propelling forces in language discourse. Within the confines of globalization which is neither homogenization nor convergence; but the beginning of drawing on the strength of indigenous capabilities to create knowledge ecology that would enliven socio-economic and scientific development of the world in far reaching interconnectivities and relationships across every clime, issues pertaining to language development, acquisition and use become imperative. It is against this background that this paper examines the development/standardization, acquisition and use of Esan language as one of several Nigerian indigenous languages to promote scientific and technological development through knowledge creation, preservation and dissemination. The obsession of using western model and epistemological outlook to achieve appropriate scientific and technological development to the utter neglect of home grown and culturally distilled efforts were also examined. In the light of the dare consequences and the harsh conditions globalization imposes on developing nations, this paper highlights standardization and use of indigenous languages in chatting appropriate trajectory for effectual developmental efforts in fast shrinking contemporary world.

This paper presents an approach to the application of the Model-Based Systems Engineering (MBSE) and Model-Based Systems Architecting (MBSA) principles to develop a Model-Based Pattern Language (MBPL). It takes too long for systems engineers and architects to develop a new system from scratch, particularly new space-based systems derived from the existing space systems architectures. A pattern language is a holistic view of reusable logical model artifacts; many are interdisciplinary and introductory, if at all. The results are mostly a combination of the application-specific logical solution, which further results in the best possible overall solution. The main benefit of the pattern language is reducing the time and validation required to generate a new space-based system architecture; this approach will develop top-level requirements in the initial phase of the system development. The rationale of the methodology proposed by the paper is as follows, collect, and decompose published literature and other open-source information available on space system architectures and system models; develop SysML models for systems, subsystems, products, assembly, subassembly level, and mission-specific requirements using CAMEO SysML software. Arrange these patterns to develop a functional ontology and construct a logical architecture pattern library. This approach created, updated, and managed SysML pattern language, which evaluated the expedited new model construction. Again, our objective is to develop a logical pattern language using public domain information and evaluate patterns by constructing a new space mission concept—for example, planetary surface habitat.

Visualising textual content could be helpful to professionals as well as amateurs across several fields. However, training a text-to-image generator in the mainstream domain requires large amounts of paired text-image and data, which is too expensive to collect since labeling millions of images and videos can be tiresome. GANs like StackGAN and StyleGAN can be considered as solutions to generate images from text. But the images generated may be of low accuracy and resolution, and the entire processing can be highly time-consuming. Moreover, image generation is a notion that is still being researched. Hence, the process of developing a Video Generation model necessitates substantial research. Despite the need for such a model, modern technology has lagged behind the solutions to this problem. This proposal suggests combining two methods, Text modification for Action Definition (TexAD) and SeQuential Image Generation for Video Synthesis (SQIGen). The proposed solution synthesises a sequence of images from textual information feeds and combines these images to create a video. TexAD uses Natural Language Processing and Deep Learning techniques to process, classify and modify text data. SQIGen is an extension of the VQGAN+CLIP neural network architecture that generates a sequence of images from the modified text data

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

Interactions between proteins and ions are essential for various biological functions like structural stability, metabolism, and signal transport. Given that more than half of all proteins bind to ions, it becomes crucial to identify ion-binding sites. Accurate identification of protein-ion binding sites helps us to understand proteins’ biological functions and plays a significant role in drug discovery. While several computational approaches have been proposed, this remains a challenging problem due to the small size and high versatility of metals and acid radicals. In this study, we propose IonPred, a sequence-based approach that employs ELECTRA (Efficiently Learning an Encoder that Classifies Token Replacements Accurately) to predict ion binding sites using only raw protein sequences. We successfully fine-tuned our pretrained model to predict the binding sites for nine metal ions (Zn2+, Cu2+, Fe2+, Fe3+, Ca2+, Mg2+, Mn2+, Na+, and K+) and four acid radical ion ligands (CO32−, SO42−, PO43−, NO2−). IonPred surpassed six current state-of-the-art tools by over 44.65% and 28.46% respectively in F1 score and MCC when compared on an independent test dataset. Our method is more computationally efficient than existing tools producing prediction results for a hundred sequences for a specific ion in under ten minutes.

A reduced ability to work with information contained in a text is usually registered in low-achieving students. One important internal factor influencing reading comprehension concerns the child’s executive functioning. The current study investigated whether the domain-specific intervention ExeFun-READ targeting language abilities related to reading comprehension and executive functioning in primary school children would be effective in improving their scholastic performance in their reading domain and executive functioning. ExeFun-READ is designed to address the relations between domain-specific versus thinking-skill-oriented (domain-general) instruction. A child’s active learning is focused on semantic, phonetic, morphological and syntactical comprehension of linguistic material. In total, 151 students attending grade four from seven elementary schools took part in the project. The study concerned a pretest-intervention-posttest experimental design with three conditions: the experimental condition, an active, and a passive control group. To assess the children’s level of EF, the Delis–Kaplan Executive Function System test battery was used; to assess children’s language ability in reading domain, the Cognitive Abilities Test (the verbal battery, Thorndike & Hagan, 1986 [1]), was used. In the current study, the intervention led to improved language abilities related to reading comprehension, but in terms of executive functioning the improvement only extended to switching fluency. Regarding the effects of the ExeFun-READ intervention on children’s reading abilities, specified as language abilities related to reading comprehension, significant improvements were found in vocabulary, completion of sentences, and classification of terms in the group of children that received the ExeFun-READ intervention.

The disruptive application of ChatGPT (GPT-3.5, GPT-4) to a variety of domains has become a topic of much discussion in the scientific community and society at large. Large Language Models (LLMs), e.g., BERT, Bard, Generative Pre-trained Transformers (GPTs), LLaMA, etc., have the ability to take instructions, or prompts, from users and generate answers and solutions based on very large volumes of text-based training data. This paper assesses the impact and potential impact of ChatGPT on the field of digital forensics, specifically looking at its latest pre-trained LLM, GPT-4. A series of experiments are conducted to assess its capability across several digital forensic use cases including artefact understanding, evidence searching, code generation, anomaly detection, incident response, and education. Across these topics, its strengths and risks are outlined and a number of general conclusions are drawn. Overall this paper concludes that while there are some potential low-risk applications of ChatGPT within digital forensics, many are either unsuitable at present, since the evidence would need to be uploaded to the service, or they require sufficient knowledge of the topic being asked of the tool to identify incorrect assumptions, inaccuracies, and mistakes. However, to an appropriately knowledgeable user, it could act as a useful supporting tool in some circumstances.

The COVID-19 pandemic measures have negatively impacted education worldwide via travel restrictions, student visas, and physical attendanc,e among many other fac-tors. As one of the first places to impose strict pandemic measures and one of the last places to lift the measures, Mainland China provided a unique venue to investigate the effect of public health pandemic control policies on tertiary education. Considering the large portion of international students in medical schools and the higher susceptibility to the pandemic measures due to the natural synergy with teaching hospitals, medical schools can be an early forefront indicator of the impact of the pandemic on tertiary education. We surveyed 513 participants international medical students from Wen-zhou Medical University’s school of international studies in 2019 and 2022 about their satisfaction and demographic and cultural adaptation parameters. We found that the pandemic restrictions did not generally impact student satisfaction. Further analyzing the associated parameters, we found teaching satisfaction to be independent of age (P=.159), years in China (P=.896) and Chinese Level (P=.577) in the medical university. Teaching satisfaction is associated with the region of origin (P <0.001), acceptance of local social norms (P <0.001), satisfaction with the core values of Chinese culture (P <0.001), acclimatization to life in China (P <0.001), can easily make Chinese friends (P <0.001) among other factors. The findings of this study provide an understanding of the effects of pandemic measures on tertiary education satisfaction and other factors that can aid in international student satisfaction.

This paper presents four key results in the philosophy of language. Firstly, it distinguishes between partial and consistent assertion of a sentence, and introduces the concept of an equivocal sentence, which is both partially asserted and partially denied. Secondly, it proposes a novel definition of truth, stating that a true sentence is one that is consistently asserted. This definition avoids the Liar paradox, does not restrict classical logic, and applies to declarative sentences in the language used by any particular person. Thirdly, the paper introduces an epistemic model of language, called assertional language, which formalizes the definition of truth. Finally, it provides an argument for the falsity of so-called Liar sentences. The proposed definition of truth can be viewed as a formal account of the correspondence theory. The epistemic model is a powerful concept that allows for combining different languages in a meaningful way. This model is uniquely capable of reflecting on epistemic inconsistencies, such as logical paradoxes, in a consistent manner and without resorting to non-classical solutions.

Ion channels are integral membrane proteins that facilitate the movement of ions across cell membranes, playing a key role in a range of biological processes. The high cost and time required for wet lab experiments to characterize ion channels has spurred the development of computational methods for this purpose. In our previous work, we demonstrated the effectiveness of protein language models for ion channel prediction, using a logistic regression classifier to distinguish ion channels from non-ion channels (TooT-BERT-C) and transporters from non-transporters (TooT-BERT-T). In this study, we build upon this approach by using a combination of classical machine learning classifiers and a Convolutional Neural Network (CNN) with fine-tuned representations from ProtBERT, ProtBERT-BFD, and MembraneBERT to discriminate ion channels from non-ion channels. The results of our experiments demonstrate that TooT-BERT-CNN-C, a combination of the representations from ProtBERT-BFD and a CNN, outperforms existing state-of-the-art methods for predicting ion channels, with a Matthews Correlation Coefficient (MCC) of 0.86 and an accuracy of 98.35% on an independent test set.

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7%, 42.0%, and 70.1% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future.

Google play store allow the user to download a mobile application (app) and user get inspired by the rating and reviews of the mobile app. A recent study analyzes that user preferences, user opinion for improvement, user sentiment about particular feature and detail with descriptions of experiences are very useful for an application developer. However, many application reviews are very large and difficult to process manually. Star rating is given of the whole application and the developer cannot analyze the single feature. In this research, we have scrapped 282,231 user reviews through different data scraping techniques. We have applied the text classification on these user reviews. We have applied different algorithms and find the precision, accuracy, F1 score and recall. In evaluated results, we have to also find the best algorithm.

The high demand for liquefied natural gas (LNG) requires more LNG carriers (LNGCs) to be in operation. During transportation, there is a high risk due to the required extremely low temperatures and the explosive nature of LNG cargo. Moreover, when there is a lack of experience in operating old LNGCs, there is a serious concern regarding operational accidents. A systematic maintenance strategy, especially for LNG cargo containment systems, is crucial for maintaining safe LNG transportation at sea. The purpose of this study is to develop preventive LNG cargo containment system maintenance models by using LNGC dock specifications from LNGCs of various ages. The dock specifications from a conventional LNGC repairing dock were analyzed using natural language processing techniques in order to develop preventive maintenance models of the LNG cargo containment system. From these results, and by considering the ship’s age, it was found that for young LNGCs the priority for repair should focus on checking routine consumable spare parts by tank inspections, whereas for older LNGCs the focus should be on tank condition maintenance rather than on other facilities. These results are expected to be useful in the development of a maintenance strategy of preventive LNG cargo containment systems in maritime LNG transportation.

With the introduction of the IEC 61850 standard, the path is set for a single communication topology covering all substation levels. The standard has the potential to change the way substations are designed, build, tested and maintained. This means that the key segment of the substation, its protection system, will go through a transition period with the end goal of having a digitalized substation where all information exchange is performed over an Ethernet communication bus. The goal of this paper is to analyse the performance impact of the IEC 61850-9-2LE on the protection system. To do this, a laboratory hardware-in-the-loop test setup is developed representing traditional, hybrid and digital substation topology. This setup served to simulate faults and create transient waveforms in an extended IEEE 123 node test system, which were then used to detect the reaction times of protection relay devices. To verify protection relay results significant number of tests are performed clearly showing benefits which can be gained by distribution system digitalization.

In recent years, the implementation of artificial intelligence (AI) in accounting has grown in many domains, including auditing. AI permits auditors to evaluate large data sets and rapidly identify discrepancies and sequences in audit. This means auditors can review all of a client's transactions via a low time and effort. This entails auditing firms investing heavily in technological infrastructure as well as training their human resources to use cutting-edge AI technologies. Thus, this research sought to investigate the impact of the use of AI techniques by Jordanian external auditors in fraud risk assessment, the moderating effect of auditor size. The descriptive analytical method was used by distributing 280 questionnaires electronically to auditors employed in auditing firms operating in Jordan, The result reveals that AI techniques are extremely beneficial in fraud risk assessment at all levels, and the relationship between the use of AI techniques and the assessment of fraud risk has improved as auditor size has increased.

Nollywood, based on the idea of Bollywood from India, is a series of outstanding movies that originate from Nigeria. Unfortunately, while the movies are in English, they are hard to understand for many native speakers due to the dialect of English that is spoken. In this article, we accomplish two goals: (1) create a phonetic sub-title model that is able to translate Nigerian English speech to American English and (2) use the most advanced toxicity detectors to discover how toxic the speech is. Our aim is to highlight the text in these videos which is often times ignored for lack of dialectal understanding due the fact that many people in Nigeria speak a native language like Hausa at home.

(1) Background: Information overload challenges decision-making in the Industry 4.0 era. While Natural Language Processing (NLP), especially Automatic Text Summarization (ATS), offers solutions, issues with factual accuracy persist. This research bridges cognitive neuroscience and NLP, aiming to improve model interpretability. (2) Methods: This research examined four fact extraction techniques: dependency relation, named entity recognition, part-of-speech tagging, and TF-IDF, in order to explore their correlation with human EEG signals. Representational Similarity Analysis (RSA) was applied to gauge the relationship between language models and brain activity. (3) Results: Named entity recognition showed the highest sensitivity to EEG signals, marking the most significant differentiation between factual and non-factual words with a score of -0.99. The dependency relation followed with -0.90, while part-of-speech tagging and TF-IDF resulted in 0.07 and -0.52, respectively. Deep language models such as GloVe, BERT, and GPT-2 exhibited noticeable influences on RSA scores, highlighting the nuanced interplay between brain activity and these models. (4) Conclusions: Our findings emphasize the crucial role of named entity recognition and dependency relations in fact extraction and demonstrate the independent effects of different models and TOIs on RSA scores. These insights aim to refine algorithms to reflect human text processing better, thereby enhancing ATS models’ factual integrity.

Text classification is one of the most important task in natural language processing, In this research, we carried out several experimental research on three (3) of the most popular Text classification NLP classifier in Convolutional Neural Network (CNN), Multinomial Naive Bayes (MNB), and Support Vector Machine (SVN). In the presence of enough training data, Deep Learning CNN works best in all parameters for evaluation with 77% accuracy, followed by SVM with accuracy of 76%, and multinomial Bayes with least performance of 69% accuracy. CNN has the best performance in the presence of large enough training dataset because of the presence of filter/ kernels which help to indentify patterns in text data regardless of their position in the sentence. We repeated the training again with just one-third of our data, at this point SVM comes with the best performance, the performance of CNN noticeably drops but still better than Multinomial Naive Bayes, the reason why SVM works best when we reduce the training data was because of its ability to look for a hyper-plane that creates a boundary between different classes of data so as to properly classify them, so we believed that getting the hyper-plane was more efficient when we reduce the dataset, hence reason for the good performance. Multinomial Naive Bayes have the least performance which we attributed to its assumption of independency between the features which sometimes does not hold true. We concluded that availability of data should be an important factor when choosing classifier for Natural Language Processing Text Classification task. CNN should be use in the presence of enough dataset, and SVM should be use when data is not enough. Multinomial Naive Bayes must not be trusted with state of the art NLP task due to its assumption of independency between the features.

With the widespread Application of Virtual Reality (VR) in education, optimizing foreign language learning in VR has become a focal point of research. This paper introduces a comprehensive theoretical framework (VR-CCL) based on constructivism and cognitive load theory to enhance foreign language learning in VR. Through a literature review, we explore the applications of VR in education, foreign language learning theories, and prior works on technology-assisted language learning. We further detail the three main components of the VR-CCL framework and validate its effectiveness through two case studies: Duolingo VR and Rosetta Stone VR. Finally, we discuss the strengths and limitations of the framework and its implications for educators and developers.

This study investigates how digital alchemy can enhance literature and language teaching through a combination of online and face-to-face learning. It uses constructivist learning theory and the SAMR model to examine how digital tools and resources can transform learner engagement, critical thinking, and creativity. The study gathered data from interviews, focus groups, and document analysis with 30 participants from private HEI schools. The results show that digital alchemy through blended learning allows learners to personalize and collaborate in their exploration of various literary texts. However, the study also identifies some challenges related to resource availability and educator training. The study emphasizes the importance of using digital alchemy in literature and language teaching and suggests some ways for educators, administrators, and policymakers to effectively use digital tools and resources for student-centered teaching methods in the digital era.

The use of artificial intelligence in natural language processing (NLP) has significantly contributed to the advancement of natural language applications such as sentimental analysis, topic modeling, text classification, chatbots, and spam filtering. With a large amount of text generated each day from different sources such as webpages, blogs, emails, social media, and articles, one of the most common tasks in natural language processing is the classification of a text corpus. This is important in many institutions for planning, decision-making, and archives of their projects. Many algorithms exist to automate text classification operations but the most intriguing of them is that which also learns these operations automatically. In this study, we present a new model to infer and learn from data using probabilistic logic and apply it to text classification. This model, called GenCo, is a multi-input single-output (MISO) learning model that uses a collaboration of partial classifications to generate the desired output. It provides a heterogeneity measure to explain its classification results and enables the reduction of the curse of dimensionality in text classification. The classification results are compared with those of conventional text classification models, and it shows that our proposed model has a higher classification performance than conventional models.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96\% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

The practice of nurse health coaching (NHC) draws from the art and science of nursing, behavioral sciences, and evidence-based health coaching methods. This secondary analysis of the audio-recorded natural language of participants during NHC sessions of our recent 8-week RCT evaluates improvement over time in cognitive-behavioral outcomes: Change Talk, Resiliency, Self-Efficacy/Independent Agency, Insight & Pattern Recognition, and Building Towards Sustainability. We developed a measurement tool for coding, Indicators of Health Behavior Change (IHBC), that was designed to allow trained health coach experts to assess the presence and frequency of the indicators in the natural language content of participants. We used a two-step method for randomly selecting the 20-minute audio-recorded session that was analyzed at each time point. Fifty-six participants had high-quality audio recordings of the NHC sessions. Twelve participants were placed in the social determinants of health (SDH) group based on the following: low income (<$20,000/year), early-onset hypertension, and social disadvantages. Our analyses significantly improved Change Talk and the other four factors over time. Our factor analyses indicated two distinct factors at each measurement point of the study, demonstrating the stability of the outcome measures over time. Our newly developed measurement tool, IHBC, proved stable in structure over time and sensitive to change. This NHC program shows promise in improving cognitive-behavioral indicators associated with health behavior change in both non-SDH and SDH individuals.

A Twi-English parallel corpus is certainly an important resource for Machine Translation of Twi (ISO 639-3), a Low-Resource African Language (LRAL) which is mainly spoken in Ghana and Ivory Coast. Currently large-scale multi-domain Twi-English parallel corpus is still unavailable partly due to the difficulties and the arduous efforts required in its design. In this paper, we present TWIENG: a large-scale multi-domain Twi-English parallel corpus. We crawled the sentences from the web using web crawlers, translated, aligned, tokenized and compiled to create the corpus. We crawled English sentences from Ghanaian indigenous electronic news portals, Ghanaian Parliamentary Hansards, Twi Bible and crowdsourcing via google forms. The sentences were translated by professional translators and linguists, they were then aligned, tokenized and compiled. The corpus was curated using the sketch engine, a corpus manager and analysis software developed by Lexical Computing Limited. The corpus was manually evaluated by Twi professional linguists. The Corpus has 5,419 parallel sentences.

The deep neural network - BERT model (Bidirectional Encoder Representations from Transformers) and the stocks cumulative abnormal return is used in this article to analyze the sentiment of financial texts. The proposed approach, unlike those used so far, does not require the creation of dictionaries, takes into account the broad context of words and their meaning in financial texts, eliminates the problem of ambiguity of words in various contexts, does not require manual labelling of data and is free from the subjective assessment of the researcher. The sentiment of financial texts in the meaning presented in this paper is directly related to the market reaction to the information contained in these texts. For texts belonging to one of the two classes (positive or negative) with the highest probability the BERT model gives the results of predictions with a precision level of 62.38% for the positive class and 55% for the negative class. The results at this level can be used in event study, market efficiency research, investment strategy development or support of investment analysts using fundamental analysis.

In light of the self-simulation hypothesis, a simple form implementation of the principle of efficient language is discussed in a self-referential geometric quasicrystalline state sum model in three dimensions. Emergence is discussed in context of geometric state sum models.

Now when the whole world is still under COVID-19 pandemic, many schools have transferred the teaching from physical classroom to online platforms. It is highly important for schools and online learning platforms to investigate the feedback to get valuable insights about online teaching process so that both platforms and teachers are able to learn which aspect they can improve to achieve better teaching performance. But handling reviews expressed by students would be a pretty laborious work if they were handled manually as well as it is unrealistic to handle large-scale feedback from e-learning platform. In order to address this problem, both machine learning algorithms and deep learning models are used in recent research to automatically process students' review getting the opinion, sentiment and attitudes expressed by the students. Such studies may play a crucial role in improving various interactive online learning platforms by incorporating automatic analysis of feedback. Therefore, we conduct an overview study of sentiment analysis in educational field presented in recent research, to help people grasp an overall understanding of the sentiment analysis research. Besides, according to the literature review, we identify three future directions that researchers can focus on in automatically feedback processing: high-level entity extraction, multi-lingual sentiment analysis, and handling of figurative language.

With the proliferation of locating devices, more and more raw spatial trajectories are formed, and many works enrich these raw trajectories with semantics, and mine patterns from both raw and semantic trajectories, but access control of spatial trajectories is not considered yet. We present a multi-policy secure model for semantic spatial trajectories. In our model, Mandatory Access Control, Role Based Access Control and Discretionary Access control are all enforced, separately and combined, and we represent the model semi-formally in Ontology Web Language.

The article suggests a Value Proposition (VP) framework that enables the analysis of the beneficial impact of Artificial Intelligence (AI) resources and capabilities on specific VP development activities. To develop such a framework, we examined existing management research publications to identify and extract assertions that could be used as a source of actionable insights for new growth-oriented companies. The extracted assertions were assembled into a corpus of texts that were subjected to topic modelling analysis – a machine learning approach to natural language processing that is used to identify latent themes in large corpora of text documents. The topic modeling resulted in the identification of seven topics. Each topic is defined by a set of most frequent words co-occurring in a distinctive subset of texts that could be interpreted in terms of activities constituting the core elements of the VP framework. We then examined each activity in terms of its potential to be enhanced by employing AI resources and capabilities. The interpretation of the topic modeling results led to the identification of seven topics: 1) Value created; 2) Stakeholder value propositions; 3) Foreign market entry; 4) Customer base; 5) Continuous improvement; 6) cross-border operations; and 7) Company image. The uniqueness of the adopted topic modeling approach consists in the quality of the assertions and the interpretation of the seven topics as an activity framework, i.e. in its capacity to generate actionable insights for practitioners. The additional analysis suggests that there is a potential for AI to enhance emerging the four core elements of the VP framework: Value created, Stakeholder value propositions, Foreign market entry, and Customer base. More importantly, we found that the greatest number of assertions related to activities that could be enhanced by AI are part of the Customer base topic, i.e., the topic that is most directly related to the growth potential of the companies. In addition, the VP framework suggests that a company’s customer base growth is continuously enhanced through a positive loop enabled by activities focused on the Continuous improvement of the activities and the amount of Value created, the alignment of Stakeholder value propositions, and companies’ Foreign market entry. Thus, Foreign market entry appears as a factor that helps in understanding the beneficial impact of AI on the VP development of new growth-oriented companies.

This study presents a novel approach to enhance Large Language Models (LLMs) like Alpaca by dynamically integrating real-time information. This method addresses the issue of content hallucination and data relevancy by automatically collecting and integrating current data from credible sources into model prompts. Experiments show a significant improvement in accuracy and a decrease in content hallucination, with a manageable increase in response time. The research underscores the potential of real-time data integration in making LLMs more accurate and contextually relevant, setting a foundation for future advancements in dynamic data processing in AI.

Deep learning is based on matrix computing with a large amount of hidden parameters that is not visible outside the computing module. Deep learning is a non-linear system and a linear approach is not possible. It is natural for people to visualize the algorithm and to follow some hidden parameters. In this paper, we propose a simple graphical programming of a nonlinear system based on drawing the simplest unit, such as a single neuron model. A more complex scheme of a classical neural network is obtained by commands copy-move-place of one neuron. The number of neurons and layers can be chosen arbitrarily. Once the scheme is complete, the implementation code is evaluated with symbolic parameters and nonlinear activation functions. This cannot be done manually. With the symbolic expression of outputs in terms of inputs and symbolic parameters, including symbolic activation pure functions, some other properties can be derived in closed form. This unique original approach can help scientists and developers and design numerical algorithms for machine learning and to understand how deep learning algorithms work.

This study employs a qualitative research approach to investigate the intrinsic and extrinsic motivations that influence college students' engagement, learning experiences, and long-term commitment to language and literature studies within the context of blended learning modality. Drawing on the theoretical frameworks of Self-Determination Theory and Achievement Goal Theory, the research explores the complex interplay between intrinsic factors (e.g., passion, self-improvement, personal growth) and extrinsic factors (e.g., external rewards, recognition). The study is conducted at SMC among the 30 participant and utilizes interviews and classroom observations, in conjunction with a comprehensive review of relevant literature, to gain insights into the impact of these motivations on academic performance and learning outcomes, particularly in blended learning environments. The study acknowledges the limitations inherent in its locale-specific scope and the challenges associated with ensuring the validity and reliability of data collected through online surveys and virtual classroom observations. The findings of this study have significant implications for educators and policymakers, highlighting the importance of nurturing intrinsic motivation while leveraging extrinsic factors to establish supportive learning environments that foster student autonomy, incorporate student interests, and provide timely feedback. By comprehending the motivations that drive student engagement and long-term commitment, educators can enhance learning experiences, elevate academic performance, and sustain students' engagement with language and literature studies amidst the evolving educational landscape of blended learning modality.

Purpose: Hearing assistive technology (HAT) has been shown to be a viable solution to the speech-in-noise perception (SPIN) issue in children with autism spectrum disorder (ASD); however, little is known about its efficacy in tonal language speakers. This study compared sentence-level SPIN performance between Chinese children with ASD and neurotypical (NT) children and evaluated HAT use in improving SPIN performance and easing SPIN difficulty. Methods: Children with ASD (n=26) and NT children (n=19) aged 6-12 performed two adaptive tests in steady-state noise and three fixed-level tests in quiet and steady-state noise with and without using HAT. Speech recognition thresholds (SRT) and accuracy rates were assessed using adaptive and fixed-level tests, respectively. Parents or teachers of the ASD group completed a questionnaire regarding children’s listening difficulty under six circumstances before and after a ten-day trial period of HAT use. Results: Although the two groups of children had comparable SRTs, the ASD group showed a significantly lower SPIN accuracy rate than the NT group. Also, a significant impact of noise was found in the ASD group’s accuracy rate, but not in the NT group’s. There was a general improvement in the ASD group’s SPIN performance with HAT and a decrease in their listening difficulty ratings across all conditions after the device trial. Conclusion: The findings indicated inadequate SPIN in the ASD group using a relatively sensitive measure to gauge SPIN performance among children. The markedly increased accuracy rate in noise during HAT-on sessions for the ASD group confirmed the feasibility of HAT for improving SPIN performance in controlled laboratory settings, and the reduced post-use ratings of listening difficulty further confirmed the benefits of HAT use in daily scenarios.

Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. In this study, we developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to analyze relevant free-text colonoscopy reports, including indications, pathology, and findings notes. The Bio-Bi-LSTM-CRF framework was developed using Bidirectional Long Short-term Memory (Bi-LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free-text reports, including indications for the colonoscopy, findings during the colonoscopy, and pathology of the resected material. We then trained the Bio-Bi-LSTM-CRF and existing Bi-LSTM-CRF models on 80% of 4,000 manually annotated notes obtained from the colonoscopy reports of 3,867 patients. The clinical notes were from a group of patients aged over 40 years old enrolled in four Veterans Affairs Medical Centers. A total of 10% of the remaining annotated notes were used to train hyperparameter, while the remaining 10% were used to evaluate the accuracy of our model (Bio-Bi-LSTM-CRF) and to compare the results with the outcomes obtained using Bi-LSTM-CRF. The results of our experiments showed that the bidirectional encoder representations by integrating dictionary function vector from Bio-Bi-LSTM-CRF and strategies character sequence embedding approach is an effective way to identify colonoscopy features from EHR-extracted clinical notes. Therefore, the Bio-Bi-LSTM-CRF model is concluded to be capable of creating new opportunities to identify patients at risk for colon cancer and to study their health outcomes.

The notion of information and complexity are important concepts in many scientific fields such as molecular biology, evolutionary theory, and exobiology. Many measures of these quantities, either rely on a statistical notion of information, are difficult to compute, or can only be applied to strings. Based on assembly theory, we propose the notion of a \textit{ladderpath}, which describes how an object can be decomposed into a hierarchical structure using repetitive elements. From the ladderpath two measures naturally emerge: the ladderpath-index and the order-index, which represent two axes of complexity. We show how the ladderpath approach can be applied to both strings and spatial patterns and argue that all systems that undergo evolution can be described as ladderpaths. Further, we discuss possible applications to human language and the origins of life. The ladderpath approach provides a novel characterization of the information that is contained in a single object (or a system) and could aid in our understanding of evolving systems and the origin of life in particular.

With the rapid development of science and technology, many new concepts and terms appear, especially in English. Other languages try to express these concepts with words from their own vocabulary. In the specific case of Arabic, there are many ways to find a counterpart for a particular new concept, such as using an existing word to denote the new concept, derivation, and blending. When these methods fail, the new concepts are simply phonetically transliterated. This has the disadvantage that most of the transliterated terms do not conform to the rules of the Arabic language and lead to a distortion of the language. Some modern linguists call for using the generation strategy to translate the new terms into Arabic by using the unused Arabic roots. Therefore, it is necessary to provide a resource that contains all Arabic roots with a categorization of what is used, what is available for use, and what is rejected according to the phonetic system. This work provides a comprehensive lexicon that contains all possible Arabic triliteral roots, determines the status of each root in terms of usage and acceptability, and provides a mechanism for giving preference to roots when there is more than one root that indicates the desired meaning.

Social media platforms have been entirely an undeniable part of the lifestyle for the past decade. Analyzing the information being shared is a crucial step to understanding human behavior. Social media analysis aims to guarantee a better experience for the user and risen user satisfaction. For deriving any further conclusion, first, it is necessary to know how to compare users. In this paper, a hybrid model has been proposed to measure Twitter profiles’ similarity and quantifies the likeness degree of profiles by calculating features considering users’ behavioral habits. For this, first, the timeline of each profile has been extracted using the official TwitterAPI. Then, in parallel, three aspects of a profile are deliberated. Behavioral ratios are time-series-related information showing the consistency and habits of the user. Dynamic time warping has been utilized to compare the behavioral ratios of two profiles. Next, the audience network is extracted for each user, and for estimating the similarity of two sets, Jaccard similarity is used. Finally, for the Content similarity measurement, the tweets are preprocessed respecting the feature extraction method; TF-IDF and DistilBERT for feature extraction are employed and then compared using the cosine similarity method. Results have shown that TF-IDF has slightly better performance; therefore, the more straightforward solution is selected for the model. Similarity level of different profiles. As in the case study, a Random Forest classification model was trained on almost 20000 users revealed a 97.24% accuracy. This comparison enables us to find duplicate profiles with nearly the same behavior and content.

This article propose a didactic, through games, tool based on information and communication technologies, in order to eliminate possible communication barriers and to promote the inclusion of students with hearing impairment in Physical Education classes. To this end, a dossier of traditional games has been developed. These are structured in turn into objectives, materials, organisation, graphic description and a QR code for each game. These codes are linked to different videos hosted on the YouTube platform, in which the explanation of the games, mentioned above, can be visualised graphically using sign language. The whole creative process is described in the article, as well as possible pedagogical applications of the use of the tools created for this purpose in other educational contexts.

A more sustainable society and economy also implies a more sustainable behavior in the consumption of financial products. A possible change in focus can come from the demand side, so that more sustainable consumption of financial products have to go hand to hand with financial literacy. However, financial literacy, potential favoring of this sustainable behavior, is far from reaching an international consensus about its definition, object and scope. Two objectives are analyzed; the different interpretations of financial literacy in the academic literature, as well as its evolution and how, in what context and with what other concepts the term is used in social networks. Scientometric techniques and content analysis have been used to carry out a systematic review of literature and also NLP to analyze the comments on Social Networks. Critical moments are identified in the definition of financial literacy. Also ten sentiments are analyzed in social networks in wich positivity, trust, and anticipation predominate. Greater attention to this issue is necessary both from the private initiative and from public policies, so that financial literacy is an effective tool for a more sustainable behavior by consumers. Finally, a new definition is proposed based on our findings.

Bayesian formulations of learning imply that whenever the evidence for a correlation between events in an animal’s habitat is sufficient, the correlation is learned. This implies that regularities can be learnt rapidly, from small numbers of learning examples. This speed of learning gives maximum possible fitness, and no faster learning is possible. There is evidence in many domains that animals and people can learn at nearly Bayesian optimal speeds. These domains include associative conditioning, and the more complex domains of navigation and language. There are computational models of learning which learn at near-Bayesian speeds in complex domains, and which can scale well – to learn thousands of pieces of knowledge (i.e., relations and associations). These are not neural net models. They can be defined in computational terms, as algorithms and data structures at David Marr’s [1] Level Two. Their key data structures are composite feature structures, which are graphs of multiple linked nodes. This leads to the hypothesis that animal learning results not from deep neural nets (which typically require thousands of training exam-ples), but from neural implementations of the Level Two models of fast learning; and that neu-rons provide the facilities needed to implement those models at Marr’s Level Three. The required facilities include feature structures, dynamic binding, one-shot memory for many feature struc-tures, pattern-based associative retrieval, unification and generalization of feature structures. These may be supported by multiplexing of data and metadata in the same neural fibres.

The aim of this study was to build a tool to analyze, using artificial intelligence, the sentiment perception of users who answered two questions from the CSQ – 8 questionnaires with raw Spanish free-text. Their responses are related to mindfulness, which is a novel technique used to control stress and anxiety caused by different factors in daily life. As such, we proposed an online course where this method was applied in order to improve the quality of life of health care professionals in COVID 19 pandemic times. We also carried out an evaluation of the satis-faction level of the participants involved, with a view to establishing strategies to improve fu-ture experiences. To automatically perform this task, we used Natural Language Processing (NLP) models such as swivel embedding, neural networks and transfer learning, so as to classify the inputs into the following 3 categories: negative, neutral and positive. Due to the lim-ited amount of data available - 86 registers for the first and 68 for the second - transfer learning techniques were required. The length of the text had no limit from the user’s standpoint, and our approach attained a maximum accuracy of 93.02 % and 90.53 % respectively based on ground truth labeled by 3 experts. Finally, we proposed a complementary analysis, using com-puter graphic text representation based on word frequency, to help researchers identify relevant information about the opinions with an objective approach to sentiment. The main conclusion drawn from this work is that the application of NLP techniques in small amounts of data using transfer learning is able to obtain enough accuracy in sentiment analysis and text classification stages

The recent advancements of the Semantic Web and Linked Data have changed the working of the traditional web. There is significant adoption of the Resource Description Framework (RDF) format for saving of web-based data. This massive adoption has paved the way for the development of various centralized and distributed RDF processing engines. These engines employ various mechanisms to implement critical components of the query processing engines such as data storage, indexing, language support, and query execution. All these components govern how queries are executed and can have a substantial effect on the query runtime. For example, the storage of RDF data in various ways significantly affects the data storage space required and the query runtime performance. The type of indexing approach used in RDF engines is critical for fast data lookup. The type of the underlying querying language (e.g., SPARQL or SQL) used for query execution is a crucial optimization component of the RDF storage solutions. Finally, query execution involving different join orders significantly affects the query response time. This paper provides a comprehensive review of centralized and distributed RDF engines in terms of storage, indexing, language support, and query execution.

In the dynamic field of mental health care, the nuanced application of Artificial Intelligence (AI) through Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) is a pivotal innovation in patient empowerment and service optimization. This study introduces a distinctive online therapy platform that capitalizes on the synergy of NLP and ASR to offer unprecedented levels of interactive and personalized therapeutic interventions. The architecture of our system is meticulously detailed, featuring an ASR component with an impressive Word Error Rate (WER) of 14% when trained on the diverse French subsets of the Mozilla Common Voice dataset, complemented by a high-precision NLP framework skilled in processing and responding to user inputs. The evaluation of our system highlights its efficacy in enhancing therapy sessions and user satisfaction, with an emphasis on the qualitative aspects of user feedback. The paper addresses challenges such as dataset representativeness and language model refinement and articulates the strategic solutions employed to overcome them. The paper concludes with forward-looking perspectives on AI's role in mental health services, advocating for the creation of sophisticated, language-specific datasets and models to satisfy the increasing demands of online therapy, reflecting a growing commitment of patients in the management of their therapy. This research underscores the transformative impact of AI in advancing mental health care into the digital age, representing a significant evolution over existing methodologies.

Leveraging the open-world understanding capacity of large-scale visual-language pre-trained models has become a hot-spot in point cloud classification. Recent approaches rely on transferable visual-language pre-trained models, classifying point clouds by projecting them into 2D images and evaluating consistency with textual prompts. These methods benefit from the robust open-world understanding capabilities of visual-language pre-trained models and require no additional training. However, they face several challenges summarized as prompt ambiguity, image domain gap, view weights confusion, and feature deviation. In response to these challenges, we propose PointBLIP, a zero-training point cloud classification network based on the recently introduced BLIP-2 visual-language model. PointBLIP is adept at processing similarities between multi-images and multi-prompts. We separately introduce a novel method for point cloud zero-shot and few-shot classification, which involves comparing multiple features to achieve effective classification. Simultaneously, we enhance the input data quality for both the image and text sides of PointBLIP. In point cloud zero-shot classification tasks, we outperform state-of-the-art methods on three benchmark datasets. For few-shot classification tasks, to the best of our knowledge, we present the first zero-training few-shot point cloud method, surpassing previous works under the same conditions and showcasing comparable performance to full-training methods.

Tactics, Techniques, and Procedures (TTPs) constitute the most valuable aspect of Cyber Threat Intelligence (CTI). However, TTPs are often implicit in unstructured text, necessitating manual analysis by field experts. Automating the classification of TTPs from unstructured text is a crucial task in contemporary research. MITRE ATT&CK serves as the de facto standard for studying TTPs. Existing research constructs classification datasets based on its procedural examples for tactics and techniques. However, due to a significant proportion of small sample categories, a long-tail phenomenon exists, leading to a highly imbalanced sample distribution. Consequently, more research concentrates on categories with relatively abundant samples. This paper proposes a method that combines ChatGPT data augmentation with Instruction Supervised Fine-Tuning of open large language models. This approach offers a solution for TTPs classification in few-shot learning scenarios, achieving coverage of 625 technical categories. The Precision, Recall, and F1 scores reach 86.2%, 89.9%, and 87.3%, respectively.

The work of this paper presents multiple novel findings from a comprehensive analysis of about 150,000 tweets about exoskeletons posted between May 2017 and May 2023. First, findings from content analysis and temporal analysis of these tweets reveal the specific months per year when a significantly higher volume of Tweets was posted and the time windows when the highest number of tweets, the lowest number of tweets, tweets with the highest number of hashtags, and tweets with the highest number of user mentions were posted. Second, the paper shows that there are statistically significant correlations between the number of tweets posted per hour and different characteristics of these tweets. Third, the paper presents a multiple linear regression model to predict the number of tweets posted per hour in terms of these characteristics of tweets. The R2 score of this model was observed to be 0.9540. Fourth, the paper reports that the 10 most popular hashtags were #exoskeleton, #robotics, #iot, #technology, #tech #innovation, #ai, #sci, #construction and #news. Fifth, sentiment analysis of these tweets was performed using VADER and the DistilRoBERTa-base library. The results show that the percentage of positive, neutral, and negative tweets were 46.8%, 33.1%, and 20.1%, respectively. The results also show that in the tweets that did not express a neutral sentiment, the sentiment of surprise was the most common sentiment. It was followed by the sentiments of joy, disgust, sadness, fear, and anger. Furthermore, analysis of hashtag-specific sentiments revealed several novel insights, for instance, for almost all the months in 2022, the usage of #ai in tweets about exoskeletons was mainly associated with a positive sentiment. Sixth, text processing-based approaches were used to detect possibly sarcastic tweets and tweets that contained news. Finally, a comparison of positive tweets, negative tweets, neutral tweets, possibly sarcastic tweets, and tweets that contained news, in terms of different characteristic properties of these tweets are presented. The findings reveal multiple novel insights, for instance, the average number of hashtags used in tweets that contained news has considerably increased since January 2022.

Background: Although electronic health records (EHR) provide useful insights into disease patterns and patient treatment optimisation, their reliance on unstructured data presents a difficulty. Because of their narrative structure, echocardiography reports, which provide extensive pathology information for cardiovascular patients, are particularly challenging to extract and analyse. Although natural language processing (NLP) has been utilised successfully in a variety of medical fields, it is not commonly used in echocardiography analysis. Objectives: To develop an NLP-based approach for extracting and categorizing data from echocardiography reports by accurately converting continuous (e.g. LVOT VTI, AV VTI, and TR Vmax) and discrete (e.g. Regurgitation severity) outcomes in semi-structured narrative format into structured and categorized format, allowing for future research or clinical use. Methods: 135,062 Trans-Thoracic Echocardiogram (TTE) reports were derived from 146967 baseline Echocardiogram reports and split into three cohorts: Training and Validation (n = 1075), Test Dataset (n = 98) and Application Dataset (n = 133,889). The NLP system was developed and iteratively refined using medical expert knowledge. The system was used to curate a moderate-fidelity database from extractions of 133,889 reports. A hold-out validation set of 98 reports was blindly annotated and extracted by two clinicians for comparison with the NLP extraction. Agreement, discrimination, accuracy and calibration of outcome measure extractions were evaluated. Results: Continuous outcomes including LVOT VTI, AV VTI, and TR Vmax exhibited perfect inter-rater reliability using intra-class correlation scores (ICC=1.00, P< 0.05) alongside high R2 values, demonstrating an ideal alignment between the NLP system and clinicians. Good level (ICC =0.75-0.9, P<0.05) of inter-rater reliability were observed for outcomes such as LVOT Diam, Lateral MAPSE, Peak E Velocity, Lateral E' Velocity, PV Vmax, Sinuses of Valsalva, and Ascending Aorta diameters. Furthermore, the accuracy rate for discrete outcome measures was 91.38% in the confusion matrix analysis, indicating effective performance. Conclusions: The NLP-based technique yielded good results when it came to extracting and categorising data from echocardiography reports. The system demonstrated a high degree of agreement and concordance with clinician extractions. This study contributes to the effective use of semi-structured data by providing a useful tool for converting semi-structured text to structured echo report that can be used for data management. Additional validation and implementation in healthcare settings can improve data availability and support research and clinical decision-making.

A topical challenge for algorithms in general and for automatic image categorization and generation in particular is presented with the aim of highlighting strengths and deficiencies of current Artificial Intelligence approaches while sketching a way forward. A general lack of encompassing symbol-embedding and (not only) -grounding in some bodily basis is made responsible for current deficiencies. A concomitant dearth of hierarchical organization of concepts follows suite. As a remedy for these shortcomings, it is proposed to take a wide step back and to newly incorporate aspects of cybernetics and analog control processes. It is claimed that a promising overarching perspective is provided by the Ouroboros Model with a valid and versatile algorithmic backbone for general cognition at all accessible levels of abstraction and capabilities.

(1) Background: Artificial intelligence (AI) has existed in some form for decades, but recent rapid advances in a subset called machine learning (ML) — and more specifically deep learning (DL), a neural network-based approach — have made headlines for the potential to revolutionize and automate multiple large sectors of society, including scientific research and the healthcare field. Furthermore, large language models (LLMs) — which are built on DL — could lead to a more seamless, natural interaction between humans and computers. (2) Methods: We reviewed numerous publications on this subject from recent years. (3) Results: We found these studies collectively show that AI is positively disrupting both biomedical research and medical practice, such as optical imaging in surgery guidance. (4) Conclusions: However, we recommend caution in over-reliance on AI in the laboratory or the clinic due to anticipated risks and current limitations.

As time continues to advance, the need for robust security threat mitigation has become increasingly vital in software. However, ensuring early effective security threat mitigation requires optimal test data and consistent test case design. It is a constant struggle to maximize test coverage through test data optimization. We conducted explanatory research to maximize test coverage of security requirements as modeled in Structured Misuse Case Description (SMCD) i.e., structured specification of misuse case, so as to improve consistency in optimal test data generation. We specified constraints upon Mal activity in Object Constraint Language (OCL) in order to minimize human dependency and improve consistency in optimal test data generation. It was evident through results that MC/DC generated optimal test data of security threats through SMCD in comparison to the Decision Coverage method thus resulting in designing a significantly lower number of test cases and yet maximizing test coverage of security threats. MC/DC generated test data with n+1, while Decision Coverage generated test data with〖 2〗^n, we, therefore, conclude that MC/DC maximizes test coverage through optimal test data from SMCD in comparison to Decision Coverage.

The exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications and diverse use-cases in assisted living, military, healthcare, firefighting, and industry 4.0. The exoskeleton market is projected to increase by multiple times of its current value within the next two years. Therefore, it is crucial to study the degree and trends of user interest, views, opinions, perspectives, attitudes, acceptance, feedback, engagement, buying behavior, and satisfaction, towards exoskeletons, for which the availability of Big Data of conversations about exoskeletons is necessary. The Internet of Everything style of today's living, characterized by people spending more time on the internet than ever before, with a specific focus on social media platforms, holds the potential for the development of such a dataset, by the mining of relevant social media conversations. Twitter, one such social media platform, is highly popular amongst all age groups, where the topics found in the conversation paradigms include emerging technologies such as exoskeletons. To address this research challenge, this work makes two scientific contributions to this field. First, it presents an open-access dataset of about 140,000 tweets about exoskeletons that were posted in a 5-year period from May 21, 2017, to May 21, 2022. Second, based on a comprehensive review of the recent works in the fields of Big Data, Natural Language Processing, Information Retrieval, Data Mining, Pattern Recognition, and Artificial Intelligence that may be applied to relevant Twitter data for advancing research, innovation, and discovery in the field of exoskeleton research, a total of 100 Research Questions are presented for researchers to study, analyze, evaluate, ideate, and investigate based on this dataset.

Context: Anomaly detection in a data center is a challenging task, having to consider different services on various resources. Current literature shows the application of artificial intelligence techniques to either log files or monitoring data: the former created by services at run time, while the latter produced by specific sensors directly on the physical or virtual machine. Objectives: We propose a model that exploits information both in log files and monitoring data to identify patterns and detect anomalies over time. Methods: The key idea is to use on one side natural language processing solutions to detect problems at service level, extracting words that represent anomalies. Clustering and topic modeling techniques have been used to identify patterns and group them with respect to topics. On the other side time series anomaly detection technique has been applied to sensors data in order to combine problems found in the log files with problems stored in the monitoring data. Results: We have tested our approach on a real data center equipped with log files and monitoring data that can characterize the behaviour of physical and virtual resources in production. We have observed a correspondence between anomalies in log files and monitoring data, e.g. an increase in memory usage or machine load. The results are extremely promising. Conclusion: Our model requires to integrate site administrators' expertise in order to consider all critical scenario in the data center and understand results properly.