LLMs are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as LIME, SHAP, and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task.

This study leverages transformer-based models and focuses on data representation strategies in the named entity recognition task, including "single" (one sentence per vector), "merged" (multiple sentences per vector), and "context" (sentences joined with attention to context). Performance analysis reveals that models trained with a single strategy may not perform well on different data representations. A combined training procedure is proposed to address this limitation, using all three strategies to enhance the stability and adaptability of the model. The results of this approach are presented and discussed for various datasets for four languages (English, Polish, Czech, and German), demonstrating the effectiveness of the combined strategy.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

Tactics, Techniques, and Procedures (TTPs) constitute the most valuable aspect of Cyber Threat Intelligence (CTI). However, TTPs are often implicit in unstructured text, necessitating manual analysis by field experts. Automating the classification of TTPs from unstructured text is a crucial task in contemporary research. MITRE ATT&CK serves as the de facto standard for studying TTPs. Existing research constructs classification datasets based on its procedural examples for tactics and techniques. However, due to a significant proportion of small sample categories, a long-tail phenomenon exists, leading to a highly imbalanced sample distribution. Consequently, more research concentrates on categories with relatively abundant samples. This paper proposes a method that combines ChatGPT data augmentation with Instruction Supervised Fine-Tuning of open large language models. This approach offers a solution for TTPs classification in few-shot learning scenarios, achieving coverage of 625 technical categories. The Precision, Recall, and F1 scores reach 86.2%, 89.9%, and 87.3%, respectively.

Sign Language Recognition (SLR) aims to bridge speech-impaired and general communities by recognizing signs from given videos. Researchers still face challenges developing efficient SLR systems because of the video’s complex background, light illumination, and subject structures. Recently many researchers developed a skeleton-based sign language recognition system to overcome the subject and background variation of hand gesture signs. However, skeleton-based SLR is still under exploration due to the lack of information and annotations on hand key points. More recently, researchers included body and face information with the hand gesture for the SLR, but their performance and efficiency are unsatisfactory. We proposed a Multi-Stream Graph-based Deep Neural Network (SL-GDN) for a skeleton-based SLR system to overcome the problems. The main purpose of the proposed SL-GDN approach is to improve the efficiency and performance of the SLR system with a low computational cost based on the human body pose in the form of 2D landmark locations. In the procedure, firstly, we constructed a skeleton graph based on the selected 27 whole-body key points among 67 key points to solve the inefficiency problems. Then we proposed multi-stream SL-GDN to extract features from the whole-body skeleton graph for four streams. Finally, we concatenated the four different features and applied a classification module to refine the feature and recognize corresponding sign classes. Our data-driven and graph construction method increases the system’s flexibility and brings high generability to adapt various data samples. We used three large-scale benchmark SLR datasets to evaluate the proposed model: WLASL, AUTSL and CSL. The demonstrated performance accuracy table proved the superiority of the proposed model, and we believe this will be considered a great invention in the SLR domain.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Although learning analytics (LA) holds great potential to improve teaching and learning, LA research and practice are currently riddled with limitations that impact every stage of the LA life cycle. The present paper offers an overview of these challenges before proposing strategies to overcome them and exploring how the recent innovations brought forth by language models can improve LA research and practice. In particular, we encourage the empowerment of teachers during LA development, as this would strengthen the theoretical foundation of LA solutions and increase their interpretability and usability. Furthermore, we provide examples of how process data can be used to understand learning processes and generate more interpretable LA insights. Furthermore, we explore how LLMs could come into play in LA to generate interpretable insights, timely and actionable feedback, increase personalization, and support teachers’ tasks more broadly.

The growing dependence on large language models (LLM)s highlights the urgent need to deepen trust in these technologies. Regular, rigorous validation of their expertise, especially in nuanced and intricate scenarios, is essential to ensure their readiness for clinical applications. Our study pioneers the exploration of LLM utility in the field of cardiology. We stand at the cusp of a transformative era where mature AI and LLMs, notably ChatGPT, GPT-4, and Google Bard, are poised to influence healthcare significantly. Recently, we put three available LLMs, OpenAI's ChatGPT-3.5, GPT-4.0, and Google's Bard, to the test against a significant Polish medical special-ization licensing exam (PES). The exams cover the scope of completed specialist training, focusing on diagnostic and therapeutic procedures, excluding invasive medical procedures and interven-tions. In our analysis, GPT-4 consistently outperformed the others, ranking first, with and Google Bard and ChatGPT- 3.5 following, respectively. The performance metrics underscore GPT-4's no-table potential in medical applications. Given a score improvement of over 23.5 % between two AI models released just four months apart, clinicians must stay informed and up-to-date about these rapidly evolving tools and their potential applications to clinical practice. Our results provide a snapshot of the current capabilities of these models, highlighting the nuanced performance dif-ferences when confronted with identical questions

This paper examines the potential of large language models, specifically ChatGPT, BingChat, and Bard, in enhancing the work of teachers in various educational settings. These models, powered by cutting-edge artificial intelligence, offer a wide range of applications that can aid educators in curriculum development, personalized instruction, student engagement, and administrative tasks. By harnessing the capabilities of these language models, teachers can not only streamline their workload but also improve the overall quality of education. This paper explores the ways in which these models can empower educators and revolutionize teaching practices.

Humans have a unique cognitive ability known as relational abstraction, which allows us to identify logical rules and patterns beyond basic perceptual characteristics. This ability represents a key difference between how humans and other animals learn and interact with the world. With current large language models rivaling human intelligence in many regards, we investigated whether relational abstraction was an emergent chat completion capacity in various models. We find that despite their impressive language processing skills, all tested language models failed the relational match-to-sample (RMTS) test, a benchmark for assessing relational abstraction. These results challenge the assumption that advanced language skills inherently confer the capacity for complex relational reasoning. The paper highlights the need for a broader evaluation of AI cognitive abilities, emphasizing that language proficiency alone may not be indicative of certain higher-order cognitive processes thought to be supported by language.

(1) Background: Artificial Intelligence (AI) models have shown potential in various educational contexts. However, their utility in explaining complex biological phenomena, such as Intrinsically Disordered Proteins (IDPs), requires further exploration. This study empirically evaluated the performance of various Large Language Models (LLMs) in the educational domain of IDPs. (2) Methods: Four LLMs, GPT-3.5, GPT-4, GPT-4 with Browsing, and Google Bard (PaLM 2), were assessed using a set of IDP-related questions. An expert evaluated their responses across five categories: accuracy, relevance, depth of understanding, clarity, and overall quality. Descriptive statistics, ANOVA, and Tukey's honesty significant difference tests were utilized for analysis. (3) Results: The GPT-4 model consistently outperformed the others across all evaluation categories. Although GPT-4 and GPT-3.5 were not statistically significantly different in performance (p>0.05), GPT-4 was preferred as the best response in 13 out of 15 instances. The AI models with browsing capabilities, GPT-4 with Browsing and Google Bard (PaLM 2) displayed lower performance metrics across the board with statistically significant differences (p<0.0001). (4) Conclusion: Our findings underscore the potential of AI models, particularly LLMs such as GPT-4, in enhancing scientific education, especially in complex domains such as IDPs. Continued innovation and collaboration among AI developers, educators, and researchers are essential to fully harness the potential of AI for enriching scientific education.

In light of the self-simulation hypothesis, a simple form implementation of the principle of efficient language is discussed in a self-referential geometric quasicrystalline state sum model in three dimensions. Emergence is discussed in context of geometric state sum models.

The pursuit of Artificial Intelligence (AI) that emulates human cognitive processes is a cornerstone of ethical AI development, ensuring that emerging technologies can integrate seamlessly into societal frameworks requiring nuanced understanding and decision-making. Zero-Shot Instance Retrieval (ZSIR) stands at the forefront of this endeavour, potentially providing a robust platform for AI systems, particularly large visual language models, to demonstrate and refine cognition-aligned learning without the need for direct experience. In this paper, we critically evaluate current cognition alignment methodologies within traditional zero-shot learning paradigms, using visual attributes and word embedding generated by large AI models. We propose a unified similarity function that quantifies the cognitive alignment level, bridging the gap between AI processes and human-like understanding. Through extensive experimentation, our findings illustrate that this similarity function can effectively mirror the visual-semantic gap, steering the model towards enhanced performance in zero-shot instance retrieval. This work not only benchmarks the cognition alignment of AI, but also sets a new precedent for the development of visual language models attuned to the complexities of human cognition.}

Cognitive Warfare (CogWar) is another form of warfare where the goal is to exploit cognition facets to disrupt, undermine, influence or modify human decisions. Famous examples include “Operation Gidlock” meddling with the US 2016 election, and CogWar campaigns assisting the annexation of Crimea. As Large Language Model(LLM)-based applications expand, reaching more users and their cognitive states, stealth Malicious Cognitive Behavioral Tactics (MCBT) can be embedded in trusted application sessions to systematically profile, then alter, each individual’s cognition over time. Successful MCBT can create more cases like Snowden, mass shootings, or January6. This short-form paper discusses a novel MCBT threat model, a novel kill chain, and an on-going prototype for demonstration.

This paper proposes the utilization of large language models as recommendations systems for museums. Since the aforementioned models lack the notion of context, they can’t work with temporal information that is often present in recommendations for cultural environments (e.g. special exhibitions or events). In this respect, the current work aims at enhancing the capabilities of large language models through a fine-tuning process that incorporates contextual information and user instructions. The resulting models are expected to be capable of providing personalized recommendations, aligned with user preferences and desires. More specifically, Generative Pre-trained Transformer 4, a knowledge-based large language model is fine-tuned and turned into a context-ware recommendation system, adapting its suggestions based on user input and specific contextual factors such as location, time of visit, and other relevant parameters. The effectiveness of the proposed approach is evaluated through certain user studies, which ensure an improved user experience and engagement within the museum environment.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

With the rapid growth of large language models (LLMs), there is increasing demand for memory and computation for LLMs. Recent efforts on post-training pruning of LLMs aim to reduce the model size and computation, yet the performance is still sub-optimal. In this paper, we present a plug-and-play solution for post-training pruning of LLMs. The proposed solution has two innovative components: 1) **Relative Importance and Activations** (RIA), a new pruning metric that jointly considers the weight and activations efficiently on LLMs; and 2) **Channel Permutation**, a new approach to maximally preserve important weights under N:M sparsity. The proposed two components can be readily combined to further enhance the N:M structuredly pruned LLMs. Our empirical experiments show that RIA alone can already surpass all existing post-training pruning methods on prevalent LLMs, e.g., LLaMA ranging from 7B to 65B. Furthermore, N:M structured pruning with channel permutation can even outperform the original LLaMA2 70B on zero-shot tasks, together with practical speed-up on specific hardware.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

Over the years, machine learning has emerged as a tool for automated translation and has been studied relentlessly for decades. RBMT, SMT, and NMT models have been used to achieve machine translation and the results have drastically improved from when research in this field first began. Although a few general-purpose translators such as Google Translate or Microsoft Translator have accurate translations compared to that of a human translator, many pieces of text containing highly technical terms or homonyms are often mistranslated completely. When considering the necessity and importance of translating technical patents from different domains, accuracy in translation is not something that can be compromised. This motivates the need to improve the performance of machine translation further. The scope of this paper covers three open-source machine translation models for the purpose of patent documentation translation from English to Japanese, evaluates their performance on patent data, and proposes a methodology that enabled us to improve one of the model’s BLEU score by 41.22%, achieving a BLEU score of 46.18.

ChatGPT, a Large Language Model (LLM) utilizing Natural Language Processing (NLP), has caused concerns about its impact on job sectors, including cybersecurity. In this study, we assessed ChatGPT’s impacts in non-managerial cybersecurity roles using the NICE Framework and Technological Displacement theory. We also explored its potential in passing top cybersecurity certification exams. Findings revealed ChatGPT’s promise in streamlining some jobs, especially those requiring memorization. Moreover, we highlighted ChatGPT’s challenges and limitations, such as ethical implications, LLM limitations, and Artificial Intelligence (AI) security. The study suggests that LLMs like ChatGPT could transform the cybersecurity landscape, causing job losses, skill obsolescence, labor market shifts, and mixed socioeconomic impacts. We recommend a shift in focus from memorization to critical thinking, and collaboration between LLM developers and cybersecurity professionals.

Evolutionary perspectives have generated many questions and some answers in the study of human health and disease. The field of evolutionary medicine, and related analytics of evolutionary psychiatry and evolutionary psychology have extended and expanded the way health disorders are viewed by searching for why humans, as a species, are vulnerable to certain pathological conditions. The search is organized into four domains that apply proximate and evolutionary explanations to human traits and developmental sequences. This framework opens inquiry to the ontogeny, phylogeny, mechanism, and adaptive significance of human health conditions. In this paper I argue that evolutionary medicine seems to parallel biomedicine in its primarily pathogenic focus. That is, conditions of pain, suffering, and disorder have received the most attention. Some work has used the architecture of evolutionary medicine to take a salutogenic approach, evaluating the proximate and evolutionary explanations of human well-being. I propose that an evolutionary understanding of human well-being requires a survey of emotions and their relationship with neurobiology, language, and culture. My anthropology based, multidisciplinary review of biopsychosocial processes reveals the way evolution has shaped modern human understanding of well-being through sociolinguistic learning processes and thereby our individual experiences of well-being. These insights have the power to contextualize human suffering and flourishing as we progress toward the goal of attenuating the former and expanding the latter.

The scope of a lucrative career promoted by Google through its video distribution platform YouTube 1 has attracted a large number of users to become content creators. An important aspect of this line of work is the feedback received in the form of comments which show how well the content is being received by the audience. However, volume of comments coupled with spam and limited tools for comment classification makes it virtually impossible for a creator to go through each and every comment and gather constructive feedback. Automatic classification of comments is a challenge even for established classification models, since comments are often of variable lengths riddled with slang, symbols and abbreviations. This is a greater challenge where comments are multilingual as the messages are often rife with the respective vernacular. In this work, we have evaluated top-performing classification models and four different vectorizers, for classifying comments which are a mix of different combinations of English and Malayalam (only English, only Malayalam and Mix of English and Malayalam). The statistical analysis of results indicates that Multinomial Naïve Bayes, K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Random Forest and Decision Trees offer similar level of accuracy in comment classification. Further, we have also evaluated 3 multilingual sub-types of the novel NLP language model, BERT and compared its’ performance to the conventional machine learning classification techniques. XLM was the top-performing BERT model with an accuracy of 67.31%. Random Forest with Term Frequency Vectorizer was the best the top-performing model out of all the traditional classification models with an accuracy of 63.59%.

This study presents a novel approach to enhance Large Language Models (LLMs) like Alpaca by dynamically integrating real-time information. This method addresses the issue of content hallucination and data relevancy by automatically collecting and integrating current data from credible sources into model prompts. Experiments show a significant improvement in accuracy and a decrease in content hallucination, with a manageable increase in response time. The research underscores the potential of real-time data integration in making LLMs more accurate and contextually relevant, setting a foundation for future advancements in dynamic data processing in AI.

Today, LLMs are not good at personalization providing recommendation. They advise physicians and financial advisors to ask professionals in respective fields for help, even having user information available. Answering questions of software professionals, LLM needs to deliver in-depth answers with codes or algorithms, whereas for professionals in other fields would need definitions and main concepts. The intent of this chapter is to make LLM answer tailored to the needs of users, taking into account available information about them. To do that, we need to generalize available information about a person like her health record, maintaining the privacy of this person. We rely on meta-learning techniques to design a LLM prompt to produce a personalization prompt to obtain a suitable relevant information. Such “meta-prompt” is produced by generalization operation applied to available documents for the user. These documents need to be de-identified so that they are sufficient for personalization on one hand and will maintain user privacy on the other hand. The second neuro-symbolic technique to support personalization is abductive reasoning, acting in parallel to LLM fine-tuning. Traditional recommendation and personalization techniques as well as modern, deep learning – based are presented, and the comparison is drawn to the proposed approach. We also share the evaluation and comparative analyses of these approaches. We consider an example for how to build personalization LLM systems coming from Langchain platform. We will explore how to construct chains to form a personalization profile for a user and apply it to user search and recommendation requests.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

The classification of goods involved in international trade in Brazil is based on the Mercosur Common Nomenclature (NCM). The classification of these goods represents a real challenge due to the complexity involved in assigning the correct category codes especially considering the legal and fiscal implications of misclassification. This work focuses on the training of a classifier based on Bidirectional En-coder Representations from Transformers (BERT) for the tax classification of goods with NCM codes. In particular, this article presents results from using a specific Portuguese Language tuned BERT model as well results from using a Multilingual BERT. Experimental results justify the use of these models in the classification process and also that the language specific model has a slightly better performance.

This research investigates the potential application of generative language models, especially ChatGPT, in aviation safety analysis as a means to enhance the efficiency of safety analyses and accelerate the time it takes to process incident reports. In particular, ChatGPT was leveraged to generate incident synopses from narratives, which were subsequently compared with ground truth synopses from the Aviation Safety Reporting System (ASRS) dataset. The comparison was facilitated by using embeddings from Large Language Models (LLMs), with aeroBERT demonstrating the highest similarity due to its aerospace-specific fine-tuning. A positive correlation was observed between synopsis length and their cosine similarity. In a subsequent phase, human factor issues involved in incidents as identified by ChatGPT were compared to human factor issues identified by safety analysts. A concurrence rate of 61% was found, with ChatGPT demonstrating a cautious approach towards attributing human factor issues. Finally, the model was used to attribute incidents to relevant parties. As no dedicated ground truth column existed for this task, a manual evaluation was conducted. ChatGPT attributed the majority of incidents to the Flight Crew, ATC, Ground Personnel, and Maintenance. This study opens new avenues for leveraging AI in aviation safety analysis.

The high demand for liquefied natural gas (LNG) requires more LNG carriers (LNGCs) to be in operation. During transportation, there is a high risk due to the required extremely low temperatures and the explosive nature of LNG cargo. Moreover, when there is a lack of experience in operating old LNGCs, there is a serious concern regarding operational accidents. A systematic maintenance strategy, especially for LNG cargo containment systems, is crucial for maintaining safe LNG transportation at sea. The purpose of this study is to develop preventive LNG cargo containment system maintenance models by using LNGC dock specifications from LNGCs of various ages. The dock specifications from a conventional LNGC repairing dock were analyzed using natural language processing techniques in order to develop preventive maintenance models of the LNG cargo containment system. From these results, and by considering the ship’s age, it was found that for young LNGCs the priority for repair should focus on checking routine consumable spare parts by tank inspections, whereas for older LNGCs the focus should be on tank condition maintenance rather than on other facilities. These results are expected to be useful in the development of a maintenance strategy of preventive LNG cargo containment systems in maritime LNG transportation.

Retweet prediction is an important task related to different problems such as information spreading analysis, the automatic detection of fake news, social media monitoring, etc. In this study we explore the possibilities of retweet prediction based on heterogeneous data sources. In order to classify the tweet according to the amount of retweets, we combine features extracted from the multilayer network and the text. More specifically, we introduce a multilayer framework that proposes the multilayer network representation of Twitter. This formalism captures different users' actions and complex relationships as well as other key properties of communication on Twitter. We select a set of local network measures from each layer and construct a set of multilayer network features. In addition, we adopt a BERT-based language model, namely Cro-CoV-cseBERT to capture high-level semantics and structure of tweets as a set of text features. Then, we train six machine learning (ML) algorithms: random forest, multilayer perceptron, light gradient boosting machine, category embedding model, neural oblivious decision ensembles and attentive interpretable tabular learning model in the task of retweet prediction. We compare the performance of all six algorithms in three different setups (i) using only text features, (ii) using only multilayer network features and (iii) using both sets of features. We evaluate all setups in terms of standard evaluation measures i.e. precision, recall, F1-score and accuracy. For this task, we first prepare and use an empirical dataset of 199,431 tweets in the Croatian language posted during the period between January 1, 2020 and May 31, 2021. Our results indicate that by integrating multilayer network features with text features the prediction model would perform better than using just one set of features.

This paper presents an approach to the application of the Model-Based Systems Engineering (MBSE) and Model-Based Systems Architecting (MBSA) principles to develop a Model-Based Pattern Language (MBPL). It takes too long for systems engineers and architects to develop a new system from scratch, particularly new space-based systems derived from the existing space systems architectures. A pattern language is a holistic view of reusable logical model artifacts; many are interdisciplinary and introductory, if at all. The results are mostly a combination of the application-specific logical solution, which further results in the best possible overall solution. The main benefit of the pattern language is reducing the time and validation required to generate a new space-based system architecture; this approach will develop top-level requirements in the initial phase of the system development. The rationale of the methodology proposed by the paper is as follows, collect, and decompose published literature and other open-source information available on space system architectures and system models; develop SysML models for systems, subsystems, products, assembly, subassembly level, and mission-specific requirements using CAMEO SysML software. Arrange these patterns to develop a functional ontology and construct a logical architecture pattern library. This approach created, updated, and managed SysML pattern language, which evaluated the expedited new model construction. Again, our objective is to develop a logical pattern language using public domain information and evaluate patterns by constructing a new space mission concept—for example, planetary surface habitat.

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

(1) Background: Information overload challenges decision-making in the Industry 4.0 era. While Natural Language Processing (NLP), especially Automatic Text Summarization (ATS), offers solutions, issues with factual accuracy persist. This research bridges cognitive neuroscience and NLP, aiming to improve model interpretability. (2) Methods: This research examined four fact extraction techniques: dependency relation, named entity recognition, part-of-speech tagging, and TF-IDF, in order to explore their correlation with human EEG signals. Representational Similarity Analysis (RSA) was applied to gauge the relationship between language models and brain activity. (3) Results: Named entity recognition showed the highest sensitivity to EEG signals, marking the most significant differentiation between factual and non-factual words with a score of -0.99. The dependency relation followed with -0.90, while part-of-speech tagging and TF-IDF resulted in 0.07 and -0.52, respectively. Deep language models such as GloVe, BERT, and GPT-2 exhibited noticeable influences on RSA scores, highlighting the nuanced interplay between brain activity and these models. (4) Conclusions: Our findings emphasize the crucial role of named entity recognition and dependency relations in fact extraction and demonstrate the independent effects of different models and TOIs on RSA scores. These insights aim to refine algorithms to reflect human text processing better, thereby enhancing ATS models’ factual integrity.

Virtual assistants (VAs) have gained widespread popularity across a wide range of applications, and the integration of Large Language Models (LLMs) such as ChatGPT has opened up new possibilities for developing even more sophisticated VAs. However, this integration poses new ethical issues and challenges that must be carefully considered, particularly as these systems are increasingly used in public services: transfer of personal data, decision-making transparency, potential biases, and privacy risks. This paper, an extension of the work presented at IberSPEECH 2022, analyzes the current regulatory framework for AI-based VAs in Europe and delves into ethical issues in depth, examining potential benefits and drawbacks of integrating LLMs with VAs. Based on the analysis, this paper argues that the development and use of VAs powered by LLMs should be guided by a set of ethical principles that prioritize transparency, fairness, and harm prevention. The paper presents specific guidelines for the ethical use and development of this technology, including recommendations for data privacy, bias mitigation, and user control. By implementing these guidelines, the potential benefits of VAs powered by LLMs can be fully realized while minimizing the risks of harm and ensuring that ethical considerations are at the forefront of the development process.

It is essential to deal with data scattered among heterogeneous information sources, which can be structured, semi-structured, or unstructured, to give consumers a cohesive perspective of the data. Information gathering is challenging as a result, and one of the major causes of this is that data sources are developed to support specific applications. A method to simplify this procedure is to use ontology representation as an intermediate step. An ontology represents a knowledge structure that reasonably reflects the real world's complexity and is ideally used in many industries today. This research aims to enhance the functionality of a global ontology system by implementing and integrating a natural language query system. Leveraging NLP-based approaches, we constructed SPARQL queries for our ontologies to facilitate natural language translation into a well-structured query format. A dedicated query component was developed to transform natural language questions into SPARQL queries, with the selection of the optimal query graph to generate the final queries. In the subsequent phase, we explored the integration of distinct sentence encoders to improve latent sentence representations during query construction. The generated SPARQL queries were executed on the global ontology output and then translated into source-specific questions. This innovative approach enables unified access to heterogeneous data sources through a user-friendly natural language querying interface.

In today's world, news events are emerging incessantly. Classifying the same event reported by different countries is of significant importance for public opinion control and intelligence gathering. Due to the diverse types of news, relying solely on translators would be costly and inefficient, while depending solely on translation systems would incur considerable performance overheads in invoking translation interfaces and storing translated texts. To address this issue, we mainly focus on the clustering problem of cross-lingual news. To be specific, we use a combination of sentence vector representations of news headlines in a mixed semantic space and the topic probability distributions of news content to represent a news article. In the training of cross-lingual models, we employ knowledge distillation techniques to fit two semantic spaces into a mixed semantic space. We abandon traditional static clustering methods like K-Means and AGNES in favor of the incremental clustering algorithm Single-Pass, which we further modify to better suit cross-lingual news clustering scenarios. Our main contributions are as follows: (1) We adopt the English standard BERT as the teacher model and XLM-Roberta as the student model, training a cross-lingual model through knowledge distillation that can represent sentence-level bilingual texts in both Chinese and English. (2) We use the LDA topic model to represent news as a combination of cross-lingual vectors for headlines and topic probability distributions for content, introducing concepts such as topic similarity to address the cross-lingual issue in news content representation. (3) We adapt the Single-Pass clustering algorithm for the news context to make it more applicable. Our optimizations of Single-Pass include adjusting the distance algorithm between samples and clusters, adding cluster merging operations, and incorporating a news time parameter.

In the field of industrial process monitoring, more and more interest is being shown in specific process categories. These include time-varying processes, that is, those processes whereby the response one receives as output from the system depends on when the input signal is sent into it. There are many reasons for this process variability and such contexts are not always analyzed with this operational characteristic at their core. At the same time, interest in certain categories of techniques is also becoming more prominent, to meet certain application needs. Among these, clustering and unsupervised techniques in general are gaining ground. This is largely due to the difficulty of finding fault data with which to train, for example, supervised models. On the other hand, the clustering technique, on which this contribution focuses, also makes it possible to compensate for the lack of complete knowledge of the structure of the process itself. With these two considerations in mind, this contribution proposes a literature review on the topic of clustering applied in time-varying contexts, in the maintenance field. The aim is to present an overview of the main fields of study, the role of clustering in this context and the main clustering techniques used.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

Decision-making is a complex process of selecting an option from the given choices by analyzing the background information like risk, loss, and gain within the alternative options presented. It has been observed in earlier studies that people are prompt to make less rational decisions when choices are given in a language less known to them. Therefore, to understand the effect of languages on decision-making, we have questioned native Hindi speakers in French and English. French being the foreign language, and English as their second language. Thus, this effect of a non-native language brings to light the important role that the native language plays routinely in judgment and decision-making. In this paper, we developed a Neuropsychological assessment to decipher the effects on decision-making between choices when given in foreign language and second language in comparison with the native language of an individual, which is termed as foreign language effect(Fle). We have explored various possible situations to understand the foreign language effect(Fle) in decision-making and does this change translates when the decision is to be made in the second language. Our study concludes that the Foreign language is least affected by the intuitive biases, followed by the second language, and the native language is most affected by it.

At the end of 2018, a high school student asked a question in Zhihu community, claiming that he had proved Goldbach's conjecture. The problem caused an explosive reaction and a large number of users participated in the discussion. And has caused the widespread influence. On January 1, 2019, the questioner issued his "proof". His proof was soon proved wrong. The heated discussion caused by the incident contains a lot of information of social science analysis value. Therefore, we follow up the event in the first time and build a time series dataset for the event. Taking the questioner's "proof" as the dividing line, all the answers, comments, sub comments and user information of writing these texts before and after two days were recorded. This series of temporal information can reflect the dynamic features of the interaction between user opinions, and the impact of exogenous shocks (proof release) on community opinions. The dataset can be used not only for the demonstration of various social network analysis algorithms, but also for a series of natural language processing tasks such as fine-grained sentiment analysis for long texts, as well as multimodal tasks combining natural language processing and social network analysis. This paper introduces the characteristics and structure of the dataset, shows the visualization effect of social network, and uses the dataset train the benchmark model of emotion analysis.

Coronavirus, also known as COVID-19, has been declared a pandemic by the World Health Organization (WHO). At the time of conducting this study, it had recorded over 1.6 million cases while more than 105,000 have died due to it, with these figures rising on a daily basis across the globe. The burden of this highly contagious respiratory disease is that it presents itself in both symptomatic and asymptomatic patterns in those already infected, thereby leading to an exponential rise in the number of contractions of the disease and fatalities. It is therefore crucial to expedite the process of early detection and diagnosis of the disease across the world. The case-based reasoning (CBR) model is an effective paradigm that allows for the utilization of cases’ specific knowledge previously experienced, concrete problem situations or specific patient cases for solving new cases. This study therefore aims to leverage the very rich database of cases of COVID-19 to solve new cases. The approach adopted in this study employs the use of an improved CBR model for state-of-the-art reasoning task in classification of suspected cases of Covid19. The CBR model leverages on a novel feature selection and semantic-based mathematical model proposed in this study for case similarity computation. An initial population of the archive was achieved with 68 cases obtained from the Italian Society of Medical and Interventional Radiology (SIRM) repository. Results obtained revealed that the proposed approach in this study successfully classified suspected cases into their categories at an accuracy of 97.10%. The study found that the proposed model can support physicians to easily diagnose suspected cases of Covid19 base on their medical records without subjecting the specimen to laboratory test. As a result, there will be a global minimization of contagion rate occasioned by slow testing and as well reduce false positive rates of diagnosed cases as observed in some parts of the globe.

Task-Based Instruction (TBI) is a dynamic approach in tertiary language education that emphasizes the integration of authentic and meaningful tasks to enhance language learning outcomes. This study aims to explore the implementation of TBI in the Philippines, investigate its cognitive benefits and transformative nature, identify pedagogical considerations, and provide recommendations for optimization. The study employed a qualitative research design, with data collected from five private schools in Iligan City. A purposive sampling procedure was used to select 20 participants who engaged in interviews, focus group discussions, and thematic analysis. The results revealed that TBI positively influenced language proficiency, cognitive development, learner autonomy, intercultural competence, and pedagogical considerations. Participants reported enhanced language skills and increased confidence in real-life language use. They also highlighted the development of critical thinking, problem-solving, and decision-making skills through engaging in challenging tasks. TBI was found to empower learners by promoting autonomy, ownership, and self-directed learning. Additionally, it cultivated intercultural communicative competence and fostered appreciation for diverse perspectives. Pedagogical considerations included task design, clear instructions, scaffolding, and feedback, while recommendations focused on optimizing TBI, integrating technology-enhanced learning, and supporting professional development for educators. This research contributes to the growing body of literature on TBI in tertiary language education and underscores its potential for creating transformative learning experiences. The findings provide valuable insights for educators, curriculum designers, and policymakers in enhancing language education practices in the Philippines and beyond.

Objective: Food security during public health emergencies relies on situational awareness of needs and resources. Artificial intelligence (AI) has revolutionized situational awareness during crises, allowing the allocation of resources to needs through machine learning algorithms. Limited research exists monitoring Twitter for changes in the food security-related public discourse during the COVID-19 pandemic. We aim to address that gap with AI by classifying food security topics on Twitter and showing topic frequency per day. Methods: Tweets were scraped from Twitter from January 2020 through December 2021 using food security keywords. Latent Dirichlet Allocation (LDA) topic modeling was performed, followed by time-series analyses on topic frequency per day.Results: 237,107 tweets were scraped and classified into topics, including food needs and resources, emergency preparedness and response, and mental/physical health. After the WHO’s pandemic declaration, there were relative increases in topic density per day regarding food pantries, food banks, economic and food security crises, essential services, and emergency preparedness advice. Threats to food security in Tigray emerged in 2021.Conclusions: AI is a powerful yet underused tool to monitor food insecurity on social media. Machine learning tools to improve emergency response should be prioritized, along with measurement of impact. Further food insecurity word patterns testing, as generated by this research, with supervised machine learning models can accelerate the uptake of these tools by policymakers and aid organizations.

Biosynthetic gene clusters are specific genomic regions in microorganisms, like bacteria and fungi, responsible for producing bioactive compounds. Identifying these clusters is complex due to their diverse nature. This research presents a comprehensive approach to effective BGC identification. The study focuses on five classes of Natural Products: PKS , NRPS, RiPP, Terpenes, and Hybrid PKS-NRPS. Data was gathered from the MiBIG database in GBK format. Protein sequences from each file were extracted, and sequences under the same BGC ID were combined. Physicochemical properties were calculated, and sequence embeddings were generated using NLP techniques like CountVec, TFIDF, and Word2Vec specific to each NP class. An integrated feature matrix was created by merging physicochemical properties and generated embeddings. This matrix was used for training and testing of nine ML models such SVM, RF and many more. The study explored data balancing techniques with and without SMOTE and employed Grid Search for parameter optimization. This led to six datasets and 54 models. The LR model, using TFIDF with SMOTE, emerged as the most effective, achieving an accuracy of 0.96, AUC of 0.9912, and other strong metrics. This method enhances BGC identification for drug development, offering a broader understanding of their applications in medicine and biotechnology.

This review paper investigates the influence of gestures on foreign language (FL) vocabulary learning through a series of experiments conducted in our laboratory. The manipulation of the gesture-word relationship was a consistent factor across the studies. Firstly, we examined the impact of gestures on noun and verb learning. The results revealed that participants exhibited better learning outcomes when FL words were accompanied by congruent gestures compared to a no gesture condition. This suggests that gestures have a positive effect on FL learning when there is a meaningful connection between the words and the accompanying gestures. However, in general, the recall of words in conditions where gestures were incongruent or lacked meaning was lower than in the no gesture condition. This indicates that under certain circumstances, gestures may have a detrimental impact on FL learning. We analyzed these findings in terms of their implications for facilitating or interfering with FL acquisition. Secondly, we addressed the question of whether individuals need to physically perform the gestures themselves to observe the effects of gestures on vocabulary learning. To explore this, participants were divided into two experimental groups. In one group, participants learned the words by actively performing the gestures ("do" learning group), while the other group simply observed the gestures performed by others ("see" learning group). The processing of congruent gestures facilitated the recall of FL words in both the "see" and "do" learning groups. However, the interference effect associated with processing incongruent gestures was more pronounced in the "see" learning group than in the "do" learning group. Thus, the performance of gestures appears to mitigate the negative impact that gestures may have on the acquisition of FL vocabulary. In conclusion, our findings suggest that iconic gestures can serve as an effective tool for learning vocabulary in a FL, particularly when the gestures align with the meaning of the words. Furthermore, the active performance of gestures helps counteract the negative effects associated with inconsistencies between gestures and word meanings. Consequently, if a choice must be made, a FL learning strategy in which learners acquire words while making gestures congruent with their meaning would be highly desirable.

Stop words are very important for information retrieval and text analysis investigation. This study aimed to automatically analyze and detect stop words in texts in the Uzbek language. Because of the limited availability of methods for automatic search of stop words of texts in Uzbek we analyzed a newly prepared corpus. The Uzbek language belongs to the family of agglutinative languages. As with all agglutinative languages, we can explain that the detection of stop words in Uzbek texts is a more complex process than in inflected languages: In inflected languages, words such as auxiliary words, articles, prepositions can be included in the stop words group. In agglutinative languages, the meanings of such words are hidden in the text. Therefore, it is not appropriate to apply all known methods of stop words detection in inflected languages directly to agglutinative languages. In this work, the “School corpus” which contains 731156 Uzbek words has been investigated. The bigram method of analysis was applied to the corpus. We proposed the collocation method of detecting stop words of the corpus. We proposed the method of automatically detecting stop words of texts in Uzbek. It is shown that the collocation method is 6 times better than the bigram method.

Arabic is present in the Arab world and beyond. It is used as an official (or co-official) language in the Arab World (this refers to the twenty-two member states of the Arab League). Also, Arabic has the status of a national language in Mali, Niger, and Senegal. Besides, it is spoken in linguistic enclaves in Nigeria, Cyprus, Turkey, Uzbekistan, Iran, and Afghanistan. In addition, it is employed as the liturgical language in Muslim countries and countries with a Muslim minority all over Africa and Asia. As a result of the migration to Western countries since the end of the nineteenth century, Arabs and Arabic has been present in such countries. The presence of Arabs in Western countries raises the following question: Are these Arabs language maintainers or language shifters? The present article is an attempt to answer this question through reviewing a number of studies that have dealt with Arabic language maintenance among the Arabs living in Western countries (namely the United States of America, the United Kingdom, Canada, Australia, New Zealand, Sweden, Greece, and France), deducing from these studies the major trends in Arabic language maintenance among these Arabs, and providing a critique of the studies.

Hallyu or the Korean wave has sweeped through nations especially the Philippines. This exploratory study offers a dip into the effects of the Hallyu wave on a Filipino speaker through ambient exposure, consequently on the development of a Korean proto-lexicon through indirect vocabulary acquisition. Finally, a focus group discussion and a preliminary assessment tested out the waters of the effects of Hallyu on casual Filipino speakers. A thorough statistically comprehensive qualitative study on the acquisition framework is recommended to provide substantial evidence to support the framework.

Based on the teaching material of "Robotics" course, this paper studied the automatic knowledge graph construction, including knowledge points extraction and knowledge point relation extraction. We proposed a new method of extracting the first-level, second-level, and third-level knowledge points as well as their prerequisite relations of knowledge points in the textbook. For the problem of insufficient knowledge of the pre-trained language model in the specific field, methods such as incremental pre-training and optimization of cost functions are employed to integrate subject knowledge into the pre-trained language model, thus improving its effectiveness. To overcome the problem that the traditional method of relationship extraction can not be applied directly to the extraction of teaching materials, a new scheme for knowledge point relationship extraction based on keyword relationship is proposed. The experimental data from textbooks shows that the F1 score of knowledge point extraction reaches 93%, considerably improved compared to the traditional model. Consequently, the knowledge point entity extraction and relationship extraction methods based on the pre-trained model can effectively extract structured information and facilitate the automatic construction of knowledge graphs.

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

This study is to explore the feasibility using neural network (NN) and deep learning to diagnose three common respiratory diseases with only few symptom words. These three diseases are nasopharyngitis, upper respiratory infection, and bronchitis/bronchiolitis. Through natural language processing, the symptom word vectors are encoded by GPT-2 and classified by the last linear layer of the NN. The experimental results are promising, showing that this model achieves a high performance in predicting all these three diseases. They reach 90% in accuracy, which suggests the implications of the developed model, highlighting its potential use in assisting patients understanding their conditions via a remote diagnosis. Unlike previous studies that focus on extracting various categories of information from medical records, this study directly extracts sequential features from unstructured text data, reducing the effort required for data pre-process.

In an era marked by rapid technological progress and global dynamics, the Neo-Language Acquisition and Learning Theory challenges conventional language acquisition paradigms through its conceptualization of 'Grit: The Unyielding Will to Connect,' emphasizing determination, motivation, and adaptability as the primary drivers of language learning, transcending age-related constraints and critical periods. This theory also underscores 'Self-Preservation: Language as the Canvas of Reality,' as language plays a pivotal role in preserving and conveying our individual and collective experiences. Recent global events have underscored the theory's relevance, prompting a reevaluation of language education in response to changing circumstances. Moreover, 'Techno-Training: Language Acquisition and Learning in the Digital Age' is integral to the theory, as it recognizes the influence of technology on modern language education. Beyond traditional methods, these three reshape our fundamental understanding of said theory. Drawing from historical evidence, psychological principles, and contemporary applications, they supported the conceptualization of the theory itself. Overall, the Neo-Language Acquisition and Learning Theory revolutionizes language education, spotlighting the power of motivation, determination, and adaptability to navigate the evolving landscape of language learning and acquisition.

This systematic review examines the potential of digital language learning in contributing to students' cognitive gains. The study reviews existing research on the relationship between digital language learning and cognitive benefits, with a focus on enhanced problem-solving skills, memory, and multitasking ability. The findings indicate that higher levels of digital competences correlate positively with language proficiency outcomes, suggesting that participants with greater digital skills achieve better language learning outcomes. Digital technologies offer interactive and engaging methods of learning, which can positively impact retention and understanding. However, the study also acknowledges the limitations of digital foreign language learning, such as the lack of face-to-face interaction and the need for high motivation and discipline. The research questions explored in this study are: (1) Does digital language learning contribute to cognitive gains in foreign language education? and (2) What are the pedagogical implications for cognitive improvement in digital foreign language education? The study employs the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) methodology to identify and analyze relevant research articles. The results of the review suggest that working with printed texts may be more effective for cognitive gains compared to electronic texts. Additionally, implementing more senses through digital language education appears to be beneficial for cognitive gains. The article concludes by discussing the implications of these findings and the need for further research in this area.

There is a serious concern regarding framing rules and guidelines to regulate the content on OTT platforms that needs urgent attention. In the Current Scenario, the use of vulgar language in the public domain on OTT platforms needs to take seriously. Some OTT platforms heavenly use foul language, which is open to children that cause a huge psychological impact on them. The use of vulgar language, including profanity and bad words, has to be regulated strictly. Web series uses obscene, abusive words and foul language with excessive usage. This review paper highlights the excessive use of swear words, profane language, and vulgar expletives on OTT platforms.

When integrating data from different sources, there are problems of synonymy, different languages, concepts of different granularity. This paper proposes a simple but effective approach to evaluate the semantic similarity of short texts, especially keywords. The method is capable of matching keywords from different sources and languages by exploiting transformers and WordNet-based methods. Key features of the approach include its unsupervised pipeline, mitigation of the lack of context in keywords, scalability for large archives, support for multiple languages and real-world scenarios adaptation capabilities. The work aims to provide a versatile tool for different cultural heritage archives without requiring complex customization. The objectives of the paper are to explore different approaches to identifying similarities in 1- or n-gram tags, to evaluate and compare different pre-trained language models, and to define integrated methods to overcome limitations. Tests to validate the approach have been conducted using the QueryLab portal, a search engine for cultural heritage archives, to evaluate the proposed pipeline.

Software engineers from all over the world solve independently a lot of similar problems. In this condition the problem of code or even better architecture reusing becomes an issue of the day. In this paper two phase approach to determining the functional and structural likenesses of software projects is proposed. This approach combines two methods of artificial intelligence: natural language processing techniques with a novel method for comparing software projects based on ontological representation of their architecture automatically obtained from the projects source code. Additionally several similarity metrics are proposed to estimate similarity between projects.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

(1) Background: Attention Deficit Hyperactivity Disorder (ADHD) and Developmental Language Disorder (DLD) are neurodevelopmental disorders that affect various areas of chil-dren’s development, such as language. There is an emerging idea that ADHD is characterised by the presence of language difficulties, which could be explained by the high comorbidity between ADHD and DLD. The purpose of this study is to analyse the empirical evidence of language com-petence in children aged 6–17 years old, diagnosed with ADHD and/or DLD. (2) Method: Fifteen studies with experimental designs were identified from Scopus, PsycINFO and WoS databases, reporting on language skills in children diagnosed with ADHD and/or DLD. Studies relating ex-ecutive functioning to language skills in this target population were also included. (3) Results: The literature is heterogeneous and different components of language are also examined. Even though the results are contradictory they convincingly demonstrate that there are overlapping symptoms between ADHD and DLD, such as language skills and executive functions. (4) Conclusions: the differences in the samples limit the generalisability of the results. Therefore, this review highlights the importance of considering language skills when designing individualised interventions for the population with ADHD and DLD, both in comorbidity and in isolation.

while enjoying a relative positive revival in the digital age, Esperanto and the assessment of its language vitality is often problematic and prone to gross errors, and therefore a theoretical re-flection is required. Unlike other lesser-used languages, Esperanto is intergenerationally trans-mitted mainly outside the family, and so Fishman’s GIDS and subsequent scales such as the EGIDS cannot be applied straightforwardly for language vitality diagnosis and estimation. In particular, it is the social movement with its language activists who guarantee its vitality and developing, for more than a century. A key aspect is the digital domain, where the relatively good positioning of Esperanto does not reflect in a parallel increase in the number of activists. This paper critically assesses the digital language vitality of Esperanto on the basis of its language ide-ology and other sociolinguistic data as a starting point for a discussion to overcome the limits of Blanke’s (2006) scale of language vitality of Esperanto and its rivals. This assessment eventually leads to a more general reflection on the role of ‘coolification’, i.e., the positive effects on language attitudes and development thanks to digital visibility, its limits and the issue of placing it in the context of language vitality in general.

This paper investigates women’s empowerment and their active involvement in governance aimed at promoting sustainable development. The study focuses on examining the roles and processes of co-creation of nature-based solutions (NBS) for water management in Milan. Three research directions were explored: 1) to determine gender-based roles within local governance; 2) to detect semantic groups of NBS based on stakeholders' gender; c) to analyze gender-based linguistic and conceptual patterns of NBS. To achieve our objectives, we converted a sample of audio-video interviews of local stakeholders into textual data along with metadata indicating speakers' roles and gender. Descriptive statistics were applied to explore the governance's roles. We employed a combination of textual analysis and network analysis to identify thematic groups of NBS, and applied a word embedding approach to uncover linguistic patterns indicative of semantic sub-structures. The findings revealed significant demographic diversity. Male stakeholders perceive sustainable development as a process driven by the circular economy and the coordination of territorial authorities, while female stakeholders envision a transformative approach rooted in science, culture, and collaboration. The semantic sub-structure analysis highlighted a tendency among male governance to emphasize specialized skills, whereas female governance placed greater emphasis on problem definition rather than resolution.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96\% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

The use of artificial intelligence in natural language processing (NLP) has significantly contributed to the advancement of natural language applications such as sentimental analysis, topic modeling, text classification, chatbots, and spam filtering. With a large amount of text generated each day from different sources such as webpages, blogs, emails, social media, and articles, one of the most common tasks in natural language processing is the classification of a text corpus. This is important in many institutions for planning, decision-making, and archives of their projects. Many algorithms exist to automate text classification operations but the most intriguing of them is that which also learns these operations automatically. In this study, we present a new model to infer and learn from data using probabilistic logic and apply it to text classification. This model, called GenCo, is a multi-input single-output (MISO) learning model that uses a collaboration of partial classifications to generate the desired output. It provides a heterogeneity measure to explain its classification results and enables the reduction of the curse of dimensionality in text classification. The classification results are compared with those of conventional text classification models, and it shows that our proposed model has a higher classification performance than conventional models.

Leveraging the open-world understanding capacity of large-scale visual-language pre-trained models has become a hot-spot in point cloud classification. Recent approaches rely on transferable visual-language pre-trained models, classifying point clouds by projecting them into 2D images and evaluating consistency with textual prompts. These methods benefit from the robust open-world understanding capabilities of visual-language pre-trained models and require no additional training. However, they face several challenges summarized as prompt ambiguity, image domain gap, view weights confusion, and feature deviation. In response to these challenges, we propose PointBLIP, a zero-training point cloud classification network based on the recently introduced BLIP-2 visual-language model. PointBLIP is adept at processing similarities between multi-images and multi-prompts. We separately introduce a novel method for point cloud zero-shot and few-shot classification, which involves comparing multiple features to achieve effective classification. Simultaneously, we enhance the input data quality for both the image and text sides of PointBLIP. In point cloud zero-shot classification tasks, we outperform state-of-the-art methods on three benchmark datasets. For few-shot classification tasks, to the best of our knowledge, we present the first zero-training few-shot point cloud method, surpassing previous works under the same conditions and showcasing comparable performance to full-training methods.

Natural language processing (NLP) is being widely used globally for a variety of value-creation tasks ranging from chat-bots and machine translations to sentiment and topic analysis and multilingual large language models (LLMs). However, most of the advances are initially implemented within the English language framework, and it takes time and resources to develop comparable resources in other languages. The advances in machine translations have enabled the rapid and effective conversion of content in global languages into English and vice-versa. This creates potential opportunities to apply English language NLP methods and tools to other languages via machine translations. However, although this idea is powerful, it needs to be validated and processes and best practices need to be developed and kept updated. The present research is an effort to contribute to the development of best practices and an evaluation framework. We present a systematic and repeatable state-of-the-art process to evaluate the viability of applying English language sentiment analysis tools to Italian text by using multiple English language machine translation mechanisms such that it can be easily extended to other languages. hor[RU,RA]{\large Richard Anderson} \address[RU]{\large Rutgers University, USA} \address[RA]{\large rick.anderson@rutgers.edu} \author[RU]{\large Carmela Scala} \author[RU]{\large Jim Samuel} \author[UC]{\large Vivek Kumar} \address[UC]{\large University of Cagliari, Italy} \author[RU]{\large Parth Jain}

Large Language Models (LLMs) have revolutionized the field of Artificial Intelligence with their ability to understand and generate natural language discourse. This has led to the use of LLMs in various creative fields such as music, art, and storytelling, which has sparked a debate on the impact of LLMs on human creativity. This article explores the cyclic effect of LLMs on human creativity, where LLMs can generate an ever-evolving cycle of creative output from both humans and machines. The article also highlights the importance of responsible and ethical use of LLMs, including privacy and copyright issues with the training data used by LLMs. The article emphasizes the need for transparency, data security measures, and AI governance policies to protect user data and ensure the safe use of LLMs. It also calls for the development of educational materials and resources to increase public understanding of LLMs and their ethical implications. The article concludes by highlighting the potential of LLMs as powerful tools for communication and education, but also emphasizes the need for ethical considerations to ensure the responsible and beneficial use of LLMs in society.

Micro-level language policy and planning (LPP) primarily concerns local actors' decision-making on matters in relation to language(s) and its users. Despite a growing body of literature focusing on micro language planning in educational settings, there is a scarcity of research examining early childhood education settings such as micro-level LPP context for young English language learners. By adopting a case study approach, the present study examined the educators' enactment of agency in micro-planning the English language education policy (LEP) in one Chinese kindergarten and the associated factors shaping their agency. Our study revealed that the sustainable implementation of the kindergarten English LEP depended on the principal, native English-speaking teachers, and the Chinese assistant teachers' different degrees of agency. Also, the research findings indicated an array of contextual and individual factors nested in a hierarchical structure that facilitated, guided, and constrained the educators' agency in a role-and circumstance-dependent manner. This study contributes to the pertinent literature by casting nuanced light on the different educators' contributions to the micro-level LPP against a national policy that does not endorse early-year English language education.

Paraphrase Generation is one of the most important and challenging tasks in the field of Natural Language Generation. The paraphrasing techniques help to identify or to extract/generate phrases/sentences conveying the similar meaning. The paraphrasing task can be bifurcated into two sub-tasks namely, Paraphrase Identification (PI) and Paraphrase Generation (PG). Most of the existing proposed state-of-the-art systems have the potential to solve only one problem at a time. This paper proposes a light-weight unified model that can simultaneously classify whether given pair of sentences are paraphrases of each other and the model can also generate multiple paraphrases given an input sentence. Paraphrase Generation module aims to generate fluent and semantically similar paraphrases and the Paraphrase Identification systemaims to classify whether sentences pair are paraphrases of each other or not. The proposed approach uses an amalgamation of data sampling or data variety with a granular fine-tuned Text-To-Text Transfer Transformer (T5) model. This paper proposes a unified approach which aims to solve the problems of Paraphrase Identification and generation by using carefully selected data-points and a fine-tuned T5 model. The highlight of this study is that the same light-weight model trained by keeping the objective of Paraphrase Generation can also be used for solving the Paraphrase Identification task. Hence, the proposed system is light-weight in terms of the model’s size along with the data used to train the model which facilitates the quick learning of the model without having to compromise with the results. The proposed system is then evaluated against the popular evaluation metrics like BLEU (BiLingual Evaluation Understudy):, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), METEOR, WER (Word Error Rate), and GLEU (Google-BLEU) for Paraphrase Generation and classification metrics like accuracy, precision, recall and F1-score for Paraphrase Identification system. The proposed model achieves state-of-the-art results on both the tasks of Paraphrase Identification and paraphrase Generation.

The purpose of this systematic review is to provide second language acquisition (SLA) researchers with an overview of research trends in this field in the last ten years (2009-2019). In doing so, three international peer-reviewed journals, Studies in Second Language Acquisition, Language Teaching Research, and The Modern Language Journal, were selected. 150 articles were systematically selected and analyzed. The analysis of data resulted in identifying six descriptive themes. Results showed that some areas of second language acquisition still need further exploration while some areas are of great interest for researchers. Some suggestions for future research as well as implications of the study were discussed in detail.

Purpose. This article examines the use of English medium instruction (EMI) for teaching Japanese as a foreign language (JFL) by non-native speakers with a focus on multilingual classrooms. The study also explores teachers’ positive and negative beliefs about using EMI in classroom settings for JFL instruction.Methods and procedure. Two hundred sixty-one non-native Japanese language teachers worldwide voluntarily participated in the survey, answering the questionnaire (Google Forms and Jotforms) used to gather data. Both qualitative and quantitative methods were employed. The research instrument was piloted before the main study and was found to be effective and adequate to elicit the desired data. The research questions aimed to identify whether there were any relationships between the use of EMI and the multilingual classroom. Findings. The results showed a clear correlation between the extensive use of EMI and the multilingual character of JFL multilingual classrooms. Translanguaging turned out to be a common practice adopted by non-native Japanese teachers regardless of the primary language of instruction. The article concludes that EMI can be a valuable tool for JFL instruction in multilingual classrooms. Based on the investigation of the teachers’ beliefs, the study results showed a changing positive attitude towards English employed in JFL classrooms. Implications for research and practice. The findings can be used further to investigate EMI in JFL instructional practices in multilingual classrooms, to improve the quality of JFL instruction, and to facilitate the integration of multilingual education into foreign language teaching. Future research can explore the effectiveness of EMI in different JFL contexts and investigate the impact of EMI on students’ language learning outcomes.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

This paper addresses the grammatical challenges associated with the development of clause complexity, focusing on the performance of a group of monolingual Spanish-speaking schoolchildren with Specific Language Impairment/Developmental Language Disorder (SLI/DLD) in a longitudinal corpus of oral narrative samples. The study examines the presence of interclause relations of subordination and equivalence (hypotaxis and parataxis) in language samples of two groups: an experimental group made up of 24 schoolchildren with SLI/DLD and a control group made up of 24 schoolchildren with typical development (TD). The results show that while both groups use parataxis as the most common relation between clauses in all school grades, there is a significant decrease in paratactic relations and a significant increase in hypotactic relations from first to fourth grade of primary education. Although the development patterns are highly similar, the SLI/DLD group shows greater difficulties in mastering more complex (hypotactic) relations in fourth grade compared to the control group, indicating that they are less sophisticated in the use of these types of complex relations. These findings suggest that focused support on the most complex structures is needed towards the fourth grade of primary education, given the demands of the school academic register from 6 and 7 years of age, and the potential problems that the development of clause complexity can cause in school-age children.

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

With the widespread Application of Virtual Reality (VR) in education, optimizing foreign language learning in VR has become a focal point of research. This paper introduces a comprehensive theoretical framework (VR-CCL) based on constructivism and cognitive load theory to enhance foreign language learning in VR. Through a literature review, we explore the applications of VR in education, foreign language learning theories, and prior works on technology-assisted language learning. We further detail the three main components of the VR-CCL framework and validate its effectiveness through two case studies: Duolingo VR and Rosetta Stone VR. Finally, we discuss the strengths and limitations of the framework and its implications for educators and developers.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

This paper discusses some of the most common misconceptions about large language models (LLMs), including the belief that they are sentient or conscious, that they are always accurate, and that they can replace human creativity. The paper also proposes a strategy for overcoming these misbeliefs, which involves educating the public about the capabilities and limitations of LLMs, developing guidelines for the responsible use of LLMs, and conducting more research to understand the potential impact of LLMs on society.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

In this article, we discuss problems that exist in modern SCADA systems and present a Controls-kt (formerly DataForge-controls) software development kit, that allows both to create a control system from scratch and provide integration with existing systems via Magix specification and connector.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

The sentiment of a word varies based on its context of usage: the words used around it and the part-of-speech it is used as. This paper proposes a technique to suggest the sentiment of a word by combining its part-of-speech and the semantic similarities of its co-occurrences with both context-specific and pre-trained embeddings to achieve powerful and fast results. A study was conducted across domains and sub-domains to measure variance of sentiment by switching domains and switching context within the same domain. Re-scoring a commonly used polarity lexicon showed that 10% of words changed scores while switching domains and 8% changed scores within domains while switching context. Part of Speech analysis on 65,353 commonly used sentiment lexicons showed that 81% of sentiment bearing (non-neutral) lexicons were of the tags NN (Common Noun), JJ (Adjective) or NNS (Proper Noun).

Since matter, energy and information are the three major components of the world, is there an interaction between information and matter? In the present work, the coevolution of human language and brain is taken as a case of interaction between information and brain. Some evidence that may show interactions between human language and brain revealed by previous researches is summarized in this paper, such as the language areas in the cerebral cortex of the modern human brain, the evolution of human language and brain in human history, and the genetic basis for the evolution of language. Based on the evidence, a dynamic model is developed to investigate the possible mechanism of coevolution of human language and brain. In the model, human language development and brain development reinforce each other: the developmental level of language can be promoted by advances in brain function due to language-related gene mutations, in turn, whether such mutations are selected positively can be influenced by the current developmental level of language. The coevolution of human language and brain can be taken as a case of interaction between information and matter.

Converting natural language into machine language that can be recognized by distributed systems is the core challenge of intelligent interactive interfaces and human-machine dialogue systems. The human-machine interface interaction of large distributed SCADA measurement and control system is tedious and the operation and maintenance cost is high, so it is significant to design an intelligent natural language interaction interface for distributed measurement and control system. In this paper, we design the intermediate language format of SCADA system, i.e., Key-value logic form, and then formulate the Text2SCADA framework and propose the TICS algorithm and SDPA algorithm, the former adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for basic natural language instructions, and the latter adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for relatively The latter one adopts the algorithm of dependent syntactic analysis for the structured representation of natural language instructions with relatively complex natural language instructions. Based on the above algorithms, a lightweight information extraction model based on DGCNN and probabilistic graph ideas is constructed, aiming to enhance the scientific generalization ability of the framework on unknown instruction sets. The experimental results show that the proposed intelligent natural language interface can better solve the human-machine interface interaction problem of distributed SCADA measurement and control system. The average accuracy, recall and F-value of instruction parsing reach 89.27\%, 89.28\% and 89.27\%, respectively. The average response time is 1.593 s. Especially, it provides a more convenient means of interaction for industrial and agricultural information control.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

Artificial intelligence (AI) techniques have grown rapidly in recent years in the context of computing with smart mobile phones that typically allows the devices to function in an intelligent manner. Popular AI techniques include machine learning and deep learning methods, natural language processing, as well as knowledge representation and expert systems, can be used to make the target mobile applications intelligent and more effective. In this paper, we present a comprehensive view on mobile data science and intelligent apps in terms of concepts and AI-based modeling that can be used to design and develop intelligent mobile applications for the betterment of human life in their diverse day-to-day situation. This study also includes the concepts and insights of various AI-powered intelligent apps in several application domains, ranging from personalized recommendation to healthcare services, including COVID-19 pandemic management in recent days. Finally, we highlight several research issues and future directions relevant to our analysis in the area of mobile data science and intelligent apps. Overall, this paper aims to serve as a reference point and guidelines for the mobile application developers as well as the researchers in this domain, particularly from the technical point of view.

This article propose a didactic, through games, tool based on information and communication technologies, in order to eliminate possible communication barriers and to promote the inclusion of students with hearing impairment in Physical Education classes. To this end, a dossier of traditional games has been developed. These are structured in turn into objectives, materials, organisation, graphic description and a QR code for each game. These codes are linked to different videos hosted on the YouTube platform, in which the explanation of the games, mentioned above, can be visualised graphically using sign language. The whole creative process is described in the article, as well as possible pedagogical applications of the use of the tools created for this purpose in other educational contexts.

In the dynamic landscape of E-commerce, the proliferation of user-generated queries regarding products highlights the critical need for advanced automatic question answering (AQA) systems. These systems are instrumental in harnessing the vast array of information available online to deliver immediate and informative responses to potential buyers. Recognizing the complexity of such queries, which often require synthesis of reviews, product specifications, and responses to similar questions, we introduce a sophisticated model, the Comprehensive E-commerce Answer Generation System (CEAGS). This model adeptly navigates the challenges posed by irrelevant data and sentiment ambiguity in user-generated content. Our approach leverages a dual-phase process of relevance determination and sentiment clarity, setting the stage for a transformative response generation mechanism. Empirical analyses reveal the superiority of CEAGS, with our relevance assessment framework outstripping existing models by a notable margin in precision metrics, and our answer generation module achieving unprecedented gains in content preservation and coherence. Notably, CEAGS marks a pioneering contribution to the E-commerce domain by integrating disparate information sources to formulate responses that are not only accurate but also contextually rich and user-centric.

This paper will argue that memory from early childhood underlies many practices and beliefs that we commonly refer to as “religious”. The consciousness of young children does not yet have certain features that characterizes adult consciousness. This paper will concentrate on four of these: (I) a reality that is recognizable; (II) a sense of temporal duration; (III) a sense of self; (IV) an experience of the world that is deeply affected by our acquaintance with (a) language. Absence of these features presumably characterizes the consciousness of infants. It also often characterizes mystical experiences. The paper will argue that the human tendency to engage in so-called religious practices and beliefs makes most sense on the assumption that adults somehow preserve the memory of their state of being in childhood.

The daVinci Surgical Robot has revolutionized minimally invasive surgery by enabling greater accuracy and less invasive procedures. However, the system lacks advanced features and autonomy necessary for it to function as a true partner. To enhance its usability, we introduce the implementation of a ChatGPT-based natural language robot interface. Overall, our integration of a ChatGPT-enabled daVinci Surgical Robot has potential to expand the utility of the surgical platform by supplying a more accessible interface. Our system can listen to the operator speak and, through the ChatGPT-enabled interface, translate the sentence and context to execute specific commands to alter the robot’s behavior or to activate certain features. For instance, the surgeon could say (even in Spanish) “please track my left tool” and the system will translate the sentence into a specific track command. This specific error-checked command will then be sent to the hardware which will respond by controlling the camera of the system to continuously adjust to center the left tool in the field of view. We have implemented many commands including “Find my tools” (tools that are not in the field of view) or start/stop recording that can be triggered based on a natural conversational context. Here, we present details of our prototype system, give some accuracy results, and explore its potential implications and limitations. We also discuss how artificial intelligence tools (such as ChatGPT) of the future could be leveraged by robotic surgeons to reduce errors and enhance the efficiency and safety of surgical procedures and even ask for help.

This paper aims to provide an overview of the complete process in the development of a Domain-Specific Language (DSL). It explains the construction steps such as preliminary research, language implementation, and evaluation. Moreover, it provides details for different key components which are commonly found in the DSLs such as the abstraction layer, DSL metamodel, and the applications. It also explains the general limitations related to the Domain-Specific Languages for Workflows.

Psychedelics are drugs capable of eliciting profound alterations in the subjective experience of the users, sometimes with long-lasting consequences. Because of this, psychedelic research tends to focus on human subjects, given their capacity to construct detailed narratives about the contents of their consciousness experiences. In spite of its relevance, the interaction between serotonergic psychedelics and language production is comparatively understudied in the recent literature. This review is focused on two aspects of this interaction: how the acute effects of psychedelic drugs impact on speech organization regardless of its semantic content, and how to characterize the subjective effects of psychedelic drugs by analyzing the semantic content of written retrospective reports. We show that the computational characterization of language production is an emergent powerful tool to predict the therapeutic outcome of individual experiences, relate the effects elicited by psychedelics with those associated with other altered states of consciousness, draw comparisons between the psychedelic state and the symptomatology of certain psychiatric disorders, and investigate the neurochemical profile and mechanism of action of different psychedelic drugs. We conclude that researchers studying psychedelics can considerably expand the range of their potential scientific conclusions by analyzing brief interviews obtained before, during and after the acute effects. Finally, we list a series of questions and open problems that should be addressed to further consolidate this approach.

In this paper we analyse spatial variation in Japanese dialectal lexicon by assembling a set of methodologies using theories in variationist linguistics and GIScience, and tools used in historical GIS. Based on historical dialect atlas data, we calculate a linguistic distance matrix across survey localities. The linguistic variation expressed through this distance is contrasted with several measurements, based on spatial distance, utilised to estimate language contact potential across Japan, historically and at present. Further, administrative boundaries are tested for their separation effect. Measuring aggregate association within linguistic variation can contrast previous notions of dialect area formation by detecting continua. Depending on local geographies in spatial subsets, great circle distance, travel distance and travel times explain a similar proportion of the variance in linguistic distance despite the limitations of the latter two. While they explain the majority, two further measurements estimating contact have lower explanatory power: least cost paths modelling contact before the industrial revolution, based on DEM and seafaring, and a linguistic influence index based on settlement hierarchy. Historical domain boundaries and present day prefecture boundaries are found to have a statistically significant effect on dialectal variation. However, the interplay of boundaries and distance is yet to be identified. We claim that a similar methodology can address spatial variation in other digital humanities, given a similar spatial and attribute granularity.

Background: Mental synthesis is the conscious purposeful process of synthesizing a novel mental image from objects stored in memory. In our everyday use of language, we rely on mental synthesis to communicate an infinite number of images with a finite number of words. In typical children, the timeline of mental synthesis acquisition is highly correlated with an increasing vocabulary. Children with ASD, on the other hand, may learn hundreds of words but never acquire mental synthesis. In these individuals, tests assessing vocabulary comprehension may fail to demonstrate the profound deficit in mental synthesis and the resulting inability to understand flexible syntax and spatial prepositions. Objective: We developed a 20-question parent-reported evaluation tool designed to quantitatively assess mental synthesis ability and to serve as a complimentary scale for Autism Treatment Evaluation Checklist (ATEC). Results: Internal reliability was good (Cronbach’s alpha > .9), and the MSEC exhibited adequate test-retest reliability after a three- and nine-months follow up period. The MSEC results positively correlated with the ATEC communication subscale, providing support for construct validity. Moreover, MSEC scores were significantly different for children of different ASD severity levels confirming the known groups validity. Conclusions: This study represents the first step toward the development of an instrument to measure mental synthesis in children with ASD. Although the current empirical evaluation demonstrated strong evidence of excellent psychometric properties, such as validity and reliability, additional studies should be performed to replicate these findings.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

Functional Near Infrared Spectroscopy (fNIRS) systems for e-health applications usually suffer of poor signal detection mainly due to a low end-to-end signal to noise ratio of the electronics chain. Lock-In Amplifiers (LIA) historically represent a powerful technique helping to improve performances in such circumstances. In this work it has been designed and implemented a digital LIA system, based on a Zynq® Field Programmable Gate Array (FPGA), trying to explore if this technique might improve fNIRS system performances. More broadly, FPGA based solution flexibility has been investigated, with particular emphasis applied to digital filter parameters, needed in the digital LIA, and it has been evaluated its impact on the final signal detection and noise rejection capability. The realized architecture was a mixed solution between VHDL hardware modules and software ones, running within a softcore microprocessor. Experimental results have shown the goodness of the proposed solutions and comparative details among different implementation will be detailed. Finally a key aspect taken into account throughout the design was its modularity, allowing an ease increase of the input channels while avoiding the growth of the design cost of the electronics system.

This study aimed to compare procedural learning skills between Spanish-speaking preschool children (ages 4 years to 4 years, 11 months) with Developmental Language Disorder (DLD) and their typically developing (TD) peers. Using the Serial Reaction Time task, participants (30 DLD and 30 TD children) respond to visual stimuli in a sequenced manner over four blocks, followed by a random order block. The task assessed reaction time (RT) and accuracy. Results showed a significant interaction between group and block for reaction time (RT) and accuracy, with children with DLD exhibiting longer RTs and accuracy deficits across blocks. In contrast, the TD group showed higher RT efficiency and accuracy in the sequential blocks and as expected, decreased performance in the random block according to the experimental manipulation. Overall, the results of this investigation suggest that there was no implicit learning in the DLD group, as indicated by the SRT task paradigms of procedural memory. These findings align with the Procedural Deficit Hypothesis (PDH), suggesting that linguistic deficits in the TD population may derive from a general dysfunction of the procedural memory system domain in the Spanish context.

Highly-skilled migrants and refugees finding employment in low-skill vocations, despite professional qualifications and educational background, has become a global tendency, mainly due to the language barrier. Employment prospects for displaced communities are mostly decided by their knowledge of the sublanguage of the vocational domain they are interested in working. Common vocational domains include agriculture, cooking, crafting, construction, and hospitality. The increasing amount of user-generated content in wikis and social networks provides a valuable source of data for data mining, Natural Language Processing and machine learning applications. This paper extends the contribution of the authors’ previous research on automatic vocational domain identification by further analyzing the results of the machine learning experiments with the domain-specific textual data set, considering 2 research directions: a. predictions analysis and b. data balancing. Wrong predictions analysis and the features that contributed to misclassification, along with correct predictions analysis and the features that were the most dominant, contributed to the identification of a primary set of terms for the vocational domains. Data balancing techniques were applied on the data set to observe their impact on the performance of the classification model. A novel 4-step methodology is proposed in this paper for the first time, consisting of successive applications of SMOTE oversampling on imbalanced data. Data oversampling obtains better results than data undersampling in imbalanced data sets, while hybrid approaches perform reasonably well.