In the intricate tapestry of our ever-evolving world, where complexities abound and change unfurls with unyielding speed, the amalgamation of values, critical thinking, and moral reasoning within the realm of language and literature education emerges as an imperious necessity. For it is through this harmonious integration that we fortify the minds of our students, bestowing upon them the indispensable tools to traverse the labyrinthine paths of multifaceted ethical quandaries, while shaping them into steadfast guardians of our shared global community. This article highlights the connection between language, literature, critical thinking, moral reasoning, and values integration in education. Through language and literature, teachers can incorporate values education in their classroom, which can benefit not only individual students but also society as a whole. Theoretical frameworks such as character education, moral education, and values education provide the basis for this approach. The researcher recommends strategies for incorporating values integration in language and literature curricula, including the use of literary texts that promote critical thinking and moral reasoning skills. The limitations of this approach, including the challenges in assessing the effectiveness of values integration and potential resistance from some stakeholders, are also discussed. Ultimately, this article aims to call on educators to take a proactive role in promoting values integration in language and literature education, guided by the principles of Jesus Christ and the belief that education is not only about acquiring knowledge but developing character as well. Moreover, this concept has a significant and lasting impact on students' overall development that highlights the importance of values and moral reasoning needed to live a better life.

This work describes the orthographic content in grammars of European languages in the 17th and the 18th century. Reviewed were 17 grammars for 7 languages in Rationalism, 15 grammars for 11 languages in the Enlightenment, and 12 Latin orthographies. As for orthographic entities in the broader sense (orthography as a way to write down speech), our starting point were orthographic grapheme units which are contrasted to meaning (i.e. orthographic entities in the narrower sense, e.g. punctuation). Contrary to the traditional description which focused on spelling, this work observes the beginnings of orthographic content in grammars and its development into an autonomous language phenomenon and norm. The strong connection between orthography and grammar is described and it is established that, from the diachronic point of view, orthography cannot be integrally reviewed without studying the grammatical teachings.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Musyakalah is one of the Arabic linguistic styles included under the category of majaz. This style is commonly used in Al-Quran. The Indonesian translation of Al-Quran is a case where many of the figures of speech are translated literally, thereby causing serious semantic problems. Thus, the research problem of this is formulated with the following questions: 1) How many musyakalah ayahs are there in Al-Quran?; 2) How are the musyakalah ayahs translated, literally (harfiyya) or interpretatively (tafsiriyya)?; 3) How many ayahs are translated literally and how many are translated interpretatively?; and 4) Which translated musyakalah ayahs have the potential to raise semantic and theological problems? The corpus in this research consists of all musyakalah ayahs in Al-Quran and their translation to Indonesian published by the Department of Religious Affairs of Indonesia. The research adopted a descriptive-semantic method. The findings of this research are: 1) There are only eleven ayahs in Al-Quran using musyakalah style, namely: Alhasyr ayah 19, Ali Imran ayah 54, Annaml ayah 50, Alanfal ayah 30, Asysyura ayah 40, Albaqarah ayah 15, Almaidah 116, Aljatsiah ayah 34, Attaubah ayah 79, Annisa ayah 142, and Albaqarah 194; 2) The musyakalah ayahs translated literally are: Aljatsiah 34, Almaidah 116, Asysura 40, Annaml 50, and Alhasyr 19, whereas the musyakalah ayahs translated interpretatively are Albaqarah 194, Annisa 142, Attaubah 79, Albaqarah 15, Alanfal 30, and Ali Imran 54; 3) Of the eleven musyakalah ayahs, only Alhasyr ayah 19 that is translated correctly and does not have the potential of creating misinterpretation. Meanwhile, the interpretation of the other four ayahs can potentially cause misinterpretation or are against the basic principles of Islam. The six remaining ayahs are translated interpretatively and thus do not have the potential to be misinterpreted; 4) The findings suggest that musyakalah ayahs are more appropriately translated interpretatively. Therefore, the following is recommended: 1) Considering the different characteristics of Arabic and Indonesian languages, studies on Al-Quran translation into Indonesian should continuously be carried out; 2) In order to avoid misinterpretation, it is better that the translation of musyakalah ayahs uses tafsiriyya (interpretative) approach; 3) The harfiyya (literal) and tafsiriyya (interpretative) approaches should be developed for other styles beside musyakalah..

Sentiment analysis plays a crucial role in understanding customer feedback, guiding product development, and informing business decisions. This paper introduces term sentiment entropy (TSE), a novel weighting method that leverages the distribution of sentiment labels associated with words to enhance text classification accuracy. TSE complements traditional TF-IDF techniques by capturing the nuances of sentiment variation across different contexts. Experiments across diverse public datasets demonstrate TSE's potential to improve sentiment analysis performance, especially in capturing subtle sentiment shifts and adapting to specific domains. While computational cost and label quality pose challenges, TSE offers a promising avenue for refining sentiment analysis and opening new research frontiers.

The pursuit of Artificial Intelligence (AI) that emulates human cognitive processes is a cornerstone of ethical AI development, ensuring that emerging technologies can integrate seamlessly into societal frameworks requiring nuanced understanding and decision-making. Zero-Shot Instance Retrieval (ZSIR) stands at the forefront of this endeavour, potentially providing a robust platform for AI systems, particularly large visual language models, to demonstrate and refine cognition-aligned learning without the need for direct experience. In this paper, we critically evaluate current cognition alignment methodologies within traditional zero-shot learning paradigms, using visual attributes and word embedding generated by large AI models. We propose a unified similarity function that quantifies the cognitive alignment level, bridging the gap between AI processes and human-like understanding. Through extensive experimentation, our findings illustrate that this similarity function can effectively mirror the visual-semantic gap, steering the model towards enhanced performance in zero-shot instance retrieval. This work not only benchmarks the cognition alignment of AI, but also sets a new precedent for the development of visual language models attuned to the complexities of human cognition.}

Decision-making is a complex process of selecting an option from the given choices by analyzing the background information like risk, loss, and gain within the alternative options presented. It has been observed in earlier studies that people are prompt to make less rational decisions when choices are given in a language less known to them. Therefore, to understand the effect of languages on decision-making, we have questioned native Hindi speakers in French and English. French being the foreign language, and English as their second language. Thus, this effect of a non-native language brings to light the important role that the native language plays routinely in judgment and decision-making. In this paper, we developed a Neuropsychological assessment to decipher the effects on decision-making between choices when given in foreign language and second language in comparison with the native language of an individual, which is termed as foreign language effect(Fle). We have explored various possible situations to understand the foreign language effect(Fle) in decision-making and does this change translates when the decision is to be made in the second language. Our study concludes that the Foreign language is least affected by the intuitive biases, followed by the second language, and the native language is most affected by it.

This study explores the Experience Economy dimensions within fishing tourism, adopting a data science perspective by employing web crawling for extensive data gathering on reviewer profiles from TripAdvisor. Utilizing Natural Language Processing (NLP) techniques, it scrutinizes the relationship between Experience Economy dimensions and user profiling aspects. Findings reveal "Entertainment" as the predominant dimension in tourist reviews, followed by "Aesthetic," "Educational," and "Escapist." Particularly notable are the frequent co-occurrences of "Entertainment"-"Aesthetic" and "Educational"-"Entertainment" pairs. The practical implications underscore the potential socioeconomic benefits of fishing tourism for local communities and fishermen, emphasizing the necessity for governmental support in terms of infrastructure, leadership, legislation, and financial backing to foster sustainable development in this sector. Notably, this research stands as a pioneering effort in its focus on Experience Economy dimensions and user profiling within the context of fishing tourism, drawing data from business pages and user profiles.

Videogames have been the focus of research since their widespread popularity, with particular emphasis on their effects on cognitive and affective abilities, especially in children and adolescents. Despite numerous correlational studies, robust evidence on the causal relationship between videogames and cognition remains scarce, hindered by the absence of a comprehensive assessment tool for gaming skills across various genres. This study aimed to develop and validate the Gaming Skill Questionnaire (GSQ) and to assess the impact of gaming skills in six different genres (Sport, First-Person Shooters, Role-Playing Games, Action-Adventure, Strategy, and Puzzle Games) on adolescents’ cognitive and affective abilities. The GSQ exhibited strong reliability and validity, highlighting its potential as a valuable tool. Gaming skills positively affected executive function, memory, overall cognition, cognitive flexibility, and emotion recognition, except for empathy. Various game genres had different effects on cognitive and affective abilities, with verbal fluency influenced mainly by sports, executive functions by action, strategy, and puzzle, and emotion recognition positively impacted by action and puzzle but negatively by sports and strategy games. Both age and gaming skills influenced cognitive flexibility, with gaming having a greater effect. These intriguing genre-specific effects on cognitive and affective functioning postulate further research with GSQ's contribution.

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

The enormous growth in the penetration of electric vehicles (EVs), has laid the path to advancements in the charging infrastructure. Connectivity between charging stations is an essential prerequisite for future EV adoption to alleviate users’ “range anxiety”. The existing charging stations fail to adopt power provision allocation and scheduling management. To improve the existing charging infrastructure data based on real-time information and availability of reserves at charging stations could be uploaded to the users to help them locate the nearest charging station for an EV. This research article focuses on an a interactive user application developed through SQL and PHP platform to allocate the charging slots based on estimated battery parameters, which uses data communication with charging stations to receive the slot availability information. The proposed server-based real-time forecast charging infrastructure avoids waiting times and its scheduling management efficiently prevents the EV from halting on road due to battery drain out. The proposed model is implemented using a low-cost microcontroller and the system etiquette tested.

In an era marked by rapid technological progress and global dynamics, the Neo-Language Acquisition and Learning Theory challenges conventional language acquisition paradigms through its conceptualization of 'Grit: The Unyielding Will to Connect,' emphasizing determination, motivation, and adaptability as the primary drivers of language learning, transcending age-related constraints and critical periods. This theory also underscores 'Self-Preservation: Language as the Canvas of Reality,' as language plays a pivotal role in preserving and conveying our individual and collective experiences. Recent global events have underscored the theory's relevance, prompting a reevaluation of language education in response to changing circumstances. Moreover, 'Techno-Training: Language Acquisition and Learning in the Digital Age' is integral to the theory, as it recognizes the influence of technology on modern language education. Beyond traditional methods, these three reshape our fundamental understanding of said theory. Drawing from historical evidence, psychological principles, and contemporary applications, they supported the conceptualization of the theory itself. Overall, the Neo-Language Acquisition and Learning Theory revolutionizes language education, spotlighting the power of motivation, determination, and adaptability to navigate the evolving landscape of language learning and acquisition.

while enjoying a relative positive revival in the digital age, Esperanto and the assessment of its language vitality is often problematic and prone to gross errors, and therefore a theoretical re-flection is required. Unlike other lesser-used languages, Esperanto is intergenerationally trans-mitted mainly outside the family, and so Fishman’s GIDS and subsequent scales such as the EGIDS cannot be applied straightforwardly for language vitality diagnosis and estimation. In particular, it is the social movement with its language activists who guarantee its vitality and developing, for more than a century. A key aspect is the digital domain, where the relatively good positioning of Esperanto does not reflect in a parallel increase in the number of activists. This paper critically assesses the digital language vitality of Esperanto on the basis of its language ide-ology and other sociolinguistic data as a starting point for a discussion to overcome the limits of Blanke’s (2006) scale of language vitality of Esperanto and its rivals. This assessment eventually leads to a more general reflection on the role of ‘coolification’, i.e., the positive effects on language attitudes and development thanks to digital visibility, its limits and the issue of placing it in the context of language vitality in general.

Considering that cryptocurrencies are now present in practically every financial transaction because they are widely accepted as an alternate means of making payments and exchanging currencies, academics and economists have more opportunities to study cryptocurrency prices. Over the years, investors, traders and investment banks have found it difficult to predict the closing daily price of Ethereum due to its rapid price fluctuation. The daily closing price of cryptocurrency is essential to consider when trading or investing in Ethereum. This report focuses on carrying out a comparative study of the predictive capabilities of deep machine learning algorithms with a stacking ensemble modelling framework using daily historical observations of the price of Ethereum obtained from Coindesk, tweets extracted from Twitter ranging from the 1st of August 2022 to the 8th of August 2022 and other five covariates (closing price lag1, closing price lag2, noltrend, daytype and month) engineered from the closing price of Ethereum. Seven models are used to compute the forecasts for the daily closing price of Ethereum; these are the recurrent neural network, ensemble stacked recurrent neural network, gradient boosting machine, generalized linear model, distributed random forest, deep neural networks and stacked ensemble for gradient boosting machine, generalized linear model, distributed random forest and deep neural networks. The main evaluation metric used is the mean absolute error. According to MAE, RNN forecasts outperform the other model’s forecasts in this study, producing an MAE of 0.0309.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

This paper investigates women’s empowerment and their active involvement in governance aimed at promoting sustainable development. The study focuses on examining the roles and processes of co-creation of nature-based solutions (NBS) for water management in Milan. Three research directions were explored: 1) to determine gender-based roles within local governance; 2) to detect semantic groups of NBS based on stakeholders' gender; c) to analyze gender-based linguistic and conceptual patterns of NBS. To achieve our objectives, we converted a sample of audio-video interviews of local stakeholders into textual data along with metadata indicating speakers' roles and gender. Descriptive statistics were applied to explore the governance's roles. We employed a combination of textual analysis and network analysis to identify thematic groups of NBS, and applied a word embedding approach to uncover linguistic patterns indicative of semantic sub-structures. The findings revealed significant demographic diversity. Male stakeholders perceive sustainable development as a process driven by the circular economy and the coordination of territorial authorities, while female stakeholders envision a transformative approach rooted in science, culture, and collaboration. The semantic sub-structure analysis highlighted a tendency among male governance to emphasize specialized skills, whereas female governance placed greater emphasis on problem definition rather than resolution.

Large Language Models (LLMs) have revolutionized the field of Artificial Intelligence with their ability to understand and generate natural language discourse. This has led to the use of LLMs in various creative fields such as music, art, and storytelling, which has sparked a debate on the impact of LLMs on human creativity. This article explores the cyclic effect of LLMs on human creativity, where LLMs can generate an ever-evolving cycle of creative output from both humans and machines. The article also highlights the importance of responsible and ethical use of LLMs, including privacy and copyright issues with the training data used by LLMs. The article emphasizes the need for transparency, data security measures, and AI governance policies to protect user data and ensure the safe use of LLMs. It also calls for the development of educational materials and resources to increase public understanding of LLMs and their ethical implications. The article concludes by highlighting the potential of LLMs as powerful tools for communication and education, but also emphasizes the need for ethical considerations to ensure the responsible and beneficial use of LLMs in society.

(1) Background: Attention Deficit Hyperactivity Disorder (ADHD) and Developmental Language Disorder (DLD) are neurodevelopmental disorders that affect various areas of chil-dren’s development, such as language. There is an emerging idea that ADHD is characterised by the presence of language difficulties, which could be explained by the high comorbidity between ADHD and DLD. The purpose of this study is to analyse the empirical evidence of language com-petence in children aged 6–17 years old, diagnosed with ADHD and/or DLD. (2) Method: Fifteen studies with experimental designs were identified from Scopus, PsycINFO and WoS databases, reporting on language skills in children diagnosed with ADHD and/or DLD. Studies relating ex-ecutive functioning to language skills in this target population were also included. (3) Results: The literature is heterogeneous and different components of language are also examined. Even though the results are contradictory they convincingly demonstrate that there are overlapping symptoms between ADHD and DLD, such as language skills and executive functions. (4) Conclusions: the differences in the samples limit the generalisability of the results. Therefore, this review highlights the importance of considering language skills when designing individualised interventions for the population with ADHD and DLD, both in comorbidity and in isolation.

This research presents a comprehensive framework for efficiently generating forest fire datasets from Google Earth Engine data sources. The primary contribution of this work lies in providing a methodology to swiftly extract forest fire factors without the need for permissions or access to private datasets, rendering the dataset openly accessible and shared without barriers. Furthermore, given that the remote sensing data used is a global dataset, it can be applied in any region without restrictions. In this study, Peninsular Malaysia is chosen as a case study to demonstrate the framework's effectiveness. The generated dataset includes essential variables including the climate and environment, landcover, topography, and anthropogenic factors facilitating the analysis of fire occurrences. The methodology empowers data scientists, enabling them to leverage their analytical skills on the extracted dataset without requiring specialized remote sensing knowledge. Additionally, this study also showcases the adoption of large language models, specifically GPT-4 with the Noteable plugin, as a tool for conducting preliminary analyses on the generated dataset. Sample analyses reveal that several key features, including the KBDI, LST, PDSI, climate water deficit, and precipitation, significantly impact forest fire occurrences in Peninsular Malaysia. Despite the successful application of the GPT-4 with Noteable plugin, certain limitations and challenges are identified, highlighting the necessity for further validation of the tool's applicability and limitations. This study encourages future research to (1) adopt the proposed framework in other regions, (2) explore more detailed analyses encompassing all variables, and (3) leverage machine learning for advanced forecasting.

Sign Language Recognition (SLR) aims to bridge speech-impaired and general communities by recognizing signs from given videos. Researchers still face challenges developing efficient SLR systems because of the video’s complex background, light illumination, and subject structures. Recently many researchers developed a skeleton-based sign language recognition system to overcome the subject and background variation of hand gesture signs. However, skeleton-based SLR is still under exploration due to the lack of information and annotations on hand key points. More recently, researchers included body and face information with the hand gesture for the SLR, but their performance and efficiency are unsatisfactory. We proposed a Multi-Stream Graph-based Deep Neural Network (SL-GDN) for a skeleton-based SLR system to overcome the problems. The main purpose of the proposed SL-GDN approach is to improve the efficiency and performance of the SLR system with a low computational cost based on the human body pose in the form of 2D landmark locations. In the procedure, firstly, we constructed a skeleton graph based on the selected 27 whole-body key points among 67 key points to solve the inefficiency problems. Then we proposed multi-stream SL-GDN to extract features from the whole-body skeleton graph for four streams. Finally, we concatenated the four different features and applied a classification module to refine the feature and recognize corresponding sign classes. Our data-driven and graph construction method increases the system’s flexibility and brings high generability to adapt various data samples. We used three large-scale benchmark SLR datasets to evaluate the proposed model: WLASL, AUTSL and CSL. The demonstrated performance accuracy table proved the superiority of the proposed model, and we believe this will be considered a great invention in the SLR domain.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

Paraphrase Generation is one of the most important and challenging tasks in the field of Natural Language Generation. The paraphrasing techniques help to identify or to extract/generate phrases/sentences conveying the similar meaning. The paraphrasing task can be bifurcated into two sub-tasks namely, Paraphrase Identification (PI) and Paraphrase Generation (PG). Most of the existing proposed state-of-the-art systems have the potential to solve only one problem at a time. This paper proposes a light-weight unified model that can simultaneously classify whether given pair of sentences are paraphrases of each other and the model can also generate multiple paraphrases given an input sentence. Paraphrase Generation module aims to generate fluent and semantically similar paraphrases and the Paraphrase Identification systemaims to classify whether sentences pair are paraphrases of each other or not. The proposed approach uses an amalgamation of data sampling or data variety with a granular fine-tuned Text-To-Text Transfer Transformer (T5) model. This paper proposes a unified approach which aims to solve the problems of Paraphrase Identification and generation by using carefully selected data-points and a fine-tuned T5 model. The highlight of this study is that the same light-weight model trained by keeping the objective of Paraphrase Generation can also be used for solving the Paraphrase Identification task. Hence, the proposed system is light-weight in terms of the model’s size along with the data used to train the model which facilitates the quick learning of the model without having to compromise with the results. The proposed system is then evaluated against the popular evaluation metrics like BLEU (BiLingual Evaluation Understudy):, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), METEOR, WER (Word Error Rate), and GLEU (Google-BLEU) for Paraphrase Generation and classification metrics like accuracy, precision, recall and F1-score for Paraphrase Identification system. The proposed model achieves state-of-the-art results on both the tasks of Paraphrase Identification and paraphrase Generation.

This review paper investigates the influence of gestures on foreign language (FL) vocabulary learning through a series of experiments conducted in our laboratory. The manipulation of the gesture-word relationship was a consistent factor across the studies. Firstly, we examined the impact of gestures on noun and verb learning. The results revealed that participants exhibited better learning outcomes when FL words were accompanied by congruent gestures compared to a no gesture condition. This suggests that gestures have a positive effect on FL learning when there is a meaningful connection between the words and the accompanying gestures. However, in general, the recall of words in conditions where gestures were incongruent or lacked meaning was lower than in the no gesture condition. This indicates that under certain circumstances, gestures may have a detrimental impact on FL learning. We analyzed these findings in terms of their implications for facilitating or interfering with FL acquisition. Secondly, we addressed the question of whether individuals need to physically perform the gestures themselves to observe the effects of gestures on vocabulary learning. To explore this, participants were divided into two experimental groups. In one group, participants learned the words by actively performing the gestures ("do" learning group), while the other group simply observed the gestures performed by others ("see" learning group). The processing of congruent gestures facilitated the recall of FL words in both the "see" and "do" learning groups. However, the interference effect associated with processing incongruent gestures was more pronounced in the "see" learning group than in the "do" learning group. Thus, the performance of gestures appears to mitigate the negative impact that gestures may have on the acquisition of FL vocabulary. In conclusion, our findings suggest that iconic gestures can serve as an effective tool for learning vocabulary in a FL, particularly when the gestures align with the meaning of the words. Furthermore, the active performance of gestures helps counteract the negative effects associated with inconsistencies between gestures and word meanings. Consequently, if a choice must be made, a FL learning strategy in which learners acquire words while making gestures congruent with their meaning would be highly desirable.

Stop words are very important for information retrieval and text analysis investigation. This study aimed to automatically analyze and detect stop words in texts in the Uzbek language. Because of the limited availability of methods for automatic search of stop words of texts in Uzbek we analyzed a newly prepared corpus. The Uzbek language belongs to the family of agglutinative languages. As with all agglutinative languages, we can explain that the detection of stop words in Uzbek texts is a more complex process than in inflected languages: In inflected languages, words such as auxiliary words, articles, prepositions can be included in the stop words group. In agglutinative languages, the meanings of such words are hidden in the text. Therefore, it is not appropriate to apply all known methods of stop words detection in inflected languages directly to agglutinative languages. In this work, the “School corpus” which contains 731156 Uzbek words has been investigated. The bigram method of analysis was applied to the corpus. We proposed the collocation method of detecting stop words of the corpus. We proposed the method of automatically detecting stop words of texts in Uzbek. It is shown that the collocation method is 6 times better than the bigram method.

Arabic is present in the Arab world and beyond. It is used as an official (or co-official) language in the Arab World (this refers to the twenty-two member states of the Arab League). Also, Arabic has the status of a national language in Mali, Niger, and Senegal. Besides, it is spoken in linguistic enclaves in Nigeria, Cyprus, Turkey, Uzbekistan, Iran, and Afghanistan. In addition, it is employed as the liturgical language in Muslim countries and countries with a Muslim minority all over Africa and Asia. As a result of the migration to Western countries since the end of the nineteenth century, Arabs and Arabic has been present in such countries. The presence of Arabs in Western countries raises the following question: Are these Arabs language maintainers or language shifters? The present article is an attempt to answer this question through reviewing a number of studies that have dealt with Arabic language maintenance among the Arabs living in Western countries (namely the United States of America, the United Kingdom, Canada, Australia, New Zealand, Sweden, Greece, and France), deducing from these studies the major trends in Arabic language maintenance among these Arabs, and providing a critique of the studies.

Hallyu or the Korean wave has sweeped through nations especially the Philippines. This exploratory study offers a dip into the effects of the Hallyu wave on a Filipino speaker through ambient exposure, consequently on the development of a Korean proto-lexicon through indirect vocabulary acquisition. Finally, a focus group discussion and a preliminary assessment tested out the waters of the effects of Hallyu on casual Filipino speakers. A thorough statistically comprehensive qualitative study on the acquisition framework is recommended to provide substantial evidence to support the framework.

Since matter, energy and information are the three major components of the world, is there an interaction between information and matter? In the present work, the coevolution of human language and brain is taken as a case of interaction between information and brain. Some evidence that may show interactions between human language and brain revealed by previous researches is summarized in this paper, such as the language areas in the cerebral cortex of the modern human brain, the evolution of human language and brain in human history, and the genetic basis for the evolution of language. Based on the evidence, a dynamic model is developed to investigate the possible mechanism of coevolution of human language and brain. In the model, human language development and brain development reinforce each other: the developmental level of language can be promoted by advances in brain function due to language-related gene mutations, in turn, whether such mutations are selected positively can be influenced by the current developmental level of language. The coevolution of human language and brain can be taken as a case of interaction between information and matter.

This paper discusses some of the most common misconceptions about large language models (LLMs), including the belief that they are sentient or conscious, that they are always accurate, and that they can replace human creativity. The paper also proposes a strategy for overcoming these misbeliefs, which involves educating the public about the capabilities and limitations of LLMs, developing guidelines for the responsible use of LLMs, and conducting more research to understand the potential impact of LLMs on society.

The purpose of this paper is to explore the implementation of Retrieval-Augmented Gen- 14 eration (RAG) technology with open-source Large Language Models (LLMs). For this purpose, a 15 web-based application named PaSSER that integrates RAG with three models - Mistral:7b, 16 Llama2:7b: Orca2:7b, is developed. In its development various technologies are used, including 17 Blockchain for managing and storing assessment results of built-in testing modules. PaSSER em- 18 ploys a set of evaluation metrics for LLMs’ performance - METEOR, ROUGE, BLEU, Perplexity, 19 Cosine similarity, Pearson correlation, and F1 score. The specialized knowledge base is in the smart 20 agriculture domain. As an illustration, the paper presents results and analysis of two tests. First one 21 is assessing the performance of LLMs across different hardware configurations, the other is deter- 22 mining the model that delivers most accurate and contextually relevant responses within the RAG. 23 The paper also discusses the integration of blockchain technology with LLMs to manage and store 24 assessment results within a blockchain environment. The tests revealed that Mistral:7b demon- 25 strates the best results across most of the evaluated metrics. The discussion section comments on 26 technical and hardware considerations that affect the performance of LLMs. Future development 27 will focus in leveraging new larger pre-trained open-source LLMs, exploring different finetuning 28 approaches, and further integration with Blockchain and IPFS.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

This systematic review examines the potential of digital language learning in contributing to students' cognitive gains. The study reviews existing research on the relationship between digital language learning and cognitive benefits, with a focus on enhanced problem-solving skills, memory, and multitasking ability. The findings indicate that higher levels of digital competences correlate positively with language proficiency outcomes, suggesting that participants with greater digital skills achieve better language learning outcomes. Digital technologies offer interactive and engaging methods of learning, which can positively impact retention and understanding. However, the study also acknowledges the limitations of digital foreign language learning, such as the lack of face-to-face interaction and the need for high motivation and discipline. The research questions explored in this study are: (1) Does digital language learning contribute to cognitive gains in foreign language education? and (2) What are the pedagogical implications for cognitive improvement in digital foreign language education? The study employs the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) methodology to identify and analyze relevant research articles. The results of the review suggest that working with printed texts may be more effective for cognitive gains compared to electronic texts. Additionally, implementing more senses through digital language education appears to be beneficial for cognitive gains. The article concludes by discussing the implications of these findings and the need for further research in this area.

There is a serious concern regarding framing rules and guidelines to regulate the content on OTT platforms that needs urgent attention. In the Current Scenario, the use of vulgar language in the public domain on OTT platforms needs to take seriously. Some OTT platforms heavenly use foul language, which is open to children that cause a huge psychological impact on them. The use of vulgar language, including profanity and bad words, has to be regulated strictly. Web series uses obscene, abusive words and foul language with excessive usage. This review paper highlights the excessive use of swear words, profane language, and vulgar expletives on OTT platforms.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

The daVinci Surgical Robot has revolutionized minimally invasive surgery by enabling greater accuracy and less invasive procedures. However, the system lacks advanced features and autonomy necessary for it to function as a true partner. To enhance its usability, we introduce the implementation of a ChatGPT-based natural language robot interface. Overall, our integration of a ChatGPT-enabled daVinci Surgical Robot has potential to expand the utility of the surgical platform by supplying a more accessible interface. Our system can listen to the operator speak and, through the ChatGPT-enabled interface, translate the sentence and context to execute specific commands to alter the robot’s behavior or to activate certain features. For instance, the surgeon could say (even in Spanish) “please track my left tool” and the system will translate the sentence into a specific track command. This specific error-checked command will then be sent to the hardware which will respond by controlling the camera of the system to continuously adjust to center the left tool in the field of view. We have implemented many commands including “Find my tools” (tools that are not in the field of view) or start/stop recording that can be triggered based on a natural conversational context. Here, we present details of our prototype system, give some accuracy results, and explore its potential implications and limitations. We also discuss how artificial intelligence tools (such as ChatGPT) of the future could be leveraged by robotic surgeons to reduce errors and enhance the efficiency and safety of surgical procedures and even ask for help.

Highly-skilled migrants and refugees finding employment in low-skill vocations, despite professional qualifications and educational background, has become a global tendency, mainly due to the language barrier. Employment prospects for displaced communities are mostly decided by their knowledge of the sublanguage of the vocational domain they are interested in working. Common vocational domains include agriculture, cooking, crafting, construction, and hospitality. The increasing amount of user-generated content in wikis and social networks provides a valuable source of data for data mining, Natural Language Processing and machine learning applications. This paper extends the contribution of the authors’ previous research on automatic vocational domain identification by further analyzing the results of the machine learning experiments with the domain-specific textual data set, considering 2 research directions: a. predictions analysis and b. data balancing. Wrong predictions analysis and the features that contributed to misclassification, along with correct predictions analysis and the features that were the most dominant, contributed to the identification of a primary set of terms for the vocational domains. Data balancing techniques were applied on the data set to observe their impact on the performance of the classification model. A novel 4-step methodology is proposed in this paper for the first time, consisting of successive applications of SMOTE oversampling on imbalanced data. Data oversampling obtains better results than data undersampling in imbalanced data sets, while hybrid approaches perform reasonably well.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

Psychedelics are drugs capable of eliciting profound alterations in the subjective experience of the users, sometimes with long-lasting consequences. Because of this, psychedelic research tends to focus on human subjects, given their capacity to construct detailed narratives about the contents of their consciousness experiences. In spite of its relevance, the interaction between serotonergic psychedelics and language production is comparatively understudied in the recent literature. This review is focused on two aspects of this interaction: how the acute effects of psychedelic drugs impact on speech organization regardless of its semantic content, and how to characterize the subjective effects of psychedelic drugs by analyzing the semantic content of written retrospective reports. We show that the computational characterization of language production is an emergent powerful tool to predict the therapeutic outcome of individual experiences, relate the effects elicited by psychedelics with those associated with other altered states of consciousness, draw comparisons between the psychedelic state and the symptomatology of certain psychiatric disorders, and investigate the neurochemical profile and mechanism of action of different psychedelic drugs. We conclude that researchers studying psychedelics can considerably expand the range of their potential scientific conclusions by analyzing brief interviews obtained before, during and after the acute effects. Finally, we list a series of questions and open problems that should be addressed to further consolidate this approach.

This paper examines the potential of large language models, specifically ChatGPT, BingChat, and Bard, in enhancing the work of teachers in various educational settings. These models, powered by cutting-edge artificial intelligence, offer a wide range of applications that can aid educators in curriculum development, personalized instruction, student engagement, and administrative tasks. By harnessing the capabilities of these language models, teachers can not only streamline their workload but also improve the overall quality of education. This paper explores the ways in which these models can empower educators and revolutionize teaching practices.

The recent past has witnessed a growing interest in technologies for creating chatbots. Advances in Large Language Models for natural language processing are underpinning rapid progress in chatbot development, and experts predict revolutionary changes in the labour market as many manual tasks are replaced by virtual assistants in a range of business functions. As the new technology becomes more accessible and advanced, more companies are exploring the possibilities of implementing virtual assistants to automate routine tasks and improve service. This article reports on qualitative inductive research undertaken within a chatbot development team operating in a major international enterprise. The findings identify critical success factors for chatbot projects, and, based on the in-depth case study, a model is put forward to aid the manageability of chatbot implementation. The presented model can serve as an exemplar guide for researchers and practitioners working on the design, development and implementation of virtual assistants. It is flexible and applicable in a wide range of business contexts, linking strategic business goals with execution steps. It is particularly applicable for teams with no experience of chatbot implementation, reducing uncertainty and managing decisions and risks throughout the project lifecycle, thereby increasing the likelihood of project success.

Natural language processing (NLP) is being widely used globally for a variety of value-creation tasks ranging from chat-bots and machine translations to sentiment and topic analysis and multilingual large language models (LLMs). However, most of the advances are initially implemented within the English language framework, and it takes time and resources to develop comparable resources in other languages. The advances in machine translations have enabled the rapid and effective conversion of content in global languages into English and vice-versa. This creates potential opportunities to apply English language NLP methods and tools to other languages via machine translations. However, although this idea is powerful, it needs to be validated and processes and best practices need to be developed and kept updated. The present research is an effort to contribute to the development of best practices and an evaluation framework. We present a systematic and repeatable state-of-the-art process to evaluate the viability of applying English language sentiment analysis tools to Italian text by using multiple English language machine translation mechanisms such that it can be easily extended to other languages. hor[RU,RA]{\large Richard Anderson} \address[RU]{\large Rutgers University, USA} \address[RA]{\large rick.anderson@rutgers.edu} \author[RU]{\large Carmela Scala} \author[RU]{\large Jim Samuel} \author[UC]{\large Vivek Kumar} \address[UC]{\large University of Cagliari, Italy} \author[RU]{\large Parth Jain}

Micro-level language policy and planning (LPP) primarily concerns local actors' decision-making on matters in relation to language(s) and its users. Despite a growing body of literature focusing on micro language planning in educational settings, there is a scarcity of research examining early childhood education settings such as micro-level LPP context for young English language learners. By adopting a case study approach, the present study examined the educators' enactment of agency in micro-planning the English language education policy (LEP) in one Chinese kindergarten and the associated factors shaping their agency. Our study revealed that the sustainable implementation of the kindergarten English LEP depended on the principal, native English-speaking teachers, and the Chinese assistant teachers' different degrees of agency. Also, the research findings indicated an array of contextual and individual factors nested in a hierarchical structure that facilitated, guided, and constrained the educators' agency in a role-and circumstance-dependent manner. This study contributes to the pertinent literature by casting nuanced light on the different educators' contributions to the micro-level LPP against a national policy that does not endorse early-year English language education.

The purpose of this systematic review is to provide second language acquisition (SLA) researchers with an overview of research trends in this field in the last ten years (2009-2019). In doing so, three international peer-reviewed journals, Studies in Second Language Acquisition, Language Teaching Research, and The Modern Language Journal, were selected. 150 articles were systematically selected and analyzed. The analysis of data resulted in identifying six descriptive themes. Results showed that some areas of second language acquisition still need further exploration while some areas are of great interest for researchers. Some suggestions for future research as well as implications of the study were discussed in detail.

Teaching and learning a new language is a complex process that requires more than just memorizing vocabulary and grammar rules. Immersing oneself in the target language's culture and history is essential for achieving fluency and accuracy. In recent years, researchers have explored the potential of music as a tool for language learning. This paper discusses the benefits of using music in language learning, including improved listening comprehension, pronunciation and fluency, and cultural understanding. The theoretical framework of sociocultural theory, cognitive load theory, and task-based language learning is presented to support the use of music in language learning. This paper also provides practical recommendations for learners to incorporate music into their language learning routine, as well as resources for finding music in the target language, such as online music platforms and language learning apps. The article concludes by encouraging language learners to incorporate music into their language learning routine and providing resources for finding music in the target language, such as online music platforms and language learning apps. Overall, this paper demonstrates that music can be a powerful and enjoyable tool for enhancing language learning outcomes.

This paper explores how Artificial Intelligence (AI) can help reduce the communication gap and streamline the distribution of resources. It uses an exploratory case study to examine the current state of the communication gap and the potential opportunities AI can bring to close it. The paper will discuss the current state of the communication gap, the current methods of resource distribution, and the potential opportunities AI can bring to reduce the communication gap. It will also explore the potential implications of AI on resource distribution and the communication gap. The paper will review the existing literature on the communication gap, resource distribution, and AI. It will then focus on the opportunities AI can bring to the communication gap. It will analyze the use of machine learning, natural language processing, and other AI-based technologies to reduce the communication gap. It will also examine the potential implications of AI on resource distribution, such as developing more efficient distribution channels, increasing transparency, and reducing costs. Finally, the paper will analyze the impact of AI on the communication gap and resource distribution. It will discuss the potential challenges and benefits of using AI, such as the need for data security, the potential for bias, and the limitations of AI technology. The paper will also explore the potential for AI to improve the distribution of resources and reduce the communication gap. Overall, this paper provides an exploratory case study on the opportunities of how AI can contribute to reducing the communication gap and streamlining the distribution of resources. It discusses the potential implications of AI on the communication gap and resource distribution, and it reviews the potential challenges and benefits of using AI. The paper provides an in-depth analysis of the potential opportunities of using AI to reduce the communication gap and streamline the distribution of resources.

This publication delves into the intricate world of human communication, extending beyond the realm of spoken and written language to explore the profound influence of non-verbal communication. Focusing on body language—comprising gestures, facial expressions, postures, and movements—it reveals the pivotal role it plays in conveying emotions, intentions, and psychological states. The rapidly evolving fields of neuroscience and cognitive science are investigating the neural mechanisms and cognitive processes that underpin the interpretation and utilization of these non-verbal cues. Notably, the amygdala's involvement in processing emotional facial expressions has provided a neurological foundation for our emotional understanding in non-verbal communication. Concurrently, cognitive psychology sheds light on how perception, attention, and memory influence our interpretation of non-verbal cues and communication strategies.In our modern, technologically advancing society characterized by global interconnectivity and cultural diversity, the significance of non-verbal communication, especially in digital and virtual contexts, is paramount. The transformation of non-verbal expression into digital symbols like emoticons and emojis raises questions regarding its ability to maintain authenticity and emotional understanding. This publication endeavors to comprehensively explore the fundamental role of body language and non-verbal communication in contemporary society. By integrating insights from psychology, neuroscience, social sciences, and digital technologies, it aims to elucidate the underlying mechanisms guiding non-verbal communication. Additionally, it delves into the implications of non-verbal communication across diverse domains, including interpersonal communication, the workplace, politics, advertising, and the virtual world.The research presented herein strives to offer a thorough understanding of interpersonal dynamics, relationships, and social behavior, with the goal of promoting the development of more effective, conscious, and ethically guided communication strategies. Ultimately, this analysis aspires to inspire further interdisciplinary research and reflection, addressing emerging challenges and fully leveraging the potential of non-verbal communication in modern society. This, in turn, guides our path towards a communication landscape that is more inclusive, authentic, and empathetic.

Children with hearing loss have been found to have significantly more behavioral and emotional challenges than their typically hearing peers, though these outcomes are variable at the individual level. Working memory deficits have been found to relate to executive functioning and overall emotion regulation, leading to behavior challenges. Language development is essential for development of social relationships and communicating one’s needs - this may lead to distress when children cannot communicate effectively. Based on prior findings in children with hearing loss and their typically hearing peers, working memory and language skills were hypothesized to be related to parent and teacher report of socioemotional functioning. Participants were 35 children with hearing loss (66% female, M = 5.17 years old, SD = ±1.97) whose language, working memory, and socioemotional functioning were evaluated during the course of treatment and educational planning. Bivariate analyses indicated that working memory was related to a number of socioemotional domains (e.g., functional communication, atypicality, withdrawal), as were language scores (e.g., social skills, inattention). The direction of these associations was such that stronger working memory and language skills were related to more regulated socioemotional functioning. A call to action of the current study includes more education with regard to profiles and presentations of children with hearing loss, and an early focus on socioemotional learning to foster the development of regulatory skills.

Retweet prediction is an important task related to different problems such as information spreading analysis, the automatic detection of fake news, social media monitoring, etc. In this study we explore the possibilities of retweet prediction based on heterogeneous data sources. In order to classify the tweet according to the amount of retweets, we combine features extracted from the multilayer network and the text. More specifically, we introduce a multilayer framework that proposes the multilayer network representation of Twitter. This formalism captures different users' actions and complex relationships as well as other key properties of communication on Twitter. We select a set of local network measures from each layer and construct a set of multilayer network features. In addition, we adopt a BERT-based language model, namely Cro-CoV-cseBERT to capture high-level semantics and structure of tweets as a set of text features. Then, we train six machine learning (ML) algorithms: random forest, multilayer perceptron, light gradient boosting machine, category embedding model, neural oblivious decision ensembles and attentive interpretable tabular learning model in the task of retweet prediction. We compare the performance of all six algorithms in three different setups (i) using only text features, (ii) using only multilayer network features and (iii) using both sets of features. We evaluate all setups in terms of standard evaluation measures i.e. precision, recall, F1-score and accuracy. For this task, we first prepare and use an empirical dataset of 199,431 tweets in the Croatian language posted during the period between January 1, 2020 and May 31, 2021. Our results indicate that by integrating multilayer network features with text features the prediction model would perform better than using just one set of features.

Purpose. This article examines the use of English medium instruction (EMI) for teaching Japanese as a foreign language (JFL) by non-native speakers with a focus on multilingual classrooms. The study also explores teachers’ positive and negative beliefs about using EMI in classroom settings for JFL instruction.Methods and procedure. Two hundred sixty-one non-native Japanese language teachers worldwide voluntarily participated in the survey, answering the questionnaire (Google Forms and Jotforms) used to gather data. Both qualitative and quantitative methods were employed. The research instrument was piloted before the main study and was found to be effective and adequate to elicit the desired data. The research questions aimed to identify whether there were any relationships between the use of EMI and the multilingual classroom. Findings. The results showed a clear correlation between the extensive use of EMI and the multilingual character of JFL multilingual classrooms. Translanguaging turned out to be a common practice adopted by non-native Japanese teachers regardless of the primary language of instruction. The article concludes that EMI can be a valuable tool for JFL instruction in multilingual classrooms. Based on the investigation of the teachers’ beliefs, the study results showed a changing positive attitude towards English employed in JFL classrooms. Implications for research and practice. The findings can be used further to investigate EMI in JFL instructional practices in multilingual classrooms, to improve the quality of JFL instruction, and to facilitate the integration of multilingual education into foreign language teaching. Future research can explore the effectiveness of EMI in different JFL contexts and investigate the impact of EMI on students’ language learning outcomes.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

This paper addresses the grammatical challenges associated with the development of clause complexity, focusing on the performance of a group of monolingual Spanish-speaking schoolchildren with Specific Language Impairment/Developmental Language Disorder (SLI/DLD) in a longitudinal corpus of oral narrative samples. The study examines the presence of interclause relations of subordination and equivalence (hypotaxis and parataxis) in language samples of two groups: an experimental group made up of 24 schoolchildren with SLI/DLD and a control group made up of 24 schoolchildren with typical development (TD). The results show that while both groups use parataxis as the most common relation between clauses in all school grades, there is a significant decrease in paratactic relations and a significant increase in hypotactic relations from first to fourth grade of primary education. Although the development patterns are highly similar, the SLI/DLD group shows greater difficulties in mastering more complex (hypotactic) relations in fourth grade compared to the control group, indicating that they are less sophisticated in the use of these types of complex relations. These findings suggest that focused support on the most complex structures is needed towards the fourth grade of primary education, given the demands of the school academic register from 6 and 7 years of age, and the potential problems that the development of clause complexity can cause in school-age children.

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

Recent research has suggested that working memory training interventions may benefit children with Developmental Language Disorder (DLD). The current study investigated a short and engaging adaptive working memory intervention that targeted executive skills and aimed to improve both language comprehension and working memory abilities in children with DLD. Forty-seven 6- to 10-year-old children with DLD were randomly allocated to an executive working memory training intervention (n=24) or an active control group (n=23). A pre-test/intervention/post-test/9-month-follow-up design was used. Outcome measures included assessments of language (to evaluate far transfer of the training) and working memory (to evaluate near transfer of the training). Hierarchical multiple regression analyses controlling for pre-intervention performance and age found group to be a significant predictor of sentence comprehension and of performance on six untrained working memory measures at post-intervention and 9-month follow-up. Children in the intervention group showed significantly higher language comprehension and working memory scores at both time points than children in the active control group. The intervention programme showed potential to improve working memory and language comprehension in children with DLD and demonstrated several advantages: it involved short sessions over a short period; caused little disruption in the school day; and was enjoyed by children.

Coronavirus, also known as COVID-19, has been declared a pandemic by the World Health Organization (WHO). At the time of conducting this study, it had recorded over 1.6 million cases while more than 105,000 have died due to it, with these figures rising on a daily basis across the globe. The burden of this highly contagious respiratory disease is that it presents itself in both symptomatic and asymptomatic patterns in those already infected, thereby leading to an exponential rise in the number of contractions of the disease and fatalities. It is therefore crucial to expedite the process of early detection and diagnosis of the disease across the world. The case-based reasoning (CBR) model is an effective paradigm that allows for the utilization of cases’ specific knowledge previously experienced, concrete problem situations or specific patient cases for solving new cases. This study therefore aims to leverage the very rich database of cases of COVID-19 to solve new cases. The approach adopted in this study employs the use of an improved CBR model for state-of-the-art reasoning task in classification of suspected cases of Covid19. The CBR model leverages on a novel feature selection and semantic-based mathematical model proposed in this study for case similarity computation. An initial population of the archive was achieved with 68 cases obtained from the Italian Society of Medical and Interventional Radiology (SIRM) repository. Results obtained revealed that the proposed approach in this study successfully classified suspected cases into their categories at an accuracy of 97.10%. The study found that the proposed model can support physicians to easily diagnose suspected cases of Covid19 base on their medical records without subjecting the specimen to laboratory test. As a result, there will be a global minimization of contagion rate occasioned by slow testing and as well reduce false positive rates of diagnosed cases as observed in some parts of the globe.

Among the most popular learning management systems available worldwide is Moodle [1]. This current study examines how learners' attitudes toward English as a foreign language (EFL) and their language proficiency are affected by Moodle's interactive language learning activities. Thirty-three undergraduate students participated in this study. We investigated the effects of engaging language learning exercises that were practiced on Moodle using an experimental re-search design. To find out if the experimental and control groups differed significantly from one another on pre- and post-measures regarding the development of language skills and attitudes toward language classrooms, a number of statistical tests were employed. We conducted data analysis using SPSS software. Results demonstrated that there were differences favoring the ex-perimental group in the language skills developments and attitudes of learners toward the lan-guage classroom. There were no apparent differences in the forming structures, speaking, or listening of the control group's learners. On the other hand, there were notable differences in the overall score, writing and reading skills, and lexical item mastery. Additionally, significant dif-ferences in the language acquisition growth of the experimental and control groups were found using an Independent Samples T-test in the post-test, with the experimental group benefiting.

This paper proposes an interpretable geometry solution based on the formal language set of text and diagram. Geometry problems are solved by machines, which still poses challenges in natural language processing and computer vision. Significant progress promotes existing methods in the extraction of geometric formal languages. However, the neglect of the graph structure information in the formal language and the lack of further refinement of the extracted language set can lead to the poor effect of the theorem prediction and affect the accuracy in problem solving. In this paper, the formal language graph is constructed by the extracted formal language set and used to theorem prediction by graph convolutional network. So as to better extract the relationship set of diagram elements, an improved diagram parser was proposed. The test results indicate that the improved method has good results in solving the problem with interpretability geometry.

The circular economy (CE) has emerged as a viable alternative for tackling the problems caused by rising consumption, including solid waste (SW). The present study conducted a meta-analysis of research published between 2012 and 2022 on CE and solid waste management (SWM). A bibliometric analysis was used from the Web of Science (WoS) and Scopus databases. By studying the articles, we briefly discussed the connections between them and how one contributes to the evolution of the other. Some findings point to greater collaboration between Italy and Bolivia, followed by China and Malaysia. However, they move away from the traditional axes as the United States and Canada. In addition, it was found that the adoption of reuse and selective collection, in fact, allow the reduction of the volume of discarded materials. In this way, it was possible to conclude that a greater connection between CE and GRS makes it possible to optimize the useful life of landfills through the treatment of organic waste and recycling, to encourage waste picker cooperatives and selective collection programs, and to reduce the financial costs of the system as a whole, making it more durable and sustainable.

In bilingual communities, social interactions take place in both single- and mixed-language con-texts. Some of the information shared in multilingual conversations is often required in conse-quent social encounters, like interlocutors’ personal information. In this study we explored whether the autobiographical information provided in a single-language context is better re-membered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilin-gual (pre-)teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across partici-pants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

This paper explores the integration of multiple intelligences and artificial intelligence (AI) in language learning, focusing on its potential to enhance personalization and engagement. Drawing from existing research and studies conducted in various contexts, including the Philippines, this study aims to contribute to the understanding of the benefits, challenges, and effectiveness of this integration. The paper begins with an introduction that highlights the background and significance of integrating multiple intelligences and AI in language learning, identifying research gaps, objectives, research questions, and the theoretical framework. A literature review provides an overview of multiple intelligences theory by Howard Gardner, the role of AI in language learning, and identifies gaps in the existing literature. The methodology section outlines the research design and approach, participant selection, data collection methods, validity and reliability measures, and ethical considerations. Findings and results are presented through the analysis of qualitative data, exploring emergent themes and patterns. The discussion section critically examines the identified research gaps, discusses the validity and reliability of the study, addresses the scope and limitations, and explores the implications of the findings for theory, practice, and future research. The conclusion summarizes the key findings and contributions of the study, reflects on the achievement of research objectives, offers recommendations for further research, and provides final remarks tying together the main points of the study. This paper contributes to the existing body of knowledge by providing insights into the integration of multiple intelligences and AI in language learning and its impact on personalization, engagement, and language learning outcomes.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

In this article, we discuss problems that exist in modern SCADA systems and present a Controls-kt (formerly DataForge-controls) software development kit, that allows both to create a control system from scratch and provide integration with existing systems via Magix specification and connector.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

The sentiment of a word varies based on its context of usage: the words used around it and the part-of-speech it is used as. This paper proposes a technique to suggest the sentiment of a word by combining its part-of-speech and the semantic similarities of its co-occurrences with both context-specific and pre-trained embeddings to achieve powerful and fast results. A study was conducted across domains and sub-domains to measure variance of sentiment by switching domains and switching context within the same domain. Re-scoring a commonly used polarity lexicon showed that 10% of words changed scores while switching domains and 8% changed scores within domains while switching context. Part of Speech analysis on 65,353 commonly used sentiment lexicons showed that 81% of sentiment bearing (non-neutral) lexicons were of the tags NN (Common Noun), JJ (Adjective) or NNS (Proper Noun).

Background: Over the past decade, the use of digital tools has grown and research evidence suggests that traditional media and new media offer both benefits and health risks for young children. The abilities to understand and use language represent two of the most important competencies developed during the first 3 years of life through the interaction of the child with people, objects, events, and other environmental factors. The main goal of our study is to evaluate the relationship between digital devices use and language abilities in children between 8-36 month, considering also the influence of several variables. Materials and Methods: We conducted a cross-sectional observational study on 260 healthy children (140 males = 54%) aged between 8-36 months (mean=23.5±7.18 months). All the parents completed a self-report questionnaire investigating the use of digital devices by their children, and a standardized questionnaire for the assessment of language skills (MacArthur). Multiple linear regression was used to evaluate the relationship between different variables. Subsequent moderation analysis were performed to verify the influence of other factors. Results: W found a statistically significant negative correlation between the total daily time of exposure to digital devices and the Actions and Gestures Quotient (ß=-0.397) in children between 8-17 months, and between the total daily time of exposure to digital devices and Language Quotient (ß=-0.224) in children between 18-36 months. Sex, level of education/job of parents, modality of use/content of digital device do not significantly affect these relationships. Conclusion: In our study we found that a longer time of exposure to digital devices was related to lower mimic-gestural skills in children from 8-17 months and to lower language skills in children between 18-36 months, regardless of age, sex, socio-economic status, content and modality of use. Further studies are needed to confirm and better understand this relationship, but parents and pediatricians are advised to limit the use of digital devices by children and encourage the social interaction to support the learning of language and communication skills in this age group.

The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics, and language sciences more generally. Information-theory gives us tools at hand to measure precisely the average amount of choice associated with words—the word entropy. Here we use three parallel corpora—encompassing ca. 450 million words in 1916 texts and 1259 languages—to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present three main results: 1) a text size of 50K tokens is sufficient for word entropies to stabilize throughout the text, 2) across languages of the world, word entropies display a unimodal distribution that is skewed to the right. This suggests that there is a trade-off between the learnability and expressivity of words across languages of the world. 3) There is a strong linear relationship between unigram entropies and entropy rates, suggesting that they are inherently linked. We discuss the implications of these results for studying the diversity and evolution of languages from an information-theoretic point of view.

Effective communication is key for healthcare providers to provide optimal care for patients. Pharmacists’ fluency in a patient’s native language is vital to communicate effectively. Additionally, language concordance improves patients’ trust and ensures health equity. In the United States (US), Hispanics are the largest minority group, but only 36% of the pharmacy schools in the US offer Spanish courses in their curriculum. Conversely, Middle Eastern countries have implemented English as the language of instruction in pharmacy schools, though the native language of the patient population is Arabic. The discrepancy between the language of education and the language used by patients might lead to communication problems, thus limiting a pharmacist’s role in practice. This review aims to describe the efforts of pharmacy schools both in the US and Middle Eastern countries to incorporate second language (Spanish and Arabic, respectively) in their curriculum. Spanish language content has scarcely been introduced into the pharmacy curriculum in the US either as didactic elements (elective courses, lab sessions, modules within a course, or co-curricular programs) or as language immersion experiences (rotations and internships nationally or abroad). In Arabic-speaking countries, an Arabic course was introduced to the pharmacy curriculum to enhance students’ communication skills. This review provides an overview of what has been done in various pharmacy programs to prepare students for adequate multilingual speaking. The findings reveal the need for additional strategies to assess the impact of language courses on student performance and patient experience, as well as language competence in pharmacists and pharmacy students.

Human language and social cognition are two key disciplines that have traditionally been studied as separate domains. However, emerging research from detailed studies of comparative animal behavior, human social behavior, language acquisition in children, social cognitive neuroscience, and the cognitive neuroscience of language suggest that language and social cognition are two deeply interrelated capacities of the human species. For instance, recent developmental studies on the acquisition of language in infants and young children, draw attention to the important crucial benefits associated with several different aspects of social stimulation for youngsters, including the quantity and quality of linguistic input, dyadic infant/child-to-parent verbal and non-verbal social interactions, and other important social cues integral for facilitating language learning and social bonding. Studies of the adult human brain further suggest a high degree of specialization for sociolinguistic information processing, memory retrieval, and comprehension, suggesting the function of these regions may link language with social cognition and social bonding. In effect, the social brain and social complexity hypotheses may jointly help to explain how neurotypical children and adults learn language, why autistic adults and children exhibit simultaneous deficits in language and social cognition, and why nonhuman primates and other animals with significant computational abilities do not acquire the capacity for language. But perhaps most critically, the following article argues that this and related research will allow scientists to generate a holistic profile and deeper understanding of the healthy adult social brain, while developing more innovative and effective diagnoses, prognoses, and treatments for maladies and deficits also associated with the social brain.

Human language is a prime example of a complex system characterized by multiple scales of description. Understanding its origins and distinctiveness has sparked investigations with very different approaches, ranging from the Universal Grammar to statistical analyses of word usage, all of which highlight, from different angles, the potential existence of universal patterns shared by all languages. Yet, a cohesive perspective remains elusive. In this paper we address this challenge. First, we provide a basic structure of universality, and define recursion as a special case thereof. We cast generative grammars of formal languages, the Universal Grammar and the Greenberg Universals in our basic structure of universality, and compare their mathematical properties. We then define universality for writing systems and show that only those using the rebus principle are universal. Finally, we examine Zipf's law for the statistics of word usage, explain its role as a complexity attractor, and explore its relation to universal writing systems as well as its similarities with universal Turing machines. Overall, we find that there are two main kinds of universality, termed {\it mechanistic} and {\it emergent}, and unveil some connections between them.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

Converting natural language into machine language that can be recognized by distributed systems is the core challenge of intelligent interactive interfaces and human-machine dialogue systems. The human-machine interface interaction of large distributed SCADA measurement and control system is tedious and the operation and maintenance cost is high, so it is significant to design an intelligent natural language interaction interface for distributed measurement and control system. In this paper, we design the intermediate language format of SCADA system, i.e., Key-value logic form, and then formulate the Text2SCADA framework and propose the TICS algorithm and SDPA algorithm, the former adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for basic natural language instructions, and the latter adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for relatively The latter one adopts the algorithm of dependent syntactic analysis for the structured representation of natural language instructions with relatively complex natural language instructions. Based on the above algorithms, a lightweight information extraction model based on DGCNN and probabilistic graph ideas is constructed, aiming to enhance the scientific generalization ability of the framework on unknown instruction sets. The experimental results show that the proposed intelligent natural language interface can better solve the human-machine interface interaction problem of distributed SCADA measurement and control system. The average accuracy, recall and F-value of instruction parsing reach 89.27\%, 89.28\% and 89.27\%, respectively. The average response time is 1.593 s. Especially, it provides a more convenient means of interaction for industrial and agricultural information control.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

Communication is indispensable for today's lifestyle, and thanks to technology, millions of people can communicate as quickly as possible. The effect of this breakthrough has transformed organizations to the degree that they generate billions of emails daily to facilitate their operations. There is implicit information behind this vast corpus of human-generated content that can be mined and used for their benefit. This paper tries to address the opportunity that email logs can bring to organizations and propose an approach to discover process models by combining supervised text classification and process mining. This framework consists of two main steps, text classification, and process mining. First, Emails will be classified with supervised machine learning, and to mine, the processes fuzzy Miner is used. To further investigate the application of this framework, we also applied this framework over a real-life dataset from a case study organization.

Music and language are hypothesized to share neural resources, particularly at the level of syntax processing. Recent reports suggest that attention modulates this sharing of neural resources, but the time-course of the effects of attention, and the degree to which attention operates similarly on music and language, are yet unclear. In this EEG study we manipulate the syntactic structure of simultaneously presented musical chord progressions and garden-path sentences in a modified rapid serial visual presentation paradigm, while varying top-down attentional demands to the two modalities. The Early Right Anterior Negativity (ERAN) was observed in response to both attended and unattended musical syntax violations. In contrast, an N400 was only observed in response to attended linguistic syntax violations, and a P3 only in response to attended musical syntax violations. Results show that top-down allocation of attention indeed affects the processing of syntax in both music and language, with different neural resources acting upon the two modalities particularly at later stages of cognitive processing. However, the processing of musical syntax at an earlier stage of the perceptual-cognitive pathway, as indexed by the ERAN, is partially automatic, and is strongly indicative of separate neural resources for music and language.

In today's complex and rapidly changing world, integrating values, critical thinking, and moral reasoning in language and literature education is crucial for equipping students with the skills to navigate multifaceted ethical dilemmas and become responsible global citizens. This article highlights the connection between language, literature, critical thinking, moral reasoning, and values integration in education. Through language and literature, teachers can incorporate values education in their classroom, which can benefit not only individual students but also society as a whole. Theoretical frameworks such as character education, moral education, and values education provide the basis for this approach. The researcher recommends strategies for incorporating values integration in language and literature curricula, including the use of literary texts that promote critical thinking and moral reasoning skills. The limitations of this approach, including the challenges in assessing the effectiveness of values integration and potential resistance from some stakeholders, are also discussed. Ultimately, this article aims to call on educators to take a proactive role in promoting values integration in language and literature education, guided by the principles of Jesus Christ and the belief that education is not only about acquiring knowledge but developing character as well. Moreover, this concept has a significant and lasting impact on students' overall development that highlights the importance of values and moral reasoning needed to live a better life.

Recent studies highlight the need to introduce objectives in Initial Teaching Education focused on the development of oral language competence (OLC). The main aim of the study is to examine activities to promote the development of OLC that are carried out in university classrooms and their evaluation, to analyze the relationship between students’ awareness of OLC work and class activities and to identify proposals to improve students’ OLC. Participants were 175 university teachers who teach on the bachelor’s degree in Initial Teacher Education (ITE) and the master’s degree in Secondary Education (MSE) at seven Catalan universities. The data collection instrument was an online questionnaire with 69 questions. The results indicate that 92.5% of participants work on OLC in their subjects, that 76.5% propose activities that are specifically linked to OLC and that 65.1% of participants evaluate OLC in their subject. A total of 39.4% of participants reported the need to increase discussions to generate processes of collaborative and interdisciplinary reflection between university teachers from different areas of knowledge, among others. We conclude that professional development processes need to be designed for ITE teachers to reflect on how they help students to develop OLC from a pragmatic perspective.

This paper documents the development of a special case of multilingual Automatic Speech Recognition model, specifically tailored to attend two languages spoken by the majority of Latin America, Portuguese and Spanish. The bilingual model combines Language Identification and Speech Recognition developed with the Wav2Vec2.0 architecture and trained on several open and private speech datasets. In this model, the feature encoder is trained jointly for all tasks and different context encoders are trained for each task. The model is evaluated separately on two tasks: language identification and speech recognition. The results indicate that this model achieves good performance on speech recognition and average performance on language identification, training on a low quantity of speech material. The average accuracy of the language identification module on the MLS dataset is 66.75%. The average Word Error Rate in the same scenario is 13.89%, which is better than average 22.58% achieved by the commercial speech recognizer developed by Google.

The goal of the next generation World Wide Web is machine readability through linked databases. To improve web search, integration, and mining in local languages like Urdu, there is a growing need to develop ontologies and vocabulary in these languages. The majority of people use the web in local languages for agriculture, social media interaction, news, etc. How to create agents for the integration of web data. In our country, the literacy ratio is very low and IT literacy is negligible. More comprehensive information for its target audience is only possible through the World Wide Web. Our first target is to improve and enhance the use of social media and the web in local languages. That will encourage its constructive use in Urdu for society and the economy. The Web in natural languages is the source of income for small and medium enterprises. The semantic web is concerned with linked databases and structured data. In this work, we are focused on some selected ontologies to be translated into natural languages. Expertise in Ontology Engineering helps us in job production. Ontology Engineering has extensive freelancing opportunities. Only if the web is correctly interpreted in regional languages is an economic boost achievable. A standardized foundation for data sharing and reuse on the internet is provided by the Semantic Web. In other words, a group of standards and technology that enables computers to comprehend the semantics (meaning) of material on the Web.

The deaf impairment is among the most substantial health problem worldwide, that can lead to various personal, economical, and social crisis. Therefore, it is critical for developing an efficient way to facilitate communication between deaf-dumb impaired and normal people. Herein, we have rationally designed a new digitally computerized and mobile smart system as an efficient communication tool between deaf impaired and normal Arabian people. This is based on two main steps, including creating a digital output for the hand gestures using gloves flex sensors equipped with a three-axis accelerometer that is controlled using a microcontroller. The digital results are compared to that in a words-based “database”, where Arabs use expressions not alphabet in their communication. The second step is translation or conversion the outputs of the first stage into written texts and voices. The newly developed system allows Arabian deaf to translate words of ordinary people into gestures using a speech recognition system with an impressive accuracy over 90 % without the needing for a webcam, colored gloves, and/or online translator. The presented system can be used on any android or windows.

In the dynamic landscape of E-commerce, the proliferation of user-generated queries regarding products highlights the critical need for advanced automatic question answering (AQA) systems. These systems are instrumental in harnessing the vast array of information available online to deliver immediate and informative responses to potential buyers. Recognizing the complexity of such queries, which often require synthesis of reviews, product specifications, and responses to similar questions, we introduce a sophisticated model, the Comprehensive E-commerce Answer Generation System (CEAGS). This model adeptly navigates the challenges posed by irrelevant data and sentiment ambiguity in user-generated content. Our approach leverages a dual-phase process of relevance determination and sentiment clarity, setting the stage for a transformative response generation mechanism. Empirical analyses reveal the superiority of CEAGS, with our relevance assessment framework outstripping existing models by a notable margin in precision metrics, and our answer generation module achieving unprecedented gains in content preservation and coherence. Notably, CEAGS marks a pioneering contribution to the E-commerce domain by integrating disparate information sources to formulate responses that are not only accurate but also contextually rich and user-centric.

This paper will argue that memory from early childhood underlies many practices and beliefs that we commonly refer to as “religious”. The consciousness of young children does not yet have certain features that characterizes adult consciousness. This paper will concentrate on four of these: (I) a reality that is recognizable; (II) a sense of temporal duration; (III) a sense of self; (IV) an experience of the world that is deeply affected by our acquaintance with (a) language. Absence of these features presumably characterizes the consciousness of infants. It also often characterizes mystical experiences. The paper will argue that the human tendency to engage in so-called religious practices and beliefs makes most sense on the assumption that adults somehow preserve the memory of their state of being in childhood.

This paper aims to provide an overview of the complete process in the development of a Domain-Specific Language (DSL). It explains the construction steps such as preliminary research, language implementation, and evaluation. Moreover, it provides details for different key components which are commonly found in the DSLs such as the abstraction layer, DSL metamodel, and the applications. It also explains the general limitations related to the Domain-Specific Languages for Workflows.

In this experiment, an efficient and accurate network of detecting automatically disseminated (bot) content on social platforms is devised. Through the utilisation of parallel convolutional neural network (CNN) which processes variable n-grams of text 15, 20, and 25 tokens in length encoded by Byte Pair Encoding (BPE), the complexities of linguistic content on social platforms are effectively captured and analysed. With validation on two sets of previously unexposed data, the model was able to achieve an accuracy of around 96.6% and 97.4% respectively — meeting or exceeding the performance of other comparable supervised ML solutions to this problem. Through testing, it is concluded that this method of text processing and analysis proves to be an effective way of classifying potentially artificially synthesized user data — aiding the security and integrity of social platforms.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

In this paper we analyse spatial variation in Japanese dialectal lexicon by assembling a set of methodologies using theories in variationist linguistics and GIScience, and tools used in historical GIS. Based on historical dialect atlas data, we calculate a linguistic distance matrix across survey localities. The linguistic variation expressed through this distance is contrasted with several measurements, based on spatial distance, utilised to estimate language contact potential across Japan, historically and at present. Further, administrative boundaries are tested for their separation effect. Measuring aggregate association within linguistic variation can contrast previous notions of dialect area formation by detecting continua. Depending on local geographies in spatial subsets, great circle distance, travel distance and travel times explain a similar proportion of the variance in linguistic distance despite the limitations of the latter two. While they explain the majority, two further measurements estimating contact have lower explanatory power: least cost paths modelling contact before the industrial revolution, based on DEM and seafaring, and a linguistic influence index based on settlement hierarchy. Historical domain boundaries and present day prefecture boundaries are found to have a statistically significant effect on dialectal variation. However, the interplay of boundaries and distance is yet to be identified. We claim that a similar methodology can address spatial variation in other digital humanities, given a similar spatial and attribute granularity.

Background: Mental synthesis is the conscious purposeful process of synthesizing a novel mental image from objects stored in memory. In our everyday use of language, we rely on mental synthesis to communicate an infinite number of images with a finite number of words. In typical children, the timeline of mental synthesis acquisition is highly correlated with an increasing vocabulary. Children with ASD, on the other hand, may learn hundreds of words but never acquire mental synthesis. In these individuals, tests assessing vocabulary comprehension may fail to demonstrate the profound deficit in mental synthesis and the resulting inability to understand flexible syntax and spatial prepositions. Objective: We developed a 20-question parent-reported evaluation tool designed to quantitatively assess mental synthesis ability and to serve as a complimentary scale for Autism Treatment Evaluation Checklist (ATEC). Results: Internal reliability was good (Cronbach’s alpha > .9), and the MSEC exhibited adequate test-retest reliability after a three- and nine-months follow up period. The MSEC results positively correlated with the ATEC communication subscale, providing support for construct validity. Moreover, MSEC scores were significantly different for children of different ASD severity levels confirming the known groups validity. Conclusions: This study represents the first step toward the development of an instrument to measure mental synthesis in children with ASD. Although the current empirical evaluation demonstrated strong evidence of excellent psychometric properties, such as validity and reliability, additional studies should be performed to replicate these findings.

In the wake of globalization and the revolutionary impact of Artificial Intelligence (AI), literature and language education play a pivotal role in preparing the next generation to navigate an ever-changing world. This reflective concept paper explores the profound insights shared by educators, focusing on literature and language education amidst globalization and AI. Drawing on interviews and observations, teachers' reflections reveal the enduring value of literature in shaping young minds, fostering critical thinking, and promoting empathy. Additionally, they emphasize the importance of embracing multilingualism and cultural diversity to equip students for an interconnected world. In the face of challenges, educators showcase their resilience and adaptability, harnessing technology, particularly AI-driven tools, to foster future-ready learners. Identifying gaps and implications in literature and language education, this paper sets the stage for collective efforts among stakeholders to shape the future of education. Ultimately, teachers hold the key to nurturing a generation capable of embracing the complexities of the AI-driven global landscape with confidence and compassion, empowering students as transformative agents in a rapidly changing world.

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

While adequate for English-speaking users in the United States, as well as many Commonwealth countries and other English-speaking jurisdictions (e.g., Canada, Australia, New Zealand or South Africa among others), typing in Romance Languages (Spanish, French, Portuguese and Italian) by using a standard US-QWERTY Keyboard is not easy since it is not adapted to special characters such as accented vowels, tildes and cedillas or ligatures, used in Romance Languages. With regard to the International Layout, intended to enable access to the most common diacritics used in Western European Languages, the problem comes from the fact that accented vowels are spread throughout the Keyboard layout, and their uppercase versions need chord combinations which can require good manual dexterity. This paper will analyze how the Spanish or Portuguese Keyboards are the best options for these users since they are QWERTY-based and the most compatible ones for the different character sets in Spanish, French, Portuguese and Italian Languages.

This study mostly analyzes the pragmatic viewpoints of speech acts and language functions through Halliday’s (1975) language functions and Searle’s (1976) speech acts were adapted to analyze the functional aspects of the conversations and it was also intended to explore the teachers’ perception toward teaching and learning English as a Foreign Language (EFL) learners’ textbooks and the teacher’s components of communicative knowledge regarding the functions of language in daily activity. The participants of this paper consisted of thirteen Sunrise 10, 11, 12 grades of Kurdish teachers at high school English in Iraqi Kurdistan. Through semi-structured interview, it was found that the conversations in the mentioned textbooks are insufficient from the pragmatic point of view. Some recommendation for the textbook designers, teachers, material developer were raised to make up the shortcomings of the textbooks. The findings reveal that the conversation texts in Sunrise textbooks are not meeting the systematic standard of pragmatic competence the English language learners and the book designer must be recommended to be aware of those shortcomings of the textbook series if they are required to develop their speaking skills in both student and activity series. The implications of this paper can be helpful in comparing the results of this study with other similar studies to check if there is a universal pattern in performing the speech acts and language functions and the interest to Kimberley Education for Life learners in increasing their knowledge of pragmatics in general and the role of language functions and speech acts investigated in this study.

During the last two years the COVID-19 pandemic has affected the world population in several ways. An important increase in mental health problems is a consequence of this pandemic that is ubiquitous worldwide. In this work we study the effect of the pandemic on the mental health of a population of teenagers and youth based on the analysis of natural language processing, machine learning algorithms and expert knowledge. The data analysed was obtained from a chat helpline called Safe time from theIt Get’s Better Foundation in Chile. The data consists of 10,986 conversations gathered from 2018 until 2020 between volunteers from the foundation and users of the platform. We compared the conversationsbefore and during the pandemic in terms of their thematic content. Our analysis found: a significantdecrease in self-image appreciation during the pandemic; a significant decrease in the quality of personalrelationships during the pandemic, and a significant increase of performance appreciation.

News on the stock market contains positive or negative sentiments depending on whether the information provided is favorable or unfavorable to the stock market. This study aims to discover the news sentiment and classify news according to its sentiments with the application of PhoBERT, a Natural Language Processing model designed for the Vietnamese language. A collection of nearly 40,000 articles on financial and economic websites is used to train the model. After training, the model succeeds in assigning news to different classes of sentiments with an accuracy level of over 81%. The research also aims to investigate how investors concern about the daily news by testing the movements of the market before and after the news is released. The analysis results show that there is an insignificant difference in the stock price as a response to the news. However, investors tend to overreact to negative and positive news in the Vietnam stock market.

This study aimed to compare procedural learning skills between Spanish-speaking preschool children (ages 4 years to 4 years, 11 months) with Developmental Language Disorder (DLD) and their typically developing (TD) peers. Using the Serial Reaction Time task, participants (30 DLD and 30 TD children) respond to visual stimuli in a sequenced manner over four blocks, followed by a random order block. The task assessed reaction time (RT) and accuracy. Results showed a significant interaction between group and block for reaction time (RT) and accuracy, with children with DLD exhibiting longer RTs and accuracy deficits across blocks. In contrast, the TD group showed higher RT efficiency and accuracy in the sequential blocks and as expected, decreased performance in the random block according to the experimental manipulation. Overall, the results of this investigation suggest that there was no implicit learning in the DLD group, as indicated by the SRT task paradigms of procedural memory. These findings align with the Procedural Deficit Hypothesis (PDH), suggesting that linguistic deficits in the TD population may derive from a general dysfunction of the procedural memory system domain in the Spanish context.

Due to the substantial growth of internet users and its spontaneous access via electronic devices, the amount of electronic contents is growing enormously in recent years through instant messaging, social networking posts, blogs, online portals, and other digital platforms. Unfortunately, the misapplication of technologies has boosted with this rapid growth of online content which leads to the rise in suspicious activities. People misuse the web media to disseminate malicious activity, perform the illegal movement, abuse other people, and publicize suspicious contents on the web. The suspicious contents usually available in the form of text, audio or video, whereas text contents have been used in most of the cases to perform suspicious activities. Thus, one of the most challenging issues for NLP researchers is to develop a system that can identify suspicious text efficiently from the specific contents. In this paper, a Machine Learning (ML)-based classification model is proposed (hereafter called STD) to classify Bengali text into non-suspicious and suspicious categories based on its original contents. A set of ML classifiers with various features has been used on our developed corpus, consisting of 7000 Bengali text documents where 5600 documents used for training and 1400 documents used for testing. The performance of the proposed system is compared with the human baseline and existing ML techniques. The SGD classifier `tf-idf’ with the combination of unigram and bigram features are used to achieve the highest accuracy of 84.57%.

With the rapid growth of large language models (LLMs), there is increasing demand for memory and computation for LLMs. Recent efforts on post-training pruning of LLMs aim to reduce the model size and computation, yet the performance is still sub-optimal. In this paper, we present a plug-and-play solution for post-training pruning of LLMs. The proposed solution has two innovative components: 1) **Relative Importance and Activations** (RIA), a new pruning metric that jointly considers the weight and activations efficiently on LLMs; and 2) **Channel Permutation**, a new approach to maximally preserve important weights under N:M sparsity. The proposed two components can be readily combined to further enhance the N:M structuredly pruned LLMs. Our empirical experiments show that RIA alone can already surpass all existing post-training pruning methods on prevalent LLMs, e.g., LLaMA ranging from 7B to 65B. Furthermore, N:M structured pruning with channel permutation can even outperform the original LLaMA2 70B on zero-shot tasks, together with practical speed-up on specific hardware.

Crowdsourced Data (CSD) generated by citizens is becoming more popular as its potential utilisation in many applications is increasing due to its currency and availability. However, the quality of CSD, including its relevance, is often questioned as the data is not generated by professionals nor follows standard data collection procedures. The quality of CSD can be assessed according to a range of attributes including its relevance. Information relevance has been explored through using in Geographic Information Retrieval (GIR) techniques to identify relevant information. This research tested a relevance assessment approach for CSD by adapting relevance assessment techniques available in the GIR domain. The thematic and geographic relevance were assessed using the Term Frequency-Inverse Document Frequency (TF-IDF), Vector Space Model (VSM) and Natural Language Processing (NLP) techniques. The thematic and geographic specificities of the queries were calculated as 0.44 and 0.67 respectively, which indicates the queries used were more geographically specific than thematically specific. The Spearman's rho value of 0.62 indicated that the final ranked relevance lists showed reasonable agreement with a manually classified list and confirmed the potential of the approach for CSD relevance assessment for other possible crowdsourced data analysis.

In an ever-evolving landscape of higher education, this study delves into the transformative potential of merging deep learning principles and meaningful pedagogy in language acquisition, aided by artificial intelligence (AI) technologies. Drawing from a qualitative research design, it navigates the post-pandemic educational landscape, examining shifts in language education, student perspectives, and adaptations. Through comprehensive data collection methods, including literature review, interviews, and classroom observations, the study presents insights from 30 participants from SMC. The qualitative findings reveal emerging themes related to deep learning, meaningful learning, AI integration, and language acquisition, underscoring their profound impact on teaching methods and student engagement. This research contributes to the field by shedding light on innovative approaches that elevate language acquisition in an AI-evolving educational environment. The study concludes with implications for school administrators, teachers, and students, offering recommendations for future research directions, ultimately striving to enhance language education in the modern era.

(1) Background: Children with autism spectrum disorder (ASD) show certain characteristics in visual attention which generate difficulties in the integration of relevant social information to set the basis of communication. Gaze following and pupil dilation could be used to identify signs for the early detection of ASD. Eye-tracking methodology allows objective measurement of these anomalies in visual attention. The aim is to determine whether measurements of gaze following and pupillary dilation in a linguistic interaction task, captured using eye-tracking methodology, are objective for early diagnosis of ASD. (2) Methods: 20 children between 17 and 24 months of age, made up of 10 neurotypical children and 10 children with ASD were paired together according to chronological age. A human face on a monitor pronounced pseudowords associated with pseudo-objects. Gaze following and pupil dilation was registered during the task. (3) Results: Significant statistical differences were found in the time of gaze fixation on the human face and on the object, as well as in the number of gazes. Also, there were significant differences in the maximum peak of pupil dilation, this being found in the neurotypical group at the moment of processing of the pseudoword, and in the ASD group in the baseline prior to the task (4) Conclusions: The registration and the duration of gaze, and the measurement of pupil dilation with ‘eye-tracker’ are objective measures for early detection of ASD.

Potocki-Lupski Syndrome (PTLS) is a rare condition associated with a duplication of 17p11.2 that may underlie a wide range of congenital abnormalities and heterogeneous behavioral phenotypes. Along with developmental delay and intellectual disability, autism-specific traits are often reported to be the most common among patients with PTLS. To contribute to the discussion of the role of autism spectrum disorder (ASD) in the PTLS phenotype, we present a case of a female adolescent with a de novo dup(17)(p11.2p11.2) without ASD features, focusing on in-depth clinical, behavioral, and electrophysiological (EEG) evaluations. Among EEG features, we found the atypical peak-slow wave patterns and a unique saw-like sharp wave of 13 Hz that was not previously described in any other patient. The power spectral density of the resting state EEG was typical in our patient with only the values of non-linear EEG dynamics: Hjorth complexity and Fractal dimension were drastically attenuated compared with the patient’s neurotypical peers. Here we also summarize results from previously published reports of PTLS that point to the about 21% occurrence of ASD in PTLS that might be biased, taking into account methodological limitations. More consistent among PTLS patients were intellectual disability and speech and language disorders.

We present improvements in n-best rescoring of code-switched speech achieved by n-gram augmentation as well as optimised pretraining of long short-term memory (LSTM) language models with larger corpora of out-of-domain monolingual text. In addition, we consider the application of large pretrained transformer-based architectures. Our experimental evaluation is performed on an under-resourced corpus of code-switched speech comprising four bilingual code-switched sub-corpora, each containing a Bantu language (isiZulu, isiXhosa, Sesotho, or Setswana) and English. We find in our experiments that, by combining n-gram augmentation with the optimised pretraining strategy, speech recognition errors are reduced for each individual bilingual pair by 3.51% absolute on average over the four corpora. Importantly, we find that even speech recognition at language boundaries improves by 1.14% even though the additional data is monolingual. Utilising the augmented n-grams for lattice generation, we then contrast these improvements with those achieved after fine-tuning pretrained transformer-based models such as distilled GPT-2 and M-BERT. We find that, even though these language models have not been trained on any of our target languages, they can improve speech recognition performance even in zero-shot settings. After fine-tuning on in-domain data, these large architectures offer further improvements, achieving a 4.45% absolute decrease in overall speech recognition errors and a 3.52% improvement over language boundaries. Finally, a combination of the optimised LSTM and fine-tuned BERT models achieves a further gain of 0.47% absolute on average for three of the four language pairs compared to M-BERT. We conclude that the careful optimisation of the pretraining strategy used for neural network language models can offer worthwhile improvements in speech recognition accuracy even at language switches, and that much larger state-of-the-art architectures such as GPT-2 and M-BERT promise even further gains.