What does the way autistics bypass, learn, and eventually master language tell us about humans’ genetically encoded linguistic ability? In this theoretical review, we argue that autistic non-social acquisition of language, as well as autistic savant abilities, provide a strong argument for an innate, human-specific orientation toward (and mastery of) complex embedded structures. Autistic non-social language learning may represent a widening of the material processed during development beyond oral language. Structure detection and manipulation and generative production of non-linguistic embedded and chained material (savant abilities in calendar calculation, musical composition and interpretation, three-dimensional drawing) may thus represent an application of such innate mechanisms to non-standard materials. Typical language learning through exposure to the child’s mother tongue may represent but one of many possible achievements of the same capacity. The deviation from typical language development in autism may ultimately allow access to oral language, sometimes in its most elaborate forms, but also explains the possibility of the absence of its development when applied exclusively to non-linguistic structured material. Such an extension of human capacities beyond, or in parallel to, their usual limits call into question what we consider to be specific or expected in humans and, therefore, does not necessarily represent a genetic “error”. Regardless of the adaptive success or failure of non-social language learning, it is up to science and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

Many children have suspected delayed language development and need extensive support from parents and the health care team. This study aimed to investigate suspected delayed language development and factors associated with suspected delayed language development among early childhood in Southern Thailand. Children aged 24 to 60 months were recruited as study samples using stratified random sampling conducted in 23 districts and simple randomized seven sections (425 children). Instruments comprised demographic data of the children and families, The preschool temperament questionnaire, and the Language Development Screening questionnaire using developmental surveillance and promotion manual. I was collecting data from July 2020 to January 2021. Data analysis used descriptive statistics and logistic regression. The results showed that 40.9 percent suspected delayed development. Daily screen time exceeding 2 hours per day (A.O.R. = 17.30, 95% CI: 7.35-40.72), and regarding a child's temperament, moderate-to-difficult temperament (A.O.R. = 9.56, 95% CI: 5.12-17.85) were significantly associated with a suspected delay of language development. The study suggested two-way communication and appropriate responses will help develop children's language.

Existing implementations of game design patterns have largely been confined to theoretical or research settings. Weaknesses in these implementations have prevented game design patterns from being properly evaluated as an educational and practical development tool. This paper examines these weaknesses, describes a method of developing and applying patterns that overcome the weaknesses, and evaluates use of the method for game design education and practice. Weaknesses in existing pattern implementations are: omission of design problems, presumption of functional completeness at the level of pattern languages, narrow topical focus, and lack of a concise, repeatable method for pattern production. Several features of the proposed method were specifically built to address these weaknesses, namely the pattern template, the process for connecting patterns into a language and assessing the language’s scope, a rubric for assessing pattern confidence and interconnectivity confidence, and pattern-building exercises. This method was applied in a classroom setting. Results, as assessed by the evaluation of student work, suggest that creating patterns/pattern languages is an effective pedagogical approach. De-signs produced using designer-created patterns closely align with existing design theory and are clearly understood by students. The above results may indicate that the path to gaining wider acceptance of pattern theory as a design framework within game design is not to produce a universal pattern language but to facilitate the creation of case-specific languages, by students and professional designers, that use a shared ontology and thus can be combined easily to solve the diverse sets of problems faced by these groups.

This study investigates effective strategies for second language education in primary schools, analyzing the efficacy of immersive and interactive methods, digital literacy tools, and mixed-method approaches. The findings reveal significant improvements in language proficiency and student engagement through these methodologies, with immersive and interactive strategies showing substantial benefits in oral proficiency and engagement, digital tools enhancing accessibility and engagement, and mixed-method approaches yielding the highest overall effectiveness. The study underscores the importance of a balanced, flexible approach to language education, integrating traditional and modern methods to cater to diverse learner needs. These strategies not only advance linguistic skills but also contribute to the broader cognitive and emotional development of young learners, emphasizing the critical role of effective language education in preparing students for a globalized world.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

The aim of this study was to build a tool to analyze, using artificial intelligence, the sentiment perception of users who answered two questions from the CSQ – 8 questionnaires with raw Spanish free-text. Their responses are related to mindfulness, which is a novel technique used to control stress and anxiety caused by different factors in daily life. As such, we proposed an online course where this method was applied in order to improve the quality of life of health care professionals in COVID 19 pandemic times. We also carried out an evaluation of the satis-faction level of the participants involved, with a view to establishing strategies to improve fu-ture experiences. To automatically perform this task, we used Natural Language Processing (NLP) models such as swivel embedding, neural networks and transfer learning, so as to classify the inputs into the following 3 categories: negative, neutral and positive. Due to the lim-ited amount of data available - 86 registers for the first and 68 for the second - transfer learning techniques were required. The length of the text had no limit from the user’s standpoint, and our approach attained a maximum accuracy of 93.02 % and 90.53 % respectively based on ground truth labeled by 3 experts. Finally, we proposed a complementary analysis, using com-puter graphic text representation based on word frequency, to help researchers identify relevant information about the opinions with an objective approach to sentiment. The main conclusion drawn from this work is that the application of NLP techniques in small amounts of data using transfer learning is able to obtain enough accuracy in sentiment analysis and text classification stages

With the rapid growth of large language models (LLMs), there is increasing demand for memory and computation for LLMs. Recent efforts on post-training pruning of LLMs aim to reduce the model size and computation, yet the performance is still sub-optimal. In this paper, we present a plug-and-play solution for post-training pruning of LLMs. The proposed solution has two innovative components: 1) **Relative Importance and Activations** (RIA), a new pruning metric that jointly considers the weight and activations efficiently on LLMs; and 2) **Channel Permutation**, a new approach to maximally preserve important weights under N:M sparsity. The proposed two components can be readily combined to further enhance the N:M structuredly pruned LLMs. Our empirical experiments show that RIA alone can already surpass all existing post-training pruning methods on prevalent LLMs, e.g., LLaMA ranging from 7B to 65B. Furthermore, N:M structured pruning with channel permutation can even outperform the original LLaMA2 70B on zero-shot tasks, together with practical speed-up on specific hardware.

This study aims to put forth a new method to study the socio-spatial boundaries by using georeferenced community-authored reviews for restaurants. In this study, we show that food choice, drink choice, and restaurant ambience can be good indicators of socio-economic status of the ambient population in different neighborhoods. To this end, we use Yelp user reviews to distinguish different neighborhoods in terms of their food purchases and identify resultant boundaries in 10 North American metropolitan areas. This data-set includes restaurant reviews as well as a limited number of user check-ins and rating in those cities. We use Natural Language Processing (NLP) techniques to select a set of potential features pertaining to food, drink and ambience from Yelp user comments for each geolocated restaurant. We then select those features which determine one’s choice of restaurant and the rating that he/she provides for that restaurant. After identifying these features, we identify neighborhoods where similar taste is practiced. We show that neighborhoods identified through our method show statistically significant differences based on demographic factors such as income, racial composition, and education. We suggest that this method helps urban planners to understand the social dynamics of contemporary cities in absence of information on service-oriented cultural characteristics of urban communities.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

Recent research has suggested that working memory training interventions may benefit children with Developmental Language Disorder (DLD). The current study investigated a short and engaging adaptive working memory intervention that targeted executive skills and aimed to improve both language comprehension and working memory abilities in children with DLD. Forty-seven 6- to 10-year-old children with DLD were randomly allocated to an executive working memory training intervention (n=24) or an active control group (n=23). A pre-test/intervention/post-test/9-month-follow-up design was used. Outcome measures included assessments of language (to evaluate far transfer of the training) and working memory (to evaluate near transfer of the training). Hierarchical multiple regression analyses controlling for pre-intervention performance and age found group to be a significant predictor of sentence comprehension and of performance on six untrained working memory measures at post-intervention and 9-month follow-up. Children in the intervention group showed significantly higher language comprehension and working memory scores at both time points than children in the active control group. The intervention programme showed potential to improve working memory and language comprehension in children with DLD and demonstrated several advantages: it involved short sessions over a short period; caused little disruption in the school day; and was enjoyed by children.

The scope of a lucrative career promoted by Google through its video distribution platform YouTube 1 has attracted a large number of users to become content creators. An important aspect of this line of work is the feedback received in the form of comments which show how well the content is being received by the audience. However, volume of comments coupled with spam and limited tools for comment classification makes it virtually impossible for a creator to go through each and every comment and gather constructive feedback. Automatic classification of comments is a challenge even for established classification models, since comments are often of variable lengths riddled with slang, symbols and abbreviations. This is a greater challenge where comments are multilingual as the messages are often rife with the respective vernacular. In this work, we have evaluated top-performing classification models and four different vectorizers, for classifying comments which are a mix of different combinations of English and Malayalam (only English, only Malayalam and Mix of English and Malayalam). The statistical analysis of results indicates that Multinomial Naïve Bayes, K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Random Forest and Decision Trees offer similar level of accuracy in comment classification. Further, we have also evaluated 3 multilingual sub-types of the novel NLP language model, BERT and compared its’ performance to the conventional machine learning classification techniques. XLM was the top-performing BERT model with an accuracy of 67.31%. Random Forest with Term Frequency Vectorizer was the best the top-performing model out of all the traditional classification models with an accuracy of 63.59%.

A more sustainable society and economy also implies a more sustainable behavior in the consumption of financial products. A possible change in focus can come from the demand side, so that more sustainable consumption of financial products have to go hand to hand with financial literacy. However, financial literacy, potential favoring of this sustainable behavior, is far from reaching an international consensus about its definition, object and scope. Two objectives are analyzed; the different interpretations of financial literacy in the academic literature, as well as its evolution and how, in what context and with what other concepts the term is used in social networks. Scientometric techniques and content analysis have been used to carry out a systematic review of literature and also NLP to analyze the comments on Social Networks. Critical moments are identified in the definition of financial literacy. Also ten sentiments are analyzed in social networks in wich positivity, trust, and anticipation predominate. Greater attention to this issue is necessary both from the private initiative and from public policies, so that financial literacy is an effective tool for a more sustainable behavior by consumers. Finally, a new definition is proposed based on our findings.

This publication delves into the intricate world of human communication, extending beyond the realm of spoken and written language to explore the profound influence of non-verbal communication. Focusing on body language—comprising gestures, facial expressions, postures, and movements—it reveals the pivotal role it plays in conveying emotions, intentions, and psychological states. The rapidly evolving fields of neuroscience and cognitive science are investigating the neural mechanisms and cognitive processes that underpin the interpretation and utilization of these non-verbal cues. Notably, the amygdala's involvement in processing emotional facial expressions has provided a neurological foundation for our emotional understanding in non-verbal communication. Concurrently, cognitive psychology sheds light on how perception, attention, and memory influence our interpretation of non-verbal cues and communication strategies.In our modern, technologically advancing society characterized by global interconnectivity and cultural diversity, the significance of non-verbal communication, especially in digital and virtual contexts, is paramount. The transformation of non-verbal expression into digital symbols like emoticons and emojis raises questions regarding its ability to maintain authenticity and emotional understanding. This publication endeavors to comprehensively explore the fundamental role of body language and non-verbal communication in contemporary society. By integrating insights from psychology, neuroscience, social sciences, and digital technologies, it aims to elucidate the underlying mechanisms guiding non-verbal communication. Additionally, it delves into the implications of non-verbal communication across diverse domains, including interpersonal communication, the workplace, politics, advertising, and the virtual world.The research presented herein strives to offer a thorough understanding of interpersonal dynamics, relationships, and social behavior, with the goal of promoting the development of more effective, conscious, and ethically guided communication strategies. Ultimately, this analysis aspires to inspire further interdisciplinary research and reflection, addressing emerging challenges and fully leveraging the potential of non-verbal communication in modern society. This, in turn, guides our path towards a communication landscape that is more inclusive, authentic, and empathetic.

The language we use to describe the past can have a strong influence on the audience’s interpretation of our story. In our experiment, we explore, using 3 different conditions, how the framing and language of an accident report can affect the audience’s proposed solutions to manage the problems found. We find that the approach used to create an accident report can have a powerful influence on the audience’s decision making. Whether we are describing an accident in a similar manner to a crime, using a systems approach or we are accepting of multiple stories which are not linear or coherent, the methods we use to capture and communicate the story have a profound impact on the actions decided upon by the reader.

This article presents a state-of-the-art system to extract and synthesize causal statements from company reports into a directed causal graph. The extracted information is organized by the relevance to different stakeholder groups’ benefits (customers, employees, investors, and the community/environment). The presented method of synthesizing extracted data into a knowledge graph comprises a framework that can be used for similar tasks in other domains, e.g. medical information. The current work addresses the problem of finding, organizing, and synthesizing a view of the cause-and-effect relationships based textual data, in order to inform and even prescribe the best actions that may affect target business outcomes related to different stakeholders’ benefits (customers, employees, investors, and the community/environment).

We live in the information age and, ironically, meeting the core function of journalism – i.e., to provide people access to unbiased information – has never been more difficult. This paper explores deep journalism, our data-driven Artificial Intelligence (AI) based journalism approach to study how the LinkedIn media could be useful for journalism. Specifically, we apply our deep journalism approach to LinkedIn to automatically extract and analyse big data to provide the public with information about labour markets, people’s skills and education, and businesses and industries from multi-generational perspectives. The Great Resignation and Quiet Quitting phenomena coupled with rapidly changing generational attitudes are bringing unprecedented and uncertain changes to labour markets and our economies and societies, and hence the need for journalistic investigations into these topics is highly significant. We combine big data and machine learning to create a whole machine learning pipeline and a software tool for journalism that allows discovering parameters for age dynamics in labour markets using LinkedIn data. We collect a total of 57,000 posts from LinkedIn and use it to discover 15 parameters by Latent Dirichlet Allocation algorithm (LDA) and group them into five macro-parameters, namely Generations-Specific Issues, Skills & Qualifications, Employment Sectors, Consumer Industries, and Employment Issues. The journalism approach used in this paper can automatically discover and make objective, cross-sectional, and multi-perspective information available to all. It can bring rigour to journalism by making it easy to generate information using machine learning and can make tools and information available so that anyone can uncover information about matters of public importance. This work is novel since none of the earlier works have reported such an approach and tool and leveraged it to use LinkedIn media for journalism and to discover multigenerational perspectives (parameters) for age dynamics in labour markets. The approach could be extended with additional AI tools and other media.

This paper presents the current lexical, morphological, syntactic and rule-based machine translation work for Erzya and Moksha that can and should be used in the development of a roadmap for Mordvin linguistic research. We seek to illustrate and outline initial problem types to be encountered in the construction of an Apertium-based shallow-transfer machine translation system for the Mordvin language forms. We indicate reference points within Mordvin Studies and other parts of Uralic studies, as a point of departure for outlining a linguistic studies with a means for measuring its own progress and developing a roadmap for further studies.

Language is an essential aspect of teaching and learning mathematics. It is necessary for communicating, transmission of concepts and ideas, and formation of meaning of mathematical concepts. In mathematics, besides symbols, which are usually common in different languages, words and expressions are used, which may invoke different concept images to students in various languages. Some words are used in mathematics and in everyday language with different meanings, while others are used only in mathematics or in mathematics and other disciplines in similar but non-identical ways. In Mathematical Analysis, the used vocabulary is gradually enhanced, and the concepts are defined in a more formal way. In the current study, the language used regarding mathematics of change is examined, focusing on rate of change and in relation to misconceptions of students.

We transformed the existing learning program Language Shower, which is used in some Norwegian day-care centers in the Grorud district of Oslo municipality, into a digital solution using an app for smartphone or tablet with the option for further enhancement of presentation by a NAO robot. The solution was tested in several iterations and multiple day-care centers over several weeks. Measurements of the children’s progress across learning sessions indicate a positive impact of the program using a robot as compared to the program without robot. In-situ observations and interviews with day care center staff confirmed the solution’s many advantages, but also revealed some important areas for improvement. In particular, the speech recognition needs to be more flexible and robust, and special measures have to be in place to handle children speaking simultaneously.

This review and meta-analysis (PROSPERO registration number: CRD42020138845) critically evaluates test-retest reliability, concurrent validity and criterion validity of different physical activity (PA) levels of three most-common used international PA questionnaires (PAQs) in national language versions of EU-28: IPAQ-SF, GPAQ, and EHIS-PAQ. In total, 4969 abstracts were read, 287 full-text articles were identified as relvant to the study objectives, and 19 studies were included in the final meta-analysis. The studies’ results and quality were evaluated using the Quality Assessment of Physical Activity Questionnaires (QAPAQ) checklist. Results indicate that only five EU-28 countries validated national language versions of selected PAQs. Meta analysis revealed that assessment of moderate-to-vigourus PA (MVPA) is the most relevant PA level outcome, since no publication bias in any of measurement properties was detected while test-retest reliability was the moderately-high (rw=0.74), and moderate for both criterion (rw=0.41) and concurrent validity (rw=0.72). Reporting of methods and results of the studies was poor with overall moderate risk of bias with total score of 0.43. In conclusion, where only self-reporting is feasible, assessment of MVPA with selected PAQs in EU-28 adult population is recommended for policymaking.

Background: Over the past decade, the use of digital tools has grown and research evidence suggests that traditional media and new media offer both benefits and health risks for young children. The abilities to understand and use language represent two of the most important competencies developed during the first 3 years of life through the interaction of the child with people, objects, events, and other environmental factors. The main goal of our study is to evaluate the relationship between digital devices use and language abilities in children between 8-36 month, considering also the influence of several variables. Materials and Methods: We conducted a cross-sectional observational study on 260 healthy children (140 males = 54%) aged between 8-36 months (mean=23.5±7.18 months). All the parents completed a self-report questionnaire investigating the use of digital devices by their children, and a standardized questionnaire for the assessment of language skills (MacArthur). Multiple linear regression was used to evaluate the relationship between different variables. Subsequent moderation analysis were performed to verify the influence of other factors. Results: W found a statistically significant negative correlation between the total daily time of exposure to digital devices and the Actions and Gestures Quotient (ß=-0.397) in children between 8-17 months, and between the total daily time of exposure to digital devices and Language Quotient (ß=-0.224) in children between 18-36 months. Sex, level of education/job of parents, modality of use/content of digital device do not significantly affect these relationships. Conclusion: In our study we found that a longer time of exposure to digital devices was related to lower mimic-gestural skills in children from 8-17 months and to lower language skills in children between 18-36 months, regardless of age, sex, socio-economic status, content and modality of use. Further studies are needed to confirm and better understand this relationship, but parents and pediatricians are advised to limit the use of digital devices by children and encourage the social interaction to support the learning of language and communication skills in this age group.

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7%, 42.0%, and 70.1% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future.

Due to the substantial growth of internet users and its spontaneous access via electronic devices, the amount of electronic contents is growing enormously in recent years through instant messaging, social networking posts, blogs, online portals, and other digital platforms. Unfortunately, the misapplication of technologies has boosted with this rapid growth of online content which leads to the rise in suspicious activities. People misuse the web media to disseminate malicious activity, perform the illegal movement, abuse other people, and publicize suspicious contents on the web. The suspicious contents usually available in the form of text, audio or video, whereas text contents have been used in most of the cases to perform suspicious activities. Thus, one of the most challenging issues for NLP researchers is to develop a system that can identify suspicious text efficiently from the specific contents. In this paper, a Machine Learning (ML)-based classification model is proposed (hereafter called STD) to classify Bengali text into non-suspicious and suspicious categories based on its original contents. A set of ML classifiers with various features has been used on our developed corpus, consisting of 7000 Bengali text documents where 5600 documents used for training and 1400 documents used for testing. The performance of the proposed system is compared with the human baseline and existing ML techniques. The SGD classifier `tf-idf’ with the combination of unigram and bigram features are used to achieve the highest accuracy of 84.57%.

The aim of the existing study is to investigate the influence of teacher expectation on students’ achievement and their attitudes towards English lesson and to increase the students’ academic success and positive attitudes towards this issue. In the study, a process which defined the existing situtation and which provided the educational processes to improve by changing the existing situation could be seen. For this reason, emancipatory/improving/critical action research model was used. The study was carried out on a sample group consisting of 87 students; 43 6th graders and 44 8th graders attending a school located in the city center of Düzce during the 2015-2016 academic year. In order to collect the data, “Teacher Expectancy Scale” developed by the researchers, “Attitude Scale towards English Course” and 7 test exams prepared by Turkish Ministry of National Education (MoNE) were used. The study was conducted for a total 48 hours in 12 weeks, 4 hours a week. As the result of the study, it was revealed that teacher expectation influenced the attitudes of the students towards the English lesson in a positive way and increased their academic achievements.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

When participants in a statistical learning paradigm are asked to learn from two incompatible or competing inputs, they often fail to learn from one or both inputs. This study presents the results of two experiments that were both completed by one group of typically developing four-year-old children. One experiment targeted word-medial consonant patterns (phonotactics), whereas the other targeted strong-weak and weak-strong stress patterns (prosody). The order of the experiments was critical for learning outcomes in the phonotactics experiment: When children learned phonotactics first, their production accuracy increased following exposure to a high frequency input. When children learned phonotactics second, however, their production accuracy dropped when they were exposed to the high frequency input. Results from the prosody experiment were inconclusive, with limited evidence of any learning effect. Overall, the results suggest that children may conflate learning experiences, and patterns learned from an initial experimental input compete with patterns in a subsequent experiment. When considering natural language acquisition, the results suggest that an isolated episode of learning may lead to generalizations that are incompatible with later input, and possibly, with larger patterns in the language.

This paper aims to provide an overview of the complete process in the development of a Domain-Specific Language (DSL). It explains the construction steps such as preliminary research, language implementation, and evaluation. Moreover, it provides details for different key components which are commonly found in the DSLs such as the abstraction layer, DSL metamodel, and the applications. It also explains the general limitations related to the Domain-Specific Languages for Workflows.

Technological advancements and innovations have profoundly changed the lives of people giving rise to smart environments, cities, and societies. As homes are the building block of cities and societies, smart homes are critical to establishing smart living and are expected to play a key role in enabling smart cities and societies. The current academic literature and commercial advancements on smart homes have mainly focused on developing and providing smart functions for homes to provide security management and facilitate the residents in their various activities such as ambiance management. Homes are much more than physical structures, buildings, appliances, operational machines, and systems. Homes are composed of families and are inherently complex phenomena underlined by humans and their relationships with each other, subject to individual, intragroup, intergroup, and intercommunity goals. There is a clear need to understand, define, consolidate existing research, and actualize the overarching roles of smart homes, the roles of smart homes that would serve the needs of future smart cities and societies. This paper introduces our data-driven parameter discovery methodology and uses it to provide, for the first time, an extensive, rather fairly comprehensive, analysis of the families and homes landscape seen through the eyes of academics and the public using over a hundred thousand research papers and nearly a million tweets. We develop a methodology using deep learning, natural language processing (NLP), and big data analytics methods and apply it to automatically discover parameters that capture a comprehensive knowledge and design space of smart families and homes comprising social, political, economic, environmental, and other dimensions. The 66 discovered parameters and the knowledge space comprising 100s of dimensions are explained by reviewing and referencing over 300 articles from the academic literature and tweets. The knowledge and parameters discovered in this paper can be used to develop a holistic understanding of matters related to families and homes facilitating the development of better, community-specific, policies, technologies, solutions, and industries for families and homes, leading to strengthening families and homes, and in turn, empowering sustainable societies across the globe.

In an ever-evolving landscape of higher education, this study delves into the transformative potential of merging deep learning principles and meaningful pedagogy in language acquisition, aided by artificial intelligence (AI) technologies. Drawing from a qualitative research design, it navigates the post-pandemic educational landscape, examining shifts in language education, student perspectives, and adaptations. Through comprehensive data collection methods, including literature review, interviews, and classroom observations, the study presents insights from 30 participants from SMC. The qualitative findings reveal emerging themes related to deep learning, meaningful learning, AI integration, and language acquisition, underscoring their profound impact on teaching methods and student engagement. This research contributes to the field by shedding light on innovative approaches that elevate language acquisition in an AI-evolving educational environment. The study concludes with implications for school administrators, teachers, and students, offering recommendations for future research directions, ultimately striving to enhance language education in the modern era.

This article propose a didactic, through games, tool based on information and communication technologies, in order to eliminate possible communication barriers and to promote the inclusion of students with hearing impairment in Physical Education classes. To this end, a dossier of traditional games has been developed. These are structured in turn into objectives, materials, organisation, graphic description and a QR code for each game. These codes are linked to different videos hosted on the YouTube platform, in which the explanation of the games, mentioned above, can be visualised graphically using sign language. The whole creative process is described in the article, as well as possible pedagogical applications of the use of the tools created for this purpose in other educational contexts.

Today, LLMs are not good at personalization providing recommendation. They advise physicians and financial advisors to ask professionals in respective fields for help, even having user information available. Answering questions of software professionals, LLM needs to deliver in-depth answers with codes or algorithms, whereas for professionals in other fields would need definitions and main concepts. The intent of this chapter is to make LLM answer tailored to the needs of users, taking into account available information about them. To do that, we need to generalize available information about a person like her health record, maintaining the privacy of this person. We rely on meta-learning techniques to design a LLM prompt to produce a personalization prompt to obtain a suitable relevant information. Such “meta-prompt” is produced by generalization operation applied to available documents for the user. These documents need to be de-identified so that they are sufficient for personalization on one hand and will maintain user privacy on the other hand. The second neuro-symbolic technique to support personalization is abductive reasoning, acting in parallel to LLM fine-tuning. Traditional recommendation and personalization techniques as well as modern, deep learning – based are presented, and the comparison is drawn to the proposed approach. We also share the evaluation and comparative analyses of these approaches. We consider an example for how to build personalization LLM systems coming from Langchain platform. We will explore how to construct chains to form a personalization profile for a user and apply it to user search and recommendation requests.

We present improvements in n-best rescoring of code-switched speech achieved by n-gram augmentation as well as optimised pretraining of long short-term memory (LSTM) language models with larger corpora of out-of-domain monolingual text. In addition, we consider the application of large pretrained transformer-based architectures. Our experimental evaluation is performed on an under-resourced corpus of code-switched speech comprising four bilingual code-switched sub-corpora, each containing a Bantu language (isiZulu, isiXhosa, Sesotho, or Setswana) and English. We find in our experiments that, by combining n-gram augmentation with the optimised pretraining strategy, speech recognition errors are reduced for each individual bilingual pair by 3.51% absolute on average over the four corpora. Importantly, we find that even speech recognition at language boundaries improves by 1.14% even though the additional data is monolingual. Utilising the augmented n-grams for lattice generation, we then contrast these improvements with those achieved after fine-tuning pretrained transformer-based models such as distilled GPT-2 and M-BERT. We find that, even though these language models have not been trained on any of our target languages, they can improve speech recognition performance even in zero-shot settings. After fine-tuning on in-domain data, these large architectures offer further improvements, achieving a 4.45% absolute decrease in overall speech recognition errors and a 3.52% improvement over language boundaries. Finally, a combination of the optimised LSTM and fine-tuned BERT models achieves a further gain of 0.47% absolute on average for three of the four language pairs compared to M-BERT. We conclude that the careful optimisation of the pretraining strategy used for neural network language models can offer worthwhile improvements in speech recognition accuracy even at language switches, and that much larger state-of-the-art architectures such as GPT-2 and M-BERT promise even further gains.

This paper presents the findings of an exploratory study on the continuously generating Big Data on Twitter related to the sharing of information, news, views, opinions, ideas, knowledge, feedback, and experiences about the COVID-19 pandemic, with a specific focus on the Omicron variant, which is the globally dominant variant of SARS-CoV-2 at this time. A total of 12028 tweets about the Omicron variant were studied, and the specific characteristics of tweets that were analyzed include - sentiment, language, source, type, and embedded URLs. The findings of this study are manifold. First, from sentiment analysis, it was observed that 50.5% of tweets had the ‘neutral’ emotion. The other emotions - ‘bad’, ‘good’, ‘terrible’, and ‘great’ were found in 15.6%, 14.0%, 12.5%, and 7.5% of the tweets, respectively. Second, the findings of language interpretation showed that 65.9% of the tweets were posted in English. It was followed by Spanish or Castillian, French, Italian, Japanese, and other languages, which were found in 10.5%, 5.1%, 3.3%, 2.5%, and <2% of the tweets, respectively. Third, the findings from source tracking showed that “Twitter for Android” was associated with 35.2% of tweets. It was followed by “Twitter Web App”, “Twitter for iPhone”, “Twitter for iPad”, “TweetDeck”, and all other sources that accounted for 29.2%, 25.8%, 3.8%, 1.6%, and <1% of the tweets, respectively. Fourth, studying the type of tweets revealed that retweets accounted for 60.8% of the tweets, it was followed by original tweets and replies that accounted for 19.8% and 19.4% of the tweets, respectively. Fifth, in terms of embedded URL analysis, the most common domains embedded in the tweets were found to be twitter.com, which was followed by biorxiv.org, nature.com, wapo.st, nzherald.co.nz, recvprofits.com, science.org, and other URLs. Finally, to support similar research and development in this field centered around the analysis of tweets, we have developed an open-access Twitter dataset that comprises tweets about the SARS-CoV-2 omicron variant since the first detected case of this variant on November 24, 2021.

The review of previous works shows this study is the first attempt to analyse the lockdown effect using Natural Language Processing Techniques, particularly sentiment analysis methods applied at large scale. On the other hand, it is also the first of its kind to analyse the impact of COVID 19 on the university community jointly on staff and students and with a multi-country perspective. The main overall findings of this work show that the most often related words were family, anxiety, house and life. On another front, it has also been shown that staff have a slightly less negative perception of the consequences of COVID in their daily life. We have used artificial intelligence models like swivel embedding and the Multilayer Perceptron, as classification algorithms. The performance reached in terms of accuracy metric are 88.8% and 88.5%, for student and staff respectively. The main conclusion of our study is that higher education institutions and policymakers around the world may benefit from these findings while formulating policy recommendations and strategies to support students during this and any future pandemics.

Social media, traditionally reserved for social exchanges on the net, has been increasingly used by researchers to gain insight into different facets of human life. Unemployment is an area that has gained attention by researchers in various fields. Medical practitioners especially in the area of mental health have traditionally monitored the effects of involuntary unemployment with great interest. In this work, we compare the feedback gathered from social media using crowdsourcing techniques to results obtained prior to the advent of Big Data. We find that the results are consistent in terms of 1) financial strain is the biggest stressor and concern, 2) onslaught of depression is typical and 3) possible interventions including reemployment and support from friends and family is crucial in minimizing the effects of involuntary unemployment. Lastly, we could not find enough evidence to study effects on physical health and somatization in this work.

Objective: The Acute Cystitis Symptom Score (ACSS) was developed and validated as a self-reporting questionnaire for diagnosing and monitoring acute, uncomplicated cystitis (AC) in female patients. The study aims at the translation of the ACSS into Greek from original Russian as a source and American English as a new master version and at its linguistic validation. Material and Methods: Three independent professional native Greek translators, two of them experts in Russian and one in English, translated the ACSS from Russian and American English into Greek. The second group of three translators translated each of the three versions back into the original language to detect or correct any important discrepancies. These three Greek versions were then used for linguistic validation. Results: The English to Greek translation reflected more the spoken language, the two Russian to Greek translations more the written, formal language. A total of 60 randomly selected females and 30 healthcare professionals was asked about their preferences and to comment on each of the three translations. Considering all comments the scientific committee (SC) developed the Greek consensus version. For cognitive assessment additional 30 healthcare professionals and 30 females were asked to comment on the intelligibility of all items. Considering their comments the linguistically validated Greek study version was established by the SC. Conclusion: The linguistically validated Greek version of the ACSS can now be used for the clinical validation study.

In bilingual communities, social interactions take place in both single- and mixed-language con-texts. Some of the information shared in multilingual conversations is often required in conse-quent social encounters, like interlocutors’ personal information. In this study we explored whether the autobiographical information provided in a single-language context is better re-membered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilin-gual (pre-)teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across partici-pants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

(1) Background: Children with autism spectrum disorder (ASD) show certain characteristics in visual attention which generate difficulties in the integration of relevant social information to set the basis of communication. Gaze following and pupil dilation could be used to identify signs for the early detection of ASD. Eye-tracking methodology allows objective measurement of these anomalies in visual attention. The aim is to determine whether measurements of gaze following and pupillary dilation in a linguistic interaction task, captured using eye-tracking methodology, are objective for early diagnosis of ASD. (2) Methods: 20 children between 17 and 24 months of age, made up of 10 neurotypical children and 10 children with ASD were paired together according to chronological age. A human face on a monitor pronounced pseudowords associated with pseudo-objects. Gaze following and pupil dilation was registered during the task. (3) Results: Significant statistical differences were found in the time of gaze fixation on the human face and on the object, as well as in the number of gazes. Also, there were significant differences in the maximum peak of pupil dilation, this being found in the neurotypical group at the moment of processing of the pseudoword, and in the ASD group in the baseline prior to the task (4) Conclusions: The registration and the duration of gaze, and the measurement of pupil dilation with ‘eye-tracker’ are objective measures for early detection of ASD.

Bayesian formulations of learning imply that whenever the evidence for a correlation between events in an animal’s habitat is sufficient, the correlation is learned. This implies that regularities can be learnt rapidly, from small numbers of learning examples. This speed of learning gives maximum possible fitness, and no faster learning is possible. There is evidence in many domains that animals and people can learn at nearly Bayesian optimal speeds. These domains include associative conditioning, and the more complex domains of navigation and language. There are computational models of learning which learn at near-Bayesian speeds in complex domains, and which can scale well – to learn thousands of pieces of knowledge (i.e., relations and associations). These are not neural net models. They can be defined in computational terms, as algorithms and data structures at David Marr’s [1] Level Two. Their key data structures are composite feature structures, which are graphs of multiple linked nodes. This leads to the hypothesis that animal learning results not from deep neural nets (which typically require thousands of training exam-ples), but from neural implementations of the Level Two models of fast learning; and that neu-rons provide the facilities needed to implement those models at Marr’s Level Three. The required facilities include feature structures, dynamic binding, one-shot memory for many feature struc-tures, pattern-based associative retrieval, unification and generalization of feature structures. These may be supported by multiplexing of data and metadata in the same neural fibres.

Hate Speech Detection in Arabic presents a multifaceted challenge due to the broad and diverse linguistic terrain. With its multiple dialects and rich cultural subtleties, Arabic requires particular measures to address hate speech online successfully. To address this issue, academics and developers have used natural language processing (NLP) methods and machine learning algorithms adapted to the complexities of Arabic text. However, many proposed methods were hampered by a lack of a comprehensive dataset/corpus of Arabic hate speech. In this research, we propose a novel multi-class public Arabic dataset comprised of 403,688 annotated tweets categorized as extremely positive, positive, neutral, or negative based on the presence of hate speech. Using our developed dataset, we additionally characterize the performance of multiple machine learning models for Hate speech identification in Arabic Jordanian dialect tweets. Specifically, the Word2Vec, TF-IDF, and AraBert text representation models have been applied to produce word vectors. With the help of these models, we can provide classification models with vectors representing text. After that, seven Machine learning classifiers have been evaluated: Support Vector Machine (SVM), Logistic Regression (LR), Naive Bays (NB), Random Forest (RF), AdaBoost (Ada), XGBoost (XGB), and CatBoost (CatB). In light of this, the experimental evaluation revealed that, in this challenging and unstructured setting, our gathered and annotated datasets were rather efficient and generated encouraging assessment outcomes. This will enable academics to delve further into this crucial field of study.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

With the rapid development of science and technology, many new concepts and terms appear, especially in English. Other languages try to express these concepts with words from their own vocabulary. In the specific case of Arabic, there are many ways to find a counterpart for a particular new concept, such as using an existing word to denote the new concept, derivation, and blending. When these methods fail, the new concepts are simply phonetically transliterated. This has the disadvantage that most of the transliterated terms do not conform to the rules of the Arabic language and lead to a distortion of the language. Some modern linguists call for using the generation strategy to translate the new terms into Arabic by using the unused Arabic roots. Therefore, it is necessary to provide a resource that contains all Arabic roots with a categorization of what is used, what is available for use, and what is rejected according to the phonetic system. This work provides a comprehensive lexicon that contains all possible Arabic triliteral roots, determines the status of each root in terms of usage and acceptability, and provides a mechanism for giving preference to roots when there is more than one root that indicates the desired meaning.

This study delves into the dynamic intersection of artificial intelligence (AI) and English Language Teaching (ELT) within the post-pandemic educational landscape. Grounded in Constructivism, Connectivism, and Technological Pedagogical Content Knowledge (TPACK), this research explores how AI integration impacts language instruction efficiency, benefits and challenges perceived by St. Michael's College students, differences in learning outcomes, and its potential to address the digital divide. Employing a qualitative approach, the study employs a rigorous method that includes intensive in-depth reviews of literature, maximum purposeful sampling, informal interviews, observation, and thematic analysis. Through these methods, data was collected from 30 participants, leading to the identification of five key themes. Findings suggest that AI enhances instructional efficiency, offers personalized learning experiences, and bridges gaps in remote settings. However, challenges and the importance of pedagogical balance emerged. The study underscores the need for adaptive pedagogical strategies to fully harness AI's potential. Future directions and limitations are discussed, emphasizing the study's implications for shaping the future of ELT.

At the end of 2018, a high school student asked a question in Zhihu community, claiming that he had proved Goldbach's conjecture. The problem caused an explosive reaction and a large number of users participated in the discussion. And has caused the widespread influence. On January 1, 2019, the questioner issued his "proof". His proof was soon proved wrong. The heated discussion caused by the incident contains a lot of information of social science analysis value. Therefore, we follow up the event in the first time and build a time series dataset for the event. Taking the questioner's "proof" as the dividing line, all the answers, comments, sub comments and user information of writing these texts before and after two days were recorded. This series of temporal information can reflect the dynamic features of the interaction between user opinions, and the impact of exogenous shocks (proof release) on community opinions. The dataset can be used not only for the demonstration of various social network analysis algorithms, but also for a series of natural language processing tasks such as fine-grained sentiment analysis for long texts, as well as multimodal tasks combining natural language processing and social network analysis. This paper introduces the characteristics and structure of the dataset, shows the visualization effect of social network, and uses the dataset train the benchmark model of emotion analysis.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

A sparse language is a formal language such that the number of strings of length $n$ is bounded by a polynomial function of $n$. We create a class with the opposite definition, that is a class of languages that are dense instead of sparse. We define a dense language on $m$ as a formal language (a set of binary strings) where there exists a positive integer $n_{0}$ such that the counting of the number of strings of length $n \geq n_{0}$ in the language is greater than or equal to $2^{n - m}$ where $m$ is a real number and $0 < m \leq 1$. We call the complexity class of all dense languages on $m$ as $DENSE(m)$. We prove that there exists an $\textit{NP--complete}$ problem that belongs to $DENSE(m)$ for every possible value of $0 < m \leq 1$.

With the rapid development of science and technology, many new concepts and terms appear, especially in English. Other languages try to express these concepts with words from their own vocabulary. In the specific case of Arabic, there are many ways to find a counterpart for a particular new concept, such as using an existing word to denote the new concept, derivation, and blending. When these methods fail, the new concepts are simply phonetically transliterated. This has the disadvantage that most of the transliterated terms do not conform to the rules of the Arabic language and lead to a distortion of the language. Some modern linguists call for using the generation strategy to translate the new terms into Arabic by using the unused Arabic roots. Therefore, it is necessary to provide a resource that contains all Arabic roots with a categorization of what is used, what is available for use, and what is rejected according to the phonetic system. This work provides a comprehensive lexicon that contains all possible Arabic triliteral roots, determines the status of each root in terms of usage and acceptability, and provides a mechanism for giving preference to roots when there is more than one root that indicates the desired meaning.

Nowadays, an analysis of virtual media to predict society’s reaction to any events or processes is a task of great relevance. Especially it concerns meaningful information on healthcare problems. Internet sources contain a large amount of pharmacologically meaningful information useful for pharmacovigilance purposes and repurposing drug use. An analysis of such a scale of information demands developing the methods that require the creation of a corpus with labeled relations among entities. Before, there have been no such Russian language datasets. This paper considers the first Russian language dataset where labeled entity pairs are divided into multiple contexts within a single text (by used drugs, by different users, by the cases of use, etc.), and a method based on the XLM-RoBERTa language model, previously trained on medical texts to evaluate the state-of-the-art accuracy for the task of indication of the four types of relationships among entities: ADR–Drugname, Drugname–Diseasename, Drugname–SourceInfoDrug, Diseasename–Indication. As shown based on the presented dataset from the Russian Drug Review Corpus, the developed method achieves the F1-score of 81.2% (obtained using cross-validation and averaged for the four types of relationships), which is 7.8% higher than the basic classifiers.

Risk management of electric power transmission lines requires knowledge from different areas such as environment, land, investors, regulations, and engineering. Despite the widespread availability of databases for most of those areas, integrating them into a single database or model is a challenging problem. Instead, in this paper, we use a single source, the Brazilian National Electric Energy Agency’s (ANEEL) weekly reports, which contains decisions about the electrical grid, comprising most of the areas. Since the data is unstructured (text), we employed NLP techniques such as stemming and tokenization to identify keywords related to common causes of risks provided by an expert group on energy transmission. Then, we used models to estimate the probability of each risk. Our results show that we were able to estimate the probability of 97 risks out of 233.

The purpose of this paper is to explore the implementation of Retrieval-Augmented Gen- 14 eration (RAG) technology with open-source Large Language Models (LLMs). For this purpose, a 15 web-based application named PaSSER that integrates RAG with three models - Mistral:7b, 16 Llama2:7b: Orca2:7b, is developed. In its development various technologies are used, including 17 Blockchain for managing and storing assessment results of built-in testing modules. PaSSER em- 18 ploys a set of evaluation metrics for LLMs’ performance - METEOR, ROUGE, BLEU, Perplexity, 19 Cosine similarity, Pearson correlation, and F1 score. The specialized knowledge base is in the smart 20 agriculture domain. As an illustration, the paper presents results and analysis of two tests. First one 21 is assessing the performance of LLMs across different hardware configurations, the other is deter- 22 mining the model that delivers most accurate and contextually relevant responses within the RAG. 23 The paper also discusses the integration of blockchain technology with LLMs to manage and store 24 assessment results within a blockchain environment. The tests revealed that Mistral:7b demon- 25 strates the best results across most of the evaluated metrics. The discussion section comments on 26 technical and hardware considerations that affect the performance of LLMs. Future development 27 will focus in leveraging new larger pre-trained open-source LLMs, exploring different finetuning 28 approaches, and further integration with Blockchain and IPFS.

The effects of cognate synonymy in L2 word learning are explored. Participants learned the names of well-known concrete concepts in a new fictional language following a picture-word association paradigm. Half of the concepts (set A) had two possible translations in the new language (i.e., both words were synonyms): one was a cognate in participants’ L1 and the other one was not. The other half of the concepts (set B) had only one possible translation in the new language, a non-cognate word. After learning the new words, participants’ memory was tested in a picture-word matching task and a translation recognition task. In line with previous findings, our results clearly indicate that cognates are much easier to learn, as we found that the cognate translation was remembered much better than both its non-cognate synonym and the non-cognate from set B. Our results also seem to suggest that non-cognates without cognate synonyms (set B) are better learned than non-cognates with cognate synonyms (set A). This suggests that, at early stages of L2 acquisition, learning a cognate would produce a poorer acquisition of its non-cognate synonym, as compared to a solely learned non-cognate. These results are discussed under the light of different theories and models of bilingual mental lexicon.

(1) Background: Artificial intelligence (AI) has existed in some form for decades, but recent rapid advances in a subset called machine learning (ML) — and more specifically deep learning (DL), a neural network-based approach — have made headlines for the potential to revolutionize and automate multiple large sectors of society, including scientific research and the healthcare field. Furthermore, large language models (LLMs) — which are built on DL — could lead to a more seamless, natural interaction between humans and computers. (2) Methods: We reviewed numerous publications on this subject from recent years. (3) Results: We found these studies collectively show that AI is positively disrupting both biomedical research and medical practice, such as optical imaging in surgery guidance. (4) Conclusions: However, we recommend caution in over-reliance on AI in the laboratory or the clinic due to anticipated risks and current limitations.

Artificial intelligence (AI) tools, such as OpenAI's Chat Generative Pre-trained Transformer (ChatGPT), have great potential in various fields, such as healthcare, education, and industry. This review highlights the applications and challenges of the ChatGPT versions 3.5 and 4.0 in radiology. ChatGPT can process medical texts, analyze medical images, and generate reports and summaries for different audiences. ChatGPT can also answer patients' questions and translate complex medical information into a plain language. ChatGPT has shown impressive results in medical tests and quizzes, indicating its potential to enhance diagnostic accuracy and medical education. These models show promise for reducing diagnosis times and healthcare costs. However, ChatGPT also faces challenges and limitations, such as a lack of visual content, ethical and legal issues, data quality, and error detection. This review highlights the benefits and future directions of ChatGPT and artificial intelligence (AI) in radiology.

In the field of industrial process monitoring, more and more interest is being shown in specific process categories. These include time-varying processes, that is, those processes whereby the response one receives as output from the system depends on when the input signal is sent into it. There are many reasons for this process variability and such contexts are not always analyzed with this operational characteristic at their core. At the same time, interest in certain categories of techniques is also becoming more prominent, to meet certain application needs. Among these, clustering and unsupervised techniques in general are gaining ground. This is largely due to the difficulty of finding fault data with which to train, for example, supervised models. On the other hand, the clustering technique, on which this contribution focuses, also makes it possible to compensate for the lack of complete knowledge of the structure of the process itself. With these two considerations in mind, this contribution proposes a literature review on the topic of clustering applied in time-varying contexts, in the maintenance field. The aim is to present an overview of the main fields of study, the role of clustering in this context and the main clustering techniques used.

This paper presents an approach to the application of the Model-Based Systems Engineering (MBSE) and Model-Based Systems Architecting (MBSA) principles to develop a Model-Based Pattern Language (MBPL). It takes too long for systems engineers and architects to develop a new system from scratch, particularly new space-based systems derived from the existing space systems architectures. A pattern language is a holistic view of reusable logical model artifacts; many are interdisciplinary and introductory, if at all. The results are mostly a combination of the application-specific logical solution, which further results in the best possible overall solution. The main benefit of the pattern language is reducing the time and validation required to generate a new space-based system architecture; this approach will develop top-level requirements in the initial phase of the system development. The rationale of the methodology proposed by the paper is as follows, collect, and decompose published literature and other open-source information available on space system architectures and system models; develop SysML models for systems, subsystems, products, assembly, subassembly level, and mission-specific requirements using CAMEO SysML software. Arrange these patterns to develop a functional ontology and construct a logical architecture pattern library. This approach created, updated, and managed SysML pattern language, which evaluated the expedited new model construction. Again, our objective is to develop a logical pattern language using public domain information and evaluate patterns by constructing a new space mission concept—for example, planetary surface habitat.

Maintaining a healthy cyber society is a big challenge due to the users’ freedom of expression and behaving. It can be solved by monitoring and analyzing the users’ behavior and taking proper actions towards them. This research aims to present a platform that monitors the public content on Twitter by extracting tweet data. After maintaining the data, the users’ interactions are analyzed using Graph Analysis methods. Then the users’ behavioral patterns are analyzed by applying Metadata Analysis, in which the timeline of each profile is obtained; also, the time-series behavioral features of users are investigated. Then in the Abnormal Behavior Detection Filtering component, the interesting profiles are selected for further examinations. Finally, in the Contextual Analysis component, the contents will be analyzed using natural language processing techniques; A binary text classification model (SVM + TF-IDF with 88.89% accuracy) for detecting if the tweet is related to crime or not. Then, a sentiment analysis method is applied to the crime-related tweets to perform aspect-based sentiment analysis (DistilBERT + FFNN with 80% accuracy); because sharing positive opinions about a crime-related topic can threaten society. This platform aims to provide the end-user (Police) suggestions to control hate speech or terrorist propaganda.

Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Suicide may be prevented if prompt intervention is taken to mitigate risk. Machine learning and artificial intelligence-based modelling, such as natural language processing (NLP) and other text analytics approaches, has the potential to become a major technique for the detection, diagnosis, and treatment of people who are suffering from mental health issues. The primary aims of this research are to determine whether NLP techniques have been utilised in the field of suicide prevention, and if so, were they effective? What were their limitations? Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. Thematic analysis was used to synthesise and analyse the included studies. Findings were reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement, and the Mixed Methods Appraisal Tool (MMAT) was used in assessing paper quality. Result: The preliminary search of five databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Also, to reduce suicides, people with mental problems must be continuously and passively monitored. Further, NLP and other machine learning/artificial intelligence technologies can be used to address health inequities and electronic health records provide valuable data for creating suicide risk tools. Finally, Online, social media, and smartphone applications can be leverage in detecting people with suicide ideation. Conclusion: The use of artificial intelligence and machine learning opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention. To summarise, there is substantial evidence that NLP is useful in identifying people who have suicide ideation.

The daVinci Surgical Robot has revolutionized minimally invasive surgery by enabling greater accuracy and less invasive procedures. However, the system lacks advanced features and autonomy necessary for it to function as a true partner. To enhance its usability, we introduce the implementation of a ChatGPT-based natural language robot interface. Overall, our integration of a ChatGPT-enabled daVinci Surgical Robot has potential to expand the utility of the surgical platform by supplying a more accessible interface. Our system can listen to the operator speak and, through the ChatGPT-enabled interface, translate the sentence and context to execute specific commands to alter the robot’s behavior or to activate certain features. For instance, the surgeon could say (even in Spanish) “please track my left tool” and the system will translate the sentence into a specific track command. This specific error-checked command will then be sent to the hardware which will respond by controlling the camera of the system to continuously adjust to center the left tool in the field of view. We have implemented many commands including “Find my tools” (tools that are not in the field of view) or start/stop recording that can be triggered based on a natural conversational context. Here, we present details of our prototype system, give some accuracy results, and explore its potential implications and limitations. We also discuss how artificial intelligence tools (such as ChatGPT) of the future could be leveraged by robotic surgeons to reduce errors and enhance the efficiency and safety of surgical procedures and even ask for help.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

Although learning analytics (LA) holds great potential to improve teaching and learning, LA research and practice are currently riddled with limitations that impact every stage of the LA life cycle. The present paper offers an overview of these challenges before proposing strategies to overcome them and exploring how the recent innovations brought forth by language models can improve LA research and practice. In particular, we encourage the empowerment of teachers during LA development, as this would strengthen the theoretical foundation of LA solutions and increase their interpretability and usability. Furthermore, we provide examples of how process data can be used to understand learning processes and generate more interpretable LA insights. Furthermore, we explore how LLMs could come into play in LA to generate interpretable insights, timely and actionable feedback, increase personalization, and support teachers’ tasks more broadly.

Tactics, Techniques, and Procedures (TTPs) constitute the most valuable aspect of Cyber Threat Intelligence (CTI). However, TTPs are often implicit in unstructured text, necessitating manual analysis by field experts. Automating the classification of TTPs from unstructured text is a crucial task in contemporary research. MITRE ATT&CK serves as the de facto standard for studying TTPs. Existing research constructs classification datasets based on its procedural examples for tactics and techniques. However, due to a significant proportion of small sample categories, a long-tail phenomenon exists, leading to a highly imbalanced sample distribution. Consequently, more research concentrates on categories with relatively abundant samples. This paper proposes a method that combines ChatGPT data augmentation with Instruction Supervised Fine-Tuning of open large language models. This approach offers a solution for TTPs classification in few-shot learning scenarios, achieving coverage of 625 technical categories. The Precision, Recall, and F1 scores reach 86.2%, 89.9%, and 87.3%, respectively.

This research investigates the potential application of generative language models, especially ChatGPT, in aviation safety analysis as a means to enhance the efficiency of safety analyses and accelerate the time it takes to process incident reports. In particular, ChatGPT was leveraged to generate incident synopses from narratives, which were subsequently compared with ground truth synopses from the Aviation Safety Reporting System (ASRS) dataset. The comparison was facilitated by using embeddings from Large Language Models (LLMs), with aeroBERT demonstrating the highest similarity due to its aerospace-specific fine-tuning. A positive correlation was observed between synopsis length and their cosine similarity. In a subsequent phase, human factor issues involved in incidents as identified by ChatGPT were compared to human factor issues identified by safety analysts. A concurrence rate of 61% was found, with ChatGPT demonstrating a cautious approach towards attributing human factor issues. Finally, the model was used to attribute incidents to relevant parties. As no dedicated ground truth column existed for this task, a manual evaluation was conducted. ChatGPT attributed the majority of incidents to the Flight Crew, ATC, Ground Personnel, and Maintenance. This study opens new avenues for leveraging AI in aviation safety analysis.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

(1) Background: Artificial Intelligence (AI) models have shown potential in various educational contexts. However, their utility in explaining complex biological phenomena, such as Intrinsically Disordered Proteins (IDPs), requires further exploration. This study empirically evaluated the performance of various Large Language Models (LLMs) in the educational domain of IDPs. (2) Methods: Four LLMs, GPT-3.5, GPT-4, GPT-4 with Browsing, and Google Bard (PaLM 2), were assessed using a set of IDP-related questions. An expert evaluated their responses across five categories: accuracy, relevance, depth of understanding, clarity, and overall quality. Descriptive statistics, ANOVA, and Tukey's honesty significant difference tests were utilized for analysis. (3) Results: The GPT-4 model consistently outperformed the others across all evaluation categories. Although GPT-4 and GPT-3.5 were not statistically significantly different in performance (p&gt;0.05), GPT-4 was preferred as the best response in 13 out of 15 instances. The AI models with browsing capabilities, GPT-4 with Browsing and Google Bard (PaLM 2) displayed lower performance metrics across the board with statistically significant differences (p&lt;0.0001). (4) Conclusion: Our findings underscore the potential of AI models, particularly LLMs such as GPT-4, in enhancing scientific education, especially in complex domains such as IDPs. Continued innovation and collaboration among AI developers, educators, and researchers are essential to fully harness the potential of AI for enriching scientific education.

Objective: Food security during public health emergencies relies on situational awareness of needs and resources. Artificial intelligence (AI) has revolutionized situational awareness during crises, allowing the allocation of resources to needs through machine learning algorithms. Limited research exists monitoring Twitter for changes in the food security-related public discourse during the COVID-19 pandemic. We aim to address that gap with AI by classifying food security topics on Twitter and showing topic frequency per day. Methods: Tweets were scraped from Twitter from January 2020 through December 2021 using food security keywords. Latent Dirichlet Allocation (LDA) topic modeling was performed, followed by time-series analyses on topic frequency per day.Results: 237,107 tweets were scraped and classified into topics, including food needs and resources, emergency preparedness and response, and mental/physical health. After the WHO’s pandemic declaration, there were relative increases in topic density per day regarding food pantries, food banks, economic and food security crises, essential services, and emergency preparedness advice. Threats to food security in Tigray emerged in 2021.Conclusions: AI is a powerful yet underused tool to monitor food insecurity on social media. Machine learning tools to improve emergency response should be prioritized, along with measurement of impact. Further food insecurity word patterns testing, as generated by this research, with supervised machine learning models can accelerate the uptake of these tools by policymakers and aid organizations.

In recent years, e-commerce platforms have replaced conventional marketplaces. People are rapidly adopting internet shopping due to the convenience of making purchases from the comfort of their homes. Online review sites allow customers to share their thoughts on products and services. Customers and businesses are increasingly relying on online reviews to assess and improve the quality of products. Existing literature uses Natural language processing (NLP) to analyze customer reviews for different applications. Due to the growing importance of NLP for online customer reviews, this study attempts to provide a taxonomy of NLP applications based on existing literature. This study also examined emerging methods, data sources, and research challenges by reviewing 154 publications from 2013 to 2023 that explore state-of-the-art approaches for diverse applications. Based on existing research, the taxonomy of applications divides literature into five categories: sentiment analysis, review analysis, customer feedback and satisfaction, user profiling, and marketing and reputation management. It is interesting to note that the majority of existing research relies on Amazon user reviews. Additionally, recent research has encouraged the use of advanced techniques like Bidirectional Encoder Representations from Transformers (BERT), Long Short-Term Memory (LSTM), and ensemble classifiers. The rising number of articles published each year indicates increasing interest of researchers and continued growth. This survey additionally addresses open issues, providing future directions in online customer review analysis.

Purpose: Hearing assistive technology (HAT) has been shown to be a viable solution to the speech-in-noise perception (SPIN) issue in children with autism spectrum disorder (ASD); however, little is known about its efficacy in tonal language speakers. This study compared sentence-level SPIN performance between Chinese children with ASD and neurotypical (NT) children and evaluated HAT use in improving SPIN performance and easing SPIN difficulty. Methods: Children with ASD (n=26) and NT children (n=19) aged 6-12 performed two adaptive tests in steady-state noise and three fixed-level tests in quiet and steady-state noise with and without using HAT. Speech recognition thresholds (SRT) and accuracy rates were assessed using adaptive and fixed-level tests, respectively. Parents or teachers of the ASD group completed a questionnaire regarding children’s listening difficulty under six circumstances before and after a ten-day trial period of HAT use. Results: Although the two groups of children had comparable SRTs, the ASD group showed a significantly lower SPIN accuracy rate than the NT group. Also, a significant impact of noise was found in the ASD group’s accuracy rate, but not in the NT group’s. There was a general improvement in the ASD group’s SPIN performance with HAT and a decrease in their listening difficulty ratings across all conditions after the device trial. Conclusion: The findings indicated inadequate SPIN in the ASD group using a relatively sensitive measure to gauge SPIN performance among children. The markedly increased accuracy rate in noise during HAT-on sessions for the ASD group confirmed the feasibility of HAT for improving SPIN performance in controlled laboratory settings, and the reduced post-use ratings of listening difficulty further confirmed the benefits of HAT use in daily scenarios.

Emergent physics education research (PER) literatures have been disseminated through academic publications within the community. The growing body of literatures over years challenge Indonesian PER scholars to understand how the research community has been progressed and what possible future work that should be emphasized. Nevertheless, previous traditional method of thematic analysis performed serious limitation when the number of PER literatures exponentially increased. Dealing with this large volume of publications, one of the machine learning studies namely natural language processing (NLP) was employed in this study to automate our thematic analysis among Indonesian PER literatures that are still limited to be explored. One of the well-known NLP algorithm, latent Dirichlet allocation (LDA), has been performed to extract Indonesian PER topics and their associated development between 2014 and 2021. A total of 852 papers (~ 4 to 8 pages each) were collectively downloaded from five international conference proceedings organized by Indonesian PER researchers. Before their topics were modeled through LDA algorithm, our data corpus should be previously preprocessed through several common procedures of established NLP studies. Findings revealed that LDA has thematically quantified Indonesian PER topics and described their distinct development over certain period. The identified topics from this study demonstrated that Indonesian PER community has established robust development in eight distinctive topics to the present. They begin with initial interest in focusing research on physics laboratory and following the research based instruction in the late 2015. Indonesian PER scholars sustained to study continuous topic on 21st century skill until 2019 which gave way to a focus on developing relevant educational technology to address several forms of students’ performance including scientific literacy and problem solving. There is still lack of Indonesian PER literatures that have been attempted to address qualitative aspects of physics teaching and learning.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

This study presents a novel approach to enhance Large Language Models (LLMs) like Alpaca by dynamically integrating real-time information. This method addresses the issue of content hallucination and data relevancy by automatically collecting and integrating current data from credible sources into model prompts. Experiments show a significant improvement in accuracy and a decrease in content hallucination, with a manageable increase in response time. The research underscores the potential of real-time data integration in making LLMs more accurate and contextually relevant, setting a foundation for future advancements in dynamic data processing in AI.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Context: Anomaly detection in a data center is a challenging task, having to consider different services on various resources. Current literature shows the application of artificial intelligence techniques to either log files or monitoring data: the former created by services at run time, while the latter produced by specific sensors directly on the physical or virtual machine. Objectives: We propose a model that exploits information both in log files and monitoring data to identify patterns and detect anomalies over time. Methods: The key idea is to use on one side natural language processing solutions to detect problems at service level, extracting words that represent anomalies. Clustering and topic modeling techniques have been used to identify patterns and group them with respect to topics. On the other side time series anomaly detection technique has been applied to sensors data in order to combine problems found in the log files with problems stored in the monitoring data. Results: We have tested our approach on a real data center equipped with log files and monitoring data that can characterize the behaviour of physical and virtual resources in production. We have observed a correspondence between anomalies in log files and monitoring data, e.g. an increase in memory usage or machine load. The results are extremely promising. Conclusion: Our model requires to integrate site administrators' expertise in order to consider all critical scenario in the data center and understand results properly.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

The classification of goods involved in international trade in Brazil is based on the Mercosur Common Nomenclature (NCM). The classification of these goods represents a real challenge due to the complexity involved in assigning the correct category codes especially considering the legal and fiscal implications of misclassification. This work focuses on the training of a classifier based on Bidirectional En-coder Representations from Transformers (BERT) for the tax classification of goods with NCM codes. In particular, this article presents results from using a specific Portuguese Language tuned BERT model as well results from using a Multilingual BERT. Experimental results justify the use of these models in the classification process and also that the language specific model has a slightly better performance.

The disruptive application of ChatGPT (GPT-3.5, GPT-4) to a variety of domains has become a topic of much discussion in the scientific community and society at large. Large Language Models (LLMs), e.g., BERT, Bard, Generative Pre-trained Transformers (GPTs), LLaMA, etc., have the ability to take instructions, or prompts, from users and generate answers and solutions based on very large volumes of text-based training data. This paper assesses the impact and potential impact of ChatGPT on the field of digital forensics, specifically looking at its latest pre-trained LLM, GPT-4. A series of experiments are conducted to assess its capability across several digital forensic use cases including artefact understanding, evidence searching, code generation, anomaly detection, incident response, and education. Across these topics, its strengths and risks are outlined and a number of general conclusions are drawn. Overall this paper concludes that while there are some potential low-risk applications of ChatGPT within digital forensics, many are either unsuitable at present, since the evidence would need to be uploaded to the service, or they require sufficient knowledge of the topic being asked of the tool to identify incorrect assumptions, inaccuracies, and mistakes. However, to an appropriately knowledgeable user, it could act as a useful supporting tool in some circumstances.

Requirements are predominantly written in Natural Language (NL), which makes them accessible to stakeholders with varying degrees of experience, as compared to a model-based language which requires special training. However, despite its benefits, NL can introduce ambiguities and inconsistencies in requirements, which may eventually result in system quality degradation and system failure altogether. The system complexity that characterizes current systems warrants an integrated and comprehensive approach to system design and development. This need has brought about a paradigm shift towards Model-Based Systems Engineering (MBSE) approaches to system design and a departure from traditional document-centric methods. While, MBSE shows great promise, the ambiguities and inconsistencies present in NL requirements hinder their conversion to models directly. The field of Natural Language Processing (NLP) has demonstrated great potential in facilitating the conversion of NL requirements into a semi-machine-readable format that enables their standardization and use in a model-based environment. A first step towards standardizing requirements consists of classifying them according to the ``type'' (design, functional, performance, etc.) they represent. To that end, a language model capable of classifying requirements needs to be fine-tuned on labeled aerospace requirements. This paper presents the development of an annotated aerospace requirements corpus and its use to fine-tune BERT$_\text{BASE-UNCASED}$ to obtain aeroBERT-Classifier: a new language model for classifying aerospace requirements into design, functional, or performance requirements. A comparison between aeroBERT-Classifier and bart-large-mnli (zero-shot text classification) showcased the superior performance of aeroBERT-Classifier on classifying aerospace requirements despite being fine-tuned on a small labeled dataset.

Teaching and learning a new language is a complex process that requires more than just memorizing vocabulary and grammar rules. Immersing oneself in the target language's culture and history is essential for achieving fluency and accuracy. In recent years, researchers have explored the potential of music as a tool for language learning. This paper discusses the benefits of using music in language learning, including improved listening comprehension, pronunciation and fluency, and cultural understanding. The theoretical framework of sociocultural theory, cognitive load theory, and task-based language learning is presented to support the use of music in language learning. This paper also provides practical recommendations for learners to incorporate music into their language learning routine, as well as resources for finding music in the target language, such as online music platforms and language learning apps. The article concludes by encouraging language learners to incorporate music into their language learning routine and providing resources for finding music in the target language, such as online music platforms and language learning apps. Overall, this paper demonstrates that music can be a powerful and enjoyable tool for enhancing language learning outcomes.

In today's complex and rapidly changing world, integrating values, critical thinking, and moral reasoning in language and literature education is crucial for equipping students with the skills to navigate multifaceted ethical dilemmas and become responsible global citizens. This article highlights the connection between language, literature, critical thinking, moral reasoning, and values integration in education. Through language and literature, teachers can incorporate values education in their classroom, which can benefit not only individual students but also society as a whole. Theoretical frameworks such as character education, moral education, and values education provide the basis for this approach. The researcher recommends strategies for incorporating values integration in language and literature curricula, including the use of literary texts that promote critical thinking and moral reasoning skills. The limitations of this approach, including the challenges in assessing the effectiveness of values integration and potential resistance from some stakeholders, are also discussed. Ultimately, this article aims to call on educators to take a proactive role in promoting values integration in language and literature education, guided by the principles of Jesus Christ and the belief that education is not only about acquiring knowledge but developing character as well. Moreover, this concept has a significant and lasting impact on students' overall development that highlights the importance of values and moral reasoning needed to live a better life.

This paper investigates if Corporate Social Responsibility (CSR) reports published by a selected group of Nordic companies are aligned with the Global Reporting Initiative (GRI) standards. To achieve this goal, several natural language processing, and text mining techniques were implemented and tested. We extracted strings, corpus, and hybrid semantic similarities from the reports and evaluated the models through the intrinsic assessment methodology. A quantitative ranking score based on index matching was developed to complement the semantic valuation. The final results show that Latent Semantic Analysis (LSA) and Global Vectors for Word Representation (GloVE) are the best methods for our study. Our findings will open the door to the automatic evaluation of sustainability reports which could have a strong impact on the environment.

Humans have a unique cognitive ability known as relational abstraction, which allows us to identify logical rules and patterns beyond basic perceptual characteristics. This ability represents a key difference between how humans and other animals learn and interact with the world. With current large language models rivaling human intelligence in many regards, we investigated whether relational abstraction was an emergent chat completion capacity in various models. We find that despite their impressive language processing skills, all tested language models failed the relational match-to-sample (RMTS) test, a benchmark for assessing relational abstraction. These results challenge the assumption that advanced language skills inherently confer the capacity for complex relational reasoning. The paper highlights the need for a broader evaluation of AI cognitive abilities, emphasizing that language proficiency alone may not be indicative of certain higher-order cognitive processes thought to be supported by language.

The known three-component reaction-diffusion system modeling competition and co-existence of different language speakers is under study. A modification of this system is proposed, which is examined by Lie symmetry method; furthermore exact solutions in the form of traveling fronts are constructed and their properties are identified. Plots of the traveling fronts are presented and the relevant interpretation describing the language shift occurred in Ukraine during the Soviet times is suggested

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

Background: In the present study, we assessed the feasibility and success outcomes of voice prosthesis (VP) changes when performed by speech-language pathologist (SLP). Methods: Patients treated with total laryngectomy (TL) from January 2020 to December 2020 were prospectively recruited from our medical center. Patients benefited from tracheoesophageal puncture. The VP changes were performed by the senior SLP and the following data were collected for each VP change: date of placement; change or removal; VP type and size; reason for change or removal; and use of a washer for periprosthetic leakage. A patient-reported outcome questionnaire including 6 items was proposed to patients at each VP change (Appendix 1). Items were assessed with a 10-point Likert-scale. Results: Fifty-two VP changes were performed by the senior SLP during the study period. The mean duration of the SLP consultation, including patient history, examination and VP change procedure was 20 min (range: 15-30). The median prosthesis lifetime was 88 days. The main reasons for VP changes were transprosthetic (N=34; 79%) and periprosthetic (N=7; 21%) leakages, respectively. SLP successfully performed all VP changes. He did not change one VP but used a periprosthetic silastic to stop the periprosthetic leakages. In two cases, SLP needed the surgeon examination to discuss about the following indication: implant mucosa inclusion and autologous fat injection. The patient satisfaction was high according to the speed and the quality of care by the SLP. Conclusion: The delegation of VP change from the otolaryngologist-head and neck sur-geon to the speech-language pathologist (SLP) may be done without significant complications. The delegation of VP change procedure to SLP may be interesting in some rural regions with otolaryngologist shortage.

In the realm of mathematics education, self-explanation stands as a crucial learning mechanism, allowing learners to articulate their comprehension of intricate mathematical concepts and strategies. As digital learning platforms grow in prominence, there are mounting opportunities to collect and utilize mathematical self-explanations. However, these opportunities are met with challenges in automated evaluation. Automatic scoring of mathematical self-explanations is crucial for preprocessing tasks, including the categorization of learner responses, identification of common misconceptions, and the creation of tailored feedback and model solutions. Nevertheless, this task is hindered by the dearth of ample sample sets. Our research introduces a semi-supervised technique using the Language Learning Model (LLM), specifically its Japanese variant, to enrich datasets for the automated scoring of mathematical self-explanations. We rigorously evaluated the quality of self-explanations across five datasets, ranging from human-evaluated originals to ones devoid of original content. Our results show that combining LLM-based explanations with mathematical material significantly improves the model's accuracy. Interestingly, there's an optimal limit to how much synthetic self-explanation data can bene-fit the system. Exceeding this limit doesn't further improve outcomes. This study thus highlights the need for careful consideration when integrating synthetic data into solutions, especially within the mathematics discipline.

In an era marked by rapid technological progress and global dynamics, the Neo-Language Acquisition and Learning Theory challenges conventional language acquisition paradigms through its conceptualization of 'Grit: The Unyielding Will to Connect,' emphasizing determination, motivation, and adaptability as the primary drivers of language learning, transcending age-related constraints and critical periods. This theory also underscores 'Self-Preservation: Language as the Canvas of Reality,' as language plays a pivotal role in preserving and conveying our individual and collective experiences. Recent global events have underscored the theory's relevance, prompting a reevaluation of language education in response to changing circumstances. Moreover, 'Techno-Training: Language Acquisition and Learning in the Digital Age' is integral to the theory, as it recognizes the influence of technology on modern language education. Beyond traditional methods, these three reshape our fundamental understanding of said theory. Drawing from historical evidence, psychological principles, and contemporary applications, they supported the conceptualization of the theory itself. Overall, the Neo-Language Acquisition and Learning Theory revolutionizes language education, spotlighting the power of motivation, determination, and adaptability to navigate the evolving landscape of language learning and acquisition.

Task-Based Instruction (TBI) is a dynamic approach in tertiary language education that emphasizes the integration of authentic and meaningful tasks to enhance language learning outcomes. This study aims to explore the implementation of TBI in the Philippines, investigate its cognitive benefits and transformative nature, identify pedagogical considerations, and provide recommendations for optimization. The study employed a qualitative research design, with data collected from five private schools in Iligan City. A purposive sampling procedure was used to select 20 participants who engaged in interviews, focus group discussions, and thematic analysis. The results revealed that TBI positively influenced language proficiency, cognitive development, learner autonomy, intercultural competence, and pedagogical considerations. Participants reported enhanced language skills and increased confidence in real-life language use. They also highlighted the development of critical thinking, problem-solving, and decision-making skills through engaging in challenging tasks. TBI was found to empower learners by promoting autonomy, ownership, and self-directed learning. Additionally, it cultivated intercultural communicative competence and fostered appreciation for diverse perspectives. Pedagogical considerations included task design, clear instructions, scaffolding, and feedback, while recommendations focused on optimizing TBI, integrating technology-enhanced learning, and supporting professional development for educators. This research contributes to the growing body of literature on TBI in tertiary language education and underscores its potential for creating transformative learning experiences. The findings provide valuable insights for educators, curriculum designers, and policymakers in enhancing language education practices in the Philippines and beyond.

The COVID-19 pandemic measures have negatively impacted education worldwide via travel restrictions, student visas, and physical attendanc,e among many other fac-tors. As one of the first places to impose strict pandemic measures and one of the last places to lift the measures, Mainland China provided a unique venue to investigate the effect of public health pandemic control policies on tertiary education. Considering the large portion of international students in medical schools and the higher susceptibility to the pandemic measures due to the natural synergy with teaching hospitals, medical schools can be an early forefront indicator of the impact of the pandemic on tertiary education. We surveyed 513 participants international medical students from Wen-zhou Medical University’s school of international studies in 2019 and 2022 about their satisfaction and demographic and cultural adaptation parameters. We found that the pandemic restrictions did not generally impact student satisfaction. Further analyzing the associated parameters, we found teaching satisfaction to be independent of age (P=.159), years in China (P=.896) and Chinese Level (P=.577) in the medical university. Teaching satisfaction is associated with the region of origin (P <0.001), acceptance of local social norms (P <0.001), satisfaction with the core values of Chinese culture (P <0.001), acclimatization to life in China (P <0.001), can easily make Chinese friends (P <0.001) among other factors. The findings of this study provide an understanding of the effects of pandemic measures on tertiary education satisfaction and other factors that can aid in international student satisfaction.

This paper explores how Artificial Intelligence (AI) can help reduce the communication gap and streamline the distribution of resources. It uses an exploratory case study to examine the current state of the communication gap and the potential opportunities AI can bring to close it. The paper will discuss the current state of the communication gap, the current methods of resource distribution, and the potential opportunities AI can bring to reduce the communication gap. It will also explore the potential implications of AI on resource distribution and the communication gap. The paper will review the existing literature on the communication gap, resource distribution, and AI. It will then focus on the opportunities AI can bring to the communication gap. It will analyze the use of machine learning, natural language processing, and other AI-based technologies to reduce the communication gap. It will also examine the potential implications of AI on resource distribution, such as developing more efficient distribution channels, increasing transparency, and reducing costs. Finally, the paper will analyze the impact of AI on the communication gap and resource distribution. It will discuss the potential challenges and benefits of using AI, such as the need for data security, the potential for bias, and the limitations of AI technology. The paper will also explore the potential for AI to improve the distribution of resources and reduce the communication gap. Overall, this paper provides an exploratory case study on the opportunities of how AI can contribute to reducing the communication gap and streamlining the distribution of resources. It discusses the potential implications of AI on the communication gap and resource distribution, and it reviews the potential challenges and benefits of using AI. The paper provides an in-depth analysis of the potential opportunities of using AI to reduce the communication gap and streamline the distribution of resources.

The notion of information and complexity are important concepts in many scientific fields such as molecular biology, evolutionary theory, and exobiology. Many measures of these quantities, either rely on a statistical notion of information, are difficult to compute, or can only be applied to strings. Based on assembly theory, we propose the notion of a \textit{ladderpath}, which describes how an object can be decomposed into a hierarchical structure using repetitive elements. From the ladderpath two measures naturally emerge: the ladderpath-index and the order-index, which represent two axes of complexity. We show how the ladderpath approach can be applied to both strings and spatial patterns and argue that all systems that undergo evolution can be described as ladderpaths. Further, we discuss possible applications to human language and the origins of life. The ladderpath approach provides a novel characterization of the information that is contained in a single object (or a system) and could aid in our understanding of evolving systems and the origin of life in particular.

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

The exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications and diverse use-cases in assisted living, military, healthcare, firefighting, and industry 4.0. The exoskeleton market is projected to increase by multiple times of its current value within the next two years. Therefore, it is crucial to study the degree and trends of user interest, views, opinions, perspectives, attitudes, acceptance, feedback, engagement, buying behavior, and satisfaction, towards exoskeletons, for which the availability of Big Data of conversations about exoskeletons is necessary. The Internet of Everything style of today's living, characterized by people spending more time on the internet than ever before, with a specific focus on social media platforms, holds the potential for the development of such a dataset, by the mining of relevant social media conversations. Twitter, one such social media platform, is highly popular amongst all age groups, where the topics found in the conversation paradigms include emerging technologies such as exoskeletons. To address this research challenge, this work makes two scientific contributions to this field. First, it presents an open-access dataset of about 140,000 tweets about exoskeletons that were posted in a 5-year period from May 21, 2017, to May 21, 2022. Second, based on a comprehensive review of the recent works in the fields of Big Data, Natural Language Processing, Information Retrieval, Data Mining, Pattern Recognition, and Artificial Intelligence that may be applied to relevant Twitter data for advancing research, innovation, and discovery in the field of exoskeleton research, a total of 100 Research Questions are presented for researchers to study, analyze, evaluate, ideate, and investigate based on this dataset.

Sign Language Recognition (SLR) aims to bridge speech-impaired and general communities by recognizing signs from given videos. Researchers still face challenges developing efficient SLR systems because of the video’s complex background, light illumination, and subject structures. Recently many researchers developed a skeleton-based sign language recognition system to overcome the subject and background variation of hand gesture signs. However, skeleton-based SLR is still under exploration due to the lack of information and annotations on hand key points. More recently, researchers included body and face information with the hand gesture for the SLR, but their performance and efficiency are unsatisfactory. We proposed a Multi-Stream Graph-based Deep Neural Network (SL-GDN) for a skeleton-based SLR system to overcome the problems. The main purpose of the proposed SL-GDN approach is to improve the efficiency and performance of the SLR system with a low computational cost based on the human body pose in the form of 2D landmark locations. In the procedure, firstly, we constructed a skeleton graph based on the selected 27 whole-body key points among 67 key points to solve the inefficiency problems. Then we proposed multi-stream SL-GDN to extract features from the whole-body skeleton graph for four streams. Finally, we concatenated the four different features and applied a classification module to refine the feature and recognize corresponding sign classes. Our data-driven and graph construction method increases the system’s flexibility and brings high generability to adapt various data samples. We used three large-scale benchmark SLR datasets to evaluate the proposed model: WLASL, AUTSL and CSL. The demonstrated performance accuracy table proved the superiority of the proposed model, and we believe this will be considered a great invention in the SLR domain.

Global rapidly evolving events, e.g., COVID-19, are usually followed by countermeasures and policies. As a reaction, the public tends to express their emotions on social media platforms. Therefore, predicting emotional responses to events is critical to put a plan to avoid risky behaviors. This paper proposes a machine learning-based framework to detect public emotions based on social media posts in response to specific events. It presents a precise measurement of population-level emotions which can aid governance in monitoring public response and guide it to put in place strategies such as targeted monitoring of mental health, to react to a rise in negative emotions in response to lockdowns, or information campaigns, for instance in response to elevated rates of fear in response to vaccination programs. We evaluate our framework by extracting 15,455 tweets. We annotate and categorize the emotions into 11 categories based on Plutchik’s study of emotion and extract the features using a combination of Bag of Words and Term Frequency-Inverse Document Frequency. We filter 813 COVID-19 vaccine-related tweets and use them to demonstrate our framework’s effectiveness. Numerical evaluation of emotions prediction using Random Forest and Logistic Regression shows that our framework predicts emotions with an accuracy up to 95%.

A novel hypothesis concerning language evolution is advanced. It posits that languages have evolved as a means of binding individuals to a group, as well as for defining those groups. This means that language evolution has to be considered on the level of groups and not only on the level of individuals. This hypothesis helps to explain the huge diversity of human languages, as well as their complexity. Perhaps more importantly, it explains why adults lose the ability to learn languages with the ease that children possess.

Ion channels are integral membrane proteins that facilitate the movement of ions across cell membranes, playing a key role in a range of biological processes. The high cost and time required for wet lab experiments to characterize ion channels has spurred the development of computational methods for this purpose. In our previous work, we demonstrated the effectiveness of protein language models for ion channel prediction, using a logistic regression classifier to distinguish ion channels from non-ion channels (TooT-BERT-C) and transporters from non-transporters (TooT-BERT-T). In this study, we build upon this approach by using a combination of classical machine learning classifiers and a Convolutional Neural Network (CNN) with fine-tuned representations from ProtBERT, ProtBERT-BFD, and MembraneBERT to discriminate ion channels from non-ion channels. The results of our experiments demonstrate that TooT-BERT-CNN-C, a combination of the representations from ProtBERT-BFD and a CNN, outperforms existing state-of-the-art methods for predicting ion channels, with a Matthews Correlation Coefficient (MCC) of 0.86 and an accuracy of 98.35% on an independent test set.

There is a serious concern regarding framing rules and guidelines to regulate the content on OTT platforms that needs urgent attention. In the Current Scenario, the use of vulgar language in the public domain on OTT platforms needs to take seriously. Some OTT platforms heavenly use foul language, which is open to children that cause a huge psychological impact on them. The use of vulgar language, including profanity and bad words, has to be regulated strictly. Web series uses obscene, abusive words and foul language with excessive usage. This review paper highlights the excessive use of swear words, profane language, and vulgar expletives on OTT platforms.

A digital twin is a virtual representation that serves as the real-time digital counterpart of a physical object or system. Recent advancements have extended the concept of digital twins to humans, incorporating complex biological data such as DNA (Predictiv Care, Inc.) and immune system profiles. These sophisticated models go beyond mere pictorial representations, offering a more holistic digital reflection. However, a significant gap remains. The current human digital twin models are not capable of learning one’s preferences. In this pilot study, we introduce Diginality, a chatbot powered by HyperCLOVA X, a Large Language Model (LLM) developed by NAVER, Inc. Diginality, learns one’s preferences with custom training from data collected by interview-style questions on the user’s topic of interest. Our findings demonstrate that Diginality successfully answers one’s preferences, thereby adding a new dimension to the concept of human digital twins. This work represents a pioneering step towards creating a more comprehensive and psychologically nuanced human digital twin.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

This paper proposes the utilization of large language models as recommendations systems for museums. Since the aforementioned models lack the notion of context, they can’t work with temporal information that is often present in recommendations for cultural environments (e.g. special exhibitions or events). In this respect, the current work aims at enhancing the capabilities of large language models through a fine-tuning process that incorporates contextual information and user instructions. The resulting models are expected to be capable of providing personalized recommendations, aligned with user preferences and desires. More specifically, Generative Pre-trained Transformer 4, a knowledge-based large language model is fine-tuned and turned into a context-ware recommendation system, adapting its suggestions based on user input and specific contextual factors such as location, time of visit, and other relevant parameters. The effectiveness of the proposed approach is evaluated through certain user studies, which ensure an improved user experience and engagement within the museum environment.