Background: This study presents a graph-based and purely structural analysis to detect echo chambers on Twitter. Echo chambers are a concern as they can spread misinformation and reinforce harmful stereotypes and biases in social networks. Methods: The study recorded the German-language Twitter stream over two months, recording about 180.000 accounts and their interactions. The study focuses on retweet interaction patterns in the German-speaking Twitter stream and found that the greedy modularity maximization and HITS metric are the most effective methods for identifying echo chambers. Results: The purely structural detection approach was able to identify an echo chamber (red community) that was focused on a few topics with a triad of Anti-Covid, right-wing populism, and pro-Russian positions (very likely reinforced by Kremlin-orchestrated troll accounts). In contrast, a blue community was much more heterogeneous and showed "normal" communication interaction patterns. Conclusions: The study highlights the effects of echo chambers as they can make political discourse dysfunctional and foster polarization in open societies. The presented results contribute to identifying problematic interaction patterns in social networks often involved in the spread of disinformation by problematic actors. It is important to note that not the content but only the interaction patterns would be used as a decision criterion, thus avoiding problematic content censorship.

Ion channels are integral membrane proteins that facilitate the movement of ions across cell membranes, playing a key role in a range of biological processes. The high cost and time required for wet lab experiments to characterize ion channels has spurred the development of computational methods for this purpose. In our previous work, we demonstrated the effectiveness of protein language models for ion channel prediction, using a logistic regression classifier to distinguish ion channels from non-ion channels (TooT-BERT-C) and transporters from non-transporters (TooT-BERT-T). In this study, we build upon this approach by using a combination of classical machine learning classifiers and a Convolutional Neural Network (CNN) with fine-tuned representations from ProtBERT, ProtBERT-BFD, and MembraneBERT to discriminate ion channels from non-ion channels. The results of our experiments demonstrate that TooT-BERT-CNN-C, a combination of the representations from ProtBERT-BFD and a CNN, outperforms existing state-of-the-art methods for predicting ion channels, with a Matthews Correlation Coefficient (MCC) of 0.86 and an accuracy of 98.35% on an independent test set.

Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. In this study, we developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to analyze relevant free-text colonoscopy reports, including indications, pathology, and findings notes. The Bio-Bi-LSTM-CRF framework was developed using Bidirectional Long Short-term Memory (Bi-LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free-text reports, including indications for the colonoscopy, findings during the colonoscopy, and pathology of the resected material. We then trained the Bio-Bi-LSTM-CRF and existing Bi-LSTM-CRF models on 80% of 4,000 manually annotated notes obtained from the colonoscopy reports of 3,867 patients. The clinical notes were from a group of patients aged over 40 years old enrolled in four Veterans Affairs Medical Centers. A total of 10% of the remaining annotated notes were used to train hyperparameter, while the remaining 10% were used to evaluate the accuracy of our model (Bio-Bi-LSTM-CRF) and to compare the results with the outcomes obtained using Bi-LSTM-CRF. The results of our experiments showed that the bidirectional encoder representations by integrating dictionary function vector from Bio-Bi-LSTM-CRF and strategies character sequence embedding approach is an effective way to identify colonoscopy features from EHR-extracted clinical notes. Therefore, the Bio-Bi-LSTM-CRF model is concluded to be capable of creating new opportunities to identify patients at risk for colon cancer and to study their health outcomes.

Potocki-Lupski Syndrome (PTLS) is a rare condition associated with a duplication of 17p11.2 that may underlie a wide range of congenital abnormalities and heterogeneous behavioral phenotypes. Along with developmental delay and intellectual disability, autism-specific traits are often reported to be the most common among patients with PTLS. To contribute to the discussion of the role of autism spectrum disorder (ASD) in the PTLS phenotype, we present a case of a female adolescent with a de novo dup(17)(p11.2p11.2) without ASD features, focusing on in-depth clinical, behavioral, and electrophysiological (EEG) evaluations. Among EEG features, we found the atypical peak-slow wave patterns and a unique saw-like sharp wave of 13 Hz that was not previously described in any other patient. The power spectral density of the resting state EEG was typical in our patient with only the values of non-linear EEG dynamics: Hjorth complexity and Fractal dimension were drastically attenuated compared with the patient’s neurotypical peers. Here we also summarize results from previously published reports of PTLS that point to the about 21% occurrence of ASD in PTLS that might be biased, taking into account methodological limitations. More consistent among PTLS patients were intellectual disability and speech and language disorders.

Cerebellar mutism syndrome (CMS), also known as posterior fossa syndrome, is encountered in a subset of children who have undergone an operative procedure of the posterior cranial fossa, mainly involving the vermis, and the most frequent underlying pathology is proved to be medulloblastoma. The most common characteristics of this syndrome include an often transient, although protracted, language impairment, emotional lability, along with cerebellar, and brainstem dysfunction. Nevertheless, a significant number of patients experience persistent neurological deficits and lasting neurocognitive impairment. A lot of research and clinical studies have been performed in order to better delineate this syndrome. The main obstacles in our way to highlight all aspects of this syndrome were related with an inconsistent nomenclature, poorly defined diagnostic criteria, and uncertainty surrounding risk factors and etiology. Currently, there is a combination of diagnostic criteria that are regarded as prerequisites in order to establish the diagnosis of CMS. These include language impairment and emotional lability, as proposed by the international Board of the Posterior Fossa Society in their consensus statement. Several risk factors are recognized as implicated in the pathogenesis of this syndrome, including midline tumor location, diagnosis of medulloblastoma, younger age at diagnosis, and preoperatively established language impairment. A proposed etiology of CMS includes disruption of the cerebellar outflow tracts, the cerebellar nuclei, and their efferent projections through the superior cerebellar peduncle. Specific treatment for CMS is lacking, and it continues to be directed at symptom management. Our aim is to present a comprehensive narrative review of CMS etiology, diagnosis, risk factors, clinical presentation, and clinical management. Moreover, we attempt to recognize the most widely recognized priorities of the research community in order to expand our knowledge in the era of diagnostics, prevention, and therapeutic options for patients suffering from CM, or who are at risk for development of this syndrome.

Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Suicide may be prevented if prompt intervention is taken to mitigate risk. Machine learning and artificial intelligence-based modelling, such as natural language processing (NLP) and other text analytics approaches, has the potential to become a major technique for the detection, diagnosis, and treatment of people who are suffering from mental health issues. The primary aims of this research are to determine whether NLP techniques have been utilised in the field of suicide prevention, and if so, were they effective? What were their limitations? Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. Thematic analysis was used to synthesise and analyse the included studies. Findings were reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement, and the Mixed Methods Appraisal Tool (MMAT) was used in assessing paper quality. Result: The preliminary search of five databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Also, to reduce suicides, people with mental problems must be continuously and passively monitored. Further, NLP and other machine learning/artificial intelligence technologies can be used to address health inequities and electronic health records provide valuable data for creating suicide risk tools. Finally, Online, social media, and smartphone applications can be leverage in detecting people with suicide ideation. Conclusion: The use of artificial intelligence and machine learning opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention. To summarise, there is substantial evidence that NLP is useful in identifying people who have suicide ideation.

When animals evolve sufficient intelligence and dexterity to be able to learn to fabricate utility products (UPs) like tools, the UP's they produce become part of an induced-reproduction system that intrinsically shares many life-like traits with biological organisms, including genome-like fabrication and operation information that is physically-encoded in the animal fabricator’s neural networks. When this set of life- like traits includes a sufficient capacity for system-improving cultural evolution (UP-evolvability), the UPs become ‘para-alive’, i.e., nearly alive, or a form of non-biological UP-paralife that is equivalent to the life- status of biological viruses, plasmids, and transposons. In the companion paper I focus on the evolution of UP-paralife in the context of modern, language-capable humans and its predicted evolution going forward in time (Rice 2022). Here I look backward in time and focus on the origin of UP-paralife and its subsequent coevolution with human intelligence. I begin by determining the pathways leading to the evolution of large brains in the rare lineages of biological life that have sufficient intelligence to learn to fabricate tools –a critical first step in the evolution of UP-paralife. The simplest forms of these learning- based UPs, made by species like chimpanzees and New Caledonian crows, represent only proto-UP- paralife because they lack sufficient UP-evolvability. Expanded UP-evolvability required a combination of three attributes that enabled continuous niche-expansion of the animal fabricator via a new and advanced form of UP-mediated teamwork (TW): i) self-domestication that facilitated TW among low-related individuals, ii) learned volitional words (protolanguage) that represent ephemeral UPs that coordinate TW, and iii) learned fabrication of simple flaked-stone tools with cutting and chopping capabilities (a UP to make other structural UPs) that expanded teammate phenotypes and TW capabilities. This specific triad of attributes is synergistic because each one acts as a TW-enhancer that can gradually erode different components of the three major constraints on TW operation and expansion: too much selfishness, insufficient coordination signals, and insufficient physical traits of teammates. The increase in UP- evolvability was transformative and marked the origin of UP-paralife and the initiation of coevolution between UP-paralife (cultural evolution) and the intelligence of its hominin/human symbiont (genetic evolution) that fostered 2.5 million years of: i) continuous brain size increase and niche-expansion within the genus Homo, and ii) parallel advances in the diversity, complexity and uses of UP-paralife. This coevolution also fostered evolutionary expansion of word-based communication, and eventually language, that acted in a catalyst-like manner to facilitate the evolution of increasingly complex forms of imagination, reasoning, mentalizing, and UP-generating technology. I next focus on the evolution of creativity in the human lineage –in the form of divergent thinking and creative imagination. I conclude that the evolution of this advanced cognitive feature required a preadaptation of sufficient intelligence and is the component of human cognition that was the major causal factor generating the greatly expanded diversity and complexity of UP-paralife currently associated with modern humans. Lastly, I apply my findings to the issue of the prevalence of extraterrestrial intelligent life. I conclude that any exoplanets with detected chemical life will very rarely (e.g., probability ~10-5 for a planet closely matching Earth’s characteristics) have evolved intelligence equalling or exceeding that of humans.

The practice of nurse health coaching (NHC) draws from the art and science of nursing, behavioral sciences, and evidence-based health coaching methods. This secondary analysis of the audio-recorded natural language of participants during NHC sessions of our recent 8-week RCT evaluates improvement over time in cognitive-behavioral outcomes: Change Talk, Resiliency, Self-Efficacy/Independent Agency, Insight & Pattern Recognition, and Building Towards Sustainability. We developed a measurement tool for coding, Indicators of Health Behavior Change (IHBC), that was designed to allow trained health coach experts to assess the presence and frequency of the indicators in the natural language content of participants. We used a two-step method for randomly selecting the 20-minute audio-recorded session that was analyzed at each time point. Fifty-six participants had high-quality audio recordings of the NHC sessions. Twelve participants were placed in the social determinants of health (SDH) group based on the following: low income (<$20,000/year), early-onset hypertension, and social disadvantages. Our analyses significantly improved Change Talk and the other four factors over time. Our factor analyses indicated two distinct factors at each measurement point of the study, demonstrating the stability of the outcome measures over time. Our newly developed measurement tool, IHBC, proved stable in structure over time and sensitive to change. This NHC program shows promise in improving cognitive-behavioral indicators associated with health behavior change in both non-SDH and SDH individuals.

The goal of the next generation World Wide Web is machine readability through linked databases. To improve web search, integration, and mining in local languages like Urdu, there is a growing need to develop ontologies and vocabulary in these languages. The majority of people use the web in local languages for agriculture, social media interaction, news, etc. How to create agents for the integration of web data. In our country, the literacy ratio is very low and IT literacy is negligible. More comprehensive information for its target audience is only possible through the World Wide Web. Our first target is to improve and enhance the use of social media and the web in local languages. That will encourage its constructive use in Urdu for society and the economy. The Web in natural languages is the source of income for small and medium enterprises. The semantic web is concerned with linked databases and structured data. In this work, we are focused on some selected ontologies to be translated into natural languages. Expertise in Ontology Engineering helps us in job production. Ontology Engineering has extensive freelancing opportunities. Only if the web is correctly interpreted in regional languages is an economic boost achievable. A standardized foundation for data sharing and reuse on the internet is provided by the Semantic Web. In other words, a group of standards and technology that enables computers to comprehend the semantics (meaning) of material on the Web.

“A Picture is worth a thousand words”. Given an image, humans are able to deduce various cause-and-effect captions of past, current, and future events beyond the image. The task of visual commonsense generation aims at generating three cause-and-effect captions (1) what needed to happen before, (2) what is the current intent, and (3) what will happen after for a given image. However, such a task is challenging for machines owing to two limitations: existing approaches (1) directly utilize conventional vision-language transformers to learn relationships between input modalities, and (2) ignore relations among target cause-and-effect captions but consider each caption independently. We propose Cause-and-Effect BART (CE-BART) which is based on (1) Structured Graph Reasoner that captures intra- and inter-modality relationships among visual and textual representations, and (2) Cause-and-Effect Generator that generates cause-and-effect captions by considering the causal relations among inferences. We demonstrate the validity of CE-BART on VisualCOMET and AVSD benchmarks. CE-BART achieves SOTA performances on both benchmarks, while extensive ablation study and qualitative analysis demonstrate the performance gain and improved interpretability.

At the end of 2019, while the world was being hit by the COVID-19 virus and, consequently, was living a global health crisis, many other pandemics were putting humankind in danger. The role of social media is of paramount importance in these kinds of contexts since they help health systems to cope with emergencies by contributing to conducting some activities such as the identification of public concerns, the detection of infections’ symptoms, and the traceability of the virus diffusion. In this paper, we have analyzed comments on events related to cholera, ebola, HIV/AIDS, influenza, malaria, Spanish influenza, swine flu, tuberculosis, typhus, yellow fever, and zika, collecting 369,472 tweets from the 3rd of March to the 15th of September, 2022. Our analysis has started with the collection of comments composed of unstructured texts on which we have applied natural language processing solutions. Afterward, we have employed topic modelling and sentiment analysis techniques to obtain a collection of people’s concerns and attitudes toward these pandemics. According to our findings, people's discussions were mostly about malaria, influenza, and tuberculosis and the focus was on the diseases themselves. As regards emotions, the most popular were fear, trust, and disgust where trust is mainly regarding HIV/AIDS tweets.

This paper documents the development of a special case of multilingual Automatic Speech Recognition model, specifically tailored to attend two languages spoken by the majority of Latin America, Portuguese and Spanish. The bilingual model combines Language Identification and Speech Recognition developed with the Wav2Vec2.0 architecture and trained on several open and private speech datasets. In this model, the feature encoder is trained jointly for all tasks and different context encoders are trained for each task. The model is evaluated separately on two tasks: language identification and speech recognition. The results indicate that this model achieves good performance on speech recognition and average performance on language identification, training on a low quantity of speech material. The average accuracy of the language identification module on the MLS dataset is 66.75%. The average Word Error Rate in the same scenario is 13.89%, which is better than average 22.58% achieved by the commercial speech recognizer developed by Google.

We live in the information age and, ironically, meeting the core function of journalism – i.e., to provide people access to unbiased information – has never been more difficult. This paper explores deep journalism, our data-driven Artificial Intelligence (AI) based journalism approach to study how the LinkedIn media could be useful for journalism. Specifically, we apply our deep journalism approach to LinkedIn to automatically extract and analyse big data to provide the public with information about labour markets, people’s skills and education, and businesses and industries from multi-generational perspectives. The Great Resignation and Quiet Quitting phenomena coupled with rapidly changing generational attitudes are bringing unprecedented and uncertain changes to labour markets and our economies and societies, and hence the need for journalistic investigations into these topics is highly significant. We combine big data and machine learning to create a whole machine learning pipeline and a software tool for journalism that allows discovering parameters for age dynamics in labour markets using LinkedIn data. We collect a total of 57,000 posts from LinkedIn and use it to discover 15 parameters by Latent Dirichlet Allocation algorithm (LDA) and group them into five macro-parameters, namely Generations-Specific Issues, Skills & Qualifications, Employment Sectors, Consumer Industries, and Employment Issues. The journalism approach used in this paper can automatically discover and make objective, cross-sectional, and multi-perspective information available to all. It can bring rigour to journalism by making it easy to generate information using machine learning and can make tools and information available so that anyone can uncover information about matters of public importance. This work is novel since none of the earlier works have reported such an approach and tool and leveraged it to use LinkedIn media for journalism and to discover multigenerational perspectives (parameters) for age dynamics in labour markets. The approach could be extended with additional AI tools and other media.

There is a strong need and demand from the United Nations, public institutions, and private sector for classifying government publications, policy briefs, academic literature, and corporate social responsibility reports according to their relevance to the Sustainable Development Goals (SDGs). It is well understood that the SDGs play a major role in the strategic objectives of various entities. However, linking projects and activities to the SDGs has not always been straightforward or possible with existing methodologies. Natural language processing (NLP) techniques offer a new avenue to identify linkages for SDGs from text data. This research examines various machine learning approaches optimized for NLP-based text classification tasks for their success in classifying reports according to their relevance to the SDGs. Extensive experiments have been performed with the recently released Open Source SDG (OSDG) Community Dataset, which contains texts with their related SDG label as validated by the community volunteers. Results demonstrate that especially RoBERTa achieves very high performance in the attempted task, which is promising for automated processing of large collections of sustainability reports for detection of relevance to SDGs.

Retweet prediction is an important task related to different problems such as information spreading analysis, the automatic detection of fake news, social media monitoring, etc. In this study we explore the possibilities of retweet prediction based on heterogeneous data sources. In order to classify the tweet according to the amount of retweets, we combine features extracted from the multilayer network and the text. More specifically, we introduce a multilayer framework that proposes the multilayer network representation of Twitter. This formalism captures different users' actions and complex relationships as well as other key properties of communication on Twitter. We select a set of local network measures from each layer and construct a set of multilayer network features. In addition, we adopt a BERT-based language model, namely Cro-CoV-cseBERT to capture high-level semantics and structure of tweets as a set of text features. Then, we train six machine learning (ML) algorithms: random forest, multilayer perceptron, light gradient boosting machine, category embedding model, neural oblivious decision ensembles and attentive interpretable tabular learning model in the task of retweet prediction. We compare the performance of all six algorithms in three different setups (i) using only text features, (ii) using only multilayer network features and (iii) using both sets of features. We evaluate all setups in terms of standard evaluation measures i.e. precision, recall, F1-score and accuracy. For this task, we first prepare and use an empirical dataset of 199,431 tweets in the Croatian language posted during the period between January 1, 2020 and May 31, 2021. Our results indicate that by integrating multilayer network features with text features the prediction model would perform better than using just one set of features.

The ability to identify and rank risk is essential for efficient and effective supervision of financial service firms, such as banks and insurers. Risk ranking ensures limited resources are allocated where they are most needed. Today, automatic risk identification within insurance supervision primarily relies on quantitative metrics based on numerical data (e.g. returns). The purpose of this work is to assess whether Natural Language Processing (NLP) and cognitive networks can achieve similar automated risk ranking and identification by analysing textual data, i.e. NIDT=829 investor transcripts from Bloomberg. To this aim, this work explores and tunes 3 NLP techniques: (1) keyword extraction enhanced by cognitive network analysis; (2) valence/sentiment analysis; and (3) topic modelling. Results highlight that keyword analysis, enriched by term frequency-inverse document frequency scores and semantic framing through cognitive networks, could detect events of relevance for the insurance system like cyber-attacks or the COVID-19 pandemic. Cognitive networks were found to highlight events that related to specific financial transitions: The semantic frame of "climate" grew in size by +538% between 2018 and 2020 and outlined an increased awareness that agents and insurers expressed towards climate change. A lexicon-based sentiment analysis achieved a Pearson’s correlation of ρ=0.16 (p&lt;0.001,N=829) between sentiment levels and daily share prices. Although relatively weak, this finding indicates that insurance jargon is insightful to support risk supervision. Topic modelling is considered less amenable to support supervision, because of a lack of results’ stability and an intrinsic difficulty to interpret risk patterns. We discuss how these automatic methods could complement existing supervisory tools in automated risk ranking.

Version Control and Source Code Management Systems, such as GitHub, contain large amount ofunstructured historical information of software projects. Recent studies have introduced Natural Language Processing (NLP) to help software engineers retrieve information from very large collection of unstructured data. In this study, we have extended our previous study by increasing our datasets and ML and clustering techniques. Method: We have followed a complex methodology made up of various steps. Starting from the raw commit messages we have employed NLP techniques to build a structured database. We have extracted their main features and used as input of different clustering algorithms. Once labelled each entry, we have applied supervised machine learning techniques to build a prediction and classification model. Results: We have developed a machine learning-based model to automatically classify commit messages of a software project. Our model exploits a ground-truth dataset which includes commit messages obtained from various GitHub projects belonging to the HEP context. Conclusions: The contribution of this paper is two-fold: it proposes a ground-truth database; it provides a machine learning prediction model. They automatically identify the more change-proneness areas of code. Our model has obtained a very high average precision, recall and F1-score.

Micro-level language policy and planning (LPP) primarily concerns local actors' decision-making on matters in relation to language(s) and its users. Despite a growing body of literature focusing on micro language planning in educational settings, there is a scarcity of research examining early childhood education settings such as micro-level LPP context for young English language learners. By adopting a case study approach, the present study examined the educators' enactment of agency in micro-planning the English language education policy (LEP) in one Chinese kindergarten and the associated factors shaping their agency. Our study revealed that the sustainable implementation of the kindergarten English LEP depended on the principal, native English-speaking teachers, and the Chinese assistant teachers' different degrees of agency. Also, the research findings indicated an array of contextual and individual factors nested in a hierarchical structure that facilitated, guided, and constrained the educators' agency in a role-and circumstance-dependent manner. This study contributes to the pertinent literature by casting nuanced light on the different educators' contributions to the micro-level LPP against a national policy that does not endorse early-year English language education.

A novel hypothesis concerning language evolution is advanced. It posits that languages have evolved as a means of binding individuals to a group, as well as for defining those groups. This means that language evolution has to be considered on the level of groups and not only on the level of individuals. This hypothesis helps to explain the huge diversity of human languages, as well as their complexity. Perhaps more importantly, it explains why adults lose the ability to learn languages with the ease that children possess.

Evolutionary perspectives have generated many questions and some answers in the study of human health and disease. The field of evolutionary medicine, and related analytics of evolutionary psychiatry and evolutionary psychology have extended and expanded the way health disorders are viewed by searching for why humans, as a species, are vulnerable to certain pathological conditions. The search is organized into four domains that apply proximate and evolutionary explanations to human traits and developmental sequences. This framework opens inquiry to the ontogeny, phylogeny, mechanism, and adaptive significance of human health conditions. In this paper I argue that evolutionary medicine seems to parallel biomedicine in its primarily pathogenic focus. That is, conditions of pain, suffering, and disorder have received the most attention. Some work has used the architecture of evolutionary medicine to take a salutogenic approach, evaluating the proximate and evolutionary explanations of human well-being. I propose that an evolutionary understanding of human well-being requires a survey of emotions and their relationship with neurobiology, language, and culture. My anthropology based, multidisciplinary review of biopsychosocial processes reveals the way evolution has shaped modern human understanding of well-being through sociolinguistic learning processes and thereby our individual experiences of well-being. These insights have the power to contextualize human suffering and flourishing as we progress toward the goal of attenuating the former and expanding the latter.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

Hallyu or the Korean wave has sweeped through nations especially the Philippines. This exploratory study offers a dip into the effects of the Hallyu wave on a Filipino speaker through ambient exposure, consequently on the development of a Korean proto-lexicon through indirect vocabulary acquisition. Finally, a focus group discussion and a preliminary assessment tested out the waters of the effects of Hallyu on casual Filipino speakers. A thorough statistically comprehensive qualitative study on the acquisition framework is recommended to provide substantial evidence to support the framework.

Technological advancements and innovations have profoundly changed the lives of people giving rise to smart environments, cities, and societies. As homes are the building block of cities and societies, smart homes are critical to establishing smart living and are expected to play a key role in enabling smart cities and societies. The current academic literature and commercial advancements on smart homes have mainly focused on developing and providing smart functions for homes to provide security management and facilitate the residents in their various activities such as ambiance management. Homes are much more than physical structures, buildings, appliances, operational machines, and systems. Homes are composed of families and are inherently complex phenomena underlined by humans and their relationships with each other, subject to individual, intragroup, intergroup, and intercommunity goals. There is a clear need to understand, define, consolidate existing research, and actualize the overarching roles of smart homes, the roles of smart homes that would serve the needs of future smart cities and societies. This paper introduces our data-driven parameter discovery methodology and uses it to provide, for the first time, an extensive, rather fairly comprehensive, analysis of the families and homes landscape seen through the eyes of academics and the public using over a hundred thousand research papers and nearly a million tweets. We develop a methodology using deep learning, natural language processing (NLP), and big data analytics methods and apply it to automatically discover parameters that capture a comprehensive knowledge and design space of smart families and homes comprising social, political, economic, environmental, and other dimensions. The 66 discovered parameters and the knowledge space comprising 100s of dimensions are explained by reviewing and referencing over 300 articles from the academic literature and tweets. The knowledge and parameters discovered in this paper can be used to develop a holistic understanding of matters related to families and homes facilitating the development of better, community-specific, policies, technologies, solutions, and industries for families and homes, leading to strengthening families and homes, and in turn, empowering sustainable societies across the globe.

Emergent physics education research (PER) literatures have been disseminated through academic publications within the community. The growing body of literatures over years challenge Indonesian PER scholars to understand how the research community has been progressed and what possible future work that should be emphasized. Nevertheless, previous traditional method of thematic analysis performed serious limitation when the number of PER literatures exponentially increased. Dealing with this large volume of publications, one of the machine learning studies namely natural language processing (NLP) was employed in this study to automate our thematic analysis among Indonesian PER literatures that are still limited to be explored. One of the well-known NLP algorithm, latent Dirichlet allocation (LDA), has been performed to extract Indonesian PER topics and their associated development between 2014 and 2021. A total of 852 papers (~ 4 to 8 pages each) were collectively downloaded from five international conference proceedings organized by Indonesian PER researchers. Before their topics were modeled through LDA algorithm, our data corpus should be previously preprocessed through several common procedures of established NLP studies. Findings revealed that LDA has thematically quantified Indonesian PER topics and described their distinct development over certain period. The identified topics from this study demonstrated that Indonesian PER community has established robust development in eight distinctive topics to the present. They begin with initial interest in focusing research on physics laboratory and following the research based instruction in the late 2015. Indonesian PER scholars sustained to study continuous topic on 21st century skill until 2019 which gave way to a focus on developing relevant educational technology to address several forms of students’ performance including scientific literacy and problem solving. There is still lack of Indonesian PER literatures that have been attempted to address qualitative aspects of physics teaching and learning.

This paper presents an approach to the application of the Model-Based Systems Engineering (MBSE) and Model-Based Systems Architecting (MBSA) principles to develop a Model-Based Pattern Language (MBPL). It takes too long for systems engineers and architects to develop a new system from scratch, particularly new space-based systems derived from the existing space systems architectures. A pattern language is a holistic view of reusable logical model artifacts; many are interdisciplinary and introductory, if at all. The results are mostly a combination of the application-specific logical solution, which further results in the best possible overall solution. The main benefit of the pattern language is reducing the time and validation required to generate a new space-based system architecture; this approach will develop top-level requirements in the initial phase of the system development. The rationale of the methodology proposed by the paper is as follows, collect, and decompose published literature and other open-source information available on space system architectures and system models; develop SysML models for systems, subsystems, products, assembly, subassembly level, and mission-specific requirements using CAMEO SysML software. Arrange these patterns to develop a functional ontology and construct a logical architecture pattern library. This approach created, updated, and managed SysML pattern language, which evaluated the expedited new model construction. Again, our objective is to develop a logical pattern language using public domain information and evaluate patterns by constructing a new space mission concept—for example, planetary surface habitat.

The exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications and diverse use-cases in assisted living, military, healthcare, firefighting, and industry 4.0. The exoskeleton market is projected to increase by multiple times of its current value within the next two years. Therefore, it is crucial to study the degree and trends of user interest, views, opinions, perspectives, attitudes, acceptance, feedback, engagement, buying behavior, and satisfaction, towards exoskeletons, for which the availability of Big Data of conversations about exoskeletons is necessary. The Internet of Everything style of today's living, characterized by people spending more time on the internet than ever before, with a specific focus on social media platforms, holds the potential for the development of such a dataset, by the mining of relevant social media conversations. Twitter, one such social media platform, is highly popular amongst all age groups, where the topics found in the conversation paradigms include emerging technologies such as exoskeletons. To address this research challenge, this work makes two scientific contributions to this field. First, it presents an open-access dataset of about 140,000 tweets about exoskeletons that were posted in a 5-year period from May 21, 2017, to May 21, 2022. Second, based on a comprehensive review of the recent works in the fields of Big Data, Natural Language Processing, Information Retrieval, Data Mining, Pattern Recognition, and Artificial Intelligence that may be applied to relevant Twitter data for advancing research, innovation, and discovery in the field of exoskeleton research, a total of 100 Research Questions are presented for researchers to study, analyze, evaluate, ideate, and investigate based on this dataset.

The notion of information and complexity are important concepts in many scientific fields such as molecular biology, evolutionary theory, and exobiology. Many measures of these quantities, either rely on a statistical notion of information, are difficult to compute, or can only be applied to strings. Based on assembly theory, we propose the notion of a \textit{ladderpath}, which describes how an object can be decomposed into a hierarchical structure using repetitive elements. From the ladderpath two measures naturally emerge: the ladderpath-index and the order-index, which represent two axes of complexity. We show how the ladderpath approach can be applied to both strings and spatial patterns and argue that all systems that undergo evolution can be described as ladderpaths. Further, we discuss possible applications to human language and the origins of life. The ladderpath approach provides a novel characterization of the information that is contained in a single object (or a system) and could aid in our understanding of evolving systems and the origin of life in particular.

Objective: Food security during public health emergencies relies on situational awareness of needs and resources. Artificial intelligence (AI) has revolutionized situational awareness during crises, allowing the allocation of resources to needs through machine learning algorithms. Limited research exists monitoring Twitter for changes in the food security-related public discourse during the COVID-19 pandemic. We aim to address that gap with AI by classifying food security topics on Twitter and showing topic frequency per day. Methods: Tweets were scraped from Twitter from January 2020 through December 2021 using food security keywords. Latent Dirichlet Allocation (LDA) topic modeling was performed, followed by time-series analyses on topic frequency per day.Results: 237,107 tweets were scraped and classified into topics, including food needs and resources, emergency preparedness and response, and mental/physical health. After the WHO’s pandemic declaration, there were relative increases in topic density per day regarding food pantries, food banks, economic and food security crises, essential services, and emergency preparedness advice. Threats to food security in Tigray emerged in 2021.Conclusions: AI is a powerful yet underused tool to monitor food insecurity on social media. Machine learning tools to improve emergency response should be prioritized, along with measurement of impact. Further food insecurity word patterns testing, as generated by this research, with supervised machine learning models can accelerate the uptake of these tools by policymakers and aid organizations.

This paper presents the findings of an exploratory study on the continuously generating Big Data on Twitter related to the sharing of information, news, views, opinions, ideas, knowledge, feedback, and experiences about the COVID-19 pandemic, with a specific focus on the Omicron variant, which is the globally dominant variant of SARS-CoV-2 at this time. A total of 12028 tweets about the Omicron variant were studied, and the specific characteristics of tweets that were analyzed include - sentiment, language, source, type, and embedded URLs. The findings of this study are manifold. First, from sentiment analysis, it was observed that 50.5% of tweets had the ‘neutral’ emotion. The other emotions - ‘bad’, ‘good’, ‘terrible’, and ‘great’ were found in 15.6%, 14.0%, 12.5%, and 7.5% of the tweets, respectively. Second, the findings of language interpretation showed that 65.9% of the tweets were posted in English. It was followed by Spanish or Castillian, French, Italian, Japanese, and other languages, which were found in 10.5%, 5.1%, 3.3%, 2.5%, and <2% of the tweets, respectively. Third, the findings from source tracking showed that “Twitter for Android” was associated with 35.2% of tweets. It was followed by “Twitter Web App”, “Twitter for iPhone”, “Twitter for iPad”, “TweetDeck”, and all other sources that accounted for 29.2%, 25.8%, 3.8%, 1.6%, and <1% of the tweets, respectively. Fourth, studying the type of tweets revealed that retweets accounted for 60.8% of the tweets, it was followed by original tweets and replies that accounted for 19.8% and 19.4% of the tweets, respectively. Fifth, in terms of embedded URL analysis, the most common domains embedded in the tweets were found to be twitter.com, which was followed by biorxiv.org, nature.com, wapo.st, nzherald.co.nz, recvprofits.com, science.org, and other URLs. Finally, to support similar research and development in this field centered around the analysis of tweets, we have developed an open-access Twitter dataset that comprises tweets about the SARS-CoV-2 omicron variant since the first detected case of this variant on November 24, 2021.

This paper investigates if Corporate Social Responsibility (CSR) reports published by a selected group of Nordic companies are aligned with the Global Reporting Initiative (GRI) standards. To achieve this goal, several natural language processing, and text mining techniques were implemented and tested. We extracted strings, corpus, and hybrid semantic similarities from the reports and evaluated the models through the intrinsic assessment methodology. A quantitative ranking score based on index matching was developed to complement the semantic valuation. The final results show that Latent Semantic Analysis (LSA) and Global Vectors for Word Representation (GloVE) are the best methods for our study. Our findings will open the door to the automatic evaluation of sustainability reports which could have a strong impact on the environment.

Background: In the present study, we assessed the feasibility and success outcomes of voice prosthesis (VP) changes when performed by speech-language pathologist (SLP). Methods: Patients treated with total laryngectomy (TL) from January 2020 to December 2020 were prospectively recruited from our medical center. Patients benefited from tracheoesophageal puncture. The VP changes were performed by the senior SLP and the following data were collected for each VP change: date of placement; change or removal; VP type and size; reason for change or removal; and use of a washer for periprosthetic leakage. A patient-reported outcome questionnaire including 6 items was proposed to patients at each VP change (Appendix 1). Items were assessed with a 10-point Likert-scale. Results: Fifty-two VP changes were performed by the senior SLP during the study period. The mean duration of the SLP consultation, including patient history, examination and VP change procedure was 20 min (range: 15-30). The median prosthesis lifetime was 88 days. The main reasons for VP changes were transprosthetic (N=34; 79%) and periprosthetic (N=7; 21%) leakages, respectively. SLP successfully performed all VP changes. He did not change one VP but used a periprosthetic silastic to stop the periprosthetic leakages. In two cases, SLP needed the surgeon examination to discuss about the following indication: implant mucosa inclusion and autologous fat injection. The patient satisfaction was high according to the speed and the quality of care by the SLP. Conclusion: The delegation of VP change from the otolaryngologist-head and neck sur-geon to the speech-language pathologist (SLP) may be done without significant complications. The delegation of VP change procedure to SLP may be interesting in some rural regions with otolaryngologist shortage.

Context: Anomaly detection in a data center is a challenging task, having to consider different services on various resources. Current literature shows the application of artificial intelligence techniques to either log files or monitoring data: the former created by services at run time, while the latter produced by specific sensors directly on the physical or virtual machine. Objectives: We propose a model that exploits information both in log files and monitoring data to identify patterns and detect anomalies over time. Methods: The key idea is to use on one side natural language processing solutions to detect problems at service level, extracting words that represent anomalies. Clustering and topic modeling techniques have been used to identify patterns and group them with respect to topics. On the other side time series anomaly detection technique has been applied to sensors data in order to combine problems found in the log files with problems stored in the monitoring data. Results: We have tested our approach on a real data center equipped with log files and monitoring data that can characterize the behaviour of physical and virtual resources in production. We have observed a correspondence between anomalies in log files and monitoring data, e.g. an increase in memory usage or machine load. The results are extremely promising. Conclusion: Our model requires to integrate site administrators' expertise in order to consider all critical scenario in the data center and understand results properly.

We present improvements in n-best rescoring of code-switched speech achieved by n-gram augmentation as well as optimised pretraining of long short-term memory (LSTM) language models with larger corpora of out-of-domain monolingual text. In addition, we consider the application of large pretrained transformer-based architectures. Our experimental evaluation is performed on an under-resourced corpus of code-switched speech comprising four bilingual code-switched sub-corpora, each containing a Bantu language (isiZulu, isiXhosa, Sesotho, or Setswana) and English. We find in our experiments that, by combining n-gram augmentation with the optimised pretraining strategy, speech recognition errors are reduced for each individual bilingual pair by 3.51% absolute on average over the four corpora. Importantly, we find that even speech recognition at language boundaries improves by 1.14% even though the additional data is monolingual. Utilising the augmented n-grams for lattice generation, we then contrast these improvements with those achieved after fine-tuning pretrained transformer-based models such as distilled GPT-2 and M-BERT. We find that, even though these language models have not been trained on any of our target languages, they can improve speech recognition performance even in zero-shot settings. After fine-tuning on in-domain data, these large architectures offer further improvements, achieving a 4.45% absolute decrease in overall speech recognition errors and a 3.52% improvement over language boundaries. Finally, a combination of the optimised LSTM and fine-tuned BERT models achieves a further gain of 0.47% absolute on average for three of the four language pairs compared to M-BERT. We conclude that the careful optimisation of the pretraining strategy used for neural network language models can offer worthwhile improvements in speech recognition accuracy even at language switches, and that much larger state-of-the-art architectures such as GPT-2 and M-BERT promise even further gains.

Stop words are very important for information retrieval and text analysis investigation. This study aimed to automatically analyze and detect stop words in texts in the Uzbek language. Because of the limited availability of methods for automatic search of stop words of texts in Uzbek we analyzed a newly prepared corpus. The Uzbek language belongs to the family of agglutinative languages. As with all agglutinative languages, we can explain that the detection of stop words in Uzbek texts is a more complex process than in inflected languages: In inflected languages, words such as auxiliary words, articles, prepositions can be included in the stop words group. In agglutinative languages, the meanings of such words are hidden in the text. Therefore, it is not appropriate to apply all known methods of stop words detection in inflected languages directly to agglutinative languages. In this work, the “School corpus” which contains 731156 Uzbek words has been investigated. The bigram method of analysis was applied to the corpus. We proposed the collocation method of detecting stop words of the corpus. We proposed the method of automatically detecting stop words of texts in Uzbek. It is shown that the collocation method is 6 times better than the bigram method.

With the rapid development of science and technology, many new concepts and terms appear, especially in English. Other languages try to express these concepts with words from their own vocabulary. In the specific case of Arabic, there are many ways to find a counterpart for a particular new concept, such as using an existing word to denote the new concept, derivation, and blending. When these methods fail, the new concepts are simply phonetically transliterated. This has the disadvantage that most of the transliterated terms do not conform to the rules of the Arabic language and lead to a distortion of the language. Some modern linguists call for using the generation strategy to translate the new terms into Arabic by using the unused Arabic roots. Therefore, it is necessary to provide a resource that contains all Arabic roots with a categorization of what is used, what is available for use, and what is rejected according to the phonetic system. This work provides a comprehensive lexicon that contains all possible Arabic triliteral roots, determines the status of each root in terms of usage and acceptability, and provides a mechanism for giving preference to roots when there is more than one root that indicates the desired meaning.

With the rapid development of science and technology, many new concepts and terms appear, especially in English. Other languages try to express these concepts with words from their own vocabulary. In the specific case of Arabic, there are many ways to find a counterpart for a particular new concept, such as using an existing word to denote the new concept, derivation, and blending. When these methods fail, the new concepts are simply phonetically transliterated. This has the disadvantage that most of the transliterated terms do not conform to the rules of the Arabic language and lead to a distortion of the language. Some modern linguists call for using the generation strategy to translate the new terms into Arabic by using the unused Arabic roots. Therefore, it is necessary to provide a resource that contains all Arabic roots with a categorization of what is used, what is available for use, and what is rejected according to the phonetic system. This work provides a comprehensive lexicon that contains all possible Arabic triliteral roots, determines the status of each root in terms of usage and acceptability, and provides a mechanism for giving preference to roots when there is more than one root that indicates the desired meaning.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

Risk management of electric power transmission lines requires knowledge from different areas such as environment, land, investors, regulations, and engineering. Despite the widespread availability of databases for most of those areas, integrating them into a single database or model is a challenging problem. Instead, in this paper, we use a single source, the Brazilian National Electric Energy Agency’s (ANEEL) weekly reports, which contains decisions about the electrical grid, comprising most of the areas. Since the data is unstructured (text), we employed NLP techniques such as stemming and tokenization to identify keywords related to common causes of risks provided by an expert group on energy transmission. Then, we used models to estimate the probability of each risk. Our results show that we were able to estimate the probability of 97 risks out of 233.

Recent research has suggested that working memory training interventions may benefit children with Developmental Language Disorder (DLD). The current study investigated a short and engaging adaptive working memory intervention that targeted executive skills and aimed to improve both language comprehension and working memory abilities in children with DLD. Forty-seven 6- to 10-year-old children with DLD were randomly allocated to an executive working memory training intervention (n=24) or an active control group (n=23). A pre-test/intervention/post-test/9-month-follow-up design was used. Outcome measures included assessments of language (to evaluate far transfer of the training) and working memory (to evaluate near transfer of the training). Hierarchical multiple regression analyses controlling for pre-intervention performance and age found group to be a significant predictor of sentence comprehension and of performance on six untrained working memory measures at post-intervention and 9-month follow-up. Children in the intervention group showed significantly higher language comprehension and working memory scores at both time points than children in the active control group. The intervention programme showed potential to improve working memory and language comprehension in children with DLD and demonstrated several advantages: it involved short sessions over a short period; caused little disruption in the school day; and was enjoyed by children.

A Twi-English parallel corpus is certainly an important resource for Machine Translation of Twi (ISO 639-3), a Low-Resource African Language (LRAL) which is mainly spoken in Ghana and Ivory Coast. Currently large-scale multi-domain Twi-English parallel corpus is still unavailable partly due to the difficulties and the arduous efforts required in its design. In this paper, we present TWIENG: a large-scale multi-domain Twi-English parallel corpus. We crawled the sentences from the web using web crawlers, translated, aligned, tokenized and compiled to create the corpus. We crawled English sentences from Ghanaian indigenous electronic news portals, Ghanaian Parliamentary Hansards, Twi Bible and crowdsourcing via google forms. The sentences were translated by professional translators and linguists, they were then aligned, tokenized and compiled. The corpus was curated using the sketch engine, a corpus manager and analysis software developed by Lexical Computing Limited. The corpus was manually evaluated by Twi professional linguists. The Corpus has 5,419 parallel sentences.

Many children have suspected delayed language development and need extensive support from parents and the health care team. This study aimed to investigate suspected delayed language development and factors associated with suspected delayed language development among early childhood in Southern Thailand. Children aged 24 to 60 months were recruited as study samples using stratified random sampling conducted in 23 districts and simple randomized seven sections (425 children). Instruments comprised demographic data of the children and families, The preschool temperament questionnaire, and the Language Development Screening questionnaire using developmental surveillance and promotion manual. I was collecting data from July 2020 to January 2021. Data analysis used descriptive statistics and logistic regression. The results showed that 40.9 percent suspected delayed development. Daily screen time exceeding 2 hours per day (A.O.R. = 17.30, 95% CI: 7.35-40.72), and regarding a child's temperament, moderate-to-difficult temperament (A.O.R. = 9.56, 95% CI: 5.12-17.85) were significantly associated with a suspected delay of language development. The study suggested two-way communication and appropriate responses will help develop children's language.

We live in a complex world characterised by complex people, complex times, and complex social, technological, and ecological environments. There is clear evidence that governments are failing at most public matters. The recent COVID-19 pandemic is a high example of global governance failure both at preventing such pandemics and managing the COVID-19 pandemic. It is time that all of us take responsibility and look into ways of collaboratively improving the governance of public matters, our matters. While there are many reasons for government failures, we believe the lack of information availability is a fundamental reason that limits the government’s ability to act smartly and allows the lack of transparency to creep into policy and action leading to corruption and failure. To this end, this paper introduces the concept of deep journalism, a data-driven deep learning-based approach for discovering multi-perspective parameters related to a topic of interest. We build three datasets (a newspaper, a technology magazine, and a Web of Science dataset) and discover the academic, industrial, public, governance, and political parameters for the transportation sector as a case study to introduce deep journalism and our tool DeepJournal (Version 1.0) that implements our proposed approach. We elaborate on 89 transportation parameters and hundreds of dimensions reviewing 400 technical, academic, and news articles. The findings related to the multi-perspective view of transportation reported in this paper show that there are many important problems seen by the public that industry and academia seem to not place their focus on. On the other hand, academia produces much broader and deeper knowledge on the subject such as a wide range of pollutions affecting the people and planet do not get to reach the public eye. Our deep journalism approach could find the gaps and highlight them to the public and other stakeholders.

Arabic is present in the Arab world and beyond. It is used as an official (or co-official) language in the Arab World (this refers to the twenty-two member states of the Arab League). Also, Arabic has the status of a national language in Mali, Niger, and Senegal. Besides, it is spoken in linguistic enclaves in Nigeria, Cyprus, Turkey, Uzbekistan, Iran, and Afghanistan. In addition, it is employed as the liturgical language in Muslim countries and countries with a Muslim minority all over Africa and Asia. As a result of the migration to Western countries since the end of the nineteenth century, Arabs and Arabic has been present in such countries. The presence of Arabs in Western countries raises the following question: Are these Arabs language maintainers or language shifters? The present article is an attempt to answer this question through reviewing a number of studies that have dealt with Arabic language maintenance among the Arabs living in Western countries (namely the United States of America, the United Kingdom, Canada, Australia, New Zealand, Sweden, Greece, and France), deducing from these studies the major trends in Arabic language maintenance among these Arabs, and providing a critique of the studies.

Social media platforms have been entirely an undeniable part of the lifestyle for the past decade. Analyzing the information being shared is a crucial step to understanding human behavior. Social media analysis aims to guarantee a better experience for the user and risen user satisfaction. For deriving any further conclusion, first, it is necessary to know how to compare users. In this paper, a hybrid model has been proposed to measure Twitter profiles’ similarity and quantifies the likeness degree of profiles by calculating features considering users’ behavioral habits. For this, first, the timeline of each profile has been extracted using the official TwitterAPI. Then, in parallel, three aspects of a profile are deliberated. Behavioral ratios are time-series-related information showing the consistency and habits of the user. Dynamic time warping has been utilized to compare the behavioral ratios of two profiles. Next, the audience network is extracted for each user, and for estimating the similarity of two sets, Jaccard similarity is used. Finally, for the Content similarity measurement, the tweets are preprocessed respecting the feature extraction method; TF-IDF and DistilBERT for feature extraction are employed and then compared using the cosine similarity method. Results have shown that TF-IDF has slightly better performance; therefore, the more straightforward solution is selected for the model. Similarity level of different profiles. As in the case study, a Random Forest classification model was trained on almost 20000 users revealed a 97.24% accuracy. This comparison enables us to find duplicate profiles with nearly the same behavior and content.

Abstract: Understanding social media networks and group interactions are crucial to the ad-vancement of linguistic and cultural behaviour. This includes the manner in which people ac-cessed advice on health, especially during the global lockdown periods. Some people turned to social media to access information on health where most activities were curtailed with isolation rules, especially for older generations. Facebook public pages, groups and verified profiles, using "senior citizen health", "older generations", and "healthy living" keywords were analysed over a 12-month period to analyse the engagement promoting good mental health. CrowdTangle was used to source English language status updates, photo and video sharing information which resulted in an initial 116,321 posts and 6,462,065 interactions Data analysis and visualisation were used to explore large datasets, including natural language processing for “Message” content discovery, word frequency and correlational analysis and co-word clustering. Preliminary results indicate strong links to healthy aging information shared on social media which showed correla-tions to global daily confirmed case and daily death totals. The results can be used to identify public concerns early on and address mental health issues in the senior generation on Facebook.

During the last two years the COVID-19 pandemic has affected the world population in several ways. An important increase in mental health problems is a consequence of this pandemic that is ubiquitous worldwide. In this work we study the effect of the pandemic on the mental health of a population of teenagers and youth based on the analysis of natural language processing, machine learning algorithms and expert knowledge. The data analysed was obtained from a chat helpline called Safe time from theIt Get’s Better Foundation in Chile. The data consists of 10,986 conversations gathered from 2018 until 2020 between volunteers from the foundation and users of the platform. We compared the conversationsbefore and during the pandemic in terms of their thematic content. Our analysis found: a significantdecrease in self-image appreciation during the pandemic; a significant decrease in the quality of personalrelationships during the pandemic, and a significant increase of performance appreciation.

As Christopher Alexander discovered, all space or matter – either organic or inorganic – has some degree of order in it according to its structure and arrangement. The order refers to a kind of structural character, called living structure, which is defined as a mathematical structure that consists of numerous substructures with an inherent hierarchy. Across the hierarchy, there are far more small substructures than large ones, while on each level of the hierarchy the substructures are more or less similar in size. In this paper we develop a new approach to representing geographic space as a hierarchy of recursively defined subspaces for computing the degree of order. A geographic space is first represented as a hierarchy of recursively defined subspaces, and all the subspaces are then topologically represented as a network for computing the degree of order of the geographic space, as well as that of its subspaces. Unlike conventional geographic representations, which are mechanical in nature, this new geographic representation is organic, conceived, and developed under the third view of space; that is, space is neither lifeless nor neutral, but a living structure capable of being more living or less living. Thus, the order can also be referred to as life, beauty, coherence, or harmony. We applied the new representation to three urban environments, 253 patterns, and 35 black-white strips to verify it and to demonstrate advantages of the new approach and the new kind of order. We further discuss the implications of the approach and the order on geographic information science and sustainable urban planning.

At the end of 2018, a high school student asked a question in Zhihu community, claiming that he had proved Goldbach's conjecture. The problem caused an explosive reaction and a large number of users participated in the discussion. And has caused the widespread influence. On January 1, 2019, the questioner issued his "proof". His proof was soon proved wrong. The heated discussion caused by the incident contains a lot of information of social science analysis value. Therefore, we follow up the event in the first time and build a time series dataset for the event. Taking the questioner's "proof" as the dividing line, all the answers, comments, sub comments and user information of writing these texts before and after two days were recorded. This series of temporal information can reflect the dynamic features of the interaction between user opinions, and the impact of exogenous shocks (proof release) on community opinions. The dataset can be used not only for the demonstration of various social network analysis algorithms, but also for a series of natural language processing tasks such as fine-grained sentiment analysis for long texts, as well as multimodal tasks combining natural language processing and social network analysis. This paper introduces the characteristics and structure of the dataset, shows the visualization effect of social network, and uses the dataset train the benchmark model of emotion analysis.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

The classification of goods involved in international trade in Brazil is based on the Mercosur Common Nomenclature (NCM). The classification of these goods represents a real challenge due to the complexity involved in assigning the correct category codes especially considering the legal and fiscal implications of misclassification. This work focuses on the training of a classifier based on Bidirectional En-coder Representations from Transformers (BERT) for the tax classification of goods with NCM codes. In particular, this article presents results from using a specific Portuguese Language tuned BERT model as well results from using a Multilingual BERT. Experimental results justify the use of these models in the classification process and also that the language specific model has a slightly better performance.

This paper aims to provide an overview of the complete process in the development of a Domain-Specific Language (DSL). It explains the construction steps such as preliminary research, language implementation, and evaluation. Moreover, it provides details for different key components which are commonly found in the DSLs such as the abstraction layer, DSL metamodel, and the applications. It also explains the general limitations related to the Domain-Specific Languages for Workflows.

Nowadays, an analysis of virtual media to predict society’s reaction to any events or processes is a task of great relevance. Especially it concerns meaningful information on healthcare problems. Internet sources contain a large amount of pharmacologically meaningful information useful for pharmacovigilance purposes and repurposing drug use. An analysis of such a scale of information demands developing the methods that require the creation of a corpus with labeled relations among entities. Before, there have been no such Russian language datasets. This paper considers the first Russian language dataset where labeled entity pairs are divided into multiple contexts within a single text (by used drugs, by different users, by the cases of use, etc.), and a method based on the XLM-RoBERTa language model, previously trained on medical texts to evaluate the state-of-the-art accuracy for the task of indication of the four types of relationships among entities: ADR–Drugname, Drugname–Diseasename, Drugname–SourceInfoDrug, Diseasename–Indication. As shown based on the presented dataset from the Russian Drug Review Corpus, the developed method achieves the F1-score of 81.2% (obtained using cross-validation and averaged for the four types of relationships), which is 7.8% higher than the basic classifiers.

Thanks to rapid development of artificial intelligence technology in recent years, the current artificial intelligence technology is contributing to many part of society. Education, environment, medical care, military, tourism, economy, politics, etc. are having a very large impact on society as a whole. For example, in the field of education, there is an artificial intelligence tutoring system that automatically assigns tutors based on student's level. In the field of economics, there are quantitative investment methods that automatically analyze large amounts of data to find investment laws to create investment models or predict changes in financial markets. As such, artificial intelligence technology is being used in various fields. So, it is very important to know exactly what factors have an important influence on each field of artificial intelligence technology and how the relationship between each field is connected. Therefore, it is necessary to analyze artificial intelligence technology in each field. In this paper, we analyze patent documents related to artificial intelligence technology. We propose a method for keyword analysis within factors using artificial intelligence patent data sets for artificial intelligence technology analysis. This is a model that relies on feature engineering based on deep learning model named KeyBERT, and using vector space model. A case study of collecting and analyzing artificial intelligence patent data was conducted to show how the proposed model can be applied to real-world problems.

Psychedelics are drugs capable of eliciting profound alterations in the subjective experience of the users, sometimes with long-lasting consequences. Because of this, psychedelic research tends to focus on human subjects, given their capacity to construct detailed narratives about the contents of their consciousness experiences. In spite of its relevance, the interaction between serotonergic psychedelics and language production is comparatively understudied in the recent literature. This review is focused on two aspects of this interaction: how the acute effects of psychedelic drugs impact on speech organization regardless of its semantic content, and how to characterize the subjective effects of psychedelic drugs by analyzing the semantic content of written retrospective reports. We show that the computational characterization of language production is an emergent powerful tool to predict the therapeutic outcome of individual experiences, relate the effects elicited by psychedelics with those associated with other altered states of consciousness, draw comparisons between the psychedelic state and the symptomatology of certain psychiatric disorders, and investigate the neurochemical profile and mechanism of action of different psychedelic drugs. We conclude that researchers studying psychedelics can considerably expand the range of their potential scientific conclusions by analyzing brief interviews obtained before, during and after the acute effects. Finally, we list a series of questions and open problems that should be addressed to further consolidate this approach.

In the field of industrial process monitoring, more and more interest is being shown in specific process categories. These include time-varying processes, that is, those processes whereby the response one receives as output from the system depends on when the input signal is sent into it. There are many reasons for this process variability and such contexts are not always analyzed with this operational characteristic at their core. At the same time, interest in certain categories of techniques is also becoming more prominent, to meet certain application needs. Among these, clustering and unsupervised techniques in general are gaining ground. This is largely due to the difficulty of finding fault data with which to train, for example, supervised models. On the other hand, the clustering technique, on which this contribution focuses, also makes it possible to compensate for the lack of complete knowledge of the structure of the process itself. With these two considerations in mind, this contribution proposes a literature review on the topic of clustering applied in time-varying contexts, in the maintenance field. The aim is to present an overview of the main fields of study, the role of clustering in this context and the main clustering techniques used.

The review of previous works shows this study is the first attempt to analyse the lockdown effect using Natural Language Processing Techniques, particularly sentiment analysis methods applied at large scale. On the other hand, it is also the first of its kind to analyse the impact of COVID 19 on the university community jointly on staff and students and with a multi-country perspective. The main overall findings of this work show that the most often related words were family, anxiety, house and life. On another front, it has also been shown that staff have a slightly less negative perception of the consequences of COVID in their daily life. We have used artificial intelligence models like swivel embedding and the Multilayer Perceptron, as classification algorithms. The performance reached in terms of accuracy metric are 88.8% and 88.5%, for student and staff respectively. The main conclusion of our study is that higher education institutions and policymakers around the world may benefit from these findings while formulating policy recommendations and strategies to support students during this and any future pandemics.

This article propose a didactic, through games, tool based on information and communication technologies, in order to eliminate possible communication barriers and to promote the inclusion of students with hearing impairment in Physical Education classes. To this end, a dossier of traditional games has been developed. These are structured in turn into objectives, materials, organisation, graphic description and a QR code for each game. These codes are linked to different videos hosted on the YouTube platform, in which the explanation of the games, mentioned above, can be visualised graphically using sign language. The whole creative process is described in the article, as well as possible pedagogical applications of the use of the tools created for this purpose in other educational contexts.

Maintaining a healthy cyber society is a big challenge due to the users’ freedom of expression and behaving. It can be solved by monitoring and analyzing the users’ behavior and taking proper actions towards them. This research aims to present a platform that monitors the public content on Twitter by extracting tweet data. After maintaining the data, the users’ interactions are analyzed using Graph Analysis methods. Then the users’ behavioral patterns are analyzed by applying Metadata Analysis, in which the timeline of each profile is obtained; also, the time-series behavioral features of users are investigated. Then in the Abnormal Behavior Detection Filtering component, the interesting profiles are selected for further examinations. Finally, in the Contextual Analysis component, the contents will be analyzed using natural language processing techniques; A binary text classification model (SVM + TF-IDF with 88.89% accuracy) for detecting if the tweet is related to crime or not. Then, a sentiment analysis method is applied to the crime-related tweets to perform aspect-based sentiment analysis (DistilBERT + FFNN with 80% accuracy); because sharing positive opinions about a crime-related topic can threaten society. This platform aims to provide the end-user (Police) suggestions to control hate speech or terrorist propaganda.

A sparse language is a formal language such that the number of strings of length $n$ is bounded by a polynomial function of $n$. We create a class with the opposite definition, that is a class of languages that are dense instead of sparse. We define a dense language on $m$ as a formal language (a set of binary strings) where there exists a positive integer $n_{0}$ such that the counting of the number of strings of length $n \geq n_{0}$ in the language is greater than or equal to $2^{n - m}$ where $m$ is a real number and $0 < m \leq 1$. We call the complexity class of all dense languages on $m$ as $DENSE(m)$. We prove that there exists an $\textit{NP--complete}$ problem that belongs to $DENSE(m)$ for every possible value of $0 < m \leq 1$.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

The deep neural network - BERT model (Bidirectional Encoder Representations from Transformers) and the stocks cumulative abnormal return is used in this article to analyze the sentiment of financial texts. The proposed approach, unlike those used so far, does not require the creation of dictionaries, takes into account the broad context of words and their meaning in financial texts, eliminates the problem of ambiguity of words in various contexts, does not require manual labelling of data and is free from the subjective assessment of the researcher. The sentiment of financial texts in the meaning presented in this paper is directly related to the market reaction to the information contained in these texts. For texts belonging to one of the two classes (positive or negative) with the highest probability the BERT model gives the results of predictions with a precision level of 62.38% for the positive class and 55% for the negative class. The results at this level can be used in event study, market efficiency research, investment strategy development or support of investment analysts using fundamental analysis.

Personality is the most critical feature that tells us about an individual. It is the collection of the individual’s thoughts, opinions, emotions and more. Personality detection is an emerging field in research and Deep Learning models have only recently started being developed. There is a need for a larger dataset that is unbiased as the current dataset that is used is in the form of questionnaires that the individuals themselves answer, hence increasing the chance of unconscious bias. We have used the famous stream-of-consciousness essays collated by James Pennbaker and Laura King. We have used the Big Five Model often known as the five-factor model or OCEAN model. Document-level feature extraction has been performed using Google’s word2vec embeddings and Mairesse features. The processed data has been fed into a deep convolutional network and a binary classifier has been used to classify the presence or absence of the personality trait. Hold- out method has been used to evaluate the model, and the F1 score has been used as the performance metric.

In light of the self-simulation hypothesis, a simple form implementation of the principle of efficient language is discussed in a self-referential geometric quasicrystalline state sum model in three dimensions. Emergence is discussed in context of geometric state sum models.

Decision-making is a complex process of selecting an option from the given choices by analyzing the background information like risk, loss, and gain within the alternative options presented. It has been observed in earlier studies that people are prompt to make less rational decisions when choices are given in a language less known to them. Therefore, to understand the effect of languages on decision-making, we have questioned native Hindi speakers in French and English. French being the foreign language, and English as their second language. Thus, this effect of a non-native language brings to light the important role that the native language plays routinely in judgment and decision-making. In this paper, we developed a Neuropsychological assessment to decipher the effects on decision-making between choices when given in foreign language and second language in comparison with the native language of an individual, which is termed as foreign language effect(Fle). We have explored various possible situations to understand the foreign language effect(Fle) in decision-making and does this change translates when the decision is to be made in the second language. Our study concludes that the Foreign language is least affected by the intuitive biases, followed by the second language, and the native language is most affected by it.

Documenting cultural heritage by using artificial intelligence (AI) is crucial for preserving the memory of the past and a key point for future knowledge. However, modern AI technologies make use of statistical learners that lead to self-empiricist logic, which, unlike human minds, use learned non-symbolic representations. Nevertheless, it seems that it is not the right way to progress in AI. If we want to rely on AI for these tasks, it is essential to understand what lies behind these models. Among the ways to discover AI there are the senses and the intellect. We could consider AI as an intelligence. Intelligence has an essence, but we do not know whether it can be considered “something” or “someone”. Important issues in the analysis of AI concern the structure of symbols -operations with which the intellectual solution is carried out- and the search for strategic reference points, aspiring to create models with human-like intelligence. For many years, humans, seeing language as innate, have carried out symbolic theories. Everything seems to have skipped with the advent of Machine Learning. In this paper, after a long analysis of history, the rule-based and the learning-based vision, we propose KERMIT as a unit of investigation for a possible meeting point between the different learning theories. Finally, we propose a new vision of knowledge in AI models based on a combination of rules, learning and human knowledge.

Communication is indispensable for today's lifestyle, and thanks to technology, millions of people can communicate as quickly as possible. The effect of this breakthrough has transformed organizations to the degree that they generate billions of emails daily to facilitate their operations. There is implicit information behind this vast corpus of human-generated content that can be mined and used for their benefit. This paper tries to address the opportunity that email logs can bring to organizations and propose an approach to discover process models by combining supervised text classification and process mining. This framework consists of two main steps, text classification, and process mining. First, Emails will be classified with supervised machine learning, and to mine, the processes fuzzy Miner is used. To further investigate the application of this framework, we also applied this framework over a real-life dataset from a case study organization.

Language is an essential aspect of teaching and learning mathematics. It is necessary for communicating, transmission of concepts and ideas, and formation of meaning of mathematical concepts. In mathematics, besides symbols, which are usually common in different languages, words and expressions are used, which may invoke different concept images to students in various languages. Some words are used in mathematics and in everyday language with different meanings, while others are used only in mathematics or in mathematics and other disciplines in similar but non-identical ways. In Mathematical Analysis, the used vocabulary is gradually enhanced, and the concepts are defined in a more formal way. In the current study, the language used regarding mathematics of change is examined, focusing on rate of change and in relation to misconceptions of students.

We transformed the existing learning program Language Shower, which is used in some Norwegian day-care centers in the Grorud district of Oslo municipality, into a digital solution using an app for smartphone or tablet with the option for further enhancement of presentation by a NAO robot. The solution was tested in several iterations and multiple day-care centers over several weeks. Measurements of the children’s progress across learning sessions indicate a positive impact of the program using a robot as compared to the program without robot. In-situ observations and interviews with day care center staff confirmed the solution’s many advantages, but also revealed some important areas for improvement. In particular, the speech recognition needs to be more flexible and robust, and special measures have to be in place to handle children speaking simultaneously.

The realization of the third-generation artificial intelligence (AI) requires the evolution from perceptual intelligence to cognitive intelligence, where knowledge graphs may not meet the practical needs anymore. Based on the dual channel theory, cognitive graphs are established and developed through coordinating the implicit extraction module and the explicit reasoning module as well as integrating knowledge graphs, cognitive reasoning and logical expressions, which have achieved successes in multi-hop question answering. It is desired for cognitive graphs to be widely used in advanced AI applications such as large-scale knowledge representations and intelligent responses, promoting the development of Al dramatically. This review discusses cognitive graphs systematically and elaborately, including basic concepts, generations, theories and technologies. Moreover, we try to predict the development of cognitive intelligence in the short-term future and further enlighten more researches and studies.

Existing implementations of game design patterns have largely been confined to theoretical or research settings. Weaknesses in these implementations have prevented game design patterns from being properly evaluated as an educational and practical development tool. This paper examines these weaknesses, describes a method of developing and applying patterns that overcome the weaknesses, and evaluates use of the method for game design education and practice. Weaknesses in existing pattern implementations are: omission of design problems, presumption of functional completeness at the level of pattern languages, narrow topical focus, and lack of a concise, repeatable method for pattern production. Several features of the proposed method were specifically built to address these weaknesses, namely the pattern template, the process for connecting patterns into a language and assessing the language’s scope, a rubric for assessing pattern confidence and interconnectivity confidence, and pattern-building exercises. This method was applied in a classroom setting. Results, as assessed by the evaluation of student work, suggest that creating patterns/pattern languages is an effective pedagogical approach. De-signs produced using designer-created patterns closely align with existing design theory and are clearly understood by students. The above results may indicate that the path to gaining wider acceptance of pattern theory as a design framework within game design is not to produce a universal pattern language but to facilitate the creation of case-specific languages, by students and professional designers, that use a shared ontology and thus can be combined easily to solve the diverse sets of problems faced by these groups.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

A more sustainable society and economy also implies a more sustainable behavior in the consumption of financial products. A possible change in focus can come from the demand side, so that more sustainable consumption of financial products have to go hand to hand with financial literacy. However, financial literacy, potential favoring of this sustainable behavior, is far from reaching an international consensus about its definition, object and scope. Two objectives are analyzed; the different interpretations of financial literacy in the academic literature, as well as its evolution and how, in what context and with what other concepts the term is used in social networks. Scientometric techniques and content analysis have been used to carry out a systematic review of literature and also NLP to analyze the comments on Social Networks. Critical moments are identified in the definition of financial literacy. Also ten sentiments are analyzed in social networks in wich positivity, trust, and anticipation predominate. Greater attention to this issue is necessary both from the private initiative and from public policies, so that financial literacy is an effective tool for a more sustainable behavior by consumers. Finally, a new definition is proposed based on our findings.

Recommender systems have been applied in a wide range of domains such as e-commerce, media, banking, and utilities. This kind of system provides personalized suggestions based on large amounts of data in order to increase user satisfaction. These suggestions help client select products, while organizations can increase the consumption of a product. In the case of social data, sentiment analysis can help gain better understanding of a user’s attitudes, opinions and emotions, which is beneficial to integrate in recommender systems for achieving higher recommendation reliability. On the one hand, this information can be used to complement explicit ratings given to products by users. On the other hand, sentiment analysis of items that can be derived from online news services, blogs, social media or even from the recommender systems themselves is seen as capable of providing better recommendations to users. In this study, we present and evaluate a recommendation approach that integrates sentiment analysis into collaborative filtering methods. The recommender system proposal is based on an adaptive architecture, which includes improved techniques for feature extraction and deep learning models based on sentiment analysis. The results of the empirical study performed with two popular datasets show that sentiment–based deep learning models and collaborative filtering methods can significantly improve the recommender system’s performance.

General–purpose automatic speech recognition (ASR) systems have improved their quality and are being used for pronunciation assessment. However, the assessment of isolated short utterances, as words in minimal pairs for segmental approaches, remains an important challenge, even more for non-native speakers. In this work, we compare the performance of our own tailored ASR system (kASR) with the one of Google ASR (gASR) for the assessment of Spanish minimal pair words produced by 33 native Japanese speakers in a computer-assisted pronunciation training (CAPT) scenario. Participants of a pre/post-test training experiment spanning four weeks were split into three groups: experimental, in-classroom, and placebo. Experimental group used the CAPT tool described in the paper, which we specially designed for autonomous pronunciation training. Statistically significant improvement for experimental and in-classroom groups is revealed, and moderate correlation values between gASR and kASR results were obtained, beside strong correlations between the post-test scores of both ASR systems with the CAPT application scores found at the final stages of application use. These results suggest that both ASR alternatives are valid for assessing minimal pairs in CAPT tools, in the current configuration. Discussion on possible ways to improve our system and possibilities for future research are included.

What does the way autistics bypass, learn, and eventually master language tell us about humans’ genetically encoded linguistic ability? In this theoretical review, we argue that autistic non-social acquisition of language, as well as autistic savant abilities, provide a strong argument for an innate, human-specific orientation toward (and mastery of) complex embedded structures. Autistic non-social language learning may represent a widening of the material processed during development beyond oral language. Structure detection and manipulation and generative production of non-linguistic embedded and chained material (savant abilities in calendar calculation, musical composition and interpretation, three-dimensional drawing) may thus represent an application of such innate mechanisms to non-standard materials. Typical language learning through exposure to the child’s mother tongue may represent but one of many possible achievements of the same capacity. The deviation from typical language development in autism may ultimately allow access to oral language, sometimes in its most elaborate forms, but also explains the possibility of the absence of its development when applied exclusively to non-linguistic structured material. Such an extension of human capacities beyond, or in parallel to, their usual limits call into question what we consider to be specific or expected in humans and, therefore, does not necessarily represent a genetic “error”. Regardless of the adaptive success or failure of non-social language learning, it is up to science and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

Bayesian formulations of learning imply that whenever the evidence for a correlation between events in an animal’s habitat is sufficient, the correlation is learned. This implies that regularities can be learnt rapidly, from small numbers of learning examples. This speed of learning gives maximum possible fitness, and no faster learning is possible. There is evidence in many domains that animals and people can learn at nearly Bayesian optimal speeds. These domains include associative conditioning, and the more complex domains of navigation and language. There are computational models of learning which learn at near-Bayesian speeds in complex domains, and which can scale well – to learn thousands of pieces of knowledge (i.e., relations and associations). These are not neural net models. They can be defined in computational terms, as algorithms and data structures at David Marr’s [1] Level Two. Their key data structures are composite feature structures, which are graphs of multiple linked nodes. This leads to the hypothesis that animal learning results not from deep neural nets (which typically require thousands of training exam-ples), but from neural implementations of the Level Two models of fast learning; and that neu-rons provide the facilities needed to implement those models at Marr’s Level Three. The required facilities include feature structures, dynamic binding, one-shot memory for many feature struc-tures, pattern-based associative retrieval, unification and generalization of feature structures. These may be supported by multiplexing of data and metadata in the same neural fibres.

Currently the integration of Kazakhstan into the world community requires the training of highly qualified specialists fluently speaking and having a good command of foreign language. The study is devoted to the problem of development of foreign language professional skills of students of non-linguistic specialty. The aim of the research is to identify the efficiency of integrated approach use for shaping foreign language communicative skills of non-linguistic specialty students. The methodological basis of the research was communicative approach to foreign language teaching. In the framework of the research scientific and theoretical literary sources on the problem of the development of foreign language professional skills of non-linguistic specialty students were studied and summarized; the analysis of the empirical material obtained in the questioning and testing of students. To determine the level of formation of foreign language professional competence of international relations specialty students we have developed the following components: linguistic, cognitive, pragmatic. In the course of the experimental study, the authors revealed that the use of problem-based methods such as discussion, project and case technologies, debates in the framework of integrated approach to professional foreign language teaching promote students’ motivation increase and contribute to the improvement of their foreign language professional skills. The results of the study can be used in application of CLIL technology for the formation of foreign language professional competence of non-linguistic specialty students at the university.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

The aim of this study was to build a tool to analyze, using artificial intelligence, the sentiment perception of users who answered two questions from the CSQ – 8 questionnaires with raw Spanish free-text. Their responses are related to mindfulness, which is a novel technique used to control stress and anxiety caused by different factors in daily life. As such, we proposed an online course where this method was applied in order to improve the quality of life of health care professionals in COVID 19 pandemic times. We also carried out an evaluation of the satis-faction level of the participants involved, with a view to establishing strategies to improve fu-ture experiences. To automatically perform this task, we used Natural Language Processing (NLP) models such as swivel embedding, neural networks and transfer learning, so as to classify the inputs into the following 3 categories: negative, neutral and positive. Due to the lim-ited amount of data available - 86 registers for the first and 68 for the second - transfer learning techniques were required. The length of the text had no limit from the user’s standpoint, and our approach attained a maximum accuracy of 93.02 % and 90.53 % respectively based on ground truth labeled by 3 experts. Finally, we proposed a complementary analysis, using com-puter graphic text representation based on word frequency, to help researchers identify relevant information about the opinions with an objective approach to sentiment. The main conclusion drawn from this work is that the application of NLP techniques in small amounts of data using transfer learning is able to obtain enough accuracy in sentiment analysis and text classification stages

Differentiated instruction has been implemented in classrooms where students who come from various backgrounds require appropriate lessons that are tailored to their varied learning preferences. As the spread of coronavirus 19 (Covid-19) is becoming more rampant, online learning has been lifted up as the main platform of teaching and learning, forcing the need to shift from the conventional face-to-face classroom to online, or virtual, mode of knowledge transfer. Having such global phenomenon affecting education, how does it affect the implementation of differentiated instruction that has been practised regularly by teachers before the wake of Covid-19? Previous studies have shown how it is done in the normal classroom setting, and that the practice of differentiated instruction contributes to students’ motivation as well as academic performance. However, there is a need to explore how do teachers go about with online differentiated instruction and how does it affect the students, since online learning poses various threads to both teachers and students; and thus, one might argue the effectiveness of not only the teaching approach but also the overall teaching and learning outcomes. Borg’s framework of teacher cognition, which has been extensively used in exploring how teachers teach, can be utilized to document the practice of online differentiated instruction. This study aimed to explore the practice of online differentiated instruction by teachers and examined its impact on students’ motivation and academic performance during the Covid-19 outbreak. The participants of this study consists of 247 gifted students from a public school in Malaysia. To meet these aims, this study employed a mixed method research design, utilizing the framework of teacher cognition to explore the teachers’ practice of online differentiated through interviews; and, utilizing a survey design using a questionnaire to determine the impact of online differentiated instruction towards students’ motivation and academic performance. The findings revealed that although online differentiated instruction is feasible, however, appropriate combination of differentiation constructs need to be applied in order to achieve higher motivation and better academic performance among the students.

When participants in a statistical learning paradigm are asked to learn from two incompatible or competing inputs, they often fail to learn from one or both inputs. This study presents the results of two experiments that were both completed by one group of typically developing four-year-old children. One experiment targeted word-medial consonant patterns (phonotactics), whereas the other targeted strong-weak and weak-strong stress patterns (prosody). The order of the experiments was critical for learning outcomes in the phonotactics experiment: When children learned phonotactics first, their production accuracy increased following exposure to a high frequency input. When children learned phonotactics second, however, their production accuracy dropped when they were exposed to the high frequency input. Results from the prosody experiment were inconclusive, with limited evidence of any learning effect. Overall, the results suggest that children may conflate learning experiences, and patterns learned from an initial experimental input compete with patterns in a subsequent experiment. When considering natural language acquisition, the results suggest that an isolated episode of learning may lead to generalizations that are incompatible with later input, and possibly, with larger patterns in the language.

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7%, 42.0%, and 70.1% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future.

In bilingual communities, social interactions take place in both single- and mixed-language con-texts. Some of the information shared in multilingual conversations is often required in conse-quent social encounters, like interlocutors’ personal information. In this study we explored whether the autobiographical information provided in a single-language context is better re-membered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilin-gual (pre-)teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across partici-pants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

Paraphrase Generation is one of the most important and challenging tasks in the field of Natural Language Generation. The paraphrasing techniques help to identify or to extract/generate phrases/sentences conveying the similar meaning. The paraphrasing task can be bifurcated into two sub-tasks namely, Paraphrase Identification (PI) and Paraphrase Generation (PG). Most of the existing proposed state-of-the-art systems have the potential to solve only one problem at a time. This paper proposes a light-weight unified model that can simultaneously classify whether given pair of sentences are paraphrases of each other and the model can also generate multiple paraphrases given an input sentence. Paraphrase Generation module aims to generate fluent and semantically similar paraphrases and the Paraphrase Identification systemaims to classify whether sentences pair are paraphrases of each other or not. The proposed approach uses an amalgamation of data sampling or data variety with a granular fine-tuned Text-To-Text Transfer Transformer (T5) model. This paper proposes a unified approach which aims to solve the problems of Paraphrase Identification and generation by using carefully selected data-points and a fine-tuned T5 model. The highlight of this study is that the same light-weight model trained by keeping the objective of Paraphrase Generation can also be used for solving the Paraphrase Identification task. Hence, the proposed system is light-weight in terms of the model’s size along with the data used to train the model which facilitates the quick learning of the model without having to compromise with the results. The proposed system is then evaluated against the popular evaluation metrics like BLEU (BiLingual Evaluation Understudy):, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), METEOR, WER (Word Error Rate), and GLEU (Google-BLEU) for Paraphrase Generation and classification metrics like accuracy, precision, recall and F1-score for Paraphrase Identification system. The proposed model achieves state-of-the-art results on both the tasks of Paraphrase Identification and paraphrase Generation.

while enjoying a relative positive revival in the digital age, Esperanto and the assessment of its language vitality is often problematic and prone to gross errors, and therefore a theoretical re-flection is required. Unlike other lesser-used languages, Esperanto is intergenerationally trans-mitted mainly outside the family, and so Fishman’s GIDS and subsequent scales such as the EGIDS cannot be applied straightforwardly for language vitality diagnosis and estimation. In particular, it is the social movement with its language activists who guarantee its vitality and developing, for more than a century. A key aspect is the digital domain, where the relatively good positioning of Esperanto does not reflect in a parallel increase in the number of activists. This paper critically assesses the digital language vitality of Esperanto on the basis of its language ide-ology and other sociolinguistic data as a starting point for a discussion to overcome the limits of Blanke’s (2006) scale of language vitality of Esperanto and its rivals. This assessment eventually leads to a more general reflection on the role of ‘coolification’, i.e., the positive effects on language attitudes and development thanks to digital visibility, its limits and the issue of placing it in the context of language vitality in general.

What does the way autistics bypass, learn, and eventually master language tell us about human linguistic ability? Here, we argue that non-social acquisition of language, in addition to representing a strong argument for nativist models of human language, may be encompassed within the human-specific orientation and mastery of complex embedded structures, of which language represents one realization. Non-social language learning could thus represent the extension of available linguistic, and non-linguistic material processed by human genetic constraints, allowing language acquisition. This deviation from typical developmental language acquisition may ultimately allow access to language, sometimes in its most elaborate forms, and also explains the possibility of the absence of its development when applied to primarily non-linguistic structured material. However, such enlargement of material-specificity does not cast doubts about its human nature. Regardless of the adaptive success or failure of non-social language learning, it is up to science, legal policies, and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

This paper presents the current lexical, morphological, syntactic and rule-based machine translation work for Erzya and Moksha that can and should be used in the development of a roadmap for Mordvin linguistic research. We seek to illustrate and outline initial problem types to be encountered in the construction of an Apertium-based shallow-transfer machine translation system for the Mordvin language forms. We indicate reference points within Mordvin Studies and other parts of Uralic studies, as a point of departure for outlining a linguistic studies with a means for measuring its own progress and developing a roadmap for further studies.

This article presents a dataset of tweets in the Urdu language. There are 1,140,824 tweets in the dataset, collected from Twitter for September and October 2020. This large-scale corpus of tweets is generated by performing pre-processing which includes removing columns containing user information, retweet’s count, followers information, duplicate tweets, removing unnecessary punctuation, links, symbols, and spaces, and finally extracting emojis if present in the tweet text. In the final dataset each tweet record contains columns for tweet id, text, and emoji extracted from the text with a sentiment score. Emojis are extracted to validate Machine Learning models used for the multilingual sentiment and behavior analysis. These are extracted using a Python script that searches for an emoji from the list of 751 most frequently used emojis. If an emoji is present in the text, a column with the emoji description and sentiment score is added.

The critical period (CP) phenomenon in language development ranks among the 125 conundrums facing scientists in the 21st century, according to Science. While the phenomenon itself has been noncontroversial in first language acquisition, it still warrants an adequate explanation. Predicated on language acquisition as a complex process, questions among the first to be raised include: How do children accomplish this remarkable feat in such a short amount of time? And how do nature and nurture come together to influence language learning? In second language acquisition, however, both the notion of CP, albeit popular, and its empirical evidence have remained contested to this date - among the questions, whether the observed evidence counts as CP-specific and/or whether or not it warrants an isomorphic attribution to maturational constraints. Entwined in this debate are two well-established facets of inter-learner differential attainment. The first is that there exists a stark difference in ultimate attainment between younger and older learners. A second facet is the vast differences in ultimate attainment among older learners. In this article, adopting a social physics approach, we mathematically establish both the relationship between nature and nurture contributions and the presence of a critical period, and, at once, tender a parsimonious and probable theory for the twin phenomena of inter-learner differential attainment.

Increasing evidence suggests that prenatal exposure to opioids can adversely influence brain development, yet, limited data exists on the effects of opioid-exposure on preschool language development. Our study aimed to characterize the nature and prevalence of language problems in children prenatally exposed to opioids, and the factors that support or hinder language acquisition. A sample of 100 children born to pregnant women in methadone maintenance treatment and 110 randomly identified non-exposed children were studied from birth to age 4.5 years. At 4.5 years, 89 opioid-exposed and 103 non-exposed children completed the preschool version of the Clinical Evaluation of Language Fundamentals (CELF-P) as part of a comprehensive neurodevelopmental assessment. Children prenatally exposed to opioid had poorer receptive and expressive language outcomes at age 4.5 years compared to non-exposed children. After adjustment for child sex, maternal education, other pregnancy substance use, maternal pregnancy nutrition and prenatal depression, opioid exposure remained a significant independent predictor of children’s total CELF-P language score. Examination of a range of potential intervening factors showed that a composite measure of the quality of parenting and home environment at 18 months and early childhood education participation at 4.5 years were important positive mediators.

Deep neural networks are hegemonic approaches to many machine learning areas, including natural language processing (NLP). Thanks to the availability of large corpora collections and the capability of deep architectures to shape internal language mechanisms in self-supervised learning processes (also known as "pre-training"), versatile and performing models are released continuously for every new network design. But these networks, somehow, learn a probability distribution of words and relations across the training collection used, inheriting the potential flaws, inconsistencies and biases contained in such a collection. As pre-trained models have found to be very useful approaches to transfer learning, dealing with bias has become a relevant issue in this new scenario. We introduce bias in a formal way and explore how it has been treated in several networks, in terms of detection and correction. Also, available resources are identified and a strategy to deal with bias in deep NLP is proposed.

While adequate for English-speaking users in the United States, as well as many Commonwealth countries and other English-speaking jurisdictions (e.g., Canada, Australia, New Zealand or South Africa among others), typing in Romance Languages (Spanish, French, Portuguese and Italian) by using a standard US-QWERTY Keyboard is not easy since it is not adapted to special characters such as accented vowels, tildes and cedillas or ligatures, used in Romance Languages. With regard to the International Layout, intended to enable access to the most common diacritics used in Western European Languages, the problem comes from the fact that accented vowels are spread throughout the Keyboard layout, and their uppercase versions need chord combinations which can require good manual dexterity. This paper will analyze how the Spanish or Portuguese Keyboards are the best options for these users since they are QWERTY-based and the most compatible ones for the different character sets in Spanish, French, Portuguese and Italian Languages.

Electronic health records (EHRs) are becoming a vital source of data for healthcare quality improvement, research, and operations. However, much of the most valuable information contained in EHRs remains buried in unstructured text. The field of clinical text mining has advanced rapidly in recent years, transitioning from rule-based approaches to machine learning and, more recently, deep learning. With new methods come new challenges, however, especially for those new to the field. This review provides an overview of clinical text mining for those who are encountering it for the first time (e.g. physician researchers, operational analytics teams, machine learning scientists from other domains). While not a comprehensive survey, it describes the state of the art, with a particular focus on new tasks and methods developed over the past few years. It also identifies key barriers between these remarkable technical advances and the practical realities of implementation at health systems and in industry.

Now when the whole world is still under COVID-19 pandemic, many schools have transferred the teaching from physical classroom to online platforms. It is highly important for schools and online learning platforms to investigate the feedback to get valuable insights about online teaching process so that both platforms and teachers are able to learn which aspect they can improve to achieve better teaching performance. But handling reviews expressed by students would be a pretty laborious work if they were handled manually as well as it is unrealistic to handle large-scale feedback from e-learning platform. In order to address this problem, both machine learning algorithms and deep learning models are used in recent research to automatically process students' review getting the opinion, sentiment and attitudes expressed by the students. Such studies may play a crucial role in improving various interactive online learning platforms by incorporating automatic analysis of feedback. Therefore, we conduct an overview study of sentiment analysis in educational field presented in recent research, to help people grasp an overall understanding of the sentiment analysis research. Besides, according to the literature review, we identify three future directions that researchers can focus on in automatically feedback processing: high-level entity extraction, multi-lingual sentiment analysis, and handling of figurative language.

Objective: The Acute Cystitis Symptom Score (ACSS) was developed and validated as a self-reporting questionnaire for diagnosing and monitoring acute, uncomplicated cystitis (AC) in female patients. The study aims at the translation of the ACSS into Greek from original Russian as a source and American English as a new master version and at its linguistic validation. Material and Methods: Three independent professional native Greek translators, two of them experts in Russian and one in English, translated the ACSS from Russian and American English into Greek. The second group of three translators translated each of the three versions back into the original language to detect or correct any important discrepancies. These three Greek versions were then used for linguistic validation. Results: The English to Greek translation reflected more the spoken language, the two Russian to Greek translations more the written, formal language. A total of 60 randomly selected females and 30 healthcare professionals was asked about their preferences and to comment on each of the three translations. Considering all comments the scientific committee (SC) developed the Greek consensus version. For cognitive assessment additional 30 healthcare professionals and 30 females were asked to comment on the intelligibility of all items. Considering their comments the linguistically validated Greek study version was established by the SC. Conclusion: The linguistically validated Greek version of the ACSS can now be used for the clinical validation study.

Distributional word vector representation orword embedding has become an essential ingredient in many natural language processing (NLP) tasks such as machine translation, document classification, information retrieval andquestion answering. Investigation of embedding model helps to reduce the feature space and improves textual semantic as well as syntactic relations.This paper presents three embedding techniques (such as Word2Vec, GloVe, and FastText) with different hyperparameters implemented on a Bengali corpusconsists of180 million words. The performance of the embedding techniques is evaluated with extrinsic and intrinsic ways. Extrinsic performance evaluated by text classification, which achieved a maximum of 96.48% accuracy. Intrinsic performance evaluatedby word similarity (e.g., semantic, syntactic and relatedness) and analogy tasks. The maximum Pearson (ˆr) correlation accuracy of 60.66% (Ssˆr) achieved for semantic similarities and 71.64% (Syˆr) for syntactic similarities whereas the relatedness obtained 79.80% (Rsˆr). The semantic word analogy tasks achieved 44.00% of accuracy while syntactic word analogy tasks obtained 36.00%

(1) Background: Children with autism spectrum disorder (ASD) show certain characteristics in visual attention which generate difficulties in the integration of relevant social information to set the basis of communication. Gaze following and pupil dilation could be used to identify signs for the early detection of ASD. Eye-tracking methodology allows objective measurement of these anomalies in visual attention. The aim is to determine whether measurements of gaze following and pupillary dilation in a linguistic interaction task, captured using eye-tracking methodology, are objective for early diagnosis of ASD. (2) Methods: 20 children between 17 and 24 months of age, made up of 10 neurotypical children and 10 children with ASD were paired together according to chronological age. A human face on a monitor pronounced pseudowords associated with pseudo-objects. Gaze following and pupil dilation was registered during the task. (3) Results: Significant statistical differences were found in the time of gaze fixation on the human face and on the object, as well as in the number of gazes. Also, there were significant differences in the maximum peak of pupil dilation, this being found in the neurotypical group at the moment of processing of the pseudoword, and in the ASD group in the baseline prior to the task (4) Conclusions: The registration and the duration of gaze, and the measurement of pupil dilation with ‘eye-tracker’ are objective measures for early detection of ASD.

Ongoing COVID-19 Pandemic has resulted into massive damage to various platforms of global economy which has caused disruption to human livelihood. Natural Language Processing has been extensively used in different organizations to categorize sentiments, perform recommendation, summarizing information and topic modelling. This research aims to understand the non-medical impact of COVID-19 on global economy by leveraging the natural language processing methodology. This methodology comprises of text classification which includes topic modelling on unstructured COVID-19 media articles dataset provided by Anacode. Like other Natural Language Processing algorithms, Latent Dirichlet allocation (LDA) and Non-negative matrix factorization (NMF) has been proposed to classify the media articles dataset in order to analyze COVID-19 pandemic impacts in the different sectors of global economy. Model Accuracy was examined based on the coherence and perplexity score which came out to be 0.51 and -10.90 using LDA algorithm. Both the LDA and NMF algorithm identified similar prevalent topics that was impacted by COVID-19 pandemic in multiple sectors of economy. Through intertopic distance map visualization produced by LDA algorithm, it can be reciprocated that general industries which includes children schooling, parental care, and family gatherings had the major impact followed by business sector and the financial industry.