Neural stem cell (NSC) based therapies are at the forefront of regenerative medicine strategies to combat illness and injury of the central nervous system (CNS). In addition to their ability to produce new cells, NSCs secrete a variety of products, known as the NSC secretome, that have been shown to ameliorate CNS disease pathology and promote recovery. As pre-clinical and clinical research to harness the NSC secretome for therapeutic purposes advances, a more thorough understanding of the endogenous NSC secretome can provide useful insight into the functional capabilities of NSCs. In this review, we focus on research investigating the autocrine and paracrine functions of the endogenous NSC secretome across life. We also compare the NSC secretome across species, finding signs of conserved parallels between rodent, human and zebrafish NSC secretomes. Throughout development and adulthood, we find evidence that the NSC secretome is a critical component of how endogenous NSCs regulate themselves and their niche. We also find gaps in current literature, most notably in the clinically relevant domain of endogenous NSC paracrine function in the injured CNS. Future investigations to further define the endogenous NSC secretome and its role in CNS tissue regulation are necessary to bolster our understanding of NSC-niche interactions and to aid in the generation of safe and effective NSC-based therapies.

Choline and choline metabolites are essential for all cellular functions. They have also been reported to be crucial for neural development. In this work, we studied the functional characteristics of the choline uptake system in human neural stem cells (hNSCs). Additionally, we investigated the effect of extracellular choline uptake inhibition on the cellular activities in hNSCs. We found that the mRNAs and proteins of choline transporter-like protein 1 (CTL1) and CTL2 were expressed at high levels. Immunostaining showed that CTL1 and CTL2 were localized in the cell membrane and partly in the mitochondria, respectively. The uptake of extracellular choline was saturable and performed by a single uptake mechanism, which was Na+-independent and pH-dependent. We conclude that CTL1 is responsible for extracellular choline uptake, and CTL2 may uptake choline in the mitochondria and be involved in DNA methylation via choline oxidation. Extracellular choline uptake inhibition caused intracellular choline deficiency in hNSCs, which suppressed cell proliferation, cell viability, and neurite outgrowth. Our findings contribute to the understanding of the role of choline in neural development as well as the pathogenesis of various neurological diseases caused by choline deficiency or choline uptake impairment.

The therapeutic, attenuative, and morphological effects of proprietary neural stem cell-derived extracellular vesicles (NSC EVs, AB126) produced by Aruna Bio, Inc. were assessed in a range of in vitro and in vivo models of stroke. We emphasize that modulation of neuroinflammation is a key target and suggest further studies to advance our understanding of the mechanisms of action and ultimately how best to dose and monitor the benefits of AB126 in stroke patients.

Cancer stem cells (CSCs) are a tumor cell subpopulation that drives tumor progression and metastasis, leading to poor overall survival of patients. In colorectal cancer (CRC), hyper-activation of Wnt/β-catenin signaling by mutation of both Adenomatous polyposis coli (APC) and K-Ras increases the size of the CSC population. We previously showed that the CPD0857 inactivates Wnt/β-catenin signaling by promoting ubiquitin-dependent proteasomal degradation of β-catenin and Ras proteins, thereby decreasing proliferation and increasing apoptosis of CRC lines. CPD0857 also decreased growth and invasiveness of CRC cells harboring mutant K-Ras resistant to EGFR mAb therapy. Here, we show that CPD0857 treatment decreases proliferation and increases neuronal differentiation of neural progenitor cells (NPCs). CDP0857 effectively reduced expression of CSC markers and suppressed self-renewal capacity. CPD0857 treatment also inhibited proliferation and expression of CSC markers in D-K-Ras MT cells carrying K-Ras, APC and PI3K mutations, indicating inhibition of PI3K/AKT signaling. Moreover, CPD0857-treated xenograft mice showed regression of tumor growth and decreased numbers of CSCs in tumors. We conclude that CPD0857 could serve as the basis of a drug development strategy targeting CSCs activated through Wnt/β-catenin-Ras MAPK-PI3K/AKT signaling in CRCs.

Brain stem cells (neural stem cells or NSCs) and neurons of a chosen kind reprogramming is a potential technique for cell therapy. It is possible to reprogram non-neuronal cells, for example, by using a predetermined group of factors, nuclear transfer, and the induced transcriptional factors (TFs) expression in a related lineage of cells, and non-coding microRNAs (miRNAs). Researchers have additionally been attempting to improve reprogramming methods, whether it is by employing unique sets of biomolecules and particular TFs or by delivering relevant miRNA and Biomolecules. The technique of miRNA mediated is intriguing for its capability to quickly create a range of biologically desirable cell types for therapy from different lineages of cells. Current findings have made significant advancements towards changing the somatic cells to diverse particular neuronal subgroups with greater efficiency, using reprogramming of miRNA-mediated neural cells, despite the fact that the precise processes need to be discovered. To further understand how miRNAs might direct somatic cells to become neural, we need to look at the latest research on their function in neural reprogramming over the differentiated cells. Recent findings on the role of miRNAs in the initiation of cell reprogramming and the determination of the neuronal subtype's destiny are the primary focus of this comprehensive overview. Furthermore, we cover the far more latest results concerning certain miRNAs' activity in controlling different phases of neuronal differentiation, which contributes in comprehending the interaction network of miRNAs and their receptors.

Mammalian cells have evolved to function under Earth’s gravity, but how they respond to microgravity remains largely unknown. Neural stem cells (NSCs) are essential for the maintenance of central nervous system (CNS) functions during development and the regeneration of all CNS cell populations. Here, we examined the behavior of space (SPC)-flown NSCs as they readapted to Earth’s gravity. We found that most of these cells survived the space flight and self-renewed. Yet, some showed autophagy-like behaviors (ALB). To ascertain if the secretome from SPC-flown NSCs contained molecules inducing this behavior, we incubated naïve, non-starved NSCs in a medium containing SPC-NSCs secretome. We found a four-fold increase in the ALB rate. Proteomic analysis of the secretome revealed that the protein of highest content produced by SPC-NSCs was secreted protein acidic and rich in cysteine (SPARC), which triggers endoplasmic reticulum (ER) stress leading to lethal ALB. These results offer novel knowledge on the response of neural cells, particularly NSCs, subjected to space microgravity. Moreover, some secreted proteins have been identified as microgravity sensing, paving a new venue for future research aiming at targeting SPARC metabolism. Although we did not establish a direct relationship between ALB and SPARC as a potential marker, these results represent the first step in the identification of gravity sensing molecules as targets to be modulated and to design effective countermeasures to mitigate intracranial hypertension in astronauts using structure-based-protein design.

Due to its aggressive and invasive nature glioblastoma (GBM), the most common and aggressive primary brain tumour in adults, remains almost invariably lethal. Significant advances in the last several years have elucidated much of the molecular and genetic complexities of GBM. However, GBM exhibits a vast genetic variation and a wide diversity of phenotypes that has complicated the development of effective therapeutic strategies. This complex pathogenesis makes it necessary the development of experimental models that could be used to further understand the disease, and also to provide a more realistic testing ground for potential therapies. In this report, we describe the process of transformation of primary mouse embryo astrocytes into immortalized cultures with neural stem cell characteristics, that are able to generate of GBM when injected in the brain of C57BL/6 mice, or heterotopic tumours when injected iv. Overall, our results show that oncogenic transformation is a fate for NSC if cultured for long periods in vitro. In addition, since no additional hit is necessary to induce the oncogenic transformation, our model may be used to investigate the pathogenesis of gliomagenesis and to test the effectiveness of different drugs throughout the natural history of GBM.

Tumorigenesis is a complex biological phenomenon that includes extensive genetic and phenotypic heterogeneities and complicated regulatory mechanisms. In the recent few years, our studies demonstrate that tumor-initiating cells are similar to neural stem/progenitor cells in regulatory networks, tumorigenicity and pluripotent differentiation potential. In the review, I will make further discussion on these observations and propose a rule of cell biology by integrating these findings with evidence from developmental biology, tumor biology and evolution, which suggests that neural stemness underlies two coupled cell properties, tumorigenicity and pluripotent differentiation potential. Tumorigenicity and phenotypic heterogeneity in tumor is a result of acquirement of neural stemness in cells. The neural stemness property of tumor-initiating cells can hopefully integrate different concepts/hypotheses underlying tumorigenesis. Neural stem cells/neural progenitors and tumor-initiating cells share regulatory networks; both exhibit neural stemness, tumorigenicity and differentiation potential; both are dependent on expression or activation of ancestral genes (the atavistic effect); both rely primarily on aerobic glycolytic metabolism; both can differentiate into various cells or tissues that are derived from three germ layers, resembling severely disorganized or more severely degenerated process of embryonic development; both are enriched in long genes with more splice variants that provide more plastic scaffolds for cell differentiation, etc. The property of neural stemness might be a key point to understand tumorigenesis and pluripotent differentiation potential, and possibly explain certain pathological observations in tumors that have been inexplicable. Therefore, behind the complexity of tumorigenesis might be a general rule of cell biology, i.e., neural stemness represents the ground state of cell tumorigenicity and pluripotent differentiation potential.

Dynamic neural networks (DNN) are types of artificial neural networks (ANN) that are designed to work with sequential data where context in time is important. In contrast to traditional static neural networks that process data in a fixed order, dynamic neural networks use information about past inputs, which is important if dynamic of a certain process is emphasized. They are widely used in natural language processing, speech recognition and time series prediction. In industrial processes, their use is interesting for the prediction of difficult-to-measure process variables. In an industrial process of isomerization, it is crucial to measure the quality attributes affecting the octane number of gasoline. Process analyzers that are commonly used for this purpose are expensive and subject to failures, therefore, in order to achieve continuous production in case of malfunction, mathematical models for estimating the product quality attributes are imposed as a solution. In this paper, mathematical models were developed using dynamic recurrent neural networks (RNN), i.e., their subtype of a long short-term memory (LSTM) architecture. The results of the developed models were compared with the results of several types of other data-driven models developed for an isomerization process, such as multilayer perceptron (MLP) artificial neural networks, support vector machines (SVM) and dynamic polynomial models. The obtained results are satisfactory, which suggests a good possibility of application.

Periodontitis is microbial infection affecting periodontium, the tooth supporting structure and affects >743 million people worldwide. Neural crest-derived stem cells (NCSCs) hold the promise to regenerate the damaged periodontium. These cells have been identified within adult adipose tissue, periodontal ligament, and palatal tissue. Typical enzymatic isolation protocols are expensive, time consuming and often not clinically compliant. Enzyme-free, mechanical dissociation has been suggested as an alternative method of generating cell suspensions required for cell separation and subsequent expansion ex vivo. In our study, samples of rat skeletal muscle tissue were used to appraise the suitability of a novel mincing method of mechanical dissociation against enzymatic digestion with collagenase and dispase. Skeletal muscle is readily available and has been shown to contain NCSC populations. We used a Rigenera-Human Brain Wave^® prototype mincer to produce a suspension of skeletal muscle-derived cells modeling NCSCs. We have compared the resulting cell cultures produced via mechanical dissociation and enzymatic dissociation, producing single cell suspensions suitable for Magnetic Cell Sorting (MACs) and Fluorescence-activated cell sorting (FACS). Despite the Countess Automated Cytometry data demonstrating that cell suspensions produced by mechanical dissociation (n=24) contain on average 26.8 times as many viable cells as enzymatic cell suspensions (n=18), enzymatic suspensions produced more successful cell cultures. Spheroids and subsequently adherent cells formed from 4 enzymatic cell suspensions (44.4%) vs. 1 mechanical cell suspension (8.3%). Enzymatic digestion protocols formed spheroids faster and more plentifully than mechanical cell suspensions. Adherent cells and spheroids isolated via both methods appear morphologically similarly to NCSCs from our previous studies.

Biofilms are congregations of bacteria on a surface, and they grow into obstacles for the functionalities of any device or machinery involves anything biological. Biofilms are developed through a biochemical system known as ‘Quorum Sensing’ that accounts for the chemical signaling that direct either biofilm formation or inhibition. Computational models that relate chemical and structural features of compounds to their performance properties have been used to aide in the discovery of active small molecules for many decades. These quantitative structure-activity relationship (QSAR) models are also important for predicting the activity of molecules that can have a range of effectiveness in biological systems. This study uses QSAR methodologies combined with and different machine learning algorithms to predict and assess the performance of several different compounds acting in Quorum Sensing. Through computational probing of the quorum sensing molecular interaction, new design rules can be elucidated for countering biofilms.

Background: Proteins targeted by the Ubiquitin Proteasome System (UPS) are identified for degradation by the proteasome, which has been implicated in the development of neuro-degenerative diseases. Major histocompatibility complex (MHC) molecules present peptides broken down by the proteasome and are involved in neuronal plasticity, regulating synapse number and axon regeneration in the central or peripheral nervous system during develop-ment and in brain diseases. The mechanisms governing these effects are mostly unknown, but evidence from different compartments of the cerebral cortex indicates the presence of im-mune-like MHC receptors in the central nervous system. Methods: We have used human induced pluripotent stem cells (iPSC) differentiated to neural stem cells and then to motor neurons as a developmental model to better understand the structure of the proteasome in developing motor neurons. We perform a proteomic analysis of starting human skin fibroblasts, their matching iPSC, differentiated neural stem cells and motor neurons that highlighted significant differences in the constitutive proteasome and immunoproteasome subunits during development towards motor neurons from iPSC. Results: Proteomic analysis showed that the catalytic proteasome subunits expressed in fi-broblasts differ to those in neural stem cells and motor neurons. Western blot analysis con-firmed the proteomic data, particularly the decreased expression of Beta5i (PSMB8) subunit immunoproteasome. Conclusion: The constitutive proteasome subunits are upregulated in iPSC from HFF and the immunoproteasome subunit beta 5i expression is higher in MN than NSC suggesting a im-munoproteasome phenotype in MN. The immunoproteasome may have implications on motor neuron development and neurodevelopmental diseases that warrants further investi-gation.

Adult neural stem and progenitor cells (NSPCs) contribute to learning, memory, maintenance of homeostasis, energy metabolism and many other essential processes. They are highly heterogeneous populations that require input from a regionally distinct microenvironment including a mix of neurons, oligodendrocytes, astrocytes, ependymal cells, NG2+ glia, vasculature, cerebrospinal fluid (CSF), and others. The diversity of NSPCs is present in all three major parts of the CNS, i.e., the brain, spinal cord, and retina. Intrinsic and extrinsic signals, e.g., neurotrophic and growth factors, master transcription factors, and mechanical properties of the extracellular matrix (ECM), collectively regulate activities and characteristics of NSPCs: quiescence/survival, proliferation, migration, differentiation, and integration. This review discusses the heterogeneous NSPC populations in the normal physiology and highlights their potentials and roles in injured/diseased states for regenerative medicine.

A recent study from our lab revealed that inhibition of cyclooxygenase-2 exclusively reduces the level of PGE2 amongst the prostanoids and hamper the normal development of several structures, strikingly the cranial vault, in chick embryos. In order to unearth the mechanism behind the deviant development of cranial features, the expression pattern of various factors that are known to influence the cranial neural crest cell (CNCC) migration were checked in chick embryo after inhibiting the COX-2 activity using etoricoxib. The compromised level of cell adhesion molecules and their upstream regulators, namely CDH1, CDH2, MSX1, and TGF-β, observed in the etoricoxib treated embryos indicate that COX-2, through its downstream effector PGE2, regulates the expression of these factors perhaps to aid the migration of CNCC. The histological features and levels of FoxD3 as well as PCNA further consolidates the role of COX-2 in migration and survival of CNCC in developing embryo. The results of the current study indicate that the COX-2 plays a pivotal role in orchestrating the proliferation and migration of CNCC during embryonic development of chick.

The neural crest, a unique cell population originating from the primitive neural field, has a multi-systemic and structural contribution to vertebrate development. At the cephalic level, the neural crest generates most of the skeletal tissues encasing the developing forebrain and provides the prosencephalon with functional vasculature and meninges. Over the last decade, we have demonstrated that the cephalic neural crest (CNC) exerts an autonomous and prominent control on forebrain and sense organs development. The present paper reviews the primary mechanisms by which CNC can orchestrate vertebrate encephalization. Demonstrating the role of the CNC as an exogenous source of patterning for the forebrain provides a novel conceptual framework with profound implications for understanding neurodevelopment. From a biomedical standpoint, these data suggest that the spectrum of neurocristopathies is broader than expected and that some neurological disorders may stem from CNC dysfunctions.

The beating heart is subject to intrinsic mechanical factors, exerted by contraction of the myocardium (stretch and strain) and fluid forces of the enclosed blood (wall shear stress). The earliest contractions of the heart occur already in the 10-somite stage in the tubular as yet unsegmented heart. With development the looping heart becomes asymmetric providing varying diameters and curvatures resulting in unequal flow profiles. These flow profiles exert various wall shear stresses and as a consequence different expression patterns of shear responsive genes. In this paper we investigate the morphological changes of the heart after changes the blood flow by ligation of the right vitelline vein in a model chicken embryo and analyze the extended expression in the endocardial cushions of the shear responsive gene Tgfbeta receptor III. A major phenomenon is the diminished endocardial-mesenchymal transition resulting in hypoplastic (even absence of) atrioventricular and outflow tract endocardial cushions, that might be lethal in early phases. The surviving embryos exhibit several cardiac malformations including ventricular septal defects and malformed semilunar valves related to a malposition of the aortopulmonary septum and the enclosed neural crest cells. We discuss the results in the light of the interactions between several shear stress responsive signaling pathways including Vegf, Notch, Pdgf, Klf2, eNos, Endothelin and Tgfβ/Bmp/Smad.

Neurogenesis in the adult brain plays a major role in the cognitive ability of animals including learning and memory. Poria cocos (Schw.) Wolf (P. cocos) has been known as a traditional Chinese edible medicinal herb with the potential effect to improve learning and memory. However, the effect mechanisms are still elusive. In this study, significant neuronal differentiation-promoting activities of the ethanol extracts of P. cocos (EEPC) were tested in Neuro-2a cells and mouse cortical neural stem/progenitor cells (NSPCs). Subsequently, 97 compounds of EEPC were identified using UHPLC-Q-Exactive-MS/MS. After investigation of neuronal differentiation-promoting activities of 4 major compounds (Ethyl palmitoleate, L-(-)-Arabitol, Choline and Adenosine), only Choline has significant neuronal differentiation-promoting activity. In summary, we investigated the neuronal differentiation-promoting activity and chemical compositions of EEPC, the study of the neuronal differentiation-promoting effect of ether extract of P. cocos indicated P. cocos’s positive effect on learning and memory functions. This is the first investigation of the neuronal differentiation-promoting effect of ether extract of P. cocos based on similar research references.

This paper presents a novel approach to sentiment analysis specifically customized for predicting stock market movements, bypassing the need for external dictionaries which are often unavailable for many languages. Our methodology directly analyzes textual data, with a particular focus on context-specific sentiment words within neural network models. This specificity ensures our sentiment analysis is both relevant and accurate in identifying trends in the stock market. We employ sophisticated mathematical modeling techniques to enhance both the precision and interpretability of our models. Through meticulous data handling and advanced machine learning methods, we leverage large datasets from Twitter and financial markets to examine the impact of social media sentiment on financial trends. We achieved an accuracy exceeding 75%, highlighting the effectiveness of our modeling approach, which we further refined into a convolutional neural network model. This achievement contributes valuable insights into sentiment analysis within the financial domain, thereby improving the overall clarity of forecasting in this field.

Efficient management of basal cell carcinoma (BCC) requires reliable assessments of both tumors and post-treatment scars. We aimed to estimate image similarity metrics that account for BCC's perceptual color and texture deviation from perilesional skin. 176 clinical photographs of BCC were assessed by six physicians using a visual deviation scale. Internal consistency and inter-rater agreement were estimated using Cronbach's α, weighted Gwet's AC2, and quadratic Cohen's Kappa. The mean visual scores were used to validate a range of similarity metrics employing different color spaces, distances, and image embeddings from pre-trained VGG16 neural network. The calculated similarities were transformed into discrete values using ordinal logistic regression models. The Bray-Curtis distance in the YIQ color model and rectified embeddings from the 'fc6' layer minimized the mean squared error and demonstrated strong performance in representing perceptual similarities. Box plot analysis and Wilcoxon rank-sum test were used to visualize and compare the levels of agreement, conducted on a random validation round between the two groups: ‘Human-System’ and ‘Human-Human’. The proposed metrics were comparable in terms of internal consistency and agreement with human raters. The findings suggest that the proposed metrics offer a robust, and cost-effective approach to monitoring BCC treatment outcomes in clinical settings.

Although adults and children differ in self-versus-other perception, the developmental perspective on this discriminative ability is missing. We compared neural activation of self-vs-others in 39 participants of 4 different age groups (4 yo. to adulthood). Two brain regions, the MCC and right postcentral gyrus, exhibited respectively non-linear and gradual gains in discriminative abilities for self-vs-others stimuli. These regions play critical roles in self-referential processing, empathy, and social cognition. Nine brain regions showed linear increase for others-vs-self stimuli. These regions are associated with multisensory processing, somatosensory skills, complex visual stimuli, self-awareness, empathy, theory of mind, and social recognition. Understanding the neural basis of self-vs-others discrimination during development can inform when and how social contexts support learning processes during childhood and adolescence.

Ageing may be characterized by progressive loss of cognitive function as well as decrease in physical activities, in addition to change in appearance. Previously, we reported that intracerebroventricular transplantation of a human neural stem cell (NSC) line (F3) over-expressing choline acetyltransferase (F3.ChAT) gene, an enzyme responsible for acetylcholine synthesis, markedly improved cognitive function and physical activity of aged animals by enhancing acetylcholine and growth factors (GFs) and neurotrophic factors (NFs). In the present study, 10-month-old F344 rats were intravenously transplanted with F3 or F3.ChAT NSCs (1 x 106 cells) once a month to 21st month of age when the cumulative mortality reached 20%, and physical activity and learning/memory function were investigated, in addition to the analyses of brain acetylcholine concentration, and cholinergic and dopaminergic system restoration. Neuroprotective and neuroregenerative activities of stem cells were also confirmed by analyzing oxidative damages, neuronal skeletal protein, angiogenesis, brain and muscle weights, and proliferating host stem cells. Stem cells markedly improved both the cognitive (passive avoidance and water-maze performances) and physical (locomotor and rota-rod activities) functions, in parallel with the elevation of acetylcholine levels in cerebrospinal fluid and in muscles, in which F3.ChAT cells were superior to F3 parental cells. Stem cell transplantation down-regulated CCL11, leading to restoration of microtubule-associated protein 2 as well as functional markers of cholinergic and dopaminergic systems, and preserved brain and muscular capillaries, recovering muscle mass. In addition, stem cells enhanced antioxidative capacity, attenuating oxidative damage of multiple organs including muscles and the brain. The results indicate that NSCs over-expressing ChAT gene improve cognitive function and physical activity of ageing animals by protecting and recovering functions of multiple organs including cholinergic and dopaminergic systems as well as muscles from oxidative injuries through secretion of acetylcholine and GFs/NFs, increased antioxidant elements, and enhanced blood flow.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

The potential of Neural Stem Cells (NSCs) to provide therapeutic benefit for a variety of neurological disorders, including brain malignancies, has been long recognized and has inspired many scientists to design, test and successfully demonstrate that NSCs are efficient and effective therapeutic agents. Glioblastoma, the deadliest form of primary brain tumor, despite extensive and sustained efforts to find better therapies, remains a disease without cure, with a median survival after diagnosis of less than two years. Treatment resistance in glioblastoma is in large part attributed to limitations in the delivery and distribution of therapeutic agents administered either systemically or directly into the tumor due to the highly invasive nature of this cancer and its abnormal intratumoral vasculature. Stem Cells (SCs) have an innate tumor-tropic migratory behavior, can be modified to deliver a variety of therapeutic agents and efficiently distribute their cargo into brain tumors, pursuing invading streams of tumor cells, deep into the brain parenchyma. Over the last twenty years, numerous preclinical trials have demonstrated the feasibility and efficacy of SCs as antiglioma agents, leading to the development of trials to test these therapies in the clinic. In this review we present and analyze these studies and discuss mechanisms underlying their beneficial effect, highlighting experimental progress, limitations and the emergence of promising new therapeutic avenues. We hope to increase awareness of the advantages of using SCs for the treatment of glioblastoma and inspire further studies that will lead to accelerated implementation of effective therapies.

The article describes machine learning using artificial neural networks (ANN) to develop the parameters of the friction stir welding (FSW) process for three types of aluminum joints (EN AW 7075). A total of 608 experimental data were used to build the ANN. Two types of networks were built: the first one was used to classify good/bad connections with the MLP 7-19-2 topology, the second one was used to regress the tensile load-bearing capacity with the MLP 7-19-1 topology. Selected parameters of the FSW process were used as input data for ANN training: rotational speed, welding speed, joint and tool geometry. Based on a case study, the quality of the FSW joint was assessed in terms of microstructure and mechanical properties. The usefulness of both trained neural networks has been demonstrated. For the regression network, the quality of the validation set was approximately 93.6%. In the case of confusion matrix for the test set, errors never exceeded 6%. Only 184 epochs were needed to train the regression network. The quality of the validation set was approximately 87.1%. On their basis, predictive maps were developed and presented in the work allowing for the selection of optimal parameters of the FSW process for three types of joints.

The enteric nervous system (ENS) is principally derived from vagal neural crest cells that migrate caudally along the entire length of the gastrointestinal tract, giving rise to neurons and glial cells in two ganglionated plexuses. Incomplete migration of enteric neural crest-derived cells (ENCDC) leads to Hirschsprung disease, a congenital disorder characterized by the absence of enteric ganglia along variable lengths of the colorectum. Our recent data [1] support an essential role for the avian ceca, present at the junction of midgut and hindgut, in hindgut ENS development, since ablation of the cecal buds leads to incomplete ENCDC colonization of the hindgut. In situ hybridization shows bone morphogenetic protein-4 (BMP4) highly expressed in the cecal mesenchyme, leading us to hypothesize that cecal BMP4 is required for hindgut ENS development. To test this, we modulated BMP4 activity using embryonic intestinal organ culture techniques and retroviral infection in ovo. We show that overexpression or inhibition of BMP4 in the ceca disrupts hindgut ENS development, with GDNF playing an important regulatory role. Our results suggest that these two important signaling pathways are required for normal ENCDC migration and enteric ganglion formation in the developing hindgut ENS.

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

An automatic recognizing system of white blood cells can assist hematologists in the diagnosis of many diseases, where accuracy and efficiency are paramount for computer-based system. In this paper, we present a new image processing system to recognize the five types of white blood cells in peripheral blood with marked improvement in efficiency when juxtaposed against mainstream methods. The prevailing deep learning segmentation solutions often utilize millions of parameters to extract high-level image features and neglect the incorporation of prior domain knowledge, which consequently consume substantial computational resources and increase the risk of overfitting, especially when limited medical image samples are available for training. To address these challenges, we propose a novel memory-efficient strategy that exploits graph structures derived from the images. Specifically, we introduce a lightweight superpixel-based Graph Neural Network (GNN) and break new ground by introducing superpixel metric learning to segment nucles and cytoplasm. Remarkably, our proposed segmentation model (SMGNN) achieves state-of-the-art segmentation performance while utilizing at most 10000$\times$ less than the parameters compared to existing approaches. The subsequent segmentation-based cell type classification processes show satisfactory results that such automatic recognizing algorithms are accurate and efficient to execeute in hematological laboratories.

Axonal degeneration resulting from optic nerve damage can lead to the progressive death of retinal ganglion cells (RGCs), culminating in irreversible vision loss. We contrasted two methods for inducing optic nerve damage: optic nerve compression (ONCo) and optic nerve crush (ONCr). These were assessed for their respective merits in simulating traumatic optic neuropathies and neurodegeneration. We also administered neural progenitor cells (NPCs) into the subtenon space to validate their potential in mitigating optic nerve damage. Our findings indicate that both ONCo and ONCr successfully induced optic nerve damage, as shown by increased ischemia and expression of genes linked to neuronal regeneration. Post NPCs injection, recovery in the expression of neuronal regeneration-related genes was more pronounced in the ONCo model than in the ONCr model, while inflammation-related gene expression saw a better recovery in ONCr. In addition, proteomic analysis of R28 cells in hypoxic conditions identified Vps35 and Syntaxin12 genes. Vps35 preserved mitochondrial function in ONCo, while Syntaxin12 appeared to restrain inflammation via the Wnt/β-catenin signaling pathway in ONCr. NPCs managed to restore damaged RGCs by elevating neuroprotection factors and controlling inflammation through mitochondrial homeostasis and Wnt/β-catenin signaling in hypoxia-injured R28 cells and in both animal models. Our results suggest that ischemic injury and crush injury cause optic nerve damage via different mechanisms, which can be effectively simulated using ONCo and ONCr, respectively. Moreover, cell-based therapies such as NPCs may offer promising avenues for treating various optic neuropathies, including ischemic and crush injuries.

(1) Background: This study aimed to identify the recurrence and survival rates according to the mismatch repair (MMR), p53, and L1 cell adhesion molecule (L1CAM) states in patients with advanced and recurrent endometrial cancer receiving systemic chemotherapy.; (2) Methods: This single-center retrospective cohort study included chemotherapy-naïve patients (n=156) with advanced-stage (III/IV) or recurrent endometrial cancer who were administered chemotherapy as adjuvant therapy (n=112) or first-line palliative treatment (n=44) between January 2015 and June 2022. MMR and p53 states were assessed using PCR, and L1CAM was tested using immunohistochemistry in the no specific molecular profile (NSMP) group. The primary outcomes were progression-free survival (PFS) and overall survival (OS).; (3) Results: Of the 156 patients, 62 (39.7%), 53 (34.0%), and 41 (26.3%) had NSMP, abnormal p53 (p53abn), and an MMR deficiency (MMR-D), respectively. PFS and OS were longest in MMR-D, followed by NSMP, and were the least in p53abn tumors (PFS: p=0.0006, OS: p=0.0013). After NSMP was classified according to positive or negative L1CAM status, the L1CAM-negative group exhibited significantly lower survival rates than the L1CAM-positive group (PFS: p=0.0001, OS: p=0.0027); p53abn tumors were independent prognostic factors for poor PFS (p=0.039 on the multivariable analysis).; (4) Conclusions: In chemotherapy-naïve patients with advanced and recurrent endometrial cancer, the best prognosis after chemotherapy was obtained using MMR-D, followed by NSMP and p53abn tumors. The L1CAM status is a useful new marker for stratifying NSMP in advanced and recurrent patients.

Smart City has emerged as the mainstream paradigm for urban governance innovation, sustainable development, and strategy upgrades, which is drawing attention from scholars worldwide. However, current frameworks for Smart City assessment remain incomplete and simplistic. In is paper, 30 national or provincial capitals in China were selected and we designed a tri-dimensional SPI model—Social, Physical, and Information Space—for smart city spatial development assessment. Utilizing methods such as entropy weighting, coupled coordination degree models, and the Dagum Gini coefficient, this study assesses the spatial development and coupled coordination of 30 cities from 2011 to 2019. Finally, by means of BP neural networks, the study examines the contribution of each indicator to the spatial coupled coordination. The results indicated that with a narrowing disparity in development speeds among different regions, the spatial coupled coordination development level of smart capitals in China has steadily increased, presenting a pattern of staggered distribution. Moreover, the IS subsystem plays the most significant role in coupled coordination. The significance of this research lies in its tri-dimensional spatial perspective of the spatial development and coupled coordination differences of the Smart City, providing evidence-based support for the regional layout and optimization in China.

The intricate functionality of the vertebrate retina relies on the interplay between neurotransmitter activity and calcium dynamics, offering important insights into de-velopmental processes, physiological functioning, and disease progression. Neuro-transmitters orchestrate cellular processes to shape the behavior of the retina under diverse circumstances. Despite research to elucidate the roles of individual neuro-transmitters in the visual system, there remains a gap in our understanding of the holistic integration of their interplay with calcium dynamics in the broader context of neuronal development, health, and disease. To address this gap, the present review explores the mechanisms used by the neurotransmitters glutamate, GABA, glycine, dopamine, and acetylcholine and their interplay with calcium dynamics. This con-ceptual outline is intended to inform and guide future research, underpinning novel therapeutic avenues for retinal-associated disorders.

In this paper, we redefine the boundaries of blood cell classification, expanding from 5 to 11 distinct blood cell types using the challenging 11-class PBC dataset. This shift enables a deeper understanding of blood cell diversity, overcoming previous limitations in medical image analysis. Our approach combines state-of-the-art deep learning techniques, including pre-trained ConvNets, ViTb16 models, and custom CNN architectures. We employ transfer learning, fine-tuning, and ensemble strategies, such as CBAM and Averaging ensembles, to achieve unprecedented accuracy and interpretability. Our fully fine-tuned EfficientNetV2 B0 model sets a new standard, with a macro-average precision, recall, and F1-score of 91%, 90%, and 90%, respectively, and an average accuracy of 93%. This breakthrough underscores the transformative potential of 11-class blood cell classification for more precise medical diagnoses. Moreover, our groundbreaking "Naturalize" augmentation technique produces remarkable results. The 2K-PBC dataset generated with "Naturalize" boasts a macro-average precision, recall, and F1-score of 97%, along with an average accuracy of 96% when leveraging the fully fine-tuned EfficientNetV2 B0 model. This innovation not only elevates classification performance but also addresses data scarcity and bias in medical deep learning. Our research marks a paradigm shift in blood cell classification, enabling more nuanced and insightful medical analyses. The "Naturalize" technique’s impact extends beyond blood cell classification, emphasizing the vital role of diverse and comprehensive datasets in advancing healthcare applications through deep learning.

In this paper, we demonstrate that fixed-weight layers, generated from random distribution or logistic functions, can effectively extract significant features from input data, resulting in high accuracy on a variety of tasks, including Fisher’s iris, Wisconsin Breast Cancer, and MNIST datasets. We have observed that logistic functions yield high accuracy with less dispersion in results. We have also assessed the precision of our approach under conditions of minimizing spikes number generated in the network, it is a practically useful for reducing energy consumption in spiking neural networks. Our findings reveal that the proposed method demonstrates a highest accuracy on Fisher’s iris and MNIST datasets with logistic regression. Furthermore, they surpass the accuracy of the conventional (non-spiking) approach using logistic regression in the case of Wisconsin Breast Cancer. We have also investigated the impact of non-stochastic spike generation on accuracy.

Metalloproteinases are zinc-dependent endopeptidases that function as primary effectors of tissue remodelling, cell-signalling, and many other roles. Their regulation is ferociously complex, and is exquisitely sensitive to their molecular milieu, making in vivo studies challenging. Phenanthroline (PhN) is an inexpensive, broad-spectrum inhibitor of metalloproteinases that functions by chelating the catalytic zinc ion, however its use in vivo has been limited due to suspected off-target effects. PhN is very similar in structure to phenanthrene (Phe), a well-studied poly aromatic hydrocarbon (PAH) known to cause toxicity in aquatic animals by activating the aryl hydrocarbon receptor (AhR). We show that zebrafish are more sensitive to PhN than Phe, and that PhN causes a superset of the effects caused by Phe. Morpholino knock-down of the AhR rescues the effects of PhN that are shared with Phe, suggesting these are due to PAH toxicity. The effects of PhN that are not shared with Phe (specifically disruption of neural crest development and angiogenesis) involve processes known to depend on metalloproteinase activity. Furthermore these PhN-specific effects are not rescued by AhR knock-down, suggesting that these are bona fide effects of metalloproteinase inhibition, and that PhN can be used as a broad spectrum metalloproteinase inhibitor for studies with zebrafish in vivo.

Neuronal cell fate is predominantly controlled by the effects of growth factors, such as neurotrophins, and the activation of a variety of signaling pathways acting through neurotrophin receptors, namely Trk and p75 (p75NTR). Despite their beneficial effects on brain function, their therapeutic use is compromised, due to their polypeptidic nature and blood–brain-barrier impermeability. To overcome these limitations, our previous studies have proven that DHEA-derived synthetic analogs can act like neurotrophins, lacking endocrine side effects. The present study focuses on the biological characterization of a newly synthesized analog, ENT-A044, and its role on inducing cell specific functions of p75NTR. We show that ENT-A044 can induce cell death and phosphorylation of JNK protein by activating p75NTR. Additionally, ENT-A044 can induce the phosphorylation of TrkB receptor, indicating that our molecule can activate both neurotrophin receptors, leading towards the protection of neuronal populations that express both receptors. Furthermore, the present study demonstrates for the first time the expression of p75NTR in human induced Pluripotent Stem Cells - derived Neural Progenitor Cells (hiPSCs - derived NPCs) and receptor-dependent cell death induced by ENT-A044 treatment. In conclusion, ENT-A044 could be proven a lead molecule for the development of novel pharmacological agents, aiming on new therapeutic approaches and research tools, by controlling p75NTR actions.

Iron ore processing involves critical steps that affect the quality of the final product. Determining the diameter of the pellets is the necessary initial step for volume measurement and, ultimately, for porosity and bulk density measurement, crucial characteristics for optimizing the burning process in the blast furnace. Traditional measurement methods using mercury present issues related to operator safety and environmental preservation, while the practices described in ISO 4698 standard require lengthy preparation and execution time. In light of environmental needs, operator safety, and the time consumed in tests, implementing a new method based on digital image processing and convolutional neural networks for measuring the diameter of burnt iron ore pellets is proposed. The methodology involves capturing images of the pellets using a high-resolution camera and utilizing digital image processing and neural networks capable of performing pixel-by-pixel object segmentation in the images, providing precise information about the pellets to calculate their volume automatically. The results were compared with those obtained using traditional methods, evaluating their conformity with the ISO 4698 standard. In conclusion, this study offers a new approach to measuring the volume of burnt iron ore pellets, providing accurate and reliable results in compliance with safety and environmental preservation standards.

Machine learning (ML) has a large capacity to learn and analyze a large volume of data. This study aimed to train different algorithms to discriminate between healthy and pathologic corneal images by evaluating digitally processed spectral-domain optical coherence tomography (SD-OCT) corneal images. A set of 22 SD-OCT images belonging to a random set of corneal pathologies was compared to 71 healthy corneas (control group). A binary classification method was applied; three approaches of ML were used. Once all images were analyzed, representative areas from every digital image were also processed and analyzed for a statistical feature comparison between healthy and pathologic corneas. The best performance was obtained from transfer learning - support vector machine (TL-SVM) (AUROC = 0.94, SPE 88%, SEN 100%) and transfer learning – random forest (TL- RF) method (AUROC = 0.92, SPE 84%, SEN 100%), followed by convolutional neural network (CNN) (AUROC = 0.84, SPE 77%, SEN 91%) and random forest (AUROC = 0.77, SPE 60%, SEN 95%). The highest diagnostic accuracy in classifying corneal images was achieved with the TL-SVM and the TL-RF models. In image classification, CNN was a strong predictor. This pilot experimental study developed a systematic mechanized system to discern pathologic from healthy corneas.

Previously we demonstrated, in rats, that the treatment with growth hormone (GH) and rehabilitation, carried out immediately after a motor cortical ablation, significantly improved the motor affectation produced by the lesion and induced the re-expression of nestin in the contralateral motor cortex. Here we analyze cortical proliferation after ablation of the frontal motor cortex and investigate the re-expression of nestin in the contralateral motor cortex and the role of the striatum and thalamus in motor recovery. The rats were subjected to ablation of the frontal motor cortex in the dominant hemisphere or sham-operated and immediately treated with GH or vehicle (V), for five days. At 1 dpi (days after injury), 5 rats received daily injections (4 days) of bromodeoxyuridine and were sacrificed. The other 15 rats (n = 5 / group) underwent treatment and rehabilitation and were sacrificed at 25 dpi. GH induced the greatest number of proliferating cells in the perilesional cortex. GH and rehabilitation produced the functional recovery of the motor lesion and increased the expression of nestin in the striatum. In the thalamic ventral nucleus ipsilateral to the lesion, cells positive for nestin and actin were detected, but this was independent of GH. Our data suggest that GH-induced striatal nestin is involved in motor recovery.

Keywords: Аrtificial neural network, electric drive system, database, stability, training algorithm, technological mechanisms.

Deep Learning (DL) has made significant advances in computer vision with the advent of Vision Transformers (ViT). Unlike Convolutional Neural Networks (CNNs), ViTs use self-attention to extract both local and global features from image data, and then use residual connections to feed these features directly into a fully networked multilayer perceptron head. In hospitals, hematologists prepare peripheral blood smears (PBSs) and read them under a medical microscope to detect abnormalities in blood counts such as leukemia. However, this task is time-consuming and prone to human error. This study investigates the transfer learning process of Google ViT and ImageNet CNNs to automate the reading of PBSs. The study used two online PBS datasets, PBC and BCCD, and transferred them into balanced datasets to investigate the influence of data amount and noise immunity on both neural networks. The PBC results show that Google ViT is an excellent DL neural solution for data scarcity. The BCCD results show that Google ViT is superior to ImageNet CNNs in dealing with unclean, noisy image data because it is able to extract both global and local features and use residual connections, despite the additional time and computational overhead.

One of the most effective image processing techniques is the use of convolutional neural networks, where we combine intensity values at grid points in the vicinity of each point. To speed up computations, researchers have developed a dilated version of this technique, in which only some points are processed. It turns out that the most efficient case is when we select points from a sub-grid. In this paper, we explain this empirical efficiency proving that the sub-grid is indeed optimal – in some reasonable sense. To be more precise, we prove that all reasonable optimality criteria, the optimal subset of the original grid is either a sub-grid, or a sub-grid-like set.

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a new approach to ONNs based on integrated Kerr micro-combs that is programmable, highly scalable and capable of reaching ultra-high speeds, demonstrating the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths to achieve a single-unit throughput of 11.9 Giga-OPS at 8 bits per OP, or 95.2 Gbps. We test the perceptron on handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. By scaling the perceptron to a deep learning network using off-the-shelf telecom technology we can achieve high throughput operation for matrix multiplication for real-time massive data processing.

The informational synthesis of neural structures, processes, parameters and characteristics that allow a unified description and modeling as neural machines of natural and artificial neural systems is presented. The general informational parameters as the global quantitative measure of the neural systems computing potential as absolute and relative neural power were proposed. Neural information organizing and processing follows the way in which nature manages neural information by developing functions, functionalities and circuits related to different internal or peripheral components and also to the whole system through a non-deterministic memorization, fragmentation and aggregation of afferent and efferent information, deep neural information processing representing multiple alternations of fragmentation and aggregation stages. The relevant neural characteristics were integrated into a neural machine type model that incorporates unitary also peripheral or interface components as the central ones. The proposed approach allows overcoming the technical constraints in artificial computational implementations of neural information processes and also provides a more relevant description of natural ones.

The intracranial pressure (ICP) signal, as monitored on patients in intensive care units, contains pulses of cardiac origin where P1 and P2 subpeaks can often be observed. When calculable, the ratio of their relative amplitudes is an indicator of the patient’s cerebral compliance. This characterization is particularly informative on the overall state of the cerebrospinal system. We developed a recurrent neural network-based framework for P2/P1 ratio computation that only takes a raw ICP signal as an input. Two tasks are performed, namely pulse classification and subpeak designation. Pulse classification was achieved with an area under the curve of 0.90 on a 4,344-pulse testing dataset, while the peak designation algorithm identified pulses with a P2/P1 ratio > 1 with a 97.3% accuracy. Although it still needs to be evaluated on a larger number of labeled recordings, our automated P2/P1 ratio calculation framework appears to be a promising tool for improving bedside monitoring devices.

An earthquake is a natural event by its general definition. This natural event is a disaster that causes significant damage, loss of life, and other economic effects that will damage the state. The possibility of predicting a natural event such as an earthquake will minimize the reasons mentioned. Data collection, data processing, and data evaluation were carried out in this study. Earthquake forecasting was performed using the data and the RNN (Recurrent Neural Network) method. The study was carried out on seismic data with a magnitude of 3.0 and above belonging to Düzce Province between 1990 and 2022. In order to increase the learning potential of the method, the b and d values of the earthquake were calculated and included in the data set, except for the earthquake magnitude. The determination of earthquakes in a specific time interval in regions of Turkey, the classification of earthquake-related seismic data using artificial neural networks, and the production of predictions for the future reveal the importance of this study.

This paper investigates the dynamic properties of artificial neural networks using differential equations and explores the influence of parameters on stability and neural oscillations. By analyzing the equilibrium point of the differential equations, we identify conditions for asymptotic stability and criteria for oscillation in artificial neural networks. Furthermore, we demonstrate how adjusting synaptic weights between neurons can effectively control stability and oscillation. The proposed model offers potential insights into the malfunctioning mechanisms of biological neural networks implicated in neurological disorders like Parkinson's disease tremors and epilepsy seizures, which are characterized by abnormal oscillations.

Multiply-accumulate calculations using a memristor crossbar array is an important method to realize neuromorphic computing. However, the memristor array fabrication technology is still immature, and it is difficult to fabricate large-scale arrays with high-yield, which restricts the development of memristor-based neuromorphic computing technology. Therefore, cascading small-scale arrays to achieve the neuromorphic computational ability that can be achieved by large-scale arrays, which is of great significance for promoting the application of memristor-based neuromorphic computing. To address this issue, we present a memristor-based cascaded framework with some basic computation units, several neural network processing units can be cascaded by this means to improve the processing capability of the dataset. Besides, we introduce a split method to reduce pressure of input terminal. Compared with VGGNet and GoogLeNet, the proposed cascaded framework can achieve 93.54% Fashion-MNIST accuracy under the 4.15M parameters. Extensive experiments with Ti/AlOx/TaOx/Pt we fabricated are conducted to show that the circuit simulation results can still provide a high recognition accuracy, and the recognition accuracy loss after circuit simulation can be controlled at around 0.26%.

Machine learning (ML) has found increasing use in research on energy conversion and storage technologies, in particular, so-called sustainable technologies. While often ML is used to directly optimize the parameters or phenomena of interest in the space of features, in this perspective, we focus on using ML to construct objects and methods that help in or enable the modeling of the underlying phenomena. We highlight the need for machine learning from very sparse and unevenly distributed numeric data in multidimensional spaces in these applications. After a brief introduction of some common regression-type machine learning techniques, we will focus on more advanced ML techniques which use these known methods as building blocks of more complex schemes and thereby allow working with extremely sparse data and also allow generating insight. Specifically, we will highlight the utility of using representations with sub-dimensional functions by combining the high-dimensional model representation ansatz with machine learning methods like neural networks or Gaussian process regressions in applications ranging from heterogeneous catalysis to nuclear energy.

This research investigates the application of deep learning in sentiment analysis of Canadian maritime case law. It offers a framework for improving maritime law and legal analytics policy-making procedures. The automation of legal document extraction takes center stage, underscoring the vital role sentiment analysis plays at the document level. Therefore, this study introduces a novel strategy for sentiment analysis in Canadian maritime case law, combining sentiment case law approaches with state-of-the-art deep learning techniques. The overarching goal is to systematically unearth hidden biases within case law and investigate their impact on legal outcomes. Employing Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) based models, this research achieves a remarkable accuracy of 98.05% for categorizing instances. In contrast, Conventional Machine Learning techniques such as Support Vector Machines (SVM) yield an accuracy rate of 52.57%, Naive Bayes at 57.44 %, and Logistic Regression at 61.86%. The superior accuracy of the CNN and STM model combination underscores its usefulness in legal sentiment analysis, offering promising future applications in diverse fields like legal analytics and policy design. These findings mark a significant choice for AI-powered legal tools, presenting more sophisticated and sentiment-aware options for the legal profession.

A chronically stable electrode material with low impedance for recording neural activity and high charge-injection capacity for functional electro-stimulation is desirable for the fabrication of implantable microelectrode arrays that aims to restore impaired or lost neurological functions in humans. For this purpose, we have investigated the electrochemical properties of sputtered ruthenium oxide (RuOx) electrode coatings, deposited on planar microelectrode arrays, using an inorganic model of interstitial fluid (model-ISF) at 37o C as the electrolyte. Through a combination of cyclic voltammetry (CV) and electrochemical impedance spectroscopy (EIS) modelling study we have established the contribution of faradaic reaction as the major charge-injection contributor within the safe neural stimulation potential window of 0.6 V vs Ag|AgCl. We have also established the reversibility of the charge-injection process for sputtered RuOx film by applying constant charge-per-phase current stimulations at different pulse widths and by comparing the magnitudes of leading and trailing access voltages during voltage transient measurements. Finally, the impedance of the sputtered RuOx film was found to be reasonably comparable in both its oxidized and reduced states, although electronic contribution from capacitive double-layer was found to be slightly higher for the completely oxidized film around 0.6 V than its reduced counterpart around -0.6V.

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-OPS (TOPS - operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

This research investigates the implementation of complex exponential-based neurons in FPGA, which can pave the way for implementing bio-inspired spiking neural networks to compensate for the existing computational constraints in conventional artificial neural networks. The increasing use of extensive neural networks and the complexity of models in handling big data lead to higher power consumption and delays. Hence, finding solutions to reduce computational complexity is crucial for addressing power consumption challenges. The complex exponential form effectively encodes oscillating features like frequency, amplitude, and phase shift, streamlining the demanding calculations typical of conventional artificial neurons through levering simple phase addition of complex exponential functions. The article implements such a two-neuron and a multi-neuron neural model using Xilinx system generator and Vivado design suite, employing 8-bit, 16-bit, and 32-bit fixed-point data format representations. The study evaluates the accuracy of the proposed neuron model across different FPGA implementations while also providing a detailed analysis of operating frequency, power consumption, and resource usage for the hardware implementations. BRAM-based Vivado designs outperformed Simulink regarding speed, power, and resource efficiency. Specifically, the Vivado BRAM-based approach supported up to 128 neurons, showcasing optimal LUT and FF resource utilization. Such outcomes accommodate choosing the optimal design procedure for implementing spiking neural networks on FPGAs.

Biological neural network (BNN) is the core brain for creature to accomplish its intelligent behaviors through unique network structure and mechanisms. It also inspires controlling human-designed autonomous agents including robots to generate more advanced intelligent behaviors by mimicking the neural control mechanism of creatures at a deeper and more interactive level. Here, we constructed a whole-brain neural network model of Caenorhabditis elegans (C. elegans), which characterizes the electrochemical processes at the level of cellular synapse. The neural network simulation integrates computational programming and visualization of neurons and synapse connections of C. elegans, containing the specific controllable circuits summarization with their dynamic characteristics within the whole network. To illustrate its particular intelligent control capability in terms of robotics, we introduce the first innovative methodology for applying the BNN model to a 12-legged robot’s movement control based on the established numerical simulation platforms. We accomplished and designed two methods and corresponding encoding processes, one involving orientation control and the other involving locomotion generation, to demonstrate the intelligent control performance of BNN. Both simulation and experiment results indicate that the robot exhibits stronger autonomy and more intelligent moving performance under the control of BNN. We then summarized the contributions for digitalizing the C. elegans’ whole-brain neural network in real-time and utilizing it to control robot in a closed loop to validate its advanced intelligence control ability in terms of a scientific robot.

Speech recognition, or automatic speech recognition (ASR), is a technology designed to convert spoken language into text using software. However, conventional ASR methods involve several distinct components, including language, acoustic, and pronunciation models with dictionaries. This modular approach can be time-consuming and may influence performance. In this study, we propose a method that streamlines the speech recognition process by incorporating a unified recurrent neural network (RNN) architecture. Our architecture integrates a convolutional neural network (CNN) with an RNN and employs a connectionist temporal classification (CTC) loss function. Key experiments were carried out using a dataset comprising 576,656 valid sentences, using erosion techniques. Evaluation of the model performance, measured by the word error rate (WER) metric, demonstrated remarkable results, achieving a WER of 2%. This approach has significant implications for the realm of speech recognition, as it alleviates the need for labor-intensive dictionary creation, enhancing the efficiency and accuracy of ASR systems, and making them more applicable to real-world scenarios. For future enhancements, we recommend the inclusion of dialectal and spontaneous data in the dataset to broaden the model's adaptability. Additionally, fine-tuning the model for specific tasks can optimize its performance for targeted objectives or domains, further enhancing its effectiveness in those areas.

Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) have been utilised to forecast the foreign exchange market (Forex). However, such models usually exhibit unstable behaviour, as data perturbations often downgrade the functionality of the entire network due to their monolithic architecture. Hence, this study proposes a novel neuroscience-informed modular network applied to the closing prices and the sentiments retrieved from Yahoo Finance and Twitter APIs, aiming to anticipate better price fluctuations in Euro to British Pound Sterling (EUR/GBP) rather than monolithic methods. The proposed model is based on a new modular CNN, replacing pooling layers with orthogonal kernel initialisation RNNs coupled with Monte Carlo Dropout (MCD), namely MCoRNNMCD. It combines two modules: i) a convolutional simple RNN and ii) a convolutional Gated Recurrent Unit (GRU), where orthogonality and MCD are added to reduce the overfitting, assessing each module's uncertainty. These parallel feature extraction modules concatenate their outputs to a final three-layer Artificial Neural Network (ANN) decision-making module. A comprehensive comparison viewing objective evaluation metrics such as the Mean Square Error (MSE) proved that the proposed MCoRNNMCD-ANN outperformed single CNN, LSTM, GRU, and the state-of-the-art hybrid BiCuDNNLSTM, CLSTM, CNN-LSTM, and LSTM-GRU in forecasting hourly EUR/GBP closing price fluctuations.

In recent years, Neural networks are increasingly deployed in various fields to learn complex patterns and make accurate predictions. However, designing an effective neural network model is a challenging task that requires careful consideration of various factors, including architecture, optimization method, and regularization technique. This paper aims to comprehensively overview the state-of-the-art artificial neural network (ANN) generation and highlight key challenges and opportunities in machine learning applications. It provides a critical analysis of current neural network model design methodologies, focusing on the strengths and weaknesses of different approaches. Also, it explores the use of different learning approaches, including convolutional neural networks (CNN), deep neural networks (DNN), and recurrent neural networks (RNN) in image recognition, natural language processing, and time series analysis. Besides, it discusses the benefits of choosing the ideal values for the different components of ANN, such as the number of Input/output layers, hidden layers number, activation function type, epochs number, and model type selection, which help improve the model performance and generalization. Furthermore, it identifies some common pitfalls and limitations of existing design methodologies, such as overfitting, lack of interpretability, and computational complexity. Finally, it proposes some directions for future research, such as developing more efficient and interpretable neural network architectures, improving the scalability of training algorithms, and exploring the potential of new paradigms, such as Spiking Neural Networks, quantum neural networks, and neuromorphic computing.

Computer-aided image diagnostics (CAD) have been used in many fields of diagnostic medicine. It relies heavily on classical computer vision and artificial intelligence. Quantum neural network (QNN) has been introduced by many researchers around the world and presented recently by research corporations such as Microsoft, Google, and IBM. In this paper, the investigation of the validity of using the QNN algorithm for machine-based breast cancer detection was performed. To validate the learnability of the QNN, a series of learnability tests were performed alongside with classical convolutional neural network (CCNN). QNN is built using the Cirq library to perform the assimilation of quantum computation on classical computers. Series of investigations were performed to study the learnability characteristics of QNN and CCNN under the same computational conditions. The comparison was performed for real Mammogram data sets. The investigations showed success in terms of recognizing the data and training. Our work shows better performance of QNN in terms of successfully training and producing a valid model for smaller data set compared to CCNN.

Optical artificial neural networks (ONNs) — analog computing hardware tailored for machine learning [1,2] — have significant potential for ultra-high computing speed and energy efficiency [3]. We propose a new approach to architectures for ONNs based on integrated Kerr micro-comb sources [4] that is programmable, highly scalable and capable of reaching ultra-high speeds. We experimentally demonstrate the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths of a micro-comb to achieve a high single-unit throughput of 11.9 Giga-FLOPS at 8 bits per FLOP, corresponding to 95.2 Gbps. We test the perceptron on simple standard benchmark datasets — handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. This performance is a direct result of the record small wavelength spacing (49GHz) for a coherent integrated microcomb source, which results in an unprecedented number of wavelengths for neuromorphic optics. Finally, we propose an approach to scaling the perceptron to a deep learning network using the same single micro-comb device and standard off-the-shelf telecommunications technology, for high-throughput operation involving full matrix multiplication for applications such as real-time massive data processing for unmanned vehicle and aircraft tracking.

This article presents a detailed examination of the methodology and modeling tools utilized to analyze gas flow in pipelines, rooted in the fundamental principles of gas dynamics. The methodology integrates numerical simulations with modern neural network techniques, particularly focusing on the Physics-Informed Neural Network (PINN) method. This innovative approach combines artificial neural networks (ANNs) with physical equations, offering a more efficient and accurate way to model various complex processes and phenomena. The proposed mathematical model, based on the Euler equation, has been meticulously implemented using the Python language. Verification with analytical solutions ensures the accuracy and reliability of the computations. In the research, a comprehensive comparative analysis was conducted between results obtained using the PINN method and those from conventional Computational Fluid Dynamics (CFD) approaches. The analysis highlighted the advantages of the PINN method, which produced smoother pressure and velocity fluctuation profiles while reducing computation time, demonstrating its potential as a transformative modeling tool. The data derived from this study are of paramount importance for ensuring ongoing energy supply reliability and can also be used to create predictive models related to gas behavior in pipelines. The application of modeling techniques for gas flow simulation has the potential to revolutionize the integrity of our energy infrastructure and utilization of gas resources. However, it is crucial to emphasize that the effectiveness of such models relies on continuous monitoring and frequent updates to ensure alignment with real-world conditions. This research not only contributes to a deeper understanding of compressible gas flows but also underscores the crucial role of advanced modeling methodologies in the sustainable management of gas resources for both current and future generations.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

This study aimed at exploring what role artificial intelligence techniques could play in the futural numerical analysis. In this paper, a convolutional neural network techniques based on modified loss function is proposed as a surrogate of finite element method(FEM). Several surrogate-based physics-informed neural networks(PINNs) are developed to solve representative boundary value problems based on elliptic partial differential equations (PDEs). Results from the proposed surrogate-based approach are in good agreement with ones from conventional FEM. It is found that modification of the loss function could improve the prediction accuracy of the neural network. It is indicated that to some extent the artificial intelligence technique could replace conventional numerical analysis as a great surrogate model.

Forest fire identification is important for forest resource protection. Effective monitoring of forest fires requires the deployment of multiple monitors with different viewpoints, while most traditional recognition models can only recognize images from a single source. By ignoring the information from images with different viewpoints, these models produce high rates of missed and false alarms. In this paper, we propose a graph neural network model based on the similarity of dynamic features of multi-view images to improve the accuracy of forest fire recognition. The input features of the nodes on the graph are converted into relational features of different gallery pairs by establishing pairs (nodes) representing different viewpoint images and gallery images. The new feature library relationship is used to update the image gallery with dynamic features in order to achieve the estimation of similarity between images and improve the image recognition rate of the model. In addition, to reduce the complexity of image pre-processing process and extract key features in images effectively, this paper also proposes a dynamic feature extraction method for fire regions based on image segment ability. By setting the threshold value of HSV color space, the fire region is segmented from the image, and the dynamic features of successive frames of the fire region are extracted. The experimental results show that, compared with the baseline method Resnet, this paper's method is more effective in identifying forest fires, and its recognition accuracy is improved by 2%. And the scheme of this paper can adapt to different forest fire scenes, with better generalization ability and anti-interference ability.

Characterization of cancer cells and neural stem cells indicates that tumorigenicity and pluripotency are coupled cell properties determined by neural stemness, and tumorigenesis represents a process of progressive loss of original cell identity and gain of neural stemness. This reminds of a most fundamental process required for the development of the nervous system and body axis during embryogenesis, i.e., embryonic neural induction. Neural induction is that, in response to extracellular signals that are secreted by the Spemann-Mangold organizer in amphibians or the node in mammals and inhibit epidermal fate in ectoderm, the ectodermal cells lose their epidermal fate and assume the neural default fate and consequently, turn into neuroectodermal cells. They further differentiate into the nervous system and also some non-neural cells via interaction with adjacent tissues. Failure in neural induction leads to failure of embryogenesis, and ectopic neural induction due to ectopic organizer or node activity or activation of embryonic neural genes causes a formation of secondary body axis or a conjoined twin. During tumorigenesis, cells progressively lose their original cell identity and gain of neural stemness, and consequently, gain of tumorigenicity and pluripotency, due to various intra-/extracellular insults in cells of a postnatal animal. Tumorigenic cells can be induced to differentiation into normal cells and integrate into normal embryonic development within an embryo. However, they form tumors and cannot integrate into animal tissues/organs in a postnatal animal because of lack of embryonic inducing signals. Combination of studies of developmental and cancer biology indicates that neural induction drives embryogenesis in gastrulating embryos but a similar process drives tumorigenesis in a postnatal animal. Tumorigenicity is the manifestation of aberrant occurrence of pluripotent state in a postnatal animal. Pluripotency and tumorigenicity are both but different manifestations of neural stemness in pre- and postnatal stage, respectively, of animal life. The unique property of neural stemness is derived from the evolutionary advantage of neural genes and the neural-biased state of the last common unicellular ancestors of metazoan. Based on these findings, I discuss about some confusion in cancer research, propose to distinguish the causality and associations and discriminate causal and supporting factors involved in tumorigenesis, and suggest revisiting the focus of cancer research.

Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare system and patients’ information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD), and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays AI grants the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI challenges the role of the physician’s experience in PAD treatment.

Partial differential equations (PDEs) are used to describe a wide range of phenomena, such as heat transfer, fluid dynamics, and quantum mechanics. By solving PDEs, we can ob- tain insights into the behavior of the system and make predictions about its future evolution. Conventional numerical methods for obtaining the approximate solutions of PDEs may re- quire extensive computational resources and time, especially for complex PDEs and large- scale problems. The recently developed physics-informed neural network (PINN) has shown promise in a variety of scientific and engineering fields by incorporating physical laws into the loss functions of the neural network (NN). In addition, the training of PINN does not require ground truth data, but it has poor generalization ability to unseen domains. On the other hand, a convolutional neural network (CNN) has fast inference and better generalization ability, but it requires a large amount of training data. Taking the advantages of PINN and CNN by using Legendre multiwavelets (LMWs) as basis functions, we introduce a new method to approach the PDEs in this paper, namely Physics-Informed Legendre Multiwavelets CNN (PiLMWs-CNN), in order to continuously approximate a grid-based state representation that can be handled by a CNN. PiLMWs-CNN enable us to train our models using only physics-informed loss functions without any pre- computed training data, simultaneously providing fast and continuous solutions that gener- alize to previously unknown domains. In particular, the LMWs can simultaneously possess compact support, orthogonality, symmetry, high smoothness, and high approximation order. Compared to orthonormal polynomial (OP) bases, the approximation accuracy can be greatly increased and computation costs can be significantly reduced by using LMWs. We applied PiLMWs-CNN to approximate the damped wave equation, incompressible Navier-Stokes (N- S) equation, and two-dimensional heat conduction equation. The experimental results show that this method provides more accurate, efficient, and fast convergence with better stability when approximating the solution of PDEs.

Human activity recognition (HAR) using wearable sensors is gaining popularity in the healthcare domain, enabling continuous monitoring and timely interventions. The conventional HAR systems are centralised and need data sharing with a server for processing and model training. However, this data sharing leads to various challenges, such as privacy concerns, increased communication and storage costs, inefficient computational algorithms, data scarcity due to unwillingness to share, and difficulty achieving high accuracy and personalised models simultaneously. To overcome these challenges, this paper introduces a privacy and energy-aware federated learning (FL) framework for model training without data sharing. The proposed scheme incorporates spiking neural networks (SNNs), which are particularly suited for resource-constrained devices due to their event-driven information processing. The key idea is to synergise the strengths of SNNs and long short-term memory (LSTM) to create a hybrid model for robust HAR. The proposed hybrid spiking LSTM (S-LSTM) model uses the LSTM as an input layer to capture temporal dependencies efficiently, followed by spiking layers that replace the typical activation using leaky integrate-and-fire neurons. We employ the combination of surrogate gradient learning and backpropagation through time (BPTT) to update the weights of SNN layers in a supervised manner. The performance of the proposed model is evaluated using two publicly available datasets for both indoor and outdoor scenarios. The results show that the proposed S-LSTM performs much better than spike convolutional neural networks (S-CNN) and simple CNN, achieving the accuracy of 97% and 87% for indoor and outdoor datasets, respectively. Personalisation, also known as fine-tuning the global model using local data, is crucial in HAR. It allows the model to adapt to individual behaviour and preferences, making predictions more accurate. The results also show that personalisation improves the performance of participants up to 9% on average. Additionally, analysis with 50% random client participation reduces communication costs by 50% with minimal impact on accuracy.

A scalable optical convolutional neural network (SOCNN) based on free-space optics and Koehler illumination was proposed to address the limitations of the previous 4f correlator system. Unlike Abbe illumination, Koehler illumination provides more uniform illumination and reduces crosstalk. SOCNN allows for scaling up of the input array and the use of incoherent light sources. Hence, the problems associated with 4f correlator systems can be avoided. We analyzed the limitations in scaling the kernel size and parallel throughput and found that SOCNN can offer a multilayer convolutional neural network with massive optical parallelism.

This study uses machine learning to predict the convergence results of the Duffing equation with and without damping. The Duffing equation represents a nonlinear second-order differential equation with interesting behavior in undamped free vibration and forced vibration with damping. Convergence alternates randomly between 1 and -1 in undamped free vibration, depending on initial conditions. For forced vibration with damping, multiple factors influence vibration patterns. We utilize the fourth-order Runge-Kutta method to collect convergence results for both conditions. Machine learning techniques, specifically the long short term memory (LSTM) and LSTM-Neural Network (LSTM-NN) method, are employed to predict these convergence values. The LSTM-NN model is a hybrid approach that combines the LSTM method with the addition of hidden layers of neurons. Both the LSTM and LSTM-NN models are thoroughly explored and analyzed in this research. The research process involves three stages: data preprocessing, training, and verification. The results show that the LSTM-NN model becomes more adept at predicting binary datasets, boasting an impressive accuracy of up to 98%. However, when it comes to predicting multiple solutions, the traditional LSTM method outperforms the LSTM-NN approach.

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-FLOPS (floating point operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

There are several challenges on how to attain energy efficiency while maintaining balance among factors affecting energy consumption such as power rating and temperature setpoints of cooling units, room temperature and humidity, and indoor air quality (IAQ). A real-time energy and IAQ monitoring system were installed in an educational building to profile the operational power consumption of inverter-based air condition unit (ACU) installed in each room. Polynomial curve and neural fitting regression analysis were applied to the real-time power consumption, indoor temperature and humidity, and carbon dioxide (CO2) level data. The derived models were able to provide the stabilizing indoor thermal and air conditions of the room to reach steady state ACU power consumption. These collected data and calculated parameters can be used to define rules in automating control of cooling appliances for an efficient energy utilization. The regression approaches, using real-time data, have determined the influence of indoor heat conditions and carbon dioxide levels on ACU power consumption. These parameters were utilized to establish consistent values for temperature, humidity, and carbon dioxide levels under stable settings of inverter-based air conditioning units.

Speech recognition, also known as automatic speech recognition (ASR), is a technology that enables software to transcribe spoken language into text. However, existing Amharic ASR methods require multiple separate blocks, such as language, acoustic, and pronunciation models with dictionaries, which can be time-consuming and influence performance. This study proposes an approach that replaces much of the speech pipeline with a single recurrent neural network (RNN) architecture. Our proposed architecture is based on a hybrid approach that combines a convolutional neural network (CNN) with a recurrent neural network (RNN) and a connectionist temporal classification (CTC) loss function. We conducted several experiments with noisy audio data that contain 20,000 valid sentences. The model was evaluated using the word error rate (WER) metric, achieving impressive results of 7% WER on noisy data. This approach has significant implications for the field of speech recognition, as it reduces the human effort required to create dictionaries and improves the efficiency and accuracy of ASR systems, making them more practical for real-world applications.

Creating self-learning algorithms, developing deep neural networks and improving other methods that "learn" for various areas of human activity is the main goal of the theory of machine learning. It helps to replace the human with a machine, aiming to increase the quality of production. The theory of artificial neural networks, which already have replaced the humans in problems of detection of moving objects, recognition of images or sounds, time series prediction, big data analysis and numerical methods remains the most dispersed branch of the theory of machine learning. Certainly, for each area of human activity it is necessary to select appropriate neural network architectures, methods of data processing and some novel tools from applied mathematics. But the universal problem for all these neural networks with specific data is the achieving the highest accuracy in short time. Such problem can be resolved by increasing sizes of architectures and improving data preprocessing, where the accuracy rises with the training time. But there is a possibility to increase the accuracy without time growing, applying optimization methods. In this survey we demonstrate existing optimization algorithms of all types, which can be used in neural networks. There are presented modifications of basic optimization algorithms, such as stochastic gradient descent, adaptive moment estimation, Newton and quasi-Newton optimization methods. But the most recent optimization algorithms are related to information geometry, for Fisher-Rao and Bregman metrics. This approach in optimization extended the theory of classic neural networks to quantum and complex-valued neural networks, due to geometric and probabilistic tools. There are provided applications of all introduced optimization algorithms, what delighted many kinds of neural networks, which can be improved by including any advanced approaches in minimization of the loss function. Afterwards, we demonstrated ways of developing optimization algorithms in further researches, engaging neural networks with progressive architectures. Classical gradient based optimizers can be replaced by fractional order, bilevel and, even, gradient free optimization methods. There is a possibility to add such analogues in graph, spiking, complex-valued, quantum and wavelet neural networks. Besides the usual problems of image recognition, time series prediction, object detection, there are many are other tasks for modern theory of machine learning, such as solving problem of quantum computations, partial differential and integro-differential equations, stochastic processes and Brownian motion, making decisions and computer algebra.

In the pursuit of energy efficiency and reduced environmental impact, adequate ventilation in enclosed spaces is essential. This study presents a hybrid neural network model designed for real-time monitoring and prediction of environmental variables. The system comprises two phases: An IoT hardware-software platform for data acquisition and decision-making, and a hybrid model combining short-term memory and convolutional recurrent structures. The results are promising and hold potential for integration into parallel processing AI architectures.

In computer vision and image analysis, Convolutional Neural Networks (CNNs) and other deep learning models are at the forefront of research and development. These advanced models have proven to be highly effective in tasks related to computer vision. One technique that has gained prominence in recent years is the construction of ensembles using Deep CNNs. These ensembles typically involve combining multiple pre-trained CNNs to create a more powerful and robust network. The purpose of this study is to evaluate the effectiveness of building CNN ensembles by combining several advanced techniques. Tested here are CNN ensembles constructed by replacing ReLU layers with different activation functions, employing various data augmentation techniques, and utilizing several algorithms, including some novel ones, that perturb network weights. Experimental results performed across many data sets representing different tasks demonstrate that our proposed methods for building deep ensembles produces superior results. All the resources required to replicate our experiments are available at https://github.com/LorisNanni.

We present a simplified computational rule for the back-propagation formulas for artificial neural networks. In this work, we provide a generic two-step rule for the back-propagation algorithm in matrix notation. Moreover, this rule incorporates both the forward and backward phases of the computations involved in the learning process. Specifically, this recursively computing rule permits the propagation of the changes to all synaptic weights in the network, layer by layer, efficiently. In particular, we use this rule to compute both the up and down partial derivatives of the cost function of all the connections feeding into the output layer.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

Background: Disruption of alternative splicing (AS) is frequently observed in cancer and it might represent an important signature for tumor progression and therapy. Exon skipping (ES) represents one of the most frequent AS events and in non-small cell lung cancer (NSCLC) MET exon 14 skipping was shown to be targetable. Methods: We constructed a neural network (NN) specifically designed to detect MET exon 14 skipping events using RNAseq data. Furthermore, for discovery purpose we also developed a sparsely connected autoencoder to identify uncharacterized MET isoforms. Results: The NN had 100% Met exon 14 skipping detection rate, when tested on a manually curated set of 690 TCGA bronchus and lung samples. When globally applied to 2605 TCGA samples, we observed that the majority of false positives was characterized by a blurry coverage of exon 14, but interesting they share a common coverage peak in the second intron and we speculate that this event could be the transcription signature of a LINE1-MET fusion. Conclusions: Taken together our results indicate that neural networks can be an effective tool to provide a quick classification of pathological transcription events and sparsely connected autoencoders could represent the basis for the development of an effective discovery tool.

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a novel approach to ONNs that uses integrated Kerr optical micro-combs. This approach is programmable and scalable and is capable of reaching ultra-high speeds. We demonstrate the basic building block ONNs — a single neuron perceptron — by mapping synapses onto 49 wavelengths to achieve an operating speed of 11.9 x 10⁹ operations per second, or Giga-OPS, at 8 bits per operation, which equates to 95.2 gigabits/s (Gbps). We test the perceptron on handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. By scaling the perceptron to a deep learning network using off-the-shelf telecom technology we can achieve high throughput operation for matrix multiplication for real-time massive data processing.

Real-world time series data sets contain a combination of linear and nonlinear patterns, making the time series forecasting problem more challenging. In this paper, a new hybrid methodology is introduced for forecasting univariate time series data sets using a multiplicative error modeling approach. An autoregressive integrated moving average (ARIMA) model is combined with an autoregressive neural network (ARNN) for improving the predictions of individual forecast models. The proposed multiplicative ARIMA-ARNN model glorifies the chances of capturing the different combinations of linear and nonlinear patterns in time series. The model shows outstanding performance on six standard time-series data sets compared to other widely used single and hybrid forecasting models.

Using smartphone especially android platform has already got eighty percent market shares, due to aforementioned report, it becomes attacker’s primary goal. There is a growing number of private data onto smart phones and low safety defense measure, attackers can use multiple way to launch and to attack user’s smartphones.(e.g. Using different coding style to confuse the software of detecting malware). Existing android malware detection methods use multiple features, like safety sensor API, system call, control flow structure and data information flow, then using machine learning to check whether its malware or not. These feature provide app’s unique property and limitation, that is to say, from some perspectives it might suit for some specific attack, but wouldn’t suit for others. Nowadays most malware detection methods use only one aforementioned feature, and these methods mostly analysis to detect code, but facing the influence of malware’s code confusion and zero-day attack, aforementioned feature extraction method may cause wrong judge. So, it’s necessary to design an effective technique analysis to prevent malware. In this paper, we use the importance of word from apk, because of code confusion, some malware attackers only rename variables, if using general static analysis wouldn’t judge correctly, then use these importance value to go through our proposed method to generate picture, finally using convolutional neural network to see whether the apk file is malware or not.

Deep learning is emerging in many industrial sectors in hand with big data analytics to streamline production. In the biomanufacturing sector, big data infrastructure is lagging comparatively to other industries. A promising approach is to combine Deep Neural Networks (DNN) with prior knowledge in Hybrid Neural Network (HNN) workflows that are less dependent on the quality and quantity of data. This paper reviews published articles over the past 30 years on the topic of HNN applications to bioprocesses. It revealed that HNNs were applied to various bioprocesses, including microbial cultures, animal cells cultures, mixed microbial cultures, and enzyme biocatalysis. HNNs were mainly applied for process analysis, process monitoring, development of software sensors, open- and closed-loop control, batch-to-batch control, model predictive control, intensified design of experiments, quality-by-design, and recently for the development of digital twins. Most previous HNN studies combined shallow Feedforward Neural Networks (FFNNs) with physical laws, such as macroscopic material balance equations, following the semiparametric design principle. Only recently, deep HNNs based on deep FFNNs, Convolution Neural Networks (CNN), Long Short-Term Memory (LSTM) networks and Physics Informed Neural Networks (PINNs) have been reported. The biopharma sector is currently a major driver but applications to biologics quality attributes, new modalities, and downstream processing are significant research gaps.

Intracortical microelectrode arrays (MEAs) can be used in a range of applications, from basic neuroscience research to providing an intimate interface with the brain as part of a Brain-Computer Interface (BCI) system aimed to restore function for people living with neurological disorders or injuries. Unfortunately, MEAs tend to fail prematurely, leading to a loss in functionality for many applications. An important contributing factor in MEA failure is oxidative stress resulting from chronically inflammatory-activated microglia and macrophages releasing reactive oxygen species (ROS) around the implant site. Antioxidants offer a means for mitigating oxidative stress and improving tissue health and MEA performance. Here, we investigate using the clinically available antioxidant dimethyl fumarate (DMF) to reduce the neuroinflammatory response and improve MEA performance in a rat MEA model. Daily treatment of DMF for 16 weeks resulted in a significant improvement in the recording capabilities of MEA devices during the sub-chronic (Weeks 5-11) phase (42% active electrode yield vs. 35% for control). However, these sub-chronic improvements were lost in the chronic implantation phase, as a more exacerbated neuroinflammatory response occurs in DMF-treated animals by 16 weeks post-implantation. Yet, neuroinflammation was indiscriminate between treatment and control groups during the sub-chronic phase. Although worse for chronic use, a temporary improvement (<12 weeks) in MEA performance is meaningful. Providing short-term improvement to MEA devices using DMF can allow for improved use for limited-duration studies. Further efforts should be taken to explore the mechanism behind a worsened neuroinflammatory response at the 16-week time point for DMF-treated animals to assess its usefulness to specific applications.

Abstract: It has been shown that three-dimensional self-assembled multicellular structures derived from human pluripotent stem cells show electrical activity similar to EEG. More recently, neurons were successfully embedded in a digital game-worlds (Kagan, et al. 2022). The biologically inspired neural network (BNN), expressing human cortical cells, was able to show internal modification and learn the task at hand (predicting the trajectory of a digital ball while moving a digital paddle). In other words, the system allowed to read motor information and write sensory data into cell cultures. In this article, we discuss Neural Correlates of Consciousness (NCC) theories, and their capacity to predict or even allow for consciousness in a BNN. We found that In-formation Integration Theory (IIT) is the only NCC that offers the possibility for a BNN to show consciousness. IIT argues that any system capable of integrating information will have some degree of phenomenal consciousness. The pattern of activity appearing in the BNN, with increased density of sensory information leading to better performance, implies that the BNN could be conscious. This may have profound implications from a physiological, philosophical, and ethical perspective.

This article presents a forecast model that uses a hybrid architecture of recurrent neural networks (RNN) with surface neural networks (ANN), based on historical records of exported active energy (EAE) and weather data. Two types of models were developed: the first type includes six models that use EAE records and weather variables as inputs, while the second type includes eight models that use only weather variables. Different metrics were applied to assess the performance of these models, and the best model of each type was selected. Finally, a comparison of the performance between the selected models of both types is presented, and they are validated with real data provided by a solar plant, achieving acceptable levels of accuracy. The selected model of the first type has an RMSE of 0.19, MSE of 0.03, MAE of 0.09, a correlation coefficient of 0.96, and a determination coefficient of 0.93. The other selected model of the second type showed lower precision in the metrics (RMSE = 0.24, MSE = 0.06, MAE = 0.10, Corr. Coef. = 0.95, and Det. Coef. = 0.90). Both models demonstrated good performance and acceptable accuracy in forecasting the weekly photovoltaic energy production of the solar plant.

Sense element engagement theory explains how neural networks produce cortical prosthetic vision. A major prediction of the theory can be tested by developing a device which is expected to enable perception of continuous forms in altered visual geometries. The research reported here completes several essential steps in developing this device: (1) replication of simulations that are consistent with the theory using the NEST simulator, which can also be used for full-scale network emulation by a neuromorphic computer; (2) testing whether results consistent with the theory survive increasing the scale and duration of simulations; (3) establishing a method that uses numbers of spikes produced by network neurons to report the number of phosphenes produced by cortical stimulation; and (4) simulating essential functions of the prosthetic device. NEST simulations replicated early results and increasing their scale and duration produced results consistent with the theory. A decision function created using multinomial logistic regression correctly classified the expected number of phosphenes for 2080 spike number distributions for each of three sets of data, half of which arise from simulations expected to yield continuous visual forms on an altered visual geometry. A process for modulating electrical stimulation amplitude based on intermittent population recordings that is predicted to produce continuous visual forms was successfully simulated. The classification function developed using logistic regression will be used to tune this process as the scale of simulations is further increased.

Deep learning models are part of the family of artificial neural networks and, as such, it suffers of catastrophic interference when they learn sequentially. In addition, most of these models have a rigid architecture which prevents the incremental learning of new classes. To overcome these drawbacks, in this article we propose the Self-Improving Generative Artificial Neural Network (SIGANN), a type of end-to-end Deep Neural Network system which is able to ease the catastrophic forgetting problem when leaning new classes. In this method, we introduce a novelty detection model to automatically detect samples of new classes, moreover an adversarial auto-encoder is used to produce samples of previous classes. This system consists of three main modules: a classifier module implemented using a Deep Convolutional Neural Network, a generator module based on an adversarial autoencoder; and a novelty detection module, implemented using an OpenMax activation function. Using the EMNIST data set, the model was trained incrementally, starting with a small set of classes. The results of the simulation show that SIGANN is able to retain previous knowledge with a gradual forgetfulness for each learning sequence. Moreover, SIGANN can detect new classes that are hidden in the data and, therefore, proceed with incremental class learning.

The emerging use of visualization techniques in pathology and microbiol- ogy has been accelerated by machine learning (ML) approaches towards image preprocessing, classification, and feature extraction in an increasingly complex series of datasets. Modern Convolutional Neural Network (CNN) architectures have developed into an umbrella of vast image reinforcement and recognition methods, including a combined classification-localization of single/multi-object featured images. As a subtype neural network, CNN cre- ates a rapid order of complexity by initially detecting borderlines, edges, and colours in images for dataset construction, eventually capable in mapping intricate objects and conformities. This paper investigates the disparities between Tensorflow object detection APIs, exclusively, Single Shot Detector (SSD) Mobilenet V1 and the Faster RCNN Inception V2 model, to sample computational drawbacks in accuracy-precision vs. real time visualization capabilities. The situation of rapid ML medical image analysis is theoretically framed in regions with limited access to pathology and disease prevention departments (e.g. 3rd world and impoverished countries). Dark field mi- croscopy datasets of an initial 62 XML-JPG annotated training files were processed under Malaria and Syphilis classes. Model trainings were halted as soon as loss values were regularized and converged.

In the current industrial landscape, increasingly pervaded by technological innovations, the adoption of optimized strategies for asset management is becoming a critical key success factor. Among the various strategies available, the “Prognostics and Health Management” strategy is able to support maintenance management decisions more accurately, through continuous monitoring of equipment health and “Remaining Useful Life” forecasting. In the present study, Convolutional Neural Network-based Deep Neural Network techniques are investigated for the Remaining Useful Life prediction of a punch tool, whose degradation is caused by working surface deformations during the machining process. Surface deformation is determined using a 3D scanning sensor capable of returning point clouds with micrometric accuracy during the operation of the punching machine, avoiding both downtime and human intervention. The 3D point clouds thus obtained are transformed into bidimensional image-type maps, i.e., maps of depths and normal vectors, to fully exploit the potential of convolutional neural networks for extracting features. Such maps are then processed by comparing 15 genetically optimized architectures with the transfer learning of 19 pre-trained models, using a classic machine learning approach, i.e., Support Vector Regression, as a benchmark. The achieved results clearly show that, in this specific case, optimized architectures provide performance far superior (MAPE=0.058) to that of transfer learning which, instead, remains at a lower or slightly higher level (MAPE=0.416) than Support Vector Regression (MAPE=0.857).

Building deep learning models proposed by third parties can become a simple task when specialized libraries are used. However, a great deal of mystery still surrounds the design of new models or the modification of existing ones. These tasks require in-depth knowledge of the different components or building blocks as well as their dimensions. This information is limited and broken up in different literature. In this article, we collect and explain in-depth the building blocks to design deep learning models, starting from the artificial neuron to the concepts involved in building deep neural networks. Furthermore, the implementation of each building block is exemplified using the Keras library.

Drug-target affinity (DTA) prediction is crucial for understanding molecular interactions and aiding drug discovery and development. While various computational methods have been proposed for DTA prediction, their predictive accuracy remains limited, failing to delve into the structural nuances of interactions. With increasingly accurate and accessible structure prediction of targets, we developed a novel deep learning model, named S2DTA, to accurately predict DTA by fusing sequence and structural knowledge of drugs, targets, and pockets using heterogeneous models based on graph and semantic networks. Experimental findings underscored that complex feature representations imparted negligible enhancements to the model’s performance. However, the integration of heterogeneous models demonstrably bolstered predictive accuracy. In comparison to three state-of-the-art methodologies, the supremacy of S2DTA became strikingly apparent. It showcased a noteworthy 25.2% reduction in Mean Absolute Error (MAE) and an impressive 20.1% decrease in Root Mean Square Error (RMSE). Furthermore, S2DTA exhibited substantial advancements in other pivotal metrics, including Pearson Correlation Coefficient (PCC), Spearman, Concordance Index (CI), and R2. These metrics experienced remarkable increments of at least 19.6%, 17.5%, 8.1%, and a remarkable 49.4%, respectively. Finally, we conducted interpretability analysis on the effectiveness of S2DTA by bidirectional self-attention mechanism, fully proving that S2DTA is a valuable and accurate tool for predicting DTA. For further exploration, the source data and code repository can be accessed at https://github.com/dldxzx/S2DTA.

In this paper, we continue the research cycle on the properties of convolutional neural network-based image recognition systems and ways to improve noise immunity and robustness [1]. Currently, a popular research area related to artificial neural networks is adversarial attacks. The effect of adversarial attacks on the image is not highly perceptible to the human eye, also it drastically reduces the neural network accuracy. Image perception by a machine is highly dependent on the propagation of high frequency distortions throughout the network. At the same time, a human efficiently ignores high-frequency distortions, perceiving the shape of objects as a whole. The approach proposed in this paper can improve the image recognition accuracy in the presence of high-frequency distortions, in particular, caused by adversarial attacks. The proposed technique makes it possible to measure up the logic of artificial neural network to that of a human, for whom high-frequency distortions are not decisive in object recognition.

The Physics-Informed Neural Networks (PINNs) improve the efficiency of data utilization by combining physical principles with neural network algorithms and ensure that the predictions are consistent and stable with the physical laws. PINNs opens up a new approach to address inverse problems in fluid mechanics. Based on the single-relaxation-time lattice Boltzmann method (SRT-LBM) with the Bhatnagar-Gross-Krook (BGK) collision operator, the PINN-SRT-LBM model is proposed in this paper for solving the inverse problem in fluid mechanics. The PINN-SRT-LBM model consists of three components. The first component involves a deep neural network that predicts the equilibrium control equations in different discrete velocity directions within SRT-LBM. The second component employs another deep neural network to predict non-equilibrium control equations, enabling inference of the fluid's non-equilibrium characteristics. The third component, a physics informed function translates the outputs of the first two networks into physical infor-mation. By minimizing the residuals of the physical partial differential equations (PDEs), the physics informed function infers relevant macroscopic quantities of the flow. The model evolves two sub-models applicable to different dimensions, named PINN-SRT-LBM-I and PINN-SRT-LBM-II models according to the construction of the physical informed function. The innovation of this work is the introduction of SRT-LBM and discrete velocity models as physical drivers into the neural network through the interpretation function. Therefore, PINN-SRT-LBM allows the neural network to handle inverse problems of various dimensions and focus on problem-specific solving. Experimental results confirm the accurate prediction of flow infor-mation at different Reynolds numbers within the computational domain. Relying on the PINN-SRT-LBM models, inverse problems in fluid mechanics can be solved efficiently.

Effectively avoiding gas accident is vital to the security of mineral manufacture, and the coal mine gas accident is often caused by gas concentration overrun. The prediction accuracy of gas emission quantity in coal mine is the key to solve this problem. To maintain concentration of gas in a secure range，grey theory and neural network model increasingly diffusely used in forecasting gas emission quantity in coal mine critically. Nevertheless, the limitation of the grey neural network model is that researchers merely bonded the conventional neural network and grey theory. To enhance accuracy of prediction, a modified grey GM(1,1) and RBF neural network model is proposed combined amended grey GM(1,1) model and RBF neural network model. Then the proposed model was put into simulation experiment which is built based on Matlab software. Ultimately, conclusion of the simulation experiment verified that the modified grey GM(1,1) and RBF neural network model not only boosts the precision of prediction, but also restricts relative error in a minimum range. This showed that the modified grey GM(1,1) and RBF neural network model achieves effectiveness in precision of prediction much better than grey GM(1,1) model and RBF neural network model.

In this paper, a special recurrent neural network (RNN) called \emph{Long Short-Term Memory (LSTM)} is used to design a virtual load sensor that estimates the mass of heavy vehicles. The estimation algorithm consists of a two-layer LSTM network, with the two layers based on sequence-to-sequence and sequence-to-one logic, respectively. The network estimates the vehicle mass based on the vehicle speed, longitudinal acceleration, engine speed, engine torque, and the accelerator pedal position. The network is trained and tested with a data set collected in a high-fidelity simulation environment called Truckmaker. Training data is generated in acceleration maneuvers in a range of speeds whereas test data is obtained by simulating the vehicle in a Worldwide harmonized light vehicles test cycle (WLTC). Preliminary results show that, with the proposed approach, the heavy-vehicle mass can be estimated as accurately as commercial load sensors in a range of load mass as wide as four tons.

Artificial neural networks are widely established models of computational intelligence that have been tested for effectiveness in a variety of real-world applications. These models require fitting a set of parameters through the use of some optimization technique. However, an issue that researchers often face is finding an efficient range of values for the parameters of the artificial neural network. This paper proposes an innovative technique of generating a promising range of values for the parameters of the artificial neural network. Finding the value field is done by a series of rules for partitioning the original set of values or expanding it, which rules are generated using Grammatical Evolution. After finding a promising interval of values, any optimization technique such as a genetic algorithm can be used to train the artificial neural network on that interval of values. The new technique was tested on a wide range of problems from the relevant literature and the results were extremely promising.

The Necessity of Human resources beyond perception of human understanding towards the Evaluation of video quality or Data screening methodology is conducted based on human perception level since it is concerned with how visual content is perceived by a observer based on observations with his/ her perception on a particular video sequence. Therefore, we considered that the subject has to grade the encoded video sequences under certain test environment conditions based on ITU-Recommendations. Since Human perception is considered as the true judgment and precise measurement of visual content, data screening has became quite essential and quite comfortable to general public due to introduction of User Experience(UX) concept by User Experience community. The translations of A recurrent neural network is based on certain principles, for instance we considered natural language processing which is certainly adaptable towards understanding sequential data and use patterns to predict the consistency within observers. In our research, we adapted principles based on Recurrent Neural Networks while assuming consistency within observers for predicting video quality within data screening environment towards subjective experiments. Moreover,this research work explores the trade offs between Human perception on visual content and consistency of observations within individual observer.

This article explores the transformative role of neural networks in the realm of biology, particularly within microscopy image processing and illustrations. Neural networks have revolutionized cell segmentation and analysis, enabling precise delineation of cell boundaries and tracking of cellular behaviours. They excel in detecting subcellular structures, unravelling intricate organelle interactions. In 3D image reconstruction, neural networks navigate volumetric datasets, enhancing our understanding of spatial cellular architecture. These networks enhance disease diagnosis by identifying anomalies and irregularities, potentially revolutionizing early detection and classification. Moreover, neural networks restore and enhance microscopy images, unveiling hidden details. Lastly, they bridge art and science, fostering captivating biological art and enriching science communication. As neural networks evolve, they promise a future of limitless possibilities, weaving together technology, science, and art to illuminate the microscopic realm in unprecedented ways.

Oleuropein (OLE), a main constituent of olive, displays a pleiotropic beneficial dynamic in health and disease, based mainly on its antioxidant and hypolipidemic properties, and its capacity to protect myocardium during ischemia. Furthermore, OLE activates peroxisome proliferator-activated receptor (PPARα) in neurons and astrocytes, providing neuroprotection against noxious biological reactions that are induced following cerebral ischemia. Current study investigated the effect of OLE in the regulation of various neural plasticity indices, emphasizing the role of PPARα. For this purpose, 129/Sv wild-type (WT) and Pparα-null mice were treated with OLE for three weeks. The present findings revealed that chronic treatment with OLE up-regulated the brain-derived neurotrophic factor (BDNF) and its receptor TrkB in the prefrontal cortex (PFC) of mice via activation of ERK1/2, AKT and PKA/CREB signaling pathways. No similar effects were observed in the hippocampus. The OLE-induced effects on BDNF and TrkB appear to be mediated by PPARα, because no similar alterations were observed in the PFC of Pparα-null mice. Notably, OLE did not affect the neurotrophic factors NT3 and NT4/5 in both brain tissues. Fenofibrate though, a selective PPARα agonist, up-regulated BDNF and NT3 in the PFC of mice, whereas the drug induced NT4/5 in both brain sites tested. Interestingly, OLE provided neuroprotection in differentiated human SH-SY5Y cells against β-amyloid and H2O2 toxicity independently from PPARα activation. In conclusion, OLE and similar drugs acting either as PPARα agonists or via PPARα independent mechanisms could improve synaptic function/plasticity mainly in the PFC and to a lesser extent in the hippocampus, thus beneficially affecting cognitive functions.

Soft tactile sensors based on piezoresistive materials have various large-area sensing applications. However, their accuracy is often affected by hysteresis, a phenomenon that poses a significant challenge during operation. This paper introduces a novel approach that employs a backpropagation (BP) neural network to address the hysteresis nonlinearity in conductive fibre-based tactile sensors. To assess the effectiveness of the proposed method, four sensor units with different layer configurations (1, 3, 6, and 12) were designed. These sensor units underwent force sequences to collect corresponding output resistances. A backpropagation network was trained using these force sequences, thereby correcting the resistance values. The training process exhibited excellent convergence, effectively adjusting the network's parameters to minimize the error between predicted and actual resistance values. As a result, the trained BP network accurately predicted the output resistances. Several validation experiments were conducted to highlight the primary contribution of this research. The proposed method reduced the maximum hysteresis error from 24.2% of the sensor's full-scale output to 13.5%. This improvement establishes the approach as a promising solution for enhancing the accuracy of soft tactile sensors based on piezoresistive materials. By effectively mitigating hysteresis nonlinearity, the capabilities of soft tactile sensors in various applications can be enhanced. These sensors become more reliable and more efficient tools for force measurement and control, particularly in the fields of soft robotics and wearable technology. Consequently, their widespread applications extend to robotics, medical devices, consumer electronics, and gaming. Notably, the complete elimination of hysteresis in tactile sensors may not be feasible. Nevertheless, the proposed method effectively modifies the hysteresis nonlinearity, leading to improved sensor output accuracy.

While modeling data in reality, uncertainties in both data (aleatoric) and model (epistemic) are not necessarily Gaussian. The uncertainties could appear with multimodality or any other particular forms which need to be captured. Gaussian mixture models (GMMs) are powerful tools that allow us to capture those features from a unknown density with a peculiar shape. Inspired by Fourier expansion, we propose a GMM model structure to decompose arbitrary unknown densities and prove the property of convergence. A simple learning method is introduced to learn GMMs through sampled datasets. We applied GMMs as well as our learning method to two classic neural network applications. The first one is learning encoder output of autoencoder as GMMs for handwritten digits images generation. The another one is learning gram matrices as GMMs for style-transfer algorithm. Comparing with the classic Expectation maximization (EM) algorithm, our method does not involve complex formulations and is capable of achieving applicable accuracy.