The main features of the instrumental global mean surface temperature (GMST) are reasonably well described by a simple linear response model driven by anthropogenic, volcanic and solar forcing. This model acts as a linear long-memory filter of the forcing signal. The physical interpretation of this filtering is the delayed response due to the thermal inertia of the ocean. This description is considerably more accurate if El Ni\~{n}o Southern Oscillation (ENSO) and the Atlantic Multi-decadal Oscillation (AMO) are regarded as additional forcing of the global temperature and hence subject to the same filtering as the other forcing components. By considering these as predictors in a linear regression scheme, more than 92\% of the variance in the instrumental GMST over the period 1870-2017 is explained by this model, and in particular all features of the 1998 -- 2015 hiatus, including its death. While the more prominent pauses during 1870 -- 1915 and 1940 -- 1970 can be attributed to clustering in time of strong volcanic eruptions, the recent hiatus is an unremarkable phenomenon that is attributed to ENSO and a small contribution from solar activity.

This article focuses on obtaining the analytical solutions for parabolic Volterra integro- differential equations in d-dimensional with different types frictional memory kernel. Based on theories of Laplace transform, Fourier transform, the properties of Fox-H function and convolution theorem, analytical solutions of the equations in the infinite domain are derived under three frictional memory kernel functions respectively. The analytical solutions are expressed by infinite series, the generalized multi-parameter Mittag-Leffler function, Fox-H function and convolution form of Fourier transform. In addition, the graphical representations of the analytical solution under different parameters are given for one-dimensional parabolic Volterra integro-differential equation with power-law memory kernel. It can be seen that the solution curves subject to Gaussian decay at any given moment.

Accurate streamflow forecasting is crucial for effectively managing water resources, particularly in countries like Colombia, where hydroelectric power generation significantly contributes to the national energy grid. Although highly interpretable, traditional deterministic, physically-driven models often suffer from complexity and require extensive parameterization. Data-driven models like Linear Autoregressive (LAR) and Long Short-Term Memory (LSTM) networks offer simplicity and performance but cannot quantify uncertainty. This work introduces Sparse Variational Gaussian Processes (SVGPs) for forecasting streamflow contributions. The proposed SVGP model reduces computational complexity compared to traditional Gaussian Processes, making it highly scalable for large datasets. The methodology employs optimal hyperparameters and shared inducing points to capture short-term and long-term relationships among reservoirs. Training, validation, and analysis of the proposed approach consider the streamflow dataset from 23 geographically dispersed reservoirs recorded during twelve years in Colombia. Performance assessment reveals that the proposal outperforms baseline Linear Autoregressive (LAR) and Long Short-Term Memory (LSTM) models in three key aspects: adaptability to changing dynamics, provision of informative confidence intervals through Bayesian inference, and enhanced forecasting accuracy. Therefore, the SVGP-based forecasting methodology offers a scalable and interpretable solution for multi-output streamflow forecasting, thereby contributing to more effective water resource management and hydroelectric planning.

Immune responses to influenza (flu) antigens reflect memory to prior infections or vaccinations, which might influence immunity to new flu antigens. Memory of past antigens has been termed “original antigenic sin” or more recently “immune imprinting” and “seniority”. We have researched a comparison between the immune response to live flu infections and inactivated flu vaccina-tions. A brief history of antibody generation theories is presented culminating in new findings about the immune-network theory suggesting that a network of clones exists between an-ti-idiotypic antibodies and T cell receptors. Findings regarding the 2009 pandemic flu strain and immune responses to it are presented, including memory B cells and conserved regions within the hemagglutinin protein. The importance of CD4+ memory T cells and cytotoxic CD8+ T cells responding to both infections and vaccinations are discussed and compared. Innate immune cells like natural killer (NK) cells and macrophages are discussed regarding their roles in adaptive immune responses. Antigen presentation via macroautophagy processes are described. New vaccines in development are mentioned along with the results of some clinical trials. The manu-script concludes with how repeated vaccinations are impacting the immune system and a sketch of what might be behind the imprinting phenomenon, including future research directions.

Recurrent neural networks (RNNs) transmit information over time through recurrent connections. In contrast, biological neural networks use many other temporal processing mechanisms. One of these mechanisms is the inter-neuron delays caused by varying axon properties. Recently, this feature was implemented in echo state networks (ESNs), a type of RNN, by assigning spatial locations to neurons and introducing distance-dependent inter-neuron delays. These delays were shown to significantly improve ESN task performance. However, thus far it is still unclear why distance-based delay networks (DDNs) perform bettern than ESNs. In this paper, we show that by optimizing inter-node delays, the memory capacity of the network matches the memory requirements of the task. As such, networks concentrate their memory capabilities to the points in the past which contain the most information for the task at hand. Moreover, we show that DDNs have more total linear memory capacity, with the same amount of non-linear processing power.

The microalgae Phaeodactylum tricornutum (PT) is distinguished by its rich nutrient profile, characterized by well-documented neuroprotective activities, including fucoxanthin (FX), a major carotenoid, and polyunsaturated omega-3 fatty acids (n-3 PUFA). The current study aims to evaluate the protective effects of a standardized extract of PT (Mi136) containing 2% FX on cognitive function, oxidative stress, and inflammation parameters in a mouse model of accelerated aging. Seventy-two (72) male mice were randomly assigned to the blank control group (BC), negative control group (NC), and four similar microalgae extract of PT groups (branded as BrainPhytTM) with different human equivalent doses. From day 01 to day 51, mice in the BC group were injected with a 0.9% normal saline solution, while mice in all other groups were subcutaneously injected with D-galactose (D-Gal) at a dose of 150 mg/kg once per day, five days per week. Results indicated that, for the three higher microalgae extract of PT dose groups, spatial cognitive function, swim latency, and step-through latency impairments induced by chronic D-Gal intoxication were significantly and fully inhibited, with mean values similar to those in the BC group during each day of testing. Similar benefits were observed in biochemical analysis, specifically regarding brain and plasma levels of lipid peroxidation, TNF-α, and IL-6 markers. These data underscore the positive effects of a standardized extract of PT containing 2% FX on cognitive function parameters such as spatial working memory, long-term memory, and short-term memory through the regulation of oxidative stress and inflammation pathways.

In the field of adaptive building technologies, this research introduces the development of a self-regulating solar shading actuator, that utilizes the thermal shape memory effect. The study places its focus on addressing the actuator’s performance under diverse environmental conditions. Thermal simulations were carried out during the development of the individual components of the actuator and for the prediction of specific switching temperatures. The investigation includes an analysis of the sunshade’s response to varying environmental conditions, emphasizing its effectiveness on clear summer days and identifying challenges during overcast periods. The critical coordination between the solar collector and the shape memory alloy (SMA) wire is examined, shedding light on the impact of SMA temperature dynamics on the actuation performance. Through the integration of simulation data and real-world measurements, the study validates the thermal model for the solar collector, establishing the robustness of the system’s operation. This research work contributes significantly to the development of intelligent actuators and outlines the importance of validation of SMA-based applications under real conditions.

The mathematical structure underlying a sentence is made of two independent processing units in series. The conditional probability density function of sentence length (measured in words) recordable in the extended short–term memory (E–STM) buffer made of CF cells is Gaussian. The number of sentences that authors of Italian and English Literatures have written is compared to that theoretically available to them. The multiplicity factor α describes this comparison. α>1 is more likely than α<1 and often α≫1, therefore the same sentence pattern is reused many times. These texts are easier to read. Very few novels show α<1. In these cases, there are enough diverse sentence patters to convey meaning, but most of them are not used. Texts are more difficult to read, as measured by a universal readability index GU. A mismatch index IM synthetically describes the process. α, GU. and IM increase with year of publication. Future work will concern other literatures – including ancient ones as Greek and Latin – to confirm what, in our opinion, is general feature of human mind.

Abstract There is no research that combines behavioural and fMRI research approaches to investigate the mediating and moderating effects of working memory, verbal IQ, visuospatial and verbal reasoning on students’ performance of maths and science. This paper investigates all these multiple relationships between working memory (WM), verbal IQ, visuospatial and verbal reasoning with performance in maths and science accuracy. The multimethod research consists of a behavioural survey and a fMRI neuroscience investigating the interactive and multiple relationships of all cognitive processing independent variables (IVs) with the dependent variables (DVs) of maths and science performance. Using structural Equation Modelling (SEM) and Warp Partial Least Squares (Warp PLS) analytical approach, the research discusses the findings of both, the behavioural and fMRI data. The adolescent sample (N=34) for the behavioural and fMRI study, was recruited from consenting schools in London, UK, and consisted of equal numbers of girls and boys between 11-15 years old. The hypothesised behavioural SEM model predicted positive relationships between all the independent variables (IV) of visuospatial matrix reasoning (VSMatAR), verbal analogical reasoning (VerbAR), verbal working memory (VWM), visuospatial working memory (VSWM) and verbal IQ, with performance in maths and science accuracy. The findings support all hypotheses except two and identifies verbal IQ, Verbal WM and VerbAR as the three strongest predictors of maths and science accuracy. The neuroscience fMRI data identified four brain regions of interest, namely, the bilateral DLPFC, Parietal, Temporal and pre-supplementary motor area (PSMA) as being most relevant to maths and science outcomes. The hypothesised fMRI SEM, produced mixed results which supported some of the hypothesised relationships between the IVs of verbal AR and VSMatrix AR associations with all four brain regions and in turn the associations with maths and science performance. The paper makes two original contributions, firstly, by testing the hypothesis that Verbal WM mediates the independent variables’ effects on maths and science outcomes. And secondly, by using Warp PLS to test the SEM (behavioural and fMRI) models’ multiple non-linear interactions simultaneously between the IVs with the DVs of maths and science accuracy. The Warp PLS testing of all IVs and DVs produced some interesting new insights regarding the relationships between Verbal analogical reasoning, which are deemed important to assist academics and educational practitioners in improving maths and science performance of adolescent students. The combination of behavioural and neuroscience fMRI data provides more reliable empirical evidence regarding the multiple interactive influences impacting maths and science performance for adolescents.

In industrial settings, gears play a crucial role by assisting various machinery functions such as speed control, torque manipulation, and altering motion direction.The malfunction or failure of these gear components can have serious repercussions, resulting in production halts and financial losses. As a result, there is an increasing requirement to monitor the state of these components in order to avoid such issues from occurring. To address this need, research efforts have focused on early defect detection in gears in order to reduce the impact of possible failures. This study focused on analyzing vibration and thermal datasets from two extruder machine gearboxes using an autoencoder Long Short-Term Memory (LSTM) model. The major goal is to implement an outlier detection approach to detect and classify defects. The results of this study highlighted the extraordinary performance of the Autoencoder LSTM model, which achieved an impressive accuracy rate of 94.42% in recognizing malfunctioning gearboxes within the extruder machine system. Furthermore, the study used a thorough global metrics evaluation methodology to further test the model’s dependability and efficacy, consequently substantiating the proposed approach’s validity.

An automatic recognizing system of white blood cells can assist hematologists in the diagnosis of many diseases, where accuracy and efficiency are paramount for computer-based system. In this paper, we present a new image processing system to recognize the five types of white blood cells in peripheral blood with marked improvement in efficiency when juxtaposed against mainstream methods. The prevailing deep learning segmentation solutions often utilize millions of parameters to extract high-level image features and neglect the incorporation of prior domain knowledge, which consequently consume substantial computational resources and increase the risk of overfitting, especially when limited medical image samples are available for training. To address these challenges, we propose a novel memory-efficient strategy that exploits graph structures derived from the images. Specifically, we introduce a lightweight superpixel-based Graph Neural Network (GNN) and break new ground by introducing superpixel metric learning to segment nucles and cytoplasm. Remarkably, our proposed segmentation model (SMGNN) achieves state-of-the-art segmentation performance while utilizing at most 10000$\times$ less than the parameters compared to existing approaches. The subsequent segmentation-based cell type classification processes show satisfactory results that such automatic recognizing algorithms are accurate and efficient to execeute in hematological laboratories.

Macrophages undergo different cellular states upon activation that can be hyporesponsive (tolerated) or hyperresponsive (primed or trained) to subsequent stimuli. Epigenetic modifications are known to play a key role in determining these cellular states. However, little is known about the role of signaling pathways that lead to these epigenetic modifications. Here, we examined the effects of various inhibitors targeting key signaling pathways induced by lipopolysaccharide (LPS) on tolerance and priming in the murine macrophages. We found that a prolonged inhibition (>18 h) of the MEK1/2-ERK signaling axis reversed tolerance and primed cells in expressing IL-1β and other inflammatory cytokines such as IL-6, TNFα, and CXCL10. Ectopic expression of catalytically active and inactive MEK1 mutants suppressed and enhanced IL-1β expression, respectively. Primed cells by the MEK1/2 inhibitor U0126 expressed higher levels of gene sets associated with immune responses and cytokine/chemokine production but lower levels of genes with cell cycle progression, chromosome organization, and heterochromatin formation than non-primed cells. Of interest, expression of the histone 3 lysine 9 (H3K9) methyltransferase Suv39h1 and the H3K9 methylation reader Cbx5 was substantially suppressed, whereas the H3K9 demethylase Kdm7a was enhanced, suggesting a role of the MEK1/2-ERK signaling axis in H3K9 demethylation. The H3K9 trimethylation levels in the genomic regions of IL-1β, TNFα, and CXCL10 were decreased by U0126. Also, the H3K9 methyltransferase inhibitor BIX01294 mimicked and overexpression of Cbx5 prevented the U0126 training effects in both RAW264.7 cells and bone marrow-derived macrophages. Collectively, these data suggest that prolonged inhibition of the MEK1/2-ERK signaling axis reverses tolerance and primed macrophages likely through decreasing H3K9 methylation levels.

Malware complexity is rapidly increasing, causing catastrophic impacts on computer systems. Memory dump malware is gaining increased attention due to its ability to expose plaintext passwords or key encryption files. This paper presents an enhanced classification model based on One class SVM (OCSVM) classifier that can identify any deviation from the normal memory dump file patterns and detect it as malware. The proposed model integrates OCSVM and Principal Component Analysis (PCA) for increased model sensitivity and efficiency. An up-to-date dataset known as “MALMEMANALYSIS-2022” was utilized during the evaluation phase of this study. The accuracy achieved by the traditional one-class classification (TOCC) model was 55%, compared to 99.4% in the one-class classification with PCA (OCC-PCA) model. Such results have confirmed the increased performance achieved by the proposed model.

With the latest advances in information and communication technologies, greater amounts of sensitive user and corporate information are constantly shared across the network making it susceptible to an attack that can compromise data confidentiality, integrity and availability. Intrusion Detection Systems (IDS) are important security mechanisms that can perform a timely detection of malicious events through the inspection of network traffic or host-based logs. Throughout the years, many machine learning techniques have proven to be successful at conducting anomaly detection but only a few considered the sequential nature of data. This work proposes a sequential approach and evaluates the performance of a Random Forest (RF), a Multi-Layer Perceptron (MLP) and a Long-Short Term Memory (LSTM) on the CIDDS-001 dataset. The resulting performance measures of this particular approach are compared with the ones obtained from a more traditional one, that only considers individual flow information, in order to determine which methodology best suits the concerned scenario. The experimental outcomes lead to believe that anomaly detection can be better addressed from a sequential perspective and that the LSTM is a very reliable model for acquiring sequential patterns in network traffic data, achieving an accuracy of 99.94% and a f1-score of 91.66%.

Hand and arm gesture recognition using radio frequency (RF) sensing modality proves valuable in man-machine interface and smart environment. In this paper, we use time series analysis method for accurately measuring the similarity of the micro-Doppler (MD) signatures between the training and test data, thus providing improved gesture classification. We characterize the MD signatures by the maximum instantaneous Doppler frequencies depicted in the spectrograms. In particular, we apply the dynamic time warping (DTW) method and compare its performance with that of the long short-term memory (LSTM) network. Both methods take into account the values as well as the temporal evolution and trends of time series data. It is shown that the DTW method achieves high gesture classification rates and is robust to time misalignment.

Physical Unclonable Functions (PUFs) based on the retention times of the cells of a Dynamic Random Access Memory (DRAM) can be utilised for the implementation of cost-efficient and lightweight cryptographic protocols. However, as recent work has demonstrated, the times needed in order to generate their responses may prohibit their widespread usage. In order to address this issue, the Row Hammer PUF has been proposed by Schaller et al. [1], which leverages the row hammer effect in DRAM modules to reduce the retention times of their cells and, therefore, significantly speed up the generation times for the responses of PUFs based on these retention times. In this work, we extend the work of Schaller et al. by presenting a run-time accessible implementation of this PUF and further reducing the time required for the generation of its responses. Additionally, we also provide a more thorough investigation of the effects of temperature variations on the the Row Hammer PUF and briefly discuss potential statistical relationships between the cells used to implement it. As our results prove, the Row Hammer PUF could potentially provide an adequate level of security for Commercial Off-The-Shelf (COTS) devices, if its dependency on temperature is mitigated, and, may therefore, be commercially adopted in the near future.

This study aimed to compare procedural learning skills between Spanish-speaking preschool children (ages 4 years to 4 years, 11 months) with Developmental Language Disorder (DLD) and their typically developing (TD) peers. Using the Serial Reaction Time task, participants (30 DLD and 30 TD children) respond to visual stimuli in a sequenced manner over four blocks, followed by a random order block. The task assessed reaction time (RT) and accuracy. Results showed a significant interaction between group and block for reaction time (RT) and accuracy, with children with DLD exhibiting longer RTs and accuracy deficits across blocks. In contrast, the TD group showed higher RT efficiency and accuracy in the sequential blocks and as expected, decreased performance in the random block according to the experimental manipulation. Overall, the results of this investigation suggest that there was no implicit learning in the DLD group, as indicated by the SRT task paradigms of procedural memory. These findings align with the Procedural Deficit Hypothesis (PDH), suggesting that linguistic deficits in the TD population may derive from a general dysfunction of the procedural memory system domain in the Spanish context.

Advancements in technology have revolutionized communication on social media platforms, where reviews and comments greatly influence product selection. Current opinion mining methods predominantly focus on textual content, overlooking the rich information within customer-posted images, termed here as Multus-Medium. This research introduces an innovative deep learning approach, Multus Medium Opinion Mining (MMOM), capitalizing on both text and image data for comprehensive product review analysis. MMOM employs an integrated model of Bidirectional Long Short-Term Memory (BiLSTM) and embedded Convolutional Neural Network (CNN), incorporating architectures of GoogleNet and VGGNet, thus enabling efficient extraction and fusion of textual and visual features. This synergistic approach enables data collection, preprocessing, feature extraction, fusion strategy-based feature vector generation, and subsequent product recommendation. Performance evaluation on two diverse real-world datasets name as “flicker8k” and “t4sa”. These datasets show substantial improvement over existing methods. MMOM outperforms standard benchmark models, achieving an accuracy, F1 score and ROC over fliker8k are 90.38%, 88.75% and 93.08%, whereas for twitter dataset are 88.54%, 86.34%, and 92.26% respectively, the accuracy of purposed model is 7.34% and 9.54% higher than the other two mentioned techniques. These statistics highlight the robustness and applicability of MMOM across various domains. The compelling results underscore the potential of MMOM, providing a more holistic and precise approach to opinion mining in the era of social media product reviews. This research, product recommendation helps the customer to make purchasing decision. Last but not the least, the purposed scheme can further be expanded in any other sentiment task like hospital recommendation system, crop farming recommendation and medical diagnostic system etc.

Liquid crystal elastomers (LCEs) are shape morphing materials whose large and reversible shape transformation results from the coupling between the mobile anisotropic properties of liquid crystal (LC) units and the rubber elastic of polymer networks. Their shape changing behaviors under the stimuli are largely directed by LC orientations, and therefore various strategies have been developed to spatially modulate the LC alignments. But most of the methods suffer from complex fabrication technologies or intrinsic limitations in applicability. To address this issue, programmable complex shape changes in some types of LCEs, such as polysiloxane side-chain LCEs or thiol-acrylate main-chain LCEs, etc, have been achieved by using a mechanical alignment programming process coupled with two-step crosslinking. Here, we report a polysiloxane main-chain LCE with programmable 2D and 3D shape changing performances achieved by mechanically programming the polydomain LCE between the two crosslinking steps. The resulting LCEs exhibited reversible thermal induced shape transformation between the initial and programmed shapes due to the two-way memory between the first network structure and the second network structure. Our work would be potential for expanding the applications of LCE materials in actuators, soft robotics and smart structures where arbitrary and easily programmed shape morphings are needed.

Directed movement towards a target requires spatial working memory, including processing of sensory inputs and motivational drive. In a stimulus-driven, operant conditioning paradigm designed to train zebrafish, we present a pulse of light via LED’s and/or sounds via an underwater transducer. A webcam placed below a glass tank records fish swimming behavior. During operant conditioning, a fish must interrupt an infrared beam at one location to obtain a small food reward at the same or different location. A timing-gated interrupt activates robotic-arm and feeder stepper motors via custom software controlling a microprocessor (Arduino). “Ardulink”, a JAVA facility, implements Arduino-computer communication protocols. In this way, full automation of stimulus-conditioned directional swimming is achieved. Precise multi­day scheduling of training, including timing, location and intensity of stimulus parameters, and feeder control is accomplished via a user-friendly interface. Our training paradigm permits tracking of learning by monitoring, turning, location, response times and directional swimming of individual fish. This facilitates comparison of performance within and across a cohort of animals. We demonstrate the ability to train and test zebrafish using visual and auditory stimuli. Current methods used for associative conditioning often involve human intervention, which is labor intensive, stressful to animals, and introduces noise in the data. Our relatively simple yet flexible paradigm requires a simple apparatus and minimal human intervention. Our scheduling and control software and apparatus (NemoTrainer) can be used to screen neurologic drugs and test the effects of CRISPR­-based and optogenetic modification of neural circuits on sensation, locomotion, learning and memory.

The deformation monitoring information of concrete dams contains some high-frequency com-ponents, and the high-frequency components are strongly nonlinear, which reduces the accuracy of dam deformation prediction. In order to solve such problems, this paper proposes a concrete dam deformation monitoring model based on empirical mode decomposition (EMD) combined with wavelet threshold noise reduction and sparrow search algorithm (SSA) optimization of long short-term memory network (LSTM). The model uses EMD combined with wavelet threshold to decompose and denoise the measured deformation data. On this basis, the LSTM model based on SSA optimization is used to mine the nonlinear function relationship between the reconstructed monitoring data and various influencing factors. The example analysis shows that the model has good calculation speed, fitting and prediction accuracy and it can effectively mine the date char-acteristics inherent in the measured deformation, and reduce the influence of noise components on the modeling accuracy.

Concussion, also known as mild traumatic brain injury (mTBI), commonly causes transient neurocognitive symptoms, but in some cases, it causes cognitive impairment, including working memory (WM) deficit, which can be long-lasting and impede a patient’s return to work. The predictors of long-term cognitive outcomes following mTBI remain unclear because abnormality is often absent in structural imaging findings. The purpose of the study was to determine whether machine learning-based models using functional magnetic resonance imaging (fMRI) biomarkers and demographic or neuropsychological measures at baseline could effectively predict 1-year cognitive outcomes of concussion. We conducted a prospective, observational study of patients with mTBI who were compared with demographically-matched healthy controls enrolled between September 2015 to August 2020. Baseline assessments were collected within the first week of injury, and follow-ups were conducted at 6 weeks, 3 months, 6 months, and 1 year. Potential demographic, neuropsychological, and fMRI features were selected according to the significance of correlation with the estimated changes in WM ability. The support vector machine classifier was trained using these potential features and estimated changes in WM between the predefined time periods. Patients demonstrated significant cognitive recovery at the third month, followed by worsened performance after 6 months, which persisted until 1 year after concussion. Approximately half of the patients experienced prolonged cognitive impairment at 1-year follow up. Satisfactory predictions were achieved for patients whose WM function did not recover at 3 months (accuracy=87.5%), 6 months (accuracy=83.3%), 1 year (accuracy=83.3%), and performed worse at 1-year follow-up compared to baseline assessment (accuracy=83.3%). This study demonstrated the feasibility of personalized prediction for long-term postconcussive WM outcomes based on baseline fMRI and demographic features, opening a new avenue for early rehabilitation intervention in selected individuals with possible poor long-term cognitive outcomes.

We investigate the power of time series analysis based on a variety of information-theoretic approaches from statistics (AIC, BIC) and machine learning (Minimum Message Length) - and we then compare their efficacy with traditional time series model and with hybrids involving deep learning. More specifically, we develop AIC, BIC and Minimum Message Length (MML) ARMA (autoregressive moving average) time series models - with this Bayesian information-theoretic MML ARMA modelling already being new work. We then study deep learning based algorithms in time series forecasting, using Long Short Term Memory (LSTM), and we then combine this with the ARMA modelling to produce a hybrid ARMA-LSTM prediction. Part of the purpose of the use of LSTM is to seek capture any hidden information in the residuals left from the traditional ARMA model. We show that MML not only outperforms earlier statistical approaches to ARMA modelling, but we further show that the hybrid MML ARMA-LSTM models outperform both ARMA models and LSTM models.

The effect of stress on task performance is complex, too much or too little negatively affects performance; and there exists an optimal level of stress to drive optimal performance. Task difficulty and external affective factors are distinct stressors that impact cognitive performance. Neuroimaging studies showed that mood affects working memory performance and the correlates are changes in haemodynamic activity in the prefrontal cortex (PFC). We investigate the interactive effects of affective states and working memory load (WML) on working memory task performance and haemodynamic activity using functional near-infrared spectroscopy (fNIRS) neuroimaging on the PFC of healthy participants. We seek to understand if haemodynamic responses could tell apart workload related stress from situational stress arising from external affective distraction. We found that the haemodynamic changes towards affective stressor and workload related stress were more dominant in the medial and lateral PFC respectively. Our study reveals distinct affective state-dependent modulations of haemodynamic activity with increasing WML in n-back tasks, which correlate with decreasing performance. The influence of negative affect on performance is greater at higher WML, and haemodynamic activity showed evident changes in temporal, and both spatial and strength of activation differently with WML.

Statistics of languages are calculated by counting characters, words, sentences, word rankings. Some of these random variables are also the main “ingredients” of classical readability formulae. Revisiting the readability formula of Italian, known as GULPEASE, shows that of the two terms that determine the readability index G – the semantic index G_C, proportional to the number of characters per word, and the syntactic index G_F, proportional to the reciprocal of the number of words per sentence −, G_F is dominant because G_C is, in practice, constant for any author throughout seven centuries of Italian Literature. Each author can modulate the length of sentences more freely than he can do with the length of words, and in different ways from author to author. For any author, any couple of text variables can be modelled by a linear relationship y=mx, but with different slope m from author to author, except for the relationship between characters and words, which is unique for all. The most important relationship found in the paper is, in author’s opinion, that between the short−term memory capacity, described by Miller’s “7∓2 law”, and the word interval, a new random variable defined as the average number of words between two successive punctuation marks. The word interval can be converted into a time interval through the average reading speed. The word interval is spread in the same of Miller’s law, and the time interval is spread in the same range of short−term memory response times. The connection between the word interval (and time interval) and short−term memory appears, at least empirically, justified and natural, and should further investigated. Technical and scientific writings (papers, essays etc.) ask more to their readers. A preliminary investigation of these texts shows clear differences: words are on the average longer, the readability index G is lower, word and time intervals are longer. Future work done on ancient languages, such as Greek or Latin, could bring us a flavor of the short term−memory features of these ancient readers.

Speech emotion recognition (SER) is a technology that can be applied in distance education to analyze speech patterns and evaluate speakers’ emotional states in real-time. It provides valuable insights and can be used to enhance the learning experience by enabling the assessment of instructors’ emotional stability, a factor that significantly impacts information delivery effectiveness. Students demonstrate different engagement levels during learning activities, and assessing this engagement is an important aspect of controlling the learning process and improving e-learning systems. An important aspect that may influence student engagement is the emotional states of their instructors. Accordingly, this research uses deep learning techniques to create an automated system for recognizing instructors’ emotions in their speech when delivering distance learning. This methodology entails integrating Transformer, convolutional neural network, and long short-term memory architectures into an ensemble to enhance SER. Feature extraction from audio data used Mel-frequency cepstral coefficients, chroma, Mel spectrogram, zero crossing rate, spectral contrast, centroid, bandwidth, roll-off, and root-mean square, with subsequent optimization processes adding noise to, conducting time stretching, and shifting the audio data. Notably, several Transformer blocks were incorporated, and a multi-head self-attention mechanism was employed to identify the relationships between the input sequence segments. The pre-processing and data augmentation methodologies significantly enhanced the precision of the results in that the model achieved accuracy rates of 96.3%, 99.86%, 96.5%, and 85.3% on the Ryerson Audio-Visual Database of Emotional Speech and Song, Berlin Database of Emotional Speech, Surrey Audio-Visual Expressed Emotion, and Interactive Emotional Dyadic Motion Capture datasets. Furthermore, it achieved 83% accuracy on another dataset created for this research—the Saudi Higher Education Instructor Emotions dataset. The results demonstrate this model’s considerable accuracy in detecting emotions in speech data across different languages and datasets.

In recent years, advancements in brain science and neuroscience have significantly influenced the field of computer science, particularly in the domain of reinforcement learning (RL). Drawing insights from neurobiology and neuropsychology, researchers have leveraged these findings to develop novel mechanisms for understanding intelligent decision-making processes in the brain. Concurrently, the emergence of quantum computing has opened new frontiers in artificial intelligence, leading to the development of quantum machine learning (QML). This study introduces a novel model that integrates Quantum Spiking Neural Networks (QSNN) and Quantum Long Short-Term Memory (QLSTM) architectures, inspired by the complex workings of the human brain. Specifically designed for reinforcement learning tasks in energy-efficient environments, our approach progresses through two distinct stages mirroring sensory and memory systems. In the initial stage, analogous to the brain’s hypothalamus, low-level information is extracted to emulate sensory data processing patterns. Subsequently, resembling the hippocampus, this information is processed at a higher level, capturing and memorizing correlated patterns. We conduct a comparative analysis of our model against existing quantum models such as Quantum Neural Networks and their classical counterparts, elucidating its unique contributions. Through empirical results, we aim to underscore the effectiveness of our approach in optimizing energy consumption in practical scenarios.

This paper presents a concise exploration of the synthetic biology currently to artificially 1 create life, juxtaposed against natural life’s emergence over Earth’s 4.5-billion-year history. It explores 2 the complexities of life’s origins, sustaining factors, and the consequences of synthetic life creation, 3 addressing key scientific milestones such as the Urey-Miller experiment and Jacques Monod’s pro- 4 posals. The narrative navigates through the roles of energy, Maxwell’s demons, bifurcations, and 5 genetic information in the emergence and evolution of complex biological systems. Despite significant 6 strides in genetic engineering, the challenge of creating life from scratch persists, necessitating a deep 7 understanding of diverse scientific disciplines. While synthetic biology holds promise for medicine 8 and biotechnology, the creation of truly autonomous synthetic life forms raises ethical concerns. The 9 paper also stresses the imperative for careful ethical evaluation of the societal and environmental 10 implications arising from these advancements.

Memory and emotion, fundamental components of our mental existence, are highly vulnerable to psychiatric disorders like post-traumatic stress disorder (PTSD). This condition has been linked to serotonin (5-HT) metabolism disruptions. Over 95% of the 5-HT precursor tryptophan (Trp) is metabolized through the Trp-kynurenine (KYN) metabolic pathway, but little is known about its role in behavior. Kynurenine aminotransferases are responsible for the production of the Trp-KYN metabolite kynurenic acid. The gene aadat codes for mitochondrial kynurenine aminotransferase isotype 2. We generated CRISPR/Cas9-induced aadat knockout (kat2−/−) mice to examine the consequence of the gene deletion on negative valence in emotion, memory, and motor function in males 8 weeks of age and compared them to their wild-type counterparts. The forced swim test showed increased depression-like behaviors in transgenic mice. Anxiety and memory tests showed no significant differences. The transgenic mice had fewer center field and corner entries, shorter ambulation distances, and fewer jumping counts in the open field test. Overall, the transgenic mice exhibit depression-like behavior in a learned helplessness model, emotional indifference, and motor deficits. Here we present the first evidence that the deletion of the aadat gene triggers depression-like behaviors, uniquely associated with despair experience rather than adverse-conditioned memory. These findings have profound implications, opening avenues for further exploration into the main causes of experience-based depression linked to despair. This investigation has the potential to advance our understanding of these complex conditions and pave the way for improved therapeutic strategies by elucidating the relationship between Trp metabolism and the pathogenesis of PTSD.

The correct classification of defects originating from partial discharges (PD) in medium-voltage (MV) switchgears with air insulation (AIS) remains a challenging research topic for scientists worldwide. In this article, the authors simulated four possible defects occurring in the power industry, including one that is a simultaneous combination of two commonly ones. In addition, the correctness of the algorithm was checked by adding a classification class without any fault. The measurement signals were recorded with TEV sensors. The effectiveness of various hy-brid-connected neural networks was tested and discussed: GoogleNet and SqueezeNet based on spectrograms, SAE with FNN, 2D-CNN with LSTM, and hybrid AE combined with CNN and LSTM. The highest effectiveness – approximately 97% – was demonstrated by the GoogleNet and SqueezeNet networks. The research results are expected to form the basis for the development of a universal and wireless capacitive sensor for monitoring the level of PD in switchgears.

Multilabel learning goes beyond standard supervised learning models by associating a sample with more than one class label. Among the many techniques developed in the last decade to handle multilabel learning best approaches are those harnessing the power of ensembles and deep learners. This work proposes merging both methods by combining a set of gated recurrent units, temporal convolutional neural networks, and long short-term memory networks trained with variants of the Adam optimization approach. We examine many Adam variants, each fundamentally based on the difference between present and past gradients, with step size adjusted for each parameter. We also combine Incorporating Multiple Clustering Centers and a bootstrap-aggregated decision trees ensemble, which is shown to further boost classification performance. In addition, we provide an ablation study for assessing the performance improvement that each module of our ensemble produces. Multiple experiments on a large set of datasets representing a wide variety of multilabel tasks demonstrate the robustness of our best ensemble, which is shown to outperform the state-of-the-art. The MATLAB code for generating the best ensembles in the experimental section will be made available at https://github.com/LorisNanni.

This paper realizes early bearing fault warning through bearing fault time series prediction, and proposes a bearing fault time series prediction model based on optimized maximum correlation kurtosis deconvolution (MCKD) and long short-term memory (LSTM) recurrent neural network to ensure bearings operation reliability. The model is based on lifecycle vibration signal of the bearing, to begin, the cuckoo search (CS) is utilized to optimize the parameter filter length L and deconvolution period T of MCKD, taking into account the influence and periodicity of the bearing time series, the fault impact component of the optimized MCKD deconvolution time series is improved. Then select the LSTM learning rate α depending on deconvolution time series. Finally, the dataset obtained through various preprocessing approaches are used to train and predict the LSTM model. The average prediction accuracy of the optimized MCKD-LSTM model is 26 percent higher than that of the original time series, proving the efficiency of this method, and the prediction results track the real fault data well, according to the XI'AN JIAOTONG University XJTU-SY bearing dataset.

(1) Background: Substantial evidence that neural timing deficits are prevalent in developmental disorders, aging, and concussions resulting from a mild Traumatic Brain Injury (mTBI) is presented. We show that if timing deficits are remediated using low-level movement discrimination training, then high-level cognitive skills, including reading, attention, processing speed, and working memory improve substantially. (2) Methods: Two case studies are presented using MEG source imaging on an adult dyslexic, and a healthy older adult observed before and after training on movement discrimination two times/week for 8 weeks for adult dyslexic. (3) Results: We found improvements in reading, attention, processing speed, and working memory on neuropsychological tests. Substantial MEG signal increases in visual Motion Networks (V1, V3, MT, MST), Attention Networks (ACC, dlPFC, vlPFC and precuneous/ PCC areas) and Memory Networks (dlPFC). (4) Conclusions: Improving neural timing deficits before cognitive exercises to improve specific cognitive skills provides a rapid and effective method to improve cognitive skills. Improving the timing and sensitivity of low-level dorsal pathways, improving feedforward and feedback pathways, is essential to improve high-level cognitive skills. This adaptive training with substantial feedback shows cognitive transfer to tasks not trained on, significantly improving a person’s quality of life rapidly and effectively.

A graphene-containing LDH was prepared by re-hydration of the oxides produced by the calcination of an organic LDH. While the memory effect is a widely recognized effect on oxides produced by inorganic LDHs, it is unprecedented from the calcination/re-hydration of organic ones. Different temperatures (400, 600 and 1100 °C) were tested, on the basis of thermogravimetric data. Water instead of a carbonate solution was used for the re-hydration, with CO₂ available from water itself and/or air to induce a slower process with an easier and better intercalation of the carbonaceous species within the layers. The samples were characterized by X-ray Powder Diffraction (XRPD), IR and Raman spectroscopy and scanning electron microscopy (SEM). XRPD indicate the presence of carbonate LDH mixed with a layered phase with a larger d-spacing. IR confirmed that the prevailing anion is carbonate, coming from the water used for the re-hydration and/or air. Raman data indicated the presence of low-ordered graphenic species moieties and SEM the absence of separated graphene of graphitic sheets, suggesting an intimate mixing of the carbonaceous phase with reconstructed LDH. Organic LDHs gave better memory effect after calcination at 400 °C. Conversely, the graphenic species are observed after rehydration of the sample calcined at 600 °C with a reduced memory effect, demonstrating the interference of the carbonaceous phase with LDH reconstruction and the bonding with LDH layers to form a graphene-LDH nanocomposite.

In manual maintenance inspections of large-scaled photovoltaic (PV) or rooftop PV systems, several days are required to survey the entire PV field. To improve reliability and shorten the amount of time involved, this study proposes an electrical examination based method for locating multiple faults in the PV array. The maximum power point tracking (MPPT) algorithm is used to estimate the maximum power of each PV panel; this is then compared with metering the output power of PV array. Power degradation indexes are parameterized to quantify the degradation between maximum power and metered output power. Bidirectional hetero-associative memory (BHAM) networks are then used to locate multiple faults within the entire PV field. For a rooftop PV system with two strings, as seen in Figure 1, experimental results demonstrate that the proposed model has computational efficiency for real-time applications and that its algorithm is easily implemented in a mobile intelligent vehicle.

Accurate electricity price forecasting has become a substantial requirement since the liberalization of the electricity markets. Due to the challenging nature of the electricity prices, which includes high volatility, sharp price spikes and seasonality, various types of electricity price forecasting models still compete and can not outperform each other consistently. Neural Networks have been successfully used in machine learning problems and Recurrent Neural Networks (RNNs) have been proposed to address time-dependent learning problems. In particular, Long Short Term Memory and Gated Recurrent Units (GRU) are tailor-made for time series price estimation. In this paper, we propose to use Gated Recurrent Units as a new technique for electricity price forecasting. We have trained a variety of algorithms with rolling 3-year window and compared the results with the RNNs. In our experiments, 3-layered GRUs outperformed all other neural network structures and state of the art statistical techniques in a statistically significant manner in the Turkish day-ahead market.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

This study aimed to learn disturbance information to effectively control multiple small unmanned surface vehicles (USVs) for marine research purposes at sea. The learned disturbance information was used to investigate the control of multiple USV swarms based on the leading–following formation technique. Numerous studies have already been conducted on swarm control using drones in the air; however, there has been a paucity of studies on swarm control in the sea. Contrary to swarm control in aviation, the fluid density of the sea is high, and the environment is constantly changing; thus, a robot system would be significantly affected by disturbances. This ultimately influences the maintenance of swarm formations and the accomplishment of missions [1,2]. Therefore, it is difficult to control numerous moving objects while maintaining a formation at sea by using the existing aerial drone swarm control technology. To solve this problem, we learned a long short-term memory (LSTM) model with time-series marine environmental data to predict maritime disturbances. Thereafter, the model was applied to a mission-based position control algorithm of each USV constituting the swarm to design a marine unmanned floating vessel swarm control system that can be applied to various marine environments. Specifically, to effectively control numerous small USVs for marine research purposes, ocean currents are learned using the LSTM algorithm, and the predicted ocean currents are used to generate a swarm USV control system for USV formations. In this study, a control system model of several small USVs equipped with two rear thrusters and a front lateral thruster was designed. The LSTM algorithm was learned using the previous ocean current data, and the velocity of the following ocean currents was predicted. The predictions were then used as a system disturbance to determine the thrust of the controller. To measure ocean currents in the sea when each USV moves, the velocity, azimuth, and position (latitude, longitude) data from the GPS mounted on the USV were used to measure the velocity and direction of the hull's movement. Further, the flow rate was measured using a flow rate sensor on a small USV. The USV movement and position were controlled using an artificial neural network-PID (ANN-PID) controller. This study entailed a comparative analysis of the designed USV model results and those generated by the simulator, including the behavior control rule of the USV swarm and the path of the actual USV swarm at sea. It was verified that the effectiveness of the USV mathematical model and behavior control rules. By comparing the movement path of the swarm USV with and without the disturbance learning algorithm and ANN-PID control algorithm applied to the designed simulator, the position error and maintenance performance of the swarm formation were analyzed, and the application results were compared.

Switched model predictive control (S-MPC) and recurrent neural network with long short-term memory (RNN-LSTM) are powerful control methods that have been extensively studied for energy management in microgrids (MGs). These methods are complementary in terms of constraint satisfaction, computational demand, adaptability, and comprehensibility, but typically one method is chosen over the other. The S-MPC method selects optimal models and control strategies dynamically based on the system’s operating mode and performance objectives. On the other hand, integration of auto-regressive (AR) with these powerful control methods improves prediction accuracy and system conditions’ adaptability. This paper compares the two approaches to control and proposes a novel algorithm called Switched Auto-regressive Neural Control (S-ANC) that combines their respective strengths. Using a control formulation equivalent to S-MPC and the same controller model for learning, the results indicate that pure RNN-LSTM cannot provide constraint satisfaction. The novel S-ANC algorithm can satisfy constraints and deliver comparable performance to MPC while enabling continuous learning. Results indicate that S-MPC optimization increases power flows within the MG, resulting in efficient utilization of energy resources. By merging the AR and LSTM, the model’s computational time decreased by nearly 47.2%. Also, this study evaluated our predictive model’s accuracy: (i) R-squared error is 0.951, indicating strong predictive ability, and (ii) mean absolute error (MAE) and mean square error (MSE) values of 0.571 indicate accurate predictions with minimal deviations from actual values.

Brain-derived neurotrophic factor (BDNF) is a key molecule in promoting neurogenesis, dendritic and synaptic health, and neuronal survival, plasticity, and excitability, all of which are disrupted in neurological and cognitive disorders such as Alzheimer’s disease (AD). Extracellular aggregates of amyloid-β (Aβ) in the form of plaques and intracellular aggregates of hyperphosphorylated tau protein have been identified as major pathological insults in AD brain, along with immune dysfunction, oxidative stress, and other toxic stressors. Although aggregated Aβ and tau lead to decreased brain BDNF expression, early losses in BDNF prior to plaque and tangle formation may be due to other insults such as oxidative stress and contribute to early synaptic dysfunction. Physical exercise, on the other hand, protects synaptic and neuronal structure and function, with increased BDNF as a major mediator of exercise-induced enhancements in cognitive function. Here, we review recent literature on mechanisms behind exercise induced BDNF upregulation and its effects on improving learning and memory and on Alzheimer’s disease pathology. Mechanisms include elevations in peripheral BDNF-inducing hormones such as osteocalcin, FNDC5/irisin, and lactate. The fundamental mechanisms of how exercise impacts BDNF and cognition are unclear but are a prerequisite to developing new biomarkers and therapies to delay or prevent cognitive decline.

Emotions play a vital role in understanding human behavior and interpersonal relationships. The ability to recognize emotions through Electroencephalogram (EEG) signals offers an alternative to traditional methods, such as questionnaires, enabling the identification of emotional states in a non-intrusive manner. Automatic emotion recognition holds great potential, eliminating the need for clinical examinations or physical visits, thereby contributing significantly to the advancement of Brain-Computer Interface (BCI) technology. However, one of the key challenges lies in effectively selecting and extracting relevant features from the EEG signal to establish meaningful distinctions between different emotional states. The process of feature selection is often time-consuming and demanding. In this research, we propose a groundbreaking approach for automatically identifying three emotional states (positive, negative, and neutral) by leveraging auditory stimulation of EEG signals. Our novel method directly applies the raw EEG signal to a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) architecture, bypassing the conventional feature extraction and selection steps. This unconventional approach offers a significant departure from existing literature. Our proposed network architecture comprises ten convolutional layers, followed by three LSTM layers and two fully connected layers. Through extensive simulations and evaluations on 12 active channels, our algorithm demonstrates exceptional performance, achieving an accuracy of 97.42\% and 95.23\% for the binary classification of negative and positive emotions, as well as a Cohen's Kappa coefficient of 0.96 and 0.93 for the three-class classification (negative, neutral, and positive), respectively. These promising results highlight the efficacy of our novel methodology and its potential implications in advancing emotion recognition using EEG signals.

Today, more disciplines are intercepting each other, giving rise to “cross-disciplinary” research. Technological advancements in material science and device structure and production have paved the way towards development of new classes of multi-purpose sensory devices. Organic phototransistors (OPTs) are photo-activated sensors based on organic field-effect transistors that convert incident light signals into electrical signals. The organic semiconductor (OSC) layer and three-electrode structure of an OPT offer great advantages for light detection compared to conventional photodetectors and photodiodes, due to their signal amplification and noise reduction characteristics. Solution processing of the active layer enables mass production of OPT devices at significantly reduced cost. The chemical structure of OSCs can be modified accordingly to fulfil detection at various wavelengths for different purposes. Organic phototransistors have attracted substantial interest in a variety of fields, namely biomedical, medical diagnostics, healthcare, energy, security, and environmental monitoring. Lightweight and mechanically flexible and wearable OPTs are suitable alternatives not only at clinical levels but also for point-of-care and home-assisted usage. In this review, we aim to explain different types, working mechanism and figures of merit of organic phototransistors and highlight the recent advances from the literature on development and implementation of OPTs for a broad range of research and real-life applications.

Wernicke-Korsakoff syndrome (WKS) is induced by thiamine deficiency (TD) and mainly related to alcohol consumption. Frontal cortex dysfunction has been associated to impulsivity and disinhibition in WKS patients. The pathophysiology involves oxidative stress, excitotoxicity and inflammatory responses leading to neuronal death, but the relative contributions of each factor (alcohol and TD, isolate or in interaction) to these phenomena are still poorly understood. A rat model was used by forced consumption of 20% (w/v) alcohol for 9 months (CA), TD hit (TD diet + pyrithiamine 0.25 mg/kg, i.p. daily injections the last 12 days of experimentation; TDD), and both combined treatments (CA+TDD). Motor and cognitive performance and cortical damage were examined. CA caused hyperlocomotion as a possible sensitization of ethanol-induced excitatory effects and recognition memory deficits. In addition, CA+TDD animals showed a disinhibited-like behavior, which appears to be dependent on TDD. Also, combined treatment led to more pronounced alterations in nitrosative stress, lipid peroxidation, apoptosis and cell damage markers. Correlations between injury signals and disinhibition suggest that CA+TDD disrupts behaviors dependent on the frontal cortex. Our study sheds light on the potential disease-specific mechanisms, reinforcing the need for neuroprotective therapeutic approaches along with preventive treatments for the nutritional deficiency in WKS.

With the automotive industry moving towards automated driving, sensing is increasingly important in enabling technology. The virtual sensors allow data fusion from various vehicle sensors and provide a prediction for measurement that is hard or too expensive to measure in another way or in the case of demand on continuous detection. In this paper, virtual sensing is discussed for the case of vehicle suspension control, where information about the relative velocity of the unsprung mass for each vehicle corner is required. The corresponding goal can be identified as a regression task with multi-input sequence input. The hypothesis is that the state-of-art method of Bidirectional Long-Short Term Memory (BiLSMT) can solve it. In this paper, a virtual sensor has been proposed and developed by training a neural network model. The simulations have been performed using an experimentally validated full vehicle model in IPG Carmaker. Simulations provided the reference data which was used for Neural Network (NN) training. The extensive dataset covering 26 scenarios has been used to obtain training, validation and testing data. The Bayesian Search was used to select the best neural network structure using root mean square error as a metric. The best network is made of 167 BiLSTM, 256 fully connected hidden units and 4 output units. Error histograms and spectral analysis of the predicted signal compared to the reference signal are presented. The results demonstrate the good applicability of neural network-based virtual sensors to estimate vehicle unsprung mass relative velocity.

Automated lying-posture tracking is important in preventing bed-related disorders such as pressure injuries, sleep apnea, and lower-back pain. Prior research studied in-bed lying posture tracking using sensors of different modalities (e.g., accelerometer and pressure sensors). However, there remain significant gaps in research about how to design efficient in-bed lying posture tracking systems. These gaps can be articulated through several research questions as follows. First, can we design a single-sensor, pervasive, and inexpensive system that can accurately detect lying postures? Second, what computational models are most effective in the accurate detection of lying postures? Finally, what physical configuration of the sensor system is most effective for lying posture tracking? To answer these important research questions, in this article, we propose a comprehensive approach to design a sensor system that uses a single accelerometer along with machine learning algorithms for in-bed lying posture classification. We design two categories of machine learning algorithms based on deep learning and traditional classification with handcrafted features to detect lying postures. We also investigate what wearing sites are most effective in accurate detection of lying postures. We extensively evaluate the performance of the proposed algorithms on nine different body locations and four human lying postures using two datasets. Our results show that a system with a single accelerometer can be used with either deep learning or traditional classifiers to accurately detect lying postures. The best models in our approach achieve an F-Score that ranges from 95.2% to 97.8% with a coefficient of variation from 0.03 to 0.05. The results also identify the thighs and chest as the most salient body sites for lying posture tracking. Our findings in this article suggest that because accelerometers are ubiquitous and inexpensive sensors, they can be a viable source of information for pervasive monitoring of in-bed postures.

When using computer-aided translation systems in a typical, professional translation workflow, there are several stages at which there is room for improvement. The SCATE (Smart Computer-Aided Translation Environment) project investigated several of these aspects, both from a human-computer interaction point of view, as well as from a purely technological side. This paper describes the SCATE research with respect to improved fuzzy matching, parallel treebanks, the integration of translation memories with machine translation, quality estimation, terminology extraction from comparable texts, the use of speech recognition in the translation process, and human computer interaction and interface design for the professional translation environment. For each of these topics, we describe the experiments we performed and the conclusions drawn, providing an overview of the highlights of the entire SCATE project.

Ecosystemic services are those that provide material or immaterial benefits to the inhabitants of a landscape from its water, food, medicines and raw materials. They are classified into four types: provisioning, regulating, supporting and cultural. The latter can be defined as those non-material benefits that humans obtain through ecosystems. They include educational value, cultural diversity, sources of inspiration, spirituality and religious values, aesthetic value, social relations, rootedness or belonging, cultural heritage, recreational and ecotourism services, and scientific knowledge, among others. Characterising such diverse factors requires a systematisation in study facets for their management. We propose three: memory, image and socio-system, as differentiated spheres of approach to the urban landscape. The memory facet would include the ecosystemic services of belonging, cultural heritage and, in certain themes, cultural diversity, sources of inspiration and religious values. The image facet includes the aesthetic value and perceptual aspects of ecotourism. In the socio-system we would study the educational value, scientific knowledge and recreational or spirituality services, reflected in the endowments; but also social relations, rootedness and another vision of ecotourism.

Ultra high molecular weight polyethylene (UHMWPE) is a thermoplastic high-performance polymer in high demand for biomedicine, ship and machine building, anthropomorphic robots and smart prostheses. Highly oriented UHMWPE fibers possess record specific strength and may also be used for the fabrication of self-reinforced PE-PE composites (SRPEC). The temperature evolution study of the small-angle X-ray scattering (SAXS) signature of the supramolecular structure of UHMWPE can help reveal their important role in the mechanism of the shape memory effect in SRPEC. The laboratory SAXS–WAXS beamline XEUSS 3.0 was used for in situ studies of the nanostructure parameters in unidirectional SRPEC. Namely, the radius of gyration and the dimensionality factor were extracted from 2D SAXS patterns using several fitting algorithms. Significant changes of these parameters occurred in temperature ranges that correspond to the initiation of the shape memory effect and melting. The relationship between the material anisotropy and 2D SAXS patterns are discussed in the context of the supramolecular structure evolution.

We study the short−term memory capacity of ancient readers of the original New Testament written in Greek, of its translations to Latin and modern languages. To model the short–term capacity, we have considered the number of words per interpunctions, the “word interval” , because this parameter can model how the human mind memorizes “chunks” of information. Since can be calculated for any alphabetical text, we can perform experiments − otherwise impossible − with ancient readers by studying the literary works they used to read. The “experiments” compare the of texts of a language/translation to those of another language/translation by measuring the minimum average probability of finding joint readers (those who can read both texts because of their similar short–-term memory capacity) and by defining an “overlap index”. We also define a population of universal readers who can read any the New Testament written in alphabetical language. More than 50% of the readers of specific languages overlap with the universal readers with probability . Future work is vast, with many research tracks, because alphabetical literatures are very large and allow many experiments, such as comparing authors, translations or even texts written by artificial intelligence tools.

Nowadays, technological advancement has transformed traditional vehicles into Au-tonomous Vehicles (A.V.s). In addition, in our daily lives, A.V.s play an important role since they are considered an essential component of smart cities. A.V. is an intelligent vehicle capable of main-taining safe driving by avoiding crashes caused by drivers. Unlike traditional vehicles, which are fully controlled and operated by humans, A.V.s collect information about the outside environment using sensors to ensure safe navigation. Furthermore, A.V.s reduce environmental impact because they usually use electricity to operate instead of fossil fuel, thus decreasing the greenhouse gasses. However, A.V.s could be threatened by cyberattacks, posing risks to human life. For example, re-searchers reported that Wi-Fi technology could be vulnerable to cyberattacks through Tesla and BMW AVs. Therefore, more research is needed to detect cyberattacks targeting the components of A.V.s to mitigate their negative consequences. This research will contribute to the security of A.V.s by detecting cyberattacks at the early stages. First, we inject False Data Injection (FDI) attacks into an A.V. simulation-based system developed by MathWorks. Inc. Second, we collect the dataset generated from the simulation model after integrating the cyberattack. Third, we implement an intelligent symmetrical anomaly detection method to identify FDI attacks targeting the control system of the A.V. through a compromised sensor. We use long short-term memory (LSTM) deep networks to detect FDI attacks in the early stage to ensure the stability of the operation of A.V.s. Our method classifies the collected dataset into two classifications: normal and anomaly data. The ex-perimental result shows that our proposed model's accuracy is 99.95%. To this end, the proposed model outperforms other state-of-the-art models in the same study area.

There has been a growing interest in incorporating psychological and neuroscientific knowledge about the development of cognitive functions in educational policies and academic practices. In this paper, we argue that the current knowledge about the interactions between these functions and their neurodevelopmental characteristics should also be considered in order to develop practices that could be better suited to pupils depending on their age. To facilitate this, we review current neuroscientific knowledge on the competitive interactions between two neural circuitry underlying distinct learning functions, their developmental trajectories and how they are linked to other functions such as cognitive control. The incorporation of this knowledge in education could help improve academic outcomes.

In computer networks, loss of data packets is inevitable, in particular, because of the buffer memory overflow of at least one of the nodes located on the path from the source to the receiver, including the latter. Such losses associated with overflows are hereinafter referred to as congestion of network nodes. There are many ways to prevent and eliminate overloads; these methods, in the majority, are based on the management of data flows. A special place is taken by the maintenance of packages, taking into account their priorities. The article considers a number of original technical solutions to improve the quality of control and reduce the required amount of buffer memory of network nodes. The ideas of these solutions are quite simple for their implementation in the development of appropriate software and hardware for telecommunication devices.

The ever-evolving ways attacker continues to im prove their phishing techniques to bypass existing state-of-the-art phishing detection methods pose a mountain of challenges to researchers in both industry and academia research due to the inability of current approaches to detect complex phishing attack. Thus, current anti-phishing methods remain vulnerable to complex phishing because of the increasingly sophistication tactics adopted by attacker coupled with the rate at which new tactics are being developed to evade detection. In this research, we proposed an adaptable framework that combines Deep learning and Randon Forest to read images, synthesize speech from deep-fake videos, and natural language processing at various predictions layered to significantly increase the performance of machine learning models for phishing attack detection.

We propose that the short−term memory (STM), when processing a sentence, uses two uncorrelated processing units in series. The clues for conjecturing this model emerge from studying many novels of the Italian and English Literatures. This simple model, referring to the surface of language, seems to describe mathematically the input-output characteristics of a complex mental process involved in a reading/writing a sentence. We show that there are no significant mathematical/statistical differences between the two literary corpora by considering deep-language variables and linguistic communication channels, therefore, the surface mathematical structure of alphabetical languages is very deeply rooted in human mind, independently of the language used. The first processing unit is linked to the number of words between two contiguous interpunctions, variable Ip, approximately ranging in Miller’s 7±2 range; the second unit is linked to the number of Ip’s contained in a sentence, variable MF, ranging approximately from 1 to 6. The overall capacity required to process fully of a sentence ranges from 8.3 to 61.23 words, values that can be converted into time by assuming a reading speed, giving the range 2.64~19.54 seconds for fast-reading and 5.3~30.1 seconds for average reader. Since a sentence conveys meaning, the surface features we have found might be the starting point to arrive at an Information Theory that includes meaning.

Deep neural networks (DNNs) have gained prominence in addressing regression problems, offering versatile architectural designs that cater to various applications. In the field of earthquake engineering, seismic response prediction is a critical area of study. Simplified models such as single-degree-of-freedom (SDOF) and multi-degree-of-freedom (MDOF) systems have traditionally provided valuable insights into structural behavior, known for their computational efficiency facilitating faster simulations. However, these models have notable limitations in capturing the nuanced nonlinear behavior of structures and the spatial variability of ground motions. This study focuses on leveraging ambient vibration (AV) measurements of buildings, combined with earthquake (EQ) time-history data, to create a predictive model using a neural network (NN) in image format. The primary objective is to predict a specific building's earthquake response accurately. The training dataset consists of 1,197 MDOF 2D shear models, generating a total of 32,319 training samples. To evaluate the performance of the proposed model, termed MLPER (Machine Learning based Prediction of building structures' Earthquake Response), several metrics are employed. These include mean absolute percentage error (MAPE) and mean deviation angle (MDA) for comparisons in the time domain. Additionally, we assess magnitude-squared coherence values and phase differences (Δφ) for comparisons in the frequency domain. This study underscores the potential of MLPER as a reliable tool for predicting building earthquake response, addressing the limitations of simplified models. By integrating AV measurements and EQ time-history data into a neural network framework, MLPER offers a promising avenue for enhancing our understanding of structural behavior during seismic events, ultimately contributing to improved earthquake resilience in building design and engineering.

Using of the organic base tetramethylammonium hydroxides (TMAH) is a viable, cheap and fast route, for the MgZnAl-LDH type materials synthesis by both co-precipitation and mechano-chemical methods. TMAH provided several advantages as smaller quantity of water required in the washing step compared to the use of inorganic alkalis, prevention of LDH contamination with alkali cations, acting as template molecule in texture tailoring along with disadvantages as its presence in small quantities in the resulting layered materials. Regardless the use of organic / inorganic bases and co-precipitation / mechano-chemical methods, zincite stable phase was found in all the synthesized solids. The basicity of catalysts followed the trend: mixed oxides > reconstructed > parent LDH. The memory effect of LDH is supported only by the presence of Mg and Al cations, while Zn remains as zincite stable phase. The catalytic activities for Claisen-Schmidt condensation of benzaldehyde with cyclohexanone provided values higher than 90% after 2h, with a total selectivity in 2,6-dibenzylidenecyclohexanone, while in self-condensation of cyclohexanone no more than 7.29% after 5h. These behaviors depended on catalysts basicity as well as the planar rigidity of the compound.

Accurate forecasting of wind power generation plays a key role in improving the operation and management of a power system network and thereby its reliability and security. However, predicting wind power is complex due to the existence of high non-linearity in wind speed that eventually relies on prevailing weather conditions. In this paper, a novel hybrid deep learning model is proposed to improve the prediction accuracy of very short-term wind power generation for the Bodangora Wind Farm located in New South Wales, Australia. The hybrid model consists of convolutional layers, gated recurrent unit (GRU) layers and a fully connected neural network. The convolutional layers have the ability to automatically learn complex features from raw data while the GRU layers are capable of directly learning multiple parallel sequences of input data. The data sets of five-minute intervals from the wind farm are used in case studies to demonstrate the effectiveness of the proposed model against other advanced existing models, including long short-term memory (LSTM), GRU, autoregressive integrated moving average (ARIMA) and support vector machine (SVM), which are tuned to optimise outcome. It is observed that the hybrid deep learning model exhibits superior performance over other forecasting models to improve the accuracy of wind power forecasting, numerically, up to 1.59 per cent in mean absolute error, 3.73 per cent in root mean square error and 8.13 per cent in mean absolute percentage error.

Understanding brain function is one of the most important open problems in science today. At present, there is no concrete theory for how the brain works. Here, a theory is presented that provides a detailed mechanistic biological account of the brain’s capacities. Brain function is managed by a response (R) process that is structurally similar to the immune response, and shows anatomical and molecular specificity. Different R process stages utilize different cortical layers, hippocampus fields, basal ganglia paths, GABAergic interneurons, cerebellum paths, and molecular agents such as dopamine, serotonin and opioids. We show how the R process supports hierarchical action sequences, language and thought. The theory is supported by a large body of experimental evidence in many modalities, and accounts for virtually all of the major facts known about the brain at the system level.

Electricity demand forecasting plays a significant role in energy markets. Accurate prediction of electricity demand is the key factor to optimize power generation, consumption, saving energy resources, and determining the energy prices. However, integrating energy mix scenarios, including solar and wind power which are highly non-linear and seasonal, into an existing grid increases uncertainty in generation, adds the challenges for precise forecast. To tackle these challenges, state-of-the-art methods and algorithms have been implemented in literature. We have developed Artificial Intelligence (AI) based deep learning models that can effectively handle the information of long time-series data. Based on the pattern of dataset, four different scenarios were developed and two best scenarios were selected for prediction. Dozens of models were developed and tested in deep AI networks. In the first scenario (Scenario1), data for weekdays excluding holidays was taken and in the second scenario (Scenario2) all the data in the basket was taken. Remaining two scenarios, weekends and holidays were tested and neglected because of their high prediction error. To find the optimal configuration, models were trained and tested within a large space of alternatives called hyper-parameters. In this study, an Aritificial Neural Network (ANN) based Feed-forward Neural Network (FNN) showed the minimum prediction error for Scenario1 while a Recurrent Neural Network (RNN) based Gated Recurrent Network (GRU) showed the minimum prediction error for Scenario2. While comparing the accuracy, the lowest MAPE of 2.47% was obtained from FNN for Scenario1. When evaluating the same testing dataset (non-holidays) of Scenario2, the RNN-GRU model achieved the lowest MAPE of 2.71%. Therefore, we can conclude that grouping of weekdays as Senario1 prepared by excluding the holidays provides better forecasting accuracy compared to the single group approach used in Scenario2, where all the dataset is considered together. However, Scenario2 is equally important to predict the demand for weekends and holidays.

An abdominal aortic aneurysm (AAA) is usually asymptomatic until rupture, which is associated with extremely high mortality. Consequently, early detection of AAAs is of paramount importance in reducing mortality; however, most AAAs are detected by medical imaging incidentally. The aim of this study was to investigate the feasibility of machine learning-based pulse wave (PW) analysis for the early detection of AAAs using a database of in silico PWs. PWs in the large systemic arteries were simulated using one-dimensional blood flow modelling. A database of in silico PWs representative of subjects (aged 55, 65 and 75 years) with different AAA sizes was created by varying the AAA-related parameters with major impacts on PWs – identified by parameter sensitivity analysis – in an existing database of in silico PWs representative of subjects without AAA. Then, a machine learning architecture for early detection of AAAs was proposed, which was trained and tested using the new in silico PW database. The parameter sensitivity analysis revealed that the AAA maximum diameter and stiffness of the large systemic arteries were the dominant AAA-related biophysical properties that significantly influence the PW. The simulated PW indexes extracted from the database showed that the PW was not only influenced by the presence of an AAA but was also significantly affected by multiple cardiovascular parameters that compromised the detection of AAAs by using individual PW indexes. Alternatively, the trained machine learning model performed well in classifying normal and AAA conditions using digital photoplethysmogram PWs from the database. These findings suggest that machine learning-based PW analysis is a promising approach for AAA screening using PW signals acquired by wearable devices.

We examined special roles of the Central Nervous System (CNS) in an attempt to resolve the puzzle that chronic diseases cannot be cured by medicine. By exploring a skill-learning model, we found that the CNS is able to remember certain information reflecting biochemical and cellular (B&C) processes in the body. From the skill using ability, we found that the CNS is able to control basic B&C processes that drive and power the skill. From the ability to adjust forces and force direction of a physical act, we found that the CNS is able to adjust B&C processes that drive the physical act. From this adjustment capability, we further inferred that the CNS must also store information on the baseline B&C processes. As a whole, we found that the CNS can maintain information on baseline B&C processes, up-regulate or down-regulate the processes, and make comparisons in performing its regulatory functions. We found that chronic diseases are the results of deviated baseline B&C processes. Per the proved hypothesis, the CNS maintains deviated baseline B&C processes, and thus protects the body states of fully developed diseases. We then used the three CNS roles to explain that cancer progresses with increasing malignancy, cancer quickly returns after a surgery, cancer cells repopulate after chemotherapy and radiotherapy, cancer develops drug resistance inevitably, immune cells rebound after suppression, generally poor benefits of cancer drugs such as beta-blockers, etc. We further showed that long-term exercises generally push most, if not all, baseline B&C processes in diametrical opposing directions against the diseased B&C processes, implying that exercises play unique roles in reversing chronic diseases. Finally, we proposed several strategical approaches to resetting the CNS’ state memory as the essential condition for curing chronic diseases.

The Bayes filters, such as Kalman and particle filters, have been used in sensor fusion to integrate two sources of information and obtain the best estimate of the unknowns. Efficient integration of multiple sensors requires deep knowledge of their error sources and it is not trivial for complicated sensors, such as Inertial Measurement Unit (IMU). Therefore, IMU error modelling and efficient integration of IMU and Global Navigation Satellite System (GNSS) observations has remained a challenge. In this paper, we develop deep Kalman filter to model and remove IMU errors and consequently, improve the accuracy of IMU positioning. In other words, we add modelling step to the prediction and update steps of Kalman filter and the IMU error model is learned during integration. Therefore, our deep Kalman filter outperforms Kalman filter and reaches higher accuracy.

This study investigated co-constructed research poetry as a way to understand the lived experiences of people affected by rarer dementia and as a means to use poetry to convey those experiences to healthcare professionals. Using mixed-methods, 71 people living with rarer dementia and care-partners (stakeholders) contributed to co-constructing 27 poems with professional poets; stakeholders’ verbatim words were analysed with descriptive qualitative analysis. Stakeholders were also surveyed and interviewed about their participation. Healthcare professionals (n = 93) were surveyed to elicit their responses to learning through poetry and its acceptability as a learning tool. Poems conveyed a shared narrative of different aspects of lived experience, often owing to atypical symptoms, misunderstandings by professionals, lack of support pathways, and a continuous struggle to adapt. Stakeholder surveys indicated it was a valuable experience to both co-create and respond to the poems, whilst group interviews revealed people’s experiences of the research poetry were characterised by reflection on lived experience, curiosity and exploration. Healthcare professionals’ responses reinforced the poetry’s capacity to stimulate cognitive and affective learning specific to rare dementia support and prompt both empathy and critical thinking in practice. As the largest poetry-based study that we are aware of, this novel accessible approach of creating group poems yielded substantial information about the experiences and needs of those affected by rarer dementia and how poetry can contribute to healthcare education and training.

This work addresses the challenge of EEG visual multiclass classification into 40 classes for Brain-Computer interface applications, by using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage, since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, performing multiclassifiers based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and Minimum-Norm Estimate algorithms are implemented to select discriminant channels and enhance EEG data. Hence, deep EEGNet and Convolutional-recurrent neural networks are implemented separately to classify EEG data of image visualization into 40 labels. By using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures, respectively. Satisfactory results obtained with this method offer a new implementation opportunity for multi-task BCI applications by utilizing a reduced number of channels (<50%), compared to those presented in the related literature where the whole set of channels is used.

Deep Learning (DL) oriented document processing is widely used in different fields for extraction, recognition, and classification processes from raw corpora of data. The article examines the application of deep learning approaches, based on different neural network methods, including Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and Convolutional Neural Networks (CNN). The compared models were combined with two different word embedding techniques, namely: Bidirectional Encoder Representations from Transformers BERT and Gensim Word2Vec. The models are designed to evaluate the performance of architectures based on neural network techniques for the classification of CVs of Moroccan engineering students at ENSAK(National School of Applied Sciences of Kenitra, Ibn Tofail University). The used dataset included resumes collected from engineering students at ENSAK in 2023 for a project on the employability of Moroccan engineers in which new approaches were applied, especially machine learning, deep learning, and big data. Accordingly, 867 resumes were collected from five specialties of study (Electrical Engineering, Networks and Systems Telecommunications, Computer Engineering, Automotive Mechatronics Engineering, Industrial Engineering). The results revealed good performance of the proposed models based on the BERT embedding approach compared to models based on the Gensim Word2Vec embedding approach. Accordingly, the CNN-GRU/Bert model achieved slightly better accuracy with 0.9251 compared to other hybrid models.

Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This work addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, this work proposes an efficient deep learning framework to discern stress from facial videos. In contrast to research on wearable devices, this paper investigates the application of *dl for stress detection based on *rppg. The methodology involves selecting suitable *dl models (*lstm, *gru, *1dcnn), optimising hyperparameters, and investigating augmentation techniques. 1D-CNNv1 model achieved the best performance compared to other approaches, particularly with augmentation techniques such as linear interpolation and white noise, achieving a stress classification accuracy of 95.83% while maintaining excellent computational efficiency. The experimental results demonstrate the use of *dl for stress detection based on *rppg, with the potential to make significant contributions to the international standard in the field.

We previously reported nano-pulse treatment (NPT), a pulsed power technology, resulted in 4T1-luc mammary tumor elimination and a strong in situ vaccination, thereby completely protecting tumor-free animals against a second live tumor challenge. The mechanism whereby NPT mounts effective antitumor immune responses in the 4T1 breast cancer predominantly immunosuppressive tumor microenvironment (TME) remains unanswered. In this study, orthotopic 4T1 mouse breast tumors were treated with NPT (100 ns, 50 kV/cm, 1000 pulses, 3 Hz). Blood, spleen, draining lymph nodes and tumors were harvested at 4-hour, 8-hour, 1-, 3-, 7-day. Additional studies were conducted over 3-month posttreatment intervals for the analysis of frequencies, death and functional markers of various immune cells in addition to suppressor function of regulatory T cells (Tregs). NPT was verified to elicit strong in situ vaccination (ISV) against breast cancer and promoted both acute and long-term T cell memory. NPT abolished immunosuppressive dominance systemically and in the TME by substantially reducing Tregs, myeloid-derived suppressor cells (MDSCs), and tumor-associated macrophages (TAMs). NPT induced apoptosis in Tregs and TAMs. It also functionally diminished the Treg suppression capacity, likely explained by the downregulation of activation markers, particularly 4-1BB and TGFβ, and a phenotypic shift from predominantly activated (CD44+CD62L-) to naïve (CD44-CD62L+) Tregs. Importantly, NPT selectively induced apoptosis in activated Tregs and spared effector CD4+ and CD8+ T cells. These changes were followed by a concomitant rise in CD8+CD103+ tissue-resident memory T cells and TAM M1 polarization. These findings indicate that NPT effectively switches the TME and secondary lymphatic systems from an immunosuppressive to an immunostimulatory state allowing cytotoxic T-cell function and immune memory formation to eliminate cancer cells and account for the NPT in situ vaccination.

Nowadays, power sector is an area that gather great scientific interest, due to events such as the increase in electricity prices in the wholesale energy market and new investments due to technological development in various sectors. These new challenges have in turn created new needs, such as the accurate prediction of the electrical load of the end users. On the occasion of the new challenges, Artificial Neural Networks approaches have become increasingly popular due to their ability to adopt efficiently to time-series predictions. In this paper, it is presented the development of a model which, through an automated process, will provide an accurate prediction of electrical load for the island of Thira in Greece. Through an automated application, deep learning load forecasting models have been created, such as Multilayer Perceptron, Long Short-Term Memory (LSTM), Convolutional Neural Network One Dimensional (CNN-1D), CNN-LSTM, Temporal Convolutional Network (TCN) and a proposed hybrid model called Convolutional LSTM Encoder-Decoder. The results in terms of prediction accuracy show satisfactory performances for all models, with the proposed hybrid model achieving the best accuracy.

Depression and cognitive impairment are recognized complications of COVID-19. This study aimed to assess cognitive performance in clinically diagnosed post-COVID depression (PCD) patients using neuropsychological testing. The study involved 71 post-COVID patients, with matched control groups: recovered COVID-19 individuals without complications (n=18) and individuals without prior COVID-19 history (n=19). A post-COVID depression group (PCD, n=25) was identified based on psychiatric diagnosis, a comparison group (noPCD, n=46) included participants with neurological COVID-19 complications, excluding clinical depression. The PCD patients showed significantly less scores in the MoCA test, decreased immediate memory recall in the Word Memory Test, decreased processing speed and higher accuracy in the Trail Making Test, and near to significant worse executive control and processing speed in the Stroop task compared to controls and the noPCD patients. The number of post-COVID symptoms negatively correlated with immediate word memory recall and processing speed among all post-COVID patients. In PCD patients, negative correlations between number of post-COVID symptoms and delayed recall, between time after recovery and immediate recall, and positive correlation between the number of acute symptoms and processing speed in the incongruent condition of the Stroop task were found. No differences between groups in Sniffin’s stick olfactory test was found. Overall, our study revealed cognitive impairment in PCD patients similar to those in major depressive disorder.

Cultural Tourism (CT), which enhances the economic development of a region, aids a country in reinforcing its identities, enhancing cross-cultural understanding, and preserving the heritage culture of an area. Designing a proper tourism model assists the tourists in understanding the point of interest without the help of a local guide. However, owing to the need for the analysis of different factors, designing such a model is a complex process. Therefore, this article proposes a CT model for Riyadh for peak visitor time. Primarily, the map data and cultural event dataset are processed for location, such as grouping with Kriging Interpolation-based Chameleon (KIC), tree forming, and feature extraction. After that, the event dataset’s attributes are processed with word embedding. Meanwhile, the Social Network Sites (SNS) data like reviews and news are extracted with an external Application Programming Interface (API). The review data is processed with keyword extraction and word embedding, whereas the news data is processed with score value estimation. Lastly, the data are fused corresponding to a historical site and given to the Multi-Quadratic-Long Short Term Memory (MQ-LSTM) Recommendation System (RS); also, the recommended result with the map is stored in a database. Lastly, the database security is maintained with Locality Sensitive Hashing (LSH); moreover, by attaining higher performance values, the proposed model is experimentally verified.

In the face of the upcoming 30th anniversary of econophysics, we review our contributions and other related works on the modeling of the long–range memory phenomenon in physical, economic, and other social complex systems. Our group has shown that the long–range memory phenomenon can be reproduced using various Markov processes, such as point processes, stochastic differential equations and agent–based models. Reproduced well enough to match other statistical properties of the financial markets, such as return and trading activity distributions and first–passage time distributions. Research has lead us to question whether the observed long–range memory is a result of actual long–range memory process or just a consequence of non–linearity of Markov processes. As our most recent result we discuss the long–range memory of the order flow data in the financial markets and other social systems from the perspective of the fractional Lèvy stable motion. We test widely used long-range memory estimators on discrete fractional Lèvy stable motion represented by the ARFIMA sample series. Our newly obtained results seem indicate that new estimators of self–similarity and long–range memory for analyzing systems with non–Gaussian distributions have to be developed.

HLA class-I (HLA-I) polyreactive monoclonal antibodies (mAbs) reacting to all HLA-I alleles were developed by immunizing HLA-E monomeric heavy chain (HC) (Open Conformers, OCs). Two of the mAbs (TFL-006 and TFL-007) bound to the HC’s coated on a solid matrix. The binding was inhibited by a peptide 117AYDGKDY123, present in all alleles of the six HLA-I isoforms but masked by 2-microglobulin -m) in intact HLA-I trimers (Closed Conformers, CCs). Identical HLA-I polyreactivity is observed in IVIg administered to lower anti-HLA antibodies (Abs) in HLA-sensitized patients, but the mechanism is unknown. We hypothesized that the mAbs that mimic IVIg HLA-I polyreactivity might mimic the immunomodulatory functions of IVIg. We tested the relative binding affinity of the mAbs and IVIg for both OCs- and CCs and compared their effects on (a) the phytohemagglutinin (PHA)-activation T-cells, (b) the production of anti-HLA-II antibody (Ab) by B-memory cells, and anti-HLA-I Ab by immortalized B-cells, and (c) the upregulation of CD4+, CD25+, and Fox P3+ T-regs. The mAbs bound only to OCs, whereas IVIg is bound to both CCs and OCs. The mAbs suppressed blastogenesis and proliferation of PHA-activated T-cells, anti-HLA Ab production by B-cells and expanded the T-regs, better than IVIg. We conclude that a humanized version of the TFL-mAbs could be an ideal therapeutic IVIg-mimetic.

Recent improvements in deepfake creation have made deepfake videos more realistic. Moreover, open-source software has made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the people’s privacy. There is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of countries and the world. Therefore, research into the automatic detection of deepfaked media is essential for public security. In this work, we propose a deepfake detection method using upper body language analysis. Specifically, a many-to-one LSTM network was designed and trained as a classification model for deepfake detection. Different models were trained by varying the hyperparameters to build a final model with benchmark accuracy. We achieved 94.39% accuracy on the deepfake test set. The experimental results showed that upper body language can effectively detect deepfakes.

Predicting change from multivariate time series has relevant applications ranging from medical to engineering fields. Multisensory stimulation therapy in patients with dementia aims to change the patient’s behavioral state. For example, patients who exhibit a baseline of agitation may be paced to change their behavioral state to relaxed. This study aims to predict changes in behavioral state from the analysis of the physiological and neurovegetative parameters to support the therapist during the stimulation session. In order to extract valuable indicators for predicting changes, both handcrafted and learned features were evaluated and compared. The handcrafted features were defined starting from the CATCH22 feature collection, while the learned ones were extracted using a Temporal Convolutional Network, and the behavioral state was predicted through Bidirectional Long Short-Term Memory Auto-Encoder, operating jointly. From the comparison with the state-of-the-art, the learned features-based approach exhibits superior performance with accuracy rates of up to 99.42% with a time window of 70 seconds and up to 98.44% with a time window of 10 seconds.

Deep learning (DL) algorithms have recently emerged from machine learning and soft computing techniques. Since then, several deep learning (DL) algorithms have been recently introduced to scientific communities and are applied in various application domains. Today the usage of DL has become essential due to their intelligence, efficient learning, accuracy and robustness in model building. However, in the scientific literature, a comprehensive list of DL algorithms has not been introduced yet. This paper provides a list of the most popular DL algorithms, along with their applications domains.

The sustainability of the planet and its inhabitants is in dire danger and is among the highest priorities on global agendas such as the Sustainable Development Goals (SDGs) of the United Nations (UN). Solar energy -- among other clean, renewable, and sustainable energies -- is seen as essential for environmental, social, and economic sustainability. Predicting solar energy accurately is critical to increasing reliability and stability, and reducing the risks and costs of the energy systems and markets. Researchers have come a long way in developing cutting-edge solar energy forecasting methods. However, these methods are far from optimal in terms of their accuracies, generalizability, benchmarking, and other requirements. Particularly, no single method performs well across all climates and weathers due to the large variations in meteorological data. This paper proposes SENERGY (an acronym for Sustainable Energy), a novel deep learning-based auto-selective approach and tool that, instead of generalising a specific model for all climates, predicts the best performing deep learning model for GHI forecasting in terms of forecasting error. The approach is based on carefully devised deep learning methods and feature sets through an extensive analysis of deep learning forecasting and classification methods using ten meteorological datasets from three continents. We analyse the tool in great detail through a range of metrics and methods for performance analysis, visualization, and comparison of solar forecasting methods. SENERGY outperforms existing methods in all performance metrics including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Forecast Skills (FS), Relative Forecasting Error, and the normalised versions of these metrics. The proposed auto-selective approach can be extended to other research problems such as wind energy forecasting and predict forecasting models based on different criteria (in addition to the minimum forecasting error used in this paper) such as the energy required or speed of model execution, different input features, different optimisations of the same models, or other user preferences.

Time-series analysis is a widely used technique across various fields and industries, as it helps in understanding, predicting, and forecasting the behavior of data points over time. These fields include but are not limited to finance, economics, healthcare, transportation, etc. In the case of this paper, we have focused on finance. Predicting future values of financial time series offers several benefits. Accurate forecasts can help investors make better decisions about their investments. To predict future values, deep learning algorithms are commonly used since it is an effective method with complex data. In this study, we conduct a study that investigates the use of different data pre-processing techniques on deep learning algorithms in predicting the time series values. To conduct this experimental study, we utilize an open source software, which using long short-term memory technique as the representative deep learning technique, published in github software code repository platform. With this study, we investigate the effects of autoencoder and discrete wavelet transform data pre-processing techniques in time-series prediction. We discuss the details of the experimental study and report our results. The results show that time series prediction (using backtesting methodology) without any data pre-processing leads to 12.6% for mean absolute percentage error. The results also show that, time series prediction with the data preprocessing techniques (Wavelet Transform and Stacked Autoencoder) lead to 3.4%

Understanding brain function is one of the most important problems in human history. At present, there is no concrete theory for how the brain works. Here, a theory is presented that provides a detailed mechanistic biological account of the brain's capacities, including motor control, functional states, language, and thinking. Brain function is managed by a well-defined response (R) process that is generally similar to the process underlying the immune system. The R process is strongly reflected in the brain's anatomy, physiology, and external interactions. Different R process stages are supported by distinct excitatory networks located in different cortical layers, hippocampal fields, and bagal ganglia paths, by distinct coordination networks comprised of GABAergic interneurons, and by distinct molecular agents. The roles of norepinephrine, serotonin, dopamine and acetylcholine is to promote the alert, planning, goal-setting and execution R process modes, respectively. Opioids and oxytocin promote termination by success, failure, fight or run, while glucocorticoids and cannabinoids suppress acute responses to protect cells. The R process has two instances occurring at different time scales. The millisecond-scale Quax process implements the execution of hierarchical sequences of movements and thoughts, in which the selection of the next action is determined via interaction between top-down predictions and sensory inputs. The slower Need process controls the satisfaction of internal and external needs. The theory differs from the existing standard accounts in many of the major topics (e.g., the basal ganglia, dopamine, language), and shows how cognition results from biological processes.

Continual learning, a crucial facet of machine learning, involves the perpetual acquisition of valuable insights from incoming data, sans the necessity for full dataset access. Esteemed as a fundamental goal in artificial intelligence, continual learning grapples with an enduring challenge—catastrophic forgetting. A proficient model must exhibit adaptability for new data assimilation and robustness to retain existing knowledge. Class-incremental learning (CIL) aids the gradual integration of knowledge from newly introduced classes, forming a universal classifier. However, directly training the model with fresh class instances triggers a problem—forgetting distinguishing features of prior classes, causing a performance decline. Addressing such issues in machine learning, this survey aims to delineate significant challenges, outcomes, and recent advancements, including our contributions to CIL techniques, especially in image classification.

SARS-CoV-2 Omicron variant spike RBD epitopes in complex with spike (S) -protein D614G mutations now predominate globally and increase infectivity by assembling more functional S proteins into the virion. On average, homeopathic medicine contains less than one molecule per dose on average. Single variable SphericalHarmonicY, LaguerreL, WhittakerM, SphericalBesselJ, LegendreP, LegendreQ, LaguerreL, ChebyshevT, and Hypergeometric1F1 Functions pFqarise in connection with the power series solution of the Schrodinger equation or in the summation of perturbation expansions in quantum mechanics. A quantum interpretation of the homeopathic method is presented here through a novel algebraic topology approach to supersymmetry and symmetry breaking in quantum fields and quantum gravity theory with the aim of developing a wide range of physical-based drug design applications in a Small Molecule Quantized Water Memory Network suggesting that the Hidden Black Hole Paradox of Information Loss might be solved under suitable conditions.