Nowadays people express their opinions on social media. Also provides product reviews on eCommerce websites and responds to various news as comments. It is necessary to know the polarity and aspect of various posts and comments for business, education and security. Aspect-based sentiment analysis (ABSA) predicts text category and polarity. In this paper, we proposed a deep learning framework Deep-ABSA for aspect-based sentiment analysis from Bangla texts. Our proposed framework is a multi-channel architecture. We implemented the word embedding, Bi-LSTM with the attention mechanism for one channel. And for another channel, we adopted the character-embedded convolutional neural network. Finally, we concatenated both channels for adjoining the features of each channel. We obtained an adequate performance from our proposed framework for aspect term analysis from Bangla sentences.

This paper proposes a Grouped Contrastive Learning of self-supervised Sentence Representation (GCLSR), which can learn an effective and meaningful representation of sentences. Previous works maximize the similarity between two vectors to be the objective of contrastive learning, suffering from the high-dimensionality of the vectors. In addition, most previous works have adopted discrete data augmentation to obtain positive samples and directly employed contrastive framework of computer vision to perform contrastive training, which could hamper contrastive training because text data is discrete and sparse compared with image data. To address those issues, we propose a grouped contrastive learning framework, i.e., GCLSR, which divides the high-dimensional feature vector into several groups and respectively computes the groups’ contrastive losses to make use of more local information, eventually obtaining a more fine-grained sentence representation. In addition, in GCLSR, we design a new self-attention mechanism and a continuous as well as partial word vector augmentation (PWVA). For the discrete and sparse text data, the usage of self-attention could help model focus the informative words by measuring the importance of every word in a sentence. By using the PWVA, GCLSR can obtain high-quality positive samples used for contrastive learning. Experimental results demonstrate that our proposed GCLSR achieves an encouraging result on the challenging datasets of the standard semantic textual similarity (STS) task and transfer task.

The research of object classification and part segmentation is a hot topic in computer vision. A considerable number of studies have been carried out about deep learning on 3D point clouds. However,it is challenging to achieve effective feature learning due to sparsity of point clouds. Recently, a variety of Transformers have been adopted to improve point cloud processing and display great potential. Nevertheless, large numbers of Transformer layers tend to incur huge computational and memory costs. PointNet++ is one of the most influential neural architectures for point cloud understanding. Although the accuracy of PointNet++ has been largely surpassed by recent networks, this does not mean that PointNet++ has no potential.Thus, this paper offer two major contributions that significantly improve PointNet++ performance. Firstly, we introduce a novel contextual feature extraction (CFE) block that significantly enhances the feature extraction capabilities of PointNet++ networks. Secondly, to further enhance feature fusion, we seamlessly integrate a mutual learning (ML) block into the network architecture. By embedding these two innovative blocks within each layer of the network, we not only enrich the network's functionality but also impart it with greater robustness and adaptability. The specific experiments were conducted on the S3DIS (6-fold cross-validation) and Modelnet40 datasets with 86.5% and 92.7% accuracy, respectively, which proved that our model is comparable or even better than most existing methods for classification and segmentation tasks.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Microscopic vision plays an important role in automated micro-assembly. However, some uncertain factors in the assembly process, such as occlusion and stains can lead to the mistakes of feature extraction. Herein, to solve the problem, the deep learning techniques are introduced into the feature recognition tasks, focusing on the attention mechanism and visualizing CNNs for DL-based microscopic vision. The main contributions are summarized as follows: The CBAM attention mechanism is combined with the YOLOv5 algorithm to improve the accuracy and robustness of feature extraction. The micropart feature occlusion experiment results show that at 70% occlusion degree, YOLOV5-CBAM can reach 97.9% mAP@0.5, which is 4.6% higher than the original one. Visualization analysis of DL-based model is conducted using Grad-CAM to make the decision result more transparent and avoid potential visual detection risks during assembly. The heatmap matching degree between GT area and high-light area is increased by 27.81% on average, which further verify the effectiveness of attention mechanism in micropart feature localization. Additionally, micropart surface stain and droplet quality classification models based on ResNet50 are trained to replace the manual sorting. The visual results are consistent with human eye discernment and judgement, confirming the reliability of parts and droplets sorting.

In recent years, intelligent identification and prediction of ore deposits based on deep learning algorithm and image processing technology has gradually become one of the research frontiers in the field of geological and metallogenic prediction. However, this method also has many problems that need to be solved. For example, (1) very few trainable image samples containing mineral point labels; (2) The geological image features are small and irregular, and the image similarity is high; (3) It is difficult to calculate the influence of different geological prospecting factors on ore mineralization. Based on this, this paper constructs a deep learning network model Multiscale Feature Attention Framework (MFAF) based on geo-image data. The results show that MFCA-Net module in MFAF model can solve the problem of scarce mine label images to a certain extent. In addition, the channel attention mechanism SE-Net module can quantify the difference of influence of different source factors on mineralization. The prediction map is obtained by applying the MFAF model in the study of deposit identification and prediction in the research area of the southern section of Qin-hang metallogenic Belt. In the forecast map, many regions have high metallogenic potential. Through observation, it is found that the above predicted area covers 100% of the known ore deposits at present, which has a good prediction effect. Later, we can find out the specific reasons through field verification. The multi-scale feature fusion and attention mechanism MFA Framework in this paper can provide a new way of thinking for geologists in mineral exploration. The research of this paper also provides resource guarantee and technical support for the sustainable exploitation of mineral resources and the sustainable growth of society and economy.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

The evolution of sentence representation learning, especially with parse tree encoders, has shown remarkable progress. Traditional approaches predominantly rely on recursive encoding of tree structures, which impedes parallel processing capabilities. Additionally, these methods often overlook the significance of dependency tree arc labels. To overcome these limitations, we introduce the Syntax-Enhanced Transformer (SET), incorporating a novel dual-attention mechanism that integrates relation-focused attention alongside traditional self-attention. This design effectively encodes both dependency and spatial positional relationships within sentence dependency trees. Our approach innovatively incorporates syntactic information into the Transformer framework without compromising its inherent parallelizability. The SET demonstrates superior or comparable performance to contemporary methods across various sentence representation tasks, significantly enhancing computational efficiency.

Effortful control (EC) describes individual differences in self-regulation, with a strong attentional basis. Moreover, during early childhood EC has a central role on children’s socio-emotional adjustment and academic achievement. The aim of the current study was to predict the development of EC at 36 months of age from early attentional and environmental measures taken in infancy using a machine learning approach. A sample of 75 infants participated in a longitudinal study running different waves of data collection at 6, 9 and 36 months of age. Attentional tasks were administered at 6 months of age and two additional measures were collected at 9 months of age. Parents reported household environment variables during wave 1, and their child’s EC at 36 months. A machine -learning algorithm was implemented to identify children with low EC scores at 36 months of age. An “attention only” model showed greater predictive sensitivity than the “environmental only” model. However, a model including both attentional and environmental variables was able to classify the groups (Low-EC vs Average-to-High EC) with 100% accuracy. Sensitivity analyses indicate that socio-economic variables together with attention control processes at 6-months, and self-restraint capacity at 9-months, are the most important predictors of EC. Results suggest a foundational role of executive attention processes in the development of EC in complex interaction with household environment and provide a new tool to identify early markers of socio-emotional regulation development.

Leader-follower autonomy (LFA) systems have so far only focused on vehicles following other vehicles. Though there have been several decades of research into this topic, there has not yet been any work on human-vehicle leader-follower systems. We present a system in which an autonomous vehicle — our ACTor 1 platform — can follow a human leader who controls the vehicle through gestures. We successfully developed a modular pipeline that uses artificial intelligence/deep learning to recognize hand-and-body gestures from a user in view of the vehicle’s camera and translate those gestures into physical action by the vehicle. We demonstrate our work using our ACTor 1 platform, a modified Polaris Gem 2 electric vehicle. This work has numerous applications, such as material transport in industrial contexts.

Individual investors often struggle to predict stock prices due to the limitations imposed by the computational capacities of personal laptop Graphics Processing Units (GPUs) when running intensive deep learning models. This study proposes solving these GPU constraints by integrating deep learning models with technical analysis methods. This integration significantly reduces analysis time and equips individual investors with the ability to identify stocks that may yield potential gains or losses in an efficient manner. Thus, a comprehensive buy and sell algorithm, compatible with average laptop GPU performance, is introduced in the study. This algorithm offers a lightweight analysis method that emphasizes factors identified by technical analysis methods, thereby providing a more accessible and efficient approach for individual investors. To evaluate the efficacy of this approach, we analyzed the performance of eight deep learning models: LSTM (4 layers), CNN, BiLSTM (4 layers), CNN Attention, BiGRU CNN BiLSTM Attention, BiLSTM Attention CNN, CNN BiLSTM Attention, and CNN Attention BiLSTM. These models were used to predict stock prices for Samsung Electronics and Celltrion Healthcare. The CNN Attention BiLSTM model displayed superior performance among these models, with the lowest validation mean absolute error value. In addition, an experiment was conducted using WandB Sweep to determine the optimal hyperparameters for four individual hybrid models. These optimal parameters were then implemented in each model to validate their back-testing rate of return. The CNN Attention BiLSTM hybrid model emerged as the highest-performing model, achieving an approximate rate of return of 5 percent. Overall, this study offers valuable insights into the performance of various deep learning and hybrid models in predicting stock prices. These findings can assist individual investors in selecting appropriate models that align with their investment strategies, thereby increasing their likelihood of success in the stock market.

With the development of electricity spot markets, accurate electricity load forecasting enables power generation companies to supply the right amount of electricity, Significantly avoid power waste. As a result, time series forecasting in the field of power can bring significant benefits. Previously, the Informer model successfully introduced the Transformer into long time series forecasting(LTSF) by proposing the ProbSparse self-attention mechanism, which solved the inherent problem of high memory complexity in self-attention. Recent research has further demonstrated the potential of the self-attention for mining complex dependencies. However, the limited amount of historical data has become one of the main challenges in applying deep learning techniques to power LSTF tasks. Previous reserches often add a large number of time covariates to provide more information. In this paper, to address this issue, (i) we design a simple but effective Season-aware Block to enhance the model’s ability to mine artificial prior information in temporal covariates; (ii) we conduct experiments using the provincial power data of Zhejiang Province, China, from 2019 to 2022, and our model outperforms other models, achieving a 19 percent MSE relative improvement; (iii) we conduct ablation experiments to assess the efficacy of the Season-aware Block in extracting temporal periodic features. Furthermore, we elucidate the underlying reasons for the effectiveness of both the self-attention mechanism and the Season-aware Block through visualization experiments.

Consciousness is usually perceived as a state of being aware of one’s environment as well as self. Despite its omnipresence in our life, understanding this concept is challenging. This has given rise to several theories attempting to explain the nature of consciousness, as well as hard and soft problems of consciousness. In fact, the boundaries of consciousness defined by these theories are a topic of continued discussion, particularly in light of the recent advances in artificial intelligence (AI). Some of these theories consider consciousness as a simple integration of information while others purport the need for an agency in the process of integration for an entity to be considered conscious. Some theories consider consciousness as a graded entity and some equate consciousness with content of awareness. In this work, major theories of consciousness are reviewed and compared, focusing on awareness, attention, and sense of self. These findings are interpreted in relation to AI in order to ascertain what makes AI distinct from natural intelligence.

Consciousness is usually interpreted as a state of being aware of one’s environment as well as self, while awareness is understood as knowledge of something. Despite their semantic differences, in philosophy, these terms are often used interchangeably, as is the case of the hard problem of consciousness proposed by Chalmers, which in fact is the hard problem of awareness. Trilogy paradigm of consciousness (or simply “trilogy”) offers a new paradigm where consciousness is the result of a unique interaction between awareness and the decision-making process. By conferring the input of awareness to the decision-making process, a new mental function of awareness-based choice selection (ABCS) or true free will emerges. Likewise, application of the power of decision-making to the process of awareness gives rise to discretionary selection of information for awareness (DSIA) or intentional attention. The intertwined actions of ABCS and DSIA comprise “I” which is the faculty of our consciousness and is what sets natural intelligence (NI) apart from artificial intelligence (AI). Based on trilogy, mind is an unconscious compilation of all mental function excluding ABCS and DSIA that are the essence of consciousness. As humans, we are a union of “I,” our minds, and our bodies.

The technical capabilities of modern Industry 4.0 and Industry 5.0 are rather vast and growing exponentially daily. The present-day Industrial Internet of Things (IIoT) combines manifold underlying technologies that require real-time interconnections and communications among heterogeneous devices. Smart cities are established with sophisticated designs and control for seamless Machine-to-Machine (M2M) communication to optimize resources, costs, performances, and energy distribution. All the sensory devices within a building interact to maintain a sustainable climate for residents and intuitively optimize the energy distribution to optimize energy production. However, it encompasses quite a few challenges for devices that lack compatible and interoperable designs. Conventional solutions are restricted to limited domains or rely on engineers to design and deploy translators for each pair of ontologies. This is a costly process in terms of engineering efforts and computational resources. The issue persists that a new device with a different ontology must be integrated into an existing IoT network. We propose a self-learning model that can determine the taxonomy of devices given their ontology meta-data and structural information. The model finds matches between two distinct ontologies using the Natural Language Processing (NLP) approach for learning linguistic contexts. Then, by visualizing the ontology network as a knowledge graph, it is possible to learn the structure of the meta-data and understand the device's message formulation. Finally, it can align entities of both ontology graphs similar in context and structure. Furthermore, the model performs dynamic M2M translation without requiring extra engineering or hardware efforts.

To realize the diagnosis of compound faults in gearboxes at different speeds, an "end-to-end" intelligent diagnosis method based on a deep neural network is proposed, named efficiency channel attention-capsule network (ECA-CN). First, the process uses a deep convolutional neural network to extract fault features from the collected raw vibration signals, then embeds the efficient channel attention module to filter important fault features, then uses the capsule network to vectorize the feature space information, and finally calculates the correlation between different levels of capsules by the dynamic routing algorithm to achieve accurate gearbox compound fault diagnosis. The effectiveness of the proposed ECA-CN fault diagnosis method was verified by the composite fault dataset of the 2009 PHM Challenge gearbox, with an average accuracy of 99.63% and a standard deviation of 0.22%. In the comparison experiments with the traditional fault diagnosis method, the average accuracy of the ECA-CN method was improved by 4.62%, and the standard deviation was reduced by 0.58%. The experimental results show that ECA-CN has a more competitive diagnostic performance.

The Transformer architecture, while adept at capturing context through self-attention, falls short in encapsulating complex syntactic structures effectively. Addressing this gap, we introduce the Linguistic Structure through Graphical Interpretation with BERT (LSGIB) approach in Machine Translation (MT) frameworks. Combining the strengths of Graph Attention Network (GAT) and BERT, LSGIB intricately captures syntactic dependencies as explicit knowledge from the source language. This enhances the source language representation and aids in more accurate target language generation. Our empirical analysis leverages gold-standard syntax-annotated sentences and employs a Quality Estimation (QE) model. This approach enables us to assess translation improvements in terms of syntactic accuracy, extending beyond traditional BLEU score metrics. The LSGIB model demonstrates superior translation quality across diverse MT tasks, maintaining robust BLEU scores. Our study delves into the optimal sentence lengths benefiting from LSGIB and identifies which syntactic dependencies are more precisely captured. We observe that GAT's ability to learn specific dependency relations directly influences the translation quality of sentences with those relations. Additionally, we discover that incorporating syntactic structure into BERT's intermediate and lower layers offers a novel approach to modeling linguistic structure in source sentences.

Considering the significant advancements in autonomous vehicle technology, research in this field is of interest to researchers. To drive vehicles autonomously, controlling steer angle, gas hatch, and brakes need to be learned. The behavioral cloning method is used to imitate humans’ driving behavior. We created a dataset of driving in different routes and conditions and using the designed model, the output used for controlling the vehicle is obtained. In this paper, the Learning of Self-driving Vehicles Based on Real Driving Behavior Using Deep Neural Network Techniques (LSV-DNN) is proposed. We designed a convolutional network which uses the real driving data obtained through the vehicle’s camera and computer. The response of the driver is during driving is recorded in different situations and by converting the real driver’s driving video to images and transferring the data to an excel file, obstacle detection is carried out with the best accuracy and speed using the Yolo algorithm version 3. This way, the network learns the response of the driver to obstacles in different locations and the network is trained with the Yolo algorithm version 3 and the output of obstacle detection. Then, it outputs the steer angle and amount of brake, gas, and vehicle acceleration. The LSV-DNN is evaluated here via extensive simulations carried out in Python and TensorFlow environment. We evaluated the network error using the loss function. By comparing other methods which were conducted on the simulator’s data, we obtained good performance results for the designed network on the data from KITTI benchmark, the data collected using a private vehicle, and the data we collected.

Anomaly detection and segmentation aim at distinguishing abnormal images from normal images and further localizing the anomalous regions. Feature reconstruction based method has become one of the mainstream methods for this task. This kind of method has two assumptions: (1) The features extracted by neural network is a good representation of the image. (2) The autoencoder solely trained on the features of normal images cannot reconstruct the features of anomalous regions well. But these two assumptions are hard to meet. In this paper, we propose a new anomaly segmentation method based on feature reconstruction. Our approach mainly consists of two parts: (1) We use a pretrained vision transformer (ViT) to extract the features of the input image. (2) We design a self-attention autoencoder to reconstruct the features. We regard that the self-attention operation which has a global receptive field is beneficial to the methods based on feature reconstruction both in feature extraction and reconstruction. The experiments show that our method outperforms the state-of-the-art approaches for anomaly segmentation on the MVTec dataset. It is both effective and time-efficient.

Sarcasm is a linguistic expression often used to communicate the opposite of what is said, usually something that is very unpleasant with an intention to insult or ridicule. Inherent ambiguity in sarcastic expressions, make sarcasm detection very difficult. In this work, we focus on detecting sarcasm in textual conversations from various social networking platforms and online media. To this end, we develop an interpretable deep learning model using multi-head self-attention and gated recurrent units. Multi-head self-attention module aids in identifying crucial sarcastic cue-words from the input, and the recurrent units learn long-range dependencies between these cue-words to better classify the input text. We show the effectiveness of our approach by achieving state-of-the-art results on multiple datasets from social networking platforms and online media. Models trained using our proposed approach are easily interpretable and enable identifying sarcastic cues in the input text which contribute to the final classification score. We visualize the learned attention weights on few sample input texts to showcase the effectiveness and interpretability of our model.

Wireless Sensor Networks (WSNs) are gaining traction in the realm of network communication, renowned for their adaptability, configuration, and flexibility. The forthcoming network traffic within WSNs can be forecasted through temporal sequence models. In this correspondence, We present a method (TSENet) that can accurately predict the traffic in the cellular network. TSENet is composed of transformers and self-attention network. We have designed a temporal transformer module specifically for extracting temporal features. This module accomplishes this by modeling the traffic flow within each grid of the communication network at both near-term and periodical intervals. Simultaneously, we amalgamate the spacial features of each grid with information from its correlated grids, generating spacial predictions within the spacial transformer. Furthermore, we employ self-attention aggregation to capture dependencies between external factor features and celluar data features. Empirical assessments performed on a genuine cellular traffic dataset offer compelling evidence substantiating the efficacy of TSENet.

The notion of free will seems so intuitive to us that it would be hard, even impossible, to imagine that we live in a world without ever exerting any willpower. This view of reality is not only hindrance to inspiration, it poses a serious threat to our moral and social responsibilities. Nonetheless, many scientific and philosophical schools of thought such as determinism purport free will as a mere illusion. As an attempt to rescue free will put forward by libertarianism, compatibilism or physical indeterminism that either exempts our mind from the universal rules of cause and effect by offering our minds a metaphysical status or substitute free will with random will rooted in the laws of quantum mechanics. This manuscript offers an alternative perspective under a new paradigm of consciousness called physical libertarianism that explicates true free will through the unwavering laws of cause and effect. Based on this paradigm, consciousness is the result of interaction of awareness and decision-making process. By applying awareness to the process of decision-making awareness-based choice selection or true free will is conceived. In return, by assigning the power of decision making to the process of awareness discretionary selection of information for attention or intentional attention is emerged. Through integration of these two mental functions, an independent entity called “I” is formed that differentiates natural intelligence from artificial intelligence. While determinism can aptly describe the world of inanimate objects and artificial intelligence, because of “I,” determinism has no jurisdiction over the realm of natural intelligence.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

To ensure the security of highly sensitive remote sensing images (RSI) during their transmission, it is essential to implement effective content security protection methods. Generally, secure distribution schemes for remote sensing images often employ cryptographic techniques. However, sending encrypted data exposes communication behavior, which poses significant security risks to the distribution of remote sensing images. Therefore, this paper introduces deep information hiding to achieve secure distribution of remote sensing images, which can serve as an effective alternative in certain specific scenarios. Specifically, the Deep Information Hiding for RSI Distribution (hereinafter referred to as DIH4RSID) based on encoder-decoder network architecture with Parallel Attention Mechanisms (PAM) by adversarial training was proposed. Our model is constructed with four main components: a preprocessing network (PN), an embedding network (EN), a revealing network (RN) and a discriminating network (DN). The PN module is primarily based on Inception to capture more details of RSI and targets of different scales. The PAM module obtains features in two spatial directions to realize feature enhancement and context information integration. The experimental results indicate that our proposed algorithm achieves relatively higher visual quality and secure level compared to related methods. Additionally, after extracting the concealed content from hidden images, the average classification accuracy is unaffected.

Machinery degradation assessment can offer meaningful prognosis and health management in-formation. Although numerous machine prediction models based on artificial intelligence have emerged in recent years, they still face a series of challenges: (1) Many models continue to rely on manual feature extraction. (2) Deep learning models still struggle with long sequence prediction tasks. (3) Health indicators are inefficient for remaining useful life (RUL) prediction with cross-operational environments when dealing with high-dimensional datasets as inputs. This research proposes a health indicator construction methodology based on a transformer self-attention transfer network (TSTN). This methodology can directly deal with the high-dimensional raw dataset and keep all the information without missing when the signals are taken as the input of the diagnosis and prognosis model. First, we design an encoder with a long-term and short-term self-attention mechanism to capture crucial time-varying information from a high-dimensional dataset. Second, we propose an estimator that can map the embedding from the encoder output to the estimated degradation trends. Then, we present a domain dis-criminator to extract invariant features from different machine operating conditions. The case studies with the FEMTO-ST bearing dataset and the Monte Carlo method for RUL prediction during the degradation process are conducted. The experiment results fully exhibited the signif-icant advantages of the proposed method compared to other state-of-the-art techniques.

This paper addresses the development of knowledge and assessment-centered learning approaches within a reflective learning framework in a first year physics class in a university faculty. The quality of students’ reflections was scored using a Self-reporting Reflective Learning Appraisal Questionnaire at the end of each learning approach. The results showed the differences between the approaches based on reflections on the learning control through self-knowledge, by connecting experience and knowledge, as well as through self-reflection and self-regulation. Assessment-centered activities fundamentally help students identify aspects of their attitudes towards, as well as regulate, their sustainability learning education.

With the increased emphasis on competition in academic settings, anxiety is becoming more common, which inevitably has some impact on students’ learning process and result. This study aimed to explore how competition-induced anxiety influences the subjective cognitive load (SCL), attention level and test score. Meanwhile, we investigated the mediating role of the behavioral inhibition system/behavioral activation system (BIS/BAS) in those processes. A total of 101 college students were recruited in Study 1 to learn five micro-lectures from massive open online courses (MOOC) under with and without competitive conditions. The results showed that participants’ state anxiety (SA) scores were higher after the experiment, participants in the competition condition had higher test scores, and the relationship between SA/ trait anxiety (TA) and SCL could be mediated by the BIS. To obtain more objective data on learning processes (attention levels), we conducted Study 2, which collected behavioral and EEG data from 42 college students during the online learning. The results showed that the competition group had higher SA, lower attention levels, and worse test scores, and the relationship between SA/TA and attention levels could be mediated through the BIS. The present study not only expands previous research by finding that BIS functioning plays an important role in the effects of anxiety on cognitive load and attention, but also offers implications for using competitive strategies to motivate students according to their aptitude.

This paper develops a multi-task learning framework that attempts to incorporate the image structure knowledge to assist image inpainting, which is not well explored in previous works. The primary idea is to train a shared generator to simultaneously complete the corrupted image and corresponding structures --- edge and gradient, thus implicitly encouraging the generator to exploit relevant structure knowledge while inpainting. In the meantime, we also introduce a structure embedding scheme to explicitly embed the learned structure features into the inpainting process, thus to provide possible preconditions for image completion. Specifically, a novel pyramid structure loss is proposed to supervise structure learning and embedding. Moreover, an attention mechanism is developed to further exploit the recurrent structures and patterns in the image to refine the generated structures and contents. Through multi-task learning, structure embedding besides with attention, our framework takes advantage of the structure knowledge and outperforms several state-of-the-art methods on benchmark datasets quantitatively and qualitatively.

In this essay, I revisit Neural Networks (NNs) through the lens of evolutionary dynamics. From the two most important features of NNs, I recover the two most general equations of evolutionary dynamics. These two equations may thus serve as a connection between NNs and a body of knowledge that has been built over multiple centuries and has found application across a vast range of disciplines. This connection may therefore also help explain why NNs with the two features in question are applicable across a much broader range of domains than initially envisioned.

Skin cancer is a global health concern with increasing prevalence, necessitating effective early detection and classification systems. Transfer learning has emerged as a powerful tool in this domain, enhancing diagnostic accuracy. Attention mechanisms, which selectively focus on pertinent image features, play a pivotal role in transfer learning. While previous studies have highlighted their effectiveness, their applicability across different models and datasets remains understudied. This empirical study explores the impact of various attention mechanisms on the performance of transfer learning models for skin cancer detection and classification. Using five transfer learning models (DenseNet121, InceptionV3, MobileNet, VGG16, and Xception) and six attention mechanisms (Channel Attention, Global Context Attention, Guided Attention, Nonlocal Attention, Positional Attention, and Spatial Attention), we conducted 105 experiments across three datasets. Traditional metrics (accuracy, precision, recall, and f1-score) were employed for empirical validation. The results reveal a nuanced relationship between attention mechanisms, transfer learning models, and datasets. Overall, attention mechanisms exhibit the potential to enhance skin cancer classification. Spatial and channel attention mechanisms consistently outperform others, offering simplicity and effectiveness. Model-specific selection of attention mechanisms is crucial, with a trade-off between model complexity and performance evident. This study provides insights into developing efficient skin cancer classification models utilizing attention mechanisms.

In the present, the growth of digitization and worldwide communications make OCR systems of exotic languages a very important task. In this paper, we attempt to develop an OCR system for one of these exotic languages with a unique script, Amharic. Motivated by the recent success of the Attention mechanism in Neural Machine Translation (NMT), we extend the attention mechanism for Amharic text-image recognition. The proposed model consists of CNNs and attention embedded recurrent encoder-decoder networks that are integrated following the configuration of the seq2seq framework. The attention network parameters are trained in an end-to-end fashion and the context vector is injected, with the previously predicted output, at each time steps of decoding. Unlike the existing OCR model that minimizes the CTC objective function, the new model minimizes the categorical cross-entropy loss. The performance of the proposed attention-based model is evaluated against the test dataset from the ADOCR database which consists of both printed and synthetically generated Amharic text-line images and achieved promising results with a CER of 1.54% and 1.17% respectively.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

Most natural language processing (NLP) tasks operate an input sentence as a sequence with token-level embeddings and features, despite its clausal structures. Taking Abstract Meaning Representation (AMR) parsing as an example, recent parsers are empowered by Transformers and pre-trained language models, but long-distance dependencies (LDDs) introduced by long sequences are still open problems. We argue that LDDs are not superficially blamed on the sequence length but are essentially related to the internal clause hierarchy. Typically, non-verb words in a clause cannot depend on words outside, and verbs from different but related clauses have much longer dependencies than those in the same clause. With this intuition, we introduce a type of clausal feature, hierarchical clause annotation (HCA), into AMR parsing and propose two HCA-based approaches, HCA-based self-attention (HCA-SA) and HCA-based curriculum learning (HCA-CL), to integrate HCA trees of complex sentences for addressing LDDs. We conduct extensive experiments on two in-distribution (ID) AMR datasets (AMR 2.0 and AMR 3.0) and three out-of-distribution (OOD) ones (TLP, New3, and Bio). Experimental results show that our HCA-based approaches achieve significant and explainable improvements against the baseline model and outperform the state-of-the-art (SOTA) model when encountering sentences with complex clausal structures that introduce most LDD cases.

To efficiently use its finite resources, the visual system selects for further processing only a subset of the rich sensory information. Visual masking and spatial attention control the information transfer from visual sensory-memory to visual short-term memory. There is still a debate whether these two processes operate independently or interact, with empirical evidence supporting both arguments. However, recent studies pointed out that earlier studies showing significant interactions between common-onset masking and attention suffered from ceiling and/or floor effects. Our review of previous studies reporting metacontrast-attention interactions revealed similar artifacts. Therefore, we investigated metacontrast-attention interactions by using an experimental paradigm in which ceiling/floor effects were avoided. We also examined whether metacontrast masking is differently influenced by endogenous and exogenous attention. We analyzed mean absolute-magnitude of response-errors and their statistical distribution. Our results support the hypothesis that metacontrast and endogenous/exogenous attention are largely independent with negligible likelihood for interactions. Moreover, statistical modeling of the distribution of response-errors suggests weak interactions modulating the probability of “guessing” behavior for some observers in both types of attention. Nevertheless, our data suggest that any joint effect of attention and metacontrast can be adequately explained by their independent and additive contributions.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

The adapted Posner spatial cue-target paradigm was used to explore the relationship between exogenous temporal attention caused by rhythm and endogenous and exogenous spatial attention. The study was divided into two experiments. In Experiment 1, 33 participants used arrow cues to orient endogenous spatial attention and rhythm to orient exogenous temporal attention. In Experiment 2, with 29 participants, exogenous spatial attention was directed by highlighting the cue box. Exogenous temporal attention was directed by rhythm. Experiment 1 indicated that RTs were faster for attended targets than the unattended. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. RTs were faster for late compared to synchrony. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was not significant. Experiment 2 demonstrated that exogenous spatial attention only exhibited IOR under early four stimulus repetitions. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was significant. The results indicated that rhythmic temporal attention supported foreperiod effects. Exogenous temporal attention and endogenous spatial attention independently affect behavior, while exogenous temporal attention and exogenous spatial attention mutually influenced behavior.

Underwater robotics equipped with visual detection systems have the function of detecting un-derwater artifacts, which is of great significance to deep-sea archaeology. Underwater artifacts are located in complex environments with poor imaging conditions, and the targets have chal-lenging problems such as breakage, stacking, and sediment burial, which causes the marine cul-tural target detection failures. To solve these problems, this paper proposes an underwater cul-tural target detection algorithm based on the deformable deep aggregation network model for underwater robotics exploration. To fully extract the target feature information of underwater targets in complex environments, this paper designs a multi-scale deep aggregation network with deformable convolutional layers. Besides, the BAM attention module is designed for fea-ture optimization, which enhances the potential feature information of the target while weak-ening the background interference information. Finally, the target prediction is achieved through feature fusion at different scales. The proposed algorithm has been extensively validat-ed and analyzed on the collected underwater artifact datasets, and the precision, recall, and mAP of the algorithm have reached 93.1%, 91.4%, and 92.8%, respectively. In addition, the present al-gorithm has been practically deployed on the underwater robotics. In the deep-sea tests, the ar-tifact detection frame rate reaches up to 19 fps, which satisfies the real-time target detection。

AVs suffer reduced maneuverability and performance due to the degradation in sensor performances in fog. Such degradation causes significant object detection errors essential for AVs' safety-critical conditions. For instance, YOLOv5 performs significantly well under favorable weather but suffers miss detections and false positives due to atmospheric scattering caused by fog particles. Existing deep object detection techniques often exhibit a high degree of accuracy. The drawback is being sluggish at object detection in fog. Object detection methods with fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persist. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar's object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image on the camera image. Using the attention mechanism, we emphasized and improved important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our result shows that the proposed method significantly enhances the detection of distant and small objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed with an accuracy of 0.849 at 69 fps.

The contemporary landscape of education is witnessing a paradigm shift towards innovative instructional methods, with the flipped learning approach gaining considerable attention. The purpose of this research was to investigate the impact of the flipped learning approach on students' perception and acceptance throughout an entire semester in the 'Introduction to Programming with Java' course, using a research design with a quantitative approach, ultimately aiming to inform educational practice and advance our knowledge of innovative teaching methods in higher education. This study was conducted at a university with 174 students involved, divided into two groups, 87 students in the experimental group and 87 students in the control group. The data collected through the scales were analyzed by using descriptive and inferential statistical analysis techniques in statistical software. At the end of the measurements, the technology acceptance level and self-directed learning perceptions of engineering students who received education with flipped learning were high. The results suggest that educators should consider students' readiness for self-directed learning when implementing the flipped learning approach and focus on creating an environment that supports their autonomy and engagement. This research offers valuable guidance for instructors, curriculum designers, and educational policymakers seeking to enhance the effectiveness of flipped learning in higher education courses.

In order to improve real-time performance of gesture recognition by micro-Doppler map of mmWave Radar, the point cloud based gesture recognition for mmWave Radar is proposed in this paper.Two steps are carried out for mmWave Radar based gesture recognition. The first step is to estimate the point cloud of the gestures by 3D-FFT and the peak grouping. The second step is to train the TRANS-CNN model by combining the multi-head self-attention and the 1D-convolutional network, so as to extract the features in the point cloud data at a deeper level to categorize the gestures. In the experiments, TI mmWave Radar sensor IWR1642 is used as benchmark to evaluate the feasibility of the proposed approach. The results show that the accuracy of the gesture recognition reaches 98.5%. In order to prove the effectiveness of our approach, a simply 2Tx2Rx Radar sensor is developed in our lab and the accuracy of recognition reaches 97.1%. The results show that our proposed gesture recognition approach achieves the best performance in real-time with limited training data, in comparison with the existing methods.

(1) Background: Mindfulness-based interventions (MBIs) have shown interesting preliminary ef-fects over self-regulation processes in early adolescence. However, interventions usually integrate various types of practices with no clarity about the specific effect of each of them over attentional, emotional, and behavioral regulation. The objective of this research was to evaluate the effect of two MBIs, one focused on classic attentional practices and another one focused on the recognition and expression of emotions, over attentional, emotional, and behavioral self-regulation in early adolescents. (2) Method: An experimental method was carried out. A sample of 70 children be-tween 8 and 12 years old were randomized and assigned to three experimental conditions: 1) MBI with a focus on attentional practices, 2) MBI with a focus on recognition and expression of emotions, 3) control group, waiting list. The programs lasted 8 weeks, with a weekly 1-hour online synchronic session, plus home practices. Children were evaluated before starting the in-tervention and at the end of the 8-week program. The assessed variables were: 1) Mindfulness; 2) Emotional Regulation; 3) Attentional Regulation and 4) Behavioral regulation. (3) Results: Chil-dren that participated in both programs, increased their mindfulness and emotional and be-havioral regulation scores. Only children who participated in the program with a focus on at-tention showed significant changes in their ability to self-regulate attention. (4) Conclusions: online MBIs, with attention to external and internal stimuli practices, can be a good strategy to strengthen self-regulation skills of attention, emotions, and behavior in early adolescence.

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important for accurately identifying breast cancer from unregistered multi-view mammograms. This motivates us to leverage the architecture of Vision Transformers to capture long-range relationships of multiple mammograms from the same patient. For this purpose, we employ local Transformer blocks to separately learn patch relationships within a specific view (CC/MLO) of one side (right/left) of mammogram. The outputs from different views and sides are concatenated and fed into global Transformer blocks, to jointly learn patch relationships between two different views of the left and right breasts. To evaluate the proposed model, we retrospectively assembled a dataset involving 949 sets of CC and MLO view mammograms, which include 470 malignant cases and 479 normal or benign cases. We trained and evaluated the model using a five-fold cross-validation method. Without any arduous preprocessing steps (e.g., optimal window cropping, chest wall or pectoral muscle removal, two-view image registration, etc.), our two-view Transformer-based model achieves lesion classification accuracy of 77.0% and area under ROC curve (AUC = 0.814), outperforming state-of-the-art multi-view CNNs by 3.1% and 3%, respectively. Meanwhile, the new two-view model improves mammographic case classification accuracies of two single-view models by 7.4% (CC) and 4.5% (MLO), respectively. The promising results unveil the great potential of using Transformers to develop high-performing computer-aided diagnosis (CADx) schemes of mammography.

In today’s fast paced, attention-demanding society, executive functions and attentional resources are often taxed. Individuals need ways to sustain and restore these resources. We first review the concepts of attention and restoration, as instantiated in Attention Restoration Theory (ART). ART emphasizes the role of nature in restoring attention. We then discuss essentials of experiments on the causal influences of nature. Next, we expand the concept of ART to include modern, designed environments. We propose a wider perspective termed attentional ecology, in which attention behavior is viewed within a larger system involving the human and their interactions over time with environmental demands. When the ecology is optimal, mental functioning can be a positive “flow” that is productive, sustainable for the individual, and sometimes creative.

In the study, it was aimed to develop a valid and reliable scale in order to determine the self-efficacy perceptions of classroom teachers in the field of mathematics learning difficulties. In the development process of the scale, the basic resources and the scale development studies in the literature were examined. First, a pool of substances was created. Content validity was ensured by taking the opinions of 21 expert participants in the 24 question areas determined in the item pool. Content validity index was used in content validity. In this analysis, two questions were removed from the scale. Preliminary application was made with 44 participating teachers who are experts in their fields and exploratory factor analysis was started. For exploratory factor analysis, 359 people consisting of classroom teachers in Sakarya province were studied. In the explanatory factor analysis, 5 items were removed from the scale by looking at the factor load. The factor loadings for the 17 items in the scale vary between 0.508 and 0.976. Among the comparative fit indices obtained as a result of confirmatory factor analysis, RMSEA=0.067 and Cmin/DF=1.568 were calculated. The Cronbach alpha reliability coefficient of the measurements is 0.970. The data obtained were analyzed with statistical methods using SPSS 25, AMOS 24 and Microsoft Excel programs. The validity and reliability criteria of the scale developed within the scope of the study were met.

Learning dental procedures is a complex task involving the development of fine motor skills. The reported use of theories and/ or evidence for designing learning activities to develop the fine motor skills needed for dental practice is limited. The aim of this review is to explore the available body of knowledge related to learning fine motor skills in dentistry. Evidence from studies investigating motor skill learning highlights the negative impact of self-focus and self-regulation on learning outcomes, particularly during the early stages of learning. The development of activities and schedules that enable novices to demonstrate characteristics similar to experts, without the reported long period of ‘deliberate practice’, is clearly of value. Outcomes of learning implicitly are important in dentistry because working under stressful conditions is common, either during undergraduate study or in practice. It is suggested that learning implicitly in the simulation stage can reduce disrupted performance when transitioning to clinical settings. Therefore, further investigation of effective methods for learning dental fine motor skills is indicated, using approaches that result in robust performance, even under stressful conditions.

Human pose estimation is a complex detection task in which the network needs to capture the rich information contained in the images. In this paper, we propose MSTPose (Multi-Scale Transformer for human Pose estimation). Specifically, MSTPose leverages a high-resolution Convolution neural network (CNN) to extract texture information from images. For the feature maps from three different scales produced by the backbone network, each branch performs the coordinate attention operations. The feature maps are then spatially and channel-wise flattened, combined with keypoint tokens generated through random initialization, and fed into a parallel Transformer structure to learn spatial dependencies between features. As the Transformer outputs one-dimensional sequential features, the mainstream two-dimensional heatmap method is abandoned in favor of one-dimensional coordinate vector regression. The experiments show that MSTPose outperforms other CNN-based pose estimation models and demonstrates clear advantages over CNN + Transformer networks of similar types.

One of the most rapidly advancing areas of deep learning research aims at creating models that learn to disentangle the latent factors of variation from a data distribution. However, modeling joint probability mass functions is usually prohibitive, which motivates the use of conditional models assuming that some information is given as input. In the domain of numerical cognition, deep learning architectures have successfully demonstrated that approximate numerosity representations can emerge in multi-layer networks that build latent representations of a set of images with a varying number of items. However, existing models have focused on tasks requiring to conditionally estimate numerosity information from a given image. Here we focus on a set of much more challenging tasks, which require to conditionally generate synthetic images containing a given number of items. We show that attention-based architectures operating at the pixel level can learn to produce well-formed images approximately containing a specific number of items, even when the target numerosity was not present in the training distribution.

Drugs-drugs interactions(DDI) are entities composed of different chemical substructures (functional groups). In existing methods that predict drug–drug interactions based on the usage of substructures, each node is considered the center of a substructure, and adjacent nodes eventually become centers of similar substructures, resulting in redundancy. Furthermore, the significant differ- ences in structure and properties among compounds can lead to unrelated pairings, making it difficult to integrate information. This heterogeneity negatively affects the prediction results. To address these issues, we propose a drug–drug interaction prediction method based on substructure signature learning (DDI-SSL). This method extracts useful information from local subgraphs surrounding drugs and effectively utilizes substructures to assist in predicting drug side effects. Additionally, a deep clustering algorithm is used to aggregate similar substructures, allowing any individual subgraph to be reconstructed using this set of global signatures. Furthermore, we developed a layer-independent collaborative attention mechanism to model the mutual influence between drugs, generating signal strength scores for each class of drugs to mitigate noise caused by heterogeneity. Finally, we evaluated DDI-SSL on a comprehensive dataset and demonstrated improved performance in DDI prediction compared to state-of-the-art methods.

The question of molecular similarity is core in cheminformatics, and is usually assessed via a pairwise comparison based on vectors of properties or molecular fingerprints. We recently exploited variational autoencoders to embed 6M molecules in a chemical space, such that their (Euclidean) distance within the latent space so formed could be assessed within the framework of the entire molecular set. However, the standard objective function used did not seek to manipulate the latent space so as to cluster the molecules based on any perceived similarity. Using a set of some 160,000 molecules of biological relevance, we here bring together three modern elements of deep learning to create a novel and disentangled latent space, viz transformers, contrastive learning, and an embedded autoencoder. The effective dimensionality of the latent space was varied such that clear separation of individual types of molecules could be observed within individual dimensions of the latent space. The capacity of the network was such that many dimensions were not populated at all. As before, we assessed the utility of the representation by comparing clozapine with its near neighbours, and did the same for various antibiotics related to flucloxacillin. Transformers, especially when as here coupled with contrastive learning, effectively provide one-shot learning, and lead to a successful and disentangled representation of molecular latent spaces that at once uses the entire training set in their construction while allowing ‘similar’ molecules to cluster together in an effective and interpretable way.

The purpose of this study is to analyze the self-regulated learning and the ability to write scientific papers of students after learning with the Project-Based Digital Science Module (DSM). This research is a mixed methods by analyzing quantitatively and qualitatively. The research instrument used to obtain data is using a product assessment sheet and a self-regulated learning questionnaire. Data analysis uses N-Gain to determine the increase in self-regulated learning scores and student scientific writing skills scores, and uses linear regression analysis to determine the effect of self-regulated learning on student scientific writing skills. The results obtained showed N-Gain score of learning independent is 0,65 and scientific writing ability is 0,94, then significant’s score from linear regression by using SPSS is 0,22 < 0,05. This result showed an increase in self-regulated learning and the ability to write scientific papers of students on each indicator after learning using the Project-Based Digital Science Module (DSM). In addition, based on the results of data analysis, it can be seen that there is an influence of self-regulated learning on the ability to write scientific papers of students after learning using the Project-Based Digital Science Module.

If a subject learns about the properties of an alternative under a high state of food deprivation, it will prefer this alternative over a similar one in a later choice test, although the subject is currently under a relative state of satiety. In this experiment, we probe this effect in a delay-discounting task, where the reward of the experienced alternative is progressively delayed. Eight male Wistar rats were trained to respond to an alternative under a high state of deprivation and eight rats under a relative state of satiety. After 20 sessions, their weight was recalibrated to a state of relative satiety. Then, they were exposed to a delay-discounting task where the long-larger alternative was the one used during training. The group that experienced the alternative under a higher level of food deprivation preferred more this alternative, and its preference stayed across time. On the contrary, the group that experienced the alternative under a lower level of food deprivation systematically preferred the small-shorter alternative. Our results support that the reinforcement value may be sensitive to the organism's state at the moment an alternative is experienced for the first time.

Diagnosis and treatment of Attention-Deficit/Hyperactivity Disorder (ADHD) in women remain insufficient. Fluctuations of reproductive hormones during the premenstrual period, postpartum period and (peri)menopause are neglected, even though they impact ADHD symptoms and as-sociated mood disorders [1]. Therefore, we created a female-specific treatment group for women with ADHD and premenstrual worsening of ADHD and/or mood symptoms. We describe the group programme and underlying rationale, offering a qualitative analysis of the participants’ evaluation. The 7 two-weekly sessions foreground the menstrual cycle and address several ADHD-specific topics in relation to this cyclical pattern: emotional regulation; impulsivity; setting boundaries, and triggers. Concurrently, women track their menstrual cycle and (fluctuating) ADHD and mood symptoms with an adjusted premenstrual calendar. In total, 18 women (25-47yrs) participated in three consecutive groups. We analysed the evaluation of the last group. Participants experienced the group as a safe and welcoming space. Recognition was valued by all. The topics discussed were deemed valuable and the structure suited them well. Completing the premenstrual calendar augmented awareness and recognition of individual cyclical symptoms. Discussing ADHD throughout the lifespan increased self-understanding. Participants took their menstrual cycle more seriously, prioritising self-acceptance and self-care in the luteal phase of the cycle. Exploring a cyclical approach in a group setting seems to be a positive addition to treatment for female ADHD.

Research on image-inpainting tasks has mainly focused on enhancing performance by augmenting various stages and modules. However, this trend does not consider the increase in the number of model parameters and operational memory, which increases the burden on computational resources. To solve this problem, we propose a Parametric Efficient Image InPainting Network (PEIPNet) for efficient and effective image-inpainting. Unlike other state-of-the-art methods, the proposed model has a one-stage inpainting framework in which depthwise and pointwise convolutions are adopted to reduce the number of parameters and computational costs. To generate semantically appealing results, we selected three unique components: spatially-adaptive denormalization (SPADE), dense dilated convolution module (DDCM), and efficient self-attention (ESA). The SPADE was adopted to conditionally normalize activations according to the mask to distinguish between damaged and undamaged regions. The DDCM was employed at every scale to overcome the gradient-vanishing obstacle and gradually fill-in pixels by capturing global information along the feature maps. The ESA was utilized to obtain clues from unmasked areas by extracting long-range information. In terms of efficiency, our model has the lowest operational memory compared with other state-of-the-art methods. Both qualitative and quantitative experiments demonstrate the generalized inpainting of our method on three public datasets: Paris StreetView, CelebA, and Places2.

Automatic ship detection provides an essential function towards maritime domain awareness for security or economic monitoring purposes. This work presents an approach for training a deep learning ship detector in Sentinel-2 multispectral images with few labeled examples. We design a network architecture for detecting ships with a backbone that can be pre-trained separately. By using Self Supervised Learning, an emerging unsupervised training procedure, we learn good features on Sentinel-2 images, without requiring labeling, to initialize our network’s backbone. The full network is then fine-tuned to learn to detect ships in challenging settings. We evaluated this approach versus pre-training on ImageNet and versus a classical image processing pipeline. We examined the impact of variations in the self-supervised learning step and we show that in the few-shot learning setting self-supervised pre-training achieves better results than ImageNet pre-training. When enough training data is available, our self-supervised approach is as good as ImageNet pre-training. We conclude that a better design of the self-supervised task and bigger non-annotated dataset sizes can lead to surpassing ImageNet pre-training performance without any annotation costs.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

Attention deficit hyperactivity disorder (ADHD) results in various functioning impairments in children’s lives and families. Parents of children with ADHD report high levels of parenting stress, low levels of parental self-efficacy and use of more authoritarian and/or permissive parenting practices than parents of typically developing children. Intervention programs need to address both children’s and parents’ needs and multimodal intervention programs could cover this demand. The aim of this study was to examine the efficacy of “Child ViReal Support Program” - a multi-level evidence-based comprehensive program - on parenting stress, parental self-efficacy, parenting practices, and the core symptoms of children’s ADHD. Families with a child diagnosed with ADHD (n = 16) were randomly allocated to two groups (PC and CP; P = parent training, C = child training) and a cross-over design was utilized. Participating parents completed, in four different times during the study, the Parenting Stress Index-Short Form, the Parenting Sense of Competence Scale, the Parenting Styles and Dimensions Questionnaire-Short Version and the parent form of the ADHD Rating Scale-IV. Parents from both groups, after their participation in the parent training, demonstrated reduced parenting stress, enhanced parental self-efficacy and increased the employ of democratic parenting practices. More than that, they reported decreased levels of inattention and impulsivity/hyperactivity for their children. Evidence-based multi-level intervention programs could produce positive effects in parents and children by incorporating effective methods and tools in accordance with the needs and the demands of the family context.

Citizen science substantially contributes to large-scale biodiversity monitoring and the enhancement of public literacy. While both of the contributions largely depend on the public’s self- regulated learning. In this study, we employed a mix- method approach, incorporating both a questionnaire survey of 133 participants and interviews with 12 volunteers, aiming to explore the feature of self- regulated learning in citizen science, as well as identify the main factors impacting it. The volunteers are all different ages, from different jobs, with varying educational backgrounds. The findings revealed that the educational background of volunteers did not significantly impact their self-regulated learning. However, an increased frequency of participation was linked to higher levels of self-regulated learning. Furthermore, achievement goal orientation mediates the prediction of self-regulation by scientific epistemology. These insights underscore the importance of enhancing citizen science's impact on scientific literacy by fostering self-regulated learning among participants. This can be achieved through explicit instruction in scientific epistemology and by fostering a sense of achievement to boost achievement goal orientations. Additionally, our study advocates for the promotion of social interaction between students and out- of- school citizen scientists in school-based citizen science projects. The main innovation of this study is to consider volunteers as learners, not merely as contributors of data.

Transition from primary to secondary school is more successful when students’ learning is consistent. Students are also more likely to enjoy the school, engage with learning, and have a high academic achievement in the secondary school when they feel motivated. This is a critical aspect especially in cases when global pandemics situations allow only the online schooling opportunity. Students that are away from school lack the traditional sources of motivation and self-regulated learning skills, thus research is needed to identify other important factors that can be developed in remote settings. The aim of this study was to find out how students perceive their experience with the transition from primary to secondary school and how such a transition influences students’ self-regulated learning (SRL) and motivation. Self-reported data were collected during the COVID-19 breakout from a total of N=80, 6th and 7th grade students aged 12-14 years old. Results showed that students had a successful transition, especially when they are supported by their parents and teachers. Next, Bivariate Pearson Correlation analysis indicated that students’ perceptions about their experience with the transition from primary to secondary school and their self-regulated learning and motivation are significantly correlated. No gender differences were found among all main study variables.

Machine learning has become an increasingly ubiquitous technology, as big data continues to inform and influence everyday life and decision-making. Currently in healthcare, as well as in most other industries, the two most prevalent machine learning paradigms are supervised learning and transfer learning. Both practices rely on large-scale, manually annotated datasets to train increasingly complex models. However, the requirement of data to be manually labeled leaves an excess of unused, unlabeled data available in both public and private data repositories. Self-supervised learning (SSL) is a growing area of machine learning that has the ability to take advantage of unlabeled data. Contrary to other machine learning paradigms, SSL algorithms create artificial supervisory signals from unlabeled data and pretrain algorithms on these signals. The aim of this review is two-fold: firstly, we provide a formal definition of SSL, divide SSL algorithms into their four unique subsets, and review the state-of-the-art published in each of those subsets between the years of 2014-2020. Second, this work surveys recent SSL algorithms published in healthcare, in order to provide medical experts with a clearer picture of how they can integrate SSL into their research, with the objective of leveraging unlabeled data.

Transformer models have emerged as frontrunners in the field of natural language processing, primarily due to their adept use of self-attention mechanisms to grasp the semantic linkages between words in sequences. Despite their strengths, these models often face challenges in single-task learning scenarios, particularly when it comes to delivering top-notch performance and crafting strong latent feature representations. This challenge is more pronounced in the context of smaller datasets and is particularly acute for under-resourced languages such as Arabic. In light of these challenges, this study introduces a novel methodology for text classification of Arabic texts. This method harnesses the newly developed Reverse Positional Encoding (RPE) technique. It adopts inductive-transfer learning (ITL) framework combined with a switching self-attention shared encoder, thereby increasing the model's adaptability and improving its sentence representation accuracy. The integration of Mixture of Experts (MoE) and Reverse Positional Encoding (RPE) techniques empowers the model to process longer sequences more effectively. This enhancement is notably beneficial for Arabic text classification, adeptly supporting both the intricate five-point and the simpler ternary classification tasks. The empirical evidence points to its outstanding performance, achieving accuracy rates of 87.20% for the HARD dataset, 72.17% for the BRAD dataset, and 86.89% for the LABR dataset, as evidenced by the assessments conducted on these datasets.

Alcohol use disorder (AUD) is a chronic and relapsing biopsychosocial condition that leads to a wide range of medical, psychological, social, economic, and personal issues. The study investigated the predictors of quality of life (QoL) among male patients seeking treatment for AUD based on attention, cognitive instability, motor impulsiveness, perseverance, and self-control dimensions of trait impulsivity. The study also investigated the potential mediating effect of anxiety and alcohol use severity in this relationship. After an initial assessment, participants underwent comprehensive evaluations, including sociodemographic data, clinical history, and QoL domains. Evaluations also covered AUD severity, impulsivity dimensions, cognitive functions, craving intensity, depression, anxiety and self-efficacy. Multiple linear regressions were employed to identify associations between independent variables and QoL. Attention dimension of impulsivity and anxiety symptoms significantly predicted physical health QoL. Self-control dimension and severity of alcohol use disorder predicted psychological QoL. Indirect effect of attention dimension on physical health was significant [effect =-1.082,95% CI (-2.008, -0.3598)].The significance of impulsivity in influencing QoL for individuals with AUD has profound clinical implications. These findings underscore the importance of addressing anxiety and impulsivity in managing AUD, given their considerable impact, particularly on QoL, ultimately shaping treatment outcomes.

The purpose of this study was to detect mind-wandering experienced by pre-service teachers while learning video lecture on physics. The lecture was videotaped and consisted of a live lecture in a classroom. The lecture was about Gauss's law on physics. We investigated whether oculomotor data and eye movements could be used as a marker to indicate the learner’s mind-wandering. Each data was collected in a study in which 24 pre-service teachers (16 females and 8 males) reported self-caught mind-wandering while learning physics video lecture during30 minutes. A Tobii Pro Spectrum (sampling rate: 300Hz) was used to capture their eye-gaze during learning Gauss's law course video. After watching video lecture, we interviewed pre-service teachers about their mind-wandering experience. We first used the self-caught method to capture the mind-wandering timing of pre-service teachers while learning from video lectures. We detected more accurate mind-wandering segments by comparing fixation duration and saccade count. We investigated two types of oculomotor data (blink count, pupil size) and nine eye movements (average peak velocity of saccades; maximum peak velocity of saccades; standard deviation of peak velocity of saccades; average amplitude of saccades; maximum amplitude of saccades; total amplitude of saccades; saccade count/s; fixation duration; fixation dispersion). The result was that the blink count could not be used as a marker for mind-wandering during learning video lectures among them (oculomotor data and eye movements), unlike previous literatures. Based on the results of this study, we identified elements that can be used as mind-wandering markers while learning from video lectures that are similar to real classes, among the oculomotor data and eye movement mentioned in previous literatures. Also, we found that most participants focused on past thoughts and felt unpleasant after experiencing mind-wandering through interview analysis.

The Speer allergic tension-fatigue syndrome (SATFS) is a classic syndrome characterized by allergy-like symptoms, muscle tension, headache, chronic fatigue, and a particular behavior. The particular behavior displayed includes symptoms such as hyperkinesis, hyperesthesia (i.e., insomnia), restlessness, and distractibility, among others. Interestingly, these symptoms are very similar to recent descriptions of attention deficit hyperactivity disorder (ADHD), the most prevalent neurodevelopmental disorder worldwide, which is characterized by inattention, hyperactivity and impulsivity. Although the exact cause of ADHD remains unknown, it has been proposed that deficiency of the enzyme diamine oxidase (DAO), which metabolizes histamine, may be involved in the development of ADHD. Our conceptual paper suggests that DAO enzyme deficiency may be involved in the development and severity of ADHD. Histamine, which is metabolized by DAO, plays an important role in the regulation of attention, memory and cognition. Therefore, decreased DAO activity could lead to an accumulation of histamine, which could contribute to ADHD symptoms. This study provides a theoretical framework for the relationship between DAO deficiency and ADHD, which could have important implications for the diagnosis and treatment of the disorder. Further empirical studies are needed to confirm our hypothesis and explore the clinical implications of the relationship between DAO deficiency, histamine, and ADHD.

In this unprecedented era of computer-supported and distance learning, it is critical to rethink the way students are supported through vital skills like self-regulation and peer collaboration. A variety of digital media has emerged, allowing learners autonomy while requiring the ability to effectively regulate different components of the educational process for long-term academic success. We reviewed collaboration, communication, and self-regulation in digital learning environments as part of online learning. We discussed how these abilities are reflected in highly cited content. High-impact factor studies were identified using advanced software Herzing Publish or Perish to retrieve highly cited research publications metrics. The search resulted in 272 records from 2010 to 2022, 192 duplicates were identified to remove and 48 JCR articles were shortlisted for review. We examined and reflected on sufficient connections to make firm judgments about correlations of concepts. The review identified prominent themes surfaced in the high impact factor academic publication e.g., digital learning environment, interaction, engagement, feedback, self-efficacy, motivation, meta-cognition, achievement, technology, blended learning, and orientation of ICT. Many studies support different features of SRL &amp; PCL through different tools, access to educators or feedback, encouragement, and through peers. However, all of them discuss the processes that students use to self-regulate learning in these situations. It is suggested to examine whether the effectiveness of certain SRL processes varies by online learning mode.

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher accuracy than a strong baseline trained on 8 times more data. Our method leverages knowledge contained in pre-trained speech representations extracted from models trained on a more general self-supervised task which doesn’t require human annotations, such as the wav2vec model. We provide detailed insights on the benefits of our approach by varying the training data size, which can help labeling teams to work more efficiently. We compare performance with other popular methods on the IEMOCAP dataset, a well-benchmarked dataset among the Speech Emotion Recognition (SER) research community. Furthermore, we demonstrate that results can be greatly improved by combining acoustic and linguistic knowledge from transfer learning. We align acoustic pre-trained representations with semantic representations from the BERT model through an attention-based recurrent neural network. Performance improves significantly when combining both modalities and scales with the amount of data. When trained on the full IEMOCAP dataset, we reach a new state-of-the-art of 73.9% unweighted accuracy (UA).

To reveal the influence of variables such as entrepreneurial learning, entrepreneurial inspiration, and incubation resources on students' entrepreneurial intentions in vocational colleges, this study took vocational colleges in Zhejiang Province, a province with a strong entrepreneurial climate in China, as an example. The study used a questionnaire to obtain data, and 614 valid questionnaires were collected from seven vocational colleges. The study divided entrepreneurship education into three dimensions: entrepreneurial learning, entrepreneurial inspiration, and incubation resources, and used structural equation modeling to investigate the influence of entrepreneurship education on entrepreneurial intentions while introducing entrepreneurial efficacy as a mediating variable to examine the influence mechanism of entrepreneurship education on entrepreneurial intentions of higher education students. The results showed that entrepreneurial learning, entrepreneurial inspiration, incubation resources, and entrepreneurial efficacy were all significantly and positively correlated with entrepreneurial intentions and that entrepreneurial efficacy mediated between the two dimensions of entrepreneurship education (entrepreneurial learning and entrepreneurial inspiration) and entrepreneurial intentions. Therefore, to enhance the effectiveness of entrepreneurship education in vocational institutions, we should stimulate students' sense of entrepreneurial efficacy, strengthen their entrepreneurial learning and inspire them to start their businesses. In turn, university incubation resources can be developed and utilized to enhance students' entrepreneurial confidence and intentions.

In this paper, we present the idea of Self Supervised learning on the Shape Completion and Classification of point clouds. Most 3D shape completion pipelines utilize autoencoders to extract features from point clouds used in downstream tasks such as Classification, Segmentation, Detection, and other related applications. Our idea is to add Contrastive Learning into Auto-Encoders to learn both global and local feature representations of point clouds. We use a combination of Triplet Loss and Chamfer distance to learn global and local feature representations. To evaluate the performance of embeddings for Classification, we utilize the PointNet classifier. We also extend the number of classes to evaluate our model from 4 to 10 to show the generalization ability of learned features. Based on our results, embedding generated from the Contrastive autoencoder enhances Shape Completion and Classification performance from 84.2% to 84.9% of point clouds achieving the state-of-the-art results with 10 classes.

The betel nut chewing habit of taxi drivers has shown that can promote companionship, relaxation, and emotional stability at work. 19.3% of betel nut behaviors are instigated by an invitation among drivers to engage in the habit. The objective of this study was to explore the impact of social learning, subjective norm, and self-efficacy on betel nut chewing in taxi drivers in Taiwan. We conducted a cross-sectional study on taxis’ driver of betel nut behaviour and measured their evaluations of its consequences using a self-report questionnaire. Other variables include socio-demographic characteristics and chewing-related experience. The overall variance is 44.5% in socio-demographic variable, social learning, self-efficacy, and subjective norm. Results show that the variables of affected betel nut chewing behavior, driving years has the strongest influence, followed by learning about betel nut from the media, relatives, and friends, and education level, which positively affect betel nut chewing behavior. Findings indicated that education related to quitting betel nut chewing, significant others, and rules of the taxi fleet are adopted to design a plan for quitting betel chewing to reduce the positive expectations of taxi drivers for betel nut chewing and decrease their betel nut chewing behavior.

Spatial attentional biases can be observed during the processing of linguistic material. For example, we previously reported that healthy subjects overestimate the semantic distance between word stimuli in the right vs left space. Here we explored whether attentional biases are also observed in tasks requiring evaluation of phonological distance between words in the right and left hemispace. Forty-one healthy subjects were presented with triplets of words arranged in space and were asked to indicate the side of space in which the phonological distance between the middle word and an outer word was smaller. In Experiment 1 real words and pseudowords were used, while in Experiment 2 only pseudowords and consonant strings were used. Subjects overestimated the phonological distance between the middle and outer words in the right space. These findings were specific to word stimuli. These results are consistent with the idea that semantic and phonological information may be internally mapped onto spatial representations.

Few-shot classification is challenging since the goal is to classify unlabeled samples with very few labeled samples provided. It has been shown that cross attention helps generate more discriminative features for few-shot learning. This paper extends the idea and proposes two cross attention modules, namely the cross scaled attention (CSA) and the cross aligned attention (CAA). Specifically, CSA scales different feature maps to make them better matched, and CAA adopts the principal component analysis to further align features from different images. Experiments showed that both CSA and CAA achieve consistent improvements over state-of-the-art methods on four widely used few-shot classification benchmark datasets, miniImageNet, tieredImageNet, CIFAR-FS, and CUB-200-2011, while CSA is slightly faster and CAA achieves higher accuracies.

In the remote sensing domain, it is crucial to complete semantic segmentation on the raster images, e.g., river, building, forest, etc, on raster images. A deep convolutional encoder--decoder (DCED) network is the state-of-the-art semantic segmentation method for remotely sensed images. However, the accuracy is still limited, since the network is not designed for remotely sensed images and the training data in this domain is deficient. In this paper, we aim to propose a novel CNN for semantic segmentation particularly for remote sensing corpora with three main contributions. First, we propose applying a recent CNN called a global convolutional network (GCN), since it can capture different resolutions by extracting multi-scale features from different stages of the network. Additionally, we further enhance the network by improving its backbone using larger numbers of layers, which is suitable for medium resolution remotely sensed images. Second, "channel attention'' is presented in our network in order to select the most discriminative filters (features). Third, "domain-specific transfer learning'' is introduced to alleviate the scarcity issue by utilizing other remotely sensed corpora with different resolutions as pre-trained data. The experiment was then conducted on two given datasets: (i) medium resolution data collected from Landsat-8 satellite and (ii) very high resolution data called the ISPRS Vaihingen Challenge Dataset. The results show that our networks outperformed DCED in terms of $F1$ for 17.48% and 2.49% on medium and very high resolution corpora, respectively.

Targets detection in synthetic aperture radar (SAR) remote sensing images, which is a fundamental but challenging problem in the field of satellite image analysis, plays an important role for a wide range of applications and is receiving significant attention in recent years. Besides, the ability of human visual system to detect visual saliency is extraordinarily fast and reliable. However, computational modeling of SAR image scene still remains a challenge. This paper analyzes the defects and shortcomings of traditional visual models applied to SAR images. Then a visual attention model designed for SAR images is proposed. The model draws the basic framework of classical ITTI model; selects and extracts the texture features and other features that can describe the SAR image better. We proposes a new algorithm for computing the local texture saliency of the input image, then the model constructs the corresponding saliency maps of features; Next, a new mechanism of feature fusion is adopted to replace the linear additive mechanism of classical models to obtain the overall saliency map; Finally, the gray-scale characteristics of focus of attention (FOA) in saliency map of all features are taken into account, our model choose the best saliency representation, Through the multi-scale competition strategy, the filter and threshold segmentation of the saliency maps can be used to select the salient regions accurately, thereby completing this operation for the visual saliency detection in SAR images. In the paper, several types of satellite image data, such as TerraSAR-X (TS-X), Radarsat-2, are used to evaluate the performance of visual models. The results show that our model provides superior performance compared with classical visual models. By further contrasting with the classical visual models, Our model reduce the false alarm caused by speckle noise, and its detection speed is greatly improved, and it is increased by 25% to 45%.

The research proposes a self-directed paradigm with self-design using the existing technology with LMS modules, discussions, and self-tests. The research establishes its criteria for assurance of teaching and learning known as 7x2C for the compliance of content, and appearance along with other criteria for the analysis. The above technology of web and LMS is tested for a business course that is technology-oriented in creating an experiential learning system for Covid-19 awareness. Similarly, among other ideas, an environment for educating learners about diabetes and obesity has been designed. The project is known as Sunchoke with its theme of Grow, Eat, and Heal. The educators can use their technology and apply self-directed pedagogy to transform this approach to their customized ways by using their content and rubrics.

Refugee subject position is an evolving topic of contention in the world today with increased migrant and refugee mobilities. Urban refugee spaces are often segregated in the form of colonies, ethnic villages, even ghettos, embodying institutionalised discourses of apathy and violence. These spaces only occupy the cracks and margins of the normative, formal city, as appropriations of inhospitable natural terrains and urban systems. The paper discusses how refugees compete for resources for survival as “bio-political” subjects and are often held summarily responsible for causing ecological stress in host environments. After the 1947 Partition of the Indian subcontinent, millions of Hindu Bengali refugees from East Pakistan flooded the Eastern Indian states of West Bengal, Assam and Tripura. Kolkata particularly drew millions for better livelihood prospects. Facing government apathy and local violence, East-Bengali refugees appropriated the urban fringes of Kolkata and claimed their right to urban space through the political act of squatting or Jabar-Dakhal. The intent of this paper is to investigate and map the spatial distribution of East-Bengali refugee squatters and elaborate on how they transformed the terrain and distributed resources through self-management tactics. This spatial history case-study attempts to uncover locational data from archival government records, existing academic literature and fieldwork to visualise where the 145 pre-1950 and the 123 post-1950 Jabar-Dakhal colonies were located in the Kolkata Metropolitan Area. This case of successful refugee self-settlement is qualitatively read in relation to the major areas of ecological stress in Kolkata. One of the UN sustainable development goals is to make cities and human settlements ‘inclusive, safe, resilient and sustainable’. This paper hopes to encourage further studies of urban refugee self-settlement and local integration as a viable but complex socio-political-environmental process.

This manuscript explores unmanned aerial vehicle DC motor control performance efficacy of deterministic artificial intelligence in comparison to model-following adaptation, particularly a direct self-tuner with filtering. The deterministic artificial intelligence model made use of self-awareness statements to overcome error in response to permutations of the multi-duty cycle square wave that served as the system input. It can be seen that (despite equivalently powerful estimation techniques) deterministic artificial intelligence provided far superior results: a reduction in peak initial transient error of 55%, and a mean error reduction over 81% with over 65% reduction in error standard deviation compared to a state-of-the-art nonlinear adaptive control method. Deterministic artificial intelligence also was able to very closely track at the switching of the input control, while the benchmark nonlinear adaptive control failed to respond as quickly at these points.

Generalized zero-shot learning (GZSL) aims to simultaneously recognize both seen classes and unseen classes by training only on seen class samples and auxiliary semantic descriptions. Recent state-of-the-art methods infer unseen classes based on semantic information or synthesize unseen classes using generative models based on semantic information, all of which rely on the correct alignment of visual-semantic features. However, they often overlook the inconsistency between original visual features and semantic attributes. Additionally, due to the existence of cross-modal dataset biases, the visual features extracted and synthesized by the model may also mismatch with some semantic features, which could hinder the model from properly aligning visual-semantic features. To address this issue, this paper proposes a GZSL framework that enhances the consistency of visual-semantic features using self-distillation and disentanglement network (SDDN). The aim is to utilize self-distillation and disentanglement network to obtain semantically consistent refined visual features and non-redundant semantic features to enhance the consistency of visual-semantic features. Firstly, SDDN utilizes self-distillation technology to refine the extracted and synthesized visual features of the model. Subsequently, the visual-semantic features are then disentangled and aligned using a disentanglement network to enhance the consistency of the visual-semantic features. Finally, the consistent visual-semantic features are fused to jointly train a GZSL classifier. Extensive experiments demonstrate that the proposed method achieves more competitive results on four challenging benchmark datasets (AWA2, CUB, FLO, and SUN).

In recent years, researchers have paid increasing attention on hyperspectral image (HSI) classification using deep learning methods. To improve the accuracy and reduce the training samples, we propose a double-branch dual-attention mechanism network (DBDA) for HSI classification in this paper. Two branches are designed in DBDA to capture plenty of spectral and spatial features contained in HSI. Furthermore, a channel attention block and a spatial attention block are applied to these two branches respectively, which enables DBDA to refine and optimize the extracted feature maps. A series of experiments on four hyperspectral datasets show that the proposed framework has superior performance to the state-of-the-art algorithm, especially when the training samples are signally lacking.

The aim of article is to design a calm water resistance predictor based on Machine Learning Tools and development of a systematic series for battery-driven catamaran hull forms. Regression Trees (RT), Support Vector Machines (SVM), and Artificial Neural Network (ANN) regression models are applied for dataset training on developed systematic series of catamarans. A hullform optimization was implemented for various catamarans including dimensional and hull coefficient parameters based on resistance and structural weight reduction and battery performance improvement. This paper provides a diverse database of catamaran hullform. Hence, an automated Matlab program was coded for geometry generation and cost function evaluation. Design distribution based on Lackenby transformation fulfills all design space and sequentially a novel self-blending method reconstructs new hullforms based on two parents blending. Finally, a machine learning approach was conducted on generated data of case study. This study shows that ANN algorithm correlates well with the measured resistance. Accordingly, a general and unique tool is proposed for optimized and desired design in first design stage.

Background: Student-specific stress is pervasive and impairs health and attainment. Experimentally induced self-affirmation can reduce stress, but little is known about the mechanisms underlying this effect, and the role of individual differences. The present study explores the relationship between spontaneous self-affirmation, student-specific stress, and overlapping constructs of positive self-regard during the COVID-19 pandemic. Methods: The study investigated inter-relationships between spontaneous self-affirmation, student-specific perceived stress and potential covariates including self-esteem, self-integrity and habitual positive self-thought. University students (N = 151) aged 18 to 50 responded to an online questionnaire including the Spontaneous Self-Affirmation Measure, College Student Stress Scale, Rosenberg Self-Esteem Scale, Habitual Index of Positive Thinking and Self-Integrity Scale. Results: Unexpectedly, regression analysis revealed that spontaneous self-affirmation was a positive predictor of student-specific stress, seemingly driven by relational affirmations. Self-esteem and habitual self-thought were negative predictors of student-specific stress, whilst self-integrity was not a predictor. Conclusions: Habitual positive self-thought may offer a sustainable solution to student-specific stress, but spontaneous self-affirmation does not. A reduction in defensive responses, elicitation of negative emotions, or use of conditional relationships in relational affirmation

With the development of the Internet, The content people share contains types of text, images, and videos, and utilizing these multimodal data for sentiment analysis has become an important area of research. Multimodal sentiment analysis aims to understand and perceive emotions or sentiments in different types of data. Currently, the realm of multimodal sentiment analysis faces various challenges, with a major emphasis on addressing two key issues: 1) Inefficiency when modeling the intra-modality and inter-modality dynamics and 2) Inability to effectively fuse multimodal features. In this paper, we proposed the CCDA(Cross-Correlation in Dual-Attention) model, a novel method to explore dynamics between different modalities and fuse multimodal features efficiently. We capture dynamics at intra- and inter-modal levels by using two types of attention mechanisms simultaneously. Meanwhile, the cross-correlation loss is introduced to capture the correlation between attention mechanisms. Moreover, the relevant coefficient is proposed to integrate multimodal features effectively. Extensive experiments were conducted on three publicly available datasets, CMU-MOSI, CMU-MOSEI, and CH-SIMS. The experimental results fully confirm the effectiveness of our proposed method, and compared with the current optimal method (SOTA), our model shows obvious advantages in most of the key metrics, proving its better performance in multimodal sentiment analysis.

Background: Consciousness is usually interpreted as a state of being aware of one’s environment as well as self. According to the trilogy paradigm of consciousness (or simply “trilogy”), it is primarily guided by two new mental functions—awareness-based choice selection (ABCS) and discretionary selection of information for awareness (DSIA) or intentional attention—which may play a role in the choice selection during decision making. Method: To test whether ABCS and DSIA could improve the choice selection efficiency, 204 subjects were recruited using social media platforms to complete an anonymous online survey. The survey was designed to examine the role of subtle hints and cues in guiding participants’ attention toward a particular subject of awareness and this in return would increase the likelihood of selecting a correct choice among the proposed options, thereby enhancing the decision-making efficacy. Results: The participants’ attention could be successfully swayed to a particular subject matter (DSIA) in 59−73% of occasions. In addition, using ABCS increased the efficiency of selecting a correct choice among presented options. The analyses further revealed a gap between the selecting a choice during decision-making process and its execution, which is indicative of an appropriation process. Conclusion: The present study shows that sheer knowledge of facts may not be sufficient for selecting a correct choice among presented options effectively. However, as ABCS improves the choice selection efficiency, it plays an instrumental role in determining the subject of awareness, indirectly supporting the notion of DSIA.

It has been known for a long time that many people who stutter are immediately fluent in certain conditions, for instance, when they speak in unison with others, in sync with the clicking of a metronome, or when they hear themselves speak in an altered manner. To understand why stuttering is reduced or even eliminated in such conditions is desirable because it may help understand why stuttering occurs in normal speaking conditions. However, empirical findings in this area appear conflicting and confusing, especially with regard to the role of auditory feedback. The article gives an overview of the variety and diversity of fluency-enhancing conditions and of theories proposed to explain their effect. These theories are evaluated in the light of recent empirical findings. A new hypothesis is proposed, based on findings showing that speech processing is limited without attention to the auditory channel. It is assumed that fluency-enhancing conditions draw the speaker’s attention to the auditory channel and, thereby, improve the processing of auditory feedback and its use in speech control. Implications of this account for a causal theory of stuttering and for the treatment of the disorder are discussed.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

Previous evidence in support of a slowly acting (scale of 100s of seconds) and volume-transmitted component of cholinergic signaling was based largely on studies using measures of extracellular brain acetylcholine (ACh) levels which required several minutes to generate a single data point and typically employed AChEsterase inhibitors (AChEIs) to foster the measurement of ACh. Moreover, collecting such data points in correlation with relatively stable behavioral states has supported the view that extracellular ACh levels vary at a relatively slow rate. Here we argue that forebrain cholinergic signaling is exclusively phasic (milliseconds to perhaps seconds), unlikely to be volume-transmitted, and that previous neurochemical evidence and associated behavioral correlates may be re-interpreted in terms of integrated phasic cholinergic activity and specific behavioral and cognitive operations. The highly potent catalytic enzyme for ACh, AChE, limits the presence of an ambient extracellular ACh level and thus renders it unlikely that ACh influences target regions via relatively slow changes in extracellular ACh concentrations. Real-time amperometric recordings of cholinergic signaling have suggested a specific function of rapid, phasic or transient cholinergic signaling in attentional contexts. Optogenetic studies support a causal relationship between these transients on behavior. Combined electrochemical and neurophysiological recordings revealed that the powerful behavioral control by cholinergic transients involves the generation of high-frequency oscillations. Such oscillations are thought to recruit efferent circuitry to (re)activate dormant task sets. Evidence showing the impact of genetic variations of the capacity of cholinergic synapses likewise can be interpreted in terms of their impact on the ability to sustain generation of repeated phasic cholinergic signals, as opposed to effects on ambient ACh levels. Further, while notions of slowly-changing, sleep stage-associated variations in extracellular ACh levels and their functions are widely accepted, the evidence is in fact limited. An alternative hypothesis offers a role for high-frequency cholinergic transient signaling during REM sleep. By employing a theoretical framework that focuses on the phasic and causative characteristics and functions of cholinergic signaling, results from human cognitive neuroscience studies of cholinergic function may be substantially clarified and simplified. Compared to the current treatment of cholinergic deficits using AChEIs, the conceptualization of forebrain cholinergic signaling as wired, phasic, and causative predicts that drugs that either rescue transient presynaptic signaling or amplify or rescue the postsynaptic impact of phasic signals will be more efficacious in treating age- and dementia-related cognitive and cognitive-motor disorders.

Many clinical research datasets have a large percentage of missing values that directly impacts their usefulness in yielding high accuracy classifiers when used for training in supervised machine learning. While missing value imputation methods have been shown to work well with smaller percentages of missing values, their ability to impute sparse clinical research data can be problem specific. We previously attempted to learn quantitative guidelines for ordering cardiac magnetic resonance imaging during the evaluation for pediatric cardiomyopathy, but missing data significantly reduced our usable sample size. In this work, we sought to determine if increasing the usable sample size through imputation would allow us to learn better guidelines. We first review several machine learning methods for estimating missing data. Then, we apply four popular methods (mean imputation, decision tree, k-nearest neighbors, and self-organizing maps) to a clinical research dataset of pediatric patients undergoing evaluation for cardiomyopathy. Using Bayesian Rule Learning (BRL) to learn ruleset models, we compared the performance of imputation-augmented models versus unaugmented models. We found that all four imputation-augmented models performed similarly to unaugmented models. While imputation did not improve performance, it did provide evidence for the robustness of our learned models.

In this paper I tentatively answer 50 questions sampled from a pool of over 10,000 weekly questions formulated by students in a course entitled “The Self”. The questions pertain to various key topics about self-processes, such as self-awareness, self-knowledge, self-regulation, self-talk, self-esteem, and self-regulation. The students’ weekly questions and their answers highlight what is currently know about the self. Answers to the student questions also allow for the identification of some recurrent lessons about the self. Some of these lessons include: all self-processes are interconnected (e.g., prospection depends on autobiography), self-terms must be properly defined (e.g., self-rumination and worry are not the same), inner speech plays an important role in self-processes, controversies are numerous (are animals self-aware?), measurement issues abound (e.g., self-reflection as an operationalization of self-awareness), deficits in some self-processes can have devastating effects (e.g., self-regulatory deficits may lead to financial problems), and there are lots of unknowns about the self (e.g., gender differences in Theory-of-Mind).

Text annotation is an essential element of the natural language processing approaches. The manual annotation process performed by humans has several drawbacks, such as subjectivity, slowness, fatigue, and possibly carelessness. In addition, annotators may annotate ambiguous data. So, we developed the concept of automated annotation to get the best annotations using several machine-learning approaches. The proposed approach is based on an ensemble algorithm of meta-learners and meta-vectorizer techniques. The approach employs a semi-supervised learning technique for automated annotation, aimed at detecting hate speech. This involves leveraging various machine learning algorithms, including Support Vector Machine (SVM), Decision Tree (DT), K-Nearest Neighbors (KNN), and Naive Bayes (NB), in conjunction with Word2Vec and TF-IDF text extraction methods. The annotation process is performed using 13,169 Indonesian YouTube comments data. The proposed model used a Stemming approach using data from Sastrawi and also new data of 2,245 words. Semi-supervised learning uses 5%, 10%, and 20% of labeled data as compared to performing labeling based on 80% of the datasets. In semi-supervised learning, the model learns from the labeled data, which provides explicit information, and the unlabeled data, which offers implicit insights. This hybrid approach enables the model to generalize and make informed predictions even when limited labeled data is available, ultimately enhancing its ability to handle real-world scenarios with scarce annotated information. In addition, the proposed method uses a variety of thresholds for matching words labeled with hate speech ranging from 0.6, 0.7, 0.8, and 0.9. The experiment showed that the KNN-Word2ec model has the best accuracy value of 96.9% with a scenario of 5%:80%:0.9. However, several other methods have also accuracy above 90%, such as SVM and DT based on both text extraction methods in several test scenarios.

Our previous research provides evidence that vergence eye movements may significantly influence cognitive processing and could serve as a reliable measure of cognitive issues. The rise of consumer-grade eye tracking technology, which uses sophisticated imaging techniques in the visible light spectrum to determine gaze position, is noteworthy. In our study, we explored the feasibility of using webcam-based eye tracking to monitor the vergence eye movements of patients with Mild Cognitive Impairment (MCI) during a visual oddball paradigm. We simultaneously recorded eye positions using a remote infrared-based pupil eye tracker. Both tracking methods demonstrated more pronounced cognitive vergence responses for targets as opposed to distractors. In summary, the use of a consumer-grade webcam to record cognitive vergence shows potential. This method could potentially lay the groundwork for future research aimed at creating an affordable screening tool for mental health care.

In recent years, graph neural networks (GNNs) have become a promising method for analyzing data structured in graph format. By considering connections between entities in a graph, GNNs are able to extract valuable insights. One notable variation of GNN is the graph attention network (GAT), which employs the attention mechanism and has demonstrated promising performance in various applications. However, its ability to incorporate feature information from nodes beyond the immediate neighborhood is limited, leading to degraded performance on heterophilic data. To address this limitation, this thesis proposes a novel attention-based model, namely the Directional Graph Attention Network (DGAT). This model combines the feature-based attention with the global directional information extracted from the graph topology, as inspired by the Directional Graph Network (DGN). A new class of Laplacian matrices is proposed and an existing theoretical result on DGN is extended. This extension bridges a gap in the literature. The experimental results presented in the thesis, based on nine real-world benchmarks and ten synthetic data sets, demonstrate the superiority of the proposed DGAT model compared to the GAT baseline model. Particularly on heterophilic data sets, DGAT showed a notable average increase of approximately 35% in node classification tasks across all heterophilic real-world data sets. In addition, DGAT outperforms GAT by an average margin of around 51% in all ten synthetic data sets with various levels of heterophily

Using digital media has become the most popular leisure activity for children and adolescents. The effects of digital media use on the developing brain and cognitive processes of children are subject to debate. Here, we examine the effect of digital media use on attention subdomains in children aged 6 to 10 years. In total, 77 children participated in the study. Selective and divided attention as well as switching between attentional demands were quantified by the SwAD task. Parents were asked to assess the screen time of their children (TV, smartphone, laptop/PC, game console, tablet). Results show no main or interaction effects of screen time on any of the attention conditions investigated. Based on the present findings, as well as previous studies, we suggest a possible non-linear relationship between the amount of screen time and attention function. Furthermore, we emphasize the relevance of considering the socio-economic background of children and a need for longitudinal studies.

In a complex working environment, the fault signal of the gearbox is greatly affected by the outside world, and fault feature recognition is difficult, so the fault diagnosis accuracy is difficult to meet the expected requirements. To solve this problem, this paper proposes a gearbox fault diagnosis method based on an optimized stacked denoising auto encoder (SDAE) and kernel extreme learning machine (KELM). Firstly, the Particle Swarm Optimization algorithm in Adaptive Weight (SAPSO) was adopted to optimize the SDAE network structure, and the number of hidden layer nodes, learning rate, noise addition ratio and iteration times were adaptively obtained to make SDAE obtain the best network structure. Then, the best SDAE network structure was used to extract the deep feature information of weak faults in the original signal. Finally, the extracted fault features are fed into KELM for fault classification. Experimental results show that, compared with existing commonly used methods of fault diagnosis, the fault diagnosis model proposed in this paper can reduce the influence of noise in the original signal can better learn the deep-level features in the original signal and has higher diagnosis accuracy, faster diagnosis speed and good generalization in fault diagnosis.

Understanding surfactant self-assembly in deep eutectic solvents (DES) is important to their potential use in industrial formulations. We have recently reported the formation of a fracto-eutectogel comprising SDS fractal aggregates at a concentration as low as 1.6 wt% in glyceline (a DES comprising glycerol and choline chloride) at room temperature. The building units of the fractals consisted of multilayers of self-assembled SDS lamellae arranged in a dendritic pattern. Here we report that this fractal phase transitions into a fluid phase above a critical gelation temperature, TCG ~ 45 oC, evident from polarized light microscopy (PLM) observations. Small-angle neutron scattering (SANS) reveals that this phase transition is underpinned by the nanoscopic morphological transformation of the SDS lamellae into cylindrical micelles at T &gt; TGC. Fitting SANS profiles confirms that the morphology of the micelles is SDS-concentration (cSDS) dependent at T &gt; TGC: cylindrical at cSDS &gt; 0.6 wt% and spherical at cSDS = 0.6 wt%. At cSDS &lt; 0.6 wt%, only isotropic scattering was observed in the SANS profiles. Such SDS self-assembly behaviors contrast with those we have previously observed in glycerol, which we attribute to the presence of ions (i.e. choline chloride) in glyceline. Our findings have general implications to surfactant self-assembly in DES, solvents that are rich in hydrogen bonding and ions.

Vitrimers are covalent network materials, comparable in structure to classical thermosets. Unlike normal thermosets, they possess a chemical bond swap mechanism that makes their structure dynamic and suitable for activated welding and even autonomous self-healing. The central question in designing such materials is the trade-off between autonomy and material stability: The swap mechanism facilitates the healing but it also facilitates creep, which makes the perfectly stable self-healing solid a hard goal to reach. Here, we address this question for the case of self-healing vitrimers made from star polymers. Using coarse-grained molecular dynamics simulations, we study the adhesion of two vitrimer samples and find that they bond together on timescales that are much shorter than the stress relaxation time. We show that the swap mechanism allows the star polymers to diffuse through the material through coordinated swap events, but the healing process is much faster and does not depend on this mobility.

Self-assembly is a spontaneous process through which macroscopic structures are formed from basic microscopic constituents (e.g. molecules or colloids). By contrast, the formation of large biological molecules inside the cell (such as proteins or nucleic acids) is a process more akin to self-organization than to self-assembly, as it requires a constant supply of external energy. Recent studies have tried to merge self-assembly with self-organization by analyzing the assembly of self-propelled (or active) colloid-like particles whose motion is driven by a permanent source of energy. Here we present evidence that points to the fact that self-propulsion considerably enhances the assembly of polymers: self-propelled molecules are found to assemble into polymer-like structures, the average length of which increases towards a maximum as the self-propulsion force increases. Beyond this maximum, the average polymer length decreases due to the competition between bonding energy and disruptive forces that result from collisions. The assembly of active molecules might have promoted the formation of large pre-biotic polymers that could be the precursors of the informational polymers we observe nowadays.

Abstract: The promotion and development of healthy cities are vital for enhancing human habitats and fostering sustainable economic growth. Based on the core database of Web of Science and the knowledge graph software, this paper makes a quantitative analysis of the literature related to attention recovery abroad. It is found that in recent years, the research on attention recovery has developed rapidly, the number of related literature has been increasing, and the research content presents the characteristics of interdisciplinary integration. By further analyzing the characteristics of research literature, research context, and knowledge basis, this paper summarizes the empirical research based on the existing quantitative analysis, reviews the research field based on the mechanism of attention recovery, and analyzes the development process and trend based on the research basis of attention recovery. Due to the change of modern life style, human health problems are becoming more and more prominent. Attention restoration design provides a new research idea and method to balance the relationship between humans and the urban environment.

In the industrial field, the 3D target detection algorithm PointPillars has gained popularity. Improving target detection accuracy while maintaining high efficiency has been a significant challenge. To address the issue of low target detection accuracy in the PointPillars 3D target detection algorithm, this paper proposes an algorithm based on feature enhancement to improve the backbone network. The algorithm enhances preliminary feature information of the Backbone network by modifying it based on PointPillars with the aid of channel attention and spatial attention mechanisms. To address the inefficiency caused by the excessive number of subsampled parameters in PointPillars, FasterNet (a lightweight and efficient feature extraction network) is utilized for downsampling and forming different scale feature maps. To prevent the loss and blurring of extracted features resulting from the use of inverse convolution, we utilize the lightweight and efficient up-sampling modules Carafe and Dysample for adjusting resolution. Experimental results indicate improved accuracy under all difficulties of the KITTI dataset, demonstrating the superiority of the algorithm over PointPillars.

Calligraphy works have high artistic value, but there is a rampant problem of forgery. Indeed, authentication of traditional calligraphy heavily relies on calligraphers' subjective judgment. Therefore, spurred by the recent development of neural networks, this paper proposes a method for authenticating calligraphy works based on an improved EfficientNet network. Specifically, the developed method utilizes the character box algorithm and the centroid algorithm to extract individual calligraphy characters, which are then augmented and used as the training set for the model. The training process employs CBAM and Self-Attention modules to enhance the attention mechanism of the EfficientNet network. The model is tested on authentic works, imitated works, and works from other calligraphers and is compared with other networks. The experimental results demonstrate that the proposed method effectively achieves the authentication of calligraphy works, and the improved CBAM-EfficientNet network and SA-EfficientNet network achieve better authentication performance.

This review explores the complex interrelationships between emotion, attention, and behavior, drawing upon empirical evidence from psychological, neuroscientific, and clinical studies. It delves into the neural mechanisms that underlie these interactions, with a focus on key brain regions such as the prefrontal cortex and amygdala. Clinical cases involving stroke and attention-deficit/hyperactivity disorder (ADHD) are examined to illustrate the real-world implications of these cognitive interactions. The review also discusses the impact of effective emotion regulation strategies and the role of attention as a cognitive mechanism that influences both emotion and behavior. Neuroimaging studies, particularly functional MRI, are highlighted for their role in providing a deeper understanding of these intricate relationships. The review concludes by emphasizing the importance of this triadic relationship in adaptive functioning and its broader implications for mental health, interpersonal relationships, and quality of life.

The visual span refers to the number of letters readers can identify in a single fixation without using linguistic skills. Proponents of the visual span hypothesis postulate an influence of early visual processing on reading speed. Given the slowness of reading Arabic texts, the present work aims to study the development of the visual span and its effects on reading speed in the Arabic-speaking context. Thirty-four subjects participated in the study. The trigram task and the rapid serial visual presentation (RSVP) paradigm were used to estimate visual span size and reading speed. In line with our initial assumptions, the results showed a significant effect of grade level on reading speed (F(2,31) = 30.93, p<0.001), visual span size (F(2,31) = 20.57, p<0.001). In good alignment with previous work, our results show that visual span size could explain around 40% of the reading speed variability. Interestingly, our analyses revealed a narrowing of visual span size in our Arabic sample. The results of study 2, suggest that the poor performance in the trigram task is due to poor visual attention capacities in our Arabic readers

Abstract: Background: Restless Legs Syndrome /Willis-Ekbom disease (RLS/WED) has occasionally -but not consistently- been associated with cognitive, and most notably, language and executive impairment. The present study was conducted to investigate the cognitive trajectories of older individuals with RLS/WED. Methods: Participants were drawn from the randomly selected, older (>64 years), population-based HELIAD cohort. Individuals without dementia, with available neuropsychological evaluations at baseline and follow-up were considered for potential eligibility. A comprehensive assessment examining five principal components of cognition (memory, visuo-spatial ability, attention, executive function, and language) was administered to the partici-pants. Generalized estimating equations analysis was used to examine the unadjusted and adjusted (for critical factors and covariates) effects of RLS/WED on cognition over time. Results: A total of 1003 predominantly female, older (72.9 ±4.9 years) partici-pants, with follow-up evaluations after a mean of 3.09 ±0.85 years and without demen-tia at baseline and follow-up were included in the present study. Among them, 81 were diagnosed with RLS/WED at baseline. Global cognition, memory, attention, executive and visuo-perceptual skills did not differ between those with and without RLS/WED. However, the RLS/WED group performed worse on language at baseline by 0.249 of a standard deviation, while demonstrating a mitigated language decline over time, by 0.063 of a standard deviation. The unadjusted models yielded similar results. Conclu-sions: Our findings were indicative of a baseline language disadvantage among older individuals with RLS/WED, but the initial discrepancy tends to dissolve over time.