The evolution of sentence representation learning, especially with parse tree encoders, has shown remarkable progress. Traditional approaches predominantly rely on recursive encoding of tree structures, which impedes parallel processing capabilities. Additionally, these methods often overlook the significance of dependency tree arc labels. To overcome these limitations, we introduce the Syntax-Enhanced Transformer (SET), incorporating a novel dual-attention mechanism that integrates relation-focused attention alongside traditional self-attention. This design effectively encodes both dependency and spatial positional relationships within sentence dependency trees. Our approach innovatively incorporates syntactic information into the Transformer framework without compromising its inherent parallelizability. The SET demonstrates superior or comparable performance to contemporary methods across various sentence representation tasks, significantly enhancing computational efficiency.

Recently, a large number of Transformer-based solutions have emerged for the trajectory prediction task, but there are shortcomings in the effectiveness of Transformers in trajectory prediction. Specifically, while position encoding preserves some of the ordering information, the self-attention mechanism at the core of the Transformer has its alignment invariance that leads to the loss of temporal information, which is crucial for trajectory prediction. For this reason, we design a simple and efficient strategy for temporal information extraction and prediction of trajectory sequences using the self-attention mechanism and linear layers. Experimental results show that the strategy we designed can effectively combine the advantages of the linear layer and self-attention mechanisms, compensating for the shortcomings of the Transformer. Additionally, we conducted an empirical study to explore the effectiveness of the linear layer and sparse self-attention mechanisms in trajectory prediction.

With the development of electricity spot markets, accurate electricity load forecasting enables power generation companies to supply the right amount of electricity, Significantly avoid power waste. As a result, time series forecasting in the field of power can bring significant benefits. Previously, the Informer model successfully introduced the Transformer into long time series forecasting(LTSF) by proposing the ProbSparse self-attention mechanism, which solved the inherent problem of high memory complexity in self-attention. Recent research has further demonstrated the potential of the self-attention for mining complex dependencies. However, the limited amount of historical data has become one of the main challenges in applying deep learning techniques to power LSTF tasks. Previous reserches often add a large number of time covariates to provide more information. In this paper, to address this issue, (i) we design a simple but effective Season-aware Block to enhance the model’s ability to mine artificial prior information in temporal covariates; (ii) we conduct experiments using the provincial power data of Zhejiang Province, China, from 2019 to 2022, and our model outperforms other models, achieving a 19 percent MSE relative improvement; (iii) we conduct ablation experiments to assess the efficacy of the Season-aware Block in extracting temporal periodic features. Furthermore, we elucidate the underlying reasons for the effectiveness of both the self-attention mechanism and the Season-aware Block through visualization experiments.

Consciousness is usually perceived as a state of being aware of one’s environment as well as self. Despite its omnipresence in our life, understanding this concept is challenging. This has given rise to several theories attempting to explain the nature of consciousness, as well as hard and soft problems of consciousness. In fact, the boundaries of consciousness defined by these theories are a topic of continued discussion, particularly in light of the recent advances in artificial intelligence (AI). Some of these theories consider consciousness as a simple integration of information while others purport the need for an agency in the process of integration for an entity to be considered conscious. Some theories consider consciousness as a graded entity and some equate consciousness with content of awareness. In this work, major theories of consciousness are reviewed and compared, focusing on awareness, attention, and sense of self. These findings are interpreted in relation to AI in order to ascertain what makes AI distinct from natural intelligence.

Consciousness is usually interpreted as a state of being aware of one’s environment as well as self, while awareness is understood as knowledge of something. Despite their semantic differences, in philosophy, these terms are often used interchangeably, as is the case of the hard problem of consciousness proposed by Chalmers, which in fact is the hard problem of awareness. Trilogy paradigm of consciousness (or simply “trilogy”) offers a new paradigm where consciousness is the result of a unique interaction between awareness and the decision-making process. By conferring the input of awareness to the decision-making process, a new mental function of awareness-based choice selection (ABCS) or true free will emerges. Likewise, application of the power of decision-making to the process of awareness gives rise to discretionary selection of information for awareness (DSIA) or intentional attention. The intertwined actions of ABCS and DSIA comprise “I” which is the faculty of our consciousness and is what sets natural intelligence (NI) apart from artificial intelligence (AI). Based on trilogy, mind is an unconscious compilation of all mental function excluding ABCS and DSIA that are the essence of consciousness. As humans, we are a union of “I,” our minds, and our bodies.

Anomaly detection and segmentation aim at distinguishing abnormal images from normal images and further localizing the anomalous regions. Feature reconstruction based method has become one of the mainstream methods for this task. This kind of method has two assumptions: (1) The features extracted by neural network is a good representation of the image. (2) The autoencoder solely trained on the features of normal images cannot reconstruct the features of anomalous regions well. But these two assumptions are hard to meet. In this paper, we propose a new anomaly segmentation method based on feature reconstruction. Our approach mainly consists of two parts: (1) We use a pretrained vision transformer (ViT) to extract the features of the input image. (2) We design a self-attention autoencoder to reconstruct the features. We regard that the self-attention operation which has a global receptive field is beneficial to the methods based on feature reconstruction both in feature extraction and reconstruction. The experiments show that our method outperforms the state-of-the-art approaches for anomaly segmentation on the MVTec dataset. It is both effective and time-efficient.

Sarcasm is a linguistic expression often used to communicate the opposite of what is said, usually something that is very unpleasant with an intention to insult or ridicule. Inherent ambiguity in sarcastic expressions, make sarcasm detection very difficult. In this work, we focus on detecting sarcasm in textual conversations from various social networking platforms and online media. To this end, we develop an interpretable deep learning model using multi-head self-attention and gated recurrent units. Multi-head self-attention module aids in identifying crucial sarcastic cue-words from the input, and the recurrent units learn long-range dependencies between these cue-words to better classify the input text. We show the effectiveness of our approach by achieving state-of-the-art results on multiple datasets from social networking platforms and online media. Models trained using our proposed approach are easily interpretable and enable identifying sarcastic cues in the input text which contribute to the final classification score. We visualize the learned attention weights on few sample input texts to showcase the effectiveness and interpretability of our model.

The aim of the present study was to predict the response of non-small cell lung cancer (NSCLC) patients to immune checkpoint inhibitors (ICIs) by leveraging computed tomography (CT) images using deep learning techniques. Retrospectively, 624 sequential CT images were gathered from 156 patients at Jiangsu Province Hospital, along with their clinical data. The dataset was subsequently partitioned into three groups: training (n=547), validation (n=64), and test (n=64). Moreover, an external validation cohort included 37 CT images from patients at Nanjing Pukou Peoples' Hospital, accompanied by comprehensive clinical data. An advanced Video Vision Transformer (ViViT) model incorporating global self-attention was utilized to analyse patients treated with ICIs and predict their response. The ViViT model's efficacy was evaluated using a confusion matrix and a receiver operating characteristic curve (ROC). Notably, the ViViT model demonstrated predictive prowess for ICIs response, yielding respective areas under the receiver operating characteristic curve (AUC) of 0.74 (95% CI: 0.69-0.78), 0.74 (95% CI: 0.61-0.86), 0.76 (95% CI: 0.62-0.88), and 0.69 (95% CI: 0.5-0.87) in the training, validation, test, and external validation cohorts. The present study illustrates how a deep learning model can provide a non-invasive means to predict clinical outcomes in NSCLC patients undergoing ICIs, potentially transforming personalized treatment approaches for individuals with NSCLC.

Background. The role of exercise programs during Substance Use Disorder (SUD) treatment is considered particularly supportive in fostering positive psychological and behavioral changes. The aim of this feasibility study was to explore the acute effects of cycling exercise in an immersive virtual reality (IVR) environment on attentional control and self-efficacy expectations of indi-viduals undergoing SUD treatment. Methods. A total of 20 individuals (mean age of 37.75 years) enrolled in a SUD treatment program participated in the study. They were instructed to complete a single session of cycling with a self-selected duration within the IVR system. Results. Following the cycling session, pre-post measures indicated a statistically significant im-provement in self-efficacy expectations and attentional control measured with the Stroop test. The results revealed that participants expressed high levels of intention for future use, inter-est/enjoyment, and positive attitudes toward the IVR exercise system. Qualitative data indicated that participants found the IVR exercise system enjoyable, expressed a strong intention to use it, and did not encounter technical difficulties or negative emotions. Conclusions: In conclusion, it seems that engaging in a brief period of self-selected exercise within a virtual environment can result in temporary activation of cognitive changes, heightened self-efficacy expectations, and a motivating approach to increasing physical activity participation among individuals with SUD, thus suggesting the feasibility of this approach.

Wireless Sensor Networks (WSNs) are gaining traction in the realm of network communication, renowned for their adaptability, configuration, and flexibility. The forthcoming network traffic within WSNs can be forecasted through temporal sequence models. In this correspondence, We present a method (TSENet) that can accurately predict the traffic in the cellular network. TSENet is composed of transformers and self-attention network. We have designed a temporal transformer module specifically for extracting temporal features. This module accomplishes this by modeling the traffic flow within each grid of the communication network at both near-term and periodical intervals. Simultaneously, we amalgamate the spacial features of each grid with information from its correlated grids, generating spacial predictions within the spacial transformer. Furthermore, we employ self-attention aggregation to capture dependencies between external factor features and celluar data features. Empirical assessments performed on a genuine cellular traffic dataset offer compelling evidence substantiating the efficacy of TSENet.

The notion of free will seems so intuitive to us that it would be hard, even impossible, to imagine that we live in a world without ever exerting any willpower. This view of reality is not only hindrance to inspiration, it poses a serious threat to our moral and social responsibilities. Nonetheless, many scientific and philosophical schools of thought such as determinism purport free will as a mere illusion. As an attempt to rescue free will put forward by libertarianism, compatibilism or physical indeterminism that either exempts our mind from the universal rules of cause and effect by offering our minds a metaphysical status or substitute free will with random will rooted in the laws of quantum mechanics. This manuscript offers an alternative perspective under a new paradigm of consciousness called physical libertarianism that explicates true free will through the unwavering laws of cause and effect. Based on this paradigm, consciousness is the result of interaction of awareness and decision-making process. By applying awareness to the process of decision-making awareness-based choice selection or true free will is conceived. In return, by assigning the power of decision making to the process of awareness discretionary selection of information for attention or intentional attention is emerged. Through integration of these two mental functions, an independent entity called “I” is formed that differentiates natural intelligence from artificial intelligence. While determinism can aptly describe the world of inanimate objects and artificial intelligence, because of “I,” determinism has no jurisdiction over the realm of natural intelligence.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

The research of object classification and part segmentation is a hot topic in computer vision. A considerable number of studies have been carried out about deep learning on 3D point clouds. However,it is challenging to achieve effective feature learning due to sparsity of point clouds. Recently, a variety of Transformers have been adopted to improve point cloud processing and display great potential. Nevertheless, large numbers of Transformer layers tend to incur huge computational and memory costs. PointNet++ is one of the most influential neural architectures for point cloud understanding. Although the accuracy of PointNet++ has been largely surpassed by recent networks, this does not mean that PointNet++ has no potential.Thus, this paper offer two major contributions that significantly improve PointNet++ performance. Firstly, we introduce a novel contextual feature extraction (CFE) block that significantly enhances the feature extraction capabilities of PointNet++ networks. Secondly, to further enhance feature fusion, we seamlessly integrate a mutual learning (ML) block into the network architecture. By embedding these two innovative blocks within each layer of the network, we not only enrich the network's functionality but also impart it with greater robustness and adaptability. The specific experiments were conducted on the S3DIS (6-fold cross-validation) and Modelnet40 datasets with 86.5% and 92.7% accuracy, respectively, which proved that our model is comparable or even better than most existing methods for classification and segmentation tasks.

Machinery degradation assessment can offer meaningful prognosis and health management in-formation. Although numerous machine prediction models based on artificial intelligence have emerged in recent years, they still face a series of challenges: (1) Many models continue to rely on manual feature extraction. (2) Deep learning models still struggle with long sequence prediction tasks. (3) Health indicators are inefficient for remaining useful life (RUL) prediction with cross-operational environments when dealing with high-dimensional datasets as inputs. This research proposes a health indicator construction methodology based on a transformer self-attention transfer network (TSTN). This methodology can directly deal with the high-dimensional raw dataset and keep all the information without missing when the signals are taken as the input of the diagnosis and prognosis model. First, we design an encoder with a long-term and short-term self-attention mechanism to capture crucial time-varying information from a high-dimensional dataset. Second, we propose an estimator that can map the embedding from the encoder output to the estimated degradation trends. Then, we present a domain dis-criminator to extract invariant features from different machine operating conditions. The case studies with the FEMTO-ST bearing dataset and the Monte Carlo method for RUL prediction during the degradation process are conducted. The experiment results fully exhibited the signif-icant advantages of the proposed method compared to other state-of-the-art techniques.

This paper proposes a Grouped Contrastive Learning of self-supervised Sentence Representation (GCLSR), which can learn an effective and meaningful representation of sentences. Previous works maximize the similarity between two vectors to be the objective of contrastive learning, suffering from the high-dimensionality of the vectors. In addition, most previous works have adopted discrete data augmentation to obtain positive samples and directly employed contrastive framework of computer vision to perform contrastive training, which could hamper contrastive training because text data is discrete and sparse compared with image data. To address those issues, we propose a grouped contrastive learning framework, i.e., GCLSR, which divides the high-dimensional feature vector into several groups and respectively computes the groups’ contrastive losses to make use of more local information, eventually obtaining a more fine-grained sentence representation. In addition, in GCLSR, we design a new self-attention mechanism and a continuous as well as partial word vector augmentation (PWVA). For the discrete and sparse text data, the usage of self-attention could help model focus the informative words by measuring the importance of every word in a sentence. By using the PWVA, GCLSR can obtain high-quality positive samples used for contrastive learning. Experimental results demonstrate that our proposed GCLSR achieves an encouraging result on the challenging datasets of the standard semantic textual similarity (STS) task and transfer task.

In this essay, I revisit Neural Networks (NNs) through the lens of evolutionary dynamics. From the two most important features of NNs, I recover the two most general equations of evolutionary dynamics. These two equations may thus serve as a connection between NNs and a body of knowledge that has been built over multiple centuries and has found application across a vast range of disciplines. This connection may therefore also help explain why NNs with the two features in question are applicable across a much broader range of domains than initially envisioned.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

Most natural language processing (NLP) tasks operate an input sentence as a sequence with token-level embeddings and features, despite its clausal structures. Taking Abstract Meaning Representation (AMR) parsing as an example, recent parsers are empowered by Transformers and pre-trained language models, but long-distance dependencies (LDDs) introduced by long sequences are still open problems. We argue that LDDs are not superficially blamed on the sequence length but are essentially related to the internal clause hierarchy. Typically, non-verb words in a clause cannot depend on words outside, and verbs from different but related clauses have much longer dependencies than those in the same clause. With this intuition, we introduce a type of clausal feature, hierarchical clause annotation (HCA), into AMR parsing and propose two HCA-based approaches, HCA-based self-attention (HCA-SA) and HCA-based curriculum learning (HCA-CL), to integrate HCA trees of complex sentences for addressing LDDs. We conduct extensive experiments on two in-distribution (ID) AMR datasets (AMR 2.0 and AMR 3.0) and three out-of-distribution (OOD) ones (TLP, New3, and Bio). Experimental results show that our HCA-based approaches achieve significant and explainable improvements against the baseline model and outperform the state-of-the-art (SOTA) model when encountering sentences with complex clausal structures that introduce most LDD cases.

Effortful control (EC) describes individual differences in self-regulation, with a strong attentional basis. Moreover, during early childhood EC has a central role on children’s socio-emotional adjustment and academic achievement. The aim of the current study was to predict the development of EC at 36 months of age from early attentional and environmental measures taken in infancy using a machine learning approach. A sample of 75 infants participated in a longitudinal study running different waves of data collection at 6, 9 and 36 months of age. Attentional tasks were administered at 6 months of age and two additional measures were collected at 9 months of age. Parents reported household environment variables during wave 1, and their child’s EC at 36 months. A machine -learning algorithm was implemented to identify children with low EC scores at 36 months of age. An “attention only” model showed greater predictive sensitivity than the “environmental only” model. However, a model including both attentional and environmental variables was able to classify the groups (Low-EC vs Average-to-High EC) with 100% accuracy. Sensitivity analyses indicate that socio-economic variables together with attention control processes at 6-months, and self-restraint capacity at 9-months, are the most important predictors of EC. Results suggest a foundational role of executive attention processes in the development of EC in complex interaction with household environment and provide a new tool to identify early markers of socio-emotional regulation development.

To efficiently use its finite resources, the visual system selects for further processing only a subset of the rich sensory information. Visual masking and spatial attention control the information transfer from visual sensory-memory to visual short-term memory. There is still a debate whether these two processes operate independently or interact, with empirical evidence supporting both arguments. However, recent studies pointed out that earlier studies showing significant interactions between common-onset masking and attention suffered from ceiling and/or floor effects. Our review of previous studies reporting metacontrast-attention interactions revealed similar artifacts. Therefore, we investigated metacontrast-attention interactions by using an experimental paradigm in which ceiling/floor effects were avoided. We also examined whether metacontrast masking is differently influenced by endogenous and exogenous attention. We analyzed mean absolute-magnitude of response-errors and their statistical distribution. Our results support the hypothesis that metacontrast and endogenous/exogenous attention are largely independent with negligible likelihood for interactions. Moreover, statistical modeling of the distribution of response-errors suggests weak interactions modulating the probability of “guessing” behavior for some observers in both types of attention. Nevertheless, our data suggest that any joint effect of attention and metacontrast can be adequately explained by their independent and additive contributions.

Since the beginning of the internet era, there has been an explosion of growth in structured data (such as numbers, symbols, and labels) as well as unstructured data (including images, videos, and text). Efficient and accurate mixed query of these two types of data is a key technology to achieve high-quality information retrieval, and it is also a major challenge that needs to be solved urgently in the industry. In this study, we employ an advanced Transformer model that combines strategies and fine-tuning techniques for multi-task learning. Specifically, the model is first pre-trained on a large-scale, general-purpose dataset to learn different types of data representations and basic language comprehension skills. After that, we fine-tuned the parameters of the model to better suit these specific data processing tasks for specific application scenarios, such as image annotation, video content analysis, and structured data query. At the heart of the model is the self-attention mechanism, which allows the model to automatically emphasize the important parts and ignore irrelevant information when processing the input data. In addition, we have introduced task-specific adaptation layers that are designed to add additional processing power to the original Transformer architecture, such as a semantic analysis layer for unstructured text data and a relational extraction layer for structured data. This combination of general pre-training and task-specific fine-tuning allows the model to flexibly process and integrate information from different data sources, improving processing efficiency and accuracy. Experimental results show that the model performs well in a variety of data processing tasks, significantly improves the accuracy and efficiency of information retrieval, and verifies the strong potential and adaptability of large language models in processing mixed data types.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

The adapted Posner spatial cue-target paradigm was used to explore the relationship between exogenous temporal attention caused by rhythm and endogenous and exogenous spatial attention. The study was divided into two experiments. In Experiment 1, 33 participants used arrow cues to orient endogenous spatial attention and rhythm to orient exogenous temporal attention. In Experiment 2, with 29 participants, exogenous spatial attention was directed by highlighting the cue box. Exogenous temporal attention was directed by rhythm. Experiment 1 indicated that RTs were faster for attended targets than the unattended. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. RTs were faster for late compared to synchrony. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was not significant. Experiment 2 demonstrated that exogenous spatial attention only exhibited IOR under early four stimulus repetitions. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was significant. The results indicated that rhythmic temporal attention supported foreperiod effects. Exogenous temporal attention and endogenous spatial attention independently affect behavior, while exogenous temporal attention and exogenous spatial attention mutually influenced behavior.

In Brain-Computer Interface Motor Imagery (BCI-MI) systems, Convolutional Neural Networks (CNNs) have traditionally dominated as the deep learning method of choice, demonstrating significant advancements in state-of-the-art studies. Recently, Transformer models with attention mechanisms have emerged as a sophisticated technique, enhancing the capture of long-term dependencies and intricate feature relationships in BCI-MI. This research investigates the performance of EEG-TCNet and EEG-Conformer models, which are trained and validated using various hyperparameters and bandpass filters during preprocessing to assess improvements in model accuracy. Additionally, this study introduces the EEG-TCNTransformer, a novel model that integrates the convolutional architecture of EEG-TCNet with a series of self-attention blocks employing a multi-head structure. The EEG-TCNTransformer achieves an accuracy of 82.97% without the application of bandpass filtering. The source code of EEG-TCNTransformer is available on GitHub.

In order to improve real-time performance of gesture recognition by micro-Doppler map of mmWave Radar, the point cloud based gesture recognition for mmWave Radar is proposed in this paper.Two steps are carried out for mmWave Radar based gesture recognition. The first step is to estimate the point cloud of the gestures by 3D-FFT and the peak grouping. The second step is to train the TRANS-CNN model by combining the multi-head self-attention and the 1D-convolutional network, so as to extract the features in the point cloud data at a deeper level to categorize the gestures. In the experiments, TI mmWave Radar sensor IWR1642 is used as benchmark to evaluate the feasibility of the proposed approach. The results show that the accuracy of the gesture recognition reaches 98.5%. In order to prove the effectiveness of our approach, a simply 2Tx2Rx Radar sensor is developed in our lab and the accuracy of recognition reaches 97.1%. The results show that our proposed gesture recognition approach achieves the best performance in real-time with limited training data, in comparison with the existing methods.

(1) Background: Mindfulness-based interventions (MBIs) have shown interesting preliminary ef-fects over self-regulation processes in early adolescence. However, interventions usually integrate various types of practices with no clarity about the specific effect of each of them over attentional, emotional, and behavioral regulation. The objective of this research was to evaluate the effect of two MBIs, one focused on classic attentional practices and another one focused on the recognition and expression of emotions, over attentional, emotional, and behavioral self-regulation in early adolescents. (2) Method: An experimental method was carried out. A sample of 70 children be-tween 8 and 12 years old were randomized and assigned to three experimental conditions: 1) MBI with a focus on attentional practices, 2) MBI with a focus on recognition and expression of emotions, 3) control group, waiting list. The programs lasted 8 weeks, with a weekly 1-hour online synchronic session, plus home practices. Children were evaluated before starting the in-tervention and at the end of the 8-week program. The assessed variables were: 1) Mindfulness; 2) Emotional Regulation; 3) Attentional Regulation and 4) Behavioral regulation. (3) Results: Chil-dren that participated in both programs, increased their mindfulness and emotional and be-havioral regulation scores. Only children who participated in the program with a focus on at-tention showed significant changes in their ability to self-regulate attention. (4) Conclusions: online MBIs, with attention to external and internal stimuli practices, can be a good strategy to strengthen self-regulation skills of attention, emotions, and behavior in early adolescence.

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important for accurately identifying breast cancer from unregistered multi-view mammograms. This motivates us to leverage the architecture of Vision Transformers to capture long-range relationships of multiple mammograms from the same patient. For this purpose, we employ local Transformer blocks to separately learn patch relationships within a specific view (CC/MLO) of one side (right/left) of mammogram. The outputs from different views and sides are concatenated and fed into global Transformer blocks, to jointly learn patch relationships between two different views of the left and right breasts. To evaluate the proposed model, we retrospectively assembled a dataset involving 949 sets of CC and MLO view mammograms, which include 470 malignant cases and 479 normal or benign cases. We trained and evaluated the model using a five-fold cross-validation method. Without any arduous preprocessing steps (e.g., optimal window cropping, chest wall or pectoral muscle removal, two-view image registration, etc.), our two-view Transformer-based model achieves lesion classification accuracy of 77.0% and area under ROC curve (AUC = 0.814), outperforming state-of-the-art multi-view CNNs by 3.1% and 3%, respectively. Meanwhile, the new two-view model improves mammographic case classification accuracies of two single-view models by 7.4% (CC) and 4.5% (MLO), respectively. The promising results unveil the great potential of using Transformers to develop high-performing computer-aided diagnosis (CADx) schemes of mammography.

In today’s fast paced, attention-demanding society, executive functions and attentional resources are often taxed. Individuals need ways to sustain and restore these resources. We first review the concepts of attention and restoration, as instantiated in Attention Restoration Theory (ART). ART emphasizes the role of nature in restoring attention. We then discuss essentials of experiments on the causal influences of nature. Next, we expand the concept of ART to include modern, designed environments. We propose a wider perspective termed attentional ecology, in which attention behavior is viewed within a larger system involving the human and their interactions over time with environmental demands. When the ecology is optimal, mental functioning can be a positive “flow” that is productive, sustainable for the individual, and sometimes creative.

Diagnosis and treatment of Attention-Deficit/Hyperactivity Disorder (ADHD) in women remain insufficient. Fluctuations of reproductive hormones during the premenstrual period, postpartum period and (peri)menopause are neglected, even though they impact ADHD symptoms and as-sociated mood disorders [1]. Therefore, we created a female-specific treatment group for women with ADHD and premenstrual worsening of ADHD and/or mood symptoms. We describe the group programme and underlying rationale, offering a qualitative analysis of the participants’ evaluation. The 7 two-weekly sessions foreground the menstrual cycle and address several ADHD-specific topics in relation to this cyclical pattern: emotional regulation; impulsivity; setting boundaries, and triggers. Concurrently, women track their menstrual cycle and (fluctuating) ADHD and mood symptoms with an adjusted premenstrual calendar. In total, 18 women (25-47yrs) participated in three consecutive groups. We analysed the evaluation of the last group. Participants experienced the group as a safe and welcoming space. Recognition was valued by all. The topics discussed were deemed valuable and the structure suited them well. Completing the premenstrual calendar augmented awareness and recognition of individual cyclical symptoms. Discussing ADHD throughout the lifespan increased self-understanding. Participants took their menstrual cycle more seriously, prioritising self-acceptance and self-care in the luteal phase of the cycle. Exploring a cyclical approach in a group setting seems to be a positive addition to treatment for female ADHD.

Research on image-inpainting tasks has mainly focused on enhancing performance by augmenting various stages and modules. However, this trend does not consider the increase in the number of model parameters and operational memory, which increases the burden on computational resources. To solve this problem, we propose a Parametric Efficient Image InPainting Network (PEIPNet) for efficient and effective image-inpainting. Unlike other state-of-the-art methods, the proposed model has a one-stage inpainting framework in which depthwise and pointwise convolutions are adopted to reduce the number of parameters and computational costs. To generate semantically appealing results, we selected three unique components: spatially-adaptive denormalization (SPADE), dense dilated convolution module (DDCM), and efficient self-attention (ESA). The SPADE was adopted to conditionally normalize activations according to the mask to distinguish between damaged and undamaged regions. The DDCM was employed at every scale to overcome the gradient-vanishing obstacle and gradually fill-in pixels by capturing global information along the feature maps. The ESA was utilized to obtain clues from unmasked areas by extracting long-range information. In terms of efficiency, our model has the lowest operational memory compared with other state-of-the-art methods. Both qualitative and quantitative experiments demonstrate the generalized inpainting of our method on three public datasets: Paris StreetView, CelebA, and Places2.

Attention deficit hyperactivity disorder (ADHD) results in various functioning impairments in children’s lives and families. Parents of children with ADHD report high levels of parenting stress, low levels of parental self-efficacy and use of more authoritarian and/or permissive parenting practices than parents of typically developing children. Intervention programs need to address both children’s and parents’ needs and multimodal intervention programs could cover this demand. The aim of this study was to examine the efficacy of “Child ViReal Support Program” - a multi-level evidence-based comprehensive program - on parenting stress, parental self-efficacy, parenting practices, and the core symptoms of children’s ADHD. Families with a child diagnosed with ADHD (n = 16) were randomly allocated to two groups (PC and CP; P = parent training, C = child training) and a cross-over design was utilized. Participating parents completed, in four different times during the study, the Parenting Stress Index-Short Form, the Parenting Sense of Competence Scale, the Parenting Styles and Dimensions Questionnaire-Short Version and the parent form of the ADHD Rating Scale-IV. Parents from both groups, after their participation in the parent training, demonstrated reduced parenting stress, enhanced parental self-efficacy and increased the employ of democratic parenting practices. More than that, they reported decreased levels of inattention and impulsivity/hyperactivity for their children. Evidence-based multi-level intervention programs could produce positive effects in parents and children by incorporating effective methods and tools in accordance with the needs and the demands of the family context.

Transformer models have emerged as frontrunners in the field of natural language processing, primarily due to their adept use of self-attention mechanisms to grasp the semantic linkages between words in sequences. Despite their strengths, these models often face challenges in single-task learning scenarios, particularly when it comes to delivering top-notch performance and crafting strong latent feature representations. This challenge is more pronounced in the context of smaller datasets and is particularly acute for under-resourced languages such as Arabic. In light of these challenges, this study introduces a novel methodology for text classification of Arabic texts. This method harnesses the newly developed Reverse Positional Encoding (RPE) technique. It adopts inductive-transfer learning (ITL) framework combined with a switching self-attention shared encoder, thereby increasing the model's adaptability and improving its sentence representation accuracy. The integration of Mixture of Experts (MoE) and Reverse Positional Encoding (RPE) techniques empowers the model to process longer sequences more effectively. This enhancement is notably beneficial for Arabic text classification, adeptly supporting both the intricate five-point and the simpler ternary classification tasks. The empirical evidence points to its outstanding performance, achieving accuracy rates of 87.20% for the HARD dataset, 72.17% for the BRAD dataset, and 86.89% for the LABR dataset, as evidenced by the assessments conducted on these datasets.

Alcohol use disorder (AUD) is a chronic and relapsing biopsychosocial condition that leads to a wide range of medical, psychological, social, economic, and personal issues. The study investigated the predictors of quality of life (QoL) among male patients seeking treatment for AUD based on attention, cognitive instability, motor impulsiveness, perseverance, and self-control dimensions of trait impulsivity. The study also investigated the potential mediating effect of anxiety and alcohol use severity in this relationship. After an initial assessment, participants underwent comprehensive evaluations, including sociodemographic data, clinical history, and QoL domains. Evaluations also covered AUD severity, impulsivity dimensions, cognitive functions, craving intensity, depression, anxiety and self-efficacy. Multiple linear regressions were employed to identify associations between independent variables and QoL. Attention dimension of impulsivity and anxiety symptoms significantly predicted physical health QoL. Self-control dimension and severity of alcohol use disorder predicted psychological QoL. Indirect effect of attention dimension on physical health was significant [effect =-1.082,95% CI (-2.008, -0.3598)].The significance of impulsivity in influencing QoL for individuals with AUD has profound clinical implications. These findings underscore the importance of addressing anxiety and impulsivity in managing AUD, given their considerable impact, particularly on QoL, ultimately shaping treatment outcomes.

The neural system has limited resources to interact with the environment, and this is where attention comes into play. Attention is a complex process that provides numerous benefits, but there has been a longstanding debate about the mechanisms involved in attentional orientation. Two widely proposed mechanisms are top-down and bottom-up, which relate to the organism's current behavioral goal and the salience of environmental stimuli, respectively. However, distinguishing between these mechanisms can be challenging in both behavioral and neural studies. This review introduces a new conceptualization in which both top-down and bottom-up mechanisms are viewed as aspects of the same process. This unified approach aims to prepare the organism to face stimuli and events based on its prior experiences, immediate (the current task that he/she is aware of), and innate (to be alive) demands.

The Speer allergic tension-fatigue syndrome (SATFS) is a classic syndrome characterized by allergy-like symptoms, muscle tension, headache, chronic fatigue, and a particular behavior. The particular behavior displayed includes symptoms such as hyperkinesis, hyperesthesia (i.e., insomnia), restlessness, and distractibility, among others. Interestingly, these symptoms are very similar to recent descriptions of attention deficit hyperactivity disorder (ADHD), the most prevalent neurodevelopmental disorder worldwide, which is characterized by inattention, hyperactivity and impulsivity. Although the exact cause of ADHD remains unknown, it has been proposed that deficiency of the enzyme diamine oxidase (DAO), which metabolizes histamine, may be involved in the development of ADHD. Our conceptual paper suggests that DAO enzyme deficiency may be involved in the development and severity of ADHD. Histamine, which is metabolized by DAO, plays an important role in the regulation of attention, memory and cognition. Therefore, decreased DAO activity could lead to an accumulation of histamine, which could contribute to ADHD symptoms. This study provides a theoretical framework for the relationship between DAO deficiency and ADHD, which could have important implications for the diagnosis and treatment of the disorder. Further empirical studies are needed to confirm our hypothesis and explore the clinical implications of the relationship between DAO deficiency, histamine, and ADHD.

This project investigates the behavior of multi-head attention in Transformer models, specifically focusing on the differences between benign and trojan models in the context of sentiment analysis. Trojan attacks cause models to perform normally on clean inputs but exhibit misclassifications when presented with inputs containing predefined triggers. We characterize attention head functions in trojan and benign models, identifying specific 'trojan' heads and analyzing their behavior.

Spatial attentional biases can be observed during the processing of linguistic material. For example, we previously reported that healthy subjects overestimate the semantic distance between word stimuli in the right vs left space. Here we explored whether attentional biases are also observed in tasks requiring evaluation of phonological distance between words in the right and left hemispace. Forty-one healthy subjects were presented with triplets of words arranged in space and were asked to indicate the side of space in which the phonological distance between the middle word and an outer word was smaller. In Experiment 1 real words and pseudowords were used, while in Experiment 2 only pseudowords and consonant strings were used. Subjects overestimated the phonological distance between the middle and outer words in the right space. These findings were specific to word stimuli. These results are consistent with the idea that semantic and phonological information may be internally mapped onto spatial representations.

Few-shot classification is challenging since the goal is to classify unlabeled samples with very few labeled samples provided. It has been shown that cross attention helps generate more discriminative features for few-shot learning. This paper extends the idea and proposes two cross attention modules, namely the cross scaled attention (CSA) and the cross aligned attention (CAA). Specifically, CSA scales different feature maps to make them better matched, and CAA adopts the principal component analysis to further align features from different images. Experiments showed that both CSA and CAA achieve consistent improvements over state-of-the-art methods on four widely used few-shot classification benchmark datasets, miniImageNet, tieredImageNet, CIFAR-FS, and CUB-200-2011, while CSA is slightly faster and CAA achieves higher accuracies.

Targets detection in synthetic aperture radar (SAR) remote sensing images, which is a fundamental but challenging problem in the field of satellite image analysis, plays an important role for a wide range of applications and is receiving significant attention in recent years. Besides, the ability of human visual system to detect visual saliency is extraordinarily fast and reliable. However, computational modeling of SAR image scene still remains a challenge. This paper analyzes the defects and shortcomings of traditional visual models applied to SAR images. Then a visual attention model designed for SAR images is proposed. The model draws the basic framework of classical ITTI model; selects and extracts the texture features and other features that can describe the SAR image better. We proposes a new algorithm for computing the local texture saliency of the input image, then the model constructs the corresponding saliency maps of features; Next, a new mechanism of feature fusion is adopted to replace the linear additive mechanism of classical models to obtain the overall saliency map; Finally, the gray-scale characteristics of focus of attention (FOA) in saliency map of all features are taken into account, our model choose the best saliency representation, Through the multi-scale competition strategy, the filter and threshold segmentation of the saliency maps can be used to select the salient regions accurately, thereby completing this operation for the visual saliency detection in SAR images. In the paper, several types of satellite image data, such as TerraSAR-X (TS-X), Radarsat-2, are used to evaluate the performance of visual models. The results show that our model provides superior performance compared with classical visual models. By further contrasting with the classical visual models, Our model reduce the false alarm caused by speckle noise, and its detection speed is greatly improved, and it is increased by 25% to 45%.

Background: Student-specific stress is pervasive and impairs health and attainment. Experimentally induced self-affirmation can reduce stress, but little is known about the mechanisms underlying this effect, and the role of individual differences. The present study explores the relationship between spontaneous self-affirmation, student-specific stress, and overlapping constructs of positive self-regard during the COVID-19 pandemic. Methods: The study investigated inter-relationships between spontaneous self-affirmation, student-specific perceived stress and potential covariates including self-esteem, self-integrity and habitual positive self-thought. University students (N = 151) aged 18 to 50 responded to an online questionnaire including the Spontaneous Self-Affirmation Measure, College Student Stress Scale, Rosenberg Self-Esteem Scale, Habitual Index of Positive Thinking and Self-Integrity Scale. Results: Unexpectedly, regression analysis revealed that spontaneous self-affirmation was a positive predictor of student-specific stress, seemingly driven by relational affirmations. Self-esteem and habitual self-thought were negative predictors of student-specific stress, whilst self-integrity was not a predictor. Conclusions: Habitual positive self-thought may offer a sustainable solution to student-specific stress, but spontaneous self-affirmation does not. A reduction in defensive responses, elicitation of negative emotions, or use of conditional relationships in relational affirmation

The technical capabilities of modern Industry 4.0 and Industry 5.0 are rather vast and growing exponentially daily. The present-day Industrial Internet of Things (IIoT) combines manifold underlying technologies that require real-time interconnections and communications among heterogeneous devices. Smart cities are established with sophisticated designs and control for seamless Machine-to-Machine (M2M) communication to optimize resources, costs, performances, and energy distribution. All the sensory devices within a building interact to maintain a sustainable climate for residents and intuitively optimize the energy distribution to optimize energy production. However, it encompasses quite a few challenges for devices that lack compatible and interoperable designs. Conventional solutions are restricted to limited domains or rely on engineers to design and deploy translators for each pair of ontologies. This is a costly process in terms of engineering efforts and computational resources. The issue persists that a new device with a different ontology must be integrated into an existing IoT network. We propose a self-learning model that can determine the taxonomy of devices given their ontology meta-data and structural information. The model finds matches between two distinct ontologies using the Natural Language Processing (NLP) approach for learning linguistic contexts. Then, by visualizing the ontology network as a knowledge graph, it is possible to learn the structure of the meta-data and understand the device's message formulation. Finally, it can align entities of both ontology graphs similar in context and structure. Furthermore, the model performs dynamic M2M translation without requiring extra engineering or hardware efforts.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Traditional 3D reconstruction models have consistently encountered a challenge: attaining high recall of object edges while preserving precision. In this paper, we introduce a post-processing method Multi-Head Attention Refiner (MA-R) aimed at tackling this challenge by integrating a multi-head attention mechanism within the U-Net style refiner module. The 3D reconstruction model applying this method demonstrates excellence in parsing intricate image details, resulting in significant enhancement of boundary predictions and increased recall rates. In our experiments, our method significantly enhances the reconstruction performance of Pix2Vox++ when multiple images are utilized as input. Specifically, it achieves an enhanced Intersection Over Union score of approximately 1.1% compared to the original Pix2Vox++ model when 16-view images are employed.

In recent years, researchers have paid increasing attention on hyperspectral image (HSI) classification using deep learning methods. To improve the accuracy and reduce the training samples, we propose a double-branch dual-attention mechanism network (DBDA) for HSI classification in this paper. Two branches are designed in DBDA to capture plenty of spectral and spatial features contained in HSI. Furthermore, a channel attention block and a spatial attention block are applied to these two branches respectively, which enables DBDA to refine and optimize the extracted feature maps. A series of experiments on four hyperspectral datasets show that the proposed framework has superior performance to the state-of-the-art algorithm, especially when the training samples are signally lacking.

With the development of the Internet, The content people share contains types of text, images, and videos, and utilizing these multimodal data for sentiment analysis has become an important area of research. Multimodal sentiment analysis aims to understand and perceive emotions or sentiments in different types of data. Currently, the realm of multimodal sentiment analysis faces various challenges, with a major emphasis on addressing two key issues: 1) Inefficiency when modeling the intra-modality and inter-modality dynamics and 2) Inability to effectively fuse multimodal features. In this paper, we proposed the CCDA(Cross-Correlation in Dual-Attention) model, a novel method to explore dynamics between different modalities and fuse multimodal features efficiently. We capture dynamics at intra- and inter-modal levels by using two types of attention mechanisms simultaneously. Meanwhile, the cross-correlation loss is introduced to capture the correlation between attention mechanisms. Moreover, the relevant coefficient is proposed to integrate multimodal features effectively. Extensive experiments were conducted on three publicly available datasets, CMU-MOSI, CMU-MOSEI, and CH-SIMS. The experimental results fully confirm the effectiveness of our proposed method, and compared with the current optimal method (SOTA), our model shows obvious advantages in most of the key metrics, proving its better performance in multimodal sentiment analysis.

Background: Consciousness is usually interpreted as a state of being aware of one’s environment as well as self. According to the trilogy paradigm of consciousness (or simply “trilogy”), it is primarily guided by two new mental functions—awareness-based choice selection (ABCS) and discretionary selection of information for awareness (DSIA) or intentional attention—which may play a role in the choice selection during decision making. Method: To test whether ABCS and DSIA could improve the choice selection efficiency, 204 subjects were recruited using social media platforms to complete an anonymous online survey. The survey was designed to examine the role of subtle hints and cues in guiding participants’ attention toward a particular subject of awareness and this in return would increase the likelihood of selecting a correct choice among the proposed options, thereby enhancing the decision-making efficacy. Results: The participants’ attention could be successfully swayed to a particular subject matter (DSIA) in 59−73% of occasions. In addition, using ABCS increased the efficiency of selecting a correct choice among presented options. The analyses further revealed a gap between the selecting a choice during decision-making process and its execution, which is indicative of an appropriation process. Conclusion: The present study shows that sheer knowledge of facts may not be sufficient for selecting a correct choice among presented options effectively. However, as ABCS improves the choice selection efficiency, it plays an instrumental role in determining the subject of awareness, indirectly supporting the notion of DSIA.

It has been known for a long time that many people who stutter are immediately fluent in certain conditions, for instance, when they speak in unison with others, in sync with the clicking of a metronome, or when they hear themselves speak in an altered manner. To understand why stuttering is reduced or even eliminated in such conditions is desirable because it may help understand why stuttering occurs in normal speaking conditions. However, empirical findings in this area appear conflicting and confusing, especially with regard to the role of auditory feedback. The article gives an overview of the variety and diversity of fluency-enhancing conditions and of theories proposed to explain their effect. These theories are evaluated in the light of recent empirical findings. A new hypothesis is proposed, based on findings showing that speech processing is limited without attention to the auditory channel. It is assumed that fluency-enhancing conditions draw the speaker’s attention to the auditory channel and, thereby, improve the processing of auditory feedback and its use in speech control. Implications of this account for a causal theory of stuttering and for the treatment of the disorder are discussed.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

Previous evidence in support of a slowly acting (scale of 100s of seconds) and volume-transmitted component of cholinergic signaling was based largely on studies using measures of extracellular brain acetylcholine (ACh) levels which required several minutes to generate a single data point and typically employed AChEsterase inhibitors (AChEIs) to foster the measurement of ACh. Moreover, collecting such data points in correlation with relatively stable behavioral states has supported the view that extracellular ACh levels vary at a relatively slow rate. Here we argue that forebrain cholinergic signaling is exclusively phasic (milliseconds to perhaps seconds), unlikely to be volume-transmitted, and that previous neurochemical evidence and associated behavioral correlates may be re-interpreted in terms of integrated phasic cholinergic activity and specific behavioral and cognitive operations. The highly potent catalytic enzyme for ACh, AChE, limits the presence of an ambient extracellular ACh level and thus renders it unlikely that ACh influences target regions via relatively slow changes in extracellular ACh concentrations. Real-time amperometric recordings of cholinergic signaling have suggested a specific function of rapid, phasic or transient cholinergic signaling in attentional contexts. Optogenetic studies support a causal relationship between these transients on behavior. Combined electrochemical and neurophysiological recordings revealed that the powerful behavioral control by cholinergic transients involves the generation of high-frequency oscillations. Such oscillations are thought to recruit efferent circuitry to (re)activate dormant task sets. Evidence showing the impact of genetic variations of the capacity of cholinergic synapses likewise can be interpreted in terms of their impact on the ability to sustain generation of repeated phasic cholinergic signals, as opposed to effects on ambient ACh levels. Further, while notions of slowly-changing, sleep stage-associated variations in extracellular ACh levels and their functions are widely accepted, the evidence is in fact limited. An alternative hypothesis offers a role for high-frequency cholinergic transient signaling during REM sleep. By employing a theoretical framework that focuses on the phasic and causative characteristics and functions of cholinergic signaling, results from human cognitive neuroscience studies of cholinergic function may be substantially clarified and simplified. Compared to the current treatment of cholinergic deficits using AChEIs, the conceptualization of forebrain cholinergic signaling as wired, phasic, and causative predicts that drugs that either rescue transient presynaptic signaling or amplify or rescue the postsynaptic impact of phasic signals will be more efficacious in treating age- and dementia-related cognitive and cognitive-motor disorders.

In this paper I tentatively answer 50 questions sampled from a pool of over 10,000 weekly questions formulated by students in a course entitled “The Self”. The questions pertain to various key topics about self-processes, such as self-awareness, self-knowledge, self-regulation, self-talk, self-esteem, and self-regulation. The students’ weekly questions and their answers highlight what is currently know about the self. Answers to the student questions also allow for the identification of some recurrent lessons about the self. Some of these lessons include: all self-processes are interconnected (e.g., prospection depends on autobiography), self-terms must be properly defined (e.g., self-rumination and worry are not the same), inner speech plays an important role in self-processes, controversies are numerous (are animals self-aware?), measurement issues abound (e.g., self-reflection as an operationalization of self-awareness), deficits in some self-processes can have devastating effects (e.g., self-regulatory deficits may lead to financial problems), and there are lots of unknowns about the self (e.g., gender differences in Theory-of-Mind).

Recently, the destructive impact of wildfires has proliferated; for instance, the August Complex wildfire in 2020 burned around 4% of California's landmass. This has caused increased economic damage and risk to human life. Additionally, climate change is anticipated to increase the severity of wildfires, making it imperative for accurate and efficient detection of wildfires. Machine Learning approaches allow for the automatic detection of wildfires, simultaneously prioritizing accuracy and efficiency, with minimal human intervention, thus decreasing the likelihood of increased economic damage and increasing firefighting responses. Convolutional Neural Networks (CNNs), while showing promise, are often limited by their inability to learn and capture deep spatial dependencies in satellite imagery tasks. In this paper, we propose FlameViT, a novel wildfire detection architecture based on Vision Transformers (ViT). Satellite images are more efficient to obtain and can cover wide areas prone to wildfires. We obtain a dataset of 40K+ satellite images from Canada's Open Government Portal, allowing FlameViT to be optimized to detect wildfires in satellite imagery. FlameViT uses Patch Extractor and Patch Embedding layers, followed by multiple Transformer Encoder layers with Multi-Head Self-Attention and feed-forward neural networks. FlameViT is hyperparameter-tuned and achieves a validation accuracy of 95%, outperforming various baselines in the wildfire detection task. FlameViT shows the power of Vision Transformers for wildfire detection tasks, and in conjunction with the use of satellite imagery, can provide an efficient and accurate way of detecting wildfires.

Classification of pre-processed fMRI dataset using the functional connectivity(FC) based features is considered a challenging task due to high dimensional FC features set and smaller dataset size. To tackle this specific FC high dimensional features set and a smaller dataset size , We have proposed here a GAN based dataset augmenter to firstly train the GAN on the NYU Connectivity Features dataset and used the trained GAN to generate synthetic features per category and after getting sufficient number of features per category , A multi-head attention mechanism was used as a head for the classification . We name our proposed approach as "ASD-GANNet" which is End-To-End and does not require hand-crafted features as the multi-head attention mechanism focuses on the features that are more relevant . Moreover , We compared our results with the 06 available state-of-the-art techniques from the literature and Our proposed approach results using "NYU" site as a training set for generating GAN based synthetic dataset are promising. We achieved an overall 10-fold cross validation based accuracy of 82% ,sensitivity 82% and specificity 81% outperforming the available state-of-the art approaches. Sitewise comparison of our proposed approach also outperformed the the available state-of-the-art as out of the 17 sites our proposed approach has better results in the 10 sites.

Vitrimers are covalent network materials, comparable in structure to classical thermosets. Unlike normal thermosets, they possess a chemical bond swap mechanism that makes their structure dynamic and suitable for activated welding and even autonomous self-healing. The central question in designing such materials is the trade-off between autonomy and material stability: The swap mechanism facilitates the healing but it also facilitates creep, which makes the perfectly stable self-healing solid a hard goal to reach. Here, we address this question for the case of self-healing vitrimers made from star polymers. Using coarse-grained molecular dynamics simulations, we study the adhesion of two vitrimer samples and find that they bond together on timescales that are much shorter than the stress relaxation time. We show that the swap mechanism allows the star polymers to diffuse through the material through coordinated swap events, but the healing process is much faster and does not depend on this mobility.

With the increased emphasis on competition in academic settings, anxiety is becoming more common, which inevitably has some impact on students’ learning process and result. This study aimed to explore how competition-induced anxiety influences the subjective cognitive load (SCL), attention level and test score. Meanwhile, we investigated the mediating role of the behavioral inhibition system/behavioral activation system (BIS/BAS) in those processes. A total of 101 college students were recruited in Study 1 to learn five micro-lectures from massive open online courses (MOOC) under with and without competitive conditions. The results showed that participants’ state anxiety (SA) scores were higher after the experiment, participants in the competition condition had higher test scores, and the relationship between SA/ trait anxiety (TA) and SCL could be mediated by the BIS. To obtain more objective data on learning processes (attention levels), we conducted Study 2, which collected behavioral and EEG data from 42 college students during the online learning. The results showed that the competition group had higher SA, lower attention levels, and worse test scores, and the relationship between SA/TA and attention levels could be mediated through the BIS. The present study not only expands previous research by finding that BIS functioning plays an important role in the effects of anxiety on cognitive load and attention, but also offers implications for using competitive strategies to motivate students according to their aptitude.

The Transformer architecture, while adept at capturing context through self-attention, falls short in encapsulating complex syntactic structures effectively. Addressing this gap, we introduce the Linguistic Structure through Graphical Interpretation with BERT (LSGIB) approach in Machine Translation (MT) frameworks. Combining the strengths of Graph Attention Network (GAT) and BERT, LSGIB intricately captures syntactic dependencies as explicit knowledge from the source language. This enhances the source language representation and aids in more accurate target language generation. Our empirical analysis leverages gold-standard syntax-annotated sentences and employs a Quality Estimation (QE) model. This approach enables us to assess translation improvements in terms of syntactic accuracy, extending beyond traditional BLEU score metrics. The LSGIB model demonstrates superior translation quality across diverse MT tasks, maintaining robust BLEU scores. Our study delves into the optimal sentence lengths benefiting from LSGIB and identifies which syntactic dependencies are more precisely captured. We observe that GAT's ability to learn specific dependency relations directly influences the translation quality of sentences with those relations. Additionally, we discover that incorporating syntactic structure into BERT's intermediate and lower layers offers a novel approach to modeling linguistic structure in source sentences.

Our previous research provides evidence that vergence eye movements may significantly influence cognitive processing and could serve as a reliable measure of cognitive issues. The rise of consumer-grade eye tracking technology, which uses sophisticated imaging techniques in the visible light spectrum to determine gaze position, is noteworthy. In our study, we explored the feasibility of using webcam-based eye tracking to monitor the vergence eye movements of patients with Mild Cognitive Impairment (MCI) during a visual oddball paradigm. We simultaneously recorded eye positions using a remote infrared-based pupil eye tracker. Both tracking methods demonstrated more pronounced cognitive vergence responses for targets as opposed to distractors. In summary, the use of a consumer-grade webcam to record cognitive vergence shows potential. This method could potentially lay the groundwork for future research aimed at creating an affordable screening tool for mental health care.

In recent years, graph neural networks (GNNs) have become a promising method for analyzing data structured in graph format. By considering connections between entities in a graph, GNNs are able to extract valuable insights. One notable variation of GNN is the graph attention network (GAT), which employs the attention mechanism and has demonstrated promising performance in various applications. However, its ability to incorporate feature information from nodes beyond the immediate neighborhood is limited, leading to degraded performance on heterophilic data. To address this limitation, this thesis proposes a novel attention-based model, namely the Directional Graph Attention Network (DGAT). This model combines the feature-based attention with the global directional information extracted from the graph topology, as inspired by the Directional Graph Network (DGN). A new class of Laplacian matrices is proposed and an existing theoretical result on DGN is extended. This extension bridges a gap in the literature. The experimental results presented in the thesis, based on nine real-world benchmarks and ten synthetic data sets, demonstrate the superiority of the proposed DGAT model compared to the GAT baseline model. Particularly on heterophilic data sets, DGAT showed a notable average increase of approximately 35% in node classification tasks across all heterophilic real-world data sets. In addition, DGAT outperforms GAT by an average margin of around 51% in all ten synthetic data sets with various levels of heterophily

Using digital media has become the most popular leisure activity for children and adolescents. The effects of digital media use on the developing brain and cognitive processes of children are subject to debate. Here, we examine the effect of digital media use on attention subdomains in children aged 6 to 10 years. In total, 77 children participated in the study. Selective and divided attention as well as switching between attentional demands were quantified by the SwAD task. Parents were asked to assess the screen time of their children (TV, smartphone, laptop/PC, game console, tablet). Results show no main or interaction effects of screen time on any of the attention conditions investigated. Based on the present findings, as well as previous studies, we suggest a possible non-linear relationship between the amount of screen time and attention function. Furthermore, we emphasize the relevance of considering the socio-economic background of children and a need for longitudinal studies.

Self-assembly is a spontaneous process through which macroscopic structures are formed from basic microscopic constituents (e.g. molecules or colloids). By contrast, the formation of large biological molecules inside the cell (such as proteins or nucleic acids) is a process more akin to self-organization than to self-assembly, as it requires a constant supply of external energy. Recent studies have tried to merge self-assembly with self-organization by analyzing the assembly of self-propelled (or active) colloid-like particles whose motion is driven by a permanent source of energy. Here we present evidence that points to the fact that self-propulsion considerably enhances the assembly of polymers: self-propelled molecules are found to assemble into polymer-like structures, the average length of which increases towards a maximum as the self-propulsion force increases. Beyond this maximum, the average polymer length decreases due to the competition between bonding energy and disruptive forces that result from collisions. The assembly of active molecules might have promoted the formation of large pre-biotic polymers that could be the precursors of the informational polymers we observe nowadays.

The objective of person re-identification (ReID) tasks is to match a specific individual across different times, locations, or camera viewpoints. The prevalent issue of occlusion in real-world scenarios affects image information, rendering the affected features unreliable. The difficulty and core challenge lie in how to effectively discern and extract visual features from human images under various complex conditions, including cluttered backgrounds, diverse postures, and the presence of occlusions. Some works have employed pose estimation or human keypoint detection to construct graph-structured information to counteract the effects of occlusions. However, this approach introduces new noise due to issues such as the invisibility of keypoints. Our proposed module, in contrast, does not require the use of additional feature extractors. Our module employs multi-scale graph attention for the reweighting of feature importance. This allows features to concentrate on areas genuinely pertinent to the re-identification task, thereby enhancing the model's robustness against occlusions. To address these problems, a model that employs multi-scale graph attention to re-weight the importance of features is proposed in this study, significantly enhancing the model’s robustness against occlusions. Our experimental results demonstrate that, compared to baseline models, the method proposed herein achieves a notable improvement in mAP on occluded data sets, with increases of 0.5%, 31.5%, and 12.3% in mAP scores.

Abstract: Author attribution refers to identifying the author of a document by distinguishing between texts written by various authors. Since the author’s writing style is a straightforward concept of his writing habits, an author’s attribution can be used in various sections of society, including legal work, court cases, and plagiarism. This paper studies and compares a deep architecture that automatically identifies Persian writers through their writing styles. For this purpose, since there were no existing datasets suitable for author identification in Persian, the first step was to collect three different datasets: Novels, News, and Twitter. Afterward, the Word2Vec algorithm is trained on many Persian datasets and used as word embedding. To have syntactic features besides semantic ones, Part Of Speech (POS) embedding has also been used. In the next step, an attention mechanism and Long Short-Term Memory (LSTM) are coupled with residual connections. Thus, the current layer input becomes the output of all previous layers rather than the top one. The model implemented is superior in performance for all three types of data compared to earlier models in text classification and author attribution. Absolute accuracies of 90.22%, 85.10%, and 71.39% were achieved among the three Novels, News, and Tweets datasets.

Abstract: The promotion and development of healthy cities are vital for enhancing human habitats and fostering sustainable economic growth. Based on the core database of Web of Science and the knowledge graph software, this paper makes a quantitative analysis of the literature related to attention recovery abroad. It is found that in recent years, the research on attention recovery has developed rapidly, the number of related literature has been increasing, and the research content presents the characteristics of interdisciplinary integration. By further analyzing the characteristics of research literature, research context, and knowledge basis, this paper summarizes the empirical research based on the existing quantitative analysis, reviews the research field based on the mechanism of attention recovery, and analyzes the development process and trend based on the research basis of attention recovery. Due to the change of modern life style, human health problems are becoming more and more prominent. Attention restoration design provides a new research idea and method to balance the relationship between humans and the urban environment.

In the industrial field, the 3D target detection algorithm PointPillars has gained popularity. Improving target detection accuracy while maintaining high efficiency has been a significant challenge. To address the issue of low target detection accuracy in the PointPillars 3D target detection algorithm, this paper proposes an algorithm based on feature enhancement to improve the backbone network. The algorithm enhances preliminary feature information of the Backbone network by modifying it based on PointPillars with the aid of channel attention and spatial attention mechanisms. To address the inefficiency caused by the excessive number of subsampled parameters in PointPillars, FasterNet (a lightweight and efficient feature extraction network) is utilized for downsampling and forming different scale feature maps. To prevent the loss and blurring of extracted features resulting from the use of inverse convolution, we utilize the lightweight and efficient up-sampling modules Carafe and Dysample for adjusting resolution. Experimental results indicate improved accuracy under all difficulties of the KITTI dataset, demonstrating the superiority of the algorithm over PointPillars.

Skin cancer is a global health concern with increasing prevalence, necessitating effective early detection and classification systems. Transfer learning has emerged as a powerful tool in this domain, enhancing diagnostic accuracy. Attention mechanisms, which selectively focus on pertinent image features, play a pivotal role in transfer learning. While previous studies have highlighted their effectiveness, their applicability across different models and datasets remains understudied. This empirical study explores the impact of various attention mechanisms on the performance of transfer learning models for skin cancer detection and classification. Using five transfer learning models (DenseNet121, InceptionV3, MobileNet, VGG16, and Xception) and six attention mechanisms (Channel Attention, Global Context Attention, Guided Attention, Nonlocal Attention, Positional Attention, and Spatial Attention), we conducted 105 experiments across three datasets. Traditional metrics (accuracy, precision, recall, and f1-score) were employed for empirical validation. The results reveal a nuanced relationship between attention mechanisms, transfer learning models, and datasets. Overall, attention mechanisms exhibit the potential to enhance skin cancer classification. Spatial and channel attention mechanisms consistently outperform others, offering simplicity and effectiveness. Model-specific selection of attention mechanisms is crucial, with a trade-off between model complexity and performance evident. This study provides insights into developing efficient skin cancer classification models utilizing attention mechanisms.

Calligraphy works have high artistic value, but there is a rampant problem of forgery. Indeed, authentication of traditional calligraphy heavily relies on calligraphers' subjective judgment. Therefore, spurred by the recent development of neural networks, this paper proposes a method for authenticating calligraphy works based on an improved EfficientNet network. Specifically, the developed method utilizes the character box algorithm and the centroid algorithm to extract individual calligraphy characters, which are then augmented and used as the training set for the model. The training process employs CBAM and Self-Attention modules to enhance the attention mechanism of the EfficientNet network. The model is tested on authentic works, imitated works, and works from other calligraphers and is compared with other networks. The experimental results demonstrate that the proposed method effectively achieves the authentication of calligraphy works, and the improved CBAM-EfficientNet network and SA-EfficientNet network achieve better authentication performance.

This review explores the complex interrelationships between emotion, attention, and behavior, drawing upon empirical evidence from psychological, neuroscientific, and clinical studies. It delves into the neural mechanisms that underlie these interactions, with a focus on key brain regions such as the prefrontal cortex and amygdala. Clinical cases involving stroke and attention-deficit/hyperactivity disorder (ADHD) are examined to illustrate the real-world implications of these cognitive interactions. The review also discusses the impact of effective emotion regulation strategies and the role of attention as a cognitive mechanism that influences both emotion and behavior. Neuroimaging studies, particularly functional MRI, are highlighted for their role in providing a deeper understanding of these intricate relationships. The review concludes by emphasizing the importance of this triadic relationship in adaptive functioning and its broader implications for mental health, interpersonal relationships, and quality of life.

The visual span refers to the number of letters readers can identify in a single fixation without using linguistic skills. Proponents of the visual span hypothesis postulate an influence of early visual processing on reading speed. Given the slowness of reading Arabic texts, the present work aims to study the development of the visual span and its effects on reading speed in the Arabic-speaking context. Thirty-four subjects participated in the study. The trigram task and the rapid serial visual presentation (RSVP) paradigm were used to estimate visual span size and reading speed. In line with our initial assumptions, the results showed a significant effect of grade level on reading speed (F(2,31) = 30.93, p<0.001), visual span size (F(2,31) = 20.57, p<0.001). In good alignment with previous work, our results show that visual span size could explain around 40% of the reading speed variability. Interestingly, our analyses revealed a narrowing of visual span size in our Arabic sample. The results of study 2, suggest that the poor performance in the trigram task is due to poor visual attention capacities in our Arabic readers

Abstract: Background: Restless Legs Syndrome /Willis-Ekbom disease (RLS/WED) has occasionally -but not consistently- been associated with cognitive, and most notably, language and executive impairment. The present study was conducted to investigate the cognitive trajectories of older individuals with RLS/WED. Methods: Participants were drawn from the randomly selected, older (>64 years), population-based HELIAD cohort. Individuals without dementia, with available neuropsychological evaluations at baseline and follow-up were considered for potential eligibility. A comprehensive assessment examining five principal components of cognition (memory, visuo-spatial ability, attention, executive function, and language) was administered to the partici-pants. Generalized estimating equations analysis was used to examine the unadjusted and adjusted (for critical factors and covariates) effects of RLS/WED on cognition over time. Results: A total of 1003 predominantly female, older (72.9 ±4.9 years) partici-pants, with follow-up evaluations after a mean of 3.09 ±0.85 years and without demen-tia at baseline and follow-up were included in the present study. Among them, 81 were diagnosed with RLS/WED at baseline. Global cognition, memory, attention, executive and visuo-perceptual skills did not differ between those with and without RLS/WED. However, the RLS/WED group performed worse on language at baseline by 0.249 of a standard deviation, while demonstrating a mitigated language decline over time, by 0.063 of a standard deviation. The unadjusted models yielded similar results. Conclu-sions: Our findings were indicative of a baseline language disadvantage among older individuals with RLS/WED, but the initial discrepancy tends to dissolve over time.

In practical applications, the detection of objects with various sizes is a common requirement for most detectors. The feature pyramid network (FPN) is widely adopted as a framework to address this challenge. The field is witnessing an increasing number of transformer-based target detectors due to the widespread adoption of transformer technology. This paper initially examines the design flaws in FPN and transformer-based target detectors, followed by the introduction of a new transformer-based approach called Texturized Instance Guidance (TIG-DETR) to address these issues. Specifically, TIG-DETR comprises a backbone network, a new pyramidal structure known as Texture-Enhanced FPN (TE-FPN), and an enhanced DETR detector.The TE-FPN is composed of three components: a bottom-up pathway for enhancing texture information in the feature map, a lightweight attention module to address confounding effects resulting from cross-scale fusion, and a standard attention module to enhance the final output features.The improved DETR detector utilizes Shifted Window based Self-Attention to replace the multi-headed self-attention module in DETR, thereby accelerating model convergence. Moreover, it incorporates an Instance Based Advanced Guidance Module to enhance instance perception in the image by employing a pre-local self-attentive mechanism for recognizing larger instances. By employing TE-FPN instead of FPN in Faster RCNN with Resnet-50 as the backbone network, we achieve a 1.9% improvement in average accuracy. TIG-DETR achieves an average accuracy of 44.1 with Resnet-50 as the backbone network.

Abstract: For decades, researchers have suggested the existence of a bilingual cognitive advantage, especially in tasks involving executive functions such as inhibition, shifting, and updating. Recently, an increasing number of studies have questioned whether bilingualism results in change in executive functions, highlighting conflicting data published in the literature. The present study compared the performance of third-, fourth-, and fifth-grade bilingual and monolingual children on attentional and cognitive tasks. Participants were 61 monolingual and 74 bilingual children (M = 114.6 months; SD = 8.48 months) who were tested on two versions of the Attention Network Task (ANT), with and without social stimuli, as well as tests investigating working memory, short-term memory, narrative memory, and receptive vocabulary. Data on families’ socioeconomic status and children’s reasoning abilities were also collected. The results showed that bilingualism and socioeconomic status affected attentional networks in tasks involving social stimuli. In tasks involving non-social stimuli, socioeconomic status only affected the alerting and executive conflict networks. Consistent with the literature, a positive relationship emerged between socioeconomic status and executive control in the context of social stimuli, and a negative relationship emerged between socioeconomic status and the alerting network in the context of non-social stimuli. Interestingly, neither socioeconomic status nor social attentional networks correlated with working memory. Therefore, although more investigations are required, the results suggest that differences in social contexts mainly affect attentional functions.

To realize the diagnosis of compound faults in gearboxes at different speeds, an "end-to-end" intelligent diagnosis method based on a deep neural network is proposed, named efficiency channel attention-capsule network (ECA-CN). First, the process uses a deep convolutional neural network to extract fault features from the collected raw vibration signals, then embeds the efficient channel attention module to filter important fault features, then uses the capsule network to vectorize the feature space information, and finally calculates the correlation between different levels of capsules by the dynamic routing algorithm to achieve accurate gearbox compound fault diagnosis. The effectiveness of the proposed ECA-CN fault diagnosis method was verified by the composite fault dataset of the 2009 PHM Challenge gearbox, with an average accuracy of 99.63% and a standard deviation of 0.22%. In the comparison experiments with the traditional fault diagnosis method, the average accuracy of the ECA-CN method was improved by 4.62%, and the standard deviation was reduced by 0.58%. The experimental results show that ECA-CN has a more competitive diagnostic performance.

In recent years, neural networks based on attention mechanisms have been increasingly widely used in speech recognition, separation, enhancement, and other fields. In particular, the convolution-augmented transformer has achieved good performance as it can combine the advantages of convolution and self-attention. Recently, the gated attention unit (GAU) has been proposed. Compared with the traditional multi-head self-attention, approaches with GAU are effective and computationally efficient. In this article, we propose a network for speech enhancement called CGA-MGAN, a kind of Metric GAN based on convolution-augmented gated attention. CGA-MGAN captures local and global correlations in speech signals at the same time through the fusion of convolution and gated attention units. Experiments on Voice Bank + DEMAND show that the CGA-MGAN we propose achieves an excellent performance (3.47 PESQ, 0.96 STOI, and 11.09dB SSNR) at a relatively small model size (1.14M).

I propose a test for machine self-awareness inspired by the Turing test. My test is simple, and it provides an objective, empirical metric to rectify the ungrounded speculation surging through industry, academia, and social media. Drawing from a breadth of philosophical literature, I argue the test captures the essence of self-awareness, rather than some postulated correlate or ancillary quality. To begin, the concept of self-awareness is clearly demarcated from related concepts like consciousness, agency, and free will. Next, I propose a model called the Nesting Doll of Self-Awareness and discuss its relevance for intelligent beings. Then, the test is presented in its full generality, applicable to any machine system. I show how to apply the test to Large Language Models and conduct experiments on popular open and closed source LLMs, obtaining reproducible results that suggest a lack of self-awareness. The implications of machine self-awareness are discussed in relation to questions about meaning and true understanding. Finally, some next steps are outlined for studying self-awareness in machines.

The present paper reports an exact approach quantifying the electromagnetic contribution to the anomalous magnetic moment occurring in isolated system comprised of non-composite particle carrying elementary electric charge. Essential averaging procedure and regularization of the electromagnetic field potentials necessary when quantifying the electromagnetic self-interactions and when deriving equations of motion without singularities and obeying the conservation laws are thoroughly discussed. The study shows that the dynamics of the considered system is associated to unique classical transcendental equations of motion satisfied by the particle's velocity and the electromagnetic contribution to the anomalous $g$-factor known from the quantum electrodynamics. The equations of motion lead to an exact analytical expression for the anomalous $g$-factor that provides more accurate result than that calculated with the aid of quantum electrodynamics. It matches the experimentally measured value reported in the literature to a one part per trillion. We obtain a_e=0.00115965218000(65) thus reveling the potential of non-perturbative, non-probability methods in predicting the electron's anomalous g-factor.

Background: The adoption of self-care behaviors among patients with arterial hypertension (AH) plays an important role in the management of their health condition. However, a lack of scales assessing self-care is observed. We aimed to develop and validate the Hippocratic hypertension self-care scale. Methods: From a pool of questions derived from a literature review, 18 items were included in the scale and reviewed by a committee of experts. Participants indicate the frequency at which they follow the self-behavior prescribed in each statement on a five-point Likert scale. Data were collected between April 2019 and December 2019. Re-sults: 202 consecutive adult patients with AH were enrolled in the study. The internal consistency of the scale was found to be 0.807, using Cronbach’s alpha coefficient. An exploratory factor analysis identified two do-mains that accounted for 92.94% of the variance of the scale items; however, each sub-scale could not be used as an independent scale. Finally, the test- retest of the scale showed a significant strong correlation (r=0.0095, p<0.001). Conclusion: Our data indicate that the scale is a reliable and valid tool for assessing self-behaviors in patients with AH. Health professionals can use it in their clinical practice to improve the management of patients’ health condition.

: BACKGROUND: The prevalence of smoking among students is a growing concern, particular-ly among medical students. Being associated with stress, competitiveness, and various social in-fluences, smoking can have detrimental effects on self-esteem and self-efficacy and may create a vicious cycle that may contribute to students’ well-being and academic performance out-comes.METHODS: A cross-sectional study on 456 medical students was conducted via an online survey using structured questionnaires on socio-demographic characteristics, smoking habits, nicotine dependence, self-esteem, and self-efficacy. RESULTS: The prevalence of smoking was 31.1% The scores of self-esteem and self-efficacy were positively correlated with smoking habits (W1=0.957, W2=0.975, P<0.05). Students presented rather low smoking addiction with male stu-dents having slightly higher scores than female students on self-esteem and self-efficacy, mili-tary students had higher self-esteem scores than civilians with physical activity having a posi-tive correlation with non-smoking behavior. CONCLUSION: According to our results, self-esteem and self-efficacy were slightly positively correlated with smoking habits. Furthermore, there was no statistically significant association between other social factors and smoking. Our results may develop a theoretical basis for medical students’ psychological variables studying for further implementation of university educational programs and preventive interventions em-powering students towards an overall better quality of life, addressing, among others, smoking behaviors.

Self-enhancement (SE) is often overlooked as a fundamental cognitive ability mediated via the Pre-Frontal Cortex (PFC). Here we present research that establishes the relationship between the PFC, SE, and the potential evolved beneficial mechanisms. Specifically, we believe there is now enough evidence to speculate that SE exists to provide significant benefits and should be considered a normal aspect of the self. Whatever the metabolic or social cost, the upside of SE is great enough that it is a core and fundamental psychological construct. Furthermore, though entirely theoretical, we suggest that a critical reason the PFC has evolved so significantly in Homo sapien is to, in part, sustain SE. We therefore elaborate as to its proximate and ultimate mechanisms.

While the desire to uncover the neural correlates of consciousness has taken numerous directions, self-face recognition has been a constant in attempts to isolate aspects of self-awareness. The neuroimaging revolution of the 1990’s bought about systematic attempts to isolate the underlying neural basis self-face recognition. These studies, including some of the first fMRI (functional Magnetic Resonance Imaging) studies, revealed a right hemisphere bias for self-face recognition in a diverse set of regions including the insula, the Dorsal Frontal Lobe, the Temporal Parietal Junction and Medial Temporal Cortex. Confirmation of these data (which are correlational) was provided by TMS (Transcranial Magnetic Stimulation) and patients in which direct inhibition or ablation of right hemisphere regions leads to a disruption or absence of self-face recognition. These data are consistent with a number of theories including a right hemisphere dominance for self-awareness and/or a right hemisphere specialization for identifying significant social relationships including to oneself.

Fatigue performance and self-repairing activity of asphalt binders are two properties that highly influence the fatigue cracking response of asphalt pavement. There are still numerous gaps of knowledge to fill linked with these two characteristics. For instance, current parameters fail to fully accommodate these two bitumen phenomena. This study aims to propose a new procedure to address this issue utilizing the linear amplitude sweep (LAS) test, LAS with rest period (RP) (LASH) test, and simplified viscoelastic continuum damage (S-VECD) model. This research work used four different types of asphalt binders: neat asphalt (NA), self-healing thermoplastic polyurethane (STPU)-modified bitumen (STPB), self-healing poly (dimethyl siloxane) crosslinked with urea bond (IPA1w)-modified bitumen (IPAB), and styrene–butadiene–styrene (SBS)-modified bitumen (SBSB). Before the testing process, all the materials were subjected to short-term and long-term aging. The new procedure showed a superior capacity to analyze and accommodate all bitumen fatigue performances and self-repairing activities compared to the current method. Another finding proved that asphalt binders with higher self-restoration behavior failed to show better fatigue performance. A breakthrough finding demonstrated that asphalt binder fatigue response augmented when the RP was applied at a higher damage intensity (S) value. STPBs and IPABs reached their highest increments of fatigue response, containing 1.0% of STPU and 0.5% of IPA1w, respectively. Those augmentations were 207.54% and 232.64%, respectively.

We report the development of an extrinsic self-healing coating system that shows no fluorescence from the intact coating, yellowish fluorescence in cracked regions, and greenish fluorescence in healed regions, thus allowing the separate monitoring of cracking and healing of coatings. This fluorescence monitoring self-healing system consisted of a top coating, an epoxy matrix resin containing mixed dye-loaded in single microcapsule. The dye-loaded microcapsules consisted of a poly(urea-formaldehyde) shell encapsulating a healing agent containing MAT-PDMS and styrene, a photo-initiator and a mixture of two dyes, one that fluoresces only in the solid state (DCM) and a second that fluoresces dramatically increased in the solid than solution state (4-TPAE). A mixture of the healing agent, photo-initiator and the two dyes was yellow due to fluorescence from DCM. On UV curing of this mixture, however, the color changed from yellow to green and the fluorescence intensity increased due to fluorescence from 4-TPAE in the solid state. When a self-healing coating embedded with microcapsules containing the DCM/4-TPAE dye mixture was scratched, the damaged region exhibited a yellowish color that changed to green after healing. Thus, the self-healing system reported here allows the separate monitoring of cracking and healing based on changes in fluorescence color.

This study investigated whether positive self-talk (ST) over 4 weeks would improve standing long jump (SLJ) performance in men and women in their 20s. The participants of this study were 36 men and 28 women, selected through interviews with male and female students. The test subjects’ performance was measured 10 times over a 4-week period, 2-3 sessions per week. In the experimental group, participants performed SLJ while reciting positive ST; the control group performed SLJ without any specific conditions. A pre-and post-intervention survey was conducted using the Rosenberg Self-Esteem Scale (RSE). The results revealed a significant difference in the performance of experimental group (p < 0.05), while no significant difference was observed in the control group. RSE survey results also showed a significant difference only in the experimental group (p < 0.05). These findings indicate that self-affirmation yields positive effects on SLJ performance.

Background: The adoption of self-care behaviors among patients with congestive heart failure (CHF) is essential for the management of their health condition. However, there is a lack of tools for estimating self-care in CHF patients. We aim to develop and validate the Hippocratic heart failure self-care scale (HHFSCS). Methods: the scale includes 22 items which are reviewed by a committee of experts. Individuals indicate the frequency at which they follow each self-behavior on a five-point Likert scale. Adult patients with CHF (n=250) from a General Hospital, in Athens, were participated in the study from June 2020 to March 2021. Reliability coefficients and Explanatory Factor Analysis (EFA), using a Varimax rotation and the Principal Components Method were used to assess the psychometric measurements. Results: The Cronbach’s alpha coefficient of the HHFSCS was 0.807. The exploratory factor analysis identified two domains that accounted for 88.44% of the variance of the scale items; however, each sub-scale could not be used as an independent scale. Finally, the test-retest showed a significant strong correlation (r=0.973, p&lt;0.001). Conclusions: The HHFSCS is a reliable and valid tool for assessing self-behaviors in CHF patients. Health professionals can use it in their clinical practice to improve the management of patient’s health conditions.

Online education allows learners to develop knowledge and skills flexibly and conveniently—such observation among students whose characteristics involve student engagement, self-regulation, and self-efficacy. However, studies to characterize Filipino online learners seem lacking. Thus, this study aimed to characterize science education tertiary students in the Philippines concerning their online student engagement (OSE), self-regulated learning (SRL), and online learning self-efficacy (OLSE). The unprecedented events brought by COVID-19 pandemic also urged the implementation of online modalities while there is no available information on students’ online learning profiles. Hence, researchers used a survey research employed through ex post facto approach to determine the effects of the demographic profile on OSE, SRL, and OLSE. The survey was participated by N=373 respondents who answered the questionnaire with informed consent administered via Google Forms. Results revealed that OSE indicators moderately characterized students, while SRL and OLSE indicators are true of them, substantiated by the overall mean M=3.85(SD=0.90), M=3.86(SD=0.92), and M=3.14(SD=0.73), respectively. Also, multivariate tests showed no significant effect among the independent groups (p&gt;0.05), except for gender and OLSE interaction (p&lt;0.05) so, only in OLSE was a significant difference found in gender. In conclusion, Filipino online learners are moderate across aspects of student engagement, self-regulation, and self-efficacy.

Secure attachment, developed through consistent relationships with attachment figures in childhood, is a crucial factor in fostering healthy interpersonal relationships and a positive self-perception. This research aimed to assess how perceived security, as an indicator of secure attachment, predicts adult self-concept through the mediating effects of resilience and positive self-esteem. A quantitative, cross-sectional, and non-probabilistic study was conducted with 383 participants, of whom 76.2% were females, aged between 17 and 86 years (M = 28.52, SD = 12.23). Correlational analyses revealed significant positive associations between perceived security, self-concept, resilience, and positive self-esteem. Path analysis demonstrated that resilience and positive self-esteem sequentially mediate the relationship between perceived security during childhood and adult self-concept (Total Effect R2 = .34, F(1,381) = 193, p < .001; Indirect effect of sequential mediation b = .02, CI 95% [.01, .04]). Findings suggest that the ability to cope with ad-versity and personal acceptance underlie the impact of perceived security on self-concept. It is recommended to promote not only secure attachment in family interventions but also resilience and self-esteem in programs targeting adolescents, youth, and adults.

Purpose: To identify the impact of dealing with COVID-19 patients in clinical areas on nurses' professional self-concept and self-confidence. Background: Professional self-concept is considered a critical factor in the recruitment/retention process in nursing, nursing shortage, career satisfaction, and academic achievements. Professional self-confidence is also a crucial determinant in staff satisfaction, reducing turnover, and increasing work engagement. Design: Descriptive, comparative study. Methods: The study was conducted between February to May 2021 by utilizing a convenience sampling technique. A total of 170 nurses from two facilities were recruited from two COVID-19 and non-COVID-19 designated facilities. The level of professional self-concept and self-confidence was assessed by utilizing the Nurses' Self-Concept Instrument and Self-Confidence Scale. Results: The professional self-concept level among the exposed group to COVID-19 patients was lower than the comparison group, while the professional self-confidence level among the exposed group to COVID-19 patients was similar to the comparison group. On the other hand, the satisfied staff and those who received professional training in dealing with COVID-19 patients reported a higher level of professional self-concept. Conclusions: Dealing with COVID-19 patients has an impact on professional self-concept; the exposure group was lower than those who did not deal with COVID-19 patients, while the professional self-confidence level among the exposed group was similar to the comparison group. Getting professional training in dealing with COVID-19 patients and being satisfied at work were significant factors in improving the professional self-concept. Policymakers should create strategies that target the improvement of professional training in dealing with COVID-19 patients.

Background: Level of perceived competence as a basic psychological need could trigger achievement of diabetes self-management goals. Due to lack of a specific data collection tool to measure level of self-competence among Persian speaking patients with diabetes this study was conducted for cross-cultural adaptation and psychometric assessment of the Persian version of Perceived Competence Scale for Diabetes (PCSD-P). Methods: Standard translation/back-translation procedure was carried out to prepare a preliminary draft of the PCSD-P. Content and face validity of the early draft were checked by an expert panel including 15 scholars in the field of health education and promotion as well as nursing education with experience of working and research on diabetes. The final drafted questionnaire was completed by 177 randomly selected patients with type 2 diabetes. Based on the collected data structural validity of the contrived version was appraised using exploratory and confirmatory factor analysis (EFA, CFA). Cronbach's alpha and Intraclass Correlation coefficients (ICC) were used to check the scale’s reliability and internal consistency. ; (3) Results: The estimated measures of Content Validity Index (CVI= 0.95) and Content Validity Ratio (CVR= 0.8) were in the range of acceptable recommended limits. The EFA analysis results demonstrated a single factor solution according to the items’ loadings for the component. The model fit indices i.e. RMSEA= 0.000, CFI=1, TLI=1, GFI= 0.998, NFI= 0.999 RFI= 0.995 confirmed consistency of the hypothesized one-factor solution. Values of the internal consistency and reliability coefficients were also in the vicinity of acceptable range (α= 0.892, ICC=0. 886, P= 0.001). Conclusions: The study findings revealed good internal validity and applicability of the PCSD-P to measure degree of self-competence among Persian speaking type 2 diabetes patients to manage the chronic disease. Due to unrepresentativeness of the study sample future cross-cultural test of PCSD-P on diverse and broader Persian speaking populations is recommended.

This paper addresses the development of knowledge and assessment-centered learning approaches within a reflective learning framework in a first year physics class in a university faculty. The quality of students’ reflections was scored using a Self-reporting Reflective Learning Appraisal Questionnaire at the end of each learning approach. The results showed the differences between the approaches based on reflections on the learning control through self-knowledge, by connecting experience and knowledge, as well as through self-reflection and self-regulation. Assessment-centered activities fundamentally help students identify aspects of their attitudes towards, as well as regulate, their sustainability learning education.

Detecting small objects in images poses significant challenges due to their limited pixel representation and the difficulty in extracting sufficient features, often leading to missed or false detections. To address these challenges and enhance detection accuracy, this paper presents an improved small object detection algorithm, CRL-YOLOv5. The proposed approach integrates the CBAM attention mechanism into the C3 module of the backbone network, which enhances the localization accuracy of small objects. Additionally, the Receptive Field Block (RFB) module is introduced to expand the model's receptive field, thereby fully leveraging contextual information. Furthermore, the network architecture is restructured to include an additional detection layer specifically for small objects, allowing for deeper feature extraction from shallow layers. When tested on the VisDrone2019 small object dataset, CRL-YOLOv5 achieved an mAP50 of 39.2%, representing a 5.4% improvement over the original YOLOv5, effectively boosting the detection precision for small objects in images.

Brazil is the world leader in pesticide consumption, and its indiscriminate use puts farmers’ health at risk. The CYP2C9 gene stands out for encoding the CYP2C9 enzyme, which metabolizes several endogenous substrates and specific xenobiotics, especially pesticides. Our goal is to study the risk of pesticide use, espe-cially the herbicide glyphosate, in the development of diseases and the association with two CYP2C9 poly-morphisms, in farmers living in the southern region of Espírito Santo state, Brazil. The allelic frequency of CYP2C9*1, CYP2C9*2 and CYP2C9*3 was determined in blood samples from individuals exposed or not to pesticides using real-time PCR. 304 blood samples were analyzed, dividing CYP2C9 genotypes into three metabolization classes: normal, intermediate, and slow. Our results show that normal metabolizers are more vulnerable to diseases such as blood pressure changes and cardiovascular and kidney problems, while in-termediate metabolizers show an association with attention deficit disorder and miscarriages, suggesting that farmers in the studied region developed symptoms correlated to the CYP2C9 genotype they have. This work is pioneering in associating specific genetic variations and health risks with pesticide exposure, em-phasizing the importance of personalized medicine and stricter regulation of pesticide use for public health and occupational safety.

Recently, attention mechanisms have developed into an important tool for performance improvement of deep neural networks. In computer vision, attention mechanisms are generally divided into two main branches: spatial and channel attention. Both attention categories have their own advantages. The fusion of both attentions achieves higher performance, on the cost of the computational load. This paper introduces an innovative and lighter n-shifted sigmoid channel and spatial attention (CSA) module to reduce the computational cost and to improve the 3D scene relevant features selection. To validate the proposed attention module, 3D scene object detection in the deep Hough voting point sets is considered as the testing application. The proposed attention module with its piecewise n-shifted sigmoid activation function improves the network’s learning and generalization capacity which effectively predict bounding box parameters directly from 3D scenes and detect objects more accurately. This advantage is achieved by selectively attending to more relevant features of the input data. When used in the deep Hough voting point sets, the proposed attention module outperforms state-of-the-art 3D detection methods on the sizable SUNRGBD dataset. Experiments conducted showed an increase of 12.02 mean accuracy precision (mAP) when compared to the celebrated VoteNet (without attention). It also got 9.92 mAP higher compared to the MLVCNet, and 10.32 mAP higher than the Point Transformer. The proposed model not only decreases the sigmoid vanishing gradient problem but also brings out valuable features by fusing channel-wise and spatial information while improving accuracy results in 3D object detection.

To address the problems of insufficient semantic fusion between text and questions and the lack of consideration of global semantic information encountered in machine reading comprehension models, we proposed a machine reading comprehension model called BERT_hybrid based on BERT and hybrid attention mechanism. In this model, BERT is utilized to separately map the text and questions into the feature space. Through the integration of Bi-LSTM, attention mechanism, and self-attention mechanism, the proposed model achieves comprehensive semantic fusion between text and questions. The probabilities distribution of answers is computed using Softmax. Experimental results on the public dataset DuReader demonstrate that the proposed model achieves improvements in BLEU-4 and ROUGE-L scores compared to existing models. Furthermore, to validate the effectiveness of the proposed model design, we analyze the factors influencing the model’s performance.

Cracks on concrete surfaces are vital factors affecting construction safety. Accurate and efficient crack detection can prevent safety accidents. Using drones to photograph cracks on a concrete surface and detect them through computer vision technology has the advantages of accurate target recognition, simple practical operation, and low cost. To solve this problem, an improved CenterNet concrete crack-detection model is proposed. First, a channel-space attention mechanism is added to the original model to enhance the ability of the convolution neural network to pay attention to the image. Second, a feature selection module is introduced to scale the feature map in the downsampling stage to a uniform size and combine it in the channel dimension. In the upsampling stage, the feature selection module adaptively selects the combined features and fuses them with the output features of the upsampling. Finally, the target size loss is optimised from a Smooth L1 Loss to IoU Loss to improve its inability to adapt to targets of different sizes. The experimental results show that the improved CenterNet model reduces the FPS by 123.7, increases the GPU memory by 62MB, increases the FLOPs by 3.81, and increases the AP by 0.154 compared with the original model. The GPU memory occupancy remained stable during the training process and exhibited good real-time performance and robustness.

Clinical screening tests for balance and mobility often fall short of predicting fall risk. Cognitive distractors and unpredictable external stimuli, common in busy natural environments, contrib-ute to this risk, especially in the elderly. Less is known about the effects of upper sensory-motor coordination such as coordinating one’s hand with an external stimulus. We combined move-ment sonification and affordable inertial motion sensors to develop a task for the precise meas-urement and manipulation of full-body interaction with stimuli in the environment. In a double-task design, we studied how a supra-postural activity affected quiet stance. The supra-postural task consisted of rhythmic synchronization with a repetitive auditory stimulus. The stimulus was attentionally demanding because it was being modulated continuously. The participant’s hand movement was sonified in real-time, and their goal was to synchronize their hand move-ment with the stimulus. In the unpredictable condition, the tempo changed at random points in the trial. A separate sensor recorded postural fluctuations. Young healthy adults were compared to elderly participants without known risk of falling. Results supported the hypothesis that su-pra-postural coordination would entrain postural control. The effect was stronger in the elderly, supporting the idea that diminished reserve capacities reduce the ability to isolate postural con-trol from sensory-motor and cognitive activity.

One of the most leading causes of death worldwide is Colorectal cancer(CRC). Polyp segmentation is the most important detected measure for preventing CRC. However, there is still a missing rate for diminutive polyps and multiple ones. In order to solve the phenomenon, we propose to introduce auxiliary attention module(AAM) that can enhance the learning of features related to multiple and diminutive polyps by focusing more on the located and detailed information. Meanwhile, we design to decrease missed rate of multiple and diminutive polyps by implementing an area adaptive loss(AAL) which adapts the weight according to the area and the number of polyps. Our proposed novel AAM and AAL concentrates on training with hard examples and localized information. To evaluate the effectiveness and generalization ability of our proposed model, We utilize three different datasets of variable sizes and a cross dataset. Our proposed method achieves the best results on the Kvasir-SEG dataset, the CVC-ClinicDB dataset and the cross dataset, particularly for the Kvasir-Sessile dataset consisting of small,flat and diminutive polyps. Extensive experimental results show that our proposed DoubleAANet surpass the performance of all existing state-of-the-art segmentation methods.

Vehicle re-identification research under surveillance cameras has yielded impressive results. However, the challenge of Unmanned Aerial Vehicle (UAV)-based vehicle re-identification (ReID) presents a high degree of flexibility, mainly due to complicated shooting angles, occlusions, low discrimination of top-down features, and significant changes in vehicle scales. To address this, we propose a novel Dual Mixing Attention Network (DMANet) to extract discriminative features robust to variations in viewpoint. Specifically, we first present a plug-and-play Dual Mixing Attention Module (DMAM) to capture pixel-level pairwise relationships and channel dependencies, where DMAM is composed of Spatial Mixing Attention (SMA) and Channel Mixing Attention (CMA). First, the original feature is divided according to the dimensions of spatial and channel to obtain multiple subspaces. Then, a learnable weight is applied to capture the dependencies between local features in the mixture space. Finally, the features extracted from all subspaces are aggregated to promote their comprehensive feature interaction. Moreover, the DMAM can be readily inserted into backbone networks at any depth to improve vehicle discrimination. The experiments show that the proposed structure gains a better performance compared with the representative methods in the UAV-based vehicle ReID task. Our code and models will be publicly released.

Nowadays people express their opinions on social media. Also provides product reviews on eCommerce websites and responds to various news as comments. It is necessary to know the polarity and aspect of various posts and comments for business, education and security. Aspect-based sentiment analysis (ABSA) predicts text category and polarity. In this paper, we proposed a deep learning framework Deep-ABSA for aspect-based sentiment analysis from Bangla texts. Our proposed framework is a multi-channel architecture. We implemented the word embedding, Bi-LSTM with the attention mechanism for one channel. And for another channel, we adopted the character-embedded convolutional neural network. Finally, we concatenated both channels for adjoining the features of each channel. We obtained an adequate performance from our proposed framework for aspect term analysis from Bangla sentences.

The Attentional Networks Test for Interactions and Vigilance–executive and arousal components (ANTI-Vea) is a computerized task of 32 min duration in the standard format. The task simultaneously assesses the main effects and interactions of the three attentional networks (i.e., phasic alertness, orienting, and executive control) and two dissociated components of vigilance with reasonable reliability (executive and arousal vigilance). We present this free and publicly accessible resource (ANTI-Vea-UGR; https://anti-vea.ugr.es/) developed to easily run, collect, and analyze data with the ANTI-Vea (or its subtasks measuring some attentional and/or vigilance components embedded in the ANTI-Vea). Available in six different languages, the platform allows for adaptation of stimuli timing and procedure to facilitate data collection from different populations (e.g., clinical patients, children). Collected data can be freely downloaded and easily analyzed with the provided scripts and tools, including a Shiny app. We discuss previous evidence supporting that attention and vigilance components can be assessed in typical lab conditions as well as online and outside the laboratory. We hope this tutorial will help researchers interested in measuring attention and vigilance with a tool useful to collect data from large sample sizes and easy to use in applied contexts.

Aiming at the problems that the parameters of YOLOv5s model are too large and the computing resources of development board memory are limited, a new target detection method based on deep learning YOLOv5 algorithm model is proposed. First, the light-weight module Gz-ShffleNetv2 is used to construct cotton top bud feature extraction unit, which reduces the number of parameters and improves the running speed. It can be better applied in image classification, speed up detection and meet the requirements of mobile end of development board. Secondly, in order to solve the problem of decreasing detection accuracy caused by lightweight, BotNet and C3SE attention mechanism are added to focus on specific areas of cotton terminal bud. Combined with YYG loss function XIOU boundary frame regression loss, more feature information and rich feature MAP were obtained to further improve the accuracy of target detection. Through analysis of research and experimental results, the average accuracy map reached 91.3% under the Windos system NVIDIA Geforce RTX 2060 SUPER detection. While maintaining high precision identification, the number of parameters of YOLOv6 and YOLOv7-tiny network model is reduced by 83% and 53%, respectively, and the detection accuracy is increased by 1.2% and 7.7%, respectively. Compared with YOLOv5 reasoning image, the speed of image is increased by 0.035s, and the detection accuracy of MAP_0.5:0.95 is increased by 1%. At the same time, PyQt5 and YOLOv5 target detection algorithms are used to design a cotton top bud identification system, which makes cotton top bud detection more intuitive and convenient for subsequent hardware development and use.

Land cover mapping provides spatial information on the physical properties of the Earth’s surface, for various classes of wetlands, artificial surface and constructions, vineyards, water bodies, etc. Having reliable information on land cover is crucial to developing solutions to a variety of environmental problems such as destruction of important wetlands/forests, and loss of fish and wildlife habitats. This has made land cover mapping one of the most widespread application areas in remote sensing computational imaging. However, due to the differences between modalities in terms of resolutions, content, and sensors, integrating complementary information that multi-modal remote sensing imagery exhibits into a robust and accurate system still remains challenging, and classical segmentation approaches generally do not give satisfactory results for land cover mapping. In this paper, we propose a novel dynamic deep network architecture, AMM-FuseNet, that promotes the use of multi-modal remote sensing images for the purpose of land cover mapping. The proposed network exploits the hybrid approach of the Channel Attention mechanism and Densely Connected Atrous Spatial Pyramid Pooling (DenseASPP). In the experimental analysis, in order to to verify the validity of the proposed method, we test AMM-FuseNet applied to four datasets whilst comparing it to the 6 state-of-the-art models of DeepLabV3+, PSPNet, UNet, SegNet, DenseASPP, and DANet. In addition, we also demonstrate the capability of AMM-FuseNet under minimal training supervision (reduced number of training samples) compared to the state-of-the-art, achieving less accuracy loss even for the case with 1/20 of the training samples.

Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved super-resolution model which involves the self-attention augmented WGAN is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the HR results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we therefore design a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features, this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.