Epilepsy is a neurological disorder that affects approximately 1% of the world's population. To diagnose and estimate the occurrence of epilepsy, the analysis of recorded brain activity is performed by a neurologist, which is not only time-consuming and tedious but also occasionally accompanied by human error. Therefore, in recent decades, researchers have aimed to unravel an approach for designing and building an automated method for diagnosing and estimating the occurrence of epilepsy. Accordingly, the present study proposed two new-fangled ways based on brain signals and a convolutional neural network (CNN). Moreover, this research implements a CNN with a sequential three-layer structure. Numerous experiments were performed, and the accuracy of estimating epilepsy using the developed methods was achieved at 95% without feedback and 97% with feedback. The proposed methods were proven to be more accurate than the previous techniques and can be employed as a physician's assistant once entering the field of operation.

In this paper, we propose an imagined speech-based brain wave pattern recognition using deep learning. Multiple features were extracted concurrently from eight-channel Electroencephalography (EEG) signals. To obtain classifiable EEG data with fewer number of sensors, we placed the EEG sensors on carefully selected spots on the scalp. To decrease the dimensions and complexity of the EEG dataset and to avoid overfitting during the deep learning algorithm, we utilized the wavelet scattering transformation. A low-cost 8-channel EEG headset was used with MATLAB 2023a to acquire the EEG data. The Long-Short Term Memory Recurrent Neural Network (LSTM-RNN) was used to decode the identified EEG signals into four audio commands: Up, Down, Left, and Right. Wavelet scattering transformation was applied to extract the most stable features by passing the EEG dataset through a series of filtration processes. Filtration has been implemented for each individual command in the EEG datasets. The proposed imagined speech-based brain wave pattern recognition approach achieved a 92.50% overall classification accuracy. This accuracy is promising for designing a trustworthy imagined speech-based Brain-Computer Interface (BCI) future real-time systems. For better evaluation of the classification performance, other metrics were considered, and we obtained 92.74%, 92.50% and 92.62% for precision, recall, and F1-score, respectively.

Objective A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data. Approach PyCharm, a Python platform, will be used to house and process the CNN. The raw data used for the training of the CNN will be sourced from the PhysioBank website. The EEG signal data will then be pre-processed using Brainstorm software that is a toolbox used in conjunction with MATLAB. The sample data used to validate and test the trained CNN, will be also be extracted from Brainstorm but in a much smaller size compared to the training data which is comprised of thousands of images. The sample size would be comparable to a person wearing a Brain Computer Interface (BCI), offering approximately 20 seconds of motor imagery signal data. Results The raw EEG data was successfully extracted and pre-processed. The deep learning model was trained using the extracted image data along with their corresponding labels. After training, it was able to accurately identify the T1 class label at 100 percent. The python coding was then modified to restore the trained model and feed it test sample data in which it was found to recognise 6 out of 10 lines of T1 signal image data. The result suggested that the initial training of the model required a different, more varying approach, so that it would be able to detect varying sample signal image data. The outcome of which could mean that the model could be used in applications for multiple patients wearing the same BCI hardware to control a device or interface.

Non-invasive, electroencephalography (EEG)-based brain-computer interfaces (BCIs) on motor imagery movements translate the subject’s motor intention into control signals through classifying the EEG patterns caused by different imagination tasks, e.g. hand movements. This type of BCI has been widely studied and used as an alternative mode of communication and environmental control for disabled patients, such as those suffering from a brainstem stroke or a spinal cord injury (SCI). Notwithstanding the success of traditional machine learning methods in classifying EEG signals, these methods still rely on hand-crafted features. The extraction of such features is a difficult task due to the high non-stationarity of EEG signals, which is a major cause for the stagnating progress in classification performance. Remarkable advances in deep learning methods allow end-to-end learning without any feature engineering, which could benefit BCI motor imagery applications. We developed three deep learning models: 1) a long short-term memory (LSTM); 2) a proposed spectrogram-based convolutional neural network model (pCNN); and 3) a recurrent convolutional neural network (RCNN), for decoding motor imagery movements directly from raw EEG signals without (manual) feature engineering. Results were evaluated on our own, publicly available, EEG data collected from 20 subjects and on an existing dataset known as 2b EEG dataset from "BCI Competition IV". Overall, better classification performance was achieved with deep learning models compared to state-of-the art machine learning techniques, which could chart a route ahead for developing new robust techniques for EEG signal decoding. We underpin this point by demonstrating the successful real-time control of a robotic arm using our CNN based BCI.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

Functional connectivity (FC) is a potential candidate that can increase the performance of brain-computer interfaces (BCIs) in the elderly because of its compensatory role in neural circuits. However, it is difficult to decode FC by current machine learning techniques because of a lack of its physiological understanding. To investigate the suitability of FC in BCI for the elderly, we propose the decoding of lower- and higher-order FCs using a convolutional neural network (CNN) in six cognitive-motor tasks. The layer-wise relevance propagation (LRP) method describes how age-related changes in FCs impact BCI applications for the elderly compared to younger adults. Seventeen younger (24.5±2.7 years) and twelve older (72.5±3.2 years) adults were recruited to perform tasks related to hand-force control with or without mental calculation. CNN yielded a six-class classification accuracy of 75.3% in the elderly, exceeding the 70.7% accuracy for the younger adults. In the elderly, the proposed method increases the classification accuracy by 88.3% compared to the filter-bank common spatial pattern (FBCSP). LRP results revealed that both lower- and higher-order FCs were dominantly overactivated in the prefrontal lobe depending on task type. These findings suggest a promising application of multi-order FC with deep learning on BCI systems for the elderly.

Skin cancer is one of the widespread diseases that typically develop on the skin due to continuous exposure to sunlight. Although cancer can appear on any part of the human body, skin cancer reports account for over half of all cancer occurrences worldwide. There are substantial obstacles to the precise diagnosis and classification of skin lesions because of the morphological variety and indistinguishable characteristics across skin malignancies. Recently, Deep Learning models have been used in the field of image-based lesion diagnosis, and it has demonstrated diagnostic efficiency on par with that of dermatologists. To increase classification efficiency and accuracy for skin lesions, a cutting-edge multi-layer deep Convolutional Neural Network (CNN) termed SkinLesNet has been built in this study. The ResNetV50 and VGG16 models have been carefully compared to review the performance of the proposed model. The dataset used in this study, PAD-UFES-20, contains 1314 samples in total and includes three common forms of skin lesions. The proposed approach, SkinLesNet, significantly outperforms the well-known compared models in the given conditions

To solve two key problems in the identification of people who are infected with COVID-19: the first problem is that the identification accuracy is not high enough. The second problem is that present identification method such as nucleic acid testing is expensive in many countries. Methods: So, I decided to design a fast identification method for COVID-19 patients which is based on deep learning. After the model (CoughNet) learns more than 6,000 cough spectrograms of both COVID-19 patients and normal people, the accuracy rate of identification of COVID-19 patients and normal people is higher than 99% in the test set. Structure: This paper is mainly divided into three parts: the first part introduces the main background and research status of the research; The second part introduces the research methods; The third part introduces the specific process of the experiment.

A brain-computer interface for controlling elements commonly used at home is presented in this paper. It includes the electroencephalography device needed to acquire signals associated to the brain activity, the algorithms for artefact reduction and event classification, and the communication protocol.

Deepfakes are manipulated or altered images, or video, that are created using deep learning models with high levels of photorealism. The two popular methods of producing a deepfake are based on either convolutional neural networks (CNN), or autoencoders. Deepfakes created using CNN comparatively show higher qualities of realism, yet oftentimes leave artifacts and distortions in the generated media that can be detected using machine learning and deep learning algorithms. In recent years, there has been an influx of periocular image and video data because of the increase usage of face masks. By wearing masks, much of what is used for facial recognition is hidden, leaving only the periocular region visible to an observer. This loss of vital information leads to easier misidentification of media, allowing deepfakes to less likely be identified as fake. In this work, feature extraction methods, such as Scale-Invariant Feature Transform (SIFT), Histogram of Oriented Gradients (HOG), and CNN, are used to train an ensemble deep learning model to detect deepfakes in videos on a frame-by-frame level based on the periocular region. Our proposed model is able to distinguish original and manipulated images with accuracies around 98.9 percent, which is an improvement to previous works by combining SIFT and HOG for deepfake detection in convolutional neural networks.

A scalable optical convolutional neural network (SOCNN) based on free-space optics and Koehler illumination was proposed to address the limitations of the previous 4f correlator system. Unlike Abbe illumination, Koehler illumination provides more uniform illumination and reduces crosstalk. SOCNN allows for scaling up of the input array and the use of incoherent light sources. Hence, the problems associated with 4f correlator systems can be avoided. We analyzed the limitations in scaling the kernel size and parallel throughput and found that SOCNN can offer a multilayer convolutional neural network with massive optical parallelism.

Objective: Design and validate a wireless, low-cost, easy-to-use, mobile, dry-electrode headset for scalp electroencephalography (EEG) recordings for closed-loop brain-computer (BCI) interface and internet-of-things (IoT) applications. Approach: The EEG-based BCI headset was designed from commercial off-the-shelf (COTS) components using a multi-pronged approach that balanced interoperability, cost, portability, usability, form factor, reliability, and closed-loop operation. Main Results: The adjustable headset was designed to accommodate 90\% of the population. A patent-pending self-positioning dry electrode bracket allowed for vertical self-positioning while parting the user's hair to ensure contact of the electrode with the scalp. In the current prototype, five EEG electrodes were incorporated in the electrode bracket spanning the sensorimotor cortices bilaterally, and three skin sensors were included to measure eye movement and blinks. An accelerometer provides monitoring of head movements. The EEG amplifier operates with 24 bits resolution up to 500 Hz sampling frequency, and can communicate with other devices using 802.11 {b/g/n/WiFi}. It has high SNR and CMRR (121 dB and 110 dB, respectively), and low input noise. In closed-loop BCI mode, the system can operate at 40 Hz, including real-time adaptive noise cancellation and 512 MB of processor memory. It supports LabVIEW as backend coding language and JS, CSS, HTML as front-end coding languages, and includes training and optimization of Support Vector Machine (SVM) neural classifiers. Extensive bench testing supports the technical specifications and human subject pilot testing of a closed-loop BCI application to support upper-limb rehabilitation provides proof-of-concept validation for device use at both the clinic and at home. Significance: The low-cost, accessibility, usability, interoperability, and programmability of the proposed closed-loop BCI system provides a low-cost solution for BCI and neurorehabilitation research and IoT applications.

In the last decades, the automatic recognition and interpretation of brain waves acquired by electroencephalographic (EEG) technologies have undergone remarkable growth, leading to a consequent rapid development of Brain Computer Interfaces (BCIs). EEG-based BCIs are non-invasive systems that allow communication between a human being and an external device interpreting brain activity directly. Thanks to the advances in neurotechnologies, and especially in the field of wearable devices, BCIs are now also employed outside medical and clinical applications. Within this context, this paper proposes a systematic review of EEG-based BCIs, focusing on one of the most promising paradigms based on Motor Imagery (MI) and limiting the analysis to applications that adopt wearable devices. This review aims to evaluate the maturity levels of these systems, both from the technological and computational points of view. The selection of papers has been performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), leading to 84 publications considered in the last ten years (from 2012 to 2022). Besides technological and computational aspects, this review also aims at systematically list experimental paradigms and available datasets in order to identify benchmarks and guidelines for the development of new applications and computational models.

Motor imagery(MI)-based Brain-Computer Interfaces (BCI) have shown increased potential for the rehabilitation of stroke patients; nonetheless, their implementation in clinical practice has been restricted due to their low accuracy performance. To date, although a lot of research has been made in benchmarking and highlighting the most valuable classification algorithms in BCI configurations, most of them are using offline data and not from real BCI performance during the closed-loop (or online) sessions. Since rehabilitation training relies on the availability of an accurate feedback system, we surveyed articles of current and past EEG-based BCI frameworks who report the online classification of the movement of two upper limbs in both healthy volunteers and stroke patients. We found that the recently developed Deep Learning methods do not outperform the traditional machine learning algorithms. In addition, patients and healthy subjects exhibit similar classification accuracy in current BCI configurations. Lastly, in terms of neurofeedback modality, Functional Electrical Stimulation (FES) yielded the best performance compared to non-FES systems.

One of the critical tools for early detection and subsequent evaluation of the incidence of lung diseases is chest radiography. This study presents a real-world implementation of a convolutional neural network (CNN) based Carebot Covid app to detect COVID-19 from chest X-ray (CXR) images. Our proposed model takes the form of a simple and intuitive application. Used CNN can be deployed as a STOW-RS prediction endpoint for direct implementation into DICOM viewers. The results of this study show that the deep learning model based on DenseNet and ResNet architecture can detect SARS-CoV-2 from CXR images with precision of 0.981, recall of 0.962 and AP of 0.993.

Deep learning has shown remarkable results in every field, especially in the biomedical field, due to its ability to exploit large-scale datasets. A convolutional neural network (CNN) is a widely used deep learning approach to solve medical imaging problems. Over the past few years, many studies have focused on CNN-based techniques for brain tumor diagnosis. There are, however, still some critical challenges that CNNs face towards clinic application. This study presents a comprehensive review of current literature that involves CNN architectures for brain tumor classification. We compare the key achievements in the performance evaluation metrics of the applied classification algorithms. In addition, this review assesses the clinical effectiveness of the included studies to elaborate on the limitations and directions of this area for future work. No review focusing on the clinical effectiveness of previous works in this field has been published. We believe that this study has the potential to elevate the application of CNN-based deep learning methods in clinical practice and also can be a quick reference for biomedical researchers who are interested in this field.

Intracortical microelectrodes that can be implanted have the ability to capture fast-changing neuron action potentials in the living brain. Despite this potential, many obstacles must still be overcome for reliable, long-term, high-quality recordings and accurate analysis of brain activity. These challenges include improving recording quality, enhancing recording stability, increasing recording capacity, and adding multi-functional features. One potential approach to enhance implantable microelectrodes involves the advancement of materials, refinement of implantation methodologies, and augmentation of the number of sites for recording. However, these challenges are still being actively researched, and advancements in microelectrode technology are underway. The difficulties with implantable microelectrodes are evaluated, and solutions are presented from different perspectives. The latest advancements in microelectrode technology are reviewed and condensed, and future possibilities are explored.

Vibration measurement serves as the basis for various engineering practices such as natural frequency or resonant frequency estimation. As image acquisition devices become cheaper and faster, vibration measurement and frequency estimation through image sequence analysis continue to receive increasing attention. In the conventional photogrammetry and optical methods of frequency measurement, vibration signals are first extracted before implementing the vibration frequency analysis algorithm. In this work, we demonstrated that frequency prediction can be achieved using a single feed-forward convolutional neural network. The proposed method is verified using a vibration signal generator and excitation system, and the result obtained was compared with that of an industrial contact vibrometer in a real application. Our experimental results demonstrate that the proposed method can achieve acceptable prediction accuracy even in unfavorable field conditions.

Recent progress in microfabrication technique allowed the rapid development of neural implants. They are getting categorized as effective tools for clinical practice, especially to treat traumatic and neurodegenerative disorders. Microelectrode arrays already have been used in numerous neural interface devices. Basically, almost all neural implants have been developed based on BCI (Brain Computer Interface) system. When BCI system falls under invasive technique, it is referred as BMI or Brain Machine Interface. BMIs hold promises for neurorehabilitation of motor and sensory function, cognitive state evaluation and treatment of neurological chaos. A directed overview of the field of neural implants is discussed in this article. The aim of this review is to give a brief introduction of neural prosthetics as well as their exciting applications in treating neurological disorders and a deep discussion on their functionality are mentioned. BCI system and their different types, their functionality, their pros and cons, how other neural implants developed, and their present status have been covered. Different possibilities and possible future of deep brain stimulation (DBS), Neuralink, motor and sensory neural prosthetics are further discussed.

In the realm of computer vision, semantic segmentation is the task of recognizing objects in images at the pixel level. This is done by performing a classification of each pixel. The task is complex and requires sophisticated skills and knowledge about the context to identify objects’ boundaries. The importance of semantic segmentation in many domains is undisputed. In medical diagnostics, it simplifies the early detection of pathologies, thus mitigating the possible consequences. In this work, we provide a review of the literature on deep ensemble learning models for polyp segmentation and we develop new ensembles based on convolutional neural networks and transformers. The development of an effective ensemble entails ensuring diversity between its components. To this end, we combine different models (HarDNet-MSEG, Polyp-PVT, and HSNet) trained with different data augmentation techniques, optimization methods, and learning rates, which we experimentally demonstrate to be useful to form a better ensemble. Most importantly, we introduce a new method to obtain the segmentation mask which is more suitable for combining transformers in an ensemble. In our extensive experimental evaluation, the proposed ensembles exhibit state-of-the-art performance.

Medical brain image analysis is a necessary step in the Computers Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 documents we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and proposal of new models of deep learning to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with indicators (Dice Score, DSC: 0.99) were found, however with little practical application due to the uses of small datasets and lack of reproducibility. Therefore, the main conclusion is to establish multidisciplinary research groups to overcome the gap between CAD developments and their complete utilization in the clinical environment.

This paper proposes several LabVIEW applications to accomplish the data acquisition, processing, features extraction and real-time classification of the electroencephalographic (EEG) signal detected by the embedded sensor of the NeuroSky Mindwave Mobile headset. The LabVIEW applications are aimed at the implementation of a Brain-Computer Interface system, which is necessary to people with neuromotor disabilities. It is analyzed a novel approach regarding the preparation and automatic generation of the EEG dataset by identifying the most relevant multiple mixtures between selected EEG rhythms (both time and frequency domains of raw signal, delta, theta, alpha, beta, gamma) and extracted statistical features (mean, median, standard deviation, route mean square, Kurtosis coefficient and others). The acquired raw EEG signal is processed and segmented into temporal sequences corresponding to the detection of the multiple voluntary eye-blinks EEG patterns. The main LabVIEW application accomplished the optimal real-time artificial neural networks techniques for the classification of the EEG temporal sequences corresponding to the four states: 0 - No Eye-Blink Detected; 1 - One Eye-Blink Detected; 2 – Two Eye-Blinks Detected and 3 – Three Eye-Blinks Detected. Nevertheless, the application can be used to classify other EEG patterns corresponding to different cognitive tasks, since the whole functionality and working principle could estimate the labels associated with various classes.

In this paper, we leverage state of the art models on Imagenet data-sets. We use the pre-trained model and learned weighs to extract the feature from the Dog breeds identification data-set. Afterwards, we applied fine-tuning and dataaugmentation to increase the performance of our test accuracy in classification of dog breeds datasets. The performance of the proposed approaches are compared with the state of the art models of Image-Net datasets such as ResNet-50, DenseNet-121, DenseNet-169 and GoogleNet. we achieved 89.66% , 85.37% 84.01% and 82.08% test accuracy respectively which shows the superior performance of proposed method to the previous works on Stanford dog breeds datasets.

A single paragraph of about 200 words maximum. Electroencephalography (EEG) accumulates the electrical activities of human brain. It is an easy and cost effective tool to characterize motor imagery (MI) task used in brain computer interface (BCI) implementation. The MI task is represented by short time trial of multichannel EEG. In this paper, the raw EEG is decomposed into a finite set of narrowband signals obtained from individual EEG channels using Fourier transformation based bandpass filter. Each of the subband signals represents narrowband rhythmic components which characterize the brain activities related to motor imagery. The subband signals are arranged to extent the dimension of EEG trial in spatial domain. The spatial features are extracted from the set of extended trials using common spatial pattern (CSP). An optimum number of features are used to classify the motor imagery tasks represented by EEG trials. Artificial neural network is used to classify MI tasks. The performance of the proposed method is evaluated using two publicly available benchmark datasets. The experimental results show that it performs better than the recently developed algorithms.

Mental stress state recognition using electroencephalogram (EEG) signals for real-life applications needs a conventional wearable device. This requires an efficient number of EEG channels and an optimal feature set. The main objective of the study is to identify an optimal feature subset that can best discriminate mental stress states while enhancing the overall performance. Thus, multi-domain feature extraction methods were employed, namely, time domain, frequency domain, time-frequency domain, and network connectivity features, to form a large feature vector space. To avoid the computational complexity of high dimensional space, a hybrid feature selection (FS) method of minimum Redundancy Maximum Relevance with Particle Swarm Optimization and Support Vector Machine (mRMR-PSO-SVM) is proposed to remove noise, redundant, and irrelevant features and keep the optimal feature subset. The performance of the proposed method is evaluated and verified using four datasets, namely EDMSS, DEAP, SEED, and EDPMSC. To further consolidate, the effectiveness of the proposed method is compared with that of the state-of-the-art heuristic methods. The proposed model has significantly reduced the features vector space by an average of 70% in comparison to the state-of-the-art methods while significantly increasing overall detection performance.

The use of Attitude and Heading Reference Systems (AHRS) for orientation estimation is now common practice in a wide range of applications, e.g., robotics and human motion tracking, aerial vehicles and aerospace, gaming and virtual reality, indoor pedestrian navigation and maritime navigation. The integration of the high-rate measurements can provide very accurate estimates, but these can suffer from errors accumulation due to the sensors drift over longer time scales. To overcome this issue, inertial sensors are typically combined with additional sensors and techniques. As an example, camera-based solutions have drawn a large attention by the community, thanks to their low-costs and easy hardware setup; moreover, impressive results have been demonstrated in the context of Deep Learning. This work presents the preliminary results obtained by DOES , a supportive Deep Learning method specifically designed for maritime navigation, which aims at improving the roll and pitch estimations obtained by common AHRS. DOES recovers these estimations through the analysis of the frames acquired by a low-cost camera pointing the horizon at sea. The training has been performed on the novel ROPIS dataset, presented in the context of this work, acquired using the FrameWO application developed for the scope. Promising results encourage to test other network backbones and to further expand the dataset, improving the accuracy of the results and the range of applications of the method.

This article presents a study on brain tumor detection using the VGG-16 model, a convolutional neural network known for its performance in computer vision tasks. The aim of the study is to classify magnetic resonance imaging (MRI) images and accurately identify the presence of brain tumors. The dataset used consists of brain tumor MRI images, categorized into two classes: "NO" (no tumor) and "YES" (tumor). The methodology involves setting up the environment, importing and preprocessing the data, building the VGG-16 model, and evaluating its performance using metrics such as accuracy, precision, and recall. The results demonstrate an accuracy of approximately 88% on the validation set and 80% on the test set, indicating the potential of the VGG-16 model in supporting healthcare professionals in diagnosing brain tumors. The study contributes to the field of medical image analysis and offers insights into the application of deep learning for brain tumor detection.

Abstract: In recent years, low frequency (LF) electroencephalogram (EEG) signals have been decoded to obtain kinematic trajectories with the aim of achieving closed loop natural control. However, decoded trajectories suffer variability and low correlation against the measured movement. This paper suggests that if EEG features of motor intents are directly associated with fixed points along a given range of motion, then the natural kinematic parameters can be quantified. A novel classification method is proposed to evaluate this hypothesis along with equations for obtaining the movement parameters (velocity, acceleration). Furthermore, this implies that the force of an end-effector and work done in moving the end-effector may be computed, leading to natural control of EEG-based robotic arms and neuroprostheses. Finally, expectations are that combining the proposed method with existing classification methods will increase the accuracy and scalability of brain-computer interface (BCI) applications.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

Early detection of breast cancer, one of the most common cancers in women worldwide, raises survival rates and lowers the cost of treatment. Although breast cancer detection and classification (CAD) tools have improved, some issues and restrictions still require further research. The creation of breast cancer CAD systems, particularly with deep learning models, was significantly impacted by recent advancements in machine learning and image processing techniques. The current deep learning-based CAD system to identify and categorize masses in mammography is presented in a structured manner in this survey. The survey provides the most popular breast cancer CAD system evaluation metrics, publicly available mammographic datasets, and current image modalities. The survey examines the available literature, emphasizing its strengths and limitations. The survey also emphasizes the difficulties and drawbacks of the current methods for classifying and detecting breast cancer. We point out research gaps and make suggestions for further study. This systematic review may be beneficial for clinicians using CAD systems to diagnose breast cancer early on and for researchers looking for knowledge gaps and making more contributions to the field.

Extensive growth in the volume of irregular brain cells is known as brain tumor. Human brain is surrounded by stiff skull. There are various issues that occur due to the growth of any tumor inside this restricted space. The malignant and benign are two main categories of the brain tumor. The skull is pressurized to enlarge from inside in case of growth of any benign or malignant tumor. This tumor leads to harm in brain and it may be dangerous to life also. The brain tumor is divided into two kinds - primary or secondary. The brain tumor detection techniques have various phases. In this paper, comparative study of CNN with GLCM approach and superpixel based spectral clustering is done tumor. This work takes into account metrics like accuracy, sensitivity and specificity for drawing the comparison between both the techniques.

Computer vision methods have shown to be effective in classifying garbage into recycling categories for waste processing, existing methods are costly, imprecise, and unclear. To tackle this issue, we introduce MWaste, a mobile application that uses computer vision and deep learning techniques to classify waste materials as trash, plastic, paper, metal, glass or cardboard. Its effectiveness was tested on various neural network architectures and real world images, achieving an average precision of 92% on the test set. This app can help combat climate change by enabling efficient waste processing and reducing the generation of greenhouse gases caused by incorrect waste disposal.

As a relatively high percentage of adenoma polyps are missed, a computer-aided diagnosis (CAD) tool based on deep learning can aid the endoscopist in diagnosing colorectal polyps or colorectal cancer in order to decrease polyps missing rate and prevent colorectal cancer mortality. Convolutional Neural Network (CNN) is a deep learning method and has achieved better results in detecting and segmenting specific objects in images in the last decade than conventional models such as regression, support vector machines or artificial neural networks. In recent years, based on the studies in medical imaging criteria, CNN models have acquired promising results in detecting masses and lesions in various body organs, including colorectal polyps. In this review, the structure and architecture of CNN models and how colonoscopy images are processed as input and converted to the output are explained in detail. In most primary studies conducted in the colorectal polyp detection and classification field, the CNN model has been regarded as a black box since the calculations performed at different layers in the model training process have not been clarified precisely. Furthermore, I discuss the differences between the CNN and conventional models, inspect how to train the CNN model for diagnosing colorectal polyps or cancer, and evaluate model performance after the training process.

The purpose of this study is to ​​explore the use of a custom Transformer model in brain-computer interfaces (BCIs) that translate the neural activity present when an individual with limited verbal and fine-motor skills attempts to handwrite. As found in previous studies, Transformers have performed better than recurrent neural networks (RNNs) in translation tasks which are similar to its usage here in decoding neural signals into intended handwritten text. Due to the known benefits of a Transformer, the hypothesis was that the Transformer would show promise in the context of a BCI through the recorded metrics. The neural signals of a tetraplegic individual, when they attempted to handwrite, were provided by existing research. Four trials were conducted using data with or without augmentation which the model used when training to separately minimize training loss and validation loss. When comparing the results of a BCI with the implementation of a Transformer model with the original RNN BCI (the original data source), the Transformer model performed less favorably across all four trials. Although the results do not indicate that the Transformer model currently outperforms an RNN BCI, it is important to note that further testing of the model's capabilities (such as training it with a larger and more preferable dataset and/or for longer, comparing training times between the RNN and Transformer, and/or seeing how the Transformer is improved with an offline autocorrect feature) is necessary before determining whether Transformers can enhance communication in this manner.

The increasing use of deep learning techniques to manipulate images and videos, commonly referred to as "deepfakes," is making more and more challenging to differentiate between real and fake content. While various deepfake detection systems have been developed, they often struggle to detect deepfakes in real-world situations. In particular, these methods are often unable to effectively distinguish images or videos when these are modified using novel techniques which have not been used in the training set. In this study, we carry out an analysis of different deep learning architectures in an attempt to understand which is more capable of better generalizing the concept of deepfake. According to our results, it appears that Convolutional Neural Networks (CNNs) seem to be more capable of storing specific anomalies and thus excel in cases of datasets with a limited number of elements and manipulation methodologies. The Vision Transformer, conversely, is more effective when trained with more varied datasets, achieving more outstanding generalization capabilities than the other methods analysed. Finally, the Swin Transformer appears to be a good alternative for using an attention-based method in a more limited data regime. All the analyzed architectures seem to have a different way to look at deepfakes but since in a real-world environment, the generalization capability is essential, based on the carried out experiments the Vision Transformer seems to provide superior performances.

Soybean maturity is a trait of critical importance for the development of new soybean cultivars, nevertheless, its characterization based on visual ratings has many challenges. Unmanned aerial vehicles (UAVs) imagery-based high-throughput phenotyping methodologies have been proposed as an alternative to the traditional visual ratings of pod senescence. However, the lack of scalable and accurate methods to extract the desired information from the images remains a significant bottleneck in breeding programs. The objective of this study was to develop an image-based high-throughput phenotyping system for evaluating soybean maturity in breeding programs. Images were acquired twice a week, starting when the earlier lines began maturation until the latest ones were mature. Two complementary convolutional neural networks (CNN) were developed to predict the maturity date. The first using a single date and the second using the five best image dates identified by the first model. The proposed CNN architecture was validated using more than 15,000 ground truth observations from five trials, including data from three growing seasons and two countries. The trained model showed good generalization capability with a root mean squared error lower than two days in four out of five trials. Four methods of estimating prediction uncertainty showed potential at identifying different sources of errors in the maturity date predictions. The architecture used solves limitations of previous research and can be used at scale in commercial breeding programs.

Periodic travelling waves are observed in various brain activities including visual, motor, language, sleep, and so on. There are several neural field models describing periodic waves assuming nonlocal interaction and, possibly, inhibition, time delay, or some other properties. In this work we study the influence of asymmetric connectivity functions and of time delay on the emergence of periodic waves and on their properties. Nonlinear wave dynamics is studied, including modulated and aperiodic waves. Multiplicity of waves for the same values of parameters is observed. External stimulation in order to restore wave propagation in a damaged tissue is discussed.

Recent advances in recording and real-time analysis of surface electromyographic signals (sEMG) have fostered the use of sEMG human-machine interfaces for controlling personal computers, prostheses of upper limbs, and exoskeletons among others. Despite a relatively high mean performance, sEMG-interfaces still exhibit strong variance in the fidelity of gesture recognition among different users. Here we systematically study the latent factors determining the performance of sEMG-interfaces in synthetic tests and in an arcade game. We show that the degree of muscle cooperation and the amount of the body fatty tissue are the decisive factors in synthetic tests. Our data suggest that these factors can only be adjusted by a long-term training, which promotes fine-tuning of low-level neural circuits driving the muscles. A short-term training has no effect on synthetic tests, but significantly increases the game scoring. This implies that it works at a higher decision-making level, not relevant for synthetic gestures. We propose a procedure that enables quantification of the gestures’ fidelity in a dynamic gaming environment. For each individual subject the approach allows identifying “problematic” gestures that decrease gaming performance. This information can be used for optimizing the training strategy and for adapting the signal processing algorithms to individual users, which could be a way for a qualitative leap in the development of future sEMG-interfaces.

This paper introduces an innovative approach to lipreading, leveraging a web application designed to generate subtitles for videos where the speaker's mouth is visible and a comprehensive literature review that precedes the discussion, encompassing a thorough examination of various lipreading methods employed over the past decade. Our method employs a powerful deep learning model, featuring a 3D-convolution network and bidirectional LSTM, enabling accurate sentence-level predictions based solely on visual lip movements. With an impressive accuracy of 97%, our model is trained using pre-segmented lips regions, transformed into animated GIFs for effective pre-training. This work stands as a significant contribution to the evolving landscape of lipreading research, offering a practical and accurate solution for real-world applications.

Emotions play a vital role in understanding human behavior and interpersonal relationships. The ability to recognize emotions through Electroencephalogram (EEG) signals offers an alternative to traditional methods, such as questionnaires, enabling the identification of emotional states in a non-intrusive manner. Automatic emotion recognition holds great potential, eliminating the need for clinical examinations or physical visits, thereby contributing significantly to the advancement of Brain-Computer Interface (BCI) technology. However, one of the key challenges lies in effectively selecting and extracting relevant features from the EEG signal to establish meaningful distinctions between different emotional states. The process of feature selection is often time-consuming and demanding. In this research, we propose a groundbreaking approach for automatically identifying three emotional states (positive, negative, and neutral) by leveraging auditory stimulation of EEG signals. Our novel method directly applies the raw EEG signal to a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) architecture, bypassing the conventional feature extraction and selection steps. This unconventional approach offers a significant departure from existing literature. Our proposed network architecture comprises ten convolutional layers, followed by three LSTM layers and two fully connected layers. Through extensive simulations and evaluations on 12 active channels, our algorithm demonstrates exceptional performance, achieving an accuracy of 97.42\% and 95.23\% for the binary classification of negative and positive emotions, as well as a Cohen's Kappa coefficient of 0.96 and 0.93 for the three-class classification (negative, neutral, and positive), respectively. These promising results highlight the efficacy of our novel methodology and its potential implications in advancing emotion recognition using EEG signals.

The overpopulation of feral pigeons in Hong Kong has significantly disrupted the urban ecosystem, highlighting the urgent need for effective strategies to control their population. In general, control measures should be implemented and re-evaluated periodically following accurate estimations of feral pigeon population in the concerned regions, which, however, is very difficult in urban envi-ronments due to the concealment and mobility of pigeons within complex building structures. With the advances in deep learning, computer vision can be a promising tool for pigeon monitoring and population estimation but has not been well investigated so far. Therefore, we propose an improved deep learning model based on Mask-RCNN (Swin-Mask R-CNN) for feral pigeon detection using computer vision techniques. Specifically, our model consists of a Swin transformer network (STN) as the backbone, a feature pyramid network (FPN) as the neck, and three decoupled detection heads. The STN is utilized to extract deep feature information of feral pigeons through local and cross-window attention mechanisms. The FPN is employed to fuse multi-scale features and enhance the multi-scale learning ability. Heads in the three branches are responsible for classification, pre-dicting best bounding boxes, and segmentation of feral pigeons, respectively. During the prediction phase, a Slicing Aided Hyper Inference (SAHI) tool is employed to zoom in on the feature infor-mation of small feral pigeon targets, and the segmentation head is frozen to expedite inference of large images. Experiments were conducted on feral pigeon dataset to evaluate model performance. The results reveal that our model is well-suited for detecting small targets in high-resolution images and achieves excellent recognition performance for feral pigeons with a mAP (mean average pre-cision) and an AP50 (average precision at 50% intersection over union) of 0.74 and 0.93, respectively. For small target feral pigeons, AP50 in small scale (AP50s) improved by 10% as compared to the Mask R-CNN (AP50s of 0.75), demonstrating its potential for dynamic pigeon detection and population estimation in the future.

Deep learning heavily relies on statistical correlations to drive artificial intelligence (AI) innovations, particularly in computer vision applications like autonomous driving and robotics. However, despite providing a solid foundation for deep learning, these statistical correlations can be vulnerable to unforeseen and uncontrolled factors. The lack of prior knowledge guidance can result in spurious correlations, introducing confounding factors and affecting the model's robustness. To address this challenge, recent research efforts have focused on integrating causal theory into deep learning methodologies. By modelling the inherent and unbiased causal structure, causal theory can potentially mitigate the impact of spurious correlations effectively. Hence, this paper explores the basics of causal methodologies in image classification.

If the development of machine learning and artificial intelligence plays a role in many fields of research and technology today, it has a special relationship with neurosciences. Indeed, historically inspired by our knowledge of the brain, deep learning shares some vocabularies with neurosciences and can sometimes be considered a brain’s model. Taking the particular example of epileptic seizure, which can develop in any biological neural tissue, we raise the question if and how the models used for deep learning can capture or model these pathological events. This particular example is a starting point to discuss the nature, limits, and functions of these models, and what we expect from a model of the brain. Finally, we argue that a pluralistic approach leading to the integrated coexistence of different models is necessary to study the brain in all its complexity.

To investigate the intricate dynamics of brain activity when interacting with a dynamic environment, it is imperative to continuously generate and update expectations regarding forthcoming events and their corresponding sensory and motor responses. This study aims to explore the interconnectivity in time perception across predictable and unpredictable conditions. The necessary data for this study were acquired from EEG signals, sourced from an existing database that involved an experiment conducted on a group of healthy participants. The individuals were subjected to two distinct conditions, predictable and unpredictable, encompassing various time delays. The functional connectivity between brain regions was estimated using a method known as the phase lag index. This method was employed to discern disparities in time perception between the two conditions. A comprehensive comparison of the two conditions across different delays demonstrated noteworthy variations, particularly in the gamma, beta, and theta frequency bands. The differences between delays were more pronounced in the predictable condition. Subsequently, an in-depth analysis was conducted to scrutinize the dissimilarities between the conditions within each delay. Notably, significant differences were observed across all delays. In the unpredictable condition, an increase in connectivity was detected within the alpha band during the 400-ms delay, specifically between occipital and temporal regions. Moreover, the mean connectivity in the unpredictable condition surpassed that of the predictable condition. In the delta band, distinct connectivity patterns were observed across different delays, involving connections between central and frontal regions. Specifically, a heightened connectivity between central and prefrontal regions was noted during the 83-ms delay. Notably, the right hemisphere of the prefrontal cortex played a vital role in time perception. Furthermore, a decline in connectivity across the delta, theta, and beta bands was observed in both conditions during the longest delay (800 ms) when compared to other delays

As the Autonomous Vehicle (AV) industry is rapidly advancing, classification of non-motorized (vulnerable) road users (VRUs) becomes essential to ensure their safety and to smooth operation of road applications. The typical practice of non-motorized road users’ classification usually takes numerous training time and ignores the temporal evolution and behavior of the signal. In this research effort, we attempt to detect VRUs with high accuracy be proposing a novel framework that includes using Deep Transfer Learning, which saves training time and cost, to classify images constructed from Recurrence Quantification Analysis (RQA) that reflect the temporal dynamics and behavior of the signal. Recurrence Plots (RPs) were constructed from low-power smartphone sensors without using GPS data. The resulted RPs were used as inputs for different pre-trained Convolutional Neural Network (CNN) classifiers including constructing 227×227 images to be used for AlexNet and SqueezeNet; and constructing 224×224 images to be used for VGG16 and VGG19. Results show that the classification accuracy of Convolutional Neural Network Transfer Learning (CNN-TL) reaches 98.70%, 98.62%, 98.71%, and 98.71% for AlexNet, SqueezeNet, VGG16, and VGG19, respectively. The results of the proposed framework outperform other results in the literature (to the best of our knowledge) and show that using CNN-TL is promising for VRUs classification. Because of its relative straightforwardness, ability to be generalized and transferred, and potential high accuracy, we anticipate that this framework might be able to solve various problems related to signal classification.

The Eurasian grapevine (\textit{Vitis vinifera L.}) is the most widely grown horticultural crop in the world and is important for the economy of many countries. In the wine production chain, grape varieties play an important role, as they directly influence the authenticity and classification of the product. Identifying the different grape varieties is therefore fundamental for quality control and control activities, as well as for regulating production. Currently, ampelography and molecular analysis are the main approaches to identifying grape varieties. However, both methods have limitations. Ampelography is subjective and prone to errors and is experiencing enormous difficulties as ampelographers are increasingly scarce. On the other hand, molecular analyses are very demanding in terms of cost and time. In this scenario, Deep Learning (DL) methods have emerged as a classification alternative to deal with the scarcity of ampelographers and avoid molecular analyses. In this study, the most recent and current methods for identifying grapevine varieties using DL classification-based approaches are presented through a systematic literature review. The steps of the standard DL-based classification pipeline were described for the 18 most relevant studies found in the literature, highlighting their pros and cons. Potential directions for improving this field of research were also presented.

Background: There is an increasing interest in the role of EEG in neurorehabilitation. We primarily aimed to identify the knowledge base through highly influential studies. Our secondary aims were to imprint the relevant thematic hotspots, research trends, and social networks within the scientific community. Methods: We performed an electronic search in Scopus looking for studies reporting on rehabilitation in patients with neurological disabilities. The most influential papers outlined the knowledge base, while a word co-occurrence analysis imprinted the research hotspots. Likewise, co-citation analyses highlighted collaboration networks between Universities, authors, and countries. The results were presented in summary tables, burst detection plots, and geospatial maps. Finally, a content review based on the top-20 most cited articles completed our study. Results: Our current bibliometric study was based on 874 records from 420 sources. There was a vivid research interest in EEG use for neurorehabilitation, with an annual growth rate as high as 14.3%. The most influential paper was the study titled "Brain-computer interfaces, a review" by Nicolas-Alfonso LF and Gomez-Gill J, with 997 citations, followed by "Brain-computer interfaces in neurological rehabilitation" by Daly J. and Wolpaw JR (708 citations). The USA, Italy, and Germany were among the most productive countries. The research hotspots shifted with time from the use of “functional magnetic imaging” to EEG-based “brain-machine interface”, “motor imagery”, and “deep learning”. Conclusions: EEG constitutes the most significant input in brain-computer interfaces (BCI) and can be successfully used in the neurorehabilitation of patients with stroke, amyotrophic lateral sclerosis, and traumatic brain and spinal injury. EEG-based BCI facilitates training, communication, and control of wheelchair and exoskeletons. However, research is limited to specific scientific groups from developed countries. Evidence is expected to change with the broader availability of BCI and improvement in EEG filtering algorithms.

Indoor localization (IL) is a significant topic of study with several practical applications. The area of IL has evolved greatly in recent years due to the introduction of numerous technologies such as WiFi, Bluetooth, cameras, and other sensors. Despite the growing interest in this field, there are numerous challenges and drawbacks that must be addressed to develop more accurate and sustainable systems for IL and its real-life applications. This review study gives an in-depth look into IL, covering the most promising artificial intelligence-based and hybrid strategies that have shown excellent potential in overcoming some of the limitations of classic methods. In addition, the paper investigates the significance of high-quality datasets and evaluation metrics in the design and assessment of IL algorithms. Furthermore, this overview study emphasizes the crucial role that machine learning techniques, such as deep learning and transfer learning, play in the advancement of IL. A focus on the importance of IL and the various technologies, methods, and techniques that are being used to improve it. Finally, The survey highlights the need for continued research and development to create more accurate and scalable techniques that can be applied across a range of industries, such as evacuation-egress routes, hazard-crime detection, smart occupancy-driven energy reduction and asset tracking and management.

Machine Learning (ML) approaches have been fruitfully applied to several classification problems of neurophysiological activity. Considering the relevance of emotion in human cognition and behaviour, ML found an important application field in emotion identification based on neurophysiological activity. Nonetheless, the literature results present a high variability depending on the neuronal activity measurement, the signal features and the classifier type. The present work aims to provide new methodological insight on ML applied to emotion identification based on electrophysiological brain activity. For this reason, we recorded EEG activity while emotional stimuli, high and low arousal (auditory and visual) were provided to a group of healthy participants. Our target signal to classify was the pre-stimulus onset brain activity. Classification performance of three different classifiers (LDA, SVM and kNN) was compared using both spectral and temporal features. Furthermore, we also contrasted the classifiers performance with static and dynamic (time evolving) features. The results show a clear increased in classification accuracy with temporal dynamic features. In particular, the SVM classifiers with temporal features showed the best accuracy (63.8 %) in classifying high vs. low arousal auditory stimuli.

Computer vision is a powerful technology that has enabled solutions in various fields by analyzing visual attributes in images. One field that has taken advantage of computer vision is agricultural automation, which promotes high-quality crop production. The nutritional status of a crop is a crucial factor in determining its productivity. This status is mediated by approximately 14 chemical elements acquired by the plant, and their determination plays a pivotal role in farm management. To address the timely identification of nutritional disorders, this study focuses on the classification of three levels of phosphorus deficiencies through individual leaf analysis. The methodological steps include: (1) generating a database with laboratory-grown maize plants that were induced to total phosphorus deficiency, medium deficiency, and total nutrition, using different capture devices; (2) processing the images with state-of-the-art transfer learning architectures (i.e. VGG16, ResNet50, GoogLeNet, DenseNet201, and MobileNetV2); and (3) evaluating the classification performance of the models using the created database. The results show that the VGG16 model achieves superior performance, with 98% classification accuracy. However, the other studied architectures also demonstrate competitive performance and are considered state-of-the-art automatic leaf deficiency detection tools. The proposed method can be a starting point to fine-tune machine vision-based solutions tailored for real-time monitoring of crop nutritional status.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Deep Neutral Networks (DNNs) were initially proposed towards the midst of the 20th century, motivated by the neural structure and mechanism of the human brain. Thanks to major ad-vancements in computational resources, during the past decade DNN-based systems have demonstrated unprecedented performance in terms of accuracy and speed. However, recent work has shown that such models may not be sufficiently robust during the inference process. Furthermore, due to the data-driven learning nature of DNNs, designing interpretable and gen-eralizable networks is a major challenge, especially in critical applications, such as medical Computer Aided Diagnostics (CAD) and other medical imaging tasks, including classification, regression and reconstruction. Within this context, a line of physics-driven approaches for deep learning has recently emerged, aimed at improving the stability and generalization capacity of DNNs for medical imaging applications. In this paper, we review recent work focused on phys-ics-driven or prior-information learning for a variety of imaging modalities and medical applica-tions. We discuss how the inclusion of domain-related knowledge into the learning process and networks’ design supports their stability and generalization capability. In addition, we highlight current and future challenges within this scope.

Depression is one of the psychiatric disorders characterized by anxiety, pessimism, and suicidal tendencies, which seriously affect the quality of life of patients and their families. In this paper, we used polynomial-based kernel Granger causality values as network node connectivity indicators to construct brain networks for 5 depressed patients and 11 healthy individuals’ magnetoencephalogram(MEG) under positive, neutral, and negative emotional stimuli, respectively, and found that depressed patients had closer information exchange between frontal and occipital regions compared to healthy individuals and other brain regions, and fewer causal connections in parietal and central regions. Further analysis of the topological properties of the network revealed that depressed patients had higher mean degrees under negative stimuli (p=0.008)and lower mean clustering coefficients than healthy individuals(p=0.034). Comparing the mean degree and mean clustering coefficient of the same sample under different emotional stimuli, we found that depressed patients had the greater mean degree and mean clustering coefficient under negative stimuli than neutral and positive stimuli. We also found that patients’ feature path lengths under negative and neutral stimuli significantly deviated from small-world attributes. The results suggest that analysis of nuclear Granger causality-based brain networks can effectively characterize depression pathology.

In this study, a simple machine learning-based quantitative structure-activity relationship (QSAR) model was developed to predict the inhibitory potency (pIC50 values) of FLT3 tyrosine kinase inhibitors, pivotal in treating Acute Myeloid Leukemia (AML). Distinctively, our model leverages an extensive and diverse dataset, 14 times larger than those employed in prior studies within this field, enabling an unparalleled scope of compound analysis. This vast dataset, combined with further exploration of molecular descriptors, enabled predictions of extraordinary precision, covering a broader spectrum of FLT3 inhibitors than was previously possible. The Random Forest Regressor (RFR) algorithm, selected for its superior predictive performance, was trained with 1080 inputs and validated through comprehensive external and internal methods. It achieved an remarkable coefficient of determination (R^2) of 0.941 and a standard deviation of 0.235 on a test set of 270 compounds, highlighting the efficacy of model in predicting FLT3 inhibitory activity. Key molecular descriptors were identified, enhancing our understanding of structural requirements for inhibitor potency. Additionally, we developed a user-friendly computational tool that enables the rapid prediction of pIC50 values. Utilizing this tool, potential FLT3 inhibitors were identified through ligand-based virtual screening. This study represents a major advancement in FLT3 inhibitor discovery by utilizing a simple QSAR-machine learning model. It enables more efficient and precise identification of potential drug candidates at an early stage, promising a faster development of targeted therapies and streamlining the ligand-based drug design process.

Iron ore processing involves critical steps that affect the quality of the final product. Determining the diameter of the pellets is the necessary initial step for volume measurement and, ultimately, for porosity and bulk density measurement, crucial characteristics for optimizing the burning process in the blast furnace. Traditional measurement methods using mercury present issues related to operator safety and environmental preservation, while the practices described in ISO 4698 standard require lengthy preparation and execution time. In light of environmental needs, operator safety, and the time consumed in tests, implementing a new method based on digital image processing and convolutional neural networks for measuring the diameter of burnt iron ore pellets is proposed. The methodology involves capturing images of the pellets using a high-resolution camera and utilizing digital image processing and neural networks capable of performing pixel-by-pixel object segmentation in the images, providing precise information about the pellets to calculate their volume automatically. The results were compared with those obtained using traditional methods, evaluating their conformity with the ISO 4698 standard. In conclusion, this study offers a new approach to measuring the volume of burnt iron ore pellets, providing accurate and reliable results in compliance with safety and environmental preservation standards.

Purpose The gradual increase in geriatric issues and global imbalance of the ratio between patients and healthcare professionals has created a demand for intelligent systems with the least error-prone diagnosis results to be used by less medically trained persons and save clinical time. This paper aims at investigating the development of an image-based colourimetric analysis. The purpose of recognising such tests is to support wider users to begin a colourimetric test to be used at homecare settings, telepathology, etc. Design/methodology/approach The concept of an automatic colourimetric assay detection is delivered by utilising two cases. Training Deep Learning (DL) models on thousands of images of these tests using transfer learning, this paper i) classifies the type of the assay, and ii) classifies the colourimetric results. Findings This paper demonstrated that the assay type can be recognised using DL techniques with 100% accuracy within a fraction of a second. Some of the advantages of the pre-trained model over the calibration-based approach are robustness, readiness and suitability to deploy for similar applications within a shorter period of time. Originality/value To the best of our knowledge, this is the first attempt to provide Colourimetric Assay Type Classification (CATC) using DL. Humans are capable to learn thousands of visual classifications in their life. Object recognition may be a trivial task for humans, due to photometric and geometric variabilities along with the high degree of intra-class variabilities it can be a challenging task for machines. However, transforming visual knowledge into machines, as proposed, can support non-experts to better manage their health and reduce some of the burdens on experts.

In this paper, we propose methods for brain tumor detection in MRI images based on ensemble learning. We build upon prior research on ensemble methods by testing the concatenation of pre-trained models: features extracted via transfer learning are merged and segmented by classification algorithms or a stacked ensemble of those algorithms. The proposed approach achieved accuracy scores of 0.98 , outperforming a benchmark VGG-16 model. Considerations to granular computing are given in the paper as well.

Nowadays, brain signal processing is performed rapidly in various brain-computer interface (BCI) applications. Most researchers focus on developing new methods for the future or improving the basic implemented models to identify the optimum standalone feature set. Our research focuses on four ideas. One of them introduces future communication models, and the others are for improving old models or methods. These are: 1) new communication imagery model instead of speech imager using the mental task: Due to speech imagery is very difficult, and it is impossible to imagine sound for all of the characters in all of the languages. Our research introduces a new mental task model for all languages that call Lip-sync imagery. This model can use for all characters in all languages. This paper implemented two lip-sync for two sounds, characters or letters. 2) New combination Signals: Selecting an inopportune frequency domain can lead to inefficient feature extraction. Therefore, domain selection is so important for processing. This combination of limited frequency ranges proposes a preliminary for creating Fragmentary Continuous frequency. For the first model, two s intervals of 4 Hz as filter banks were examined and tested. The primary purpose is to identify the combination of filter banks with 4Hz (scale of each filter bank) from the 4Hz to 40Hz frequency domain as new combination signals (8Hz) to obtain well and efficient features using increasing distinctive patterns and decreasing similar patterns of brain activities.3) new supplement bond graph classifier for SVM classifier: When SVM linear uses in very noisy, the performance is decreased. But we introduce a new bond graph linear classifier to supplement SVM linear in noisy data. 4) a deep formula recognition model: it converts the data of the first layer into a formula model (formula extraction model). The main goal is to reduce the noise in the subsequent layers for the coefficients of the formulas. The output of the last layer is the coefficients selected by different functions in different layers. Finally, the classifier extracts the root interval of the formulas, and the diagnosis does based on the root interval. For all of the ideas achieved the results of implementing methods. The results are between 55% to 98%. Less result is 55% for the deep detection formula, and the highest result is 98% for new combination signals.

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

Approximately 6 million youth aged 12 to 20 consume alcohol monthly in the United States. The effect of alcohol consumption in adolescence on behavior and cognition is heavily researched, however, little is known about how alcohol consumption in adolescence may alter brain function, leading to long-term developmental detriments. In order to investigate differences in brain connectivity associated with alcohol use in adolescents, brain networks were constructed using resting state functional magnetic resonance imaging data collected by the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) from 698 youth (12-21 years, 117 hazardous drinkers and 581 no/low drinkers). Analyses assessed differences in brain network topology based on alcohol consumption in eight pre-defined brain networks, as well as in whole-brain connectivity. Within the central executive network (CEN), basal ganglia network (BGN), and sensorimotor network (SMN), no/low drinkers demonstrated stronger and more frequent connections between highly globally efficient nodes, with fewer and weaker connections between highly clustered nodes. Inverse results were observed within the dorsal attention network (DAN), visual network (VN), and frontotemporal network (FTN), with no/low drinkers demonstrating weaker connections between nodes with high efficiency and increased frequency of clustered nodes compared to hazardous drinkers. Results from this study show clear organizational differences between adolescents with no/low or hazardous alcohol use, suggesting that aberrant connectivity in these brain networks is associated with risky drinking behaviors.

In recent years, a range of problems under the broad umbrella of computer vision based analysis of ancient coins have been attracting an increasing amount of attention. Notwithstanding this research effort, the results achieved by the state of the art in published literature remain poor and far from sufficiently well performing for any practical purpose. In the present paper we present a series of contributions which we believe will benefit the interested community. We explain that the approach of visual matching of coins, universally adopted in existing published papers on the topic, is not of practical interest because the number of ancient coin types exceeds by far the number of those types which have been imaged, be it in digital form (e.g., online) or otherwise (traditional film, in print, etc.). Rather, we argue that the focus should be on understanding the semantic content of coins. Hence, we describe a novel approach—to first extract semantic concepts from real-world multimodal input and associate them with their corresponding coin images, and then to train a convolutional neural network to learn the appearance of these concepts. On a real-world data set, we demonstrate highly promising results, correctly identifying a range of visual elements on unseen coins with up to 84% accuracy.

The present study illustrates a brain-computer interface designed and developed to be wearable, portable, and user-friendly. Eight dry electroencephalographic sensors were adopted to acquire the brain activity associated with motor imagery. Multimodal feedback in extended reality was exploited to improve the detection of neurological phenomena. Twenty-seven healthy subjects used the proposed system in five sessions to investigate the effects of feedback on motor imagery. The sample was divided into two equal-sized groups: the "neurofeedback" group, which performed motor imagery while receiving feedback, and the "control" group, which performed motor imagery with no feedback. Several questionnaires were administrated to participants aiming to investigate the usability of the proposed system and individual’s ability to imagine movements. The highest mean classification accuracy across subjects of control group was about 62 % with 3 % associated type A uncertainty, and 69 % with 3 % uncertainty for neurofeedback group. Moreover, in some cases the results were significantly higher for the neurofeedback group. The perceived usability by all participants was high. Overall, the study highlights the advantages and the pitfalls of using a wearable brain-computer interface with dry sensors. Notably, the results and the perceived usability pave the way for the employment of the proposed system in tele-rehabilitation.

Converting natural language into machine language that can be recognized by distributed systems is the core challenge of intelligent interactive interfaces and human-machine dialogue systems. The human-machine interface interaction of large distributed SCADA measurement and control system is tedious and the operation and maintenance cost is high, so it is significant to design an intelligent natural language interaction interface for distributed measurement and control system. In this paper, we design the intermediate language format of SCADA system, i.e., Key-value logic form, and then formulate the Text2SCADA framework and propose the TICS algorithm and SDPA algorithm, the former adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for basic natural language instructions, and the latter adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for relatively The latter one adopts the algorithm of dependent syntactic analysis for the structured representation of natural language instructions with relatively complex natural language instructions. Based on the above algorithms, a lightweight information extraction model based on DGCNN and probabilistic graph ideas is constructed, aiming to enhance the scientific generalization ability of the framework on unknown instruction sets. The experimental results show that the proposed intelligent natural language interface can better solve the human-machine interface interaction problem of distributed SCADA measurement and control system. The average accuracy, recall and F-value of instruction parsing reach 89.27\%, 89.28\% and 89.27\%, respectively. The average response time is 1.593 s. Especially, it provides a more convenient means of interaction for industrial and agricultural information control.

Image segmentation is a new challenge prob- lem in medical application. The use of medical imaging has become an integral part of research, as it allows us to see inside the human body without surgical intervention. Many researcher have studied brain segmentation. One stage method is used to segment the brain tissues. In this paper, we proposed the multi-stage generative ad- versarial network to solve the problem of information loss in the one-stage. We utilize the coarse-to-fine to improve brain segmentation using multi-stage generative adversar- ial networks (GAN). In the first stage, our model generated a coarse outline for (i) background and (ii) brain tissues. Then, in the second stage, the model generated outline for (i) white matter (WM), (ii) gray matter (GM) and (iii) cerebrospinal fluid (CSF). A good result can be achieved by fusing the coarse outline and refine outline. We conclude that our model is more efficient and accu- rate in practice for both infant and adult brain segmenta- tion. Moreover, we observe that multi-stage model is faster than prior models. To be more specific, the main goal of multi-stage model is to see the performance of the model in a few shot learning case where a few labeled data are available. For medical image, this proposed model can work in a wide range of image segmentation where the convolution neural networks and one-stage methods have failed.

The Brain-Computer Interface (BCI) technology has emerged as a groundbreaking innovation with profound implications across diverse domains, particularly in healthcare. By establishing a direct communication pathway between the human brain and external devices, BCI systems offer unprecedented opportunities for diagnosis, treatment, and rehabilitation, thereby reshaping the landscape of medical practice. However, despite its immense potential, the widespread adoption of BCI technology in clinical settings faces several challenges. These include the need for robust signal acquisition and processing techniques, ensuring user safety and privacy, addressing ethical considerations, and optimizing user training and adaptation. Overcoming these challenges is crucial to unleashing the complete potential of BCI technology in healthcare and realizing its promise of personalized, patient-centric care. This review work underscores the transformative potential of BCI technology in revolutionizing medical practice. This paper offers a comprehensive analysis of medical-oriented BCI applications by exploring the various uses of BCI technology and its potential to transform patient care.

In the age of social media, images come from unreliable sources that may change their content to fit a narrative. Automated detection of forged images is a complex task, especially considering recent technological advances in image manipulation software. However, in the existing literature, it is possible to identify two general approaches adopted by detection methods, active and passive. Active techniques preemptively act on an image by inserting structures before any manipulation is made that can verify its authenticity. In contrast, passive methods analyze the content of an image in search of traces of manipulation. In this way, this research proposes a novel approach to image manipulation detection, combining two passive methods through neural networks, creating a generalist approach capable of detecting with greater accuracy than the methods that compose it. Furthermore, this work used a combination of four datasets available in the literature for training and evaluation. After training, the merged approach obtained an accuracy of 89.59% in the set of validation images, significantly higher than the model trained with only unaltered images, which obtained 78.64%, and the two other models trained using images with a feature selection method applied to enhance inconsistencies that obtained 68.02% for Error-Level Analysis images and 50.70% for the method using Discrete Wavelet Transform. In addition to the performance improvement, the proposed approach’s accuracy variation was lower than the other models.

Objective: Radiomics and deep transfer learning are two popular technologies used to develop computer-aided detection and diadnosis (CAD) schemes of medical images. This study aims to investigate and compare advantages and potential limitations of applying these two technologies in developing CAD schemes. Methods: A relatively large and diverse retrospective dataset including 3,000 digital mammograms is assembled in which 1,496 images depict malignant lesions and 1,054 images depict benign lesions. Two CAD schemes are developed to classify breast lesions. The first scheme is developed using four steps namely, applying an adaptive multi-layer topographic region growing algorithm to segment lesions, computing initial radiomics features, applying a principal component algorithm to generate an optimal feature vector, and building a support vector machine classifier. The second CAD scheme is built based a pre-trained residual net architecture (ResNet50) as a transfer learning model to classify breast lesions. Both CAD schemes are trained and tested using a 10-fold cross-validation method. Several score fusion methods are also investigated to classify breast lesions. CAD classification performance is evaluated by the area under ROC curve (AUC). Results: ResNet50 model-based CAD scheme yields AUC = 0.85±0.02, which is significantly higher than radiomics feature-based CAD scheme with AUC = 0.77±0.02 (p < 0.01). Additionally, fusion of classification scores generated by two CAD schemes does not further improve classification performance. Conclusion: This study indicates that using deep transfer learning is more efficient to develop CAD schemes and enables to yield higher lesion classification performance than CAD schemes developed using radiomics-based technology.

Manual interpretation of these huge amounts of image volumes are susceptible to inter-reader variability and human error. Thus, accurate automated CAD scheme is highly desirable in clinical pathological diagnosis. In this research, plethora of machine learning paradigms (e.g. feature extraction, dimensionality reduction and supervised classification methods) were explored, evaluated, compared and analyzed to identify the optimal pathway for brain MR images (normal vs neoplastic) binary classification task. External validation dataset was used to test the generalizability of the optimal predictive models implemented. Relevant and informative features were selected to construct cross-validated decision tree and eventually simple rule set was built based on the decision tree. The experimental results show that almost all pattern recognition paradigms achieve high accuracy with careful selection of number of attributes. LDA+ELM with 55 features are the optimal pipelines which achieve perfect classification when training and test data are of same source; and achieving (accuracy=97.5%, AUC=0.989, sensitivity=95% and specificity=100%) under balanced test dataset; (accuracy=99.5%, AUC=0.988, sensitivity=95% and specificity=100%). Cross-validated decision tree model also shows comparable performance: accuracy=98.8%, AUC=99.1%, sensitivity=99.6% and specificity=98.2%. Three highly relevant and robust attributes are visualized and selected for construction of decision tree models and finally a rule sets are read directly off the decision tree. This rule sets can potentially serve as fast and accurate classification algorithm.

The advent of deep learning (DL) has revolutionized medical imaging, offering unprecedented avenues for accurate disease classification and diagnosis. DL models have shown remarkable promise for classifying brain tumor from Magnetic Resonance Imaging (MRI) scans. However, despite their impressive performance, the opaque nature of DL models poses challenges in understanding their decision-making processes, particularly crucial in medical contexts where interpretability is essential. This paper explores the intersection of medical image analysis and DL interpretability, aiming to elucidate the decision-making rationale of DL models in brain tumor classification. Leveraging state-of-the-art DL frameworks with transfer learning, we conduct a comprehensive evaluation encompassing both classification accuracy and interpretability. Using state-of-the-art DL frameworks with transfer learning, we conduct a thorough evaluation covering both classification accuracy and interpretability. We employ adaptive path-based techniques to understand the underlying decision-making mechanisms of these models. Grad-CAM and Grad-CAM++ highlight critical image regions where the tumors are located.

This paper introduces a novel architecture—bidirectional optical neural network (BONN)—for providing backward connections alongside forward connections in artificial neural networks (ANNs). BONN incorporates laser diodes and photodiodes and exploits the properties of Köhler illumination to establish optical channels for backward directions. Thus, it has bidirectional functionality that is crucial for algorithms such as the backpropagation algorithm. BONN has a scaling limit of 96 × 96 for input and output arrays, and a throughput of 8.5 × 1015 MAC/s. While BONN's throughput may rise with additional layers for continuous input, limitations emerge in the backpropagation algorithm as its throughput doesn't scale with layer count. Successful BONN-based implementation of the backpropagation algorithm requires the development of fast spatial light modulator to accommodate frequent data flow changes. A two-mirror-like BONN and its cascaded extension are alternatives for multilayer emulation, and they help save hardware space and increase the parallel throughput for inference. An investigation into the application of the clustering technique to BONN revealed its potential to help overcome scaling limits and to provide full interconnections for backward directions between doubled input and output ports. BONN's bidirectional nature holds promise for enhancing supervised learning in ANNs and increasing hardware compactness.

Brain-computer interfaces (BCI) from electroencephalography (EEG) provide a practical approach to support human-technology interaction. In particular, motor imagery (MI) is a widely-used BCI paradigm that guides the mental trial of motor tasks without physical movement. Here, we present a deep learning methodology, named Kernel-based Regularized EEGNet (KREEGNet), leveled on Centered Kernel Alignment and Gaussian Functional Connectivity, explicitly designed for EEG-based MI classification. The approach proactively tackles the challenge of intra-subject variability brought on by noisy EEG records and the lack of spatial interpretability within end-to-end frameworks applied for MI classification. KREEGNet is a refinement of the widely accepted EEGNet architecture, featuring an additional kernel-based layer for regularized Gaussian functional connectivity estimation based on CKA. The superiority of KREEGNet is evidenced by our experimental results from binary and multi-class MI classification databases, outperforming the baseline EEGNet and other state-of-the-art methods. Further exploration of our model’s interpretability is conducted at individual and group levels, utilizing classification performance measures and pruned functional connectivities. Our approach is a suitable alternative for interpretable end-to-end EEG-BCI based on deep learning.

The state-of-the-art smart city has been calling for an economic but efficient energy management over large-scale network, especially for the electric power system. It is a critical issue to monitor, analyze and control electric loads of all users in system. In this paper, we employ the popular computer vision techniques of AI to design a non-intrusive load monitoring method for smart electric energy management. First of all, we utilize both signal transforms (including wavelet transform and discrete Fourier transform) and Gramian Angular Field (GAF) methods to map one-dimensional current signals onto two-dimensional color feature images. Second, we propose to recognize all electric loads from color feature images using a deep neural network with multi-scale feature extraction and attention mechanism. Third, we design our method as a cloud-based, non-intrusive monitoring of all users, thereby saving energy cost during electric power system control. Experimental results on both public and our private datasets have demonstrated our method achieves superior performances than its peers, and thus supports efficient energy management over large-scale Internet of Things.

Technological advances in DBS hardware and software represent a significant growth area in functional neurosurgery. These advancements have the potential to significantly enhance treatment outcomes and expand the scope of neurological disorders that can be effectively addressed through DBS interventions. The introduction of directional DBS marks a new phase in neuromodulation, offering extended benefits for patients with Parkinson's disease, more efficient optimization of clinical outcomes, and targeted treatment of refractory symptoms through data-driven approaches. Implementing a multimodal programming strategy, incorporating novel current fractionation technology and image-guided tools for lead localization and brain sensing, further reduces reliance on traditional trial-and-error programming methods, paving the way for a more predictive application of this therapy. These advancements are expected to drive the development of sophisticated closed-loop stimulation systems capable of integrating continuous data streams for improved patient care.

This concept paper gives a narrative about intelligence from insects to the human brain, showing where evolution may have been influenced by the structures in these simpler organisms. The ideas also come from the author's own cognitive model, where a number of algorithms have been developed over time and the precursor structures should be codable to some level. Through developing and trying to implement the design, ideas like separating the data from the function have become architecturally appropriate and there have been several opportunities to make the system more orthogonal. Similarly for the human brain, neural structures may work in-sync with the neural functions, or may be slightly separate from them. Each section discusses one of the neural assemblies with a potential functional result, that cover ideas such as timing or scheduling, structural intelligence and neural binding. Another aspect of self-representation or expression is interesting and may help the brain to realise higher-level functionality based on these lower-level processes.

The central nervous system (CNS) is the final frontier in drug delivery because of the blood-brain barrier (BBB), which poses significant barriers to the access of most drugs to their targets. Kynurenic acid (KYNA), a tryptophan (Trp) metabolite, plays an important role in behavioral functions and abnormal KYNA levels have been observed in neuropsychiatric conditions. The current challenge lies in delivering KYNA to the CNS owing to its polar side chain. Recently, C-3 side chain modified KYNA analogs have been shown to cross the BBB; however, it is unclear whether they retain the biological functions of the parent molecule. This study examined the impact of KYNA analogs, specifically SZR-72, SZR-104, and the newly developed SZRG-21, on behavior. The analogs were administered intracerebroventricularly (i.c.v.), and their effects on the motor domain were compared with those of KYNA. Specifically, open field (OF) and rotarod (RR) tests were employed to assess motor activity and skills. SZR-104 increased horizontal exploratory activity in the OF test at a dose of 0.04 μmol/4 μL, while SZR-72 decreased vertical activity at doses of 0.04 and 0.1 μmol/4 μL. In the RR test, however, neither KYNA nor its analogs showed any significant differences in motor skills at either dose. Side chain modification affects affective motor performance and exploratory behavior, as the results show for the first time. In this study, we showed that KYNA analogs alter emotional components such as motor-associated curiosity and emotions. Consequently, drug design necessitates the development of precise strategies to traverse the BBB while paying close attention to modifications in their effects on behavior.

Cognitive deterioration caused by illness or aging often occurs before symptoms arise, and their timely diagnosis is crucial to reducing its medical, personal, and societal impacts. Brain-Computer Interfaces (BCIs) stimulate and analyze key cerebral rhythms, enabling reliable cognitive assessment that can accelerate diagnosis. The BCI system presented analyzes Steady-State Visually Evoked Potentials (SSVEPs) elicited in subjects of varying age to detect cognitive aging, predict its magnitude, and identify its relationship with SSVEP features (band power and frequency detection accuracy), which were hypothesized to indicate cognitive decline due to aging. The BCI system was tested with subjects of varying age to assess its ability to detect aging-induced cognitive deterioration. Rectangular stimuli flickering at theta, alpha, and beta frequencies were presented to subjects, and frontal and occipital EEG responses were recorded. These were processed to calculate detection accuracy for each subject and calculate SSVEP band power. A neural network was trained using the features to predict cognitive age. The results showed potential cognitive deterioration through age-related variations in SSVEP features. Frequency detection accuracy declined after age group 20–40 and band power, throughout all age groups. SSVEPs generated at theta and alpha frequencies, especially 7.5 Hz, were the best indicators of cognitive deterioration. Here, frequency detection accuracy consistently declined after age group 20-40 from an average of 96.64% to 69.23%. The presented system can be used as an effective diagnosis tool for age related cognitive decline.

Badminton tactics refer to the techniques and strategies employed by players to win a match. Analyzing these tactics can help players improve their performance and outsmart their opponents. To study the tactics of top players, we use a gaming tree to analyze matches between two of the most powerful badminton players in history: Lin and Lee. By employing the Nash Equilibrium, we can discover the most beneficial strategies for both players, which reflect their most powerful techniques. Additionally, with the help of this gaming tree, we can precisely predict how players will implement their tactics. Empirical experimental results demonstrate that our proposed method not only evaluates and identifies each player's weaknesses and strengths but also has powerful capabilities to predict their tactics.

The question of what generates conscious experience has mesmerized thinkers since the dawn of humanity, yet its origins remain a mystery. The topic of consciousness has gained traction in recent years, thanks to the development of large language models that now arguably pass the Turing test, an operational test for intelligence. However, intelligence and consciousness are not related in obvious ways, as anyone who suffers from a bad toothache can attest - pain generates intense feelings and absorbs all our conscious awareness yet nothing particularly intelligent is going on. Still, in the hard sciences, this topic is frequently met with skepticism because to date no protocol to measure the content or intensity of conscious experiences in an observer-independent manner has been agreed upon. Here we present a novel proposal: Conscious experience arises whenever a quantum mechanical superposition forms. Our proposal has several implications: First, it suggests that the structure of the superposition determines the qualia of the experience. Second, quantum entanglement naturally solves the binding problem, ensuring the unity of phenomenal experience. Finally, a moment of agency may coincide with the formation of a superposition state. We outline a research program to experimentally test our conjecture via a sequence of quantum biology experiments. Applying these ideas opens up the possibility of expanding human experience through brain-quantum computer interfaces.

Auto checkout has received more and more attention in recent years and this system automatically generates a shopping bill by identifying the picture of the products purchased by the customers. However, the system is challenged by the domain adaptation problem, where each image of the training set contains only one commodity, whereas the test set is a collection of multiple commodities. The existing solution to this problem is to resynthesize the training images to enhance the training set. Then the composite images are rendered using CycleGAN to make the image distribution of the training set and the test set more similar. However, we find that the detection boxes given by the ground truth of the common dataset contain a large part of the background area, the area will affect the training process as noise. To solve this problem, we propose a mask data priming method. Specifically, we redo the large scale Retail Product Checkout (RPC) dataset and add segmentation annotation information to each item in the training set image based on the original dataset using pixel-level annotation. Secondly, a new network structure is proposed in which we train the network using joint learning of detectors and counters, and fine-tune the detection network by filtering out suitable images from the test set. Experiments on the RPC dataset have shown that our method yields better results. we used an approach that reached 81.87% compared to 56.68% for the baseline approach which demonstrates that pixel-level information helps to improve the detection results of the network.

The use of visual signals in horticulture has attracted significant attention and encompassed a wide range of data types such as 2D images, videos, hyperspectral images, and 3D point clouds. These visual signals have proven to be valuable in developing cutting-edge computer vision systems for various applications in horticulture, enabling plant growth monitoring, pest and disease detection, quality and yield estimation, and automated harvesting. However, unlike other sectors, developing deep learning computer vision systems for horticulture encounters unique challenges due to the limited availability of high-quality training and evaluation datasets necessary for deep learning models. This paper investigates the current status of vision systems and available data in order to identify the high-quality data requirements specific to horticultural applications. We analyse the impact of the quality of visual signals on the information content and features that can be extracted from these signals. To address the identified data quality requirements, we explore the usage of a deep learning-based super-resolution model for generative quality enhancement of visual signals. Furthermore, we discuss how these can be applied to meet the growing requirements around data quality for learning-based vision systems. We also present a detailed analysis of the competitive quality generated by the proposed solution compared to cost-intensive hardware-based alternatives. This work aims to guide the development of efficient computer vision models in horticulture by overcoming existing data challenges and paving a pathway forward for contemporary data acquisition.

A growing area in neurosciences is focused on the modeling and analysis the complex system of connections in neural systems, i.e. the connectome. Here we focus on the representation of connectomes by using graph theory formalisms. The human brain connectomes are usually derived from neuroimages; the analyzed brains are co-registered in the image domain and brought to a common anatomical space. An atlas is then applied in order to define anatomically meaningful regions that will serve as the nodes of the network - this process is referred to as parcellation. Recently, it has been proposed to perform atlas-free random brain parcellation into nodes and align brains in the network space instead of the anatomical image space to define network nodes of individual brain networks. In the network domain, the question of comparison of the structure of networks arises. Such question is tackled by modeling the comparison of brain network as a network alignment (NA) problem. In this paper, we first defined the NA problem formally, then we applied three existing state of the art of multiple alignment algorithms (MNA) on diffusion MRI-derived brain networks and we compared the performances. The results confirm that MNA algorithms may be applied in cases of atlas-free parcellation for a fully network-driven comparison of connectomes.

The paper presents a study of two novel visual motion onset stimulus-based brain–computer interfaces (vmoBCI). Two settings are compared with afferent and efferent to a computer screen center motion patterns. Online vmoBCI experiments are conducted in an oddball event–related potential (ERP) paradigm allowing for “aha–responses” decoding in EEG brainwaves. A subsequent stepwise linear discriminant analysis classification (swLDA) classification accuracy comparison is discussed based on two inter–stimulus–interval (ISI) settings of 700 and 150 ms in two online vmoBCI applications with six and eight command settings. A research hypothesis of classification accuracy non–significant differences with various ISIs is confirmed based on the two settings of 700 ms and 150 ms, as well as with various numbers of ERP response averaging scenarios.The efferent in respect to display center visual motion patterns allowed for a faster interfacing and thus they are recommended as more suitable for the no–eye–movements requiring visual BCIs.

Maze navigation using one or more robots has become a recurring challenge in scientific literature and real life practice, with fleets having to find faster and better ways to navigate environments such as a travel hub (e.g. airports) or to evacuate a disaster zone. Many methods have been used to solve this issue, including the implementation of a variety of sensors and other signal receiving systems. Most interestingly, camera-based techniques have increasingly become more popular in this kind of applications, given their robustness and scalability. In this paper, we have implemented an end-to-end strategy to address this scenario, allowing a robot to solve a maze in an autonomous way, by using computer vision and path planning. In addition, this robot shares the generated knowledge to another by means of communication protocols, having to adapt its mechanical characteristics to be able to solve the same challenge. The paper presents experimental validation of the four components of this solution, namely camera calibration, maze mapping, path planning and robot communication. Finally, we present the integration and functionality of these methods applied in a pair of NAO robots.

Tardive dyskinesia (TD) is a phenomenon predominantly observed as a result of the long-term use of dopamine receptor blockers (antipsychotics). TD is a group of involuntary, irregular hyperkinetic movements, mainly in the muscles of the face, eyelid muscles, lips, tongue, and cheeks, and less frequently in the limbs, neck, pelvis, and trunk. In some patients, TD takes on an extremely severe form, massively disrupting functioning, moreover, causing stigmatization and suffering. Deep brain stimulation (DBS), a method used, among others, in Parkinson's disease, is also an effective treatment for TD and often becomes a method of last resort, especially in severe, drug-resistant forms. The procedure is relatively new in TD, so the available reliable clinical studies are few and consist mainly of case reports. Unilateral and bilateral stimulation of two sites has proven efficacy in TD treatment. Most authors describe stimulation of the globus pallidus internus (GPi); less frequent descriptions involve the hypothalamic nucleus (STN). In the present paper, we provide up-to-date information on the stimulation of both mentioned brain areas. We also compare the efficacy of the two methods by comparing the two available studies, which included the largest groups of patients. Although GPi stimulation is more frequently used clinically, our initial analysis indicates comparable results (reduction of involuntary movements) with STN DBS.

Susceptible, infective, recovered, and hospitalized/isolated individuals are placed on the cells of a nxn square lattice, where each cell is occupied by a single individual or is vacant. At discrete time units (typically one day each) all susceptibles and infectives execute a random movement and when a coincidence of the two types occurs the susceptible is converted to infective status according to some probability. Infectives are labelled by the number of days since originally infected. At each time increment the age label of the infectives is increased by one unit. When the label reaches a number like 15 or 20 days the susceptibles recover with some probability or become isolated/hospitalized. Upon reaching some age the latter types either recover or die. Probabilities for the movements and conversions from one status to another are implemented by random numbergeneration. Simulations were carried out to investigate the effect of several probability and age parameters, the size of population (proportional to nxn) and density (related to fraction of occupied cells), and the size of the movements. Mid-term gradual conversion of susceptibles to isolated was explored as intervention policy.

Recent biotechnological innovations make feasible the new paradigm of creating biological neural circuits de novo. With advances in protein, cell and tissue engineering techniques, as well as cellular reprogramming methods, we are entering an era where the construction of neural circuits can open completely new ways for studying nervous systems and for treating nervous system disorders. I explore here three technologies, namely cellular engraftment, neuronal reprogramming and transsynaptic molecule engineering, and delineate how they are being used in a variety of basic research and translational medicine contexts. In basic neuroscience, neural circuit construction methods are enabling ways to study causality in neural development (e.g. neural precursor differentiation and migration) and circuit function (e.g. excitation/inhibition balance, neural population dynamics). In translational neuroscience, they are providing opportunities for the targeted correction of circuit malfunction in brain disorders, both psychiatric (e.g. schizophrenia) and neurological (e.g. Parkinson’s, Huntington’s and Alzheimer’s disease, as well as epilepsy). I discuss the challenges that these methods currently face, such as targeting specificity and cell survival, and outline future paths and opportunities to realize the full potential of technologies for creating new biological neural circuits.

Brain models present a viewpoint on the fundamental structural components of the brain and their mutual organization, generally relative to a particular concept of the brain axis. A model may be based on adult brain structure or on developmental morphogenetic aspects. Brain models usually have functional implications, depending on which functional properties derive from the postulated organization. This essay examines the present scenario about brain models, emphasizing the contrast between columnar or other longitudinal models and transverse subdivisional neuromeric models. In each case, the main functional implications and apparent problems are explored and commented. Particular attention is given to the modern molecularly based ‘prosomeric model’, which postulates a set of 20 transverse prosomeres as the developmental units that serve to construct all the cerebral parts and the particular typology of many different neuronal populations within the forebrain and the hindbrain, plus a number of additional spinal cord units. These metameric developmental units (serially repeated, but with unique molecular profiles) confer to this model remarkable functional properties based mainly on its multiplicity and modularity. Many important brain functions can be decomposed into subfunctions attended to by combined sets of neuronal elements derived from different neuromeres. Each neuromere may participate in multiple functions. Most aspects related to creation of precise order in neural connections (axonal navigation and synaptogenesis) and function is due to the influence of neuromeric anteroposterior and dorsoventral positional information. Research on neuromeric functionality aspects is increasing significantly in recent times.

Deep eutectic solvents (DESs) are one of the most rapidly evolving types of solvents, appearing in a broad range of applications such as nanotechnology, electrochemistry, biomass transformation, pharmaceuticals, membrane technology, biocomposite development, modern 3D-printing, and many others. The range of their applicability continues to expand, which demands the development of new DESs with improved properties. To do so requires an understanding of the fundamental relationship between the structure and properties of DESs. Computer simulation and machine learning techniques provide a fruitful approach as they can provide predictions, reveal physical mechanisms and readily be linked to experiments. This review is devoted to the computational research of DESs and describes technical features of DES simulations and the corresponding perspectives on various DES applications. The aim is to demonstrate the current frontiers of computational research of DESs and discuss future perspectives.

Neural microprobes represent an important component of neural prosthetic systems where implanted microprobes record the electro-potentials generated by specific thoughts in the brain and convey the signals to algorithms trained to interpret these thoughts. Here, we present novel elongated multi-site neural probe that can reach depths greater than 10mm. We hypothesize that reaching such depth allows the recording of cognitive signals required to drive cognitive prosthetics. The impedance of the recording sites on the probes was on the order of 500 kΩ at 1 kHz, which is consistent with probes used for neurophysiological recordings. The probes were made porous using Xenon Difluoride (XeF₂) dry etching to improve the biocompatibility and their adherence to the surrounding neural tissue. Numerical studies were performed to determine the reliability of the porous probes. We implanted the elongated probe in rats and show that the elongated probes are capable of simultaneously recording both spikes and local field potentials (LFPs) from various recording sites.

The study of the human psyche has elucidated a bipartite structure of logic reflecting the quantum--classical nature of the world. Accordingly, we posited an approach toward studying the brain by means of the quantum--classical dynamics of a mixed Weyl symbol. The mixed Weyl symbol can be used to describe brain processes at the microscopic level and, when averaged over an appropriate ensemble, can provide a link to the results of measurements made at the meso and macro scale. Within this approach, quantum variables (such as, for example, nuclear and electron spins, dipole momenta of particles or molecules, tunneling degrees of freedom, and so on) can be represented by spinors, whereas the electromagnetic fields and phonon modes can be treated either classically or semi-classically in phase space by also considering quantum zero-point fluctuations. Quantum zero-point effects can be incorporated into numerical simulations by controlling the temperature of each field mode via coupling to a dedicated Nos\'e-Hoover chain thermostat. The temperature of each thermostat was chosen in order to reproduce quantum statistics in the canonical ensemble. In this first paper, we introduce a general quantum--classical Hamiltonian model that can be tailored to study physical processes at the interface between the quantum and the classical world in the brain. While the approach is discussed in detail, numerical calculations are not reported in the present paper, but they are planned for future work. Our theory of brain dynamics subsumes some compatible aspects of three well-known quantum approaches to brain dynamics, namely the electromagnetic field theory approach, the orchestrated objective reduction theory, and the dissipative quantum model of the brain. All three models are reviewed.

Lung cancer (LC) stands as the foremost cause of cancer-related fatality rates worldwide. Early diagnosis significantly enhances patient survival rate. Nowadays, low dose computed tomography (LDCT) is widely employed on chest as a tool for large-scale lung cancer screening. Nonetheless, a large amount of chest radiographs causes an onerous burden on radiologists. Some computer-aided diagnostic (CAD) tools can provide insights to medical images for diagnosis and augmenting diagnostic speed. However, due to variation in parameter settings across different patients, substantial discrepancies in image voxels persist. We find different voxel-size causing a compromise between model generalization and diagnostic efficacy. This study investigates the performance disparities of diagnostic models trained on original images and LDCT images reconstructed to different voxel-sizes but isotropic. The application is to differentiate a nodule to be benign or malignant. Using 11 features, a support vector machine (SVM) is trained on LDCT images with an isotropic voxel having side-length of 1.5 mm for 225 patients in house. The result yields a favorable model performance with an accuracy of 0.9596 and an area under the receiver operating characteristic curve (ROC/AUC) of 0.9855. In addition to furnish CAD tools for clinical applications, future research is encouraged to include LDCT images from multi-centers.

During a multi-detector computed tomography (MDCT) examination, it is crucial to efficiently organize, store, and transmit medical images in DICOM standard, which requires significant hardware resources and memory. Our project processed large amounts of DICOM images by classifying them based on cross-section views that may carry important information about a possible diagnosis. We ensured that images were retained and saved in PNG format to optimize hardware resources while preserving patient confidentiality. Furthermore, we have developed a graphical, user-friendly interface that allows physicians to visualize specific regions of interest in a patient's brain where changes may indicate disease. Our proposed method enables quick classification of medical images into predefined classes of confirmed diseases of brain parenchyma, contributing to swift decision-making for further diagnosis for more precisely evaluating and characterizing brain changes, and it can lead to the rapid application of adequate therapy, which may result in better outcomes.

This paper explores the application of machine learning techniques for automated object grasping. Current electronic prosthetics often require extensive training for users to gain fine motor control over the prosthetic fingers, hindering their usability and acceptance. To address this challenge, this paper proposes an automated method that leverages computer vision-based techniques and machine learning algorithms. In this study, three reinforcement learning algorithms, namely Soft Actor-Critic (SAC), Deep Q-Network (DQN), and Proximal Policy Optimization (PPO), are employed to train agents for automated grasping tasks. The results indicate that the SAC algorithm achieves the highest success rate of 99% among the three algorithms at just under 200,000 timesteps. This research also shows that object’s physical characteristics can affect the agent’s ability to learn an optimal policy. Moreover, the findings highlight the potential of the SAC algorithm in developing intelligent prosthetic hands with automatic object gripping capabilities.

Learning programming is a complex and challenging task for many students. It in-volves both understanding theoretical concepts and acquiring practical skills. Hence, analyzing learners’ data from online learning environments alone fails to capture the full breadth of stu-dents’ actions if part of their learning process takes place elsewhere. Moreover, existing studies on learning analytics applied to programming education have mainly relied on frequency analysis to classify students according to their approach to programming or to predict academic achieve-ment. However, frequency analysis provides limited insights into the individual time-related characteristics of the learning process. The current study examines students’ strategies when learning programming, combining data from the learning management system and from an au-tomated assessment tool. To gain an in-depth understanding of students’ learning process as well as of the types of learners, we used learning analytics methods that account for the temporal order of learning actions. Our results show that students have special preferences for specific learning resources when learning programming, namely slides that support search, and copy and paste. We also found that videos are relatively less consumed by students, especially while working on programming assignments. Lastly, students resort to course forums to seek help only when they struggle.

Traumatic Brain Injury (TBI) remains a leading cause of morbidity and mortality among all ages; despite the advances, understanding pathophysiological responses after TBI is still complex, involving multiple mechanisms. Previous reviews have focused on potential targets; however, the research on potential targets has continuously grown in the last five years, bringing even more alternatives and elucidating previous mechanisms. Knowing the key and updated pathophysiology concepts is vital for adequate management and better outcomes. This article reviews the underlying molecular mechanisms, the latest updates, and future directions for pathophysiology-based TBI management.

We consider a random dynamical system arising in a model of associative memory. This system can be seen as a small (stochastic and deterministic) perturbation of a determinstic system having two weak attractors which are destroyed after the perturbation. We show, with a computer aided proof, that the system has a kind of chaotic itineracy. Typical orbits are globally chaotic, while they spend relatively long time visiting attractor's ruins.

The study of the brain networks using analysis of electroencephalography (EEG) data based on statistical dependencies (functional connectivity) and mathematical graph theory concepts is common in neuroscience and cognitive sciences for examinations of patient and healthy individuals. The Consciousness Fields according to Taheri theory and applications in the optimization of system under study have been investigated in various studies. In this study, we examine the results of working with Faradarmani Consciousness Field (FCF) in the brain of Faradarmangars. Faradarmangars are one of the necessary components in mind mediation of the function of Faradarmani Consciousness Fields according to Taheri. For this purpose, the functional and effective connectivity and the corresponding brain graphs of EEG from the brain of Faradarmangars is compared with that of non Faradarmangar groups during FCF connection. According to the results of the present study, the brain of the Faradarmangars shows significant decreased activity in delta (BA8), beta2 (BA4/6/8/9/10/11/32/44/47) and beta3 (in 34 of 52 BA) frequency bands mainly in frontal lobe and after that in parietal and temporal lobes in the comparison with the non Faradarmangars. Moreover, the functional and effective connectivity analysis in the frontal network shows dominant multiple decreased connectivity mainly in the case of beta3 frequency band in all parts of the frontal network. On the other hand, the graph theory analysis of the Faradarmangar brain shows an increase in the activity of the O2-T5-F4-F3-FP2-F8 areas and significant decrease in the characteristic path length and increases in global efficiency, clustering coefficient and transitivity. In conclusion, the unique higher graph function efficiency and the reduction in the brain activity and connectivity during the Faradarmani Consciousness Field mind mediation, shown the passive and detector like function of the human brain in this task.

This article reviews the introduction of Alzheimer's Disease (AD), neural networks, training and learning of neural networks, applications of neural networks in early diagnosis of AD, applications of neural networks in AD drug discovery, other brain diseases, and challenges faced by AD. First, the paper introduces the background and characteristics of AD. AD is a degenerative neurological disorder characterized by impaired memory, decreased cognitive function, and loss of neurons. These characteristics place a huge burden on the lives and families of patients. Next, the basic principle and structure of neural network are discussed. A neural network is a computational model made up of multiple neurons that can perform tasks by learning and adapting to input data. In particular, the key concepts of neural network hierarchy, activation function and weight adjustment are discussed. Then, the training and learning methods of neural networks are discussed. Common techniques such as backpropagation algorithm and gradient descent optimizer are introduced in detail, as well as the importance of data preprocessing and model evaluation. Next, the paper focuses on the application of neural network in early diagnosis of AD. By extracting features from brain image data, neural networks can automatically identify differences between AD patients and healthy subjects, enabling early diagnosis and intervention. In addition, the application of neural networks in AD drug discovery is also discussed. By analyzing and predicting a database of known drugs, neural networks can help discover potential treatments for AD and speed up the drug discovery process. The paper further explores the application of neural networks in other brain diseases and highlights the challenges faced by AD, such as the lack of reliable biomarkers, complex pathological mechanisms, etc. In summary, this paper presents a systematic overview of AD, neural networks, training and learning of neural networks, applications of neural networks in early diagnosis of AD and drug discovery, and other brain diseases and challenges associated with AD.

Survivors of severe brain injury may require care in a neurointensive care unit (neuro-ICU), where the brain is vulnerable to secondary brain injury. Thus, there is a need for noninvasive, bedside, continuous cerebral blood flow monitoring approaches in the neuro-ICU. Our goal is to address this need through combined measurements of EEG and functional optical spectroscopy (EEG-Optical) instrumentation and analysis to provide a complementary fusion of data about brain activity and function. The present case demonstrates in a patient with traumatic brain injury, noninvasive cerebral blood flow transients can be recorded that correlate with gold-standard invasive measurements and with the frequency content changes in the EEG data during clinical care.

An extensive review of literature simulations of polymer melts is given, considering results that test aspects of the Rouse model in the melt. We focus on the mean-square amplitudes < (X_p(0))^{2} > and time correlation functions < X_p(0) X_p(t) > of the Rouse modes $X_p(t)$. Contrary to the Rouse model: (i) Mean-square Rouse mode amplitudes < (X_p(0))^2> do not scale as sin^{-2}(p \pi/2N), N being the number of beads in the polymer. For small p (say, p <= 3) < (X_p(0))^2> scales with p as p^{-2}$; for larger p it scales as p^{-3}. (ii) Rouse mode time correlation functions < X_p(t) X_p(0) > do not decay with time as exponentials; they instead decay as stretched exponentials exp(-a t^b)$. b depends on p, typically with a minimum near N/2 or N/4. (iii) Polymer bead displacements are not described by independent Gaussian random processes. (iv) For p not equal to q, < X_p(t) X_{q}(0) > is sometimes non-zero. (v) The response of a polymer coil to a shear flow is a rotation, not the affine deformation predicted by Rouse. Simulations thus conclusively demonstrate that the Rouse model is invalid in polymer melts. We also briefly consider the Kirkwood-Riseman polymer model.