Nowadays, speed up development and use of digital devices such as smartphones have put people at risk of internet crimes. The evidence of present crimes in a computer file can be easily unreachable by changing the prefix of a file or other algorithms. In more complex cases, either file divided into different parts or the parts of a file that has information about the file type are deleted, where the file fragment recognition issue is discussed. The known files are divided into different fragments, and different classification algorithms to solve the problems of file fragment recognition. A confusion matrix measures the accuracy of type recognition. In the present study, first, the file is divided into different fragments. Then, the file fragment features, which are obtained from Binary Frequency Distribution (BFD), are reduced by 2 feature reduction algorithms; Sequential Forward Selection algorithm (SFS) as well as Sequential Floating Forward Selection algorithm (SFFS) to delete sparse features that result in increased accuracy and speed. Finally, the reduced features are given to 3 classifier algorithms, Multilayer Perceptron (MLP), Support Vector Machines (SVM), and K-Nearest Neighbor (KNN) for classification and comparison of the results. In this paper, we proposed the algorithm of file type recognition that can recognize 6 types of useful files ( pdf, txt, jpg, doc, html, exe), which may distinguish a type of file fragments with higher accuracy than the similar works done.

Over the years, there has been a significant rise in the world's scientific knowledge. However, most of it lacks structure and is often termed as Dark Data. Both humans and expert systems have continually faced difficulty in analyzing and comprehending such overwhelming amounts of information which is crucial in solving several real-world problems. Information and data visualization techniques proffer a promising solution to explore such data by allowing quick comprehension of information, the discovery of emerging trends, identification of relationships and patterns, etc. In this tutorial, we utilize the rich corpus of PubMed comprising of more than 30 million citations from biomedical literature to visually explore and understand the underlying key-insights using various information visualization techniques. With this study, we aim to diminish the limitation of human cognition and perception in handling and examining such large volumes of data by speeding up the process of decision making and pattern recognition and enabling decision-makers to fully understand data insights and make informed decisions.

Studies on crop response to light quality [red (R) to far-red (FR) light ratio] often recommend early weed removal to reduce the effects of shade avoidance responses on crop yield. However, it is unclear whether crops are able to distinguish reflected light quality of kin from that of non-kin. We evaluated the response of sugarbeet (Beta vulgaris L.) to reflected FR light from sugarbeet, common lambsquarters (Chenopodium album L.), Kentucky bluegrass (Poa pratensis L.), alfalfa (Medicago sativa L.), and bare soil (control) under outdoor conditions in 2016 and 2017. Treatments were completely randomized with 10 replications per treatment. The study methods ensured there was no direct resource competition. The reflected R:FR of plant species ranged from 0.06 (common lambsquarters) to 0.24 (sugarbeet) compared to 0.7 for the bare soil. In both 2016 and 2017, there were 2 to 4 more leaves in the sugarbeet surrounded by soil compared to sugarbeet surrounded by neighboring species. There was up to 47, 57, 43, and 23% reduction in sugarbeet leaf area, shoot dry weight, root diameter, and root dry weight, respectively, due to reflected R:FR light from neighboring species. Sugarbeet did not respond differently to reflected light quality of kin compared to non-kin.

Multi-floor environments are usually ignored while designing an autonomous robot for indoor cleaning applications. However, for efficient operation in such environments, the ability of a robotic platform to traverse staircases is crucial. Staircase detection and localization is highly important for planning the traversal on staircases. This paper describes a deep learning approach using Convolutional Neural Networks (CNNs) based Robot Operation System (ROS) to staircase detection and localization. We use an object detection network to detect staircases in images. We also localize these staircases using a contour detection algorithm to detect the target point, a point close to the center of the first step, and the angle of approach to the target point. Experiments are performed with data obtained from images captured on different types of staircases at different view points/angles. Results show that the approach is very accurate in identifying the presence of the staircase in the working environment and is also able to locate the target point with good accuracy.

A supramolecular host-guest interaction and sensing between cationic pillar[5]arenes (CP5) and L-carnitine were developed by the competitive host-guest recognition for the first time. The fluorescence sensing platform was constructed by CP5 functionalized Au nanoparticles (PP5@Au-NPs) as receptor and probe (rhodamine 123, R123), which shown a high sensitivity and selectivity to L-carnitine detection. Due to the property of the negative charge and molecular size of L-carnitine, it can be highly captured by the CP5 via electrostatic interactions and hydrophobic interactions. The mechanism of host-guest between PP5 and L-carnitine was studied by ¹H NMR and molecular docking, which indicated more affinity binding force of PP5 with L-carnitine. Therefore, a selective and sensitive fluorescent method was developed. It has a linear response of 0.1–2.0 and 2.0–25.0 μM and a detection limit of 0.067 μM (S/N = 3) for L-carnitine. The fluorescent sensing platform was also used to detect L-carnitine in human serum and milk samples, which provided potential applications of detection drugs of abuse, and had path for guarding a serious food safety issues.

This paper considers target characterization and recognition in radar images with keypoint-based local descriptor. Most of the preceding works rely on the global features or raw intensity values, and hence produce the limited recognition performance. Moreover, the global features are sensitive to the real-world sources of variability, such as aspect view, configu-ration, and incidence angle changes, clutter, articulation, and occlusion. Keypoint-based local descriptor was developed as a powerful strategy to address invariance to contrast change and geometric distortion. This property inspires us to investigate whether the family of local features are relevant for radar target recognition. Most of the preceding works typically devote to finding the correspondences between a collected image and a reference one. The representative applications include image register and change detection. Little work was pursued to target recognition in SAR images. This is because the huge number of local descriptors resulting from radar images make the computational cost and memory consumption unacceptable. To handle the problems, this paper develops two families of methods. The proposed methods are used to achieve target recognition by means of local descriptors. Our first solver refers to building multiple linear regression models, and addresses the problem by the theory of sparse representation. The second scheme rebuilds a new feature by the feature quantization skill, from which the inference can be drawn. Multiple comparative studies are pursued to verify the performance of detectors and descriptors popularly used. The source code was publicly released on https://ganggangdong.github.io/homepage/.

Proteases are integral enzymes of the plant immune system. Multiple aspects of defence are regulated by proteases, including the hypersensitive response, pathogen recognition, priming and peptide hormone release. These processes are regulated by unrelated proteases residing at different subcellular locations. In this review we discuss ten prominent plant proteases contributing to the plant immune system, highlighting the diversity of roles they perform in plant defence.

Exoskeletons designed to assist patients with activities of daily living are becoming increasingly popular, but still are subject to research. In order to gather requirements for the design of such systems, long-term gait observation of the patients over the course of multiple days in an environment of daily living are required. In this paper a wearable all-in-one data acquisition system for collecting and storing biomechanical data in everyday life is proposed. The system is designed to be cost efficient and easy to use, using off-the-shelf components and a cloud server system for centralized data storage. The measurement accuracy of the system was verified, by measuring the angle of the human knee joint at walking speeds between 3 and 12 km/h in reference to an optical motion analysis system. The acquired data was uploaded to a cloud database via a smartphone application. Verification results showed that the proposed toolchain works as desired. The system reached an RMSE from 2.9° to 8°, which is below most of the comparable system. The system provides a powerful, scalable platform for collecting and processing biomechanical data, which can help to automize the generation of an extensive database for human kinematics.

Visually impaired people encounter many impediments and challenges in their lives such as related to their mobility, education, communication, use of technology, and others. This paper reports the results of an online survey to understand the requirements and challenges blind and visually impaired people face in their daily lives regarding the availability and use of digital devices. The survey was conducted among the blind and visually impaired in Saudi Arabia using digital forms. A total of 164 people responded to the survey most of them using the VoiceOver function. People were asked about the use of smart devices, special devices, operating systems, object recognition apps, indoor and outdoor navigation apps, virtual digital assistive apps, the purpose (navigation, education, etc.) of and difficulty in using these apps, the type of assistance needed, the reliance on others in using the assistive technologies, and the level of satisfaction from the existing assistive technologies. The majority of the participants were 18 – 65 years old with 13% under 18 and 3% above 65. Sixty-five percent of the participants were graduates or postgraduates and the rest only had secondary education. White Cane, mobile phones, Apple iOS, Envision, Seeing AI, VoiceOver, and Google Maps were the most used devices, technologies, and apps used by the participants. Navigation at 39.6% was the most reported purpose of the special devices followed by education (34.1%) and office jobs (12.8%). The information from this survey along with a detailed literature review of academic and commercial technologies for the visually impaired was used to establish the research gap, design requirements, and a comprehensive understanding of the relevant landscape, which in turn was used to design smart glasses called LidSonic for visually impaired.

At present, indoor localization is one of the core technologies of location-based services (LBS), and there exist numerous scenario-oriented application solutions. Visual features, as the main semantic information to help people understand the environment and thus occupy the dominant part, many techniques about indoor scene recognition are widely adopted. However, the engineering application problem of cell phone indoor scene recognition and localization has not been well solved due to insufficient semantic constraint information of building map and the immaturity of building map location anchors (MLA) matching positioning technology. To address the above problems, this paper proposes a cell phone indoor scene recognition and localization method with building map semantic constraints. Firstly, we build a library of geocoded entities for building map location anchors (MLA), which can provide users with "immersive" real-world building maps on the one hand and semantic anchor point constraints for cell phone positioning on the other. Secondly, using the improved YOLOv5s deep learning model carried on the mobile terminal, we recognize the universal map location anchors (MLA) elements in building scenes by cell phone camera video in real-time. Lastly, the spatial location of the scene elements obtained from the cell phone video recognition is matched with the building MLA to achieve real-time positioning and navigation. The experimental results show that the model recognition accuracy of this method is above 97.2%, and the maximum localization error is within the range of 0.775 m, and minimized to 0.5 m after applying the BIMPN road network walking node constraint, which can effectively achieve high positioning accuracy in the building scenes with rich MLA element information. In addition, the building map location anchors (MLA) has universal characteristics, and the positioning algorithm based on scene element recognition is compatible with the extension of indoor map data types, so this method has good prospects for engineering applications.

We employed the Riemannian Face Manifold (RFM) as an alternative approach to the conventional linear Euclidean space for explaining the atypicality bias in face likeliness judgments. The RFM posits that the mental representation of faces is better captured as a manifold of stable states, accounting for the nonlinearity in the physical properties of faces. To examine the relationship between physical and psychological distance of morph and typical/atypical faces, we manipulated the parameter k and incorporated a weight function in the Riemannian metric. Our results indicate that the psychological distance between the morph and typical face was longer than that between the morph and atypical face, consistent with prior research on the atypicality bias in perceptual similarity. The RFM approach provides mathematical support and is a powerful tool for studying face perception and recognition, offering potential implications for explaining the other-race effect. Future research can utilize the RFM to investigate individual differences in face recognition abilities and expertise, and how they impact psychological distance and face processing.

Chinese calligraphy, revered globally for its therapeutic and mindfulness benefits, encompasses styles such as Regular (Kai Shu), Running (Xing Shu), Official (Li Shu), and Cursive (Cao Shu) scripts. Beginners often start with Regular script, advancing to more intricate styles like Cursive. Each style, marked by unique historical calligraphers' contributions, requires learners to discern distinct nuances. The integration of AI in calligraphy analysis, collection, recognition, and classification are pivotal. This study introduces an innovative Convolutional Neural Network (CNN) architecture, pioneering the application of CNN in the classification of Chinese calligraphy. Focusing on the four principal calligraphers' styles from the Tang dynasty (690-907 A.D), this research spotlights the era when the traditional regular script font (Kai Shu) was refined. A comprehensive dataset of 8282 samples from these calligraphers, representing the zenith of regular style, was compiled for CNN training and testing. The model distinguishes personal styles for classification, showing superior performance over existing networks. Achieving 89.5-96.2% accuracy in calligraphy classification, our approach underscores the significance of CNN in both font and artistic style categorization. This research paves the way for advanced studies in Chinese calligraphy and its cultural implications.

Facial expression recognition is crucial for understanding human emotions and nonverbal communication. With the growing prevalence of facial recognition technology and its various applications, accurate and efficient facial expression recognition has become a significant research area. However, most previous methods have focused on designing unique deep-learning architectures while overlooking the loss function. This study presents a new loss function that allows simultaneous consideration of inter- and intra-class variations to be applied to CNN architecture for facial expression recognition. More concretely, this loss function reduces the intra-class variations by minimizing the distances between the deep features and their corresponding class centers. It also increases the inter-class variations by maximizing the distances between deep features and their non-corresponding class centers, and the distances between different class centers. Numerical results from several benchmark facial expression databases, such as Cohn-Kanade Plus, Oulu-Casia, MMI, and FER2013, are provided to prove the capability of the proposed loss function compared with existing ones.

The angle of seismic excitation is a significant factor of the seismic response of RC buildings. The procedure required for the calculation of the angle for which the potential seismic damage is maximized (critical angle) contains multiple nonlinear time history analyses using in each one of them different angles of incidence. Moreover, the seismic codes recommend the application of more than one accelerograms for the evaluation of seismic response. Thus, the whole procedure becomes time consuming. Herein, a method to reduce the time required for the estimation of the critical angle based on Multilayered Feedforward Perceptron Neural Networks is proposed. The basic idea is the detection of cases in which the critical angle increases the class of seismic damage compared to the class which arises from the application of the seismic motion along the buildings’ structural axes. To this end, the problem is expressed and solved as Pattern Recognition problem. As inputs of networks the ratios of seismic parameters’ values along the two horizontal seismic records' components, as well as appropriately chosen structural parameters, were used. The results of analyses show that the neural networks can reliably detect the cases in which the calculation of the critical angle is essential.

Even today, the automatic digitisation of scanned documents in general but especially the automatic optical music recognition (OMR) of historical manuscripts still remain an enormous challenge, since both handwritten musical symbols and text have to be identified. This paper focuses on the Medieval so-called square notation developed in the 11th-12th century, which is already composed of staff lines, staves, clefs, accidentals, and neumes, that are roughly spoken connected single notes. The aim is to develop an algorithm that captures both the neume and pitch, that is melody information that can be used to reconstruct the original writing. Our pipeline is similar to the standard OMR approach and comprises a novel staff line and symbol detection algorithm, based on deep Fully Convolutional Networks (FCN), which perform pixel-based predictions for either staff lines or symbols and their respective types. Then, the staff line detection combines the extracted lines to staves and yields an F1-score of over 99% for both detecting lines and complete staves. For the music symbol detection we choose a novel approach that skips the step to identify neumes and instead directly predicts note components (NCs) and their respective affiliation to a neume. Furthermore, the algorithm detects clefs and accidentals. Our algorithm recognises these symbols with an F1-score of over 96% if the type is ignored and predicts the true symbol sequence of a staff with a diplomatic symbol accuracy rate (dSAR) of about 87%. If only the NCs without their respective connection to a neume, all clefs, and accidentals are of interest the algorithm reaches an harmonic symbol accuracy rate (hSAR) of approximately 90%.

Human footprint is having a unique set of ridges unmatched by any other human being, and therefore it can be used in different identity documents for example birth certificate, Indian biometric identification system AADHAR card, driving license, PAN card, and passport. There are many instances of the crime scene where an accused must walk around and left the footwear impressions as well as barefoot prints and therefore it is very crucial to recovering the footprints to identify the criminals. Footprint-based biometric is a considerably newer technique for personal identification. Fingerprints, retina, iris and face recognition are the methods most useful for attendance record of the person. This time world is facing the problem of global terrorism. It is challenging to identify the terrorist because they are living as regular as the citizens do. Their soft target includes the industries of special interests such as defense, silicon and nanotechnology chip manufacturing units, pharmacy sectors. They pretend themselves as religious persons, so temples and other holy places, even in markets is in their targets. These are the places where one can obtain their footprints easily. The gait itself is sufficient to predict the behaviour of the suspects. The present research is driven to identify the usefulness of footprint and gait as an alternative to personal identification.

Designing motion representations for the problem of 3D human action recognition from skeleton sequences is an important yet challenging task. An effective representation should be robust to noise, invariant to viewpoint changes and result in a good performance with low-computational demand. Two main challenges in this task include how to efficiently represent spatio-temporal patterns of skeletal movements and how to learn their discriminative features for classification task. This paper presents a novel skeleton-based representation and a deep learning framework for 3D action recognition using RGB-D sensors. We propose to build an action map called SPMF (Skeleton Posture-Motion Feature), which is a compact image representation built from skeleton poses and their motions. An Adaptive Histogram Equalization (AHE) algorithm is then applied on the SPMF to enhance their local patterns and form an enhanced action map, namely Enhanced-SPMF. For learning and classification tasks, we exploit Deep Convolutional Neural Networks based on the DenseNet architecture to learn directly an end-to-end mapping between input skeleton sequences and their action labels via the Enhanced-SPMFs. The proposed method is evaluated on four challenging benchmark datasets, including both individual actions, interactions, multiview and large-scale datasets. The experimental results demonstrate that the proposed method outperforms previous state-of-the-art approaches on all benchmark tasks, whilst requiring low computational time for training and inference.

Synesthesia is a psychological phenomenon where sensory signals become mixed. Input to one sensory modality produces an experience in a second, unstimulated modality. In “grapheme-color synesthesia”, viewed letters and numbers evoke mental imagery of colors. The study of this condition has implications for increasing our understanding of brain architecture and function, language, memory and semantics, and the nature of consciousness. In this work, we propose a novel application deep learning to model perception in grapheme-color synesthesia. Achromatic letter images, taken from database of handwritten characters, are used to induce synesthesia. Results show the model learns to accurately create a colored version of the inducing stimulus, according to a statistical distribution from experiments on a sample population of grapheme-color synesthetes. The spontaneous, creative mental imagery characteristic of the synesthetic perceptual experience is reproduced by the model. A model of synesthesia that generates testable predictions on brain activity and behavior is needed to complement large scale data collection efforts in neuroscience, especially when articulating simple descriptions of cause (stimulus) and effect (behavior). The research and modeling approach reported here begins to address this need.

This study aims to develop an elderly care system for improving the interpersonal relationship of the elderly with mild cognitive impairment (MCI) by employing the speaker recognition technique and association functionality of social network platforms. Firstly, the speaker recognition units based on the Gaussian Mixture Model (GMM) and Gaussian Mixture Model-Universal Background Model (GMM-UBM) are implemented to identify the visitor via individual input utterance. After the visitor is identified, the proposed system will be linked to the private database and social network platforms to extract the associated message of two parties. Experimental results indicate that the speaker recognition unit based on GMM-UBM achieves the best performance. Finally, five elderly persons are invited to measure the usability of the proposed system. A questionnaire is used to survey the five elderly persons, and the result indicates that the proposed system is highly potentially applicable in improving the interpersonal relationship of the elderly with MCI.

Previous studies to recognize negative emotions (e.g. disgust, fear, sadness) for mental health care have used heavy equipment directly attaching electroencephalogram (EEG) electrodes to the head, making it difficult to use in daily life, and they have proposed binary classification methods to determine whether negative emotion or not. To tackle this problem, we propose a negative emotion recognition system to collect multimodal biosignal data such as five EEG signals in an EEG headset and heart rate, galvanic skin response, and skin temperature in a smart band for classifying multiple negative emotions. It consists of android Internet of Things (IoT) application, an oneM2M-compliant IoT server, and a machine learning server. The android IoT application upload the biosignal data to the IoT server. By using the biosignal data stored in the IoT server, the machine learning server recognizes the negative emotions of disgust, fear, and sadness using a multi-class support vector machine (SVM) model with a radial basis function kernel (RBF). The experimental results showed that the multi-class SVM model achieved 93% accuracy when considering all the multimodal biosignal data. Moreover, when considering only data in the smart band, it could achieve 98% accuracy by optimizing the hyper-parameter of the RBF kernel.

Porcine epidemic diarrhea virus (PEDV) has caused great damage to the global pig industry. The innate immunity plays a significant role in resisting viral infection, however, the exact role of innate immunity in the anti-PEDV response has not been fully elucidated. In this study, we observed that various porcine innate immune signaling adaptors are involved in the anti-PEDV activity. Among these, TRIF and MAVS showed the strongest anti-PEDV activity. The endogenous TRIF, MAVS and STING were selected for further examination of anti-PEDV activity. Agonist stimulation experiments showed that TRIF, MAVS and STING signaling all have obvious anti-PEDV activity. The siRNA knockdown assay showed that TRIF, MAVS and STING are also all involved in anti-PEDV response, and their remarkable effects on PEDV replication were confirmed in TRIF-/-, MAVS-/- and STING-/- Vero cells. For further verification, the anti-PEDV activity of TRIF, MAVS and STING could be reproduced in porcine IPEC-DQ cells. In summary, this study reveals that multiple pattern recognition receptor (PRR) signaling pathways of porcine innate immunity play an important role in the anti-PEDV infection, providing new and useful antiviral knowledge for prevention and control of PEDV spreading.

With the development of artificial intelligence technology, manipulators, as an important part of the work of intelligent robots, can replace humans to perform various complex tasks. In recent years, there have been many studies on the remote control of manipulators using various control technologies. Starting from the manufacturing materials of flexible sensors used for manipulators, this paper introduces the base materials, sensing materials, and flexible electrode materials of flexible sensors, respectively, and summarizes the performance of flexible sensors made based on the characteristics of different materials. The basic principles of dipping and coating, lithography, inkjet printing, screen printing, 3D printing and so on are introduced from the perspective of flexible sensor manufacturing process. Some different functions of sensors achieved by different structural designs, such as: tensile cracking, microchannels, etc. are also introduced. Then, from the perspective of recognition accuracy of the manipulator, two kinds of control methods based on flexible sensor by data glove control and surface EMG control are classified and introduced, and the problems existing in three aspects of flexible sensor material preparation, manufacturing process and control series design are summarized. Finally, the possible future research directions in this field are suggested.

Speech emotion recognition is a critical component for achieving natural human-robot interaction. The modulation-filtered cochleagram is a feature based on auditory modulation perception, which contains multi-dimensional spectral-temporal modulation representation. In this study, we propose an emotion recognition framework that utilizes a multi-level attention network to recognize emotions from the modulation-filtered cochleagram. The channel-level attention and spatial-level attention modules are used to capture emotional saliency maps of channel and spatial feature representations from the 3D convolution feature maps, respectively. Furthermore, the temporal-level attention module captures significant emotional regions from the concatenated feature sequence of the emotional saliency maps. Our experiments on the IEMOCAP dataset demonstrate that the modulation-filtered cochleagram significantly improves the prediction performance of categorical emotion compared to other evaluated features. Moreover, our emotion recognition framework achieves a better unweighted accuracy of 71% in categorical emotion recognition than several existing approaches in the experiments. In summary, our study demonstrates the effectiveness of the modulation-filtered cochleagram in speech emotion recognition, and our proposed multi-level attention framework provides a promising direction for future research in this field.

In the context of Shared Autonomous Vehicles, the need to monitor the environment inside the car will be crucial. This article focuses on the application of deep learning algorithms to detect objects, namely lost/forgotten items to inform the passengers, and aggressive items to monitoring if violent actions may arise between passengers. For object detection algorithms was used public datasets (COCO and TAO) to train state-of-the-art algorithms, such as YOLOv5. For violent action detection was used the MoLa InCar dataset to train on state-of-the-art algorithms such as I3D, R(2+1)D, SlowFast, TSN and TSM. At the end an embedded automotive solution was used to demonstrate both methods running in real-time.

In the current manuscript, a novel software application for Rapid Damage Assessment of RC buildings subjected to earthquake excitation is presented based on Artificial Neural Networks. The software integrates the use of a novel deep learning methodology for Rapid Damage Assessment into modern software development platforms, while the developed graphical user interface promotes the ease of use even from non-experts. The aim is to foster actions both in the pre- and post- earthquake phase. The structure of the source code permits the usage of the application either autonomously as a software tool for Rapid Visual Inspections of buildings prior to or after a strong seismic event or as a component of Building Information Modelling systems in the framework of digitizing building data and properties. The methodology implemented for the estimation of the RC buildings’ damage states is based on the theory and algorithms of Pattern Recognition problems. The effectiveness of the developed software is successfully tested using an extended, numerically generated database of RC buildings subjected to recorded seismic events

The 21st century, where all things are depending upon technology, almost all the human tasks are being done with the help of technology to save a lot of time and make our life much more comfortable. The monitoring of students’ attendance is a crucial task for faculty in today’s world. There are more chances of errors while entering the students’ attendance records in the primary system, primarily when the class was over. The main concern of this study is to build an IoT-based automated attendance management system for educational institutes by biometric recognition to incorporate fake/proxy attendance and errors of entry and to replace old manual methods of taking students’ attendance by calling their names or roll numbers. The AAS will click the image of the classroom, and it will automatically detect the faces of students sitting in the lecture room and recognize them during lectures then mark their attendance daily to keep a record of their presence and also maintain and manage it for the management staff of the institution for future by using web services.

Animal welfare is not only an ethically important consideration in good animal husbandry, but can also have a significant effect on an animal’s productivity. The aim of this paper is to show that a reduction in animal welfare, in the form of increased stress, can be identified in pigs from frontal images of the animals. We train a Convolutional Neural Network (CNN) using a leave-one-out design and show that it is able to discriminate between stressed and unstressed pigs with an accuracy of >90% in unseen animals. Grad-CAM is used to identify the animal regions used, and these support those used in manual assessments such as the Pig Grimace Scale. This innovative work paves the way for further work examining both positive and negative welfare states with a view to the development of an automated system that can be used in precision livestock farming to improve animal welfare.

Cardiovascular disease (CVD) may sometimes unexpected loss of life. It affects the heart and blood vessels of body. CVD plays an important factor of life since it may cause death of human. It is necessary to detect early of this disease for securing patients life. In this chpter two exclusively different methods are proposed for detection of heart disease. The first one is Pattern Recognition Approach with grammatical concept and the second one is machine learning approach. In the syntactic pattern recognition approach initially ECG wave from different leads is decomposed into pattern primitive based on diagnostic criteria. These primitives are then used as terminals of the proposed grammar. Pattern primitives are then input to the grammar. The parsing table is created in a tabular form. It finally indicates the patient with any disease or normal. Here five diseases beside normal are considered. Different Machine Learning (ML) approaches may be used for detecting patients with CVD and assisting health care systems also. These are useful for learning and utilizing the patterns discovered from large databases. It applies to a set of information in order to recognize underlying relationship patterns from the information set. It is basically a learning stage. Unknown incoming set of patterns can be tested using these methods. Due to its self-adaptive structure Deep Learning (DL) can process information with minimal processing time. DL exemplifies the use of neural network. A predictive model follows DL techniques for analyzing and assessing patients with heart disease. A hybrid approach based on Convolutional Layer and Gated-Recurrent Unit (GRU) are used in the paper for diagnosing the heart disease.

With the evolution of computing technology in many application like human robot interaction, human computer interaction and health-care system, 3D human body models and their dynamic motions has gained popularity. Human performance accompanies human body shapes and their relative motions. Research on human activity recognition is structured around how the complex movement of a human body is identified and analyzed. Vision based action recognition from video is such kind of tasks where actions are inferred by observing the complete set of action sequence performed by human. Many techniques have been revised over the recent decades in order to develop a robust as well as effective framework for action recognition. In this survey, we summarize recent advances in human action recognition, namely the machine learning approach, deep learning approach and evaluation of these approaches.

The identification of bloodstain is one of the most important approaches in obtaining evidence in criminalistics. A threshold method based on spectral co-efficient and interclass variance is proposed in this paper, it is a non-contact, non-destructive method for quickly identifying bloodstains. The spectra of bloodstains and other suspected substances were all extracted from their hyper-spectral image. Then calculate the correlation coefficients of these spectral and interclass variances, analyze the differences between substances. The best blood recognition threshold was determined as 0.9. After preprocessing for eliminating systematic errors, experiments with the threshold 0.9 are carried out to identify bloodstains on the calico and red T-shirt. The method can remarkably identify the bloodstain from other non-blood substances both quickly and efficiently. The blood extraction rate can reach to 93.35% and 89.19%, respectively. It is an important step toward the implementation of bloodstain non-contact and non-destructive identification in forensic casework.

Nowadays, the combination of fingerprinting methodology with friendly environmental and economical analytical instrumentation are becoming increasingly relevant in the food sector. In this study, a highly versatile portable analyser based on Spatially Offset Raman Spectroscopy (SORS) to obtain the edible vegetable oils (sunflower and olive oils) fingerprints was used to evaluate the capability of such fingerprints, obtained quickly, reliable and without any sample treatment, to discriminate/classify the analysed samples. After data treatment, not only HCA and PCA as unsupervised pattern recognition techniques but also SVM, kNN and SIMCA as supervised pattern recognition techniques, showed that the main effect over the discrimination/classification was associated to those regions of RAMAN fingerprint related to the free fatty acids content, especially oleic and linoleic acid. These facts allowed the discrimination attending to the original raw material used in the oil's elaboration. In all the model established, reliable qualimetric parameters were obtained.

Stroke is a global leading cause of death and disability. Knowledge of related guidelines is crucial for Emergency Department (ED) staff, influencing early diagnosis and timely treatment. We investigated Greek-Cypriot ED healthcare professionals' (nurses and physicians) knowledge in recognizing and managing stroke. A descriptive cross-sectional study spanned November 2019 to April 2020, encompassing four private and seven public EDs in the Republic of Cyprus. The data were collected through a self-reported questionnaire developed by the research team, consisting of 37 questions. Eight questions focused on sociodemographic and employment characteristics, 28 assessed knowledge in stroke recognition and management (each item was equally weighted without deliberate prioritization), and one question addressed self-assessment of knowledge in stroke care. 255 nurses [Response Rate (RR): 74.1%] and 26 physicians (RR: 47.3%) completed the questionnaire. The average correct response rate was 12.9 out of 28 statements (SD: 4.2), with nurses and physicians scoring 12.6 (SD: 4.1) and 15.7 (SD: 4), respectively. Work experience significantly influenced stroke knowledge, with all groups demonstrating superiority over those with less than one year of experience. Participants with previous training scored an average of 1.45 additional correct answers while educational attainment did not significantly influence stroke knowledge. Investigating stroke knowledge among Emergency Department nurses and physicians in the Republic of Cyprus revealed significant deficits. The study stresses targeted interventions, including, education, yearly examinations, workshops with hands-on training, and repeated training, to address these gaps and enhance the overall stroke care capabilities of the healthcare professionals.

Fermatean fuzzy sets (FFSs) are a versatile tool for handling uncertain problems and have shown great effectiveness in practical applications. However, many existing Fermatean fuzzy similarity measures exhibit counter-intuitive situations, making it challenging to accurately measure the similarity or difference between FFSs. To address this issue, several similarity and distance measures for FFSs are proposed, inspired by the Tanimoto similarity measure. The properties of the proposed measures are also explored, along with several comparative examples with existing measures for FFSs, which illustrate their superior performance in processing fuzzy information from FFSs. The proposed measures have effectively overcome the counter-intuitive challenges posed by many existing measures and significantly outperforms existing measures in differentiating different FFSs. Furthermore, we demonstrate the practical applicability of the proposed measures in solving pattern recognition, medical diagnosis and multiple-attribute decision-making problems.

This article introduces ten similarity measures that utilize cosine and cotangent functions to compare (m,n)-rung orthopair fuzzy sets, this a super class of q-rung orthopair fuzzy sets. Further, we applied our established weighted similarity measures to medical diagnosis, pattern recognition,and building material problems and also presented the comparison between established measures with the existing cosine and cotangent measures of q-rung orthopair, pythagorean and intuitionistic fuzzy sets. Lastly, we considered a numerical example that demonstrates the effective and scientific application of these similarity measures in plant leaf disease classification. Furthermore, we present graphical interpretations to demonstrate the effectiveness of our established measures.

Theories of reading comprehension emphasize decoding and listening comprehension as two essential components. The current study aimed to investigate how Chinese character decoding and context-driven auditory semantic integration contribute to reading comprehension in Chinese middle school students. Seventy-five middle school students were tested. Context-driven auditory semantic integration was assessed with speech-in-noise tests in which the fundamental frequency (F0) contours of spoken sentences were either kept natural or acoustically flattened with the latter requiring a higher degree of contextual information. Statistical modelling with hierarchical regression was conducted to examine the contributions of Chinese character decoding and context-driven auditory semantic integration to reading comprehension. Performance on Chinese character decoding and auditory semantic integration scores with the flattened (but not natural) F0 sentences significantly predicted reading comprehension. Furthermore, the contributions of these two factors to reading comprehension were better fitted with an additive model instead of a multiplicative model. These findings indicate that reading comprehension in middle schoolers is associated with not only character decoding but also the listening ability to make better use of the sentential context for semantic integration in a severely degraded speech-in-noise condition. The results add to our better understanding of the multi-faceted reading comprehension in children. Future research could further address the age-dependent development and maturation of reading skills by examining and controlling other important cognitive variables, and apply neuroimaging techniques such as functional magmatic resonance imaging to reveal the neural substrates for the contribution of auditory semantic integration and the observed additive model to reading comprehension.

In response to the growing inspection demand exerted by process automation in component manufacturing, Non-destructive testing (NDT) continues to explore automated approaches that utilize deep learning algorithms for defect identification, including within digital X-ray radiography images. This necessitates a thorough understanding of the implication of image quality parameters on the performance of these deep learning models. This study investigates the influence of two image quality parameters, namely Signal-to-Noise Ratio (SNR) and Contrast-to-Noise Ratio (CNR), on the performance of U-net deep learning segmentation model. Input images were acquired with varying combinations of exposure factors such as kilovoltage, milli-ampere, and exposure time, which altered the resultant quality. The data was sorted into 5 different datasets according to their measured SNR and CNR values. The deep learning model was trained 5 distinct times, utilizing a unique dataset for each training session. Training the model with high CNR values yielded an intersection over Union (IoU) metric of 0.9594 on test data of the same category but drops to 0.5875 when tested on lower CNR test data. The result in this study emphasizes the importance of achieving a balance in training dataset according to the investigated quality parameters, to enhance the performance of deep learning segmentation models in NDT radiography applications.

1) Background: Recently, illegal abuse of γ-hydroxybutyric acid (GHB) has increased in drug-facilitated crimes, but determination of GHB exposure and intoxication is difficult due to rapid metabolism of GHB. Its biochemical mechanism has not been completely investigated. And metabolomic study by polyamine profile and pattern analyses was not performed in rat urinefollowing intraperitoneal injection with GHB. 2) Methods: Polyamine profiling analysis by gas chromatography-mass spectrometry combined with star pattern recognition analysis was performed in this study. Multivariate statistical analysis was used to evaluate discrimination between control and GHB administration groups. 3) Results: Six polyamines were determined in control, single and multiple GHB administration groups. Star pattern showed distorted hexagonal shapes with characteristic and readily distinguishable patterns for each group. N¹-Acetylspermine (p < 0.001), putrescine (p <0.006), N¹-acetylspermidine (p <0.009), and spermine (p < 0.027) were significantly increased in single administration group but were significantly lower in the multiple administration group than in the control group. N¹-Acetylspermine was the main polyamine for discrimination between control, single and multiple administration groups. Spermine showed similar levels in single and multiple administration groups. 4) Conclusions: The polyamine metabolic pattern was monitored in GHB administration groups. N¹-Acetylspermine and spermine were evaluated as potential biomarkers of GHB exposure and addiction.

Hand and arm gesture recognition using radio frequency (RF) sensing modality proves valuable in man-machine interface and smart environment. In this paper, we use time series analysis method for accurately measuring the similarity of the micro-Doppler (MD) signatures between the training and test data, thus providing improved gesture classification. We characterize the MD signatures by the maximum instantaneous Doppler frequencies depicted in the spectrograms. In particular, we apply the dynamic time warping (DTW) method and compare its performance with that of the long short-term memory (LSTM) network. Both methods take into account the values as well as the temporal evolution and trends of time series data. It is shown that the DTW method achieves high gesture classification rates and is robust to time misalignment.

Phenol is added to acetophenone (methyl phenyl ketone) and to six of its halogenated derivatives in a supersonic jet expansion to determine the hydrogen bonding preference of the cold and isolated 1:1 complexes by linear infrared spectroscopy. Halogenation is found to have a pronounced effect on the docking site in this intermolecular ketone balance experiment. The spectra unambiguously decide between competing variants of phenyl group stacking due to their differences in hydrogen bond strength. Structures where the phenyl group interaction strongly distorts the hydrogen bond are more difficult to quantify in the experiment. For unsubstituted acetophenone, phenol clearly prefers the methyl side despite a predicted sub-kJ/mol advantage which is nearly independent of zero point vibrational energy, turning this complex into a challenging benchmark system for electronic structure methods which include long range dispersion interactions in some way.

Accurate and robust deep learning models for facial expression recognition are challenging to achieve, given the diversity of human faces and variations in images, including different facial poses and lighting conditions. In this work, we proposed a clock-driven convolutional Spiking Neural Network (SNN) and STDP fine-tune architecture, meticulously calibrated its hyperpa-rameters, and experimented with various optimization methods. The best model resulted was trained and evaluated on the Fer2013 and FER+ database, obtaining an accuracy of 61.87% and 79.97% without requiring auxiliary training data or face registration. To our best knowledge, the proposed SNN achieved comparable accuracy to CNNs of similar depth and possessed advantages of low energy consumption and high computational efficiency. The computational efficiency of the proposed SNN is approximately three times that of CNNs. Along with this, we introduced the very recent cumulative spike guided encoder visualization technique and revealed the strong encoding capability of the proposed SNN.

Machine learning is a fundamental aspect of artificial intelligence that involves the development of algorithms and models that allow computers to learn and make predictions or decisions without explicit programming. With the development of neural networks, back-propagation algorithms and deep learning, machine learning has made breakthroughs in the fields of image recognition, natural language processing and handwriting recognition using machine learning techniques. The advent of deep learning has revolutionized the field of handwriting recognition, using convolutional neural networks, recurrent neural networks, and sequence-to-sequence models to provide solutions that go beyond machine learning methods and significantly improve the accuracy and robustness of handwriting recognition systems. But challenges remain, including the need for large labelled datasets, computational resources and addressing potential biases. As research in deep learning techniques continues to drive handwriting recognition closer towards realisability, machine learning approaches remain at the forefront.

Autonomous target recognition (ATR) plays a crucial role in maintaining situational awareness during environmental monitoring. Unmanned aerial vehicles (UAVs) equipped with autonomous target recognition technology can gather and analyze real-time information about targets, including their locations, sizes, and types. However, UAV-captured images in complex real-world environments often display significant variations in perspective and scale due to changes in UAV altitude and distance. Existing methods for autonomous target recognition on UAVs struggle to capture targets from large field-of-view and multi-scale images, resulting in low recognition accuracy and high false-positive rates. This paper introduces two novel Slimmable neural network models, namely SE-YOLOv5s and ST-YOLOv5s, which are based on the YOLOv5s architecture. These models incorporate the Squeeze and Excitation and Swin-Transformer mechanisms to enhance the ability to extract features from large field-of-view and multi-scale images. To evaluate their performance, experiments were conducted on the Visdrone19 aerial dataset. Compared to the state-of-the-art YOLOv5s algorithm, the utilization of SE-YOLOv5s and ST-YOLOv5s for autonomous target recognition on low-altitude drones resulted in improvements in both accuracy and false-positive rates. These proposed methods combine Slimmable neural network design with feature enhancement mechanisms, addressing the challenges posed by complex real-world environments in UAV missions. The advancements in autonomous target recognition on low-altitude drones will significantly contribute to enhancing situational awareness in future environmental monitoring.

Accurate prediction of the degree of airport delays under the influence of convective weather is crucial for collaborative traffic management implementation and improving the efficiency of airport operations. However, existing studies usually only consider numerical-type quantitative features of weather-affected traffic in their models, and lack the introduction of spatial information to comprehensively portray the traffic operation scenarios under the influence of weather. In order to overcome this problem, this paper firstly designs a new image representation of weather-affected air traffic, and constructs a multi-channel traffic and weather scene image (MTWSI) by populating the airspace two-dimensional grid with traffic and meteorological information to represent the overall traffic operation situation in the terminal area under the influence of convective weather; then, a deep convolutional neural network-based airport delay prediction model ( ADLCNN), which takes MTWSI images as input and uses a specific CNN model to extract the deep features that affect traffic operation in it to input into the subsequent classification algorithm to predict the flight delay level; finally, a series of comparative experiments are carried out on the operational data of Guangzhou Baiyun Airport, and the experimental validation shows that, compared with the traditional machine learning methods, the proposed CNN-based airport delay prediction The experimental validation shows that the proposed CNN-based airport delay prediction model has satisfactory prediction performance compared with the traditional machine learning methods, which also proves that the proposed MTWSI method can more comprehensively respond to the real traffic conditions.

Human activity recognition (HAR) using wearable sensors is gaining popularity in the healthcare domain, enabling continuous monitoring and timely interventions. The conventional HAR systems are centralised and need data sharing with a server for processing and model training. However, this data sharing leads to various challenges, such as privacy concerns, increased communication and storage costs, inefficient computational algorithms, data scarcity due to unwillingness to share, and difficulty achieving high accuracy and personalised models simultaneously. To overcome these challenges, this paper introduces a privacy and energy-aware federated learning (FL) framework for model training without data sharing. The proposed scheme incorporates spiking neural networks (SNNs), which are particularly suited for resource-constrained devices due to their event-driven information processing. The key idea is to synergise the strengths of SNNs and long short-term memory (LSTM) to create a hybrid model for robust HAR. The proposed hybrid spiking LSTM (S-LSTM) model uses the LSTM as an input layer to capture temporal dependencies efficiently, followed by spiking layers that replace the typical activation using leaky integrate-and-fire neurons. We employ the combination of surrogate gradient learning and backpropagation through time (BPTT) to update the weights of SNN layers in a supervised manner. The performance of the proposed model is evaluated using two publicly available datasets for both indoor and outdoor scenarios. The results show that the proposed S-LSTM performs much better than spike convolutional neural networks (S-CNN) and simple CNN, achieving the accuracy of 97% and 87% for indoor and outdoor datasets, respectively. Personalisation, also known as fine-tuning the global model using local data, is crucial in HAR. It allows the model to adapt to individual behaviour and preferences, making predictions more accurate. The results also show that personalisation improves the performance of participants up to 9% on average. Additionally, analysis with 50% random client participation reduces communication costs by 50% with minimal impact on accuracy.

Purpose: School-age children with autism spectrum conditions (ASC) often experience difficulties in speech-in-noise (SiN) perception, leading to increased listening effort that impacts their well-being and academic performance. This study aimed to investigate the SiN processing challenges faced by Mandarin-speaking children with ASC and its impact on their listening effort. Methods: Participants completed sentence recognition tests in both quiet and noisy conditions, with a steady-state noise masker presented at 0 dB signal-to-noise ratio in the noisy condition. We compared recognition accuracy and task-evoked pupil responses from 23 Mandarin-speaking children with ASC to 19 age-matched neurotypical (NT) counterparts to gauge their behavioral performance and listening effort during these auditory tasks. Results: The ASC group demonstrated notably decreased accuracy in noise compared to their NT peers, suggesting poorer SiN perception. Pupillometric data further revealed significantly larger peak dilations in the ASC group than in the NT group under comparable conditions. Importantly, the ASC group's peak dilation in quiet mirrored the NT group's in noise. However, the ASC group exhibited shorter peak latencies and reduced mean dilations than the NT group in similar conditions. Such patterns indicate the ASC group might initially experience a heightened cognitive load but utilize fewer cognitive resources as the task continued, indicating an atypical allocation of cognitive resources and a potential tendency towards relatively superficial and automated auditory processing. Conclusion: Our findings highlight the unique SiN processing challenges children with ASC face, underscoring the importance of a nuanced, individual-centric approach for interventions and support.

Capsule endoscopy (CE) has been a widely used medical imaging tool for the diagnosis of gastrointestinal tract abnormalities like bleeding. But the CE captures a huge number of image frames that are time-consuming and tedious tasks for medical experts to diagnose manually. To address this issue, researchers focused on the computer-aided bleeding detection system to identify bleeding automatically in real-time. This paper presents a systematic review of the available state-of-the-art computer-aided bleeding detection algorithms for capsule endoscopy. The review was carried out by searching five different repositories: Scopus, PubMed, IEEE Xplore, ACM Digital Library, and ScienceDirect for all original publications on computer-aided bleeding detection published between 2001 and 2021. The PRISMA methodology was used to perform the review, and 112 full-texts of scientific papers were reviewed. The contributions of this paper are I) a taxonomy for computer-aided bleeding detection algorithms for capsule endoscopy is identified, II) the available state-of-the-art computer-aided bleeding detection algorithms including various color spaces (RGB, HSV, etc.), feature extraction techniques, and classifiers are discussed, and III) identify the most effective algorithm for practical use cases. Finally, the paper is concluded by providing future direction for computer-aided bleeding detection research.

The classifier system proposed in this work combines the dissimilarity spaces produced by a set of Siamese neural networks (SNNs) designed using 4 different backbones, with different clustering techniques for training SVMs for automated animal audio classification. The system is evaluated on two animal audio datasets: one for cat and another for bird vocalizations. Different clustering methods reduce the spectrograms in the dataset to a set of centroids that generate (in both a supervised and unsupervised fashion) the dissimilarity space through the Siamese networks. In addition to feeding the SNNs with spectrograms, additional experiments process the spectrograms using the Heterogeneous Auto-Similarities of Characteristics. Once the similarity spaces are computed, a vector space representation of each pattern is generated that is then trained on a Support Vector Machine (SVM) to classify a spectrogram by its dissimilarity vector. Results demonstrate that the proposed approach performs competitively (without ad-hoc optimization of the clustering methods) on both animal vocalization datasets. To further demonstrate the power of the proposed system, the best stand-alone approach is also evaluated on the challenging Dataset for Environmental Sound Classification (ESC50) dataset. The MATLAB code used in this study is available at https://github.com/LorisNanni.

Research on Traffic Light Recognition (TLR) has grown in recent years, primarily driven by the growing interest in autonomous vehicles development. Machine Learning algorithms have been widely used to that purpose. Mainstream approaches, however, require large amount of data to properly work, and as a consequence, a lot of computational resources. In this paper we propose the use of Expert Instruction (IE) as a mechanism to reduce the amount of data required to provide accurate ML models for TLR. Given an image of the exterior scene taken from the inside of the vehicle, we stand the hypothesis that the picture of a traffic light is more likely to appear in the central and upper regions of the image. Frequency Maps of traffic light location were thus constructed to confirm this hypothesis. The frequency maps are the result of a manual effort of human experts in annotating each image with the coordinates of the region where the traffic light appears. Results show that EI increased the accuracy obtained by the classification algorithm in two different image datasets by at least 15%. Evaluation rates achieved by the inclusion of EI were also higher in further experiments, including traffic light detection followed by classification by the trained algorithm. The inclusion of EI in the PCANet achieved a precision of 83% and recall of 73% against 75.3% and 51.1%, respectively, of its counterpart. We finally presents a prototype of a TLR Device with that expert model embedded to assist drivers. The TLR uses a smartphone as a camera and processing unit. To show the feasibility of the apparatus, a dataset was obtained in real time usage and tested in an Adaptive Background Suppression Filter (AdaBSF) and Support Vector Machines (SVMs) algorithm to detect and recognize traffic lights. Results show precision of 100% and recall of 65%.

This paper presents a system developed for the assistance with a collaborative robot in hand-assisted laparoscopic surgery (HALS). The system includes a sensing glove with piezoresistive sensors which capture continuously the flexion degree of the surgeon's fingers. These data are analyzed using an algorithm that detects and recognize the selected movements. This information is sent as commands to the collaborative robot throughout the surgical operation. The bending patterns, speed and execution times of the movements are modelled in a pre-phase in which it will extract all the necessary information for later detection during the motion execution. The results obtained with 10 different volunteers show a high degree of accuracy and a low false discovery rate.

This research delves into the realm of predictive modeling within artificial intelligence (AI) and introduces an innovative ensemble approach designed to enhance prognostic precision. The proposed methodology, characterized by its ebullient nature, leverages the collective wisdom of diverse predictive models, synthesizing a comprehensive and robust framework. The pursuit of parsimony are paramount, underscoring the need for efficient model architectures that balance predictive acuracy and computational efficiency. Our study meticulously explores the amalgamation of diverse algorithms, encapsulating the intrinsic complexity of real-world phenomena. We navigate the intricate landscape of feature selection, algorithmic diversity, and model combination, fostering a holistic understanding of the prognostic process. The ebullient ensemble emerges as a dynamic solution, harnessing the synergy of constituent models while mitigating the risk of overfitting. To validate the efficacy of our approach, extensive experiments are conducted on diverse datasets, spanning domains such as healthcare, finance, and natural language processing. Comparative analyses demonstrate the superior predictive performance of our ensemble model in comparison to individual algorithms and traditional ensemble methods. Additionally, we delve into interpretability aspects, elucidating the underlying mechanisms that contribute to the model's prognostic prowess. Our research advances the frontier of predictive modeling in AI, offering a nuanced and sophisticated paradigm for prognostication. The ebullient ensemble approach stands as a testament to the synergy achievable through the amalgamation of diverse predictive models, providing a pragmatic and parsimonious avenue for enhanced prognostic acuracy in artificial intelligence applications.

The integration of deep learning methods, especially Convolutional Neural Networks (CNN), and Synthetic Aperture Radar Automatic Target Recognition (SAR ATR) has been widely deployed in the field of radar signal processing. Nevertheless, these methods are frequently regarded as black-box models due to the limited visual interpretation of their internal feature representation and parameter organization. In this paper, we propose an innovative approach named C-RISE, which builds upon the RISE algorithm to provide a post-hoc interpretation technique for black-box models used in SAR Images Target Recognition. C-RISE generates saliency maps that effectively visualize the significance of each pixel. Our algorithm outperforms RISE by clustering masks that capture similar fusion features into distinct groups, enabling more appropriate weight distribution and increased focus on the target area. Furthermore, we employ Gaussian blur to process the masked area, preserving the original image structure with optimal consistency and integrity. C-RISE has been extensively evaluated through experiments, and the results demonstrate superior performance over other interpretation methods based on perturbation when applied to neural networks for SAR image target recognition. Furthermore, our approach is highly robust and transferable compared to other interpretable algorithms, including white-box methods.

In recent times, with the increase of Artificial Neural Network (ANN), deep learning has brought a dramatic twist in the field of machine learning by making it more Artificial Intelligence (AI). Deep learning is used remarkably used in vast ranges of fields because of its diverse range of applications such as surveillance, health, medicine, sports, robotics, drones etc. In deep learning, Convolutional Neural Network (CNN) is at the center of spectacular advances that mixes Artificial Neural Network (ANN) and up to date deep learning strategies. It has been used broadly in pattern recognition, sentence classification, speech recognition, face recognition, text categorization, document analysis, scene, and handwritten digit recognition. The goal of this paper is to observe the variation of accuracies of CNN to classify handwritten digits using various numbers of hidden layer and epochs and to make the comparison between the accuracies. For this performance evaluation of CNN, we performed our experiment using Modified National Institute of Standards and Technology (MNIST) dataset. Further, the network is trained using stochastic gradient descent and the backpropagation algorithm.

Affective computing in general and human activity and intention analysis in particular, is a rapidly growing field of research. Head pose and emotion changes, present serious challenges when applied to player’s training and ludology experience in serious games or analysis of customer satisfaction regarding broadcast and web services or monitoring a driver’s attention. Given the increasing prominence and utility of depth sensors, it is now feasible to perform large-scale collection of three-dimensional (3D) data for subsequent analysis. Discriminative random regression forests was selected in order to rapidly and accurately estimate head pose changes in unconstrained environment. In order to complete the secondary process of recognising four universal dominant facial expressions (happiness, anger, sadness and surprise), emotion recognition via facial expressions (ERFE) was adopted. After that, a lightweight data exchange format (JavaScript Object Notation-JSON) is employed, in order to manipulate the data extracted from the two aforementioned settings. Motivated by the need of generating comprehensible visual representations from different sets of data, in this paper we introduce a system capable of monitoring human activity through head pose and emotion changes, utilising an affordable 3D sensing technology (Microsoft Kinect sensor).

The state-of-the-art smart city has been calling for an economic but efficient energy management over large-scale network, especially for the electric power system. It is a critical issue to monitor, analyze and control electric loads of all users in system. In this paper, we employ the popular computer vision techniques of AI to design a non-intrusive load monitoring method for smart electric energy management. First of all, we utilize both signal transforms (including wavelet transform and discrete Fourier transform) and Gramian Angular Field (GAF) methods to map one-dimensional current signals onto two-dimensional color feature images. Second, we propose to recognize all electric loads from color feature images using a deep neural network with multi-scale feature extraction and attention mechanism. Third, we design our method as a cloud-based, non-intrusive monitoring of all users, thereby saving energy cost during electric power system control. Experimental results on both public and our private datasets have demonstrated our method achieves superior performances than its peers, and thus supports efficient energy management over large-scale Internet of Things.

In order to improve real-time performance of gesture recognition by micro-Doppler map of mmWave Radar, the point cloud based gesture recognition for mmWave Radar is proposed in this paper.Two steps are carried out for mmWave Radar based gesture recognition. The first step is to estimate the point cloud of the gestures by 3D-FFT and the peak grouping. The second step is to train the TRANS-CNN model by combining the multi-head self-attention and the 1D-convolutional network, so as to extract the features in the point cloud data at a deeper level to categorize the gestures. In the experiments, TI mmWave Radar sensor IWR1642 is used as benchmark to evaluate the feasibility of the proposed approach. The results show that the accuracy of the gesture recognition reaches 98.5%. In order to prove the effectiveness of our approach, a simply 2Tx2Rx Radar sensor is developed in our lab and the accuracy of recognition reaches 97.1%. The results show that our proposed gesture recognition approach achieves the best performance in real-time with limited training data, in comparison with the existing methods.

Abstract:The objects of fine-grained image categories(e.g., bird species) are various subclass under different categories. Because the differences between subclass are very subtle and most of them are concentrated in multiple local areas, the task of fine-grained image recognition is very challenging. At the same time, some fine-grained networks tend to focus on a certain region when judging the target category, resulting in the lack of other auxiliary regional features. To this end, Inception V3 is used as the backbone network, and an enhanced and complementary fine-grained image classification network is designed. While adopting the method of reinforcement learning to obtain more detailed fine grain image features, the complementary network can obtain the complementary discriminant area of the target through the method of attention erasure to increase the network's perception of the overall target. Finally, experiments are conducted on CUB-200-2011, FGVC Aircraft and Stanford dogs three open datasets. The experimental results show that the proposed model has better performance.

Emotion recognition and social inference impairments are well-documented post-traumatic brain injury (TBI) yet the mechanisms underpinning these are not fully understood. We examined dynamic emotion recognition, social inference abilities, and eye fixation patterns between adults with and without TBI. Eighteen individuals with TBI and 18 matched non-TBI participants were recruited and underwent all three components of The Assessment of Social Inference Test (TASIT). The TBI group were less accurate in identifying emotions compared to the non-TBI group. Individuals with TBI also scored lower when distinguishing sincere and sarcastic conversations but scored similarly to those without TBI during lie vignettes. Finally, those with TBI also had difficulty understanding the actor’s intentions, feelings, and beliefs compared to participants without TBI. No group differences were found for eye fixation patterns and there were no associations between fixations and behavioural accuracy scores. This conflicts with previous studies and might be related to an important distinction between static and dynamic stimuli. Visual strategies appeared goal- and stimulus-driven, with attention being distributed to the most diagnostic area of the face for each emotion. These findings suggest that low-level visual deficits may not be modulating emotion recognition and social inference disturbances post-TBI.

Recent advancements in Artificial Intelligence (AI), Deep Learning (DL), and computer vision have revolutionized various industrial processes through image classification and object detection. State-of-the-art Optical Character Recognition (OCR) and Object Detection (OD) technologies, such as YOLO and PaddleOCR, have emerged as powerful solutions for addressing challenges in recognizing textual and non-textual information on printed stickers. However, a well-established framework integrating these cutting-edge technologies for industrial applications still needs to be discovered. In this paper, we propose an innovative framework that combines advanced OCR and OD techniques to automate visual inspection processes in an industrial context. Our primary contribution is a comprehensive framework adept at detecting and recognizing textual and non-textual information on printed stickers within a company, harnessing the latest AI tools and technologies for sticker information recognition. Our experiments reveal an overall macro accuracy of 0.88 for the sticker OCR across three distinct patterns. Furthermore, the proposed system goes beyond traditional Printed Character Recognition (PCR) by extracting supplementary information, such as barcodes and QR codes present in the image, significantly streamlining industrial workflows and minimizing manual labor demands.

In the field of computer vision, large-scale image classification tasks are both important and highly challenging. With the ongoing advances in deep learning and optical character recognition (OCR) technologies, neural networks designed to perform large-scale classification play an essential role in facilitating OCR systems. In this study, we developed an automatic OCR system designed to identify up to 13,070 large-scale printed Chinese characters by using deep learning neural networks and fine-tuning techniques. The proposed framework comprises four components, including training dataset synthesis and background simulation, image preprocessing and data augmentation, the process of training the model, and transfer learning. The training data synthesis procedure is composed of a character font generation step and a background simulation process. Three background models are proposed to simulate the factors of the background noise and anti-counterfeiting patterns on ID cards. To expand the diversity of the synthesized training dataset, rotation and zooming data augmentation are applied. A massive dataset comprising more than 19.6 million images was thus created to accommodate the variations in the input images and improve the learning capacity of the CNN model. Subsequently, we modified the GoogLeNet neural architecture by replacing the FC layer with a global average pooling layer to avoid overfitting caused by a massive amount of training data. Consequently, the number of model parameters was reduced. Finally, we employed the transfer learning technique to further refine the CNN model using a small number of real data samples. Experimental results show that the overall recognition performance of the proposed approach is significantly better than that of prior methods and thus demonstrate the effectiveness of proposed framework, which exhibited a recognition accuracy as high as 99.39% on the constructed real ID card dataset.

Digital enabled manufacturing systems require high level of automation for fast and low-cost production but should also present flexibility and adaptiveness to varying and dynamic conditions in their environment, including the presence of human beings; However, this presence of workers in the shared workspace with robots decreases the productivity as the robot is not aware about the human position and intention which leads to concerns about the human safety. This issue is addressed in this work by designing a reliable safety monitoring system for collaborative robots (Cobots). The main idea here is, to significantly enhance safety by a combination of recognition of human actions using visual perception and at the same time interpreting physical human-robot contact by tactile perception. Two datasets containing contact and vision data are collected by using different volunteers. The action recognition system classifies human actions using the skeleton representation of the latter when entering the shared workspace and the contact detection system distinguishes between intentional and incidental interactions if a physical contact between human and cobot takes place. Two different deep learning networks are used for human action recognition and contact detection which in combination, are expected to lead to the enhancement of human safety and an increase of the level of cobot perception about human intentions. The results show a promising path for future AI-driven solutions in safe and productive human–robot collaboration (HRC) in industrial automation.

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher accuracy than a strong baseline trained on 8 times more data. Our method leverages knowledge contained in pre-trained speech representations extracted from models trained on a more general self-supervised task which doesn’t require human annotations, such as the wav2vec model. We provide detailed insights on the benefits of our approach by varying the training data size, which can help labeling teams to work more efficiently. We compare performance with other popular methods on the IEMOCAP dataset, a well-benchmarked dataset among the Speech Emotion Recognition (SER) research community. Furthermore, we demonstrate that results can be greatly improved by combining acoustic and linguistic knowledge from transfer learning. We align acoustic pre-trained representations with semantic representations from the BERT model through an attention-based recurrent neural network. Performance improves significantly when combining both modalities and scales with the amount of data. When trained on the full IEMOCAP dataset, we reach a new state-of-the-art of 73.9% unweighted accuracy (UA).

Myoelectric control is the cornerstone of many assistive technologies used in clinical practice, such as prosthetics and orthoses, and human-computer interaction, such as virtual reality control. Although the performance of such devices exceeds 90\% in controlled environments, myoelectric devices still face challenges in robustness to variability of daily living conditions. Within this survey, the intrisic physiological mechanisms limiting practical implementations of myoelectric devices were explored: the limb position effect and the contraction intensity effect. The degradation of electromyography (EMG) pattern recognition in the presence of these factors was demonstrated on six datasets, where performance was 13% and 20% lower in realistic environments compared to controlled environments for the limb position and contraction intensity effect, respectively. The experimental designs of limb position and contraction intensity literature were surveyed. Current state-of-the-art training strategies and robust algorithms for both effects were compiled and presented. Recommendations for future limb position effect studies include: the collection protocol providing exemplars of 6 positions (four limb positions and three forearm orientations), three-dimensional space experimental designs, transfer learning approaches, and multi-modal sensor configurations. Recommendations for future contraction intensity effect studies include: the collection of dynamic contractions, nonlinear complexity features, and proportional control.

Membrane-coupled RNA transport is an emerging theme in fungal biology. This review focuses on the RNA cargo and mechanistic details of transport via two inter-related sets of organelles: endosomes and extracellular vesicles for intra- and intercellular RNA transfer. Simultaneous transport and translation of messenger RNAs (mRNAs) on the surface of shuttling endosomes is a conserved process pertinent to highly polarised eukaryotic cells, such as hyphae or neurons. Here we detail the endosomal mRNA transport machinery components and mRNA targets of the core RNA-binding protein Rrm4. Extracellular vesicles (EVs) are newly garnering interest as mediators of intercellular communication, especially between pathogenic fungi and their hosts. Landmark studies in plant-fungus interactions indicate EVs as a means of delivering various cargos, most notably small RNAs (sRNAs), for cross-kingdom RNA interference. Recent advances and implications of the nascent field of fungal EVs are discussed and potential links between endosomal and EV-mediated RNA transport are proposed.

This paper propose an original approach of achieving a Cymatics based visual perception of isolated speech commands. The idea is to smartly combine the effective speech processing and analysis methods with the phenomena of Cymatics. In this context, an effective approach for automatic isolated speech based message recognition is proposed. The incoming speech segment is enhanced by applying the appropriate pre-emphasis filtering, noise thresholding and zero alignment operations. The Mel-Frequency Cepstral coefficients (MFCCs), Delta coefficients and Delta-Delta coefficients are extracted from the enhanced speech segment. Later on, the Dynamic Time Warping (DTW) technique is employed to compare these extracted features with the reference templates. The comparison outcomes are used to make the classification decision. The classification decision is transformed into a methodical excitation. Finally, this excitation is converted into the systematic visual perceptions via the phenomenon of Cymatics. The system functionality is tested with an experimental setup and results are presented. The approach is novel and can be employed in various applications like visual art, encryption, education, archeology, architecture, integration of impaired people, etc.

This paper proposes a novel approach, based on the adaptive rate processing and analysis, for the isolated speech recognition. The idea is to smartly combine the event-driven signal acquisition and windowing along with adaptive rate processing, analysis and classification for realizing an effective isolated speech recognition. The incoming speech signal is digitized with an event-driven A/D converter (EDADC). The output of EDADC is windowed with an activity selection process. These windows are later on resampled uniformly with an adaptive rate interpolator. The resampled windows are de-noised with an adaptive rate filter and their spectrum are computed with an adaptive resolution short time Fourier transform (ARSTFT). Later on, the magnitude, Delta and Delta-Delta spectral coefficients are extracted. The Dynamic Time Warping (DTW) technique is employed to compare these extracted features with the reference templates. The comparison outcomes are used to make the classification decision. The system functionality is tested for a case study and results are presented. An 8.2 times reduction in acquired number of samples is achieved by the devised approach as compared to the classical one. It aptitudes a significant computational gain and power consumption reduction of the proposed system over the counter classical ones. An average subject dependent isolated speech recognition accuracy of 96.8% is achieved. It shows that the proposed approach is a potential candidate for the automatic speech recognition applications like rehabilitation centers, smart call centers, smart homes, etc.

Sensors available on mobile devices allow the automatic identification of Activities of Daily Living (ADL). This paper describes an approach for the creation of a framework for the identification of ADL, taking in account several concepts, including data acquisition, data processing, data fusion, pattern recognition, and machine learning. These concepts can be mapped in a module of the framework, including the use and creation of several algorithms. For the development of a framework that works in several conditions, e.g., without Internet connection, these algorithms should take in account the hardware and software limitations of the mobile devices to run all main tasks locally. The main purpose of this paper is related to the presentation the sensors, algorithms, and architecture of the proposed approach.

The Centers for Disease Control and Prevention (CDC) indicates that individuals with prediabetes are significantly less likely to develop type 2 diabetes if they participate in a lifestyle change program that results in at least 5% weight loss and 150 minutes of physical activity per week. The CDC recognizes distance learning as an effective delivery mode for lifestyle change programs to prevent type 2 diabetes. The purpose of this study was to assess enrollment, engagement, and effectiveness of a type 2 diabetes prevention program (DPP) using synchronous distance technology. Eat Smart, Move More, Prevent Diabetes (ESMMPD) is an intensive 12-month DPP delivered using synchronous distance technology. Throughout 26 lessons, participants focused on healthy eating, physical activity, and mindfulness behaviors. Study findings showed a significant decrease in A1C (-0.24 p<.0001). Weight loss averaged 5.66% for those who completed the program. Based on the Wilcoxon signed-rank test, participants demonstrated statistically significant changes in self-reported confidence in their ability to perform all 18 health-promoting behaviors assessed (p<.0001). Participation in the program also resulted in the adoption of health promoting behaviors. A DPP using synchronous distance technology is an effective delivery mode to help participants adopt healthy behaviors, increase physical activity, and achieve the weight loss necessary to prevent or delay the onset of type 2 diabetes.

This article provides a general overview of the bio-inspired computing method called DNA-Based Computing (DBC), including its theory and applications. The main theme of DBC is the central dogma of molecular biology (once information of DNA/RNA has got into a protein, it can’t get out again), i.e., DNA to RNA (sequences of four types of nucleotides) and DNA/RNA to protein (sequence of twenty types of amino acids) are allowed, not the reverse ones. Thus, DBC transfers few-element information (DNA/RAN-like) to many-element information (protein-like), solving a given cognitive problem. DBC can take many forms; this article elucidates two main forms, denoted as DBC-1 and DBC-2. Using arbitrary numerical examples, it is shown that DBC-1 can solve the following cognitive problems: “similarity indexing between seemingly different but inherently identical objects” and “recognizing regions of an image separated by a complex boundary.” DBC-2 can solve the following cognitive problem: “pattern recognition when the relevant information is insufficient.” Smart manufacturing-based systems (digital twins and big data analytics) must solve the abovementioned problems to make the manufacturing enablers (machine tools and monitoring systems) more self-reliant and autonomous. Consequently, DBC can improve the cognitive problem-solving ability of smart manufacturing-relevant systems and, thereby, can enhance its biologicalization.

Optical “fingerprints” are widely used in chemometrics-assited recognition of samples of different nature. An emerging trend in this area is the transition from obtaining "static" spectral data to reactions occurring over time. The indicator reactions are usually carried out in aqueous solutions; in this study we have developed the reactions that occur in an organic solvent, which makes it possible to recognize fat-soluble samples. In this capacity, we used 5W40, 10W40 and 5W30 motor oils of 4 manufacturers, totally 6 samples. The procedure involved mixing of the dye, sample, and reagents (HNO3, HCl, or t-butyl hydroperoxide) in ethanolic solution in a 96-well plate and measuring absorbance or near-IR fluorescence intensity every several minutes during 20–55 min. The obtained photographic images were processed by linear discriminant analysis (LDA) and k-nearest neighbors algorithm (kNN). The discrimination accuracy was evaluated by using the validation procedure. Reaction of oxidation of a dye with nitric acid allowed to recognize all 6 samples with 100% accuracy by LDA. Merging data of 4 reactions that did not provide complete discrimination ensured an accuracy of 93% by kNN technique. The developed indicator systems have good prospects for the discrimination of other fat-soluble samples. Overall, the results confirm the viability of the kinetic-based discrimination strategy.

Nollywood, based on the idea of Bollywood from India, is a series of outstanding movies that originate from Nigeria. Unfortunately, while the movies are in English, they are hard to understand for many native speakers due to the dialect of English that is spoken. In this article, we accomplish two goals: (1) create a phonetic sub-title model that is able to translate Nigerian English speech to American English and (2) use the most advanced toxicity detectors to discover how toxic the speech is. Our aim is to highlight the text in these videos which is often times ignored for lack of dialectal understanding due the fact that many people in Nigeria speak a native language like Hausa at home.

Industrial radiography is a pivotal non-destructive testing (NDT) method that ensures quality and safety in a wide range of industrial sectors. Conventional human-based approaches, however, are prone to challenges in defect detection accuracy and efficiency, primarily due to the high inspection demand from manufacturing industries with high production throughput. To solve this challenge, numerous computer-based alternatives have been developed, including Auto-mated Defect Recognition (ADR) using deep learning algorithms. At the core of training, these algorithms demand large volumes of data that should be representative of real-world cases. However, the availability of digital X-ray radiography data for open research is limited by non-disclosure contractual terms in the industry. This study presents a pipeline that is capable of modeling synthetic images based on statistical information acquired from X-ray intensity distribution from real digital X-ray radiography images. Through meticulous analysis of the intensity distribution in digital X-ray images, the unique statistical patterns associated with the exposure conditions used during image acquisition, type of component, thickness variations, beam divergence, anode heel effect, etc., are extracted. The realized synthetic images were utilized to train deep learning models, yielding an impressive model performance with mean intersection over union (IoU) of 0.93, and mean dice coefficient of 0.96, on real unseen digital X-ray radiography images. This methodology is scalable and adaptable, making it suitable for diverse industrial applications.

Our image recognition system mainly judges whether the left upper limb in the image is the left upper limb or the right upper limb through our deep learning model in the image. The doctor then could give the correct surgical position. From the experimental results, it could be found that the precision rate and recall rate of the intelligent image recognition system proposed in this paper for preventing the upper limb dislocation surgery could reach 98% and 93%, respectively. It proved that our artificial intelligent image recognition system, AIIRS, could indeed assist orthopedic surgeons to prevent the occurrence of left and right dislocation in upper limb surgery. At the same time, this paper also completes the IRB application approval through the prototype experimental results and will conduct the second phase of human trials in the future. It showed that the research results of this paper will be of great benefit and research value to upper limb orthopedic surgery.

In this paper, we continue the research cycle on the properties of convolutional neural network-based image recognition systems and ways to improve noise immunity and robustness [1]. Currently, a popular research area related to artificial neural networks is adversarial attacks. The effect of adversarial attacks on the image is not highly perceptible to the human eye, also it drastically reduces the neural network accuracy. Image perception by a machine is highly dependent on the propagation of high frequency distortions throughout the network. At the same time, a human efficiently ignores high-frequency distortions, perceiving the shape of objects as a whole. The approach proposed in this paper can improve the image recognition accuracy in the presence of high-frequency distortions, in particular, caused by adversarial attacks. The proposed technique makes it possible to measure up the logic of artificial neural network to that of a human, for whom high-frequency distortions are not decisive in object recognition.

Our image recognition system mainly judges whether the left upper limb in the image is the left upper limb or the right upper limb through our deep learning model in the image. The doctor then could give the correct surgical position. From the experimental results, it could be found that the precision rate and recall rate of the intelligent image recognition system proposed in this paper for preventing the upper limb dislocation surgery could reach 98% and 93%, respectively. It proved that our intelligent image recognition system could indeed assist orthopedic surgeons to prevent the occurrence of left and right dislocation in upper limb surgery. At the same time, this paper also completes the IRB application approval through the prototype experimental results and will conduct the second phase of human trials in the future. It showed that the research results of this paper will be of great benefit and research value to upper limb orthopedic surgery.

Visual signals are the upmost important source for robots, vehicles or machines to achieve human-like intelligence. Human beings heavily depend on binocular vision to understand the dynamically changing world. Similarly, intelligent robots or machines must also have the innate capabilities of perceiving knowledge from visual signals. Until today, one of the biggest challenges faced by intelligent robots or machines is the matching in stereovision. In this paper, we present the details of a new principle toward achieving a robust matching solution which leverages on the use and integration of top-down image sampling strategy, hybrid feature extraction, and RCE neural network for incremental learning (i.e., cognition) as well as robust match-maker (i.e., recognition). A preliminary version of the proposed solution has been implemented and tested with data from Maritime RobotX Challenge (www.robotx.org). The contribution of this paper is to attract more research interest and effort toward this new direction which may eventually lead to the development of robust solutions expected by future stereovision systems in intelligent robots, vehicles and machines.

Prereactive complexes in noncovalent organocatalysis are sensitive to the relative chirality of the binding partners and to hydrogen bond isomerism. Both effects are present when a transiently chiral alcohol docks on a chiral α-hydroxy ester, turning such 1:1 complexes into elementary, non-reactive model systems for chirality induction in the gas phase. With the help of linear infrared and Raman spectroscopy in supersonic jet expansions, conformational preferences are investigated for benzyl alcohol in combination with methyl lactate, also exploring p-chlorination of the alcohol and the achiral homolog methyl glycolate to identify potential London dispersion and chirality effects on the energy sequence. Three of the four combinations prefer barrierless complexation via the hydroxy group of the ester (association). In contrast, the lightest complex shows predominantly insertion into the intramolecular hydrogen bond, like the analogous lactate and glycolate complexes of methanol. The experimental findings are rationalized with computations and a uniform helicality induction in the alcohol by the lactate is predicted, independent on insertion into or association with the internal lactate hydrogen bond. p-Chlorination of benzyl alcohol has a stabilizing effect on association, because the insertion motif prevents a close contact between the chlorine and the hydroxy ester. After simple anharmonicity and substitution corrections, the B3LYP-D3 approach offers a fairly systematic description of the known spectroscopic data on alcohol complexes with α-hydroxy esters.

Speech emotion recognition remains a heavy lifting in natural language processing. It has strict requirements to the effectiveness of feature extraction and that of acoustic model. With that in mind, a Heterogeneous Parallel Convolution Bi-LSTM model is proposed to address these challenges. It consists of two heterogeneous branches: the left one contains two dense layers and a Bi-LSTM layer, while the right one contains a dense layer, a convolution layer, and a Bi-LSTM layer. It can exploit the spatiotemporal information more effectively, and achieves 84.65%, 79.67%, and 56.50% unweighted average recall on the benchmark databases EMODB, CASIA, and SAVEE, respectively. Compared with the previous research results, the proposed model achieves better performance stably.

— In a smart healthcare system," Human Activity Recognition (HAR)" is considered as an efficient approach in pervasive computing from activity sensor readings. The "Ambient Assisted Living (AAL)" in the home or community helps the people to provide independent care and enhanced living quality. However, many AAL models are restricted to multiple factors that include both the computational cost and system complexity. Moreover, the HAR concept has more relevance because of its applications, such as content-based video search, sports play analysis, crowd behavior prediction systems, patient monitoring systems, and surveillance systems. This paper attempts to implement the HAR system using a popular deep learning algorithm, namely "Recurrent Neural Network (RNN)" with the activity data collected from smart activity sensors over time, and it is publicly available in the "UC Irvine Machine Learning Repository (UCI)". The proposed model involves three processes: (1) data collection, (b) optimal feature learning, and (c) activity recognition. The data gathered from the benchmark repository was initially subjected to optimal feature selection that helped to select the most significant features. The proposed optimal feature selection method is based on a new meta-heuristic algorithm called "Colliding Bodies Optimization (CBO)". An objective function derived from the recognition accuracy has been used for accomplishing the optimal feature selection. The proposed model on the concerned benchmark dataset outperformed the conventional models with enhanced performance.

The voice contains elementary social communication cues, conveying speech, as well as paralinguistic information pertaining to the emotional state and the identity of the speaker. In contrast to vocal-speech and vocal-emotion processing, voice-identity processing has been less explored. This seems surprising, given the day-to-day significance of person recognition by voice. A valuable approach to unravel how voice-identity processing is accomplished is to investigate people who have a selective deficit in recognising voices. Such a deficit has been termed phonagnosia. In the present chapter, we provide a systematic overview of studies on phonagnosia and how they relate to current neurocognitive models of person recognition. We review studies that have characterised people who suffer from phonagnosia following brain damage (i.e. acquired phonagnosia) and also studies, which have examined phonagnosia cases without apparent brain lesion (i.e. developmental phonagnosia). Based on the reviewed literature, we emphasise the need for a careful behavioural characterisation of phonagnosia cases by taking into consideration the multistage nature of voice-identity processing and the resulting behavioural phonagnosia subtypes.

The detection of seismic events at regional and teleseismic distances is critical to Nuclear Treaty Monitoring. Traditionally, detecting regional and teleseismic events has required the use of an expensive multi-instrument seismic array; however in this work, we present DeepPick, a novel seismic detection algorithm capable of array-like performance from a single trace. We achieve this directly, by training our single-trace detector against labeled events from an array catalog, and by utilizing a deep temporal convolutional neural network. The training data consists of all arrivals in the International Seismological Centre Catalog for seven seismic arrays over a five year window from 1 Jan 2010 to 1 Jan 2015, yielding a total training set of 608,362 detections. The test set consists of the same seven arrays over a one year window from 1 Jan 2015 to 1 Jan 2016. We report our results by training the algorithm on six of the arrays and testing it on the seventh, so as to demonstrate the transportability and generalization of the technique to new stations. Detection performance against this test set is outstanding. Fixing a type-I error rate of 1%, the algorithm achieves an overall recall rate of 73% on the 141,095 array beam picks in the test set, yielding 102,394 correct detections. This is more than 4 times the 23,259 detections found in the analyst-reviewed single-trace catalogs over the same period, and represents an 8dB improvement in detector sensitivity over current methods. These results demonstrate the potential of our algorithm to significantly enhance the effectiveness of the global treaty monitoring network.

A tabletop system can facilitate multi-user collaboration in a variety of settings including small meetings, group work, and education and training exercises. The ability of identifying the users touching the table and their positions can promote collaborative work among participants, so methods have been studied that involve the attaching of sensors to the table or chairs or to the users themselves. An effective method of recognizing user actions without placing a burden on the user would be some type of visual process, so the development of a method that processes multi-touch gestures by visual means is desired. This paper describes the development of a multi-touch tabletop system using infrared image recognition for user position identification and presents the results of touch-gesture recognition experiments and a system usability evaluation. Using an FTIR touch panel and infrared light, this system picks up the shadow area of the user’s hand by infrared camera in relation to user touch operations and estimates user position by image recognition. The multi-touch gestures prepared for this system include an operation to change the direction of an object to face the user and a copy operation in which two users generate duplicates of an object. The average recognition rate of the change-direction gesture and copy gesture were found to be 96% and 85%, respectively. In addition, the system usability evaluation revealed that prior learning was easy and that system operations could be easily performed.

Collision avoidance is an important feature in advanced driver-assistance systems, aiming at providing correct, timely and reliable warnings before an imminent collision (objects, vehicles, pedestrians, etc.). A co-simulation framework is proposed in this paper to address the design and evaluation of collision avoidances in a cyber-physical system. The co-simulation framework is supported on the interaction between SCANeR and Matlab/Simulink. From the best of authors’ knowledge, two main contributions are reported in this paper. Firstly, the modelling and simulation of virtual on-chip LIDAR sensors in a cyber-physical system (CPS) considering traffic scenarios is presented. The CPS is designed and implemented in SCANeR. Secondly, an obstacle recognition library with three specific Artificial Intelligence-based methods is also designed based on sensory information database provided by SCANeR. Three methods for collision avoidance detection are considered, i.e.; a multi-layer perceptron neural network, a self-organization map and a support vector machine. Finally, a comparison among these methods for detecting obstacles before different weather conditions is done with very promising results in terms of accuracy. The best results are achieved using the multi-layer perceptron in sunny and fog conditions, the support vector machine in rainy and self-organized map in snowy conditions.

Gender recognition is trivial for physiotherapist, but it is considered a challenge for computers. The electromyography (EMG) and heart rate variability (HRV) were utilized in this work for gender recognition during the stepping exercise using a stepper. The relevant features were extracted and selected. The selected features were then fused to automatically predict gender recognition. However, the feature selection for gender classification became a challenge to ensure better accuracy. Thus, in this paper, a feature selection approach based on both the performance and the diversity between the two features from the rank-score characteristic (RSC) function in a combinatorial fusion approach (CFA) was employed. Then, the features from the selected feature sets were fused using a CFA. The results were then compared with other fusion techniques such as naive bayes (NB), decision tree (J48), k-nearest neighbor (KNN) and support vector machine (SMO). Besides, the results were also compared with previous researches in gender recognition. The experimental results showed that the CFA was efficient for feature selection. The fusion method was also able to improve the accuracy of the gender recognition rate. The CFA provides much better gender classification results which is 94.51% compared to Nazarloo's work (90.34%) and other classifiers.

This article introduces a new way of using a Fibre Bragg Grating (FBG) sensor for detecting the presence and number of occupants in the monitored space in a Smart Home (SH). CO₂ sensors are used to determine the CO₂ concentration of the monitored rooms in an SH. CO₂ sensors can also be used for occupancy recognition of the monitored spaces in SH. To determine the presence of occupants in the monitored rooms of the SH, the newly devised method of CO₂ prediction, by means of an Artificial Neural Network (ANN) with a Scaled Conjugate Gradient (SCG) algorithm using measurements of typical operational technical quantities (indoor temperature, relative humidity indoor and CO₂ concentration in the SH) is used. The goal of the experiments is to verify the possibility of using the FBG sensor in order to unambiguously detect the number of occupants in the selected room (R104) and, at the same time, to harness the newly proposed method of CO₂ prediction with ANN SCG for recognition of the SH occupancy status and the SH spatial location (rooms R104, R203, and R204) of an occupant. The designed experiments will verify the possibility of using a minimum number of sensors for measuring the non-electric quantities of indoor temperature and indoor relative humidity and the possibility of monitoring the presence of occupants in the SH using CO₂ prediction by means of the ANN SCG method with ANN learning for the data obtained from only one room (R203). The prediction accuracy exceeded 90% in certain experiments. The uniqueness and innovativeness of the described solution lie in the integrated multidisciplinary application of technological procedures (the BACnet technology control SH, FBG sensors) and mathematical methods (ANN prediction with SCG algorithm, the Adaptive Filtration with of LMS algorithm) employed for the recognition of number persons and occupancy recognition of selected monitored rooms of SH.

Currently, Pythagorean fuzzy sets (PFSs) have been widely applied in various fields due to their substantial advantages in expressing and dealing with uncertainty. However, measuring the similarity and difference between PFSs effectively remains an unresolved issue. Inspired by Tanimoto similarity, we propose a novel set of similarity and distance measures for PFSs. We delve into the theoretical properties of the proposed measures and compare it with existing PFSs measures. Numerous numerical examples validate their rationality and effectiveness. Furthermore, our experimental findings suggest that in contrast to existing measures, the introduced measures successfully circumvent various counter-intuitive issues encountered by current measures, and yield more pronounced outcomes in the discrimination of different fuzzy sets. This enhances the uniqueness and superiority of our measures. Finally, we developed two decision models based on the proposed measures and validated their applicability in three applications.

Gesture recognition technology has been quickly developed in the field of human-computer interaction. The multiple-input multiple-output (MIMO) radar has been widely adopted in gesture recognition because of its notable spatial resolution. In this work, a highly accurate MIMO radar-based hand gesture recognition algorithm with very low complexity is proposed. To make the proposed system applicable in the industry and work well even when the size of the training data is limited, we applied several low-complexity adaptive signal processing methods to extract features and reduce the noise effect. First, spectrum analysis is applied to range-Doppler maps (RDMs) and a cell-averaging constant false alarm rate (CA-CFAR) with mirror filters is applied to improve the robustness to noise. Afterward, the features related to the distance, speed, direction, and the elevation angle of the moving object are determined by the proposed adaptive signal analysis techniques and the random forest is applied for classification. The proposed system has the capability to precisely distinguish and identify eight motions, including waving, moving to the left or right, patting, pushing, pulling, and rotating clockwise or anticlockwise, with an accuracy of 95%. Experiments demonstrate the capability of the proposed hand gesture recognition system to classify different movements precisely.

The utilization of Pig Emotion Recognition (PER) driven by Artificial Intelligence (AI) promises to mitigate labor costs and alleviate stress among domestic pigs, thereby minimizing the need for consistent human intervention. Nevertheless, this research acknowledges the inherent limitations within the raw PER datasets, which often include irrelevant porcine features, hence impeding genuine progress in real-world evaluations. A significant proportion of PER datasets derive from sequential pig imagery obtained from video recordings, and a common pitfall in these studies is the unregulated shuffling of data. This lack of control can result in the overlap of data samples between training and testing groups, thereby yielding skewed experimental evaluations. To address these challenges, this paper introduces a novel solution in the form of the Semi-Shuffle-Pig Detector (SSPD) for PER datasets, with the intent to facilitate a less biased experimental output. By applying the SSPD, we can ensure that all testing data samples remain distinct from the training datasets, and any superfluous information from raw images is systematically discarded. This optimized method enhances the true performance of classification, providing unbiased experimental evaluations. Notably, our approach has led to a remarkable improvement in the Isolation After Feeding (IAF) metric by 20.2\% and achieved higher accuracy in segregating IAF and Paired After Feeding (PAF) classifications exceeding 92\%. This methodology, thereby, ensures the preservation of pertinent data within the PER system and eliminates potential biases in experimental evaluations. Consequently, it elevates the accuracy and reliability of real-world PER applications, resulting in a tangible positive impact on both pig welfare management and food safety standards.

Local binary pattern is one of the visual descriptors and can be used as a powerful feature extractor for texture classification. In this paper, a novel representation for face recognition is proposed, called it Bilateral Line Local Binary Patterns (BL-LBP). This scheme is an extension of Line Local Binary Patterns descriptors in the statistical learning subspace. The present bilateral descriptors are fused with an ensemble learning of calibrated SVM models. The performance of this scheme is evaluated using 5 standard face databases. It is found that it is robust against illumination variation, diverse facial expressions and head pose variations and its recognition accuracy reaches 98 percent, running on a mobile device with a processing speed of 63 ms per face. Results suggest that our proposed method can be very useful for the vision systems that have limited resources where the computational cost is critical.

We present and benchmark FilterNet, a flexible deep learning architecture for time series classification tasks, such as activity recognition via multichannel sensor data. It adapts popular CNN and CNN-LSTM motifs which have excelled in activity recognition benchmarks, implementing them in a many-to-many architecture to markedly improve frame-by-frame accuracy, event segmentation accuracy, model size, and computational efficiency. We propose several model variants, evaluate them alongside other published models using the Opportunity benchmark dataset, demonstrate the effect of model ensembling and of altering key parameters, and quantify the quality of the models’ segmentation of discrete events. We also offer recommendations for use and suggest potential model extensions. FilterNet advances the state of the art in all measured accuracy and speed metrics on the benchmarked dataset, and it can be extensively customized for other applications.

Currently, the most important challenge in any assessment of state-of-the-art sensor technology and its reliability is to achieve road traffic safety targets. The research reported in this paper is focused on the design of a procedure for evaluating the reliability of Internet-of-Things (IoT) sensors and the use of a Cyber-Physical System (CPS) for the implementation of that evaluation procedure to gauge reliability. An important requirement for the generation of real critical situations under safety conditions is the capability of managing a co-simulation environment, in which both real and virtual data sensory information can be processed. An IoT case study that consists of a LiDAR-based collaborative map is then proposed, in which both real and virtual computing nodes with their corresponding sensors exchange information. Specifically, the sensor chosen for this study is a Ibeo Lux 4-layer LiDAR sensor with IoT added capabilities. Implementation is through an artificial-intelligence-based modeling library for sensor data-prediction error, at a local level, and a self-learning-based decision-making model supported on a Q-learning method, at a global level. Its aim is to determine the best model behavior and to trigger the updating procedure, if required. Finally, an experimental evaluation of this framework is also performed using simulated and real data

Recognition, decoding and tracking of vortex patterns is of increasing importance in many fields reaching from astronomical observation of distant galaxies to turbulence phenomena in liquids or gases. Currently, coherent light beams with orbital angular momentum (OAM) are of particular interest for optical communication, metrology, micro-machining or particle manipulation. One common task is to identify characteristic spiral patterns in pixelated intensity maps at real-world signal-to-noise ratios. Recently, Fast Fourier Transform (FFT) was applied to the quantitative analysis of spiral interference patterns of OAM beams. Our study considers this approach in more detail. It is demonstrated that specific information can be extracted by combining conformal mapping by polar transform with determining one- or two-dimensional angular frequency spectra either in spatially fixed or scanning mode. Results of proof-of-principle experiments are presented.

This study introduces a specialized Automatic Speech Recognition (ASR) system, leveraging the Whisper Large-v2 model, specifically adapted for radiological applications in French language. Our methodology focused on adapting the model to accurately transcribe medical terminology and diverse accents within the French language context, achieving a notable Word Error Rate (WER) of 17.121%. The research involved extensive data collection and preprocessing, utilizing a wide range of French medical audio content. The results demonstrate the system's effectiveness in transcribing complex radiological data, underscoring its potential to enhance medical documentation efficiency in French-speaking clinical settings. The discussion extends to the broader implications of this technology in healthcare, including its potential integration with Electronic Health Records (EHRs) and its utility in medical education. The study also explores future research directions, such as tailoring ASR systems to specific medical specialties and languages. Overall, this research contributes significantly to the field of medical ASR systems, presenting a robust tool for radiological transcription in the French language and paving the way for advanced technology-enhanced healthcare solutions.

This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person’s state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the Message Queue Telemetry Transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) System developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person’s face in the image captured by the UAV’s on-board camera and classify the emotion among seven possible ones (surprise, fear, happiness, sadness, disgust, anger or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.

This enables the chip to regulate the voice recognition function of the gadget, leading to a more natural and human-like process. Integrating this technique into the English language voice recognition system can greatly improve its precision in identifying the speech of a particular person. This research seeks to investigate and create an automatic error detection technique for an embedded speech instruction recognition system for English using artificial intelligence. The study commences with a conventional introduction to artificial intelligence, thereafter delving into a comprehensive investigation of the speech recognition algorithm. The MATLAB programme is used to determine the accurate number of words recognised by the system and its accuracy rate. The embedded teaching recognition system for English is then tested in different contexts to assess its performance. Several tests are performed to compare and analyse the results, which indicate that the integrated English voice recognition system achieves an accuracy rate of over 90% and has a low error rate in a calm environment. In a bustling environment with numerous auditory stimuli, the accurate recognition rate typically exceeds 60%.

In the dynamic field of mental health care, the nuanced application of Artificial Intelligence (AI) through Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) is a pivotal innovation in patient empowerment and service optimization. This study introduces a distinctive online therapy platform that capitalizes on the synergy of NLP and ASR to offer unprecedented levels of interactive and personalized therapeutic interventions. The architecture of our system is meticulously detailed, featuring an ASR component with an impressive Word Error Rate (WER) of 14% when trained on the diverse French subsets of the Mozilla Common Voice dataset, complemented by a high-precision NLP framework skilled in processing and responding to user inputs. The evaluation of our system highlights its efficacy in enhancing therapy sessions and user satisfaction, with an emphasis on the qualitative aspects of user feedback. The paper addresses challenges such as dataset representativeness and language model refinement and articulates the strategic solutions employed to overcome them. The paper concludes with forward-looking perspectives on AI's role in mental health services, advocating for the creation of sophisticated, language-specific datasets and models to satisfy the increasing demands of online therapy, reflecting a growing commitment of patients in the management of their therapy. This research underscores the transformative impact of AI in advancing mental health care into the digital age, representing a significant evolution over existing methodologies.

The automated transcription of handwritten characters into a legible output is a multi-faceted process with diverse applications. In this paper, a novel approach to optical character recognition (OCR) for handwritten digits is proposed that, in certain components, exceeds current architectures in terms of accuracy, effectiveness, adjustability, temporal efficiency, and/or computational simplicity. This model succeeds in the adoption and enhancement of deprecated or obsolete algorithms across eight steps of image pre-processing—normalization, grayscaling, thresholding/binarization, noise removal, skew-correction, skeletonization/thinning, line separation, and character segmentation. The aforementioned model is evaluated with the use of a Convolutional Neural Network (CNN) leveraging the Balanced eMNIST dataset for training and testing. By suggesting contour-based feature extraction methods as alternatives to pixel-by-pixel iteration, the proposed paradigm demonstrates its capacity to serve as a suitable alternative to current, commonly used algorithms and computational techniques for textual image classification.

In this paper, an intelligent blind guide system based on 2D LiDAR and RGB-D camera sensing is proposed, and the system is mounted on the smart cane. The intelligent guide system relies on 2D LiDAR, RGB-D camera, IMU, GPS, Jetson nano B01, STM32 and other hardware. The main advantage of the intelligent guide system proposed by us is that the distance between the smart cane and obstacles can be measured by 2D LiDAR based on Cartographer algorithm, thus achieving Simultaneous localization and mapping (SLAM). At the same time, through the improved yolov5 algorithm, pedestrians, vehicles, pedestrian crosswalks, traffic lights, warning posts, stone piers, tactile paving and other objects in front of the visually impaired can be quickly and effectively identified. Laser SLAM and improved yolov5 obstacle identification tests were carried out inside a teaching building on the campus of Hainan Normal University and on a pedestrian crossing on Longkun South Road in Haikou City, Hainan Province. The results show that the intelligent guide system developed by us can drive the wheels and omnidirectional wheels at the bottom of the smart cane, and give the smart cane a self-leading blind guide function like a "guide dog", which can effectively guide the visually impaired to avoid obstacles and reach the predetermined destination, and can quickly and effectively identify the obstacles on the way out. The laser SLAM speed of this system is 25~31FPS, which can realize the short-distance obstacle avoidance and navigation function both in indoor and outdoor envionments. The improved yolov5 helps to identify 86 types of objects, the recognition rate for pedestrian crosswalks and for vehicles are 84.6% and 71.8%, respectively; the overall recognition rate for 86 types of objects is 61.2%, and the obstacle recognition rate of the intelligent guide system is 25-26FPS.

Augmented reality (AR) provides an opportunity for mobile fitness applications to show users real-time feedback on their current fitness activity. For such applications, it is essential to accurately track the user’s current fitness activity using available mobile sensors, such as inertial measurement units (IMUs). Convolutional neural networks (CNNs) have been shown to produce strong results in different time series classification tasks, including the recognition of activities of daily living. However, fitness activities can present unique challenges to the human activity recognition task (HAR), including greater similarity between individual activities and fewer available data for model training. In this paper, we evaluate the applicability of CNNs to the fitness activity recognition task (FAR) using IMU data and determine the impact of input data size and sensor count on performance. For this purpose, we adapted three existing CNN architectures to the FAR task and designed a fourth CNN variant, which we call the scaling fully convolutional network (Scaling-FCN). We designed a preprocessing pipeline and recorded a running exercise data set with 20 participants, in which we evaluated the respective recognition performances of the four networks, comparing them with three traditional machine learning methods commonly used in HAR. On our data set, all CNN architectures significantly outperformed traditional machine learning methods, reaching up to 97.14±1.36% classification accuracy on the test set for ResNet. Whereas a reduced input data size invariably led to a performance loss, removing specific sensors improved the performance of all CNN architectures, with our Scaling-FCN reaching the highest accuracy of 99.86±0.11%. Our results suggest that CNNs are generally well suited for fitness activity recognition, and noticeable performance improvements can be achieved if sensors are dropped selectively.

Speech Emotion Recognition (SER) is an interesting and difficult problem to handle. In this paper, we deal with it through the implementation of deep learning networks. We have designed and implemented six different deep learning networks, a Deep Belief Network (DBN), a simple deep neural network (SDNN), a LSTM network (LSTM), a LSTM network with the addition of an attention mechanism (LSTM-ATN), a Convolutional neural network (CNN), and a Convolutional neural network with the addition of an attention mechanism (CNN-ATN), having in mind, apart from solving the SER problem, to test the impact of attention mechanism to the results. Dropout and Batch Normalization techniques are also used to improve the generalization ability (prevention of overfitting) of the models as well as to speed up the training process. The Surrey Audio-Visual Expressed Emotion database (SAVEE), and the Ryerson Audio-Visual Database (RAVDESS) database were used for training and evaluation of our models. The results showed that networks with the addition of the attention mechanism did better than the others. Furthermore, they showed that CNN-ATN was the best among tested networks, achieving an accuracy of 74% for the SAVEE and 77% for the RAVDESS dataset, and exceeded existing state-of-the-art systems for the same datasets.

This paper presents preliminary research that investigates the relationship between the flow of a group of jazz musicians, quantified through multi-person pose synchronization, and their collective emotions. Building upon previous studies that measured the physical synchronicity of team members by tracking their body movements and measuring the difference in arm, leg, and head movements, we introduce a novel metric termed "team entanglement". We employ facial expression recognition to evaluate the musicians’ collective emotions. Through correlation and regression analysis, we establish that higher levels of synchronized body and head movements correspond to lower levels of disgust, anger, sadness and higher levels of joy among the musicians. Furthermore, we utilize a Convolutional Neural Network (CNN) based deep learning model to predict the collective emotions of the musicians. This model leverages 17 body synchrony keypoint vectors as features, resulting in a training accuracy of 61.47% and a test accuracy of 66.17%.