Recently, the relationship between emotional arousal and depression has been studied. Focusing on this relationship, we first developed an arousal level voice index (ALVI) to measure arousal levels using the Interactive Emotional Dyadic Motion Capture database. Then, we calculated ALVI from the voices of depressed patients from two hospitals (Ginza Taimei Clinic [GTC] and National Defense Medical College hospital [NDMC]) and compared them with the severity of depression as measured by the Hamilton Rating Scale for Depression (HAM-D). Depending on the HAM-D score, the datasets were classified into a no depression (HAM-D<8) and a depression group (HAM-D≥8) for each hospital. A comparison of the mean ALVI between the groups was performed using the Wilcoxon rank-sum test and a significant difference at the level of 10% (p = 0.094) at GTC and 1% (p = 0.0038) at NDMC was determined. The area under the curve (AUC) of the receiver operating characteristic was 0.66 when categorizing between the two groups for GTC, and the AUC for NDMC was 0.70. The relationship between arousal level and depression severity was indirectly suggested via ALVI.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

Emotions play a vital role in understanding human behavior and interpersonal relationships. The ability to recognize emotions through Electroencephalogram (EEG) signals offers an alternative to traditional methods, such as questionnaires, enabling the identification of emotional states in a non-intrusive manner. Automatic emotion recognition holds great potential, eliminating the need for clinical examinations or physical visits, thereby contributing significantly to the advancement of Brain-Computer Interface (BCI) technology. However, one of the key challenges lies in effectively selecting and extracting relevant features from the EEG signal to establish meaningful distinctions between different emotional states. The process of feature selection is often time-consuming and demanding. In this research, we propose a groundbreaking approach for automatically identifying three emotional states (positive, negative, and neutral) by leveraging auditory stimulation of EEG signals. Our novel method directly applies the raw EEG signal to a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) architecture, bypassing the conventional feature extraction and selection steps. This unconventional approach offers a significant departure from existing literature. Our proposed network architecture comprises ten convolutional layers, followed by three LSTM layers and two fully connected layers. Through extensive simulations and evaluations on 12 active channels, our algorithm demonstrates exceptional performance, achieving an accuracy of 97.42\% and 95.23\% for the binary classification of negative and positive emotions, as well as a Cohen's Kappa coefficient of 0.96 and 0.93 for the three-class classification (negative, neutral, and positive), respectively. These promising results highlight the efficacy of our novel methodology and its potential implications in advancing emotion recognition using EEG signals.

This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person’s state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the Message Queue Telemetry Transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) System developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person’s face in the image captured by the UAV’s on-board camera and classify the emotion among seven possible ones (surprise, fear, happiness, sadness, disgust, anger or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.

To understand great disparities in disease outcomes between CIVID-19 patients, we explore infection and host responses in kinetics. From existing data, we deduced a model that the lungs are damaged by rapidly rising flow resistance as a result of retaining white blood cells in lung tissues. The retention of white blood cells is initially triggered by viral infection but aggravated by injuries caused by low temperature. Lungs are initially damaged by fluid leakage, rapidly followed by extruding blood into alveolar spaces. The step of blood extruding is predicted to take place in a very short time. Our simulations show that as little as 0.1% retention of white blood cells in the lungs can lead to their failure in 5 to 10 days. The small degrees of imbalance implies that this imbalance could be corrected by a large number of factors that are known to reduce flow resistance. The model implies that the top priority is maintaining blood micro-circulation and preserving organ functions in the entire disease course, especially after the virus has spread the whole lungs. From exploring a large number of hypothetical infection modes, we propose preventive, mitigating and treatment strategies for ultimately ending the pandemic. The first strategy is avoiding exposures that could result in widespread damages to lungs and taking post exposure mitigating measures that would reduce disease severity. The second strategy is reducing death rate and disability rate from the current levels to one tenth for infected patients by using multiple factors health optimization method. The double reduction strategies are expected to generate a series of chain reactions that favor mitigating or ending the pandemic. Some reactions include a big reduction of the amount of viral discharges from infected patients into the air, the avoidance of panic, chronic stress and emotional distress, and cross-infections which are expected in quarantines. The double reductions would have a final effect of ending the pandemic.

We conducted many model simulations to understand the causes of the damages of coronavirus to lung tissues and constructed a diagram showing viral development, immune response and damage accumulation curves. We found that main causes are (1) the phase lag between the viral reproduction process and a belayed immune response, (2) the direct viral damages and massive collateral damages which are mainly caused by belated immune responses, and (3) further tissue damages triggered by accumulated wastes in lungs. We deduced from those causes that the key strategies for preventing lung damages include avoiding direct lung infection, altering host-virus interactions, promoting immune responses, diluting virus concentrations in lung tissues by promoting viral migration to the rest of the body, maintaining waste removal balance, protecting heart function and renal function, avoiding other infections, reducing allergic reactions and other inflammation, etc. We finally discussed how to use dietary, medical, emotional, lifestyle, environmental, mechanical factors, etc. to alter disease outcomes. We show why true benefits of those factors cannot be determined by randomized controlled trials, and why the multiple-factor optimization approach can be highly effective by examining organ usable capacity in the cause of death. This treatment protocol using water, air, salt, sound, temperature, emotion, exercise, etc. can be the most powerful cures for viral and non-viral lung infections because they do not depend on molecular specificity and are freely available to anyone.

We examined special roles of the Central Nervous System (CNS) in an attempt to resolve the puzzle that chronic diseases cannot be cured by medicine. By exploring a skill-learning model, we found that the CNS is able to remember certain information reflecting biochemical and cellular (B&C) processes in the body. From the skill using ability, we found that the CNS is able to control basic B&C processes that drive and power the skill. From the ability to adjust forces and force direction of a physical act, we found that the CNS is able to adjust B&C processes that drive the physical act. From this adjustment capability, we further inferred that the CNS must also store information on the baseline B&C processes. As a whole, we found that the CNS can maintain information on baseline B&C processes, up-regulate or down-regulate the processes, and make comparisons in performing its regulatory functions. We found that chronic diseases are the results of deviated baseline B&C processes. Per the proved hypothesis, the CNS maintains deviated baseline B&C processes, and thus protects the body states of fully developed diseases. We then used the three CNS roles to explain that cancer progresses with increasing malignancy, cancer quickly returns after a surgery, cancer cells repopulate after chemotherapy and radiotherapy, cancer develops drug resistance inevitably, immune cells rebound after suppression, generally poor benefits of cancer drugs such as beta-blockers, etc. We further showed that long-term exercises generally push most, if not all, baseline B&C processes in diametrical opposing directions against the diseased B&C processes, implying that exercises play unique roles in reversing chronic diseases. Finally, we proposed several strategical approaches to resetting the CNS’ state memory as the essential condition for curing chronic diseases.

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

A multitude of factors influence our well-being and health in everyday life. Some of which we are totally aware like a delayed train, car exhausts, or continuous work stress. Other factors influence us on a subconscious level, making them, however, not less important to address. One of these factors is the built environment surrounding us almost every second of our lives. The idea of biophilic design states the importance of natural elements implemented in architectural structures to improve the occupants’ health and well-being. Adding to this field of research, this article targets the impact of biophilic design on positive emotions and productivity by using novel approaches like Facial Emotion Recognition (FER) with Residual Masking Networks, and sentiment detection using Large Language Models. Two separate but related studies were conducted and their results reported here. The first study measured emotions of people when confronted with images of different kinds of architecture, via FER (Facial Emotion Recognition) and also via a user survey. We distinguish between self-stated emotions entered through a survey by study participants, and emotions detected from studying the participants’ faces through AI from our FER (Facial Emotion Recognition) system. We found clear trends for most detected emotions, and significant evidence for self-stated emotions, that architecture implementing biophilic design evokes more positive emotions than one that does not. The second study measures the influence of natural elements on productivity and team-engagement. We found that natural elements do influence productivity and sentiment positively; however, only the change in sentiment was shown to be significant. As our sample size, especially for the second study, was relatively small, future research will apply these ideas in a larger setup to acquire further evidence for the importance of biophilic design for human well-being and health.