In this paper, we investigate the relationship people have with their smart devices. We use the concept of agency to capture aspects of users’ sense of mastery as they relate to their device. This study gives preliminary evidence of the existence of two independent dimensions of agency for modeling the interaction between humans and smart devices: (i) user agency and (ii) device agency. These constructs emerged from an exploratory factorial analysis conducted on a survey data collected from 587 participants. In addition, we investigate the correlation between user agency and device agency with background variables of the respondents. Finally, we argue that mapping the users’ dynamics with their device into user agency and device agency fosters a better understanding of the needs of the users and helps in designing interfaces tailored for the specific capabilities and expectations of the users.

Cognitive deterioration caused by illness or aging often occurs before symptoms arise, and their timely diagnosis is crucial to reducing its medical, personal, and societal impacts. Brain-Computer Interfaces (BCIs) stimulate and analyze key cerebral rhythms, enabling reliable cognitive assessment that can accelerate diagnosis. The BCI system presented analyzes Steady-State Visually Evoked Potentials (SSVEPs) elicited in subjects of varying age to detect cognitive aging, predict its magnitude, and identify its relationship with SSVEP features (band power and frequency detection accuracy), which were hypothesized to indicate cognitive decline due to aging. The BCI system was tested with subjects of varying age to assess its ability to detect aging-induced cognitive deterioration. Rectangular stimuli flickering at theta, alpha, and beta frequencies were presented to subjects, and frontal and occipital EEG responses were recorded. These were processed to calculate detection accuracy for each subject and calculate SSVEP band power. A neural network was trained using the features to predict cognitive age. The results showed potential cognitive deterioration through age-related variations in SSVEP features. Frequency detection accuracy declined after age group 20–40 and band power, throughout all age groups. SSVEPs generated at theta and alpha frequencies, especially 7.5 Hz, were the best indicators of cognitive deterioration. Here, frequency detection accuracy consistently declined after age group 20-40 from an average of 96.64% to 69.23%. The presented system can be used as an effective diagnosis tool for age related cognitive decline.

Bell type inequalities are proven using oversimplified probabilistic models and/or counterfactual definiteness (CFD). If setting-dependent variables describing measuring instruments are correctly introduced none of these inequalities may be proven. In spite of this a belief in a mysterious quantum nonlocality is not fading. Computer simulations of Bell tests allow studying different scenarios how the experimental data might have been created. They allow also to generate outcomes of various counterfactual experiments such as repeated or simultaneous measurements performed in different settings on the same ‘’ photon-pair” etc. They allow reinforcing or relaxing CFD- compliance and /or to study the impact of various “photon identification procedures” mimicking those used in real experiments. Using a specific setting- dependent identification procedure data samples consistent with quantum predictions may be generated. It reflects an active role of instruments during the measurement process. Each setting dependent data samples are consistent with specific setting –dependent probabilistic models which may not be deduced using non-contextual local realistic or stochastic hidden variables. In this paper we discuss the results of these simulations. Since the data samples are generated in a locally causal way, these simulations provide additional strong arguments for closing the door on quantum nonlocality

This paper presents a methodology for the integration of Building Information Modeling (BIM) and Life Cycle Cost Analysis (LCCA) to assess the economic implications of designing aging-in-place (AIP) homes at the conceptual stage. With the global increase in the aging population, there is an increased demand for housing solutions tailored to the needs of elderly individuals. Focusing on the importance of the early phase of design, this study aims to improve the process of making efficient decisions by providing a comprehensive assessment of the life cycle costs associated with AIP homes. The study introduces a semi-automated model for the economic evaluation of AIP homes, enabling the estimation of costs throughout the houses’ entire life cycle, from design and construction to operation, maintenance, and eventual renovation or disposal. The said model facilitates the exploration of the long-term economic feasibility of design’s related decisions with an emphasis on the importance of considering the life cycle costs early during the design process to optimize the functionality and economic viability. By investing in accessible and universal design features upfront, the initial costs for modifications can lead to long-term savings by reducing the need for extensive retrofits. The model can easily do comparison between different design alternatives in terms of their lifecycle costs, allowing designers to assess the financial impact of using important features in their design such as wider doorways, accessible bathrooms, and elevators. Overall, this study provides valuable insights for designers and homeowners about the economic aspects of designing AIP homes as a support for efficient decision-making during the early stages of the design process.

The paper presents a proposal for an in-house mathematical model of a liquid flat-plate solar collector. The proposed model is a one-dimensional distributed parameter model enabling simulations of the collector operation under arbitrarily variable boundary conditions. The model is based on the solution of energy balance equations for all components of the collector. The formulated differential equations are solved iteratively using an implicit difference scheme. In order to obtain a stable numerical solution, it is necessary to use appropriate steps of the time and spatial division. These were found by comparing the results obtained from the model with the results of the analytical solution available in the literature for the transient state, which constitutes the novelty of the present study. The accuracy of the results obtained from the model was verified experimentally by comparing the measured and the calculated history of the fluid temperature at the outlet of the collector. The calculation of the collector time constant is proposed in the paper as an example of the model practical application. The results of the time constant calculation were compared with the values obtained experimentally on the test stand. This is another novelty of the presented research. The analysed collector instantaneous efficiency was then calculated for selected outdoor conditions. The presented mathematical model can also be used to verify the correctness of the collector operation. Comparing, on an ongoing basis, the measured and the calculated values of the fluid temperature at the collector outlet, conclusions can be drawn about the process of solar glass fouling or glycol gelling. The model's simplicity and the low computational demands enable such comparisons in an online mode.

This study delves into the realm of heuristic evaluation within usability testing, focusing on refining and applying a tailored algorithm that simplifies the implementation of the Analytic Hierarchy Process for heuristic prioritization. Addressing the prevalent challenge of disparate evaluation methodologies and the absence of a standardized process in usability testing, our research introduces a novel method that leverages the Analytic Hierarchy Process alongside a bespoke algorithm. This algorithm utilizes transitive properties for pairwise comparisons, significantly reducing the evaluative workload. This innovative approach facilitates the estimation of heuristic relevance irrespective of the number of items per heuristic or the item scale and streamlines the overall evaluation process. In addition to rigorous simulation testing of the tailored algorithm, we applied our method in a practical scenario, engaging seven usability experts in evaluating a web interface. This empirical application underscored our method’s capacity to diminish the requisite comparison count and spotlight areas of improvement for critically weighted yet underperforming heuristics. The outcomes of this study underscore the efficacy of our approach in enhancing the efficiency and organization of heuristic evaluations, paving the way for more structured and effective usability testing methodologies in future research endeavors.

Abstract: In recent years, low frequency (LF) electroencephalogram (EEG) signals have been decoded to obtain kinematic trajectories with the aim of achieving closed loop natural control. However, decoded trajectories suffer variability and low correlation against the measured movement. This paper suggests that if EEG features of motor intents are directly associated with fixed points along a given range of motion, then the natural kinematic parameters can be quantified. A novel classification method is proposed to evaluate this hypothesis along with equations for obtaining the movement parameters (velocity, acceleration). Furthermore, this implies that the force of an end-effector and work done in moving the end-effector may be computed, leading to natural control of EEG-based robotic arms and neuroprostheses. Finally, expectations are that combining the proposed method with existing classification methods will increase the accuracy and scalability of brain-computer interface (BCI) applications.

This study observes, interprets, and analyses the knowledge production in the research field of Human–Robot Interaction (HRI). It intends to foreground the hidden assumptions that are often taken for granted when roboticist design and conduct their research. By doing so, this study demonstrates how these assumptions influence the result of their research. Based on data collected through sociological field observation, this study argues that the current practise in HRI research is highly anthropocentric. In short, the robots are designed to be like human instead of for human. Therefore, the human–robot relationship embodies the existing power relations between human beings. These relations generate inequality, hierarchy, and dominance, which are the opposite of the common imagination of the robotised future among roboticists. For the purpose of enabling the robotised future closer to their ideal, this study suggests that HRI researchers to go beyond the conventional methodology, to allow a human–robot relationship that realises reciprocity.

Augment reality (AR) is crucial for immersive human-computer interaction (HCI) and vision of artificial intelligence (AI). Labeled data drove object recognition in AR. However, manual annotating data is expensive and labor-intensive, and furthermore, scanty labeled data limits the application of AR. Aiming at solving the problem of insufficient training data in AR object recognition, an automated vision data synthesis method called BAGAN is proposed in this paper based on the 3D modeling and GAN algorithm. Our approach has been validated to have better performance than other methods through image recognition task on natural image database ObjectNet3D. This study can shorten the algorithm development time of AR and expand the application scope of AR, which is of great significance to immersive interactive systems.

In this paper we introduce a computational model for the simulation of hypervelocity impact (HVI) phenomena which is based on the Discrete Element Method (DEM). Our paper constitutes the first application of DEM to the modeling and simulating of impact events for velocities beyond 5 kms⁻¹. We present here the results of a systematic numerical study on HVI of solids. For modeling the solids, we use discrete spherical particles that interact with each other via potentials. In our numerical investigations we are particularly interested in the dynamics of material fragmentation upon impact. We model a typical HVI experiment configuration where a sphere strikes a thin plate and investigate the properties of the resulting debris cloud. We provide a quantitative computational analysis of the resulting debris cloud caused by impact and a comprehensive parameter study by varying key parameters of our model. We compare our findings from the simulations with recent HVI experiments performed at our institute. Our findings are that the DEM method leads to very stable, energy–conserving simulations of HVI scenarios that map the experimental setup where a sphere strikes a thin plate at hypervelocity speed. Our chosen interaction model works particularly well in the velocity range where the local stresses caused by impact shock waves markedly exceed the ultimate material strength.

This work addresses the challenge of EEG visual multiclass classification into 40 classes for Brain-Computer interface applications, by using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage, since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, performing multiclassifiers based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and Minimum-Norm Estimate algorithms are implemented to select discriminant channels and enhance EEG data. Hence, deep EEGNet and Convolutional-recurrent neural networks are implemented separately to classify EEG data of image visualization into 40 labels. By using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures, respectively. Satisfactory results obtained with this method offer a new implementation opportunity for multi-task BCI applications by utilizing a reduced number of channels (<50%), compared to those presented in the related literature where the whole set of channels is used.

Gyroscopes are fascinating instruments with a history of about 200 years. When J.G.F. Bohnenberger presented his machine to his students in 1810 at the University of Tuebingen, Germany, nobody could have foreseen that this fascinating development would be used for complex orientation and positioning. At the University of Stuttgart, Germany, a collection of 160 exhibits is available and in transition for a sustainable future. Here, the systems are digitized in 2D, 2.5D and 3D and are made available for a world-wide community using OpenAccess platforms. The technologies being used are Computed Tomography, Computer Vision, Endoscopy and Photogrammetry. The workflows for combining voxel representations and colored point clouds are described, to create Digital Twins of the tangible assets. Advantages and disadvantages are discussed und work for near future is outlined in this new and challenging field of Tech Heritage digitization.

OpenAI has managed to turn 100 million heads in two months towards their new Language model tool (LM) ChatGPT. The third generation Generative Pretrained Transformer (GPT-3) has the capacity to tackle simple to complex and sophisticated problems, while providing reasoning behind its generated answers. ChatGPT can be used to increase productivity and improve efficiency and face challenging problems. Programming mobile applications is a challenging task that requires professional software engineers, skills and abilities to be developed. The following paper takes a case study approach to assess how novice app developers can use ChatGPT to generate Java scripts that will be used in Android studio to create a functional application. The results after, many iterations and ongoing conversations with ChatGPT managed to create an application for the anticipated function. Important insights have been drawn from the case study that could set the ground for any novice user seeking to create applications using Java scripting and Android Studio.

Biomolecular structure drives function, and computational capabilities have progressed such that the prediction and computational design of biomolecular structures is increasingly feasible. Because computational biophysics attracts students from many different backgrounds and with different levels of resources, teaching the subject can be challenging. One strategy to teach diverse learners is with interactive multimedia material that promotes self-paced, active learning. We have created a hands-on education strategy with a set of fifteen modules that teach topics in biomolecular structure and design, from fundamentals of conformational sampling and energy evaluation to applications like protein docking, antibody design, and RNA structure prediction. Our modules are based on PyRosetta, a Python library that encapsulates all computational modules and methods in the Rosetta software package. The workshop-style modules are implemented as Jupyter Notebooks that can be executed in the Google Colaboratory, allowing learners access with just a web browser. The digital format of Jupyter Notebooks allows us to embed images, molecular visualization movies, and interactive coding exercises. This multimodal approach may better reach students from different disciplines and experience levels as well as attract more researchers from smaller labs and cognate backgrounds to leverage PyRosetta in their science and engineering research. All materials are freely available at https://github.com/RosettaCommons/PyRosetta.notebooks.

There have been multiple technological advancements that promise to gradually enable devices to measure and record signals with high resolution and accuracy in the domain of Brain Computer Interfaces (BCI). This review paper provides a comprehensive overview of fNIRS, EEG, and fMRI, including their principles, advantages, limitations, and integration with other modalities for advanced BCIs. The paper highlights the advantages of integrating multiple modalities, such as increased accuracy and reliability, and discusses the challenges and limitations of multimodal integration. Applications of advanced BCIs in clinical, assistive, gaming, and entertainment domains are also discussed. Furthermore, we explain the data acquisition approaches for each of these modalities. We also demonstrate various software programs that help in extracting, cleaning, and refining the data. We conclude this paper with discussion on the available literature on data acquisition approaches and a comparison of the ease of use for each of the modalities.

A single paragraph of about 200 words maximum. For research articles, abstracts should give a pertinent overview of the work. We strongly encourage authors to use the following style of structured abstracts, but without headings: (1) Background: Place the question addressed in a broad context and highlight the purpose of the study; (2) Methods: briefly describe the main methods or treatments applied; (3) Results: summarize the article’s main findings; (4) Conclusions: indicate the main conclusions or interpretations. The abstract should be an objective representation of the article and it must not contain results that are not presented and substantiated in the main text and should not exaggerate the main conclusions.

Deep learning heavily relies on statistical correlations to drive artificial intelligence (AI) innovations, particularly in computer vision applications like autonomous driving and robotics. However, despite providing a solid foundation for deep learning, these statistical correlations can be vulnerable to unforeseen and uncontrolled factors. The lack of prior knowledge guidance can result in spurious correlations, introducing confounding factors and affecting the model's robustness. To address this challenge, recent research efforts have focused on integrating causal theory into deep learning methodologies. By modelling the inherent and unbiased causal structure, causal theory can potentially mitigate the impact of spurious correlations effectively. Hence, this paper explores the basics of causal methodologies in image classification.

A machine learning method for classifying Lung UltraSound is here proposed to pro- vide a point of care tool for supporting a safe, fast and accurate diagnosis, that can also be useful during a pandemic like as SARS-CoV-2. Given the advantages (e.g. safety, rapidity, portability, cost-effectiveness) provided by the ultrasound technology over other methods (e.g. X-ray, computer tomography, magnetic resonance imaging), our method was validated on the largest LUS public dataset. Focusing on both accuracy and efficiency, our solution is based on an efficient adaptive ensembling of two EfficientNet-b0 models reaching 100% of accuracy, which, to our knowledge, outperforms the previous state-of-the-art. The complexity of this solution keeps the number of parameters in the same order as an EfficientNet-b0 by adopting specific design choices that are adaptive ensembling with a combination layer, ensembling performed on the deep features, minimal ensemble only two weak models. Moreover, a visual analysis of the saliency maps on sample images of all the classes of the dataset reveals where the focus is on an inaccurate weak model versus an accurate model.

Mental stress state recognition using electroencephalogram (EEG) signals for real-life applications needs a conventional wearable device. This requires an efficient number of EEG channels and an optimal feature set. The main objective of the study is to identify an optimal feature subset that can best discriminate mental stress states while enhancing the overall performance. Thus, multi-domain feature extraction methods were employed, namely, time domain, frequency domain, time-frequency domain, and network connectivity features, to form a large feature vector space. To avoid the computational complexity of high dimensional space, a hybrid feature selection (FS) method of minimum Redundancy Maximum Relevance with Particle Swarm Optimization and Support Vector Machine (mRMR-PSO-SVM) is proposed to remove noise, redundant, and irrelevant features and keep the optimal feature subset. The performance of the proposed method is evaluated and verified using four datasets, namely EDMSS, DEAP, SEED, and EDPMSC. To further consolidate, the effectiveness of the proposed method is compared with that of the state-of-the-art heuristic methods. The proposed model has significantly reduced the features vector space by an average of 70% in comparison to the state-of-the-art methods while significantly increasing overall detection performance.

Artificial intelligence (AI) and 3D printing (3DP) play critical roles in what is known as the 4th Industrial Revolution by developing data- and machine-intelligence-based integrated production technologies. This shift has led to increasingly complex design requirements and fabrication methods, posing several challenges for implementing design, fabrication process, and architectural quality standardization. This paper systematically reviews AI techniques applied in diverse stages of 3DP production in architecture. The research goals are to (1) offer a comprehensive critical analysis of the body of literature; (2) identify and categorize approaches to integrating AI in the production of 3D-printed structures; (3) identify and discuss challenges and opportunities of AI integration in architectural production of 3DP structures; and (4) identify gap and provide recommendations for future research. The findings indicate that topics related to AI applications are current and trending, receiving increasing attention from researchers in general and particularly those working in machine and deep learning, artificial neural networks, and pattern recognition. However, the potential of the application of AI in architectural production using additive manufacturing still needs to be explored. Considering this, the paper emphasizes the necessity of redefining traditional field boundaries and opening new opportunities in the sector.

Hand gestures may play an important role in medical applications for health care of elderly people, where providing a natural interaction for different requests can be executed by making specific gestures. In this study we explored three different scenarios using a Microsoft Kinect V2 depth sensor then evaluated the effectiveness of the outcomes. The first scenario utilized the default system embedded in the Kinect V2 sensor, which depth metadata gives 11 parameters related to the tracked body with five gestures for each hand. The second scenario used joint tracking provided by Kinect depth metadata and depth threshold together to enhance hand segmentation and efficiently recognize the number of fingers extended. The third scenario used a simple convolutional neural network with joint tracking by depth metadata to recognize five categories of gestures. In this study, deaf-mute elderly people execute five different hand gestures to indicate a specific request, such as needing water, meal, toilet, help and medicine. Then, the requests were sent to the care provider’s smartphone because elderly people could not execute any activity independently. The system transferred these requests as a message through the global system for mobile communication (GSM) using a microcontroller.

Objectives: Studies evaluating machine learning (ML) algorithms on cross-lingual RadLex® mappings for developing context-sensitive radiological reporting tools are lacking. Therefore, we investigated whether ML-based approaches can be utilized to assist radiologists in providing key imaging biomarkers – such as The Alberta stroke programme early CT score (APECTS). Material and Methods: A stratified random sample (age, gender, year) of CT reports (n=206) with suspected ischemic stroke was generated out of 3997 reports signed off between 2015-2019. Three independent, blinded readers assessed these reports and manually annotated clinico-radiologically relevant key features. The primary outcome was whether ASPECTS should have been provided (yes/no: 154/52). For all reports, both the findings and impressions underwent cross-lingual (German to English) RadLex®-mappings using natural language processing. Well-established ML-algorithms including classification trees, random forests, elastic net, support vector machines (SVMs) and boosted trees were evaluated in a 5 x 5-fold nested cross-validation framework. Further, a linear classifier (fastText) was directly fitted on the German reports. Ensemble learning was used to provide robust importance rankings of these ML-algorithms. Performance was evaluated using derivates of the confusion matrix and metrics of calibration including AUC, brier score and log loss as well as visually by calibration plots. Results: On this imbalanced classification task SVMs showed the highest accuracies both on human-extracted- (87%) and fully automated RadLex® features (findings: 82.5%; impressions: 85.4%). FastText without pre-trained language model showed the highest accuracy (89.3%) and AUC (92%) on the impressions. Ensemble learner revealed that boosted trees, fastText and SVMs are the most important ML-classifiers. Boosted trees fitted on the findings showed the best overall calibration curve. Conclusions: Contextual ML-based assistance suggesting ASPECTS while reporting neuroradiological emergencies is feasible, even if ML-models are restricted to be developed on limited and highly imbalanced data sets.

In this paper, we present a novel approach for managing the file system in Linux using a voice assistant. Our system allows users to perform file system operations such as creating directories, renaming files, and deleting files by issuing voice commands. We develop a voice assistant using Python libraries and integrate it with the file system in Linux. The voice assistant is capable of understanding natural language and executing commands based on the user's voice inputs. We conduct experiments to evaluate the performance of the system and demonstrate that our approach is effective and efficient in managing the file system using voice commands. Our system can enhance the accessibility and usability of the file system in Linux for individuals with disabilities or those who prefer a hands-free approach to file management.

Chatbots are intelligent conversational computer systems designed to mimic human conversation to enable automated online guidance and support. The increased benefits of chatbots led to their wide adoption by many industries in order to provide virtual assistance to customers. Chatbots utilise methods and algorithms from two Artificial Intelligence domains: Natural Language Processing and Machine Learning. However, there are many challenges and limitations in their application. In this survey we review recent advances on chatbots, where Artificial Intelligence and Natural Language processing are used. We highlight the main challenges and limitations of current work and make recommendations for future research investigation

Incorporating substantial sustainable development issues into teaching and learning is the ultimate task of Education for Sustainable Development (ESD). The purpose of our study is to identify the confused students who have failed to master the skill(s) given by the tutors as a homework using Intelligent Tutoring System (ITS). We have focused ASSISTments, an ITS in this study and scrutinized the skill-builder data using machine learning techniques and methods. We used seven candidate models that include: Naïve Bayes (NB), Generalized Linear Model (GLM), Logistic Regression (LR), Deep Learning (DL), Decision Tree (DT), Random Forest (RF), and Gradient Boosted Trees (XGBoost). We trained, validated and tested learning algorithms, performed stratified cross-validation and measured the performance of the models through various performance metrics i.e., ROC (Receiver Operating Characteristic), Accuracy, Precision, Recall, F-Measure, Sensitivity & Specificity. We found GLM, DT & RF are high accuracies achieving classifiers. However, other perceptions such as detection of unexplored features that might be related to the forecasting of outputs can also boost the accuracy of the prediction model. Through machine learning methods, we identified the group of students which were confused attempting the homework exercise and can help students foster their knowledge, and talent to play a vital role in environmental development.

The Release of government dataset for public use can potentially strengthen the relationship between the government and its constituents. However, research shows that there are several challenges for open data effectiveness. This paper reviews current determinants and issues associated with the open government data (OGD) procedures. The review concentrates on two ends of the spectrum: First, from the perspective of the preparation by the government, focusing on the organization of traditional governmental datasets and how the recording of the data is administered. Second, from the perspective of the users, focusing on the way in which the data is released to the general public and on human-computer interaction (HCI) issues between end-user and data-consumption interfaces. Following a thorough analysis of these two opposing challenges, the paper proposes approaches to mitigate them. This review and subsequent recommendations contribute and expand current understanding of open government data effectiveness and can lead to public policy changes, development of new procedures and strategies, and ultimately improvements at both ends of the federal open data endeavor.

Integrating voice assistant technology can potentially enhance accessibility and user interaction in web-based platforms for geospatial data visualisation and processing. This paper presents an open-source development incorporating a voice virtual assistant into the BStreams web application platform, designed specifically for visualising geospatial data. The study aimed to mitigate the observed limitations of virtual assistants in understanding the semantics and context of user commands in the geospatial domain. A discourse framework specialised for geospatial data was developed using a structured prototype methodology. In addition, a survey assisted in identifying commonly used English terminologies for geospatial data interaction. The questionnaire results were subsequently assessed using the ChatGPT natural language processing model. The application used open-source frameworks, including Web Speech API, Leaflet, Mapbox geocoding, and JavaScript. This investigation indicates that voice virtual assistants can potentially enhance human-computer interaction for geospatial data visualisation and processing. However, challenges related to natural language understanding, accents, and domain knowledge were raised. The paper advocates for further research to refine the integration of voice technology in this domain.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

General–purpose automatic speech recognition (ASR) systems have improved their quality and are being used for pronunciation assessment. However, the assessment of isolated short utterances, as words in minimal pairs for segmental approaches, remains an important challenge, even more for non-native speakers. In this work, we compare the performance of our own tailored ASR system (kASR) with the one of Google ASR (gASR) for the assessment of Spanish minimal pair words produced by 33 native Japanese speakers in a computer-assisted pronunciation training (CAPT) scenario. Participants of a pre/post-test training experiment spanning four weeks were split into three groups: experimental, in-classroom, and placebo. Experimental group used the CAPT tool described in the paper, which we specially designed for autonomous pronunciation training. Statistically significant improvement for experimental and in-classroom groups is revealed, and moderate correlation values between gASR and kASR results were obtained, beside strong correlations between the post-test scores of both ASR systems with the CAPT application scores found at the final stages of application use. These results suggest that both ASR alternatives are valid for assessing minimal pairs in CAPT tools, in the current configuration. Discussion on possible ways to improve our system and possibilities for future research are included.

As people grow a custom to effortless outdoor navigation there is a rising demand for similar possibility indoors as well. Unfortunately, indoor localization, being one of the necessary requirements for navigation, continues to be problem without a clear solution. In this article we are proposing a method for an indoor positioning system using a single image. This is made possible using small preprocessed database of images with known control points as the only preprocessing needed. Using feature detection with SIFT algorithm we can look through the database and find image which is the most similar to the image taken by user. Pair of images is then used to find coordinates of database image using PnP problem. Furthermore, projection and essential matrices are determined allowing for the user image localization ~ determining the position of the user in indoor environment. Benefits of this approach lies in the single image being the only input from user and no requirements for new onsite infrastructure and thus enables a simpler realization for the building management.

Abstract: Although experimental attempts to measure a single molecule/particle at room temperature or under physiological conditions without immobilization, for example on a surface, or without hydrodynamic flow have so far failed, this failure has given impetus to the underlying theory of Brownian motion towards its stochastic due to diffusion. Quantifying the thermodynamic jitter of molecules/particles inspires many and forms the theoretical basis of single-molecule/single-particle biophysics and biochemistry. For the first time, our simulation results for a live cell (cytoplasm) show that the tracks of individual single molecules are localized in Brownian motion, while there is fanning out in fractal diffusion (anomalous diffusion).

Surgical navigation has evolved as a vital tool in maxillofacial surgery, offering precise and patient-specific data. This study explores the clinical applications and accuracy of intraoperative tool tracking in maxillofacial surgery. The research includes 37 patients with various pathologies who underwent surgery assisted by a surgical navigation system using tracked instruments. The study showcases two representative cases: one involving coronoid hyperplasia with mouth opening deficit and another addressing nose-orbital-ethmoidal-frontal ossifying fibroma resection. The results indicate that surgical navigation with tracked instruments provides high precision (<1.5 mm error), reduced surgical time, and less invasive approaches. The study highlights the potential for reproducible outcomes and increased safety, especially in complex cases. Despite some limitations, the synergy between surgical navigation and tracked instruments offers a promising approach in maxillofacial surgery, expanding its applications beyond current practices.

Information is the currency of life, but the origin of prebiotic information remains a mystery. We propose transitional pathways from the cosmic building blocks of life to the complex prebiotic organic chemistry that led to the origin of information systems. The prebiotic information system, specifically the genetic code, is segregated, linear, and digital and probably appeared during biogenesis four billion years ago. In the peptide/RNA world, lipid membranes randomly encapsulated amino acids, RNA, and protein molecules, drawn from the prebiotic soup, to initiate a molecular symbiosis inside the protocells. This endosymbiosis led to the hierarchical emergence of several requisite components of the translation machine: tRNAs, aaRS, mRNAs, and ribosomes. When assembled in the right order, the translation machine created biosynthetic polypeptides, a process that transferred information from mRNAs to proteins. This was the beginning of the prebiotic information age. The molecular attraction between tRNA and amino acids led to different stages of the translation machines and the genetic code. tRNA is an ancient molecule that designed and built mRNA for storing the information of its cognate amino acid. Each mRNA strand became the storage device for the genetic information that encoded the amino acid sequences in triplet nucleotides. As information appeared in the digital languages of the codon within mRNA, and the genetic code for protein synthesis evolved, the prebiotic chemistry then became more organized and directional. The origin of the genetic code is enigmatic; herein we propose an evolutionary explanation: the demand for a wide range of specific enzymes in the peptide/RNA world was the main selective pressure for the origin of information-directed protein synthesis. We review three main concepts on the origin and evolution of the genetic code: the stereochemical theory, the coevolution theory, and the adaptive theory. These three theories are compatible with our coevolution model of the translation machines and the genetic code. We suggest biosynthetic pathways as the origin of the specific translation machines which provided the framework for the origin of the genetic code. During translation, the genetic code developed in three stages coincident with the refinement of the translation machines: GNC code developed by the pre-tRNA/pre-aaRS /pre-mRNA machine, SNS code by the tRNA/aaRS/mRNA machine, and finally the universal genetic code by the tRNA/aaRS/mRNA/ribosome machine. Our hypothesis provides the logical and incremental steps for the origin of the programmed protein synthesis. In order to understand the prebiotic information system better, we converted letter codons into numerical codons in the Universal Genetic Code Table. We have developed a software called CATI (Codon-Amino Acid-Translator-Imitator) to translate randomly chosen numerical codons into corresponding amino acids and vice versa. This conversion has granted us insight into how the translation might have worked in the peptide/RNA world. There is great potential in the application of numerical codons to bioinformatics such as barcoding, DNA mining, or DNA fingerprinting. We constructed the likely biochemical pathways for the origin of translation and the genetic code using the Model-View-Controller (MVC) software framework, and the translation machinery step-by-step. Using AnyLogic software we were able to simulate and visualize the entire evolution of the translation machines and the genetic code. The results indicate that the emergence of the information age from the peptide/RNA world was a watershed event in the origin of life about four billion years ago.

Experiments to measure a single molecule/particle, i.e. an individual molecule/particle, at room temperature or under physiological conditions without immobilization, for example on a surface, or without significant hydrodynamic flow have so far failed. This failure has given impetus to the underlying theory of Brownian molecular motion towards its stochastic due to diffusion. Quantifying the thermodynamic jitter of molecules/particles inspires many and forms the theoretical basis of single-molecule/single-particle biophysics and biochemistry. For the first time, our simulation results for a live cell (cytoplasm) show that the tracks of individual single molecules are localized in Brownian motion, while there is fanning out in fractal diffusion (anomalous diffusion).

The Late Heavy Bombardment Period (4.1 to 3.8 billion years ago) of heightened impact cratering activity on young Earth is likely the driving force for the origin of life. During the Eoarchean, asteroids such as carbonaceous chondrites delivered the building blocks of life and water to early Earth. Asteroid collisions created innumerable hydrothermal crater lakes in the Eoarchean crust which inadvertently became the perfect cradle for prebiotic chemistry. These hydrothermal crater lakes were filled with cosmic water and the building blocks of life. forming a thick prebiotic soup. The unique combination of exogenous delivery of extraterrestrial building blocks of life, and the endogenous biosynthesis in hydrothermal impact crater lakes very likely gave rise to life. A new symbiotic model for the origin of life within the hydrothermal crater lakes is here proposed. In this scenario, life arose around four billion years ago through five hierarchical stages of increasing molecular complexity: cosmic, geologic, chemical, information, and biological. During the prebiotic synthesis, membranes first appeared in the hydrothermal crater lakes, followed by the simultaneous origin of RNA and protein molecules, creating the RNA/protein world. These proteins were noncoded protein enzymes that facilitated chemical reactions. RNA molecules formed in the hydrothermal crater basin by polymerization of the nucleotides on the montmorillonite mineral substrate. Similarly, the initial synthesis of abiotic protein enzymes was mediated by the condensation of amino acids on pyrite surfaces. The regular wet-dry cycles within the crater lakes assisted further concentration, condensation, and polymerization of the RNAs and proteins. Lipid membranes randomly encapsulated amino acids, RNA, and protein molecules from the prebiotic soup to initiate a molecular symbiosis inside the protocells, this led to the hierarchical emergence of several cell components. As the role of protein enzymes became essential for catalytic process in the RNA/protein world, Darwinian selection from noncoded to coded protein synthesis led to translation systems and the genetic code, heralding the information stage. In this stage, the biochemical pathways suggest the successive emergence of translation machineries such as tRNAs, aaRS, mRNAs, and of ribosomes for protein synthesis. The molecular attraction between tRNA and amino acid led to the emergence of translation machinery and the genetic code. tRNA is an ancient molecule that created mRNA for the purpose of storing amino acid information like a digital strip. Each mRNA strand became the storage device for genetic information that encoded the amino acid sequences in triplet nucleotides. As information became available in the digital languages of the codon within mRNA, biosynthesis became less random and more organized and directional. The original translation machinery was simpler before the emergence of the ribosome than that of today. We review three main concepts on the origin and evolution of the genetic code: the stereochemical theory, the coevolution theory, and adaptive theory. We believe that these three theories are not mutually exclusive, but are compatible with our coevolution model of translations machines and the genetic code. We suggest biosynthetic pathways as the origin of the translation machine that provided the framework for the origin of the genetic code. During translation, the genetic code developed in three stages coincident with the refinement of the translation machinery: GNC code with four codons and four amino acids during interactions of pre-tRNA/pre-aaRS /pre-mRNA, SNS code consisting of 16 codons and 10 amino acids appeared during the tRNA/aaRS/mRNA interaction, and finally the universal genetic code evolved with the emergence of the tRNA/aaRS/mRNA/ribosome machine. The universal code consists of 64 codons and 20 amino acids, with a redundancy that minimizes errors in translation. To address the question of the origin of the biological information system in the RNA/protein world, we converted letter codons into numerical codons in the Universal Genetic Code Table. We developed a software called CATI (Codon-Amino Acid-Translator-Imitator) to translate randomly chosen numerical codons into corresponding amino acids and vice versa, gaining insight into how translation might have worked in the RNA/protein world. We simulated the likely biochemical pathways for the origin of translation and the genetic code using the Model-View-Controller (MVC) software framework, and the translation machinery step-by-step. We used AnyLogic software to simulate and visualize the evolution of the translation machines and the genetic code. We conclude that the emergence of the information age from the RNA/protein world was a watershed event in the origin of life about four billion years ago.

Recent improvements in deepfake creation have made deepfake videos more realistic. Moreover, open-source software has made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the people’s privacy. There is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of countries and the world. Therefore, research into the automatic detection of deepfaked media is essential for public security. In this work, we propose a deepfake detection method using upper body language analysis. Specifically, a many-to-one LSTM network was designed and trained as a classification model for deepfake detection. Different models were trained by varying the hyperparameters to build a final model with benchmark accuracy. We achieved 94.39% accuracy on the deepfake test set. The experimental results showed that upper body language can effectively detect deepfakes.

This study advances the field of solar irradiance nowcasting by introducing a discrete-level classification approach, diverging from traditional continuous measurement methods. Grounded in a need for cost-effective and modular solutions, the research employs high-resolution computer vision coupled with a deep learning framework to predict Direct Normal Irradiance (DNI). By harnessing the capabilities of a Logitech C900 1080p HD camera and an NVIDIA Jetson module, the study achieves real-time data processing, pivotal for CSP systems' operational efficiency. The core of the methodology is the ResNet-50 convolutional neural network, refined via transfer learning on a bespoke dataset, culminating in a predictive accuracy of 85.78%. This discrete classification model contrasts with conventional, costly instruments like the MS-57, offering a novel and accessible alternative for DNI estimation. Such innovation not only demonstrates high predictive accuracy but also signifies a shift towards less resource-intensive and more adaptable solar energy forecasting tools, contributing a significant leap towards optimizing renewable energy systems.

Increased screen time during the COVID-19 pandemic and the accelerated incorporation of technology into daily practices have directly contributed to the increased prevalence of eye disease. The human eye is not built for continual technological use and must adjust to exposure to digital screens. Overexposure to technology can result in eye strain and an increased risk of eye diseases such as myopia with complications later in life, including retinal tears, cataracts, and macular degeneration. As vision and ocular diseases become more prevalent, the study of eye diseases, including their causes and treatments, is especially relevant. There is a need to prevent ocular diseases before they become a burden to individuals, their families, and their communities by better understanding the pathophysiology of ocular diseases. Several ocular diseases are thought to be caused by imbalances in reactive oxygen species (ROS) and autophagy. ROS refers to a class of highly reactive oxygen-containing molecules that can undergo damaging reactions with other molecules in the cell. Autophagy is a cellular process of self-eating whereby damaged, harmful, or dead material in cells is broken down to maintain cellular homeostasis. This paper discusses the role of ROS and autophagy in the pathogenesis of computer vision syndrome (CVS), digital eye strain (DES), myopia, cataracts, glaucoma, diabetic retinopathy (DR), age-related macular degeneration (AMD), optic nerve crush injury (OCN), optic nerve gliomas, and retinoblastoma. Lifestyle changes such as limiting screen time, ensuring adequate exposure to evening sunlight, and using blue light protection measures or protective eyewear are important in the prevention of eye disease. Nutrition also contributes significantly to eye health. A balanced diet rich in vitamins and antioxidants may help to prevent ROS and autophagy imbalance-induced eye disease. Medical and surgical treatments become necessary when preventative measures fail. This paper also addresses how government measures to decrease the onset of eye disease, including targeted programs to increase access to fresh vegetables and fruits in food deserts, are a critical macro-level avenue to reduce eye disease prevalence in the US, which according to the National Eye Institute, costs $139 billion yearly.