In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Recent progress in deep learning has led to accurate and efficient generic object detection networks. Training of highly reliable models depends on large datasets with highly textured and rich images. However, in real-world scenarios, the performance of the generic object detection system decreases when (i) occlusions hide the objects, (ii) objects are present in low-light images, or (iii) they are merged with background information. In this paper, we refer to all these situations as challenging environments. With the recent rapid development in generic object detection algorithms, notable progress has been observed in the field of object detection in challenging environments. However, there is no consolidated reference to cover state-of-the-art in this domain. To the best of our knowledge, this paper presents the first comprehensive overview, covering recent approaches that have tackled the problem of object detection in challenging environments. Furthermore, we present the quantitative and qualitative performance analysis of these approaches and discuss the currently available challenging datasets. Moreover, this paper investigates the performance of current state-of-the-art generic object detection algorithms by benchmarking results on the three well-known challenging datasets. Finally, we highlight several current shortcomings and outline future directions.

A human eye has about 120 million rod cells and 6 million cone cells. This huge number of light sensing cells inside a human eye will continuously produce a huge quantity of visual signals which flow into a human brain for daily processing. However, the real-time processing of these visual signals does not cause any fatigue to a human brain. This fact tells us the truth which is to say that human-like vision processes do not rely on complicated formulas to compute depth, displacement, and colors, etc. On the other hand, a human eye is like a PTZ camera. Here, PTZ stands for pan, tilt and zoom. We all know that in computer vision, each set of PTZ parameters (i.e., coefficients of pan, tilt and zoom) requires a dedicated calibration to determine a camera’s projection matrix. Since there is an infinite number of PTZ parameters which could be produced by a human eye, it is unlikely that a human brain stores an infinite number of calibration matrices for each human eye. Therefore, it is an interesting question for us to answer, which is to say whether simpler formulas of computing depth and displacement exist or not. Moreover, these formulas must be calibration friendly (i.e., easy process on the fly or on the go). In this paper, we disclose an important discovery of a new solution to 3D projection in a human-like binocular vision system. The purpose of doing 3D projection in binocular vision is to undertake forward and inverse transformations (or mappings) between coordinates in 2D digital images and coordinates in a 3D analogue scene. The formulas underlying the new solution are accurate, easily computable, easily tunable (i.e., to be calibrated on the fly or on the go) and could be easily implemented by a neural system (i.e., a network of neurons). Experimental results have validated the discovered formulas.

The COVID-19 outbreak demonstrated the viability of various remote working solutions, telepresence robots (TPRs) being one of them. High-quality video transmission is one of the cornerstones of using such solutions, as most of the information about the environment is acquired through vision. This study aims to compare the camera capabilities of four models of popular telepresence robots using compact reduced LogMAR and Snellen optometry charts as well as text displayed on the projector screen. The symbols from the images are extracted using OCR (Optical Character Recognition) software and the results of the recognition are compared with the symbols on the charts. Double 3 TPR provides the best quality images of optometric charts, but the OCR results of measurements of the image on the projector do not show the clear advantage of one single model over the others. The results demonstrated by Temi 2 and Double 3 TPRs are generally better than the others, suggesting that these TPRs are more feasible to be used in teaching and learning scenarios.

Accurately estimating the current state of local traffic scenes is one of the key problems in the development of software components for automated vehicles. In addition to details on free space and drivability, static and dynamic traffic participants, information on the semantics may also be included in the desired representation. Multi-layer grid maps allow to include all this information in a common representation. However, most existing grid mapping approaches only process range sensor measurements such as LIDAR and Radar and solely model occupancy without semantic states. In order to add sensor redundancy and diversity it is desired to add vision based sensor setups in a common grid map representation. In this work, we present a semantic evidential grid mapping pipeline including estimates for eight semantic classes that is designed for straightforward fusion with range sensor data. Unlike in other publication our representation explicitly models uncertainties in the evdiential model. We present results of our grid mapping pipeline based on a monocular vision setup and a stereo vision setup. Our mapping resulsts are accurate and dense mapping due to the incorporation of a disparity- or depth-based ground surface estimation in the inverse perspective mapping. We conclude this paper by providing a detailed quantitative evaluation based on real traffic scenarios in the Kitti odometry benchmark and demonstrating the advantages compared to other semantic grid mapping approaches.

Dams are a critical infrastructure system for many communities, but they are also one of the most challenging to inspect. Dams are typically very large and complex structures, and the result is that inspections are often time-intensive and require expensive, specialized equipment and training to provide inspectors with comprehensive access to the structure. The scale and nature of dam inspections also introduces additional safety risks to the inspectors. Unmanned aerial vehicles (UAV) have the potential to address many of these challenges, particularly when used as a data acquisition platform for photogrammetric three-dimensional (3D) reconstruction and analysis, though the nature of both UAV and modern photogrammetric methods necessitates careful planning and coordination for integration. This paper presents a case study on one such integration at the Brighton Dam, a large-scale concrete gravity dam in Maryland, USA. A combination of multiple UAV platforms and multi-scale photogrammetry was used to create two comprehensive and high-resolution 3D point clouds of the dam and surrounding environment at intervals. These models were then assessed for their overall quality, as well as their ability to resolve flaws and defects that were artificially applied to the structure between inspection intervals. The results indicate that the integrated process is capable of generating models that accurately render a variety of defect types with sub-millimeter accuracy. Recommendations for mission planning and imaging specifications are provided as well.

Vision-based tactile sensors (VBTS) have become the de facto method of giving robots the ability to obtain tactile feedback from their environment. Unlike other solutions to tactile sensing, VBTS offers high spatial resolution feedback without compromising on instrumentation costs or incurring additional maintenance expenses. However, conventional cameras used in VBTS have a fixed update rate and output redundant data, leading to computational overhead downstream. In this work, we present a neuromorphic vision-based tactile sensor (N-VBTS) that employs observations from an event-based camera for contact angle prediction. Particularly, we design and develop a novel graph neural network, dubbed TactiGraph, that asynchronously operates on graphs constructed from raw N-VBTS streams exploiting their spatiotemporal correlations to perform predictions. Although conventional VBTS uses an internal illumination source, TactiGraph is reported to perform efficiently in both scenarios, with and without an internal illumination source. Rigorous experimental results revealed that TactiGraph achieved a mean absolute error of 0.62∘ in predicting the contact angle and was faster and more efficient than both conventional VBTS and other N-VBTS, with lower instrumentation costs. Specifically, N-VBTS requires only 5.5% of the compute-time needed by VBTS when both are tested on the same scenario.

This paper presents a methodology to detect the erosion and progradation effects in the Atrato river delta, located in the Gulf of Urabá in Colombia using SAR (Synthetic Aperture Radar) data. Other authors have studied this area by using optical images, encountering difficulties given the persistent presence of clouds in this region. SAR imagery is rescaled, despeckled, composed, classified, registered and processed to obtain a heatmap that shows the overall changes during eight years (2016–2023) in one single image. Since this technology uses microwave active signals, the presence of clouds and other environmental phenomena was not a problem, and all the images from the selected dates could be processed and analyzed. Also, detection of the dynamic processes was obtained for every period considered in this study with respect to the previous one in time, calculating areas and detecting the regions subject to the erosion and progradation processes. The multitemporal analysis performed found that the newly created mouth is the most active area for these processes, coinciding with other studies. A comparison of these findings with the Oceanic Niño Index (ONI) showed a relative delayed coupling to the erosion process and a coupling of progradation with dry and wet seasons.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

A 31-year-old male noticed blurred vision in his right eye for five days with no obvious predisposing causes, accompanied by mild dizziness. No obvious nodular lesions were found in the body. The patient’s binocular visual acuity was 20/20. Fundus photography showed the optic nerve swelling and radial superficial retinal hemorrhage of both eyes. Blood panel, urine routine, liver, and kidney function were all normal. Total cholesterol, triglycerides, high-density lipoprotein, and low-density lipoprotein were all in the normal limits. Head MRI showed a mass in the right temporal lobe, clear boundary, and multiple separations, which thinned and disappeared closer to the skull. The right temporal lobe and lateral ventricle were all compressed, with the midline structure shifted to the left. The patient was then transferred to Neurosurgery. During the operation, we observed the tumor had invaded the skull. The actual size of the tumor was 5.6 cm × 7.5 cm × 10.1 cm. Histology revealed foam cell accumulation in the mucous connective tissue of the right temporal lobe. The immunohistochemistry showed: CD34 (+), CD99 (+), EMA (−), GFAP (−), IDH-1 (−), Ki-67 (+) index about 10%, Oliga-2 (−), PR (−), S-100 (−), Vim (+), β-Catenin (+), CD1a (−), CD68 (+). Three months after the removal of the tumor, the visual acuity of both eyes was 20/20; The visual fields were normal, the optic disc edema and retinal hemorrhages had disappeared. MRI indicated the midline structure was back to normal.

Many accidents, such as those involving collisions or trips, appear to involve failures of vision; but the association between accident risk and vision as conventionally assessed, is weak or absent. We addressed this conundrum by embracing the distinction inspired by neuroscientific research, between vision for perception and vision for action. A dual-process perspective predicts that accident vulnerability will be associated more strongly with vision for action than vision for perception. Older and younger adults, with relatively high and relatively low self-reported accident vulnerability (Accident Proneness Questionnaire), completed three behavioural assessments targeting: vision for perception (Freiburg Visual Acuity Test); vision for action (Vision for Action Test - VAT); and the ability to perform physical actions involving balance, walking and standing (Short Physical Performance Battery). Accident vulnerability was not associated with visual acuity or with performance of physical actions; but was associated with VAT performance. VAT assesses the ability to link visual input with a specific action –launching a saccadic eye movement as rapidly as possible, in response to shapes presented in peripheral vision. The predictive relationship between VAT performance and accident vulnerability was independent of age, visual acuity and physical performance scores. Applied implications of these findings are considered.

Vision impairment may delay responses to hazards when driving. In a proof-of-concept driving simulator study, we evaluated a hazard warning device designed for vision impaired drivers. Three groups participated: 11 persons with central vision loss (CVL; median age 60 years), 12 with homonymous field loss (HFL; 52 years) and 11 with normal vision (NV; 60 years). CVL is characterised by impaired visual acuity and contrast sensitivity while HFL is a loss of vision in the same half of the visual field (blind side) in both eyes. Participants completed drives with and without the device which gave a directional vibro-tactile warning for an approaching pedestrian hazard when collision risk exceeded a pre-defined threshold. Warnings significantly (p< 0.001) reduced brake response times for CVL (∆= 0.54s) and HFL (∆= 0.30s), but not NV participants. For HFL participants, the reduction was greater (p = 0.02) for hazards on the blind (∆= 0.57s) than seeing side (∆= 0.10s). The warnings significantly reduced collision rates for CVL participants from 11 to 0% (all hazards) and for HFL participants from 30 to 1.7% (blind side hazards). Thus, hazard warnings may be beneficial in improving safety of vision impaired drivers; further research is warranted.

Table detection is a preliminary step in extracting reliable information from tables in scanned document images. We present CasTabDetectoRS, a novel end-to-end trainable table detection framework that operates on Cascade Mask R-CNN, including Recursive Feature Pyramid network and Switchable Atrous Convolution in the existing backbone architecture. By utilizing a comparatively lightweight backbone of ResNet-50, this paper demonstrates that superior results are attainable without relying on pre and post-processing methods, heavier backbone networks (ResNet-101, ResNeXt-152), and memory-intensive deformable convolutions. We evaluate the proposed approach on five different publicly available table detection datasets. Our CasTabDetectoRS outperforms the previous state-of-the-art results on four datasets (ICDAR-19, TableBank, UNLV, and Marmot) and accomplishes comparable results on ICDAR-17 POD. Upon comparing with previous state-of-the-art results, we obtain a significant relative error reduction of 56.36%, 20%, 4.5%, and 3.5% on the datasets of ICDAR-19, TableBank, UNLV, and Marmot, respectively. Furthermore, this paper sets a new benchmark by performing exhaustive cross-datasets evaluations to exhibit the generalization capabilities of the proposed method.

Tables in the document image are one of the most important entities since they contain crucial information. Therefore, accurate table detection can significantly improve information extraction from tables. In this work, we present a novel end-to-end trainable pipeline, HybridTabNet, for table detection in scanned document images. Our two-stage table detector uses the ResNeXt-101 backbone for feature extraction and Hybrid Task Cascade (HTC) to localize the tables in scanned document images. Moreover, we replace conventional convolutions with deformable convolutions in the backbone network. This enables our network to detect tables of arbitrary layouts precisely. We evaluate our approach comprehensively on ICDAR-13, ICDAR-17 POD, ICDAR-19, TableBank, Marmot, and UNLV. Apart from the ICDAR-17 POD dataset, our proposed HybridTabNet outperforms earlier state-of-the-art results without depending on pre and post-processing steps. Furthermore, to investigate how the proposed method generalizes unseen data, we conduct an exhaustive leave-one-out-evaluation. In comparison to prior state-of-the-art results, our method reduces the relative error by 27.57% on ICDAR-2019-TrackA-Modern, 42.64% on TableBank (Latex), 41.33% on TableBank (Word), 55.73% on TableBank (Latex + Word), 10% on Marmot, and 9.67% on UNLV dataset. The achieved results reflect the superior performance of the proposed method.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

As people grow a custom to effortless outdoor navigation there is a rising demand for similar possibility indoors as well. Unfortunately, indoor localization, being one of the necessary requirements for navigation, continues to be problem without a clear solution. In this article we are proposing a method for an indoor positioning system using a single image. This is made possible using small preprocessed database of images with known control points as the only preprocessing needed. Using feature detection with SIFT algorithm we can look through the database and find image which is the most similar to the image taken by user. Pair of images is then used to find coordinates of database image using PnP problem. Furthermore, projection and essential matrices are determined allowing for the user image localization ~ determining the position of the user in indoor environment. Benefits of this approach lies in the single image being the only input from user and no requirements for new onsite infrastructure and thus enables a simpler realization for the building management.

The Brain-Computer Interface (BCI) technology has emerged as a groundbreaking innovation with profound implications across diverse domains, particularly in healthcare. By establishing a direct communication pathway between the human brain and external devices, BCI systems offer unprecedented opportunities for diagnosis, treatment, and rehabilitation, thereby reshaping the landscape of medical practice. However, despite its immense potential, the widespread adoption of BCI technology in clinical settings faces several challenges. These include the need for robust signal acquisition and processing techniques, ensuring user safety and privacy, addressing ethical considerations, and optimizing user training and adaptation. Overcoming these challenges is crucial to unleashing the complete potential of BCI technology in healthcare and realizing its promise of personalized, patient-centric care. This review work underscores the transformative potential of BCI technology in revolutionizing medical practice. This paper offers a comprehensive analysis of medical-oriented BCI applications by exploring the various uses of BCI technology and its potential to transform patient care.

The Robotics Vision Lab of Northwest Nazarene University has developed Orchard Robot (OrBot), which was designed for harvesting fruits. OrBot is composed of a machine vision system to locate fruits on the tree, a robotic manipulator to approach the target fruit, and a gripper to remove the target fruit. Field trials conducted at commercial orchards for apples and peaches during the harvesting season of 2021 yielded a harvesting success rate of about 85% and had an average harvesting cycle time of 12 seconds. Building upon this success, the goal of this study is to evaluate the performance of OrBot during nighttime harvesting. The idea is to have OrBot harvest at night, and then human pickers continue the harvesting operation during the day. This human and robot collaboration will leverage the labor shortage issue with a relatively slower robot working at night. The specific objectives are to determine the artificial lighting parameters suitable for nighttime harvesting and to evaluate the harvesting viability of OrBot during the night. LED lighting was selected as the source for artificial illumination with a color temperature of 5600 K and 10% intensity. This combination resulted with the lowest noise in the images. OrBot was tested in a commercial orchard using twenty Pink Lady apple trees. Results showed an increased success rate during the night, with OrBot gaining 94%. compared to 88% during the daytime operations.

Many sand scorpions are faithful to burrows they dig, however, it is unknown how these animals get back home after hunting excursions. Of the many mechanisms of homing that exist, path integration (PI) is one of the more common tools used by arachnids. In PI, an animal integrates its distance and direction while leaving its home, enabling it to compute an approximate home-bound vector for the return trip. The objective of our study was to test whether scorpions use PI to return home under absolute darkness in the lab. We first allowed animals to establish burrows in homing arenas. Then, after they left their burrow, we recorded the scorpion’s location in the homing arena before we transferred it to the center of a testing arena. We used overhead IR cameras to record its movements in the testing arena. If scorpions exhibited PI, we predicted they would follow a vector in the test arena that approximated the same angle and distance from the capture point to their burrow in their home arena. However, under the conditions of this experiment, we found no evidence that scorpions moved along such home-bound vectors. We speculate that scorpions may need a reliable reference cue to accommodate path integration.

Sense element engagement theory explains how neural networks produce cortical prosthetic vision. A major prediction of the theory can be tested by developing a device which is expected to enable perception of continuous forms in altered visual geometries. The research reported here completes several essential steps in developing this device: (1) replication of simulations that are consistent with the theory using the NEST simulator, which can also be used for full-scale network emulation by a neuromorphic computer; (2) testing whether results consistent with the theory survive increasing the scale and duration of simulations; (3) establishing a method that uses numbers of spikes produced by network neurons to report the number of phosphenes produced by cortical stimulation; and (4) simulating essential functions of the prosthetic device. NEST simulations replicated early results and increasing their scale and duration produced results consistent with the theory. A decision function created using multinomial logistic regression correctly classified the expected number of phosphenes for 2080 spike number distributions for each of three sets of data, half of which arise from simulations expected to yield continuous visual forms on an altered visual geometry. A process for modulating electrical stimulation amplitude based on intermittent population recordings that is predicted to produce continuous visual forms was successfully simulated. The classification function developed using logistic regression will be used to tune this process as the scale of simulations is further increased.

Engineering of quantum computers requires reliable characterization of qubits, quantum operations, and even the entire hardware. Quantum tomography is an indispensable framework in quantum characterization, verification, and validation (QCVV), which has been widely accepted by researchers. According to the tomographic target, quantum tomography can be categorized into quantum state tomography (QST), quantum process tomography (QPT), gate set tomography (GST), process tensor tomography (PTT), and instrument set tomography (IST). Standard quantum tomography toolkits generally consist of basic linear inverse methods and statistical maximum likelihood estimation (MLE) based methods. Furthermore, the performance of standard methods, including effectiveness and efficiency, has been further developed by exploiting Bayesian estimation, neural networks, matrix completion techniques, etc. In this review, we introduce the fundamental quantum tomography techniques, including QST, QPT, GST, PTT, and IST. We first introduce the details of basic linear inverse methods. Then, the framework of MLE methods with constraints is summarized. Finally, we briefly introduce recent further research in developing the performance of tomography. This review provides a primary getting-start in developing quantum tomography, which promotes quantum computer development.

The mouse visual system recently became the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements in mice only started to be appreciated recently. Eye movements provide a basis for active sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of the known eye movement types in mice and a comparison to primates is missing.Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

Daltonisation refers to the recolouring of images such that details normally lost by colour vision deficient observers become visible. This comes at the cost of introducing artificial colours. In a previous work, we presented a gradient-domain colour image daltonisation method that outperformed previously known methods both in behavioural and psychometric experiments. In the present paper, we improve the method by (i) finding a good first estimate of the daltonised image, thus reducing the computational time significantly, and (ii) introducing local linear anisotropic diffusion, thus effectively removing the halo artefacts. The method uses a colour vision deficiency simulation algorithm as an ingredient, and can thus be applied for any colour vision deficiency, and can even be individualised if the exact individual colour vision is known.

Salamanders have been habitual residents of research laboratories for more than a century, and their history in science is tightly interwoven with vision research. Nevertheless, many vision scientists – even those working with salamanders – may be unaware of how much our knowledge about vision, and particularly the retina, has been shaped by studying salamanders. In this review, we take a tour through the salamander history in vision science, highlighting the main contributions of salamanders to our understanding of the vertebrate retina. We further point out specificities of the salamander visual system and discuss the perspectives of this animal system for future vision research.

Vertebrate color vision is evolutionarily ancient. Jawless fish evolved four main spectral types of cone photoreceptor, almost certainly complemented by retinal circuits to process chromatic opponent signals. Subsequent evolution of photoreceptors and visual pigments are now documented for many vertebrate lineages and species, giving insight into evolutionary variation and ecological adaptation of color vision. We look at organization of the photoreceptor mosaic and the functions different types of cone in teleost fish, primates, and birds and reptiles. By comparison less is known about the underlying neural processing. Here we outline the diversity of vertebrate color vision and summarize our understanding of how spectral information picked up by animal photoreceptor arrays is adapted to natural signals. We then turn to the question of how spectral information is processed in the retina. Here, the quite well known and comparatively ‘simple’ system of mammals such as mice and primates reveals some evolutionarily conserved features such as the mammalian Blue^ON system which compares short and long wavelength receptors signals. We then survey our current understanding of the more complex circuits of fish, amphibians, birds and reptiles. Together, these clades make up more than 90% of vertebrate species, yet we know disturbingly little about their neural circuits for colour vision beyond the photoreceptors. Here, long-standing work on goldfish, freshwater turtles and other species is being complemented by new insights gained from the experimentally amendable retina of zebrafish. From this body of work, one thing is clear: The retinal basis of colour vision in non-mammalian vertebrates is substantially richer compared to mammals: Diverse and complex spectral tunings are established at the level of the cone output via horizontal cell feedforward circuits. From here, zebrafish use cone-selective wiring in bipolar cells to set-up color opponent synaptic layers in the inner retina, which in turn lead a large diversity of color-opponent channels for transmission to the brain. However, while we are starting to build an understanding of the richness of spectral properties in some of these species’ retinal neurons, little is known about inner retinal connectivity and cell-type identify. To gain an understanding of their actual circuits, and thus to build a more generalised understanding of the vertebrate retinal basis of color vision, it will be paramount to expand ongoing efforts in deciphering the retinal circuits of non-mammalian models.

Artificial intelligence (AI) and 3D printing (3DP) play critical roles in what is known as the 4th Industrial Revolution by developing data- and machine-intelligence-based integrated production technologies. This shift has led to increasingly complex design requirements and fabrication methods, posing several challenges for implementing design, fabrication process, and architectural quality standardization. This paper systematically reviews AI techniques applied in diverse stages of 3DP production in architecture. The research goals are to (1) offer a comprehensive critical analysis of the body of literature; (2) identify and categorize approaches to integrating AI in the production of 3D-printed structures; (3) identify and discuss challenges and opportunities of AI integration in architectural production of 3DP structures; and (4) identify gap and provide recommendations for future research. The findings indicate that topics related to AI applications are current and trending, receiving increasing attention from researchers in general and particularly those working in machine and deep learning, artificial neural networks, and pattern recognition. However, the potential of the application of AI in architectural production using additive manufacturing still needs to be explored. Considering this, the paper emphasizes the necessity of redefining traditional field boundaries and opening new opportunities in the sector.

Event-based vision is an emerging field of computer vision that offers unique properties such as asynchronous visual output, high temporal resolutions, and dependence on brightness changes to generate data. These properties can enable robust high-temporal-resolution object detection and tracking when combined with frame-based vision. In this paper, we present a hybrid, high-temporal-resolution, object detection and tracking approach, that combines learned and classical methods using synchronized images and event data. Off-the-shelf frame-based object detectors are used for initial object detection and classification. Then, event masks, generated per each detection, are used to enable inter-frame tracking at varying temporal resolutions using the event data. Detections are associated across time using a simple low-cost association metric. Moreover, we collect and label a traffic dataset using the hybrid sensor DAVIS 240c. This dataset is utilized for quantitative evaluation using state-of-the-art detection and tracking metrics. We provide ground truth bounding boxes and object IDs for each vehicle annotation. Further, we generate high-temporal-resolution ground truth data to analyze the tracking performance at different temporal rates. Our approach shows promising results with minimal performance deterioration at higher temporal resolutions (48 – 384 Hz) when compared with the baseline frame-based performance at 24 Hz.

Recent improvements in deepfake creation have made deepfake videos more realistic. Moreover, open-source software has made deepfake creation more accessible, which reduces the barrier to entry for deepfake creation. This could pose a threat to the people’s privacy. There is a potential danger if the deepfake creation techniques are used by people with an ulterior motive to produce deepfake videos of world leaders to disrupt the order of countries and the world. Therefore, research into the automatic detection of deepfaked media is essential for public security. In this work, we propose a deepfake detection method using upper body language analysis. Specifically, a many-to-one LSTM network was designed and trained as a classification model for deepfake detection. Different models were trained by varying the hyperparameters to build a final model with benchmark accuracy. We achieved 94.39% accuracy on the deepfake test set. The experimental results showed that upper body language can effectively detect deepfakes.

Gyroscopes are fascinating instruments with a history of about 200 years. When J.G.F. Bohnenberger presented his machine to his students in 1810 at the University of Tuebingen, Germany, nobody could have foreseen that this fascinating development would be used for complex orientation and positioning. At the University of Stuttgart, Germany, a collection of 160 exhibits is available and in transition for a sustainable future. Here, the systems are digitized in 2D, 2.5D and 3D and are made available for a world-wide community using OpenAccess platforms. The technologies being used are Computed Tomography, Computer Vision, Endoscopy and Photogrammetry. The workflows for combining voxel representations and colored point clouds are described, to create Digital Twins of the tangible assets. Advantages and disadvantages are discussed und work for near future is outlined in this new and challenging field of Tech Heritage digitization.

This review paper provides a comprehensive overview of machine vision pose measurement algorithms. The paper focuses on the state-of-the-art algorithms and their applications. The paper is structured as follows: The introduction in Section 1 provides a brief overview of the field of machine vision pose measurement. Section 2 describes the commonly used algorithms for machine vision pose measurement. Section 3 discusses the factors that affect the accuracy and reliability of machine vision pose measurement algorithms. Section 4 presents the applications of machine vision pose measurement in various fields. The paper provides specific examples of how machine vision pose measurement is used in each of these fields. Finally, Section 5 summarizes the paper and provides future research directions. The paper highlights the need for more robust and accurate algorithms that can handle varying lighting conditions and occlusion. It also suggests that the integration of machine learning techniques may improve the performance of machine vision pose measurement algorithms. Overall, this review paper provides a comprehensive overview of machine vision pose measurement algorithms, their applications, and the factors that affect their accuracy and reliability. It provides a valuable resource for researchers and practitioners working in the field of computer vision.

Vision loss can be avoided if diabetic retinopathy (DR) is diagnosed and treated promptly. Following are the main 5 DR stages: none, moderate, mild, proliferate, and severe. In this study, a deep learning (DL) model is presented that diagnoses all 5 stages of DR with more accuracy than previous methods. The suggested method presents two scenarios: case 1 with image enhancement using contrast limited adaptive histogram equalization (CLAHE) filtering algorithm in conjunction with an Enhanced Super-resolution generative adversarial network (ESRGAN), and case 2 without image enhancement; augmentation techniques are then performed to generate a balanced dataset utilizing the same parameters for both cases. Using Inception-V3 applied to the Asia Pacific Tele-Ophthalmology Society (APTOS) datasets, the developed model achieved an accuracy of 98.7% for case 1 and 80.87% for case 2, which is greater than existing methods for detecting the five stages of DR. It was demonstrated that using CLAHE and ESRGAN improves a model's performance and learning ability.

This work presents the development and implementation of a distributed navigation system based on computer vision. The autonomous system consists of a wheeled mobile robot with an integrated colour camera. The robot navigates through a laboratory scenario where the track and several traffic signals must be detected and recognized by using the images acquired with its on-board camera. The images are sent to a computer server that processes them and calculates the corresponding speeds of the robot using a cascade of trained classifiers. These speeds are sent back to the robot, which acts to carry out the corresponding manoeuvre. The classifier cascade should be trained before experimentation with two sets of positive and negative images. The number of images in these sets should be considered to limit the training stage time and avoid overtraining the system.

Importance: Because of the high prevalence of myopia in Taiwan, understanding the risk factors for its development and progression is important to public health. Background: This study investigated the risk factors for myopia and their influence on the progression of myopia in schoolchildren in Taiwan. Design: Patients’ clinical records were obtained retrospectively from ophthalmologists. Questionnaires were given to collect demographic information, family background, hours spent on daily activities, myopia progression, and treatment methods. Participants: A total of 522 schoolchildren with myopia from a regional medical hospital in northern Taiwan participated the study. Written informed consent was obtained from the participants of legal age or the parents or legal guardians. Methods: Multivariable regression analyses were performed. Myopia measured in dioptres was analysed, controlling for patients’ family and demographic information as well as their daily behaviours. Main Outcome Results: Children with high myopic parents were more myopic. Earlier onset age of myopia was associated with a higher level of myopia and greater annual myopic progression. Children reporting more near work activities had higher levels of myopia and greater progression of myopia. Lower levels of myopia were associated with more exercise, longer periods of sleep, and better vision care knowledge in children and parents. Intake of food supplements had no effect on myopia. Conclusions and Relevance: In addition to genetics, education, environment, and near work activity can influence the development of myopia. Health policies for schoolchildren should promote protective activities and vision care knowledge in order to protect the eyesight of schoolchildren.

The economic development and infrastructure of a nation are closely interrelated. In addition, public trust in national infrastructure facilities is closely linked to the preservation of the advantages provided by these facilities to the public. Since the 1970s, Korea has achieved exponential economic growth over a short period of time and the number of infrastructure facilities has increased correspondingly. This compressed economic development has been underpinned by the national infrastructure, whose safety and usability have been excluded from the scope of the development. However, after around 30 years, structural deterioration coupled with general insensitivity to safety in today’s society has considerably reduced public trust in using the infrastructure. Realistically, policies that mainly focus on developing new technologies related to infrastructure construction have led to practical limitations that discourage the development of technologies for maintenance or inspection. Furthermore, current maintenance works face certain limitations caused by various reasons: insufficient budget, increasing number of infrastructure facilities requiring maintenance, shortage of manpower, and rapidly increasing number of aging infrastructure facilities. To overcome these limitations, a new approach is required that is different from general inspection methods under the existing rules and regulations. In this context, this study aimed to explore the efficiency of bridge inspection and maintenance by unmanned aerial vehicles (UAVs) that could observe inaccessible areas, could be conveniently and easily controlled, and could offer high economic benefits. To this end, various tests were performed on elevated bridges, and suitable UAV images were obtained. The obtained UAV images were inspected by using machine vision technology, thereby excluding subjective evaluations by humans. Methods for enhancing the objectivity of the inspection were also discussed. The test results showed that both the efficiency and objectivity of the proposed method were better than those of the existing bridge maintenance and inspection methods.

The term artificial intelligence refers to the field of computer science that deals with the design and implementation of computer systems that mimic elements of human behavior that imply basic intelligence: learning, adaptability, inference, contextual understanding, and problem solving among others. Artificial intelligence is a point of intersection between multiple sciences such as computer science, psychology, philosophy, neurology, linguistics and engineering science, with the aim of synthesizing intelligent behavior, with elements of reasoning, learning and adaptation to the environment, while it is usually applied to specially made machines or computers.

The aim of this study was to evaluate the clinical and radiographic outcomes of the All-on-4 technique in fully edentulous maxilla using R2GATE software for flapless, computer-guided surgery and immediate loading. Ten adult patients with fully edentulous maxilla, aged between 35 and 60 years, were included in the study between April 2021 and April 2022. The surgical procedure was performed under local anesthesia and followed the All-on-4 approach with immediate loading of implants using a screw-retained provisional acrylic resin prosthesis on the same day. Final prosthesis was delivered four months after the surgery. Clinical and radiographic outcomes were evaluated at four- and twelve-months post-operation. The study reported a 95% implant survival rate using the All-on-4 technique. The mean marginal bone level was recorded at 0.35 mm and 0.66 mm during the 4 and 12-month follow-up periods, respectively. Fixed provisional prosthesis fracture, abutment, and prosthesis screw loosening were the most frequent mechanical complications reported. Within the limitations of this study, the use of computer-guided surgery in the All-on-4 technique seemed to be a promising treatment option with high implant survival rates that may help reduce post-surgical discomfort and mechanical complications in the rehabilitation of the edentulous maxilla.

Background: Electrical conductivity of trabecular bone at 100 kHz was recently reported as a good predictor of bone volume fraction. However, to quantify its relationship with the free water (or physiological solution) content and between the conductivities of its constituents, is still unclear. Methods: In this contribution, in silico models inspired by microCT images of trabecular bovine samples were used to build realistic geometries. Finite Element Method was applied to solve the electrical problem and to robustly fit the conductivity of the constituents with literature data. The obtained effective electrical conductivity was compared to Bruggeman three media mixture model: physiological solution, bone marrow and bone matrix. Results: The values for physiological solution plus bone marrow and bone matrix that captured better the bone volume fraction in the two media Finite Element model were: σps+bm = 298.4 mS/m and σb = 21.0 mS/m, respectively. Additionally, relative good results were obtained by a three media Bruggeman mixture model with σbm= 103 mS/m, σb= 21.0 mS/m, and σps= 1200 mS/m. Simple linear relationships between the proportions of constituents depending on bone volume fraction were tested. Degree of anisotropy and fractal dimension do not show detectable changes in effective conductivity. Conclusions: These results provided some useful findings for simulation purposes: first, a higher value of electrical conductivity of bone marrow has to be used in order to obtain similar values to those experimental published data. Second, anisotropy is not detectable by conductivity measurements for small trabecular samples (cube 5 mm). Finally, the simulations presented here showed a relatively good fitting of the mixture Bruggeman model which potentially would allow both, accounting for the free water content and re-scaling the model for whole bone electrical simulations.

Susceptible, infective, recovered, and hospitalized/isolated individuals are placed on the cells of a nxn square lattice, where each cell is occupied by a single individual or is vacant. At discrete time units (typically one day each) all susceptibles and infectives execute a random movement and when a coincidence of the two types occurs the susceptible is converted to infective status according to some probability. Infectives are labelled by the number of days since originally infected. At each time increment the age label of the infectives is increased by one unit. When the label reaches a number like 15 or 20 days the susceptibles recover with some probability or become isolated/hospitalized. Upon reaching some age the latter types either recover or die. Probabilities for the movements and conversions from one status to another are implemented by random numbergeneration. Simulations were carried out to investigate the effect of several probability and age parameters, the size of population (proportional to nxn) and density (related to fraction of occupied cells), and the size of the movements. Mid-term gradual conversion of susceptibles to isolated was explored as intervention policy.

The growth of urban population, combined with an increase of extreme events due to climate changes call for a better understanding and representation of urban floods. Rainfall and infiltration are two important factors that affect the watershed response to a given precipitation event. In this paper, we evaluate the influence of the representation of infiltration and spatially variable rainfall on the computer simulation of the floods that affected the city of Hull, UK in June 2007. This work compares a uniform rainfall with one generated using Kriging with External Drift and a constant infiltration equal to the soil hydraulic conductivity with a neglected infiltration. The results of the four simulations are then compared with the flood extents observed by public authorities. It results that the computer model is able the reproduce the general dynamic of the flood and identify the main inundated areas. We found that neglecting the infiltration induce a better representation of this flood event. Furthermore, the use of radar rainfall results in an accuracy similar to the one obtained with a constant rainfall. This study indicates that when the spatial resolution of the rainfall data is low compared to the catchment size and the precipitation distribution is uniform, the spatial variability of the rainfall might not add significant information.

The twelve cranial nerves play a crucial role in nervous system, orchestrating a myriad of functions vital for our everyday life. These nerves are each specialized for particular tasks. Cranial Nerve I, known as the olfactory nerve, is responsible for our sense of smell, allowing us to perceive and distinguish various scents. Cranial Nerve II, or the optic nerve, is dedicated to vision, transmitting visual information from the eyes to the brain. Eye movements are governed by Cranial Nerves III, IV, and VI, ensuring our ability to track objects and focus. Cranial Nerve V controls facial sensation and jaw movement, while Cranial Nerve VII, the facial nerve, facilitates facial expressions and taste perception. Cranial Nerve VIII, or the vestibulocochlear nerve, plays a critical role in hearing and balance. Cranial Nerve IX, the glossopharyngeal nerve, affects throat sensation and taste perception. Cranial Nerve X, the vagus nerve, is a far-reaching nerve, influencing numerous internal organs such as the heart, lungs, and digestive system. Cranial Nerve XI, the accessory nerve, is responsible for neck muscle control, contributing to head movement. Finally, Cranial Nerve XII, the hypoglossal nerve, manages tongue movement, essential for speaking, swallowing, and breathing. Understanding these cranial nerves is fundamental in comprehending the intricate workings of our nervous system and the functions that sustain our daily lives.

Sometimes when diabetic retinopathy (DR) is found and treated quickly, vision loss can indeed be spared. This study deploys a deep learning (DL) model that can discover all 5 stages of DR more accurately than other methods. The proposed methodology shows two cases scenarios: case 1 with image enhancement using CLAHE and ESRGAN, and case 2 without image enhancement. Augmentation techniques are then employed to produce a balanced dataset with the identical criteria for both scenarios. The generated model using DenseNet-121 on the APTOS dataset outperformed other approaches for locating the 5 stages of DR, with an accuracy of 98.7 percent for case 1 and 81.2 percent for case 2. Using CLAHE and ESRGAN was shown to improve a model's performance and ability to learn.

In the mid-layers of Deep Learning systems, clustered features tend to fit multiple classifications, which are filtered out during the final stages of object recognition. However, many misclassifications remain, regarded as errors of the system. This paper claims that tagging an entity incorrectly for reasons of similarity is evidence of spontaneous machine creativeness. According to the ratings of 40 design educators and researchers, AI-generated false-class inclusions produced creative design ideas, predicting the level of innovation value. These designers were not just anybody but came from a design school in Asia with a top position on the world ranking-lists. They entered an experiment in which 20 classification mistakes were framed as early-design ideas that were either human-made or intentionally suggested by creative AI. Many examples passed the Feigenbaum variant of the Turing test with a conceptual preference to creations supposedly done by human hand.

Eye movements support memory encoding by binding distinct elements of the visual world into coherent representations. However, the role of eye movements in memory retrieval is less clear. We propose that eye movements play a functional role in retrieval by reinstating the encoding context. By overtly shifting attention in a manner that broadly recapitulates the spatial locations and temporal order of encoded content, eye movements facilitate access to, and reactivation of, associated details. Such mnemonic gaze reinstatement may be obligatorily recruited when task demands exceed cognitive resources, as is often observed in older adults. We review research linking gaze reinstatement to retrieval, describe the neural integration between the oculomotor and memory systems, and discuss implications for models of oculomotor control, memory, and aging.

Most of the existing calibration methods for binocular stereo vision sensor (BSVS) depend on high-accuracy target with feature points that are difficult to manufacture and costly. In complex light conditions, optical filters are used for BSVS, but they affect imaging quality. Hence, the use of a high-accuracy target with certain-sized feature points for calibration is not feasible under such complex conditions. To solve these problems, a calibration method based on unknown-sized elliptical stripe images is proposed. With known intrinsic parameters, the proposed method adopts the elliptical stripes located on the parallel planes as a medium to calibrate BSVS online. In comparison with the common calibration methods, the proposed method avoids utilizing high-accuracy target with certain-sized feature points. Therefore, the proposed method is not only easy to implement but is a realistic method for the calibration of BSVS with optical filter. Changing the size of elliptical curves projected on the target solves the difficulty of applying the proposed method in different fields of view and distances. Simulative and physical experiments are conducted to validate the efficiency of the proposed method. When the field of view is approximately 400 mm × 300 mm, the proposed method can reach a calibration accuracy of 0.03 mm, which is comparable with that of Zhang’s method.

Primate vision is an active process that constructs a stable internal representation of the 3D world based on 2D sensory inputs that are inherently unstable due to incessant eye movements. We present here a mathematical framework for processing visual information for a biologically-mediated active vision stereo system with asymmetric conformal cameras. This model utilizes the geometric analysis on the Riemann sphere developed in the group-theoretic framework of the conformal camera, thus far only applicable in modeling monocular vision. The asymmetric conformal camera model constructed here includes the fovea’s asymmetric displacement on the retina and the eye’s natural crystalline lens tilt and decentration, as observed in ophthalmological diagnostics. We extend the group-theoretic framework underlying the conformal camera to the stereo system with asymmetric conformal cameras. Our numerical simulation shows that the 1 theoretical horopter curves in this stereo system are conics that well approximate the empirical longitudinal horopters of the primate vision system.

Knowledge is not merely the characteristic of certain pieces of information being deemed true and justifiable, but rather a process. Within an axiomatic system, the set of information that reaches the status of knowledge forms a universe that provides an interpretation of the reality one aims to describe. Language exchanges information through communication and the process of justification (exchange of information), if it consistently justifies a particular piece of information, it elevates it to knowledge. In this paper, we provide a framework for knowledge within an axiomatic model where we define the fundamental elements of communication and grammar. As a result, the structure dictates that knowledge, to be considered as such, must be investigateable by anyone who utilizes it in its entirety, both in form and content. Ultimately, the development of knowledge processing, referred to as \emph{knowmatics}, represents a clear evolution of the computer science that processes information (subset of knowledge).

This study presents review of 7580 papers in 13 academic journals, published from January 2015 to January 2020. After a detailed analysis of all papers, 46 papers were further selected showing research on a student population aged between 6 and 15 years old. In order for the paper to be included in the research, the condition was that the paper deals with teaching at least one of the following content areas: programming languages, game design, computer thinking (CT), algorithmic thinking and robotics programming. This study shows the representation of the listed content area in reviewed papers for the specified time period as well as a detailed analysis of the selected papers. Available data about study, participants and education level, country (first author), learning domain, teaching tools, research questions, hypothesis, pre/post-test results, interviews, control groups, course duration, research design, previous experience, project or grant and re-search purpose in detected papers were analysed. In addition, impact of studying some of the listed content areas on student learning performance, motivation, attitude and perception were investigated.

Nowadays, emerging technologies have changed the places of work through computers and ICT tools, which have revolutionized teaching and learning environments in different ways. In spite of the fact that computers as ICT tools have become part and progressively instrument for teachers and instructors used in teaching and learning, but most educators can't incorporate them into their teaching and learning process, which results in students being ill-equipped or lacking some necessary skills in the world of work, which leads to low performance and poor handling of tools whose lead to low production. To tackle this issue, it is essential to develop the technical and vocational education and training (TVET) system by determining the quality of technical and vocational education (TVE) teachers. In this paper, the literature concerning the competence required by TVET teachers towards computer-related instructional tech-nology for classroom teaching and learning was examined through the technological pedagogical content knowledge (TPACK) model. Sixty (60) questionnaires were ad-ministered to TVE teachers within six technical colleges of education in north-eastern Nigeria. The data was quantitatively analyzed using traditional linear models, namely multilinear regression (MLR) and artificial intelligence (AI) models, namely artificial neural networks (ANN) and adaptive neuro-fuzzy inference systems (ANFIS), which were developed using MATLAB 9.3 (R2019a), while the classical linear MLR model was developed using SPSS software. The results from our classical study indicated that TVE teachers are competent in computer and some instructional technology usage and show a high correlation between competence and teaching experience and a lower correlation between competence and gender. The goodness of fit shows a good fit of the model. Future studies should examine the application of other linear and non-linear AI techniques.

The number of AI applications in education is growing every day. One recent AI application in the educational sector is Chatbot technology, which is used to support teaching and administrative tasks. This document presents the design and implementation of a Chatbot called Tashi-Bot that helps applicants and university students to obtain information from an educational institution about certain academic and administrative processes. Among these are processes related to well-being, tuition, costs, admission, and other services. In order to design the Chatbot, an analysis of the state of the art, methodologies, and suitable tools was carried out, and a survey was conducted to discover the needs of users and their preferences in the use of a Chatbot for this specific purpose. Tashi-Bot was implemented on the SnatchBot platform and later deployed on a Telegram channel. In its evaluation, a final survey was carried out to check on the satisfaction of the users. The results suggest that Tashi-Bot could help applicants and university students to find information on academic and administrative processes with great certainty and without the need for human interaction. Tashi-Bot can be found at: https://web.telegram.org/#/im?p=@TashiE_Bot..

Background: Tele-rehabilitation has grown significantly in the past years, especially in 2020 when it has been a crucial tool for supporting patients during the COVID-19 pandemic. Within the context of tele-rehabilitation, serious games have a significant role. However, realizing software for serious games capable of responding to the variety of user needs is resource demanding. Methods: we present Proteo, a modular framework for developing serious games from scratch, but with the ability of providing a high-level interface for game customization by therapists and researchers. We also present two serious game implementation examples with analysis of end user’s and therapists/researchers’ satisfaction. Results: by involving a group of 11 specialized therapists and 9 end users we analyzed the Proteo user’s satisfaction. We found that therapists and end users scored high level of involvement, and the therapists scored also high level of suitability. More in depth, both groups showed significant differences between positive and negative feeling, with positive feeling scoring higher than negative ones. Finally, concerning Users’ level of suitability the condition of successfulness of the system, ability to control, clarity and helpfulness were reported as high while the difficulty of the system and the difficulty of the task were reported as low. Conclusions: the proposed framework is a step forward in providing a comprehensive open-source, modular framework, to develop serious games for tele-rehabilitation. Proteo is distributed with a MIT license and available to researchers on GitHub and has been well accepted by the users we involved in the evaluation tests.

Relationships among near set theory, shape maps and recent accounts of the Quantum Hall effect pave the way to quantum computations performed in higher dimensions. We illustrate the operational procedure to build a quantum computer able to detect, assess and quantify a fourth spatial dimension. We show how, starting from two-dimensional shapes embedded in a 2D topological charge pump, it is feasible to achieve the corresponding four-dimensional shapes, which encompass a larger amount of information. This novel, relatively straightforward architecture not only permits to increase the amount of available qbits in a fixed volume, but also converges towards a solution to the problem of optical computers, that are not allowed to tackle quantum entanglement through their canonical superposition of electromagnetic waves.

A surprising insight from the advent of genomic sequencing was that many genes are deeply conserved during evolution. With a particular focus on genes that interact with light in animals, I explore the metaphor of genetic toolkits, which can be operationalized as lists of genes involved in a trait of interest. A fascinating observation is that genes of a toolkit are often used again and again during convergent evolution, sometimes across vast phylogenetic distances. Such a pattern in the evolution of toolkits requires three different stages: origin, maintenance, and redeployment of the genes. The functional origins of toolkit genes might often be rooted in interactions with external environments. The origins of light interacting genes in particular may be tied to ancient responses to photo-oxidative stress, inspiring questions about the extent to which the evolution of other toolkits were also impacted by stress. Maintenance of genetic toolkits over long evolutionary timescales requires gene multifunctionality to prevent gene loss when a trait of interest is absent. Finally, the deployment of toolkit genes in convergently evolved traits like eyes sometimes involves the repeated use of similar, ancient genes but other times involves different genes specific to each convergent origin. How often a particular gene family is used time and again for the same function may depend on how many possible biological solutions are available. When few solutions exist and are maintained, evolution is constrained to use the same genes over and over. However, when many different solutions are possible, the innovative possibilities of evolution are often on display. Therefore, a focus on genetic toolkits highlights the combination of legacy plus innovation that drives the evolution of biological diversity.

Image classification in Remote Sensing and Geographic Information Systems (GIS) containing various land-cover classes is essential for efficient and sustainable land-use estimation, and other tasks like object detection, localization and segmentation. Deep Learning (DL) techniques have shown a tremendous potential in the GIS domain. While Convolutional Neural Networks (CNN) have dominated most of the image analysis domain, a new architecture called transformers have proved to be a unifying solution for several AI-based processing pipelines. Vision Transformers (ViT), a variant of transformers can have comparable and in some cases better accuracy than a CNN. However, they suffer from a significant drawback associated with an excessive use of training parameters. In this research we explore several modifications in the vision transformer architectures, especially MobileViT that can be optimized while boosting accuracy. To verify our proposed approach these new architectures are trained on four land-cover datasets AID, EuroSAT, UC-Merced, and WHU-RS19. Experiments reveal that combination of lightweight convolutional layers including ShuffleNet along with depthwise separable convolutions and average pooling can reduce the trainable parameters by 17.85% and yet achieve higher accuracy than the base MobileViT. It is also observed that utilizing a combination of convolution layers along with multi-headed self attention layers in MobileViT variants provide better performance in capturing local and global features unlike the standalone ViT architecture that utilizes almost 95% more parameters than the proposed MobileViT variant.

The relative position of the orchard robot to the rows of fruit trees is an important parameter for achieving autonomous navigations. The current methods for estimating the position parameters between rows of orchard robots obtain low parameter accuracy, and to address this problem, this paper proposes a machine vision-based method for detecting the relative position of orchard robots and fruit tree rows. Firstly, the fruit tree trunk is identified based on the improved YOLOv4 model; secondly, the camera coordinates of the tree trunk are calculated from the principle of binocular camera triangulation, and the ground projection coordinates of the tree trunk are obtained through coordinate conversion; finally, the midpoints of the projection coordinates of different sides are combined and the navigation path is obtained by linear fitting with the least squares method, and the position parameters of the orchard robot are obtained through calculation. The experimental results show that the average accuracy and average recall of the improved YOLOv4 model for fruit tree trunk detection are 97.05% and 95.42%, respectively, which are 5.92 and 7.91 percentage points higher than those of the original YOLOv4 model. The average errors of heading angle and lateral deviation estimates obtained based on the method in this paper are 0.57° and 0.02 m. The method can accurately calculate heading angle and lateral deviation values at different positions between rows, and can provide a reference for autonomous visual navigation of orchard robots.

The traditional understanding of brain function has predominantly focused on chemical and electrical processes. However, new research in fruit fly (Drosophila) binocular vision reveals ultrafast photomechanical photoreceptor movements significantly enhance information processing, thereby impacting a fly's perception of its environment and behaviour. The coding advantages resulting from these mechanical processes suggest that similar physical motion-based coding strategies may affect neural communication ubiquitously. The theory of neural morphodynamics proposes that rapid biomechanical movements and microstructural changes at the level of neurons and synapses enhance the speed and efficiency of sensory information processing, intrinsic thoughts, and actions by regulating neural information in a phasic manner. We propose that morphodynamic information processing evolved to drive predictive coding, synchronising cognitive processes across neural networks to match the behavioural demands at hand effectively.

Obstructive Sleep Apnea (OSA) surgery is now a viable solution in selected patients and the “remodelling” palatopharyngeal surgery is the most common one. Recently it becomes less in-vasive with the introduction of Barbed Sutures (BS). An optimization of surgical technique is represented by Barbed pharyngoplasty (BP), that requires surgical precision and needs efficient and precise oropharyngeal visualization. Consequently, the lighting system is of pivotal im-portance in BP. The aim of this work is to describe the first experience on the use of a new light-ing system, called KlaroTM in BP for OSA. We evaluated the Klaro™ system in 15 consecutives BP for OSA in comparison with conventional headlamp illumination. The visualization of pala-topharyngeal muscle in the bottom of the tonsillar fossa, entry and exit needle, such as needle tip were statistically better with KlaroTM than headlamp illumination both for surgeon and resi-dent (p<0.05). No significant differences for the visualization of the posterior pharyngeal wall and uvula were reported. The KlaroTM lighting system allows a satisfied illumination of oral cavity and oropharynx in the majority of cases. We encourage to use of KlaroTM not only in BP for OSA, but also in all oral and pharyngeal surgeries, including tonsillectomy and oncological surgery.

To handle the problem of solving the results of aircraft’s visual navigation with scene matching, this paper take the measure of the spherical EPnP positioning posture solving by measuring the central angle threshold value and approaches for constructing a measuring model. The detailed steps are as follows: firstly, this approach needs to construct a positioning coordinate model for the earth surface, makes sure the expression for the 3-dimensional coordinate of the earth surface and solves the positioning of constructing data model with EPnP positioning posture solving algo-rithm. Secondly, by contrasting and analyzing the positioning posture value of approximate plane coordinates, the critical value is acquired, which can be recognized as plane calculation. Lastly, this method should construct a theoretical model of measurement for the visual height and central angle with the decided central angle threshold value. The simulation experiment shows that the average positioning precision of taking the spherical coordinates as input is 16.42 percent way higher than taking the plane coordinates as input. When the central angle is less than 0.05 degrees and the surface district is less than 5585 square meters, the positioning precision of the plane co-ordinates is pretty much equal to the spherical coordinates. At this moment, the sphere can be seen as flat. The conclusion of this essay can theoretically guide the further study of positioning posture solving of the scene matching, which is also of vital significance for theory research and engineering application.

Space syntax can be potentially applied for the evaluation of quality of user flows particularly in solving problems of sustainable projects in spaces intended for users to move around. This study aims to analyze the concepts of pedestrian flows (open and closed) by space syntax based bibli-ographical approach on a global scale, demonstrating the capability of improvements in Sus-tainable Development Goals (SDGs) as applied to the architecture of sustainable flows. Scopus theoretical reference bases were used, which are directly related to the theme of space syntax in open and closed spaces. Frequency analyzes were carried out, applying the content analysis, to identify words with a degree of similarity, related to “space syntax: flow in urban environ-ments” and “space syntax in closed built systems”, in relations to the SDGs. The results show that pedestrian flows identified in the literature aid to understand the global production on space syntax in open and closed spaces, directed to user flows in the built environment, where many environments of flows in the built space analyzed become unsustainable because they do not present full flow efficiency. In our study on space syntax, the following central terms were identified: pedestrian movements (open urban systems) and space (closed built systems), which allows a better understanding of the flows, highlighting the importance of the urbanist architect on the functionality of user flows in sustainable architectural projects on a global scale. The most frequent categories for open environments were the terms space and form and for closed envi-ronments were space and flow.

Conducting related research is crucial since there are still many problems that need to be resolved in the research on soft robots in the areas of material selection, structure design and manufacture, and drive control. Soft manipulators, a subset of soft robots, are now a popular area of study for many researchers. In comparison to typical manipulators, soft manipulators feature a high degree of gripping flexibility and a basic morphological structure. They are composed of flexible materials. It has a wide range of potential applications in healthcare, rehabilitation, bionics, and detection, and it can compensate for the drawbacks of rigid manipulators in some use scenarios. A modular soft-body torsional gripping system is developed after a torsional and gripping actuator is conceived, constructed, and its performance is examined. The torsion actuator and the grasping actuator can be combined in the system in a modular fashion. With the help of RGB-D vision algorithms, this multi-modular setup makes it possible to combine soft actuators with various twisting degrees and achieve exact gripping. Through pneumatic control, the target object is precisely grasped and rotated at various angles, enabling rotation of the target object in three dimensions.

Stripe rust ​​(caused by Puccinia striiformis f. sp. tritici) is one of the most devastating diseases of wheat and causes large-scale epidemics and severe yield loss. Applying fungicides during early epidemic development is crucial to controlling the disease but is often challenged by resource-limited human visual scouting. Deep learning has the potential to process images and videos captured from affordable devices to empower high-throughput phenotyping for early detection of stripe rust for timely application of fungicides and improve control efficiency. Here, we developed RustNet, a neural network-based image classifier, for efficiently monitoring fields for stripe rust. RustNet was built on a ResNet-18 architecture pre-trained with ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) dataset using transfer learning. RGB images and videos of multiple wheat fields with different wheat types (winter and spring wheat), conditions (irrigated and non-irrigated), and locations were acquired using smartphones or unmanned aerial vehicles near the canopy. A semi-automated image labeling approach was conducted to improve labeling efficiency by combining automated machine labeling and human correction. Cross-validations across multiple categories (sensor platforms, wheat types, and locations) achieved Area Under Curve from 0.72 to 0.87. Independent validation on a published dataset from Germany achieved accuracies ranging from 0.79 to 0.86. The visualization of the last convolutional layer of RustNet demonstrated the identification of pixels with stripe rust. RustNet is freely available at https://zzlab.net/RustNet.

In order to solve the labor-intensive and time-consuming problem in the process of measuring yak body ruler and weight in yak breeding industry in Qinghai Province, a non-contact method for measuring yak body ruler and weight was proposed in this experiment, and key technologies based on semantic segmentation, binocular ranging and neural network algorithm were studied to boost the development of yak breeding industry in Qinghai Province. Main conclusions: (1) Study yak foreground image extraction, and implement yak foreground image extraction model based on U-net algorithm; select 2263 yak images for experiment, and verify that the accuracy of the model in yak image extraction is over 97%. (2) Develop an algorithm for estimating yak body ruler based on binocular vision, and use the extraction algorithm of yak body ruler related measurement points combined with depth image to estimate yak body ruler. The final test shows that the average estimation error of body height and body oblique length is 2.6%, and the average estimation error of chest depth is 5.94%. (3) Study the yak weight prediction model; select the body height, body oblique length and chest depth obtained by binocular vision to estimate the yak weight; use two algorithms to establish the yak weight prediction model, and verify that the average estimation error of the model for yak weight is 10.7% and 13.01% respectively.

Foveal vision loss has been shown to reduce efficient visual search guidance due to contextual cueing by incidentally learned contexts. However, previous studies used artificial (T among L-shape) search paradigms that prevent the memorization of a target in a semantically meaningful scene. Here, we investigated contextual cueing in real-life scenes that allow explicit memory of target locations in semantically rich scenes. In contrast to the contextual cueing deficits in artificial scenes, contextual cueing in patients with age-related macular degeneration (AMD) did not differ from age-matched normal-sighted controls. We discuss this in the context of visuospatial working memory demands for which both eye-movement control in the presence of central vision loss and for memory-guided search may compete. Memory-guided search in semantically rich scenes may depend less on visuospatial working memory than search in abstract displays, potentially explaining intact contextual cueing in the former but not the latter. In a practical sense, our findings may indicate that Patients with AMD are less deficient than expected after previous lab experiments. This shows the usefulness of realistic stimuli in experimental clinical research.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

In the fashion field, the use of electroplated small metal parts such as studs, clips and buckles is widespread. The plate is often made of precious metal, such as gold or platinum. Due to the high cost of these materials, it is strategically relevant and of primary importance for manufacturers to avoid any waste by depositing only the strictly necessary amount of material. To this aim, Companies need to be aware of the overall number of items to be electroplated so that it is possible to properly set the parameters driving the galvanic process. Accordingly, the present paper describes a Machine Vision-based method able to automatically count small metal parts arranged on a galvanic frame. The devised method relies on the definition of a proper acquisition system and on the development of image processing-based routines. Such a system is then implemented on a counting machine is meant to be adopted in the galvanic industrial practice to properly define a suitable set or working parameters (such as current, voltage and deposition time) for the electroplating machine and, thereby, to assure the desired plate thickness from one side and to avoid material waste on the other.

It's challenging to achieve robust lane detection depending on single frame when considering complicated scenarios. In order to detect more credible lane markings by using sequential frames, a novel approach to fusing vision and Inertial Measurement Unit (IMU) is proposed in this paper. The hough space is employed as the space where lane markings are stored and it's calculated by three steps. Firstly, a basic hough space is extracted by Hough Transform and primary line segments are extracted from it. In order to measure the possibility about line segments belong to lane markings, a CNNs based classifier is introduced to transform the basic hough space into a probabilistic space by using the networks outputs. However, this probabilistic hough space based on single frame is easily disturbed. In the third step, a filtering process is employed to smooth the probabilistic hough space by using sequential information. Pose information provided by IMU is applied to align hough spaces extracted at different times to each other. The final hough space is used to eliminate line segments with low possibility and output those with high confidence as the result. Experiments demonstrate that the proposed approach has achieved a good performance.

When using computer-aided translation systems in a typical, professional translation workflow, there are several stages at which there is room for improvement. The SCATE (Smart Computer-Aided Translation Environment) project investigated several of these aspects, both from a human-computer interaction point of view, as well as from a purely technological side. This paper describes the SCATE research with respect to improved fuzzy matching, parallel treebanks, the integration of translation memories with machine translation, quality estimation, terminology extraction from comparable texts, the use of speech recognition in the translation process, and human computer interaction and interface design for the professional translation environment. For each of these topics, we describe the experiments we performed and the conclusions drawn, providing an overview of the highlights of the entire SCATE project.

Gender has been a rarely addressed aspect in digital game-based learning (DGBL). Likewise, mixed results have been presented regarding the effects according to gender and the conditions that generate these effects. The present work studies the effects of a drill-and-practice mathe-matical game on primary students. The study focused on an analysis by gender, measuring learning performance, and motivation in the practice activity. Also, two instructional mechanics were considered regarding the question answering, a multiple-try (MTF) and a single-try (STF) condition, to search for possible differences. A total of 81 students from 4 courses and 2 schools participated in the experiment. The study's main findings were that: (a) the girls outperformed boys in terms of students' learning gains, (b) girls presented lower levels of competence and autonomy than boys, (c) in the MTF, girls presented lower levels of autonomy but no differences in competence contrasted to boys, (d) in the STF, girls presented lower levels of competence but no differences in autonomy against boys, and (e) no differences existed in interest, effort and value among gender overall o per instructional condition. This study enhances the knowledge of gender differences under diverse instructional settings, in particular providing insights into possible differences by gender when varying the number of attempts provided to students.

Backround Cochlear implant is the first approved cranial nerve stimulator that works by directly stimulating the cochlear nerve. Various attempts have been made to evaluate the dimensions of the cochlea related to cochlear implantationThe preoperative computed tomographic examination is essential in assessing the anatomical aspect of the cochlea, but also in determining its dimensions, in order to choose an appropriate electrode, in order to obtain the best possible audiological performance. Method In the present paper, we aimed to carry out an observational study, regarding the role of cochlear measurements in the preoperative evaluation of patients proposed for cochlear implant. The purpose of the study was to measure the cochlea and to establish the existence of a correlation between the size of the cochlea and the age and gender of the patients. Results From the group of 35 examined patients, 54% (n= 19) were male and 46% (n=16) female. The average length of the cochlea in the age group 0-4 years is 7.82 mm in the left ear and 7.86 in the right ear, in the age group 4-7 years it is 7.82 mm and 7.94 mm respectively, for the age group 7-14 years the dimensions increase to 8.48 and 8.77 mm respectively, and after 14 years these dimensions reach 9.12, respectively 9.18 mm. Comparative measurements of the length of the cochlea by age groups show an increase in length with the patient's age, but this increase does not exceed 1.5 mm for both the right and left ears. The measurements of the width of the cochlea, by age group, start from 6.84 mm left ear and 6.81 mm right ear at 0-4 years, 6.94 mm and respective 6.97 mm at the group 4-7 years, 7.71 mm and respective 7.55 mm at 7-14 years , and reaching 8.19 mmm and 8.12 mm at the age of over 14 years. Conclusions From the study carried out it can be concluded that the evaluation of the dimensions of the cochlea is important for cochlear implantation, the size variables, although small, are still an element to be considered in correlation with the age of the patient and the implanted ear. This increase is statistically insignificant, but it still exists, even if from a theoretical point of view, it is considered that the dimensions of the cochlea remain constant.

Computer simulation relies on well-defined experimental supported theories, models, and numerical methods. Computer simulation is an alternative to fill the gaps where the experiment is pricy or limited in engineering. Computer simulation is a high-fidelity computational technique that can work as an engineering innovation tool to try imaginative ideas beyond the available technologies. The accuracy of current computer simulation results is reliable enough to accelerate innovation for new materials and mechanical technologies without experimental validation. So, we may need to urge relying on computer simulation results without any experimental validation to accelerate engineering innovations. In addition, using high-fidelity computer simulation for engineering innovation acceleration without validation will be promoted if it is credited as a new classification. This subject and a related justification's classification in engineering have been discussed.

Intracortical microelectrodes that can be implanted have the ability to capture fast-changing neuron action potentials in the living brain. Despite this potential, many obstacles must still be overcome for reliable, long-term, high-quality recordings and accurate analysis of brain activity. These challenges include improving recording quality, enhancing recording stability, increasing recording capacity, and adding multi-functional features. One potential approach to enhance implantable microelectrodes involves the advancement of materials, refinement of implantation methodologies, and augmentation of the number of sites for recording. However, these challenges are still being actively researched, and advancements in microelectrode technology are underway. The difficulties with implantable microelectrodes are evaluated, and solutions are presented from different perspectives. The latest advancements in microelectrode technology are reviewed and condensed, and future possibilities are explored.

In this article, we report how we constructed a dataset that contains the responses to a survey designed for investigating the relationship that humans have with their smart devices. The dataset has been collected in May-July 2020 and is a sample of over 500 respondents of various different ethnicities and backgrounds. These data have been used for modelling the ways people relate to their devices using the notion of agency. However, the data can be used for complementing any study that intends to investigate a tool-mediated communication from the perspective of the users and via a variety of attitudes and expectations the users invest in their devices and in themselves as users. This article presents the survey items as well as some preliminary data insights. The data have been collected in English and answers have been anonymized in order to ensure GDPR compliance. They are stored in a .csv file containing the respondents’ answers to the questions.

The designs of two large arenas of different epochs are discussed, which are the most famous antique amphitheater the Roman Colosseum (Italy) and the modern Gazprom Arena stadium (St. Petersburg, Russia). 3D-computer models of the arenas have been built and evacuation of people has been simulated in the Sigma FS software (Russia). The arena designs are analyzed in terms of organizing pedestrian evacuation, a comparative analysis is made, and the specific characteristics affecting the evacuation time are established.

This code provides computational facilities to simulate current versus time during the charging of Li-ion cells at desire constant voltage by considering multiscale physical phenomena. This code only considers a powder of active materials (at microscale or nanoscale) and a small part of electrolyte around it as a half cell. Then it is extended to a complete cell by applying correct boundary conditions. This code is very useful by modifying code parameters to understand the effect of the complex shape of active materials powder (surface area and powder size), kind of electrolyte, and the applied voltages on the charging response of Li-ion cell. As a summary, a microscale approach to the design of Li-ion cells has been provided via this code.

If a clear and valid no-go for Einsteinian hidden parameters is real, it must in no way be possible to violate the CHSH with a local hidden variables based computer simulation. In the paper we show that with the use of a modied Glauber-Sudarshan method it is possible to violate the CHSH.The criterion value comes close to the quantum value and is approximately 2.4. The proof (POC) is presented with the use of an R computer program. The important snippets of the code are discussed and the complete code is presented in an appendix.

In this paper, the columnar supramolecular aggregates of photosensitive star-shaped azobenzenes with benzene-1,3,5-tricarboxamide core and azobenzene arms are analysed theoretically applying a combination of computer simulation techniques. Without a light stimulus, the trans-stars build one-dimensional columns of stacked molecules during the first stage of the noncovalent association. These columnar aggregates represent the structural elements of more complex experimentally observed morphologies -- fibers, spheres, gels and others. Upon UV light exposure, the azobenzene arms isomerise from thermodynamically stable planar trans- to a metastable kinked cis-state influencing the aggregate morphology. Here, we determine the most favourable mutual orientations of the \textit{trans}-stars in the stack in terms of (i) the pi-pi distance between the cores lengthwise the aggregate, (ii) the star slipped displacements and (iii) the rotation promoting the helical twist and chirality of the aggregate by calculating the binding energy diagrams using density functional theory. The model predictions are further compared with available experimental data. The intermolecular forces responsible for the stability of the stacks made of trans-azobenzene stars in crystals are quantified using Hirshfeld surface analysis. Finally, to characterize the self-assembly mechanism of such stars in solution, we calculate the hydrogen bond lengths, the normalized dipole moment and the binding energies as the functions of the columnar length using molecular dynamics trajectories, and conclude about the cooperative nature of this process.

A brain-computer interface for controlling elements commonly used at home is presented in this paper. It includes the electroencephalography device needed to acquire signals associated to the brain activity, the algorithms for artefact reduction and event classification, and the communication protocol.

Gesture-based recognition is one of the most intuitive methods for inputting information and is not subject to cumbersome operations. Recognition is performed on human's consecutive motion without reference to retrial or alternation by user. We propose a gesture recognition model with a mechanism for correcting recognition errors that operates interactively and is practical. We applied the model to a setting involving a manual grading task in order to verify its effectiveness. Our system, named GERMIC, consists of two major modules, namely, handwritten recognition and interactive correction. Recognition is materialized with image feature extraction and convolutional neural network. A mechanism for interactive correction is called on-demand by a user-based trigger. GERMIC monitors, track, and stores information on the user's grading task and generates output based on the recognition information collected. In contrast to conventional grading done manually, GERMIC significantly shortens the total time for completing the task by 24.7% and demonstrates the effectiveness of the model with interactive correction in two real world user environments.

This article analyzes some available bike mobile applications for smartphones as an alternative to bike computers (Cycle Computers or speedometer or speed sensors). We have records of a large number of MTB (Mountain Bike) datasets, 219 datasets were recorded on 4 different routes. These applications create maps and profiles from geographic data. Inputs can be in GPS data (tracks and waypoints), driving routes, street addresses, or simple coordinates. Most applications estimate fields such as speed, heading, slope, distance, VMG (velocity made good) and pace (cadence). However, it is necessary to calculate the relationship between cadence and power in pedaling so that cyclists know the appropriate moment to apply power to their legs to improve the torque. This paper shows tables, comparative graphs, and performance evaluation of biking routes in four different cycling mobile applications.

Pulmonary sarcoidosis is a multisystem granulomatous interstitial lung disease (ILD) with a variable presentation and prognosis. Early accurate detection of pulmonary sarcoidosis may prevent progression to pulmonary fibrosis, a serious and potentially life-threatening form of the disease. However, the lack of a gold-standard diagnostic test and specific radiographic findings pose challenges in diagnosing pulmonary sarcoidosis. Chest computed tomography (CT) imaging is commonly used but requires expert, chest-trained radiologists to differentiate pulmonary sarcoidosis from lung malignancies, infections, and other ILDs. In this work, we developed a multichannel, CT and radiomics-guided ensemble network (RadCT-CNNViT) with visual explainability for pulmonary sarcoidosis vs. lung cancer (LCa) classification using chest CT images. We leverage CT and hand-crafted radiomics features as input channels, and a 3D convolutional neural network (CNN) and vision transformer (ViT) ensemble network for feature extraction and fusion before a classification head. The 3D CNN sub-network captures localized spatial information of lesions, while the ViT sub-network captures long-range, global dependencies between features. Through multichannel input and feature fusion, our model achieved the highest performance with accuracy, sensitivity, specificity, and combined AUC of 0.93±0.04, 0.94±0.04, 0.93±0.08 and 0.97 respectively in a 5-fold cross-validation study with pulmonary sarcoidosis (n=126) and LCa (n=93) cases. The model offers promising potential for improving the diagnosis of pulmonary sarcoidosis. A detailed ablation study showing the impact of CNN+ViT compared to CNN or ViT alone, and CT+radiomics input, compared to CT or radiomics alone, is also presented in this work.

Deep learning is widely used in image segmentation, effectively identifying crops and weeds and contributing to the reduction of herbicide use. Traditional methods of applying pesticides over large areas are inefficient in dealing with weeds as needed, leading to massive waste of pesticides, high-cost production, and serious environmental pollution. This affects crop yield and quality. Although weed recognition using conventional deep learning methods has evolved over time, there are still challenges in weed extraction, detection, and segmentation. Accurate recognition and detection of weeds are essential prerequisites for implementing variable spraying. This paper proposes a semantic segmentation method based on UNet++ for complex environments where accurate identification of plants and weeds is challenging, targeting weeds in sugar beets, peas, and rice. An attention module is integrated into the upsampling process of UNet++, and UNet++ is used as a backbone network to effectively integrate multi-scale information, efficiently suppressing external noise interference. The UNet++ model with an integrated attention mechanism module achieves higher IOU than the general UNet++ model used in medical image analysis. This method effectively detects crops and weeds in complex backgrounds, providing reference material for the accurate application of robotic herbicides.

To solve the problem of complex sensor installation and easy damage in contact displacement measurement, a non-contact measurement method of brace displacement in bridge swivel construction based on binocular vision is proposed in this study. Combined with monitoring data in a swivel construction interchange project, binocular vision system was compared and analyzed with the traditional displacement meter and total station. Results showed that force versus displacement variation plots were obtained by binocular visual measurement in the weighing test, the inflection point can be clearly distinguished, and the position of the inflection point was the same as that of the displacement meter; monitoring data of binocular vision measurement and total station were compared and analyzed in the bridge swivel process, the average error was no more than 0.18 mm, the maximum error was no more than 0.42 mm, and the standard deviation was no more than 0.12. The method proposed in this study can be used as an alternative to displacement meter and total station measurement methods in bridge swivel construction, the problem of complex sensor installation and easy damage is solved in brace displacement measurement, equipment and labor costs can be effectively saved.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

Due to the influence of background conditions, lighting conditions, occlusion issues and the image resolution, how to extract robust person features is one of the difficulties in ReID research. Vision in Transformers (ViT) has achieved significant results in the field of computer vision. However, the existing problems still limit its application in ReID due to slow extraction of person features and difficulty in utilizing local features of people. To solve the mentioned problems, we utilize Pyramid Vision Transformer (PVT) as the backbone of feature extraction and propose a PVT-based ReID method in conjunction with other studies. Firstly, some improvements suitable for ReID are used on the PVT backbone, and we establish a basic model by using powerful methods verified on CNN-based ReID. Secondly, in an effort to further promote the robustness of the person features extracted by the PVT backbone, two new modules are designed. (1) The local feature clustering (LFC) is recommend to enhance the robustness of person features by calculating the distance between local features and global feature to select the most discrete local features and clustering them. (2) The side information embeddings (SIE) are used to encode non-visual information and send it into the network for training to reduce its impact on person features. Finally, the experiments show that PVTReID has achieved excellent results in ReID datasets and are 20% faster on average than CNN-based ReID methods.

Expanding previous efforts to survey the visual opsin repertoires of the Hemiptera, this study confirms that homologs of the UV- and LW-opsin subfamilies are conserved in all Hemiptera, while the B-opsin subfamily is missing from the Heteroptera and subgroups of the Sternorrhyncha and Auchenorrhyncha, i.e. aphids (Aphidoidea) and planthoppers (Fulgoroidea), respectively. Unlike in the Heteroptera, which are characterized by multiple expansions of the LW-opsin subfamily, the lack of B-opsin correlates with the presence of tandem-duplicated UV-opsins in aphids and planthoppers. Available data on organismal wavelength sensitivities and retinal gene expression patterns lead to the conclusion that, in both groups, one UV-opsin paralog shifted from ancestral UV peak sensitivity to derived blue sensitivity, thereby compensating for the lost B-opsin. Two parallel bona fide tuning site substitutions compare to 18 non-corresponding amino acid replacements in the blue-shifted UV-opsin paralogs of aphids and planthoppers. Most notably, while the aphid blue-shifted UV-opsin clade is characterized by a replacement substitution at one of the best-documented UV/blue tuning sites (Rhodopsin site 90), the planthopper blue-shifted UV-opsin paralogs retained the ancestral lysine at this position. The combined findings identify aphid and planthopper UV-opsins as a new valuable data sample for studying adaptive opsin evolution.

Objectives: Understanding the intersection of age, ethnicity, and disability will become increasingly important as the global population ages and becomes more diverse. By 2060, Hispanics will comprise 28% of the U.S. population. This study examines critical associations between sensory impairment, social isolation, and cognitive functioning among Hispanic older adults. Methods: Our sample consisted of 557 Hispanic older adults that participated in Rounds 1-3 or Rounds 5-7 of the National Health and Aging Trends Study. Longitudinal mediation models across a three-year span were estimated using Mplus with vision, hearing, and dual sensory impairment predicting cognitive functioning directly and indirectly through social isolation. Results: Findings indicated that cognitive functioning was concurrently and, in certain cases, longitudinally predicted by vision and dual sensory impairment, and by social isolation. Contrary to expectations, vision and hearing impairment were not predictive of social isolation. Dual sensory impairment was associated with social isolation, yet no significant indirect associations were found for sensory impairments predicting cognitive functioning through social isolation. Discussion: The finding that social isolation did not mediate the relationship between sensory impairment and cognitive decline among Hispanic older adults in the U.S. is contrary to findings from other studies that were not specifically focused on this population. This finding may be evidence that culturally motivated family support and intergenerational living buffer the impact of sensory impairments in later life. Findings suggest that Hispanic older adults experiencing dual sensory impairments may benefit from interventions that foster social support and include family members.

Newly build offshore wind farms (OWFs) render a collision risk between ships and installations. The paper proposed a real-time traffic monitoring method based on machine vision and deep learning technology to improve the efficiency and accuracy of the traffic monitoring system in the vicinity of offshore wind farms. Specifically, the method employs real automatic identification system (AIS) data to train a machine vision model, which is then used to identify passing ships in OWF waters. Furthermore, the system utilizes stereo vision techniques to track and locate the positions of passing ships. The method is tested in offshore water in China to validate its reliability. The results prove that the system sensitively detects the dynamic information of the passing ships, such as the distance between ships and OWFs, ship speed and course. Overall, this study provides a novel approach to enhancing the safety of OWFs, which is increasingly important as the number of such installations continues to grow. By employing advanced machine vision and deep learning techniques, the proposed monitoring system offers an effective means of improving the accuracy and efficiency of ship monitoring in challenging offshore environments.

In the present paper, we propose a wavelet method to study the impact of electronic media on economic situations. We precisely apply wavelet techniques versus classical methods to analyze economic indices in the market. The technique consists firstly in filtering the data from unprecise circumstances (noise) to construct next a wavelet denoised contingency table. Next, a thresholding procedure is applied to such a table to extract the essential information porters. The resulting tables subject finally to correspondence analysis before and after thresholding. As a case of study, we are empirically concerned with the 2030 KSA vision in electronic and social media. Effects of the electronic media texts about the trading 2030 Vision on the Saudi and global economy have been studied. Recall that the Saudi market is the most important representative market in the GCC continent. It has both regional and worldwide influence on economies and besides, it is characterized by many political, economic, and financial movements such as the worldwide economic NEOM project. The findings provided in the present paper may be applied to predict future GCC markets situation and thus may be a basis for investors’ decisions in such markets.

The electrical stimulation of the visual cortices has the potential to restore vision to blind individuals. Until now, the results of visual cortical prosthetics has been limited as no prosthesis has restored a full working vision but the field has shown a renewed interest these last years thanks to wireless and technological advances. However, several scientific and technical challenges are still open in order to achieve the therapeutic benefit expected by these new devices. One of the main challenges is the electrical stimulation of the brain itself. In this review, we analyze the results in electrode-based visual cortical prosthetics from the electrical point of view. We first briefly describe what is known about the electrode-tissue interface and safety of electrical stimulation. Then we focus on the psychophysics of prosthetic vision and the state-of-the-art on the interplay between the electrical stimulation of the visual cortex and phosphene perception. Lastly, we discuss the challenges and perspectives of visual cortex electrical stimulation and electrode array design to develop the new generation implantable cortical visual prostheses.

Previous studies have reported certain sex differences in motor performance precision. The aim of the present study was to analyse sex differences in fine motor precision performance for both hands in different tests conditions. 220 Spanish participants (ages: 12-95) performed fine motor tasks - tracing over the provided models – lines of 40 mm for both hands, two sensory conditions (PV – proprioceptive-visual; P – proprioceptive only) and three movement types (F – frontal, T – transversal and S - Sagittal). Differences in line length (the task focused on precision) were observed through MANOVA analysis for all test conditions, both sexes and different age groups. Sex differences in precision were observed in F and T movement types (statistically significance level and higher Cohens’ d was observed in condition with vision). No any statistically significant differences were observed in both hands and sensory conditions in sagittal type. Sex differences in fine motor precision were more frequently observed in the PV sensory condition in the frontal movement type and less in the sagittal one.

A monocular vision pose estimation and identification algorithm used on a small spacecraft for future orbital servicing is studied in this paper. A tracker spacecraft equipped with a short-range vision system is proposed to recover the 3D structural model of a space target in orbit and automatically identify its solar panels and main body using only visual information from an onboard camera. The proposed reconstruction and identification framework is tested using structure-from-motion and point cloud identification methods. The Efficient Perspective-n-Points (EPnP) descriptor is used for pose estimation. Triangulated points are used for component segmentation by means of orientation histogram descriptors. Experimental results based on laboratory images of a spacecraft model show the effectiveness and robustness of our approach.

We propose an approach for estimating the error in depth data provided by generic 3D sensors, which are modern devices capable of generating an image (RGB data) and a depth map (distance) or other similar 2.5D structure (e.g. stereo disparity) of the scene. Our approach starts capturing images of a checkerboard pattern devised for the method. Then proceed with the construction of a dense depth map using functions that generally comes with the device SDK (based on disparity or depth). The 2D processing of RGB data is performed next to find the checkerboard corners. Clouds of corner points are finally created (in 3D), over which an RMS error estimation is computed. We come up with a multi-platform system and its verification and evaluation has been done, using the development kit of the board nVIDIA Jetson TK1 with the MS Kinects v1/v2 and the Stereolabs ZED camera. So the main contribution is the error determination procedure that does not need any data set or benchmark, thus relying only on data acquired on-the-fly. With a simple checkerboard, our approach is able to determine the error for any device. Envisioned application is on 3D reconstruction for robotic vision, with a series of 3D vision sensors embarked in robots (UAV of type quadcopter and terrestrial robots) for high-precision map construction, which can be used for sensing and monitoring.

One of the tools for optimal crop production is regular monitoring and assessment of crops. During the growing season of fruit trees, the bloom period has increased photosynthetic rates that correlate with the fruiting process. This paper presents the development of an image processing algorithm to detect peach blossoms on trees. Images of an experimental peach orchard were acquired from the Parma Research and Extension Center of the University of Idaho using an off-the-shelf unmanned aerial system (UAS), equipped with a multispectral camera (Near-infrared, Green, Blue). The orchard has different stone fruit varieties and different plant training system. Individual tree images (high-resolution) and arrays of trees images (low-resolution) were acquired to evaluate the detection capability. The image processing algorithm was based on different vegetation indices. Initial results showed that the image processing algorithm could detect peach blossoms and demonstrate good potential as a monitoring tool for orchard management.

The European Space Agency (ESA) defines as Earth observation (EO) Level 2 information product a single-date multi-spectral (MS) image corrected for atmospheric, adjacency and topographic effects, stacked with its data-derived scene classification map (SCM), whose thematic map legend includes quality layers cloud and cloud-shadow. ESA EO Level 2 product generation is an inherently ill-posed computer vision (CV) problem never accomplished to date in operating mode by any EO data provider at the ground segment. Herein, it is considered: (I) necessary not sufficient pre-condition for the yet-unaccomplished dependent problems of semantic content-based image retrieval (SCBIR) and semantics-enabled information/knowledge discovery (SEIKD) in multi-source EO big data cubes. (II) Synonym of EO Analysis Ready Data (ARD) format. (III) Equivalent to a horizontal policy for background developments in Space Economy 4.0. In compliance with the GEO-CEOS Quality Assurance Framework for EO Calibration/Validation guidelines, to contribute toward filling an analytic and pragmatic information gap from multi-sensor EO big data to timely, comprehensive and operational EO value-adding information products and services, this work presents an innovative AutoCloud+ CV software toolbox for cloud and cloud-shadow quality layer detection in ESA EO Level 2 product. In vision, spatial information dominates color information. Inspired by this true-fact, the inherently ill-posed AutoCloud+ CV software was conditioned, designed and implemented to be “universal”, meaning fully automated (no human-machine interaction is required), near real-time, robust to changes in input data and scalable to changes in MS imaging sensor’s spatial and spectral resolution specifications.

Attempts to use computers to aid in the detection of breast malignancies date back more than 20 years. Despite significant interest and investment, this has historically led to minimal or no significant improvement in performance and outcomes with traditional computer aided detection. However, recent advances in artificial intelligence and machine learning are now starting to deliver on the promise of improved performance. There are at present more than 20 FDA approved AI applications for breast imaging, but adoption and utilization are widely variable and overall low. Breast imaging is unique and has aspects that create both opportunities and challenges for AI development and implementation. Breast cancer screening programs worldwide rely on screening mammography to reduce the morbidity and mortality of breast cancer and many of the most exciting research and available AI applications focus on cancer detection for mammography. There are however multiple additional potential applications for AI in breast imaging including decision support, risk assessment, breast density quantitation, workflow and triage, quality evaluation, response to neoadjuvant chemotherapy assessment, and image enhancement. In this review the current status, availability, and future directions of investigation of these applications are discussed, as well as the opportunities and barriers to more widespread utilization.

This research aims to introduce a model, SectraBank, designed to mitigate cyber fraud attacks, specifically targeting SIM Swapping and Fake App schemes in mobile banking users. A quantitative methodology with an experimental design was meticulously employed to examine the rise of cyber fraud within mobile banking. The study involved a sample of 100 professionals with advanced knowledge in Information and Communication Technologies (ICTs). Surveys were utilized to measure awareness of threats and perceptions of security before and after the implementation of the proposed model. SectraBank leverages unique user identifiers such as fingerprint authentication and the International Mobile Equipment Identity (IMEI) number, in addition to geolocation and One Time Passwords (OTP) for validating electronic transactions in mobile banking. The effectiveness of the proposed model was notable, achieving a 96.1% efficacy rate in mitigating Fake App attacks and a 90.2% success rate in countering SIM Swapping attacks. These findings underscore the potential of SectraBank as a robust solution to enhance cybersecurity measures in the realm of mobile banking.

Use of MS Excel as a platform for teaching simple iterative solution of partial differential equations runs into issues of reliability of the computation because of the large number of calculations required. This article documents the problem and an empirical solution. The cause of this unreliability was found by detailed examination of the numerical results from three simultaneous iterations. Computers of several types from different manufacturers were found to fail occasionally in updating variables in the numerical iteration. A simple work-around is suggested and was tested on several platforms.

The production of high-quality castings without foundry defects at minimal production costs is a constant priority for foundries. Innovation and optimization of production processes are key to achieving this goal. Computer simulation of foundry processes offers a modern alternative to expensive and time-consuming experiments in real foundries and provides a reliable representation and analysis of casting and solidification processes. A detailed analysis of the casting and solidification simulation results allows the prediction of various risks that can cause defects in cast castings, thereby reducing their quality and, last but not least, the cost of their production. The paper deals with the analysis of a computer simulation of the casting of a brake disc in the Slovak foundry. This brake disc has had shrinkages and micro shrinkages that reduce the internal quality of the casting. These defects occurred in the ribs in the upper part of the casting under the feeders. A computer simulation of the casting and solidification of this casting was made according to real conditions. It turned out that the designed ingate system with a system of feeders was not sufficient to eliminate emerging defects. A new layout of the feeders was proposed, which ultimately eliminated the occurrence of defects based on the results of computer simulation. The input parameters were set to be as close as possible to the actual needs of the foundry. 3D models of the assemblies were designed in SolidWorks CAD software, and filling and solidification simulations were performed using the NovaFlow &amp; Solid CV 4.6r42 simulation program.

Commonly, professors, students and researchers from universities around the world use software distributed under a license agreement for computer simulation purposes, which requires a computer with considerable hardware capabilities. Consequently, this implies a high cost to conduct simulations that require implementing numerical methods in all areas of engineering, particularly in the field of robotics and nonlinear control. This paper presents the design and results analysis of a low-cost and open-source frugal computer simulation tool with applications to robotic nonlinear control, for instance, for numerical simulations of manipulator robot control based on dynamic models. Using a single board minicomputer with with reduced computing power, Raspberry Pi, together with free software, GNU-Octave, trajectory tracking control simulations in the joint space of a Selective Conformal Assembly Robot Arm (SCARA) are achieved by solving a system of nonlinear differential equations, represented in matrix form, which includes the control law and the system model. The results of the proposed alternative are compared by running the same simulation code on a laptop computer using MATLAB and GNU Octave, which show minimal deviations and reasonable time complexity. Moreover, considering the frugality curve calculated for this approach, in addition to the low acquisition cost of the simulation software tool, it would allow the creation of a simulation laboratory in some universities with budgetary constraints for educational and research purposes.

Macrophytes and seagrasses play a crucial role with a variety of the functions in the marine ecosystem and respond synchronized-promptly to the changing climate, followed by ecological status. Monitoring of the seagrasses was one of the paramount topics at the marine environment. One of the fast monitoring techniques is the vegetation acoustics with the advantages compared to the other remote sensing techniques. The acoustic method alone is ambitious to sea-truth identities of the backscatterers at the sea. Therefore, a package of computer programs was developed to identify, estimate leaf biometrics (leaf length and biomass) of one of the common seagrasses, Posidonia oceanica. Some troubleshooting in the acoustical data were fixed and then solved to reach the estimates regarding to the matters encountered for the vegetation as well as fisheries and plankton acoustics. One of the trouble was the “Lost” bottom which occurred during the data collection and post-processing due to occurrence of the acoustical noises, reverberations, interferences and intense scatterers suchlike fish schools. Another problem to remove was the occurrence as studying the near-bottom echoes belonging to submerged vegetations such as seagrasses, followed by spurious echoes. Last one was recognition of the seagrass to estimate leaf length and biomass calibrating the sheaths/vertical rhizome of the seagrass and establishing relationships between acoustical units and biometrics, respectively. As a consequence, an autonomous package of the code written in language MatLab was developed to perform all processes, and the name of the package was abbreviated as POSIBIOM, POSIdonia BIOMass. This study presented the algorithms, methodology, acoustics-biometrics relation, and mapping of the biometrics for the first time, and discussed advantages and disadvantages of the package compared to the software purposed for the bottom types, habitat and vegetation acoustic. The future studies were recommended to improve the package.

Objective A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data. Approach PyCharm, a Python platform, will be used to house and process the CNN. The raw data used for the training of the CNN will be sourced from the PhysioBank website. The EEG signal data will then be pre-processed using Brainstorm software that is a toolbox used in conjunction with MATLAB. The sample data used to validate and test the trained CNN, will be also be extracted from Brainstorm but in a much smaller size compared to the training data which is comprised of thousands of images. The sample size would be comparable to a person wearing a Brain Computer Interface (BCI), offering approximately 20 seconds of motor imagery signal data. Results The raw EEG data was successfully extracted and pre-processed. The deep learning model was trained using the extracted image data along with their corresponding labels. After training, it was able to accurately identify the T1 class label at 100 percent. The python coding was then modified to restore the trained model and feed it test sample data in which it was found to recognise 6 out of 10 lines of T1 signal image data. The result suggested that the initial training of the model required a different, more varying approach, so that it would be able to detect varying sample signal image data. The outcome of which could mean that the model could be used in applications for multiple patients wearing the same BCI hardware to control a device or interface.