The Hennovation project, an EU H2020 funded thematic network, aimed to explore the potential value of practice-led multi-actor innovation networks within the laying hen industry. The project proposed that husbandry solutions can be practice-led and effectively supported to achieve durable gains in sustainability and animal welfare. It encouraged a move away from the traditional model of science providing solutions for practice, towards a collaborative approach where expertise from science and practice were equally valued. During the 32-month project, the team facilitated 19 multi-actor networks in 5 countries through 6 critical steps in the innovation process: problem identification, generation of ideas, planning, small scale trials, implementation and sharing with others. The networks included farmers, processors, veterinarians, technical advisors, market representatives and scientists. The interaction between the farmers and the other network actors, including scientists, was essential for farmer innovation. New relationships emerged between the scientists and farmers, based on experimental learning and the co-production of knowledge for improving laying hen welfare. The project demonstrated that a practice-led approach can be a major stimulus for innovation with several networks generating novel ideas and testing them in their commercial context. The Hennovation innovation networks not only contributed to bridging the science-practice gap by application of existing scientific solutions in practice but more so by jointly finding new solutions. Successful multi-actor, practice-led innovation networks appeared to depend upon the following key factors: active participation from relevant actors, professional facilitation, moderate resource support and access to relevant expertise. Farmers and processors involved in the project were often very enthusiastic about the approach, committing significant time to the network’s activities. It is suggested that the agricultural research community and funding agencies should place greater value on practice-led multi-actor innovation networks alongside technology and advisor focused initiatives to improve animal welfare and embed best practices.

Selected by in vitro techniques (SELEX, cell-SELEX), aptamers are strands of DNA or RNA molecules able to bind a wide range of targets, from small molecules to live cells, and even tissues, with high affinity and specificity. Due to their efficient targeting ability, aptamers are extensively used in different fields of applications. For example, they ensure high performance as cancer-related markers or in recognizing cancer cells. Actually, they represent a promising way for early diagnosis (biosensors) and to deliver imaging agents and drugs, in both cancer imaging and therapy (therapeutic aptamers). Aptamer-based biosensors (aptasensors) have attracted particular attention over the last decades, so as the possibility of using aptamers in disease therapy in substitution of monoclonal antibodies. The paper briefly reviews the most recent literature on this topic, both concerning the advances in biomedical applications and in the development of electrical aptasensors. The investigation concerning the bioelectronics features of aptamers, to be implemented in the development of electrical nanobiosensors, is also reviewed. To this aim, some recent results of a theoretical/computational framework for modelling the electrical properties of biomolecules (Proteotronics) are reported.

Predicting how a genetic change affects a given character is a major challenge in biology, and being able to tackle this problem relies on our ability to develop realistic models of gene networks. However, such models are rarely tractable mathematically. In this paper, we propose a mathematical analysis of the sigmoid variant of the Wagner gene-network model. By considering the simplest case, that is, one unique self-regulating gene, we show that numerical simulations are not the only tool available to study such models: theoretical studies can be done too, by mathematical analysis of discrete dynamical systems. It is first shown that the particular sigmoid function can be theoretically investigated. Secondly, we provide an illustration on how to apply such investigations in the case of the dynamical system representing the one self-regulating gene.

Recurrent neural networks (RNNs) transmit information over time through recurrent connections. In contrast, biological neural networks use many other temporal processing mechanisms. One of these mechanisms is the inter-neuron delays caused by varying axon properties. Recently, this feature was implemented in echo state networks (ESNs), a type of RNN, by assigning spatial locations to neurons and introducing distance-dependent inter-neuron delays. These delays were shown to significantly improve ESN task performance. However, thus far it is still unclear why distance-based delay networks (DDNs) perform bettern than ESNs. In this paper, we show that by optimizing inter-node delays, the memory capacity of the network matches the memory requirements of the task. As such, networks concentrate their memory capabilities to the points in the past which contain the most information for the task at hand. Moreover, we show that DDNs have more total linear memory capacity, with the same amount of non-linear processing power.

The vast majority of autonomous driving systems are limited to applications on roads with clear lane markings and are implemented using commercial grade sensing systems coupled with specialized graphic accelerator hardware. This research reviews an alternative approach for autonomously steering vehicles that eliminates the dependency on road markings and specialized hardware. A combination of machine vision, machine learning and artificial intelligence based on popular pre-trained Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) was used to drive a vehicle along roads lacking lane markings (unmarked roads). The team developed and tested this approach on the ACTor (Autonomous Camus TranspORt) vehicle - an autonomous vehicle development and research platform coupled with a low-cost webcam based sensing system and minimal computational resources. The proposed solution was evaluated on real-world roads and varying environmental conditions. It was found that this solution may be used to successfully navigate unmarked roads autonomously with acceptable road following behavior.

The accurate prediction of molecular properties such as lipophilicity and aqueous solubility are of great importance and pose challenges in several stages of the drug discovery pipeline. Machine learning methods like graph-based neural networks (GNNs) have shown exceptionally good performance in predicting these properties. In this work, we introduce a novel GNN architecture, called directed edge graph isomorphism network (D-GIN). It is composed of two distinct sub-architectures (D-MPNN, GIN) and achieves an improvement in accuracy over its sub-architectures employing various learning, and featurization strategies. We argue that combining models with different key aspects help make graph neural networks deeper and simultaneously increase their predictive power. Furthermore, we address current limitations in assessment of deep-learning models, namely, comparison of single training run performance metrics, and offer a more robust solution.

This article explores the intricate journey of neural progenitor cells from the ventricular zones of the embryonic brain, focusing on their pivotal role in the formation of rich club networks, which are integral to the brain's functional architecture. Initially, the ventricular zones, particularly the cerebral ventricular zone, serve as the primary sites for the proliferation and differentiation of neural progenitors, giving rise to various types of neurons and glial cells. We delve into the sequential migration patterns of these cells, emphasizing how early-migrating neurons, destined to form deeper cortical layers, establish extensive and robust connections, potentially evolving into rich club nodes. These nodes are characterized by their high-degree connectivity and serve as crucial hubs for integrating and disseminating information across disparate brain regions.The article further discusses the implications of this developmental pathway in the context of brain network efficiency, resilience, and cognitive function. We highlight how disruptions in early cell migration can lead to anomalies in rich club formation, drawing connections to various neurodevelopmental disorders such as autism, ADHD and schizophrenia. Additionally, the significance of rich club nodes in maintaining efficient information transfer and network resilience is elucidated, underscoring their role in supporting complex cognitive processes and overall brain dynamics.In summary, this article offers a comprehensive overview of the developmental trajectory from the ventricular zones to the establishment of rich club networks, providing insights into the fundamental processes that shape the brain's intricate connectivity and functional capabilities. Ric

: Controlling the distribution of water and wastewater between industrial processes is very vital in rationalizing water and preserving the environment. In this paper, a mathematical technique is proposed to optimize water-wastewater networks; a nonlinear program is introduced to minimize the consumption of freshwater, and consequently, the flowrate of the wastewater dis-charge will be also minimized. A general mathematical model, able to handle industrial plants containing up to eight sources and eight sinks, is developed using LINGO optimization software to facilitate dealing with complex case studies. The introduced model can handle single contam-inant networks as well as multiple contaminants cases. The optimal water network is synthe-sized through two steps; the first step is to introduce the case study data to the developed mathematical model. The second step considers using the optimal solution produced after run-ning the developed LINGO model as feed data for a pre-designed Excel sheet able to deal with these results and simultaneously draw the optimal water-wastewater network. The proposed mathematical model is applied to two case studies; The first case study includes actual data from four fertilizer plants located in Egypt; the water resources and requirements are simultaneously integrated to obtain a sensible cutting in both freshwater consumption (lowered by 52.2%) and wastewater discharge (zero wastewater discharge). The second case study is for a Brazilian pet-rochemical plant; the obtained results showed noticeable reductions in freshwater consumption for the second case study by 12.3 % while the reduction percentage of wastewater discharge is 4.5%.

Calligraphy works have high artistic value, but there is a rampant problem of forgery. Indeed, authentication of traditional calligraphy heavily relies on calligraphers' subjective judgment. Therefore, spurred by the recent development of neural networks, this paper proposes a method for authenticating calligraphy works based on an improved EfficientNet network. Specifically, the developed method utilizes the character box algorithm and the centroid algorithm to extract individual calligraphy characters, which are then augmented and used as the training set for the model. The training process employs CBAM and Self-Attention modules to enhance the attention mechanism of the EfficientNet network. The model is tested on authentic works, imitated works, and works from other calligraphers and is compared with other networks. The experimental results demonstrate that the proposed method effectively achieves the authentication of calligraphy works, and the improved CBAM-EfficientNet network and SA-EfficientNet network achieve better authentication performance.

Addressing sustainable mobility in urban areas has become a priority in today’s society, given the growing population and increasing vehicular flow in these areas. Intelligent Transportation Systems have emerged as innovative and effective technological solutions to address these challenges. Research in this area has become crucial, as it contributes not only to improve mobility in urban areas, but also to positively impact the quality of life of its inhabitants. To address this, a dynamic clustering methodology for vehicular trajectory data is proposed which can provide an accurate representation of the traffic state. Data was collected for the city of San Francisco, a dynamic clustering algorithm was applied and then an indicator was applied to identify areas with traffic congestion. Several experiments were also conducted with different parameterizations of the forgetting factor of the clustering algorithm. The results showed in terms of precision that the dynamic clustering methodology achieved high match rates compared to the congestion indicator applied to static cells.

The COVID-19 pandemic has emphasized the crucial role of ventilation systems in mitigating cross-infections, especially in infectious disease hospitals. This study introduces a dual-design operation ventilation system that can operate under two sets of ventilation conditions for normal and epidemic times. A challenge is optimizing duct diameters for required airflow while maintaining hydraulic balance. We design a genetic algorithm with adaptive penalty factor, the velocity constraint and the improved crossover and mutation probability. The improved genetic algorithm is suitable for ventilation system networks, which can find a better air duct diameters combination to improve the hydraulic balance rate, and reduce the usage of air valves, resulting in efficient hydraulic balancing commissioning. Compared with the traditional genetic algorithm, it has a faster search speed and a better global search ability, which is effective for the optimal design of ventilation system networks.

Transfer learning has proven to be a valuable technique for deploying machine learning models on edge devices and embedded systems. By leveraging pre-trained models and fine-tuning them on specific tasks, practitioners can effectively adapt existing models to the constraints and requirements of their application. In the process of adapting an existing model, a practitioner may make adjustments to the model architecture, including the input layers, output layers, and intermediate layers. In this study, we examine the effects of these adjustments on the runtime and energy performance of an edge processor performing inferences. Based on our observations, we make recommendations for how to adjust convolutional neural networks during transfer learning to maintain runtime performance. We observe that the Edge TPU is generally more efficient than a CPU at performing inferences on convolutional neural networks, and continues to outperform a CPU as the depth and width of the convolutional network increases. We explore multiple strategies for adjusting the input and output layers of an existing model and demonstrate important performance cliffs for practitioners to consider when modifying a convolutional neural network model.

The possibility of abrupt transitions threatens to poise ecosystems into irreversibly degraded states. Recently, it has been proposed the use of engineered microbiomes in endangered ecosystems to prevent them to cross tipping points and avoid collapse. Potential targets for such interventions include some of the most prominent life-support systems in the biosphere: drylands and coral reefs. Since engineering can require the introduction of microorganisms not present in resident communities, how can we weight the potential outcomes? One way is to use general models of species interactions where the "synthetic" strain is incorporated into a standard multispecies model. Here we follow this approach by modelling a resource-consumer community where one of the species is a modified one that acts by preserving some key resource. We show how the indirect effect of damping the decay of shared resources results in biodiversity increase, and last but not less, the successful incorporation of the synthetic within the ecological network. Further extensions and implications for future restoration and terraformation strategies are discussed.

Optical networks, characterized by using optical fibers as a transmission medium, constitute the fundamental infrastructure employed today by network operators to deliver services to users. As network capacity is one of the key factors influencing optical network performance, it is important to comprehend its limitations and have the capability to estimate its value. In this context, we revisit the concept of capacity from various perspectives, including channel capacity, link capacity, and network capacity, thus providing an integrated view of the problem. Hence, we review the fundamental concepts behind optical networks, along with the basic physical phenomena present in optical fiber transmission and provide methodologies for estimating the different types of capacities, mainly using simple formulations. In particular, we propose a method to evaluate the network capacity that relies on the optical reach to account for physical layer aspects, in conjunction with capacitated routing techniques for traffic routing. We apply this method to three reference networks and obtain capacities ranging from tens to hundreds of Terabits/s. Whenever possible, we also compare our results with published experimental data to understand how they relate.

With an explosion of data in the nearly every domain, from physical and environmental sciences to econometrics and even social science, we have entered a golden era of time-domain data science. In addition to ever increasing data volumes and varieties of time-series, there's a plethora of techniques available to analyses them. Unsurprisingly, machine learning approaches are very popular. In environmental sciences (ranging from climate studies to space weather/solar physics), machine learning (ML )and deep learning (DL) approaches complement the traditional data assimilation approaches. In solar and astrophysics, multiwavelength time-series or lightcurves along with observations of other messengers like gravitational waves provide a treasure trove of time-domain data for ML/DL approaches for modeling and forecasting. In this regard, deep learning algorithms such as recurrent neural networks (RNNs) should prove extremely powerful for forecasting as it has in several other domains. Such methods agnostic of the physics can only predict transient flares that are represented in the original distribution trained on (eg. coloured noise fluctuations) and not special, isolated episodes (eg. a one-off outburst like a major coronal mass ejection) potentially distinguishing them. Therefore it is vital to test robustness of these techniques ; here we attempt to make a small contribution to this by exploring sensitivity of RNNs with some rudimentary experiments. We test the performance of a very successful class of RNNs, the Long Short Term Memory (LSTM) algorithms with simulated lightcurves. As an example, we focus on univariate forecasting of time-series (or lightcurves) characteristic certain variable astrophysical objects (eg. active galactic nuclei or AGN). Specifically, we explore the sensitivity of training and test losses to key parameters of the LSTM network and data characteristics namely gaps and complexity measured in terms of number of Fourier components. We find that typically, the performances of LSTMs are better for pink or flicker noise type sources. The key parameters on which performance is dependent are batch size for LSTM and the gap percentage of the lightcurves. While a batch size of $10-30$ seems optimal, the most optimal test and train losses are under $10 \%$ of missing data for both periodic and random gaps in pink noise. The performance is far worse for red noise. This compromises detectability of transients. Thus, we show that generative models (time-series simulations) are excellent guides for use of RNN-LSTMs in building forecasting systems

Artificial neural networks are a powerful tool for managing data that is difficult to process and interpret. This paper presents the study of artificial neural networks for information processing generated by an optical encoder based on the polarization of light. A machine learning technique is proposed to train the neural networks, such that the system can predict with remarkable accuracy the angular position in which the rotating element of the neuro-encoder is located, based on information provided by light’s phase shifting arrangements. The proposed neural designs show excellent performance in small angular intervals, and a methodology is proposed to avoid losing this remarkable characteristic in measurements from 0 to 180o or even to 360o. The neuro-encoder is implemented in simulation stage to obtain performance results. This study can be useful to improve capabilities of resolvers or other polyphasic sensors.

"Industry 5.0” is the latest industrial revolution. A variety of cutting-edge technologies, including artificial intelligence, the Internet of Things (IoT), and others, come together to form it. This new era will bring about significant changes in the way businesses operate, allowing them to become more cost-effective, more efficient, and produce higher-quality goods and services. Because sen-sors are getting better, 5G networks are being put in place, and more industrial equipment and machinery are becoming available, the manufacturing sector is going through a significant period of transition right now. These newly scalable opportunities make it possible to use and spread blockchain architectures on the shop floor, which is made possible by the ever-decreasing costs associated with implementing blockchain technology. Even though modern production models make use of the cloud (both internal and external services), networks and systems can take ad-vantage of the cloud's relatively low cost, scalability, increased computational power, real-time communication, and data transfer capabilities to create much smarter and more autonomous systems. This paper presents the results of an investigation into how blockchain services for large-scale industry networks could benefit from increased levels of security, transparency, and efficiency. We discuss the ways in which decentralized networks that make use of protocols and meshes might make things better with these technologies, which are not going away anytime soon. We emphasize the significance of new design in regards to cybersecurity, data integrity, and storage by using straightforward examples that have the potential to lead to the excellence of distributed systems.

The Ocean Color - Simultaneous Marine and Aerosol Retrieval Tool (OC-SMART) is a robust data processing platform that supports a large array of multi-spectral and hyper-spectral sensors. It provides accurate aerosol optical depths and remote sensing reflectances (Rrs estimates) that can be used to generate products such as absorption coefficients due to phytoplankton and detritus/Gelbstoff as well as backscattering coefficients due to particulate matter. The OC-SMART platform yields improved performance in complex environments by utilizing scientific machine learning (SciML) in conjunction with comprehensive radiative transfer computations. This paper expands the capability of OC-SMART by quantifying uncertainties in ocean color retrievals. Bayesian inversion is used to relate measured top of atmosphere radiances and a priori data to estimate posterior probability density functions and associated uncertainties. A framework of the methodology and implementation strategy is presented and uncertainty estimates for Rrs retrievals are provided to demonstrate the approach by applying it to MODIS, OLCI Sentinel-3, and VIIRS sensor data.

Suppose G is a graph with vertex-orbits O1,1 O2, . . . ,Ot, and jOi j denotes the cardinallity of Oi. Then OG (x) = åt 2 i=1 xjOi j is called as orbit polynomial. It is well-known that this polynomial 3 has a unique positive zero d in the interval [0, 1]. The aim of this paper is to study the specific 4 properties of this polynomial and then we determine the location of this root for several classes of 5 complex networks to compare with other graphical measures. Besides, we compare the unique 6 positive zero measure with several well-known centrality graph measures.

From the perspective of network attackers, finding attack sequences that can make significant damage on network controllability is an important task, which also helps defenders improve the robustness during network constructions. Therefore, developing effective attack strategies is a key aspect of research on network controllability and its robustness. In this paper, we propose a Leaf Node Neighbor-based Attack (LNNA) strategy that can effectively disrupt the controllability of undirected networks. The LNNA strategy targets the neighbors of leaf nodes, and when there are no leaf nodes in the network, the strategy attacks the neighbors of nodes with a higher degree to produce the leaf nodes. Results from simulations on synthetic and real-world networks demonstrate the effectiveness of the proposed method. In particular, our findings suggest that removing neighbors of low-degree nodes (i.e., nodes with degree 1 or 2) can significantly reduce the controllability robustness of networks. Thus, protecting such low-degree nodes and their neighbors during network construction can lead to networks with improved controllability robustness.

In this study, we explore the potential of using a straightforward neural network inspired by the retina model to efficiently restore low-light images. The retina model imitates the neurophysiological principles and dynamics of various optical neurons. Our proposed neural network model reduces the computational overhead compared to traditional signal-processing models while achieving results similar to complex deep learning models from a subjective perceptual perspective. By directly simulating retinal neuron functionalities with neural networks, we not only avoid manual parameter optimization but also lay the groundwork for constructing artificial versions of specific neurobiological organizations.

Social networks have become an ubiquitous aspect of adolescents' life, providing new ways to connect and communicate with peers. However, little is known about the impact of social net-works on adolescents' emotional intelligence (EI), a crucial skill for social and identity development. The aim of the present study is to explore the time spent and reasons for using social net-works and their relationship with emotional intelligence in adolescents and young adults (15-19 years). After signing informed consent, participants completed a battery of questionnaires offered via secure online form. The results showed that teenagers spend more than 3 h/day on Whatsapp, more than 2 h/day on Instagram and less on Facebook (26m per day); girls prefer to use Whatsapp and Instagram, boys opt for Facebook. Most participants use social media when bored and/or to communicate with friends. Moreover, time spent on social media has a relationship with stress management with some aspects of EI (assertiveness, self-actualization, optimism, etc.). EI and social desirability have a significant relationship, especially in the sphere of adaptability. Based on the results obtained, future perspectives and training are suggested with the aim of adapting to the constant changes in the new technological reality.

American Sign Language is a popular language for deaf individuals. Communication is made easier for these people through sign language. However, in a digital era like today, there is a need for these people to be able to communicate online, and even get help from technology to communicate in person with non sign language speakers. This research will present a program able to translate American sign language to plain English. This study aims to use the OpenCV library to recognize hand signals, also a trained model to identify images so that the program can then translate them to words and letters. The program uses a data set of over 2000 images which will be in this case the largest data set available. With over 90\% of accuracy it results in a basic computer program with the largest data set available that would make possible for users to communicate with a wide variety of words and expressions.

Deep Learning is an extremely important research topic in Earth Observation. Current use-cases range from semantic image segmentation, object detection to more common problems found in computer vision such as object identification. Earth Observation is an excellent source for different types of problems and data for Machine Learning in general and Deep Learning in particular. It can be argued that both Earth Observation and Deep Learning as fields of research will benefit greatly from this recent trend of research. In this paper we take several state of the art Deep Learning network topologies and provide a detailed analysis of their performance for semantic image segmentation for building footprint detection. The dataset used is comprised of high resolution images depicting urban scenes. We focused on single model performance on simple RGB images. In most situations several methods have been applied to increase the accuracy of prediction when using deep learning such as ensembling, alternating between optimisers during training and using pretrained weights to bootstrap new models. These methods although effective, are not indicative of single model performance. Instead, in this paper, we present different topology variations of these state of the art topologies and study how these variations effect both training convergence and out of sample, single model, performance.

With the development of data science, more and more machine learning technologies have been designed to solve complicated and challenging real-world tasks containing a large volume of data. And many significant real-world datasets contain data in the form of networks or graphs. Graph Neural Networks is one of the powerful machine learning tools, which could provide a perfect solution to processing a large amount of non-Euclidean data. And because most bio information data in bioinformatics is in the non-Euclidean domain, Graph Neural Networks could then directly be applied to solve problems in bioinformatics. Much research has been done in the field of GNN, and there are also some surveys related to GNN and its applications. However, there has been little research focusing on GNN in bioinformatics, and we think in the future we could better utilize GNN in the field of biology, so we would like to write a literature review to help take a comprehensive look at GNN and their applications in the field of bioinformatics. In this paper, we would first introduce SOTA models in Graph Neural Networks, and second, introduce their applications in bio information. And then we would provide future directions of Graph Neural Networks in bioinformatics.

We propose a model for bacterial Quorum Sensing based on an auxiliary electrostatic-like interaction originating from a fictitious electrical charge that represents bacteria activity. A cooperative mechanism for charge/activity exchange is introduced to implement chemotaxis and replication. The bacteria system is thus represented by means of a complex resistor network where link resistances take into account the allowed activity-flow among individuals. By explicit spatial stochastic simulations, we show that the model exhibits different quasi-realistic behaviors from colony formation to biofilm aggregation. The electrical signal associated with Quorum Sensing is analyzed in space and time and provides useful information about the colony dynamics. In particular, we analyze the transition between the planktonic and the colony phases as the intensity of Quorum Sensing is varied.

Water distribution networks are vital infrastructure, needed for providing consumers with sufficient water of appropriate quality. The cost of construction, operation, and maintenance of such networks is extremely large. The problem of optimization of a water distribution network is governed by the type of water distribution network and the size of pipelines placed in the distribution network. This problem of the optimal diameter allocation of pipes in a distribution network has been heavily researched over the past few decades. This study describes the development of a computer program, ‘Smart Optimization Program for Water Distribution Networks’ (SOP–WDN), which applies Genetic Algorithm to the problem of the least-cost design of water distribution networks. SOP–WDN demonstrates the application of an evolutionary optimization technique, Genetic Algorithm, linked with a hydraulic simulation solver EPANET, for the optimal design of water distribution networks. The developed program was applied to three benchmark water distribution network optimization problems and produced consistently good results. SOP–WDN can be utilized as a tool for guiding engineers during the design and rehabilitation of water distribution pipelines.

Cognitive networks have evolved to cope with uncertain environments in order to make reliable decisions. Such decision making circuits need to respond to the external world in efficient and flexible ways, and one potentially general mechanism of achieving this is grounded in critical states. Mounting evidence has shown that brains operate close to such critical boundaries consistent with self-organized criticality (SOC). Is this also taking place in small-scale living systems, such as cells? Here we explore a recent model of engineered gene networks that have been shown to exploit the feedback between order and control parameters (as defined by expression levels of two coupled genes) to achieve a SOC state. We suggest that such SOC motif could be exploited to generate adaptive behavioral patterns and might help design fast responses in synthetic cellular and multicellular organisms.

Over the past decade, recognition of human activities (HAR) has become a vibrant field of research, in particular, the spread in our everyday lives of electronics such as mobile phones, smart cell phones, and video cameras. Furthermore, the advancement in the field of deep methodologies and other paradigms have enabled scientists to enable HAR in many areas, consisting of activities in fitness and wellness. For instance, HAR is one of many resorts to support older people through day-to-day activities to support their cognition and physicality. This study is centered on the key aspects deep learning plays in the development of HAR applications. Although numerous HAR examination studies were carried out previously, there have been no overall studies on this subject, in all the earlier studies there were only specific HAR-related subjects. A detailed review covering all the main subjects in this area is therefore essential. This study discusses the latest developments and works in HAR. It separates the methods and the advantages and disadvantages of each method group. This paper finally addresses many problems in the current HAR subject and provides recommendations for potential study.

Neural networks present the characteristics that the results are strongly dependent on the training data, the weight initialisation, and the hyper-parameters chosen. The determination of the distribution of a statistical estimator, as the Mean Squared Error (MSE) or the accuracy, is fundamental to evaluate the performance of a neural network model (NNM). For many machine learning models, as linear regression, it is possible to analytically obtain information as variance or confidence intervals on the results. Neural networks present the difficulty of being not analytically tractable due to their complexity. Therefore, it is impossible to easily estimate distributions of statistical estimators. When estimating the global performance of an NNM by estimating the MSE in a regression problem, for example, it is important to know the variance of the MSE. Bootstrap is one of the most important resampling techniques to estimate averages and variances, between other properties, of statistical estimators. In this tutorial, the application of two resampling (including bootstrap) techniques to the evaluation of neural networks’ performance is explained from both a theoretical and practical point of view. Pseudo-code of the algorithms is provided to facilitate their implementation. Computational aspects, as the training time, are discussed since resampling techniques always require to run simulations many thousands of times and, therefore, are computationally intensive. A specific version of the bootstrap algorithm is presented that allows the estimation of the distribution of a statistical estimator when dealing with an NNM in a computationally effective way. Finally, algorithms are compared on synthetically generated data to demonstrate their performance.

What is a complex system? The definition of a complex system remains somewhat ambiguous. A complex system can be defined as a system consisting of many interacting parts exhibiting emergent behaviors. The emerging field of complexity science entails a change in the language of scientific research and thinking. As such, the general properties, tools and definitions pertaining to complex systems must be made accessible to multi-disciplinary systems scientists and thinkers. With this intention, this literary survey presents the development and glossary of essential concepts steering complex systems.

Over the years, various models have been developed in the stages of the mining process that have allowed predicting and enhancing results, but it is the breakage the variable that connects all the activities of the mining process from the point of view of costs (drilling, blasting, loading, hauling, crushing and grinding). To improve this process, we come up with an idea to develop a breakage prediction model; on the basis of the main variables involved in the drilling and blasting process. For this purpose, we design a computer model based on an Artificial Neuronal Networks (ANN), built by using the most representative variables that come into play with drilling and blasting, such as: the properties of the explosives, the geomechanical parameters of the rock mass, and the design parameters of drilling-blasting. For its experimentation and validation, we have taken the data from a copper mine as reference located in the north of Chile, because of we have the dataset of that ore deposit, which is valid and reliable to evaluate prediction problems based on ANN applied to copper mines. The ANN architecture was of the supervised type, feedforward, with 3 layers and 13 neurons in the only hidden layer, trained with the input data using a dataset with the previously mentioned variables, which then were compared with the breakage results. The model was feed backed in its learning process until it becomes perfected, and is a prediction option that can be used in future blasting of ore deposits with similar characteristics using the same representative variables. Therefore, this is a valid alternative for predicting rock breakage, given that it has been experimentally validated, and has achieved moderately reliable results, providing higher correlation coefficients than traditional models, and with the additional advantage that an ANN model provides, due to its ability to learn and recognize compiled dataset patterns. In this way, using this computer model we can obtain satisfactory results that allow us to predict breakage, providing an alternative for evaluating the costs that this entails.

The paper concludes the first research on mouth-based Emotion Recognition (ER), adopting a Transfer Learning (TL) approach. Transfer Learning results paramount for mouth-based emotion ER, because a few data sets are available, and most of them include emotional expressions simulated by actors, instead of adopting a real-world categorization. Using TL we can use fewer training data than training a whole network from scratch, thus more efficiently fine-tuning the network with emotional data and improving the convolutional neural network accuracy in the desired domain. The proposed approach aims at improving the Emotion Recognition dynamically, taking into account not only new scenarios but also modified situations with respect to the initial training phase, because the image of the mouth can be available even when the whole face is visible only in an unfavourable perspective. Typical applications include automated supervision of bedridden critical patients in an healthcare management environment, or portable applications supporting disabled users having difficulties in seeing or recognizing facial emotions. This work takes advantage from previous preliminary works on mouth-based emotion recognition using CNN deep-learning, and has the further benefit of testing and comparing a set of networks on large data sets for face-based emotion recognition well known in literature. The final result is not directly comparable with works on full-face ER, but valorizes the significance of mouth in emotion recognition, obtaining consistent performances on the visual emotion recognition domain.

Standard Ethernet (IEEE 802.3 and the TCP/IP protocol suite) is gradually applied in industrial control system (ICS) with the development of information technology. It breaks the natural isolation of ICS, but contains no security mechanism. A modified intrusion detection system (IDS), which is strongly correlated to specific industrial scenario, is necessary for modern ICS. On the one hand, this paper outlines attack models, including infiltration attacks and our creative forging attack. On the other hand, we proposes a hierarchical IDS, which contains a traffic prediction model and an anomaly detection model. The traffic prediction model, which is based on autoregressive integrated moving average (ARIMA), can forecast the traffic of ICS network in the short term and precisely detect the infiltration attacks according to abnormal changes in traffic pattern. The anomaly detection model using one-class support vector machine (OCSVM) is able to detect malicious control instructions by analyzing the key field in EtherNet/IP packets. The experimental results show that the hierarchical IDS has an outstanding performance in detecting infiltration attacks and forging attack compared with other two innovative IDSs.

This paper presents a study and implementation of a convolutional neural network to identify and recognize humpback whale specimens from the unique patterns of their tails. Starting from a dataset composed of images of whale tails, all the phases of the process of creation and training of a neural network are detailed – from the analysis and pre-processing of images to the elaboration of predictions, using TensorFlow and Keras frameworks. Other possible alternatives are also explained when it comes to tackling this problem and the complications that have arisen during the process of developing this paper.

In recent years, increasing attention has been paid to individuals organizing themselves and managing food systems in an ‘alternative’ and more sustainable way. Such emerging food initiatives are most commonly known as ‘Alternative Food Networks’ (AFNs). However, there is an ongoing debate concerning the extent to which AFNs facilitate social, economic and environmental change. There are criticisms of the overall sustainability promise of AFNs related to sufficiency of impact, possible counter effects and relevance of impacts. Because often empirical studies only focus on specific sustainability issues or AFNs, it has been difficult to develop more robust theories about the relations between diverse AFNs arrangements and sustainability. Thus, the aim of this paper is to contribute towards reducing this knowledge gap through a systematic literature review on AFNs in relation to sustainability. We summarize main methodological approaches, types of AFNs studied and sustainability dimensions addressed in literature to date. Findings serve as reference to propose opportunities for future research regarding sustainability in AFNs.

A major goal of neuroscience is understanding how neurons arrange themselves into neural networks that result in behavior. Most theoretical and experimental efforts have focused on a top-down approach which seeks to identify neuronal correlates of behaviors. This has been accomplished by effectively mapping specific behaviors to distinct neural patterns, or by creating computational models that produce a desired behavioral outcome. Nonetheless, these approaches have only implicitly considered the fact that neural tissue, like any other physical system, is subjected to several restrictions and boundaries of operations.Here, we propose a new, bottom-up conceptual paradigm: The Energy Homeostasis Principle, where the balance between energy income, expenditure, and availability are the key parameters in determining the dynamics of the found neuronal phenomena from molecular to behavioral levels. Neurons display high energy consumption relative to other cells, with metabolic consumption of the brain representing 20% of the whole-body oxygen uptake, contrasting with this organ representing only 2% of the body weight. Also, neurons have specialized surrounding tissue providing the necessary energy which, in the case of the brain, is provided by astrocytes. Moreover, and unlike other cell types with high energy demands such as muscle cells, neurons have strict aerobic metabolism. These facts indicate that neurons are highly sensitive to energy limitations, with Gibb’s free energy dictating the direction of all cellular metabolic processes. From this activity, the largest energy, by far, is expended by action potentials and post-synaptic potentials; therefore, plasticity can be reinterpreted in terms of their energy context. Consequently, neurons, through their synapses, impose energy demands over post-synaptic neurons in a close loop-manner, modulating the dynamics of local circuits. Subsequently, the energy dynamics end up impacting the homeostatic mechanisms of neuronal networks. Furthermore, local energy management also emerges as a neural population property, where most of the energy expenses are triggered by sensory or other modulatory inputs. Local energy management in neurons may be sufficient to explain the emergence of behavior, enabling the assessment of which properties arise in neural circuits and how. Essentially, the proposal of the Energy Homeostasis Principle is also readily testable for simple neuronal networks.

The human microbiome is an extremely complex ecosystem considering the amount of bacterial species, their interactions, and its variability over time. Here we untangle the complexity of the human microbiome for the Irritable Bowel Syndrome (IBS) that is the most prevalent functional gastrointestinal disorder in human populations. Based on a novel information theoretic network inference model we detect species interaction networks that are functionally and structurally different for healthy and unhealthy individuals. Healthy networks are characterized by a neutral symmetrical pattern of species interactions and scale-free topology versus random unhealthy networks. We detect an inverse scaling relationship between species total outgoing information flow, meaningful of node interactivity, and relative species abundance (RSA). The top ten interacting species are also the least relatively abundant for the healthy microbiome and the most detrimental. These findings support the idea about the diminishing role of network hubs and hubs should be defined considering the total outgoing information flow rather than the node degree. Macroecologically, the healthy microbiome is characterized by the highest total species diversity growth rate, the lowest species turnover, and the smallest variability of RSA for all species. This result challenges current views that posit a universal association between healthy states and the highest absolute species diversity in ecosystems. Additionally, we show how the transitory microbiome is unstable and microbiome criticality is not at the phase transition between healthy and unhealthy states. We stress out the importance of considering interacting pairs versus single node dynamics when characterizing the microbiome and of ranking these pairs in terms of their dynamics. Interactions (i.e. species collective behavior) shape transition from healthy to unhealthy states.\\ The macroecological characterization of the microbiome is useful for diagnostic purposes and disease etiognosis, while species-specific analyses can detect species that are more beneficial leading to personalized design of pre- and pro-biotic treatments and microbiome engineering.

It is a challenging issue to provide a secure and conditional anonymous authentication scheme in vehicle ad hoc networks(VANETs) with low storage space and computational cost. In 2008, Lu et al. [8] proposed an conditional privacy preservation scheme called ECPP protocol. The ECPP protocol provides conditional privacy preservation to vehicles in VANETs, that is, on one hand vehicles can achieve anonymous authentication in the network, on the other hand allow to be traced and revoked if necessary. However, ECPP scheme suffers from large storage and high computational cost. In our scheme, an improved protocol based on the concept of ECPP protocol has been proposed, which uses minimal interaction steps, little storage space and less computation overhead to achieve more efficiency conditional privacy preservation(MECPP) scheme in VANETs.

We present a new method of estimating fitness of countries and complexity of products by exploiting a non-linear non-homogeneous map applied to the publicly available information on the goods exported by a country. The non homogeneous terms guarantee both convergence and stability. After a suitable rescaling of the relevant quantities, the non homogeneous terms are eventually set to zero so that this new method is parameter free. This new map reproduces the findings of the method proposed by Tacchella et al. [1], and allows for an approximate analytic solution in case of actual binarized matrices based on the Revealed Comparative Advantage (RCA) indicator. This solution is connected with a new quantity describing the neighborhood of nodes in bipartite graphs, representing in this work the relations between countries and exported products. Moreover, we define the new indicator of country net-efficiency quantifying how a country efficiently invests in capabilities able to generate innovative complex high quality products. Eventually, we demonstrate analytically the local convergence of the algorithm.

Forming a clustered network structure has been proposed as a solution to increase network performance, scalability, stability and manageability in an ad hoc network. A good clustering algorithm aims to select cluster heads among available nodes so that a number of specific constraints are satisfied; thus the cluster head selection problem is a multiobjective optimization problem. This paper proposes an algorithm on the basis of ant colony optimization (ACO) to be used to solve this problem. The proposed algorithm is a simple, one hop cluster formation algorithm, to form a clustered structure with the minimum number of clusters. The centralized ACO-based clustering algorithm is evaluated and compared with other clustering algorithms in ad hoc networks in terms of cluster density.

Accent is on determination of appropriate friction factor of the pipes and on selection of the representative equation for water or natural gas flow which is valuable for existing conditions in the looped network of pipelines. Note that in a municipal gas pipeline, natural gas can be treated as incompressible fluid (liquid) i.e. as water or oil. Even under this circumstance, calculation of water pipelines cannot be literary copied and applied for calculation of gas pipelines. Inappropriate friction factor, equally as e.g. inappropriate usage of water flow equations for calculation of gas networks can lead to inaccurate final results. Few iterative methods for determining the optimal hydraulic solution of water- and gas- looped pipeline networks, such as, Hardy Cross, modified Hardy Cross, node-loop method, node and M.M. Andrijashev method, will be shown. Speed of convergence will be compared and discussed using a simple network with three loops.

Biofilms are congregations of bacteria on a surface, and they grow into obstacles for the functionalities of any device or machinery involves anything biological. Biofilms are developed through a biochemical system known as ‘Quorum Sensing’ that accounts for the chemical signaling that direct either biofilm formation or inhibition. Computational models that relate chemical and structural features of compounds to their performance properties have been used to aide in the discovery of active small molecules for many decades. These quantitative structure-activity relationship (QSAR) models are also important for predicting the activity of molecules that can have a range of effectiveness in biological systems. This study uses QSAR methodologies combined with and different machine learning algorithms to predict and assess the performance of several different compounds acting in Quorum Sensing. Through computational probing of the quorum sensing molecular interaction, new design rules can be elucidated for countering biofilms.

In the rapidly evolving field of real estate economics, the prediction of house prices continues to be a complex challenge, intricately tied to a multitude of socio-economic factors. However, traditional predictive models have often overlooked the spatial interdependencies that play a vital role in shaping housing prices. This study applies Graph Neural Networks (GNNs) on Open Statistics Knowledge Graphs to model spatial dependencies and predict house prices across Scotland’s 2011 data zones. To this end, integrated statistical indicators are retrieved from the official Scottish Open Government Data portal. The three representative GNN algorithms employed - ChebNet, GCN, and GraphSAGE - demonstrate higher prediction accuracy than traditional models, including the tabular-based XGBoost and a simple Multi-Layer Perceptron (MLP). In addition, local and global explainability are employed to increase transparency and trust in the predictions made by the most accurate GNN - GraphSAGE. The global feature importance is determined by a logistic regression surrogate model while the local, region-level understanding of the GNN predictions is achieved through the use of GNNExplainer. Explainaibility results are compared with those from a previous work that applied the XGBoost machine learning algorithm and the SHapley Additive exPlanations (SHAP) explainability framework on the same dataset. Interestingly, both global surrogate model and the SHAP approach underscored the Comparative Illness Factor, a health indicator, and the ratio of detached dwellings as the most crucial features in the global explainability. In the case of local explanations, while both methods showed similar results, the GNN approach provided a richer, more comprehensive understanding of the predictions for two specific data zones.

The opinion dynamics literature argues that the way people perceive social influence depends not only on the opinions of interacting individuals, but also on the individuals’ non-opinion characteristics, such as age, education, gender, or place of residence. The current paper advances this line of research by studying longitudinal data that describe the opinion dynamics of a large sample (~30,000) of online social network users, all citizens of one city. Using these data, we systematically investigate the effects of users’ demographic (age, gender) and structural (degree centrality, the number of common friends) properties on opinion formation processes. We revealed that females are less easily influenced than males. Next, we found that individuals that are characterized by similar ages have more chances to reach a consensus. Besides, we report that individuals who have many common peers find an agreement more often. We also demonstrated that the impacts of these effects are virtually the same, and despite being statistically significant, are far less strong than that of opinion-related features: knowing the current opinion of an individual and, what is even more important, the distance in opinions between this individual and the person that attempts to influence the individual is much more valuable. Next, after conducting a series of simulations with an agent-based model, we revealed that accounting for non-opinion characteristics may lead to not very sound but statistically significant changes in the macroscopic predictions of the populations of opinion camps, primarily among the agents with radical opinions (≈ 3% of all votes). In turn, predictions for the populations of neutral individuals are virtually the same. Besides, we demonstrated that the accumulative effect of non-opinion features on opinion dynamics is seriously moderated by whether the underlying social network correlates with the agents’ characteristics. After applying the procedure of random shuffling (in which the agents and their characteristics were randomly scattered over the network), the macroscopic predictions have changed by ≈ 9% of all votes. What is interesting, the population of neutral agents was again not affected by this intervention.

Multilabel learning goes beyond standard supervised learning models by associating a sample with more than one class label. Among the many techniques developed in the last decade to handle multilabel learning best approaches are those harnessing the power of ensembles and deep learners. This work proposes merging both methods by combining a set of gated recurrent units, temporal convolutional neural networks, and long short-term memory networks trained with variants of the Adam optimization approach. We examine many Adam variants, each fundamentally based on the difference between present and past gradients, with step size adjusted for each parameter. We also combine Incorporating Multiple Clustering Centers and a bootstrap-aggregated decision trees ensemble, which is shown to further boost classification performance. In addition, we provide an ablation study for assessing the performance improvement that each module of our ensemble produces. Multiple experiments on a large set of datasets representing a wide variety of multilabel tasks demonstrate the robustness of our best ensemble, which is shown to outperform the state-of-the-art. The MATLAB code for generating the best ensembles in the experimental section will be made available at https://github.com/LorisNanni.

Convolutional Neural Networks combined with autonomous drones are increasingly seen as enablers of partially automating the aircraft maintenance visual inspection process. Such an innovative concept can have a significant impact on aircraft operations. Through supporting aircraft maintenance engineers detect and classify a wide range of defects, the time spent on inspection can significantly be reduced. Examples of defects that can be automatically detected include aircraft dents, paint defects, cracks and holes, and lightning strike damage. Additionally, this concept could also increase the accuracy of damage detection and reduce the number of aircraft inspection incidents related to human factors like fatigue and time pressure. In our previous work, we have applied a recent Convolutional Neural Network architecture known by MASK R-CNN to detect aircraft dents. MASK-RCNN was chosen because it enables the detection of multiple objects in an image while simultaneously generating a segmentation mask for each instance. The previously obtained F1 and F2 scores were 62.67% and 59.35% respectively. This paper extends the previous work by applying different techniques to improve and evaluate prediction performance experimentally. The approaches uses include (1) Balancing the original dataset by adding images without dents; (2) Increasing data homogeneity by focusing on wing images only; (3) Exploring the potential of three augmentation techniques in improving model performance namely flipping, rotating, and blurring; and (4) using a pre-classifier in combination with MASK R-CNN. The results show that a hybrid approache combining MASK R-CNN and augmentation techniques leads to an improved performance with an F1 score of (67.50%) and F2 score of (66.37%)

In this article, we investigate limitations of importing methods based on algorithmic information theory from monoplex networks into multidimensional networks (such as multilayer networks) that have a large number of extra dimensions (i.e., aspects). In the worst-case scenario, it has been previously shown that node-aligned multidimensional networks with non-uniform multidimensional spaces can display exponentially larger algorithmic information (or lossless compressibility) distortions with respect to their isomorphic monoplex networks, so that these distortions grow at least linearly with the number of extra dimensions. In the present article, we demonstrate that node-unaligned multidimensional networks, either with uniform or non-uniform multidimensional spaces, can also display exponentially larger algorithmic information distortions with respect to their isomorphic monoplex networks. However, unlike the node-aligned non-uniform case studied in previous work, these distortions in the node-unaligned case grow at least exponentially with the number of extra dimensions. On the other hand, for node-aligned multidimensional networks with uniform multidimensional spaces, we demonstrate that any distortion can only grow up to a logarithmic order of the number of extra dimensions. Thus, these results establish that isomorphisms between finite multidimensional networks and finite monoplex networks do not preserve algorithmic information in general and highlight that the algorithmic information of the multidimensional space itself needs to be taken into account in multidimensional network complexity analysis.

This research delves into the realm of predictive modeling within artificial intelligence (AI) and introduces an innovative ensemble approach designed to enhance prognostic precision. The proposed methodology, characterized by its ebullient nature, leverages the collective wisdom of diverse predictive models, synthesizing a comprehensive and robust framework. The pursuit of parsimony are paramount, underscoring the need for efficient model architectures that balance predictive acuracy and computational efficiency. Our study meticulously explores the amalgamation of diverse algorithms, encapsulating the intrinsic complexity of real-world phenomena. We navigate the intricate landscape of feature selection, algorithmic diversity, and model combination, fostering a holistic understanding of the prognostic process. The ebullient ensemble emerges as a dynamic solution, harnessing the synergy of constituent models while mitigating the risk of overfitting. To validate the efficacy of our approach, extensive experiments are conducted on diverse datasets, spanning domains such as healthcare, finance, and natural language processing. Comparative analyses demonstrate the superior predictive performance of our ensemble model in comparison to individual algorithms and traditional ensemble methods. Additionally, we delve into interpretability aspects, elucidating the underlying mechanisms that contribute to the model's prognostic prowess. Our research advances the frontier of predictive modeling in AI, offering a nuanced and sophisticated paradigm for prognostication. The ebullient ensemble approach stands as a testament to the synergy achievable through the amalgamation of diverse predictive models, providing a pragmatic and parsimonious avenue for enhanced prognostic acuracy in artificial intelligence applications.

Deep learning (DL) algorithms have recently emerged from machine learning and soft computing techniques. Since then, several deep learning (DL) algorithms have been recently introduced to scientific communities and are applied in various application domains. Today the usage of DL has become essential due to their intelligence, efficient learning, accuracy and robustness in model building. However, in the scientific literature, a comprehensive list of DL algorithms has not been introduced yet. This paper provides a list of the most popular DL algorithms, along with their applications domains.

Weight thresholding (WT) is a method intended to decrease the number of links within weighted networks that may otherwise be excessively dense for network science applications. WT aims to remove links to simplify the networks by holding most of the features of the original network. Here, we test the robustness and the efficacy of the node attack strategies on real-world networks subjected to WT that remove links of higher weight (strong links). We measure the network robustness along node removal with the largest connected component (LCC). We find that the real-world networks under study are generally stable in terms of robustness when subjected to WT. Nonetheless, WT by strong link removal changes the efficacy of the attack strategies and the rank of node centralities. Also, WT by strong link removal may trigger a greater change in node centrality rank than WT by removing weak links. Network science research finding important/influential nodes in the network has to consider that simplifying the network with WT methodologies may change the node centrality.

Radial basis function (RBF) networks are often viewed as instable when used in multi-layered architectures and therefore are mostly used in a single-layered manner. Universal approximation theorems for single-layered RBF networks further render deeper architectures useless. However, deep neural networks have proven their effectiveness on many different tasks. We show that deeper RBF architectures with multiple radial basis function layers are achievable and able to learn. We introduce an initialization scheme for deep RBF networks based on k-means clustering and covariance estimation. We further show how to make use of convolutions to speed up the calculation of a Mahalanobis distance in a partially-connected fashion, similar to convolutional neural networks (CNNs). Finally, we evaluate our approach on image classification as well as speech emotion recognition tasks. Our results show that deep RBF networks perform similar to simple CNNs.

This review underscores the critical significance of incorporating network perspectives in epidemiology. Classic compartmental models (CM) employed to describe epidemic spreading often fail to capture the intricacies of real disease dynamics. Rooted in the mean-field assumption, CM models oversimplify by assuming that every individual has the potential to "infect" any other, neglecting the inherent complexity of underlying network structures. Given that social interactions follow a networked pattern with specific links between individuals based on social behaviors, the amalgamation of classic CM and network science in epidemiology becomes essential for a more authentic portrayal of epidemic spreading. This review delves into noteworthy research studies that, from various perspectives, elucidate how the synergy between networks and CM can enhance the accuracy of epidemic descriptions. In conclusion, we explore research prospects aimed at further elevating the integration of networks within the realm of epidemiology, recognizing its pivotal role in refining our understanding of disease dynamics.

The article presents the operation of the automatic pine sawn timber inspection system, which was developed at the Woodinspector company and offered commercially. The vision inspection system is used to detect various wood defects, including knots, blue stain, and mechanical damage caused by worms. Blue stain is a defect that is difficult to detect based on the color of the wood, because it can be easily confused with wood defects or dirt that do not impair its strength properties. In particular, the issues of detecting blue stain in wood, the use of artificial neural networks and improving the operation of the system in production conditions were discussed.

Vehicular traffic in urban areas continues to be a constant challenge today, due to the continuous population growth and the increase of vehicles in circulation. Vehicular congestion, as a recurrent problem, generates a negative impact on urban mobility and citizens’ quality of life. It is hypothesized that a dynamic clustering method of vehicle trajectory data can provide an accurate and up-to-date representation of real-time traffic behavior. To evaluate this hypothesis, data were collected from three different cities: San Francisco, Rome and Guayaquil. A dynamic clustering algorithm was applied to identify traffic congestion patterns and an indicator was applied to identify and evaluate the congestion conditions of the areas. The results show a high precision and recall in congestion classification compared to a method based on static cells.

For years, effort has been devoted to establishing an effective bull breeding soundness evaluation procedure; usual research on the subject is based on BBSE (Bull Breeding Soundness Examination) methodologies, which have significant limitations in terms of their evaluation procedure, such as high cost, time-consuming and administratively difficult. This research focuses on the creation of a prediction model to supplement and/or improve the BBSE approach, through the study of two algorithms, Clustering and Artificial Neural Network (ANN), to find the optimum Machine Learning (ML) approach for our application, with an emphasis on data categorization accuracy. The tool is designed to assist veterinary medicine and farmers in identifying key factors and increasing certainty in their decision-making during the selection of bulls for breeding purposes, providing data from a limited number of factors generated from a deep pairing study of bulls. Zebu Bulls, European Bulls, and Crossbred Bulls were the general groupings. The data utilized in the model's creation (N =359) considers five variables that influence improvement decisions. This approach enhances decision-making by 12%. ANN obtained an accuracy of 90%; Precision was 97% for satisfying, 92% for unsatisfying, and 85% for Bad.

The 5G technology brings many benefits already known: large connection capacity, great transmission velocities, and low latencies with high reliability. One of its core services, the massive Machine Type Communication (mMTC), theoretically allows up to one million devices connected simultaneously in a square kilometer. As the Internet of Things (IoT) devices often have very restricted resources, hampering the adoption of robust security mechanisms, they can be targets for attackers aiming to explore vulnerabilities and gain access to the 5G infrastructure. Given this concern, it is essential to know existent vulnerabilities and possible threats and solutions related to 5G-IoT, the scenarios considering IoT devices connected to 5G infrastructures. For this reason, we carried out a systematic literature review, extracting and analyzing data from 142 selected papers from conferences and journals. As the main results, we present lists with known vulnerabilities, possible threats and solutions, and some recommendations.

This paper deals with the analysis of the cognitive functions of the cerebral cortex or cortex in the evolutionary context. The triune brain model is presented given its notorious popularity in fields that are not strictly neuroscientific, and its limitations and inaccuracies are also shown. Although it is an outdated theory, this one represented the passage to a new era, because it really was the model of the movement towards understanding the brain in evolutionary terms. Next, the paper illustrates the different areas of the cortex and their functions, as well as the evolution of the brain and the cortex in vertebrates. To date, the expansion of the cortex with the amniotes was placed 300 million years ago, although recent studies place it in the lampreys more than 500 million years ago. Evolutionary changes in mammalian brain and cortex size are discussed, showing the evolution from three to six cell layers and trends in different groups of mammals. Finally, the most recent contributions in the field of research are illustrated, such as the role of neurogenesis and the evolution of the connectivity of the cortex.

Image denoising has been one of the important problems in the field of computer vision, and it has a wide range of practical value in many applications, such as medical image processing, image enhancement, and computational photography. Traditional image denoising methods are usually based on hand-designed features and filters, but these methods perform poorly under complex noise and image structures. In recent years, the rapid development of neural network technology has revolutionized the image-denoising task. This paper introduces the knowledge about neural networks and image denoising, explores the impact of neural networks on image denoising, and how is it possible to denoise images by neural networks. It also summarises other image-denoising methods and finally points out the challenges and problems faced by image-denoising at present. Some possible new development directions are proposed to provide new solutions for image-denoising researchers and to promote the development of the field.

Approximately 6 million youth aged 12 to 20 consume alcohol monthly in the United States. The effect of alcohol consumption in adolescence on behavior and cognition is heavily researched, however, little is known about how alcohol consumption in adolescence may alter brain function, leading to long-term developmental detriments. In order to investigate differences in brain connectivity associated with alcohol use in adolescents, brain networks were constructed using resting state functional magnetic resonance imaging data collected by the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) from 698 youth (12-21 years, 117 hazardous drinkers and 581 no/low drinkers). Analyses assessed differences in brain network topology based on alcohol consumption in eight pre-defined brain networks, as well as in whole-brain connectivity. Within the central executive network (CEN), basal ganglia network (BGN), and sensorimotor network (SMN), no/low drinkers demonstrated stronger and more frequent connections between highly globally efficient nodes, with fewer and weaker connections between highly clustered nodes. Inverse results were observed within the dorsal attention network (DAN), visual network (VN), and frontotemporal network (FTN), with no/low drinkers demonstrating weaker connections between nodes with high efficiency and increased frequency of clustered nodes compared to hazardous drinkers. Results from this study show clear organizational differences between adolescents with no/low or hazardous alcohol use, suggesting that aberrant connectivity in these brain networks is associated with risky drinking behaviors.

RBF networks are used in a variety of real-world applications such as medical data or signal processing problems. The success of these parametric models lies in the successful adaptation of their parameters using efficient computational techniques. In the current work, a method of adjusting the parameters of these networks using Grammatical Evolution is presented. Grammatical Evolution will be used to successfully discover the most promising range of parameter values and then the training of the parameter set will be achieved using a Genetic Algorithm. The new method was applied to a wide range of data fitting and classification problems, and the results were more than promising.

Snow parameters have traditionally been retrieved using discontinuous, multi-band sensors; however, continuous hyperspectral sensor are now being developed as an alternative. In this paper we investigate the performance of various sensor configurations using machine learning neural networks trained on a simulated dataset. Our results show improvements in accuracy of retrievals of snow grain size and impurity concentration for continuous hyperspectral channel configurations. Retrieval accuracy of snow albedo was found to be similar for all channel configurations.

This article introduces a new fractional approach to the concept of information dimension of complex networks, based on a (q,q′)-entropy proposed in the literature. The q parameter measures how far is the number of subsystems (for a given size ε) from the mean number of overall sizes. The q′ (interaction index) measures when the interactions between subsystems are greater (q′>1), lesser (q′<1) or equal to the interactions into these subsystems. The computations of the proposed information dimension are carried out on several real-world and synthetic complex networks. The results from the proposed information dimension are compared with those from the information dimension based on the Shannon entropy.

Tracking temperature changes in certain geographic regions is a current task in modern research on Earth's climate changes. One of the global problems in solving this task is related to the large volume of measured data and the search for appropriate methods for effective determination of changes. The purpose of this research is to track climate temperature changes using a machine learning-based automated change detection method. The presented method includes training of a two-level structure of neural networks, with measured temperatures for a ten-year period of time for a certain geographical region. In the testing phase, the neural structure classifies measured temperatures for two three-year periods, before and after the ten-year time period, respectively, for the same geographic region. An algorithm was developed to visualize the studied regions by creating a map with their geographic coordinates. The classification results in the neural structure outputs are presented and analyzed as possible temperature changes. Suggestions for continuing and expanding the research in the future are discussed.

As a high-quality forestry product with excellent performance, particleboard is widely used in many fields and has great market potential. At present, it is a research difficulty to accurately identify small, fine and different shapes of defects on the whole particleboard through machine vision technology. The application of image super-resolution reconstruction technology on particleboard can improve the surface image quality of particleboard, which is conducive to the subsequent improvement of defect detection accuracy. In this study, super-resolution dense attention generative adversarial network (SRDAGAN) model was improved to solve the problem that super-resolution generative adversarial network (SRGAN) reconstructed image would produce artifacts and its performance needed to be improved. The Batch Normalization (BN) layer was removed, the convolutional block attention module (CBAM) was optimized to construct dense block, and the dense blocks were constructed by densely skip connection. Then, the corresponding 52400 image blocks with high resolution and low resolution were trained, verified and tested according to the ratio of 3:1:1. The model was comprehensively evaluated from the effect of image reconstruction and the two indexes of PSNR and SSIM. It was found that compared with BICUBIC and SRGAN, PSNR index of SRDAGAN increased by 4.88dB and 3.25dB respectively, and SSIM increased by 0.0507 and 0.1122 respectively. The reconstructed images not only had clearer texture, but also had more realistic expression of various features, and the performance of the model had been greatly improved. At the same time, this study also emphatically discussed on the image reconstruction effect with defects. The result showed that the SRDAGAN proposed in this study can complete the super-resolution reconstruction of particleboard images with high quality. In the future, it can also be further combined with defect detection for actual production to improve the quality of forestry products and increase economic benefits.

Retailers must have accurate sales forecasts to operate their businesses efficiently and effectively and to remain competitive in the marketplace. Global forecasting models like RNNs can be a powerful tool for forecasting in retail settings, where multiple time series are often interrelated and influenced by a variety of external factors. By including covariates in a forecasting model, we can better capture the various factors that can influence sales in a retail setting. This can help improve the accuracy of our forecasts and enable better decision-making for inventory management, purchasing, and other operational decisions. In this study we investigate how the accuracy of global forecasting models is affected by the inclusion of different potential demand covariates. To ensure the significance of the study's findings, we used the M5 forecasting competition's openly accessible and well-established dataset. The results obtained from the DeepAR models, which were trained on various combinations of features including time, price, events, and IDs, suggest that individually only the features corresponding to IDs improve the baseline model. However, when all the features are used together, the best performance is achieved, indicating that the individual relevance of each feature is emphasized when the information is given jointly. Comparing the model with features to the model without features, there is an improvement of 1.76\% for MRMSSE and 6.47\% for MMASE.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

Since the global request for freight transportation is continuously increasing to face the requirements of the modern economy, 5G infrastructures and companion technologies are becoming essential to support the digital transformation in logistics and transportation, in particular for their capability to allow data collection through a multitude of different sources across the supply chain, improving the connectivity and making more effective the secure and reliable data sharing. The objective of this work is to assess the penetration and implementation levels of innovative technologies to optimize port operations, by interviewing a set of actors and stakeholders directly involved in the logistics chain of ports.

The Attentional Networks Test for Interactions and Vigilance–executive and arousal components (ANTI-Vea) is a computerized task of 32 min duration in the standard format. The task simultaneously assesses the main effects and interactions of the three attentional networks (i.e., phasic alertness, orienting, and executive control) and two dissociated components of vigilance with reasonable reliability (executive and arousal vigilance). We present this free and publicly accessible resource (ANTI-Vea-UGR; https://anti-vea.ugr.es/) developed to easily run, collect, and analyze data with the ANTI-Vea (or its subtasks measuring some attentional and/or vigilance components embedded in the ANTI-Vea). Available in six different languages, the platform allows for adaptation of stimuli timing and procedure to facilitate data collection from different populations (e.g., clinical patients, children). Collected data can be freely downloaded and easily analyzed with the provided scripts and tools, including a Shiny app. We discuss previous evidence supporting that attention and vigilance components can be assessed in typical lab conditions as well as online and outside the laboratory. We hope this tutorial will help researchers interested in measuring attention and vigilance with a tool useful to collect data from large sample sizes and easy to use in applied contexts.

Object classification is a crucial task in deep learning, which involves the identification and categorization of objects in images or videos. Although humans can easily recognize common objects, such as cars, animals, or plants, performing this task on a large scale can be time-consuming and error-prone. Therefore, automating this process using neural networks can save time and effort while achieving higher accuracy. Our study focuses on the classification step of human chromosome karyotyping, an important medical procedure that helps diagnose genetic disorders. Traditionally, this task is performed manually by expert cytologists, which is a time-consuming process that requires specialized medical skills. Therefore, automating it through deep learning can be immensely useful. To accomplish this, we implemented and adapted existing preprocessing and data augmentation techniques to prepare the chromosome images for classification. We used ResNet-50 convolutional neural networks and an ensemble approach to classify the chromosomes, obtaining state-of-the-art performance in the tested dataset.

Pipe leakage is an inevitable phenomenon in water distribution networks (WDNs), leading to energy waste and economic damage. Leakage events can be reflected quickly by pressure values, and the deployment of pressure sensors is significant for minimizing the leakage ratio of WDNs. Concerning the restriction of realistic factors, including project budgets, available sensor installation locations, and sensor fault uncertainties, a practical methodology is proposed in this paper to optimize pressure sensor deployment for leak identification in terms of these realistic issues. Two indexes are identified to evaluate the leak identification ability, that is, detection coverage rate (DCR) and total detection sensitivity (TDS), and the principle is to determine priority to ensure an optimal DCR and retain the largest TDS with an identical DCR. Leakage events are generated by a model simulation and the essential sensors for maintaining the DCR are obtained by subtraction. In the event of a surplus budget, and if we suppose the partial sensors have failed, then we can determine the supplementary sensors that can best complement the lost leak identification ability. Moreover, a typical WDN Net3 is employed to show the specific progress, and the result shows that the methodology is largely appropriate for real projects.

As AI models become more and more common in business and even in our daily lives, it is important to understand what the carbon impact of these models is. Recent papers have shown that this impact can be quite great, i.e., the training of a single high-end model can result in emissions of more than 500t of CO2eq. In this paper we discuss the factors that influence the carbon footprint of AI models, explore what impact different decisions have, and show how the footprint can be reduced. We also examine the footprint of different models to give a guideline on how urgent action is for different organizations.

In this work a new hydroelectric basin modelling approach is described and applied to the Pontecosi basin, Italy. Several types of data sources were used to learn the model: a number of weather stations, satellite observations, Reanalysis dataset and basin data. With the goal of predicting the water level of the basin, the model was composed by three cascade modules. Firstly, different spatial interpolation methods, such as Kriging, Radial Basis Function and Natural Neighbours, were compared and applied to interpolate the weather stations data nearby the basin area to infer the main environmental variables (air temperature, air humidity, precipitation and wind speed) in the basin area. Then, using these variables as inputs, a neural network was trained to predict the mean soil moisture concentration over the area, also to improve the low availability due to satellite orbits. Finally, a non-linear auto regressive exogenous input (NARX) model was trained to simulate the basin level with different prediction horizons, using the data from the previous modules and past basin data (water level, discharge flow rate, turbine flow rate). Accurate predictions of the basin water level were achieved within 1 to 6 hours ahead, with mean absolute errors (MAE) between 2cm and 10cm respectively.

Soil working tools, implements, and machines are inevitable in mechanized agriculture. The soil-tool/machine interaction is a multivariate, dynamic, and intricate process. The accurate interpretation, description, and modeling of a soil-machine interaction is key to providing a solution to sustainable crop production by reducing energy input, excessive soil pulverization, and compaction. The traditional method provides insight into soil-machine interaction but often provides inadequate solutions and lacks broad applicability. Computational intelligence (CI) is a comprehensive class of approaches that rely on approximate information to solve complex problems. The CI method has been extensively studied and applied in soil tillage and traction domain in recent decades. The study critically reviews the CI techniques implemented in soil-machine interactions, especially in the context of tillage, traction, and compaction. The traditional methods and their limitation are discussed. The fundamental of CI methods and a detailed overview of the most popular methods are provided. The study reviews and summarizes the 50 selected articles on soil-machine interaction studies where CI methods were employed. It discusses the strength and limitations of employed CI methods. It also suggests the emergent CI methods and future applications are discussed. The outlined study would serve as a concise reference and a quick and systematic way to understand the applicable CI methods that allow crucial farm management decision-making.

Classical religious texts remain an essential part of human culture due to their undiminished influence on the advancement of civilization. Although their entirely divine origin is questioned repeatedly, explicit or implicit quoting and adherence to their basic guidelines are fundamental in modern society. In this respect, these documents’ inner structure and linguistic style appear to be pivotal. This paper considers the topic from the standpoint of small textual patterns classified using deep learning methods, traditionally applied to analyze short textual material like tweets. We divide the considered documents into small sequential chunks imitating tweets and categorizing them, classifying an entire text. The proposed method demonstrates that the religious text collections correspond to stable ”Twitter”-like structures that adequately reflect stylistic properties. So, concise word combinations seem to be an inborn textual attribute that adequately outlines the proposed multi-source authorship. This approach differs from traditional methods of analyzing classical religious documents, which are based on the consideration and interpretation of relatively long templates. The case study consists of three famous collections of Mosaic authorship in the Old Testament (Hebrew), Pauline authorship in the New Testament (Greek), and Al-Ghazali authorship (Arabic). The obtained results go well with most previously expressed evaluations and complement them with new implications, particularly in the authorship of two famous manuscripts attributed to Al-Ghazali.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

Segmentation is an important step in medical imaging. In particular, machine learning, especially deep learning, has been widely used to efficiently improve and speed up the segmentation process in clinical practice. Despite the acceptable segmentation results of multi-stage models, little attention was paid to the use of deep learning algorithms for brain image segmentation, which could be due to the lack of training data. Therefore, in this paper, we propose a Generative Adversarial Network (GAN) model that performs transfer learning to segment MRI brain images.Our model enables the generation of more labeled brain images from existing labeled and unlabeled images. Our segmentation targets brain tissue images, including white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We evaluate the performance of our GAN model using a commonly used evaluation metric, which is Dice Coefficient (DC). Our experimental results reveal that our proposed model significantly improves segmentation results compared to the standard GAN model. We observe that our model is 2.1–10.83 minutes faster than stat-of-the-art-models.

The Internet of Things (IoT) has become one of the most attractive domains nowadays. It works by creating a special network between physical devices such as vehicles, home equipment, and other items. In recent days, the common technologies of communication such as Wi-Fi and 2G/3G/4G cellular are insufficient for the IoT networks because they are designed to serve appliances with immense processing capabilities such as laptops and PCs. Moreover, most of these technologies are centralized and use an existing infrastructure. Currently, the new communication technologies such as Z-Wave, 6LowPAN, and Thread are dedicated to the IoT and have been developed to meet its requirements. These technologies can handle many factors such as range, data requirements, security, power demands, and battery life. Nevertheless, the security issues in IoT systems have major concerns and matters because vulnerabilities in such systems may result in fatal catastrophes. In this paper, an enhanced IoT security framework for authentication and authorization is proposed and implemented to protect the IoT protocols from different types of attacks such as man-in-the-middle attack, reply attack, and brute force attack. The proposed framework combines an enhanced token authentication that has identity verification capabilities and a new sender verification mechanism on the IoT device side based on time stamp, which in turn can mitigate the need for local identity verification methods in IoT devices. The proposed IoT security framework is tested using security analysis with different types of attacks compared with previous related frameworks. The analysis shows the high capability of the proposed framework to protect IoT networks against many types of attacks compared with current available security frameworks. Finally, the proposed framework is developed using Windows application to simulate the framework phases, check its validity through the real network, and calculate the payload time is adds.

The High-Resolution Computed Tomography (HRCT) detection and diagnosis of diffuse lung disease is primarily based on the recognition of a limited number of specific abnormal findings, pattern combinations or their distributions, as well as anamnesis and clinical information. Since texture recognition has a very high accuracy percentage if a complex network approach is used, this paper aims to implement such a technique customized for diffuse interstitial lung diseases (DILD). The proposed procedure translates HRCT lung imaging into complex networks by taking samples containing a secondary lobule, converting them into complex networks and analyzing them in 3 dimensions: emphysema, ground glass opacity and consolidation. This method was evaluated on a 60 patient lot and the results show a clear quantifiable difference between healthy and affected lungs. By deconstructing the image on three pathological axes, the method offers an objective way to quantify DILD details which, so far, have only been analyzed subjectively.

Optical neural networks (ONNs), or optical neuromorphic hardware accelerators, have the potential to dramatically enhance the computing power and energy efficiency of mainstream electronic processors, due to their ultra-large bandwidths of up to 10’s of terahertz together with their analog architecture that avoids the need for reading and writing data back-and-forth. Different multiplexing techniques have been demonstrated to demonstrate ONNs, amongst which wavelength-division multiplexing (WDM) techniques make sufficient use of the unique advantages of optics in terms of broad bandwidths. Here, we review recent advances in WDM-based ONNs, focusing on methods that use integrated microcombs to implement ONNs. We present results for human image processing using an optical convolution accelerator operating at 11 Tera operations per second. The open challenges and limitations of ONNs that need to be addressed for future applications are also discussed.

The potential of social networks for the circulation of disinformation as a strategy of diplomacy has been of great interest to the academic community, but the way in which it is propagated and modelled is still in its beginnings. This article aimed to simulate the propagation of disinformation in social networks derived from the diplomacy strategy, based on the elements of the system. For the design of the simulation model, system dynamics was used as the main technique in the research methodology in conjunction with statistical analysis. Five computational simulations were run for the adoption methods of susceptible and uninformed population, misinformation techniques and echo chamber. The developed model found that the diplomacy disinformation agent is able to spread its message efficiently through the bot outreach mechanism and only a part of the susceptible population unsubscribes to the disinformation agent's account. Significant differences were identified in the absence of paid outreach, bots and trolls in the propagation of information, and in the variation in the timing of disinformation propagation. Consequently, the developed model allows the understanding of the problem of disinformation as a strategy of diplomacy from international rather than local dynamics, as well as the effects of the use of each element in the system.

Wireless Sensor Networks (WSNs) continue to provide essential services for various applications such as surveillance, data gathering, and data transmission from the hazardous environments to safer destinations. This has been enhanced by the energy-efficient routing protocols that are mostly designed for such purposes. Gateway-based Energy-Aware Multi-hop Routing protocol (MGEAR) is one of the homogenous routing schemes that was recently designed to more efficiently reduce the energy consumption of distant nodes. However, it has been found that the protocol has a high energy consumption rate, lower stability period, less data transmission to the Base station (BS). In this paper, an enhanced Heterogeneous Gateway-based Energy-Aware multi-hop routing protocol ( HMGEAR) is proposed. The proposed routing scheme is based on the introduction of heterogeneous nodes in the existing scheme, selection of the head based on the residual energy, introduction of multi-hop communication strategy in all the regions of the network, and implementation of energy hole elimination technique. Results show that the proposed routing scheme outperforms two existing ones.

Thermal simulations are an important part in the design of electronic systems, especially as systems with high power density become common. In simulation-based design approaches, a considerable amount of time is spent by repeated simulations. In this work, we present a proof-of-concept study of the application of convolutional neural networks to accelerate those thermal simulations. The goal is not to replace standard simulation tools but to provide a method to quickly select promising samples for more detailed investigations. Based on a training set of randomly generated circuits with corresponding Finite Element solutions, the full 3D steady-state temperature field is estimated using a fully convolutional neural network. A custom network architecture is proposed which captures the long-range correlations present in heat conduction problems. We test the network on a separate dataset and find that the mean relative error is around 2 % and the typical evaluation time is 35 ms per sample ( 2 ms for evaluation, 33 ms for data transfer). The benefit of this neural-network-based approach is that, once training is completed, the network can be applied to any system within the design space spanned by the randomised training dataset (which includes different components, material properties, different positioning of components on a PCB, etc.).

The Physics Informed Neural Networks framework is applied to the understanding of the dynamics of Coronavirus of 2019. To provide the governing system of equations used by the framework, the Susceptible-Infected-Recovered-Death mathematical model is used. The study focused on finding the patterns of the dynamics of the disease which involves predicting the infection rate, recovery rate and death rate; thus predicting the active infections, total recovered, susceptible and deceased at any required time. The study used data that was collected on the dynamics of COVID-19 from the Kingdom of Eswatini between March 2020 and September 2021. The obtained results showed less errors thus making highly accurate predictions.

Convolutional Neural Networks (CNNs) have gained prominence in the research literature on image classification over the last decade. One shortcoming of CNNs, however, is their lack of generalizability and tendency to overfit when presented with small training sets. Augmentation directly confronts this problem by generating new data points providing additional information. In this paper, we investigate the performance of more than ten different sets of data augmentation methods, with two novel approaches proposed here: one based on the Discrete Wavelet Transform and the other on the Constant-Q Gabor transform. Pretrained ResNet50 networks are finetuned on each augmentation method. Combinations of these networks are evaluated and compared across three benchmark data sets of images representing diverse problems and collected by instruments that capture information at different scales: a virus data set, a bark data set, and a LIGO glitches data set. Experiments demonstrate the superiority of this approach. The best ensemble proposed in this work achieves state-of-the-art performance across all three data sets. This result shows that varying data augmentation is a feasible way for building an ensemble of classifiers for image classification (code available at https://github.com/LorisNanni).

Online social networks (OSNs) play an integral role in facilitating social interaction; however, these social networks increase antisocial behavior, such as cyberbullying, hate speech, and trolling. Aggression or hate speech that takes place through short message service (SMS) or the Internet (e.g., in social media platforms) is known as cyberbullying. Therefore, automatic detection utilizing natural language processing (NLP) is a necessary first step that helps prevent cyberbullying. This research proposes an automatic cyberbullying method to detect aggressive behavior using a consolidated deep learning model. This technique utilizes multichannel deep learning based on three models, namely, the bidirectional gated recurrent unit (BiGRU), transformer block, and convolutional neural network (CNN), to classify Twitter comments into two categories: aggressive and not aggressive. Three well-known hate speech datasets were combined to evaluate the performance of the proposed method. The proposed method achieved promising results. The accuracy of the proposed method was approximately 88%.

We demonstrate, in the context of Loop Quantum Gravity, the Quantum Holographic Principle, according to which the area of the boundary surface enclosing a region of space encodes a qubit per Planck unit. To this aim, we introduce fermion fields in the bulk, whose boundary surface is the two-dimensional sphere. The doubling of the fermionic degrees of freedom and the use of the Bogoliubov transformations lead to pairs of spin network’s edges piercing the boundary surface with double punctures, giving rise to pixels of area encoding a qubit. The proof is also valid in the case of a fuzzy sphere.

5G technology propagation curve is ascending rapidly. 5G will open up the horizon to improve the performance of many other IP-based services such as voice over IP (VoIP). VoIP is a worldwide technology that is expected to rule the telecommunication world in the near future. However, VoIP has expended a significant part of the 5G technology bandwidth with no valuable use owing to its lengthy packet header. This issue even worsens when VoIP works in IPv6 networks, where the wasted bandwidth and airtime may reach 85.7% of 5G networks. VoIP developers have exerted many efforts to tackle this snag. This study adds to these efforts by proposing a new method called Zeroize (zero sizes). The main idea of the Zeroize method is to use superfluous fields of the IPv6 protocol header to carry the digital voice data of the packet and, thus, reduce or zeroize the VoIP packet payload. Although simple, the Zeroize method achieves a considerable reduction of the wasted bandwidth of 5G networks, which also directly affects the consumed airtime. The performance analysis of the Zeroize method shows that the consumed bandwidth is saved by 20% with the G.723.1 codec. Thus, the Zeroize method is a promising solution to reduce the wasted bandwidth and airtime of 5G networks when running VoIP over IPv6.

Creating intelligent systems capable of recognizing emotions is a difficult task, especially when looking at emotions in animals. This paper describes the process of designing a “proof of concept” system to recognize emotions in horses. This system is formed by two elements, a detector and a model. The detector is a fast region-based convolutional neural network that detects horses in an image. The model is a convolutional neural network that predicts the emotions of those horses. These two elements were trained with multiple images of horses until they achieved high accuracy in their tasks. 400 images of horses were collected and labeled to train both the detector and the model while 80 were used to validate the system. Once the two components were validated, they were combined into a testable system that would detect equine emotions based on established behavioral ethograms indicating emotional affect through head, neck, ear, muzzle and eye position. The system showed an accuracy of between 69% and 74% on the validation set, demonstrating that it is possible to predict emotions in animals using autonomous intelligent systems. Such a system has multiple applications including further studies in the growing field of animal emotions as well as in the veterinary field to determine the physical welfare of horses or other livestock.

Congestion pricing has received lots of attention in the scientific discussion. Congestion pricing means that the operator increases prices at the time of congestion and the traffic demand is expected to decrease. In a certain sense, shadow prices are an optimal way of congestion pricing: users are charged shadow prices, i.e., the expectations of future losses because of blocked connections. The shadow prices can be calculated exactly from Howard’s equation, but this method is difficult. The paper presents simple approximations to the solution of Howard’s equation and a way to derive more exact approximations. If users do not react by lowering their demand, they will receive higher bills to pay. Many users do not react to increased prices but would want to know how the congestion pricing mechanism affects the bills. The distribution of the price of a connection follows from knowing the shadow prices and the probability of a congestion state. There is another interesting distribution. The network produces profit to the operator, or equivalently, blocked connections produce a cost to the operator. The average cost rate can be calculated from Howard’s equation, but the costs have some distribution. The distribution gives the risk that the actual costs exceed the average costs, and the operator should include this risk to the prices. The main result of this paper shows how to calculate the distribution of the costs in the future for congestion pricing by shadow prices and for congestion pricing with a more simple pricing scheme that produces the same average costs.

We confirm that energy dissipation weighting provides the most accurate approach to determining the effective hydraulic conductivity (Keff) of a binary K grid. A deep learning algorithm (UNET) can infer Keff with extremely high accuracy (R2 > 0.99). The UNET architecture could be trained to infer the energy dissipation weighting pattern from an image of the K distribution with high fidelity, although it was less accurate for cases with highly localized structures that controlled flow. Furthermore, the UNET architecture learned to infer the energy dissipation weighting even if it was not trained on this information directly. However, the weights were represented within the UNET in a way that was not immediately interpretable by a human user. This reiterates the idea that even if ML/DL algorithms are trained to make some hydrologic predictions accurately, they must be designed and trained to provide each user-required output if their results are to be used to improve our understanding of hydrologic systems most effectively.

Simulating the non-perturbative and non-Markovian dynamics of open quantum systems is a very challenging many body problem, due to the need to evolve both the system and its environments on an equal footing. Tensor network and matrix product states (MPS) have emerged as powerful tools for open system models, but the numerical resources required to treat finite temperature environments grow extremely rapidly and limit their applications. In this study we use time-dependent variational evolution of MPS to expore the striking theory of Tamescelli et al. that shows how finite temperture open dyanmics can be obtained from zero temperature, i.e. pure wave function, simulations. Using this approach, we produce a benchmark data set for the dynamics of the Ohmic spin-boson model across a wide range of coupling and temperatures, and also present detailed analysis of the numerical costs of simulating non-equilibrium steady states, such as those emerging from the non-perturbative coupling of a qubit to baths at different temperatures. Despite ever growing resource requirements, we find that converged non-perturbative results can be obtained, and we discuss a number of recent ideas and numerical techniques that should allow wide application of MPS to complex open quantum systems.

With the prevalence of smartphones, the scope of mobile applications has been significantly broadened in the past few years including almost every aspect of our daily life. Among the applications, message dissemination services play a significant role. Traditionally, users send messages to the servers, which forward them according to friend lists. This client-server architecture is efficient with the support of infrastructures, however, it restricts the application scope and may hinder the wide deployment of location-based mobile applications. This paper proposes a novel communication model called passive broadcast for local message dissemination. In this new model, each node does not maintain a connection state and data delivery is initialized by a receiver via a ’scan’ operation. The representative carriers of passive broadcast include Bluetooth and WiFi-Direct, both of which define a mandatory ‘peer discovery’ function. Passive broadcast features negligible cost for establishing and maintaining direct links and is extremely suitable for short message dissemination in proximity. Furthermore, we study the operation management in the proposed communication model with complete protocols and in-depth analysis for optimization. We prototyped our solution on commercial phones and evaluated it with extensive experiments and simulation.

The rapid growth of network services, Internet of Things devices and online users on the Internet have led to an increase in the amount of data transmitted daily. As more and more information is stored and transmitted on the Internet, cybercriminals are trying to gain access to the information to achieve their goals, whether it is to sell it on the dark web or for other malicious intent. Through thorough literature study relating to the causes and issues that are brought from the security and privacy segment of wireless networks, it is observed that there are various factors that can cause the networks to be an insecure; especially factors that revolve around cybercriminals with their growing expertise and the lack of preparation and efforts to combat them by relevant bodies. The aim of this paper is to showcase major and frequent security as well as privacy issues in wireless networks along with specialized solutions that can assist the related organizations or the public to fathom how great of an impact these challenges can bring if every related stakeholder took a step in reducing them. Through this paper it is discovered that there are many ways these challenges can be mitigated, however, the lack of implementation of privacy and security solutions is still largely present due to the absence of practical application of these solutions by responsible parties in real world scenarios.

This paper aims to analyze the effects of Covid-19 on financial markets from the perspective of Complexity. The Covid-19 pandemic has caused turmoil in financial markets and is already one of the most important financial crises in history, causing a fall in several stock markets as well as great volatility. Unlike past crises, which in most cases were caused either by problems of fiscal deficits or in the financial system, this crisis has its origin in an epidemic disease, which occurred in Wuhan, China, and quickly spread across the globe affecting transport networks, commerce and finance, and will affect the public debt of many countries. This is a systemic situation in which there is a need to consider several interconnected systems, financial instability and high financial risk, something that econophysics and some complexity theorists already do. Therefore, this paper intends to show, theoretically, the systemic and complex character of the recent financial crisis caused by Covid-19.

This paper focuses on quantifying the uncertainty in the specific absorption rate values of brain induced by the uncertain positions of the electroencephalography electrodes placed on patient's scalp. To avoid running a large number of simulations, an artificial neural network architecture for uncertainty quantification involving high-dimensional data is proposed in this paper. The proposed method is demonstrated to be an attractive alternative to conventional uncertainty quantification methods because of its considerable advantage in the computational expense and speed.

Complete digraphs are referred to in the combinatorics literature as tournaments. We consider a family of semi-simplicial complexes, that we refer to as ``tournaplexes'', whose simplices are tournaments. In particular, given a digraph G, we associate with it a ``flag tournaplex'' which is a tournaplex containing the directed flag complex of G, but also the geometric realisation of cliques that are not directed. We define several types of filtrations on tournaplexes, and exploiting persistent homology, we observe that flag tournaplexes provide finer means of distinguishing graph dynamics than the directed flag complex. We then demonstrate the power of these ideas by applying them to graph data arising from the Blue Brain Project's digital reconstruction of a rat's neocortex.

Control And Data Acquisition (SCADA) systems currently monitor and collect a huge among of data from all kind of processes. In practice, due to sensor failures or to communication errors, in the long-time running, some data may be lost. When it happens, given the nature of these failures, information is lost in bursts, that is, sets of consecutive samples, which besides can be very long. Data completion is a critical step, which must be done with the utmost rigour in order to not propagate errors in the rest of the processing chain stages. Some Big Data techniques do not work if the data series are incomplete, due to the loss of some data. When this occurs it is necessary to fill out the gaps of the historical data with a reliable data completion method. This paper presents an ad-hoc method to replenish the data lost by a SCADA system in case of long bursts. The data correspond to levels of drinking water tanks of a Water Network company that present patterns on a daily and a weekly scale. A method based on tensors is used to take advantage of the data structure. A specially designed \textit{tensorization} is employed to deal with bursts of missed data, applying a twice tensor decomposition and a signal continuity correction. Statistical tests are realized, which consist of apply the data reconstruction algorithms, by deliberately removing bursts of data in verified historical database servers, to be able to evaluate the real effectiveness of the tested methods. For this application, the presented approach outperforms the other techniques found in the literature.

Currently, the use of numerical models for reproducing the landscape evolution of a river basin is part of the day-by-day research activities of fluvial engineers and geomorphologists. However, despite landscape modelling is based on a rather long tradition, and scientists and practitioners are trying to schematize the processes involved in the evolution of a landscape since decades, there is still the need for improving both the knowledge of the physical mechanisms and their numerical coding. The present review focuses on the first aspect, discussing the main components of a landscape evolution model and their more common schematizations, presenting possible open questions to be addressed towards an improvement of the reliability of such kind of models in describing the fluvial geomorphology.

We apply the stochastic thermodynamics formalism to describe the dynamics of systems of complex Langevin and Fokker-Planck equations. We provide in particular a simple and general recipe to calculate thermodynamical currents, dissipated and propagating heat for networks of nonlinear oscillators. By using the Hodge decomposition of thermodynamical forces and fluxes, we derive a formula for entropy production that generalises the notion of non-potential forces and makes transparent the breaking of detailed balance and of time reversal symmetry for states arbitrarily far from equilibrium. Our formalism is then applied to describe the off-equilibrium thermodynamics of a few examples, notably a continuum ferromagnet, a network of classical spin-oscillators and the Frenkel-Kontorova model of nano friction.