Complex systems exhibit critical thresholds at which they transition among alternative phases. Complex systems theory has been applied to analyze disease progression, distinguishing three stages along progression: (i) a normal non-infected state, (ii) a pre-disease state in which the host is infected and responds; therapeutic interventions could still be effective, (iii) an irreversible state, where the system is seriously threatened. The Dynamical Network Biomarker (DNB) theory sought for early-warnings of the transition from health to disease. Such DNBs might range from individual genes to complex structures in transcriptional regulatory or protein-protein interaction networks. Here we revisit transcriptomic data obtained during infection of tobacco plants with tobacco etch potyvirus to identify DNBs signaling the transition from mild/reversible to severe/irreversible disease. We identified genes showing a sudden transition in expression along disease. Some of these genes cluster in modules that show the properties of DNBs. These modules contain both genes known to be involved in response to pathogens (e.g., ADH2, CYP19, ERF1, KAB1, LAP1, MBF1C, PR1, or TPS5) and other genes not previously related to biotic stress responses (e.g., ABCI6, BBX21, NAP1, OSM34, or ZPN1).

Document classification is one of the most critical steps in the document analysis pipeline. There are two types of approaches for document classification, known as image-based and multimodal approaches. The image-based document classification approaches are solely based on the inherent visual cues of the document images. In contrast, the multimodal approach co-learns the visual and textual features, and it has proved to be more effective. Nonetheless, these approaches require a huge amount of data. This paper presents a novel approach for document classification that works with a small amount of data and outperforms other approaches. The proposed approach incorporates a hierarchical attention network(HAN) for the textual stream and the EfficientNet-B0 for the image stream. The hierarchical attention network in the textual stream uses the dynamic word embedding through fine-tuned BERT. HAN incorporates both the word level and sentence level features. While the earlier approaches rely on training on a large corpus (RVL-CDIP), we show that our approach works with a small amount of data (Tobacco-3482). To this end, we trained the neural network at Tobacco-3428 from scratch. Thereby, we outperform state-of-the-art by obtaining an accuracy of 90.3%. This results in a relative error reduction rate of 7.9%.

The latest methods based on deep learning have achieved amazing results regarding the complex work of inpainting large missing areas in an image. This type of method generally attempts to generate one single "optimal" inpainting result, ignoring many other plausible results. However, considering the uncertainty of the inpainting task, one sole result can hardly be regarded as a desired regeneration of the missing area. In view of this weakness, which is related to the design of the previous algorithms, we propose a novel deep generative model equipped with a brand new style extractor which can extract the style noise (a latent vector) from the ground truth image. Once obtained, the extracted style noise and the ground truth image are both input into the generator. We also craft a consistency loss that guides the generated image to approximate the ground truth. Meanwhile, the same extractor captures the style noise from the generated image, which is forced to approach the input noise according to the consistency loss. After iterations, our generator is able to learn the styles corresponding to multiple sets of noise. The proposed model can generate a (sufficiently large) number of inpainting results consistent with the context semantics of the image. Moreover, we check the effectiveness of our model on three databases, i.e., CelebA, Agricultural Disease, and MauFlex. Compared to state-of-the-art inpainting methods, this model is able to offer desirable inpainting results with both a better quality and higher diversity. The code and model will be made available on https://github.com/vivitsai/SEGAN.

Being a combination of the conference call, talkback radio, audio podcast, and an online video chat, Clubhouse is a new social networking app that gained over 10 million users and over $100 in valuation in just 8 months. Unlike other social networks, it offers a real-time streaming audio chat that does not ask users to share any unnecessary information like exchanging text messages, conducting video calls, or sharing photos. Instead, Clubhouse users can listen to real-time conversations, contribute to these conversations and create their own conversations for the others to listen and to interact with. Often nicknamed a “Silicon Valley’s hottest start-up”, Clubhouse positions itself as an “exclusive” and “alternative” social network that attracts various celebrities and people who just want to talk to each other. Launched in March 2020, amidst the COVID-19 pandemic with its social distancing and lockdowns, Clubhouse offered its users a space for the digital group psychotherapy where people could solve their problems by talking them through with strangers. However, it is unclear what is going to happen to this new social network in the post-pandemic world after all of its hype eventually evaporates. This paper discusses the possible underlying motives for the Clubhouse creation and its real purposes. Moreover, it looks at the three possible scenarios of its further development.

Hardy Cross originally proposed a method for analysis of flow in networks of conduits or conductors in 1936. His method was the first really useful engineering method in the field of pipe network calculation. Only electrical analogs of hydraulic networks were used before the Hardy Cross method. A problem with the flow resistance versus the electrical resistance makes these electrical analog methods obsolete. The method by Hardy Cross is taught extensively at faculties and it still remains an important tool for analysis of looped pipe systems. Engineers today mostly use a modified Hardy Cross method which threats the whole looped network of pipes simultaneously (use of these methods without computers is practically impossible). A method from the Russian practice published during 1930s, which is similar to the Hardy Cross method, is described, too. Some notes from the life of Hardy Cross are also shown. Finally, an improved version of the Hardy Cross method, which significantly reduces number of iterations, is presented and discussed. Also we tested multi-point iterative methods which can be used as substitution for the Newton-Raphson approach used by Hardy Cross, but this approach didn’t reduce number of required iterations to reach the final balanced solution. Although, many new models have been developed since the time of Hardy Cross, main purpose of this paper is to illustrate the very beginning of modeling of gas and water pipe networks or ventilation systems.

This paper presents a study and implementation of a convolutional neural network to identify and recognize humpback whale specimens from the unique patterns of their tails. Starting from a dataset composed of images of whale tails, all the phases of the process of creation and training of a neural network are detailed – from the analysis and pre-processing of images to the elaboration of predictions, using TensorFlow and Keras frameworks. Other possible alternatives are also explained when it comes to tackling this problem and the complications that have arisen during the process of developing this paper.

Deep learning (DL) algorithms have recently emerged from machine learning and soft computing techniques. Since then, several deep learning (DL) algorithms have been recently introduced to scientific communities and are applied in various application domains. Today the usage of DL has become essential due to their intelligence, efficient learning, accuracy and robustness in model building. However, in the scientific literature, a comprehensive list of DL algorithms has not been introduced yet. This paper provides a list of the most popular DL algorithms, along with their applications domains.

Research within the field of hydrology often focuses on comparing stochastic to machine learning (ML) forecasting methods. The comparisons performed are all based on case studies, while an extensive study aiming to provide generalized results on the subject is missing. Herein, we compare 11 stochastic and 9 ML methods regarding their multi-step ahead forecasting properties by conducting 12 large-scale computational experiments based on simulations. Each of these experiments uses 2 000 time series generated by linear stationary stochastic processes. We conduct each simulation experiment twice; the first time using time series of 100 values and the second time using time series of 300 values. Additionally, we conduct a real-world experiment using 405 mean annual river discharge time series of 100 values. We quantify the performance of the methods using 18 metrics. The results indicate that stochastic and ML methods perform equally well.

When computers start to become a dominant part of technology around the 1950s, fundamental questions about reliable designs and robustness were of great relevance. Their development gave rise to the exploration of new questions such as what made brains reliable (since neurons can die) and how computers could get inspiration from neural systems. In parallel, the first Artificial Neural Networks came to life. Since then, the comparative view between brains and computers has been developed in new, sometimes unsuspected directions. With the rise of deep learning and the development of connectomics, an evolutionary look at how both hardware and neural complexity have evolved or designed is required. In this paper, we argue that important similarities have resulted both from convergent evolution (the inevitable outcome of architectural constraints) and inspiration of hardware and software principles guided by toy pictures of neurobiology. Moreover, dissimilarities and gaps originate from the lack of major innovations that have paved the way to biological computing (including brains) that are completely absent within the artificial domain. As it occurs within synthetic biocomputation, we can also ask whether alternative minds can emerge from A.I.\ designs. Here we take an evolutionary view of the problem and discuss the remarkable convergences between living and artificial designs and what are the pre-conditions to achieve artificial intelligence.

This study explores the relationship between job satisfaction, employee loyalty and two types of flexible employment arrangements; teleworking and flexi-time. The analysis relies on data derived by the Workplace Employee Relations Survey (WERS) in 2004 and 2011. A propensity score matching and least squares regressions are applied. Furthermore, Bayesian Networks (BN) and Directed Acyclic Graphs (DAGs) are employed in order to confirm the causality between employment types explored and the outcomes of interest. Finally, an instrumental variables (IV) approach based on the BN framework is proposed and applied in this study. The results support that there is a positive causal effect from these employment arrangements on job satisfaction and employee loyalty.

Singing melody extraction is the task that identifies the melody pitch contour of singing voice from polyphonic music. Most of the traditional melody extraction algorithms are based on calculating salient pitch candidates or separating the melody source from the mixture. Recently, classification-based approach based on deep learning has drawn much attentions. In this paper, we present a classification-based singing melody extraction model using deep convolutional neural networks. The proposed model consists of a singing pitch extractor (SPE) and a singing voice activity detector (SVAD). The SPE is trained to predict a high-resolution pitch label of singing voice from a short segment of spectrogram. This allows the model to predict highly continuous curves. The melody contour is smoothed further by post-processing the output of the melody extractor. The SVAD is trained to determine if a long segment of mel-spectrogram contains a singing voice. This often produces voice false alarm errors around the boundary of singing segments. We reduced them by exploiting the output of the SPE. Finally, we evaluate the proposed melody extraction model on several public datasets. The results show that the proposed model is comparable to state-of-the-art algorithms.

Intelligent fault diagnosis techniques have replaced the time-consuming and unreliable human analysis, increasing the efficiency of fault diagnosis. Deep learning model can improve the accuracy of intelligent fault diagnosis with the help of its multilayer nonlinear mapping ability. This paper has proposed a novel method named Deep Convolutional Neural Networks with Wide First-layer Kernels (WDCNN). The proposed method uses raw vibration signals as input (data augmentation is used to generate more inputs), and uses the wide kernels in first convolutional layer for extracting feature and suppressing high frequency noise. Small convolutional kernels in the preceding layers are used for multilayer nonlinear mapping. AdaBN is implemented to improve the domain adaptation ability of the model. The proposed model addresses the problem that currently, the accuracy of CNN applied to fault diagnosis is not very high. WDCNN can not only achieve 100% classification accuracy on normal signals, but also outperform state of the art DNN model which is based on frequency features under different working load and noisy environment.

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

In recent years many different deep neural networks were developed, but due to a large number of layers in deep networks, their training requires a long time and a large number of datasets. Today is popular to use trained deep neural networks for various tasks, even for simple ones in which such deep networks are not required. The well-known deep networks such as YoloV3, SSD, etc. are intended for tracking and monitoring various objects, therefore their weights are heavy and the overall accuracy for a specific task is low. Eye-tracking tasks need to detect only one object - an iris in a given area. Therefore, it is logical to use a neural network only for this task. But the problem is the lack of suitable datasets for training the model. In the manuscript, we presented a dataset that is suitable for training custom models of convolutional neural networks for eye-tracking tasks. Using data set data, each user can independently pre-train the convolutional neural network models for eye-tracking tasks. This dataset contains annotated 10,000 eye images in an extension of 416 by 416 pixels. The table with annotation information shows the coordinates and radius of the eye for each image. This manuscript can be considered as a guide for the preparation of datasets for eye-tracking devices.

Wireless Sensor Networks (WSNs) are being increasingly adopted in critical applications, where verifying the correct operation of sensor nodes is a major concern. Undesired events may undermine the mission of the WSNs. Hence their effects need to be properly assessed before deployment to obtain a good level of expected performance and during the operation in order to avoid dangerous unexpected results. In this paper we propose a methodology to support design and deployment of dependable WSNs by means of an event-based formal verification technique. The methodology includes a process to guide designers towards the realization of a dependable WSN and a tool ("ADVISES") to simplify its adoption. The tool allows to generate automatically formal specifications used to check correctness properties and evaluate dependability metrics at design time and at runtime. During the runtime we can check the behavior of theWSN accordingly to the results obtained at design time and we can detect sudden and unexpected failures, in order to trigger recovery procedures. The effectiveness of the methodology is shown in the context of two case studies, aiming to illustrate how the tool is helpful to drive design choices and to check the correctness properties of theWSN at runtime

An existing power grid is going through a massive transformation. Smart grid technology is a radical approach for improvisation in prevailing power grid. Integration of electrical and communication infrastructure is inevitable for the deployment of Smart grid network. Smart grid technology is characterized by full duplex communication, automatic metering infrastructure, renewable energy integration, distribution automation and complete monitoring and control of entire power grid. Wireless sensor networks (WSNs) are small micro electrical mechanical systems which are accomplished to collect and communicate the data from surroundings. WSNs can be used for monitoring and control of smart grid assets. Security of wireless sensor based communication network is a major concern for researchers and developers. The limited processing capabilities of wireless sensor networks make them more vulnerable to cyber-attacks. The countermeasures against cyber-attacks must be less complex with an ability to offer confidentiality, data readiness and integrity. The address oriented design and development approach for usual communication network requires a paradigm shift to design data oriented WSN architecture. WSN security is an inevitable part of smart grid cyber security. This paper is expected to serve as a comprehensive assessment and analysis of communication standards, cyber security issues and solutions for WSN based smart grid infrastructure.

Although microgrids facilitate the increased penetration of distributed generations (DGs) and improve the security of power supplies, they have some issues that need to be better understood and addressed before realising the full potential of microgrids. This paper presents a comprehensive list of challenges and opportunities supported by a literature review on the evolution of converter-based microgrids. The discussion in this paper presented with a view to establishing microgrids as distinct from the existing distribution systems. This is accomplished by, firstly, describing the challenges and benefits of using DG units in a distribution network and then those of microgrid ones. Also, the definitions, classifications and characteristics of microgrids are summarised to provide a sound basis for novice researchers to undertake ongoing research on microgrids.

The Microwave Humidity and Temperature sounder (MWHTS) on board the Fengyun (FY)-3C satellite measure the outgoing radiance form the Earth surface and atmospheric constituents. MWHTS makes measurements in the isolated oxygen absorption line near 118 GHz and the vicinity of strong water vapor line around 183 GHz, can provide fine vertical distribution structure of both atmospheric humidity and temperature. However, in order to obtain the accurate soundings of humidity and temperature by the physical retrieval method, bias between the observed radiance and those simulated by radiative transfer model from the background or first guess profiles must be correct. In this study, two bias correction methods are developed through the correlation analysis between MWHTS measurements and air mass identified by the first guess profiles of the physical inversion, one is the linear regression correction (LRC) and the other is neural networks correction (NNC), representing the linear and nonlinear nature between MWHTS measurements and air mass, respectively. Both correction methods have been applied to MWHTS observed brightness temperatures over the geographic area (180° W-180° E, 60° S-60° N). The corrected results are evaluated by the probability density function of the difference between corrected observations and simulated values and the root mean square error (RMSE) with respect to simulated observations. The numerical results show that the NNC method perform better, especially in MWHTS channels 1 and 7-9 whose peak weight function heights are close to the surface. In order to assess the effects of bias correction methods proposed in this study on the retrieval accuracy, a one-dimensional variational system was built and applied to the MWHTS uncorrected and corrected brightness temperatures to estimated atmospheric temperature and humidity profiles, The retrieval results show that the NNC has better performance which is to be expected. An indication of the stability and robustness of NNC method is given which suggests that the NNC method has promising application perspectives in the physical retrieval.

In wireless sensor networks (WSNs), each sensor node can estimate the global parameter from the local data in distributed manner. This paper proposed a robust diffusion estimation algorithm based on minimum error entropy criterion with self-adjusting step-size, which are referred to as diffusion MEE-SAS (DMEE-SAS) algorithm. The DMEE-SAS algorithm has fast speed of convergence and is robust against non-Gaussian noise in the measurements. The detailed performance analysis of the DMEE-SAS algorithm is performed. By combining the DMEE-SAS with diffusion minimum error entropy (DMEE) algorithms, an Improving DMEE-SAS algorithm is proposed, in non-stationary environment where tracking is very important. The Improving DMEE-SAS algorithm can avoid insensitivity of the DMEE-SAS algorithm due to the small effective step-size near the optimal estimator, and obtain a fast convergence speed. Numerical simulations are given to verify the effectiveness and advantages of these proposed algorithms.

Biocultural heritage-based products, including regional specialty foods, are increasingly part of sustainable rural development strategies. While export-oriented biocultural products are often the most visible, we examine the role of campesino gastronomic heritage in the Central Valley of Tarija, Bolivia, as a case study of a local market-centered biocultural resource-based development strategy reflected in an alternative agri-food network. We develop a biocultural sustainability framework to examine this network from ecological, economic and sociocultural perspectives. Data are drawn from interviews (n=77), surveys (n=89) and participant observation, with primary and secondary producers of traditional and new products, as well as restaurant owners, market vendors and local consumers. We find that campesino biocultural heritage and the alternative agri-food network surrounding it represent an influential territorial project that underpins many household economies, particularly for women. We conclude that the relatively small investments by local governments to promote campesino gastronomic heritage are having positive ripple effects on small-scale producer livelihoods and on biocultural sustainability. We suggest that further support to increase market access and reduce other barriers to participation in alternative food networks will likely increase the options and benefits available to small-scale producers mobilising campesino gastronomic heritage within the local economy.

The widespread proliferation of sensor nodes in the era of Internet of Things (IoT) coupled with increasing usage of wireless spectrums especially the ISM band makes it difficult to deploy real-life IoT. Currently, the cognitive radio technology enables sensor nodes communicate with each other through the licensed spectrum bands as well as the free ISM bands. Cognitive radio networks (CRSNs) are considered as a promising solution to the problem of spectrum under utilization and artificial radio spectrum scarcity. The paradigm of dynamic spectrum access allows secondary users (SUs) to utilize wireless spectrum resources which belong to primary users (PUs) with minimal interference to PUs. Due to the dynamic spectrum availability and quality, routing for SUs in multi-hop CRSNs is a challenge. In this paper, we introduce novel routing metrics that estimate both the future spectrum availability and the average transmission time with the consideration of both the global statistical spectrum usage and local instant spectrum resources. In our novel routing metrics, one retransmission is allowed and considered to reduce the probability of rerouting upon PU's arrival. Then, we propose two routing algorithms for multi-hop CRSNs. Finally, we conduct simulations, whose results show that our proposed algorithms lead to a significant performance improvement over the reference algorithm.

Since its advent in the mid-twentieth century, the field of artificial intelligence (AI) has been heavily influenced by biology. From the structure of the brain to evolution by natural selection, core biological concepts underpin many of the fundamental breakthroughs in modern AI. Here, focusing specifically on artificial neural networks (ANNs) that have become commonplace in machine learning, we show the numerous connections between theories based on coevolution, multi-level selection, modularity and competition and related developments in ANNs. Our aim is to illuminate the valuable but often overlooked inspiration biologists have provided AI research and to spark future contributions at this intersection of biology and computer science. Although recent advances in AI have been swift, many significant challenges remain requiring innovative solutions. Thankfully, biology in all its forms still has a lot to teach us, especially when trying to create truly intelligent machines.

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

Proteomics research has become one of the most important topics in the fields of life science and natural science. At present, research on protein–protein interaction networks (PPINs) mainly focuses on detecting protein complexes or function modules. However, existing approaches are either ineffective or incomplete. In this paper, we investigate function module detection mechanisms in PPIN, including open databases, existing detection algorithms and recent solutions. After that, we describe the proposed solution based on simplified swarm optimization (SSO) algorithm and gene ontology knowledge. The proposed solution implements SSO algorithm for clustering proteins with similar function, and imports biological gene ontology knowledge for further identifying function complexes and improving detection accuracy. Furthermore, we use four different categories of species dataset for experiment: Fruitfly, Mouse, Scere, and Human. The testing and analysis result show that the proposed solution is feasible, efficient and could achieve a higher accuracy of prediction than existing approaches.

A major goal of neuroscience is understanding how neurons arrange themselves into neural networks that result in behavior. Most theoretical and experimental efforts have focused on a top-down approach which seeks to identify neuronal correlates of behaviors. This has been accomplished by effectively mapping specific behaviors to distinct neural patterns, or by creating computational models that produce a desired behavioral outcome. Nonetheless, these approaches have only implicitly considered the fact that neural tissue, like any other physical system, is subjected to several restrictions and boundaries of operations.Here, we propose a new, bottom-up conceptual paradigm: The Energy Homeostasis Principle, where the balance between energy income, expenditure, and availability are the key parameters in determining the dynamics of the found neuronal phenomena from molecular to behavioral levels. Neurons display high energy consumption relative to other cells, with metabolic consumption of the brain representing 20% of the whole-body oxygen uptake, contrasting with this organ representing only 2% of the body weight. Also, neurons have specialized surrounding tissue providing the necessary energy which, in the case of the brain, is provided by astrocytes. Moreover, and unlike other cell types with high energy demands such as muscle cells, neurons have strict aerobic metabolism. These facts indicate that neurons are highly sensitive to energy limitations, with Gibb’s free energy dictating the direction of all cellular metabolic processes. From this activity, the largest energy, by far, is expended by action potentials and post-synaptic potentials; therefore, plasticity can be reinterpreted in terms of their energy context. Consequently, neurons, through their synapses, impose energy demands over post-synaptic neurons in a close loop-manner, modulating the dynamics of local circuits. Subsequently, the energy dynamics end up impacting the homeostatic mechanisms of neuronal networks. Furthermore, local energy management also emerges as a neural population property, where most of the energy expenses are triggered by sensory or other modulatory inputs. Local energy management in neurons may be sufficient to explain the emergence of behavior, enabling the assessment of which properties arise in neural circuits and how. Essentially, the proposal of the Energy Homeostasis Principle is also readily testable for simple neuronal networks.

Vehicle to vehicle (V2V) and Vehicle to infrastructure (V2I) or briefly V2X communications are the one of hot topics in automotive industry. Therefore, this situation is providing many advantages of connected vehicles and infrastructures which bring to human life. For instance, vehicles and road infrastructures which shares information with each other, provides a neat flow regulation, more ordered traffic flow and therefore jammed traffic dependent accident’s percentage will be decreased. On the other hand, security is the most important issue for these systems because the operation of V2X networks is completely dependent on uninterrupted and accurate information sharing. In the light of these information, in this paper we review security issues and current solution architectures. We also propose some open problems in this lively field.

Two of the most common activation functions (AF) in deep neural networks (DNN) training are Sigmoid and ReLU. Sigmoid was tend to be more popular the previous decades, but it was suffering with the common vanishing gradient problems. ReLU has resolved these problems by using zero gradient and not tiny values for negative weights and the value “1” for all positives. Although it significant resolves the vanishing of the gradients, it poses new issues with dying neurons of the zero values. Recent approaches for improvements are in a similar direction by just proposing variations of the AF, such as Leaky ReLU (LReLU), while maintaining the solution within the same unresolved gradient problems. In this paper, the combining of the Sigmoid and ReLU in one single function is proposed, as a way to take the advantages of the two. The experimental results demonstrate that by using the ReLU’s gradient solution on positive weights, and Sigmoid’s gradient solution on negatives, has a significant improvement on performance of training Neural Networks on image classification of diseases such as COVID-19, text and tabular data classification tasks on five different datasets.

Semantic image segmentation has recently witnessed considerable progress by training deep convolutional neural networks (CNNs). The core issue of this technique is the limited capacity of CNNs to depict visual objects. Existing approaches tend to utilize approximate inference in a discrete domain or additional aides and do not have a global optimum guarantee. We propose the use of the multi-label manifold ranking (MR) method in solving the linear objective energy function in a continuous domain to delineate visual objects and solve these problems. We present a novel embedded single stream optimization method based on the manifold ranking (MR) model to avoid approximations without sacrificing expressive power. In addition, we propose a novel network, which we refer to as dual multi-scale manifold ranking (\textbf{DMSMR}) network, that combines the dilated, multi-scale strategies with the single stream MR optimization method in the deep learning architecture to further improve the performance. Experiments on high resolution images, including close-range and remote sensing datasets, demonstrate that the proposed approach can achieve competitive accuracy without additional aides in an end-to-end manner.

Extant research pays little attention to migrant workers’ skill accumulation/upgrading from the perspective of the labor supply. This paper takes China as an example to explore the factors influencing skill accumulation of rural-urban migrant workers (RUMWs), with a purpose to discover how to sustain or reshape regional competitive advantage through improving RUMWs’ skill accumulation. Structured questionnaire surveys were adopted for data collection in Suzhou City, Jiangsu Province and Taizhou City, Zhejiang Province located in the Yangtze River Delta in the east of China. 900 questionnaires were issued and 491 effective questionnaires were recovered totally. This paper takes a perspective of global production networks, and gets a broad viewpoint containing intra-firm coordination, inter-firm partnership and extra-firm bargaining with non-firm actors, beyond what the extant literature on laborers’ human capital focuses on. The finding indicates that firms’ skill-oriented preference, which concerns about employees’ skills and innovation ability and stimulates them to learn initiatively, have a significant influence on RUMWs’ skill accumulation. In terms of collective efficiency based on co-competitive relationship between local firms, the more intensive interactions are, the more opportunities of skill accumulation RUMWs get. The accessibility of local institutions and favorable policies benefit RUMWs’ skill accumulation. Besides, the place itself, as a synthesized space of labor-management relations inside a firm and inter-organization relations, exerts an influence on and cause the regional differences in RUMWs’ skill accumulation.

Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks(CNN) for face verification. In this work, we explore to use identification signal to supervise one CNN and the combination of semi-verification and identification to train the other one. In order to estimate semi-verification loss at a low computation cost, a circle, which is composed of all faces, is used for selecting face pairs from pairwise samples. In the process of face normalization, we propose to use different landmarks of faces to solve the problems caused by poses. And the final face representation is formed by the concatenating feature of each deep CNN after PCA reduction. What's more, each feature is a combination of multi-scale representations through making use of auxiliary classifiers. For the final verification, we only adopt the face representation of one region and one resolution of a face jointing Joint Bayesian classifier. Experiments show that our method can extract effective face representation with a small training dataset and our algorithm achieves 99.71% verification accuracy on LFW dataset.

Systems Engineering is an ubiquitous discipline of Engineering overlapping industrial, chemical, mechanical, manufacturing, control, software, electrical, and civil engineering. It provides tools for dealing with the complexity and dynamics related to the optimisation of physical, natural, and virtual systems management. This paper presents a review of how multi-agent systems and complex networks theory are brought together to address Systems Engineering and management problems. The review also encompasses current and future research directions both for theoretical fundamentals and applications in Industry. This is made by considering trends such as mesoscale, multiscale, and multilayer networks; along with the state-of-art analysis on network dynamics and intelligent networks. Critical and smart infrastructure, manufacturing processes, and supply chain networks are instances of research topics for which this literature review is highly relevant.

This work can be considered as a first step of designing a future competitive data-driven approach for remaining useful life prediction of aircraft engines. The proposed approach is an ensemble of serially connected extreme learning machines. The results of prediction of the first networks are scaled and fed to the next networks as an additive features to the original inputs. This feature mapping allows increasing the correlation of training inputs with their targets by holding new prior knowledge about the probable behavior of the target function. The proposed approach is evaluated under remaining useful estimation using a set of “time-varying” data retrieved from the public dataset C-MAPSS (Commercial Modular Aero Propulsion System Simulation) provided by NASA. The prediction performances are compared to basic extreme learning machine and proved the effectiveness of the proposed methodology.

In this paper, we study the performance of various deep reinforcement learning algorithms to enhance the energy management system of a microgrid. We propose a novel microgrid model that consists of a wind turbine generator, an energy storage system, a set of thermostatically controlled loads, a set of price-responsive loads, and a connection to the main grid. The proposed energy management system is designed to coordinate among the different flexible sources by defining the priority resources, direct demand control signals, and electricity prices. Seven deep reinforcement learning algorithms were implemented and are empirically compared in this paper. The numerical results show that the deep reinforcement learning algorithms differ widely in their ability to converge to optimal policies. By adding an experience replay and a semi-deterministic training phase to the well-known asynchronous advantage actor-critic algorithm, we achieved the highest model performance as well as convergence to near-optimal policies.

G protein-coupled receptors (GPCRs) play a key role in many cellular signaling mechanisms, and must select among multiple coupling possibilities in a ligand-specific manner in order to carry out a myriad of functions in diverse cellular contexts. Much has been learned about the molecular mechanisms of ligand-GPCR complexes from Molecular Dynamics (MD) simulations. However, to explore ligand-specific differences in the response of a GPCR to diverse ligands, as is required to understand ligand bias and functional selectivity, necessitates creating very large amounts of data from the needed large-scale simulations. This becomes a Big Data problem for the high dimensionality analysis of the accumulated trajectories. Here we describe a new machine learning (ML) approach to the problem that is based on transforming the analysis of GPCR function-related, ligand-specific differences encoded in the MD simulation trajectories into a representation recognizable by state-of-the-art deep learning object recognition technology. We illustrate this method by applying it to recognize the pharmacological classification of ligands bound to the 5-HT2A and D2 subtypes of class A GPCRs from the serotonin and dopamine families. The ML-based approach is shown to perform the classification task with high accuracy, and we identify the molecular determinants of the classifications in the context of GPCR structure and function. This study builds a framework for the efficient computational analysis of MD Big Data collected for the purpose of understanding ligand-specific GPCR activity.

With Internet of Things (IoT) gaining presence throughout different industries a lot of new technologies have been introduced to support this undertaking. Implications on one such technology, wireless systems allowed for the use of different communication methods to achieve the goal of transferring data reliably, with more cost efficiency and over longer distances. Anywhere from a single house with only a few IoT devices such as a smart light bulb or a smart thermostat connected to the network, all the way to a complex system that can control power grids throughout countries, IoT has been becoming a necessity in everyday lives. This paper presents an overview of the devices, systems and wireless technologies used in different IoT architectures (Healthcare, Vehicular Networks, Mining, Learning, Energy, Smart Cities, Behaviors and Decision Making), their upbringings and challenges to this date and some foreseen in the future.

Conventionally, partial differential equations (PDE) problems are solved numerically through discretization process by using finite difference approximations. The algebraic systems generated by this process are then finalized by using an iterative method. Recently, scientists invented a short cut approach, without discretization process, to solve the PDE problems, namely by using machine learning (ML). This is potential to make scientific machine learning as a new sub-field of research. Thus, given the interest in developing ML for solving PDEs, it makes an abundance of an easy-to-use methods that allows researchers to quickly set up and solve problems. In this review paper, we discussed at least three methods for solving high dimensional of PDEs, namely PyDEns, NeuroDiffEq, and Nangs, which are all based on artificial neural networks (ANNs). ANN is one of the methods under ML which proven to be a universal estimator function. Comparison of numerical results presented in solving the classical PDEs such as heat, wave, and Poisson equations, to look at the accuracy and efficiency of the methods. The results showed that the NeuroDiffEq and Nangs algorithms performed better to solve higher dimensional of PDEs than the PyDEns.

Object segmentation on remotely-sensed images: aerial (or very high resolution, VHS) images and satellite (or high resolution, HR) images, has been applied to many application domains, especially road extraction in which the segmented objects are served as a mandatory layer in geospatial databases. Several attempts in applying deep convolutional neural network (DCNN) to extract roads from remote sensing images have been made; however, the accuracy is still limited. In this paper, we present an enhanced DCNN framework specifically tailored for road extraction on remote sensing images by applying landscape metrics (LMs) and conditional random fields (CRFs). To improve DCNN, a modern activation function, called exponential linear unit (ELU), is employed in our network resulting in a higher number of and yet more accurate extracted roads. To further reduce falsely classified road objects, a solution based on an adoption of LMs is proposed. Finally, to sharpen the extracted roads, a CRF method is added to our framework. The experiments were conducted on Massachusetts road aerial imagery as well as THEOS satellite imagery data sets. The results showed that our proposed framework outperformed Segnet, the state-of-the-art object segmentation technique on any kinds of remote sensing imagery, in most of the cases in terms of precision, recall, and F1.

Underwater Sensor Networks (UWSNs) can enable a broad range of applications such as resource monitoring, disaster prevention, and navigation-assisted. It is especially relevant for sensor nodes location in UWSNs. Global Positioning System (GPS) is not suitable for using in UWSNs because of the underwater propagation problems. Hence some localization algorithms based on the precise time synchronization between sensor nodes have been proposed which are not feasible for UWSNs. In this paper, we propose a localization algorithm called Two-Phase Time Synchronization-Free Localization Algorithm (TP-TSFLA). TP-TSFLA contains two phases, namely, range-based estimation phase and range-free evaluation phase. In the first phase, we address a time synchronization-free localization scheme base on the Particle Swarm Optimization (PSO) algorithm to decrease the localization error. In the second phase, we propose a Circle-based Range-Free Localization Algorithm (CRFLA) to locate the unlocalized sensor nodes which cannot obtain the location information through the first phase. In the second phase, sensor nodes which are localized in the first phase act as the new anchor nodes to help realize localization. Hence in this algorithm, we use a small number of mobile beacons to help achieve location without any other anchor nodes. Besides, to improve the precision of the range-free method, an extension of CRFLA by designing a coordinate adjustment scheme is updated. The simulation results show that TP-TSFLA can achieve a relative high localization ratio without time synchronization.

Biofilms are congregations of bacteria on a surface, and they grow into obstacles for the functionalities of any device or machinery involves anything biological. Biofilms are developed through a biochemical system known as ‘Quorum Sensing’ that accounts for the chemical signaling that direct either biofilm formation or inhibition. Computational models that relate chemical and structural features of compounds to their performance properties have been used to aide in the discovery of active small molecules for many decades. These quantitative structure-activity relationship (QSAR) models are also important for predicting the activity of molecules that can have a range of effectiveness in biological systems. This study uses QSAR methodologies combined with and different machine learning algorithms to predict and assess the performance of several different compounds acting in Quorum Sensing. Through computational probing of the quorum sensing molecular interaction, new design rules can be elucidated for countering biofilms.

The comprehensibility of good predictive models learned from high-dimensional gene expression data is attractive because it can lead to biomarker discovery. Several good classifiers provide comparable predictive performance but differ in their abilities to summarize the observed data. We extend a Bayesian Rule Learning (BRL-GSS) algorithm, previously shown to be a significantly better predictor than other classical approaches in this domain. It searches a space of Bayesian networks using a decision tree representation of its parameters with global constraints, and infers a set of IF-THEN rules. The number of parameters and therefore the number of rules are combinatorial to the number of predictor variables in the model. We relax these global constraints to a more generalizable local structure (BRL-LSS). BRL-LSS entails more parsimonious set of rules because it does not have to generate all combinatorial rules. The search space of local structures is much richer than the space of global structures. We design the BRL-LSS with the same worst-case time-complexity as BRL-GSS while exploring a richer and more complex model space. We measure predictive performance using Area Under the ROC curve (AUC) and Accuracy. We measure model parsimony performance by noting the average number of rules and variables needed to describe the observed data. We evaluate the predictive and parsimony performance of BRL-GSS, BRL-LSS and the state-of-the-art C4.5 decision tree algorithm, across 10-fold cross-validation using ten microarray gene-expression diagnostic datasets. In these experiments, we observe that BRL-LSS is similar to BRL-GSS in terms of predictive performance, while generating a much more parsimonious set of rules to explain the same observed data. BRL-LSS also needs fewer variables than C4.5 to explain the data with similar predictive performance. We also conduct a feasibility study to demonstrate the general applicability of our BRL methods on the newer RNA sequencing gene-expression data.

In recent years, wireless networks have undoubtedly become a convenient way to connect to the Internet and provide connection to everyone in any corner of the world. In fact, in this era, people are connected to the internet almost everyday and wireless networks give us this privilege in a seamless manner. A wireless network normally consists of access points and nodes where the access points are responsible to amplify the wireless signals, while the nodes are the gadgets that are receiving these signals. However, with such great convenience provided, many challenges are also faced by the users and stakeholders. With no physical connection to devices, wireless networks are evidently more vulnerable to invisible cyber attacks. In this research paper, it the security issues that cause issues in the wireless networks are discussed. Furthermore, an analytical review of privacy challenges found in these networks is performed; these challenges are segregated into security issues and privacy issues. The paper will then present the methods used in conducting a survey and gathering the research results along with further discussion on the results obtained through this study. Finally, a suitable solution is proposed to prevent and overcome the intrusions faced in terms of security and privacy in wireless network scenarios through detection and response mechanism for mitigation of the problems.

Opportunistic Routing is a promising paradigm that has been proposed for efficient and reliable transfer of data packets in mobile ad hoc networks. This routing strategy takes advantage of the broadcasting nature of the wireless medium to increase the number of probable forwarding devices and improves the reliability of data transfer in the network. Opportunistic Routing utilizes the reception of the same broadcasted packet at multiple devices in the network and selects one best forwarder dynamically from the set of multiple receivers. A number of opportunistic routing protocols have been proposed over these years for effective data delivery in ad hoc networks. But as the speed and mobility of devices increases in the network, performances of the existing opportunistic routing protocols degrade considerably, leading to reduced Quality of Service and poor transmission efficiency. The exceptional potential of opportunistic routing is thus underutilized. In this research we introduce Optimized Opportunistic Routing (OOR) strategy that guarantee excellent Quality of Service and high transmission efficiency to the latest applications using opportunistic routing for communication in highly dynamic ad hoc networks. Simulation results show that our method achieve significant performance improvements compared to all other existing opportunistic routing protocols in highly dynamic mobile ad hoc networks.

Neural networks present the characteristics that the results are strongly dependent on the training data, the weight initialisation, and the hyper-parameters chosen. The determination of the distribution of a statistical estimator, as the Mean Squared Error (MSE) or the accuracy, is fundamental to evaluate the performance of a neural network model (NNM). For many machine learning models, as linear regression, it is possible to analytically obtain information as variance or confidence intervals on the results. Neural networks present the difficulty of being not analytically tractable due to their complexity. Therefore, it is impossible to easily estimate distributions of statistical estimators. When estimating the global performance of an NNM by estimating the MSE in a regression problem, for example, it is important to know the variance of the MSE. Bootstrap is one of the most important resampling techniques to estimate averages and variances, between other properties, of statistical estimators. In this tutorial, the application of two resampling (including bootstrap) techniques to the evaluation of neural networks’ performance is explained from both a theoretical and practical point of view. Pseudo-code of the algorithms is provided to facilitate their implementation. Computational aspects, as the training time, are discussed since resampling techniques always require to run simulations many thousands of times and, therefore, are computationally intensive. A specific version of the bootstrap algorithm is presented that allows the estimation of the distribution of a statistical estimator when dealing with an NNM in a computationally effective way. Finally, algorithms are compared on synthetically generated data to demonstrate their performance.

We present a first formal analysis of specific and complete local integration. Complete local integration was previously proposed as a criterion for detecting entities or wholes in distributed dynamical systems. Such entities in turn were conceived to form the basis of a theory of emergence of agents within dynamical systems. Here, we give a more thorough account of the underlying formal measures. The main contribution is the disintegration theorem which reveals a special role of completely locally integrated patterns (what we call ι-entities) within the trajectories they occur in. Apart from proving this theorem we introduce the disintegration hierarchy and its refinement-free version as a way to structure the patterns in a trajectory. Furthermore we construct the least upper bound and provide a candidate for the greatest lower bound of specific local integration. Finally, we calculate the i-entities in small example systems as a first sanity check and find that ι-entities largely fulfil simple expectations.

The demand of high data rate and ubiquitous coverage in heterogeneous cellular (HetNets) is increasing progressively. In order to meet this demand, sophisticated model having applied interference reduction scheme and cell association technique is needed. The small base station (sBS)are deployed inside the broadcasting area of macro base station (mBS), in heterogeneous cellular networks (HetNets). Since mBS has high transmission power therefore a large number of users get connected with mBS. This causes disproportion of load distribution across the HetNets. For load balancing users from high power mBS are migrated to low power sBS to increase network capacity and to decrease the load from mBS. This results in interference in the communication signal because of strong mBS Interference. Hence, we need interference management technique to mitigate interference and user association and to efficiently use sBSs’ resources. Inter-cell interference (ICI) limit the HetNets’ performance. Additionally, there exist deliberate jamming interference which depends on jammers transmission power and its proximity with the target, which notably degrades the network performance. In this paper, we employ reverse frequency allocation scheme (RFA) to reduce inter cell interference, deliberate jamming interference and to accomplish load balancing. The proposed setup is analyzed inquisitively and with the help of simulations. The result shows reduction in interferences as well as balance of load distribution in the network achieved by employing RFA scheme together with cell association.

Hydrogels evolved as an outstanding carrier material for local and controlled drug delivery that tend to the shortcomings of old conventional dosage forms for small drugs (NSAIDS) and large peptides and proteins. Aqueous swellable and crosslinked polymeric network structure of hydrogels is composed of various natural, synthetic and semisynthetic biodegradable polymers. Hydrogels have remarkable properties of functionality, reversibility, sterilizability, and biocompatibility. All these dynamic properties of hydrogels have increased the interest in their use as a carrier for peptides and proteins to be released slowly in a sustained manner. The therapeutical peptide and proteins are remarkable therapeutic agents in today’s world that allows the treatment of severe, chronic and life‐threatening diseases, such as diabetes, rheumatoid arthritis, hepatitis in an easy manner. Despite few limitations, hydrogels provide fine tuning of proteins and peptides delivery with enormous impact in clinical medicine. The primary objective of this article is to review current issues concerned with the therapeutics peptides and proteins and impact of remarkable properties of hydrogels on these therapeutic agents. Different routes for pharmaceutical peptides and proteins and superiority over other drugs candidates are presented. The article will also review literature concerning classification of hydrogels on different basis, polymers used, release mechanisms their physical and chemical characteristics and diverse applications.

The Sentinel-2 satellite mission offers high resolution multispectral time series image data, enabling the production of detailed land cover maps globally. At this scale, the trade-off between processing time and result quality is a central design decision. Currently, this machine learning task is usually performed using pixelwise classification methods. The radical shift of the computer vision field away from hand engineered image features and towards more automation by representation learning comes with many promises, including higher quality results and less engineering effort. In this paper we assess fully convolutional neural networks architectures as replacements for a Random Forest classifier in an operational context for the production of high resolution land cover maps with Sentinel-2 time series at the country scale. Our contributions include a framework for working with Sentinel-2 L2A time series image data, an adaptation of the U-Net model for dealing with sparse annotation data while maintaining high resolution output, and an analysis of those results in the context of operational production of land cover maps.

The fault diagnosis of wind farms has been proven to be a challenging task and motivates the research activities carried out through this work. Therefore, this paper deals with the fault diagnosis of a wind park benchmark model, and it considers viable solutions to the problem of earlier fault detection and isolation. The design of the fault indicator involves data-driven approaches, as they can represent effective tools for coping with poor analytical knowledge of the system dynamics, noise, uncertainty and disturbances. In particular, the proposed data-driven solutions rely on fuzzy models and neural networks that are used to describe the strongly nonlinear relationships between measurement and faults. The chosen architectures rely on nonlinear autoregressive with exogenous input models, as they can represent the dynamic evolution of the system along time. The developed fault diagnosis schemes are tested by means of a high-fidelity benchmark model, that simulates the normal and the faulty behaviour of a wind farm installation. The achieved performances are also compared with those of a model-based approach relying on nonlinear differential geometry tools. Finally, a Monte-Carlo analysis validates the robustness and the reliability of the proposed solutions against typical parameter uncertainties and disturbances.

The global climate change mitigation efforts have increased the efforts of national government to incentivize local households in adopting individual renewable energy as a mean to help reduce the usage of electricity generated using fossil fuels and to gain independence from the grid. Since the majority of residential generation is made by PV panels that generate electricity at off-peak hours, the optimal management of such installations often considers local storage that can defer the use of locally generated electricity at later times. On the other hand, the presence of distributed generation can affect negatively the operating conditions of low-voltage distribution networks. The energy stored in batteries located in optimal places in the network can be used by the utility to improve the operation of the network. This paper proposes a metaheuristic approach based on a Genetic Algorithm that considers three different scenarios of using energy storage for reducing the losses in the network. Prosumer and network operator priorities can be considered in different scenarios inside the same algorithm, to provide a comparative study of different priorities in storage placement. A case study performed on a real distribution network provides insightful results.

In airborne sensor networks (ASNs), the media access control (MAC) protocol is facing with serious unfairness problem due to the traditional protection mechanism of air-to-air communications among aircrafts. Actually by using the binary exponential back-off algorithm at high traffic loads to minimize collisions among users, the latest successful node can always benefit from this kind of MAC to obtain channel resources. Moreover, when taking the existence of the hidden nodes in ASNs into account, the inaccurate traffic load information will further aggravate the system’s unfairness. In this paper, a neighbor-channel-aware (NCA) protocol is proposed to improve the fairness of MAC protocol in ASNs. In the proposal, the NCA frame is firstly added and exchanged between neighbor nodes periodically, which helps to resolve the inaccurate traffic load information, so as to avoid reducing the probability of successful message transmission. Then a traffic-loading based back-off algorithm is involved to make the neighbor nodes cooperatively adjust the inter-frame space (IFS) interval to further reduce the unfairness. The simulation results show that, the proposed MAC protocol can guarantee the satisfied fairness, simultaneously avoiding heavy network overloads to protect key messages’ successful transmissions in ASNs.

Preserving and restoring biodiversity is becoming a great challenge as we face a world where planetary boundaries will likely be crossed over the following decades. Such challenge needs to consider multiple scales of complexity, both in space and time. A common thread in most cases is the presence of nonlinear phenomena generating shifts among alternative states. These breaking points imply a new perception of risk and different management strategies. A broad range of phenomena affect the preservation of healthy communities and constrain the ways to deal with conservation, from local features associated with habitat loss or facilitation to mesoscale or global network-level ecological complexity and the role played by extreme events. How are these scales connected? How can the emergent properties associated with ecosystem dynamics be exploited? Here a synthesis of ideas is presented, with a complex systems view of the different scales involved, the emergent phenomena separating them, and the universal properties that allow defining simple models on each scale.

The rapid growth of network services, Internet of Things devices and online users on the Internet have led to an increase in the amount of data transmitted daily. As more and more information is stored and transmitted on the Internet, cybercriminals are trying to gain access to the information to achieve their goals, whether it is to sell it on the dark web or for other malicious intent. Through thorough literature study relating to the causes and issues that are brought from the security and privacy segment of wireless networks, it is observed that there are various factors that can cause the networks to be an insecure; especially factors that revolve around cybercriminals with their growing expertise and the lack of preparation and efforts to combat them by relevant bodies. The aim of this paper is to showcase major and frequent security as well as privacy issues in wireless networks along with specialized solutions that can assist the related organizations or the public to fathom how great of an impact these challenges can bring if every related stakeholder took a step in reducing them. Through this paper it is discovered that there are many ways these challenges can be mitigated, however, the lack of implementation of privacy and security solutions is still largely present due to the absence of practical application of these solutions by responsible parties in real world scenarios.

Rural electrification rate (RER) in Africa is still low to date. Several countries in Sub-Saharan Africa have tried to address this problem using conventional single-phase two-wire or three-phase three-wire systems, however at large costs due to the nature of dispersed rural load centers, low load demand, and low population density. Another solution of off-grid generation creates associated health problems. Therefore, this paper undertakes a review of a single wire earth return (SWER) network as a RER improvement solution. The paper undertakes intensive literature review to elucidate challenges and solutions to the implementation of SWER technology. Advantages of SWER technology discussed make it the choice for RER improvement in Sub-Saharan African countries. After that, a case study is selected in rural Tanzania, and a preliminary SWER network design is undertaken.

Clients are increasingly looking for fast and effective means to quickly and frequently survey and communicate the condition of their buildings so that essential repairs and maintenance work can be done in a proactive and timely manner before it becomes too dangerous and expensive. Traditional methods for this type of work commonly comprise of engaging building surveyors to undertake a condition assessment which involves a lengthy site inspection to produce a systematic recording of the physical condition of the building elements, including cost estimates of immediate and projected long-term costs of renewal, repair and maintenance of the building. Current asset condition assessment procedures are extensively time consuming, laborious, and expensive and pose health and safety threats to surveyors, particularly at height and roof levels which are difficult to access. We propose a method for automated detection and localisation of key building defects from images using deep learning and convolution neural networks. The proposed model is based on a pre-trained VGG-16 classifier with Class Activation Mapping (CAM) for object localisation. The model has proven to be robust and able to accurately detect and localise mould growth, stains, and paint deterioration defects arising from dampness in buildings. The approach is being developed with potentials to scale-up to support automated detection of defects and deterioration of buildings in real-time using mobile devices and drones.

We present and benchmark FilterNet, a flexible deep learning architecture for time series classification tasks, such as activity recognition via multichannel sensor data. It adapts popular CNN and CNN-LSTM motifs which have excelled in activity recognition benchmarks, implementing them in a many-to-many architecture to markedly improve frame-by-frame accuracy, event segmentation accuracy, model size, and computational efficiency. We propose several model variants, evaluate them alongside other published models using the Opportunity benchmark dataset, demonstrate the effect of model ensembling and of altering key parameters, and quantify the quality of the models’ segmentation of discrete events. We also offer recommendations for use and suggest potential model extensions. FilterNet advances the state of the art in all measured accuracy and speed metrics on the benchmarked dataset, and it can be extensively customized for other applications.

Multiply-accumulate calculations using a memristor crossbar array is an important method to realize neuromorphic computing. However, the memristor array fabrication technology is still immature, and it is difficult to fabricate large-scale arrays with high-yield, which restricts the development of memristor-based neuromorphic computing technology. Therefore, cascading small-scale arrays to achieve the neuromorphic computational ability that can be achieved by large-scale arrays, which is of great significance for promoting the application of memristor-based neuromorphic computing. To address this issue, we present a memristor-based cascaded framework with some basic computation units, several neural network processing units can be cascaded by this means to improve the processing capability of the dataset. Besides, we introduce a split method to reduce pressure of input terminal. Compared with VGGNet and GoogLeNet, the proposed cascaded framework can achieve 93.54% Fashion-MNIST accuracy under the 4.15M parameters. Extensive experiments with Ti/AlOx/TaOx/Pt we fabricated are conducted to show that the circuit simulation results can still provide a high recognition accuracy, and the recognition accuracy loss after circuit simulation can be controlled at around 0.26%.

In order for robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities in order to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged on top of an object to securely grab it between the robotic gripper and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the application of deep learning methods in task generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. A number of the most promising approaches are evaluated and the most successful for grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is identified as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

Supply chain management requires regular updates of the location of assets, which can be enabled by low power wide area networks, such as Sigfox. While it is useful to localize a device simply by its communication signals, this is very difficult to do with Sigfox because of wide area and ultra narrowband nature. On the other hand, installing a satellite localization element on the device greatly increases its power consumption. We investigated using information about nearby Wi-Fi access points as a way to localize the asset over the Sigfox network, so without connecting to those Wi-Fi networks. This paper reports the location error that can be achieved by this type of outdoor localization. By using a combination of two databases, we could localize the device on all 36 test locations with a median location error of 39 m. This shows that the localization accuracy of this method is promising enough to warrant further study, most specifically the minimal power consumption.

This paper attempts at applying adaptive network-based fuzzy inference system (ANFIS) for analysis of the resonant frequency of a microstrip rectangular patch antenna with two equal size slots which are placed on the patch vertically. The resonant frequency is calculated as the position of slots is shifted to the right and left sides on the patch. As a result , the antenna resonates at more than one frequency . Commonly, machine algorithms based on artificial neural networks are employed to recognize the whole resonant frequencies. However ,they fail to estimate the resonant frequencies correctly as in some cases variations are not very sensible and the resonant frequencies overlap each other . It can be concluded that artificial neural networks could be replaced in such designs by the adaptive network-based fuzzy Inference system due to its high approximation capability and much faster convergence rate.

This work addresses the problem of the application of artificial intelligence to the creation and maintenance of medical documentation and the use of big data in medicine to support efficient patient diagnosis and treatment. This study covers the latest advances in AI and big data, based on literature reviews and interviews with leading experts in these fields. The following conclusions were obtained: (1) Based on the needs of patients and providers of medical services, and given the latest technological advances, all medical documentation should be digital and the processes of its creation, access, sharing, and consistency checking should by supported by suitably designed AI systems. (2) The knowledge contained in medical documentation constitutes a resource of strategic importance for humanity, with almost unlimited potential. (3) All medical documentation should be anonymised and should be made widely available, just like data and research results in the field of experimental physics. (4) This will accelerate development of new treatments, best practice and help to identify new medical emergencies, such as Covid-19. In practice today, unfortunately, the design of medical record systems is fragmented between institutions and countries, often focusing discussions on narrow technical details, and forcing clinicians to waste time on filling up multiple pages of illness history. This leads to many inefficiencies and lost opportunities and necessitates a fundamentally new approach.

Deep learning has taken over - both in problems beyond the realm of traditional, hand-crafted machine learning paradigms as well as in capturing the imagination of the practitioner sitting on top of petabytes of data. While the public perception about the efficacy of deep neural architectures in complex pattern recognition tasks grows, sequentially up-to-date primers on the current state of affairs must follow. In this review, we seek to present a refresher of the many different stacked, connectionist networks that make up the deep learning architectures followed by automatic architecture optimization protocols using multi-agent approaches. Further, since guaranteeing system uptime is fast becoming an indispensable asset across multiple industrial modalities, we include an investigative section on testing neural networks for fault detection and subsequent mitigation. This is followed by an exploratory survey of several application areas where deep learning has emerged as a game-changing technology - be it anomalous behavior detection in financial applications or financial time-series forecasting, predictive and prescriptive analytics, medical imaging, natural language processing or power systems research. The thrust of this review is on outlining emerging areas of application-oriented research within the deep learning community as well as to provide a handy reference to researchers seeking to embrace deep learning in their work for what it is: statistical pattern recognizers with unparalleled hierarchical structure learning capacity with the ability to scale with information.

Data generation using high throughput technologies has led to the accumulation of diverse types of molecular data.These data have different types (discrete,real,string etc.) and occur in various formats and sizes. Datasets including gene expression, miRNA expression, protein-DNA binding data (ChIP-Seq/ChIP-ChIP), mutation data(copy number variation, single nucleotide polymorphisms), GO annotations, protein-protein interaction and disease-gene association data are some of the commonly used genomic datasets to study biological processes. Each of them provides a unique, complementary and partly independent view of the genome and hence embed essential information about their regulatory mechanisms. In order to understand the functions of genes, proteins and analyze mechanisms arising out of their interactions, information provided by each of these datasets individually may not be sufficient. Therefore integrating these multi-omic data and inferring regulatory interactions from the integrated dataset provides a system level biological insights in predicting gene functions and their phenotypic outcomes. To study genome functionality through interaction networks, different methods have been proposed for collective mining of information from an integrated dataset. We survey here data integration approaches using state-of-the-art techniques such as network integration, Bayesian networks, regularized regression (LASSO) and multiple kernel learning methods.

For any positive integer n ≥ 2, the Erdős-Straus Conjecture claims that the Diophantine equation 4/n = 1/x + 1/y + 1/z has a solution where x, y, z are also positive integers. In this paper, a directed network based on this equation is generated, with properties such as its average clustering coefficient, average path length, degree distributions, and largest strongly connected component analysed to reveal some underlying trends about the nature of the conjecture. Potential connections between different numbers, that result from satisfying a source-solution relationship for this equation, are described using the appropriate number-theoretic interpretations wherever possible, while conjectures backed by these trends are made in other instances. Additionally, a directed configuration model is used to show that the origin of several results is the degree sequence of the network. Metrics relating to the prime number nodes, specifically their in and out degrees, are also explored to yield some intriguing observations. On the whole, the aim is to highlight the viability of complex networks as a computational tool to study this general class of problems pertaining to fixed-length unit fraction splits.

It is very difficult to accurately divide farmland and woodland in Gaofen 2 (GF-2) remote sensing image, because their single plant coverage is very small, and their spectra are very similar. The ratio of spatial resolution and one plant’s coverage area must be fully taken into account when designing the Convolutional Neural Network structure for extracting them from GF-2 image. We establish a Convolutional Encode Neural Networks model (CENN), The first layer has two sets of convolution kernels to learn the characteristics of farmland and woodland respectively, while the second layer is the encoder to encode the characteristics by transfer function, which can map the results to the corresponding category number. In the training stage, samples of farmland, woodland, and other categories are categorically used to train CENN, as soon as training is accomplished, CENN would acquire enough ability to accurately extract farmland and woodland from remote sensing images. The final extraction result is obtained by implementing per-pixel segmentation of images used to train the CENN. CENN is compared and analyzed with others such as Deep Belief Network (DBN), Full Convolutional Network (FCN), Deeplab Model. The results of experiments show that CENN can more accurately mine the characteristics of farmland and woodland, and it achieves its goal of extracting farmland and woodland with high precision from GF-2 images.

When extract building from high resolution remote sensing image with meter/sub-meter accuracy, the shade of trees and interference of roads are the main factors of reducing the extraction accuracy. Proposed a Bayesian Convolutional Neural Networks(BCNET) model base on standard fully convolutional networks(FCN) to solve these problems. First take building with no shade or artificial removal of shade as Sample-A, woodland as Sample-B, road as Sample-C. Set up 3 sample libraries. Learn these sample libraries respectively, get their own set of feature vector; Mixture Gauss model these feature vector set, evaluate the conditional probability density function of mixture of noise object and roofs; Improve the standard FCN from the 2 aspect:(1) Introduce atrous convolution. (2) Take conditional probability density function as the activation function of the last convolution. Carry out experiment using unmanned aerial vehicle(UVA) image, the results show that BCNET model can effectively eliminate the influence of trees and roads, the building extraction accuracy can reach 97%.

Multi-floor environments are usually ignored while designing an autonomous robot for indoor cleaning applications. However, for efficient operation in such environments, the ability of a robotic platform to traverse staircases is crucial. Staircase detection and localization is highly important for planning the traversal on staircases. This paper describes a deep learning approach using Convolutional Neural Networks (CNNs) based Robot Operation System (ROS) to staircase detection and localization. We use an object detection network to detect staircases in images. We also localize these staircases using a contour detection algorithm to detect the target point, a point close to the center of the first step, and the angle of approach to the target point. Experiments are performed with data obtained from images captured on different types of staircases at different view points/angles. Results show that the approach is very accurate in identifying the presence of the staircase in the working environment and is also able to locate the target point with good accuracy.

In recent years, increasing attention has been paid to individuals organizing themselves and managing food systems in an ‘alternative’ and more sustainable way. Such emerging food initiatives are most commonly known as ‘Alternative Food Networks’ (AFNs). However, there is an ongoing debate concerning the extent to which AFNs facilitate social, economic and environmental change. There are criticisms of the overall sustainability promise of AFNs related to sufficiency of impact, possible counter effects and relevance of impacts. Because often empirical studies only focus on specific sustainability issues or AFNs, it has been difficult to develop more robust theories about the relations between diverse AFNs arrangements and sustainability. Thus, the aim of this paper is to contribute towards reducing this knowledge gap through a systematic literature review on AFNs in relation to sustainability. We summarize main methodological approaches, types of AFNs studied and sustainability dimensions addressed in literature to date. Findings serve as reference to propose opportunities for future research regarding sustainability in AFNs.

This paper proposes a hybrid medium access control (MAC) protocol for wireless sensor network (WSN) data gathering, employing unmanned aerial vehicles (UAV). The UAV sends a beacon frame periodically to inform sensor nodes regarding its presence. Afterward, each sensor node which receives beacon frame contends to send registration frame to the UAV. The UAV will transmit the second beacon frame to the registered nodes to notify their transmission schedule. The time-slot scheme is used for the transmission schedule. The transmission schedule of each sensor is determined based on their priority. Specifically, the priority of each sensor is determined during the registration process. Furthermore, the architecture of UAV-WSN data gathering system is introduced in this paper. Simulations are performed, showing that the proposed MAC protocol achieves fairness while enhancing network performance.

The development of wireless sensor networks (WSNs) technology comes with inherent limitations and vulnerabilities that make it exploitable by intruders. The fundamental goal of this article is to solve security problems related to black hole attacks, which interfere with the proper performance of the network and can lead to data leakage and loss. The proposed solution in this article is to apply IDS to a WSN for the first time. We also used the NS2.35 simulator to compare the three routing protocols, AODV, AODV under Hacker Node (HNAODV), and the proposed solution (IDSHNAODV) in the WSN model to reduce the effects of black hole attacks.

Automatic methods for constructing navigation routes do not fully meet all requirements. The aim of this study was to modify the methodology for generating indoor navigation models based on the Medial Axis Transformation (MAT) algorithm. The simplified method for generating corridor axes relies on the Node-Relation Structure (NRS) methodology. The axis of the modeled structure (corridor) is determined based the points of the middle lines intersecting the structure (polygon). The proposed solution involves a modified approach to the segmentation of corridor space. Traditional approaches rely on algorithms to construct Triangulated Irregular Networks (TINs) by Delaunay triangulation or algorithms for generating Thiessen polygons known as Voronoi diagrams (VDs). In this study, both algorithms were used in the segmentation process. The edges of TINs intersect structures. Selected midpoints on TIN edges, which are located in the central part of the structure, are used to generate VDs. Polygon VDs segment corridor structures. The identifiers or structure nodes are the midpoints on TIN edges rather than the calculated centroids. The generated routes are not zigzag lines, and they approximate natural paths. The main advantage of the proposed solution is its simplicity which can be attributed to the use of standard tools for processing spatial data in a geographic information system.

Efficiently solving the problem of computing, in a distributed fashion, the shortest paths of a graph whose topology dynamically changes over time is a core functionality of many today’s digital infrastructures, probably the most prominent example being communication networks. Many solutions have been proposed over the years for this problem that can be broadly classified into two categories, namely Distance-Vector and Link-State algorithms. Distance-Vector algorithms are widely adopted solutions when scalability and reliability are key issues or when nodes have either limited hardware resources, as they result in being very competitive approaches in terms of both the memory and the computational point of view. In this paper, we first survey some of the most established solutions of the Distance-Vector category. Then, we discuss some recent algorithmic developments in this area. Finally, we propose a new experimental study, conducted on a prominent category of network instances, namely generalized linear preference (GLP) power-law networks, to rank the performance of such solutions.

Climate change has become the greatest threat to the survival of world and its ecosystem. With the irreversible impact on the ecosystem, problems like rise in sea level, food-insecurity, natural resources scarcity, seasonal disorders have increased over the past few years. Among these problems, the issue of water scarcity due to the lack of water resources and global warming has plagued several nations. Owing to the rising concerns over water scarcity United Nations (UN) has acknowledged water as a primary resource to the development of societies under the ‘Water Goal’ of the sustainable development goals. As the changing climate and intermittent availability of water resources pose major challenges to forecast demand, especially in countries like the United Arab Emirates (UAE) which has one of the highest per capita residential water consumption rates in the world. Therefore, the aim of this study is to propose an accurate water demand forecasting technique that incorporates all significant factors to predict the future water demands of the UAE. The forecasting model used is the Long Short Term Memory (LSTM), with the factors considered are mean temperature, mean rainfall, relative humidity, Gross Domestic Product (GDP), Consumer Price Index (CPI) and population growth. The LSTM model predicts the water demand forecasting in the UAE showing that the future demand will decrease from 1821 million m3 in 2018 to 1809.9 million m3 in 2027.

We consider the problem of coordinating the charging of an entire fleet of electric vehicles (EV), using a model-free approach, i.e. purely data-driven reinforcement learning (RL). The objective of the RL-based control is to optimize charging actions, while fulfilling all EV charging constraints (e.g. timely completion of the charging). In particular, we focus on batch-mode learning and adopt fitted Q-iteration (FQI). A core component in FQI is approximating the Q-function using a regression technique, from which the policy is derived. Recently, a dueling neural networks architecture was proposed and shown to lead to better policy evaluation in the presence of many similar-valued actions, as applied in a computer game context. The main research contributions of the current paper are that (i)we develop a dueling neural networks approach for the setting of joint coordination of an entire EV fleet, and (ii)we evaluate its performance and compare it to an all-knowing benchmark and an FQI approach using EXTRA trees regression technique, a popular approach currently discussed in EV related works. We present a case study where RL agents are trained with an epsilon-greedy approach for different objectives, (a)cost minimization, and (b)maximization of self-consumption of local renewable energy sources. Our results indicate that RL agents achieve significant cost reductions (70--80%) compared to a business-as-usual scenario without smart charging. Comparing the dueling neural networks regression to EXTRA trees indicates that for our case study's EV fleet parameters and training scenario, the EXTRA trees-based agents achieve higher performance in terms of both lower costs (or higher self-consumption) and stronger robustness, i.e. less variation among trained agents. This suggests that adopting dueling neural networks in this EV setting is not particularly beneficial as opposed to the Atari game context from where this idea originated.

Accurate estimates of daily rainfall are essential for understanding and modeling the physical processes involved in the interaction between the land surface and the atmosphere. In this study, daily satellite soil moisture observations from the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) generated by implementing the standard NASA- algorithm are employed for estimating rainfall, firstly, through the use of recently developed approach, SM2RAIN (Brocca et al., 2013) and, secondly, the nonlinear autoregressive network with exogenous inputs (NARX) neural modelling at five climate stations in the Karkheh river basin (KRB), located in southwest Iran. In the SM2RAIN method, the period 1 January 2003 to 31 December 2005 is used for the calibration of algorithm and the remaining 9 months from 1 January 2006 to 30 September 2006 is used for the validation of the rainfall estimates. In the NARX model, the full study period is split into a training (1 January 2003 to 31 September 2005) and a testing (1 September 2005 to 30 September 2006) stage. For the prediction of the rainfall as the desired target (output), relative soil moisture changes from AMSR-E and measured air temperature time series are chosen as exogenous (external) inputs in NARX. The quality of the estimated rainfall data is evaluated by comparing it with observed rainfall data at the five rain gauges in terms of the correlation coefficient R, the RMSE and the statistical bias. For the SM2RAIN method, R ranges between 0.44 and 0.9 for all stations, whereas for the NARX- model the values are generally slightly lower. Moreover, the values of the bias for each station indicate that although SM2RAIN is likely to underestimate large rainfall intensities, due to the known effect of soil moisture saturation, its biases are somewhat lower than those of NARX. In conclusion, the results of the present study show that with the use of AMSR-E soil moisture products in the physically based SM2RAIN- algorithm as well as in the NARX neural network, rainfall for poorly gauged regions can be fairly predicted.

Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include the detection of individual trees, tree species classification, bio-mass estimation, etc. Deep Neural Networks (DNN) have shown superior results when comparing with conventional machine learning methods such as Multi-Layer Perceptron (MLP) in cases of huge input data. The objective of this research was to investigate 3D convolutional neural networks (3D-CNN) to classify three major tree species in a boreal forest: pine, spruce, and birch. The proposed 3D-CNN models were employed to classify tree species in a test site in Finland. The classifiers were trained with a dataset of 3039 manually labelled trees. Then the accuracies were assessed by employing independent datasets of 803 records. To find the most efficient set of feature combination, we compare the performances of 3D-CNN models trained with hyperspectral (HS) channels, RGB channels, and canopy height model (CHM), separately and combined. It is demonstrated that the proposed 3D-CNN model with RGB and HS layers produces the highest classification accuracy. The producer accuracy of the best 3D-CNN classifier on the test dataset were 99.6%, 94.8%, and 97.4% for pines, spruces, and birches, respectively. The best 3D-CNN classifier produced ~5% better classification accuracy than the MLP with all layers. Our results suggest that the proposed method provides excellent classification results with acceptable performance metrics for HS datasets. Our results show that pine class was detectable in most layers. Spruce was most detectable in RGB data, while birch was most detectable in the HS layers. Furthermore, the RGB datasets provide acceptable results for many low-accuracy applications.

Many complex networks have a connectivity that might be only partially detected or that tends to grow over time, hence the prediction of non-observed links is a fundamental problem in network science. The aim of topological link prediction is to forecast these non-observed links by only exploiting features intrinsic to the network topology. It has a wide range of real applications, like suggesting friendships in social networks or predicting interactions in biological networks.The Cannistraci-Hebb theory is a recent achievement in network science that includes a theoretical framework to understand local-based link prediction on paths of length n. In this study we introduce two innovations: theory of modelling (science) and theory of realization (engineering). For the theory of modelling we first recall a definition of network automata as a general framework for modelling the growth of connectivity in complex networks. We then show that several deterministic models previously developed fall within this framework and we introduce novel network automata following the Cannistraci-Hebb rule. For the theory of realization, we present how to build adaptive network automata for link prediction, which incorporate multiple deterministic models of self-organization and automatically choose the rule that better explains the patterns of connectivity in the network under investigation. We compare Cannistraci-Hebb adaptive (CHA) network automaton against state-of-the-art link prediction methods such as structural perturbation method (SPM), stochastic block models (SBM) and artificial intelligence algorithms for graph embedding. CHA displays an overall higher link prediction performance across different evaluation frameworks on 1386 networks. Finally, we highlight that CHA offers the key advantage to explicitly explain the mechanistic rule of self-organization which leads to the link prediction performance, whereas SPM and graph embedding not. In comparison to CHA, SBM unfortunately shows irrelevant and unsatisfactory performance demonstrating that SBM modelling is not adequate for link prediction in real networks.

The upsurge of Generative Adversarial Networks (GANs) in the previous five years has led to advancements in unsupervised data manipulation, sourced feature translation, and precise input-output synthesis through a competitive optimization of the discriminator and generator networks. More specifically, the recent rise of cycle-consistent GANs enables style transfers from a discrete source (input A) to target domain (input B) by preprocessing object features for a multi-discriminative adversarial network. Traditionally, cyclical adversarial networks have been exploited for unpaired image-to-image translation and domain adaptation by determining mapped relationships between an input A graphic and an input B graphic. However, this integral mechanism of domain adaptation can be applied to the complex acoustical features of human speech. Although well-established datasets, such as the 2018 Voice Conversion Challenge repository, paved way for female-male voice transformation, cycle-GANs have rarely been re-engineered for voices outside the datasets. More critically, cycle-GANs have massive potential to extract surface-level and hidden feature to distort an input A source into a texturally unrelated target voice. By preprocessing, compressing, and packaging unique acoustical voice properties, CycleGANs can learn to decompose speech signals and implement new translation models while preserving emotion, the intent of words, rhythm, and accents. Due to the potential of CycleGAN’s autoencoder in realistic unsupervised voice-voice conversion/feature adaptation, the researchers raise the ethical implications of controlling source input A to manipulate target voice B, particularly in cases of defamation and sabotage of target B’s words. This paper analyzes the potential of cycle-consistent GANs in deceptive voice-voice conversion by manipulating interview excerpts of political candidates.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

We focus on macromolecules which are modelled as sequentially growing dual scale-free networks. The dual networks are built by replacing star-like units of the primal treelike scale-free networks through rings, which are then transformed in a small-world manner up to the complete graphs. In this respect, the parameter γ describing the degree distribution in the primal treelike scale-free networks regulates the size of the dual units. The transition towards the networks of complete graphs is controlled by the probability p of adding link between non-neighbouring nodes of the same initial ring. The relaxation dynamics of the polymer networks is studied in the framework of generalized Gaussian structures by using the full eigenvalue spectrum of the Laplacian matrix. The dynamical quantities on which we focus here are the averaged monomer displacement and the mechanical relaxation moduli. For several intermediate values of the parameter’s set (γ, p) we encounter for these dynamical properties regions of constant in-between slope.

Pipelines are widely used for transportation of hydrocarbon fluids over millions of miles over the world. The structures of the pipelines are designed to withstand several environmental loading conditions to ensure safe and reliable distribution from point of production to the shore or distributions deport. However, leaks in pipeline networks are one of the major causes of innumerable losses in pipeline operators and nature. Incidents of pipeline failure can result in serious ecological disasters, human casualties and financial loss. In order to avoid such menace and maintain safe and reliable pipeline infrastructure, substantial research efforts have been devoted to implementing pipeline leak detection and localisation using different approaches. This paper discusses on pipelines leakage detection technologies and summarises the state-of-the-art achievements. Different leakage detection and localisation in pipeline systems are reviewed and their strengths and weaknesses are highlighted. Comparative performance analysis is performed to provide a guide in determining which leak detection method is appropriate for particular operating settings. In addition, research gaps and open issues for development of reliable pipeline leakage detection systems are discussed.

Small non-coding RNAs (sRNAs) are ubiquitously found in the three domains of life playing large-scale roles in gene regulation, transposable element silencing, and defense against foreign elements. While a substantial body of experimental work has been done to uncover function of sRNAs in Bacteria and Eukarya, the functional roles of sRNAs in Archaea are still poorly understood. Recently, high throughput studies using RNA-sequencing revealed that sRNAs are broadly expressed in the Archaea, comprising thousands of transcripts within the transcriptome during non-challenged and stressed conditions. Antisense sRNAs, which overlap a portion of a gene on the opposite strand (cis-acting), are the most abundantly expressed non-coding RNAs and they can be classified based on their binding patterns to mRNAs (3’ UTR, 5’ UTR, CDS-binding). These antisense sRNAs target many genes and pathways, suggesting extensive roles in gene regulation. Intergenic sRNAs are less abundantly expressed and their targets are difficult to find because of a lack of complete overlap between sRNAs and target mRNAs (trans-acting). While many sRNAs have been validated experimentally, a regulatory role has only been reported for very few of them. Further work is needed to elucidate sRNA-RNA binding mechanisms, the molecular determinants of sRNA-mediated regulation, whether protein components are involved, and how sRNAs integrate with complex regulatory networks.

With the pressure of the increasing density of urban areas, some public infrastructures are moving to the underground to free up space above, such as utility lines, rail lines and roads. In the big data era, the three dimensional (3D) data can be beneficial to understand the complex urban area. Comparing to spatial data and information of the above ground, we lack of the precise and detailed information about underground infrastructures, such as the spatial information of underground infrastructure, the ownership of underground objects and the interdependence of infrastructures in the above and below ground. How to map reliable 3D underground utility networks and use it in the land administration? First, to explain the importance of this work and find a possible solution, this paper observes the current issues of the existing underground utility database in Singapore. A framework for utility data governance is proposed to manage the work process from the underground utility data capture to data usage. This is the backbone to support the coordination of different roles in the utility data governance and usage. Then, an initial design of the 3D underground utility data model is introduced to describe the 3D geometric and spatial information about underground utility data and connect it to the cadastral parcel for land administration. In the case study, the newly collected data from mobile Ground Penetrating Radar is integrated with the existing utility data for 3D modelling. It is expected to explore the integration of new collected 3D data, the existing 2D data and cadastral information for land administration of underground utilities.

Due to its spatio-temporal variability, the mismatch between the weather and demand patterns challenges the design of highly renewable energy systems. A principal component analysis is applied to a simplified networked European electricity system with a high share of wind and solar power generation. It reveals a small number of important mismatch patterns, which explain most of the system's required backup and transmission infrastructure. Whereas the first principal component is already able to reproduce most of the temporal mismatch variability for a solar dominated system, a few more principal components are needed for a wind dominated system. Due to its monopole structure the first principal component causes most of the system's backup infrastructure. The next few principal components have a dipole structure and dominate the transmission infrastructure of the renewable electricity network.

In this paper we address one of the most important topics in the field of Social Networks Analysis: the community detection problem with additional information. That additional information is modeled by a fuzzy measure that represents the possibility of polarization. Particularly, we are interested in dealing with the problem of taking into account the Polarization of nodes in the community detection problem. Adding this type of information to the community detection problem makes it more realistic, as a community is more probably to be defined if the corresponding elements are willing to maintain a peaceful dialogue. The polarization capacity is modeled by a fuzzy measure based on the JDJpol measure of polarization related to two poles. We also present an efficient algorithm for finding groups whose elements are no polarized. Hereafter, we work in a real case. It is a network obtained from Twitter, concerning the political position against the Spanish government taken by several influential users. We analyze how the partitions obtained change when some additional information related to how polarized that society is, is added to the problem.

In the present work, a novel and the robust computational investigation is carried out to estimate solubility of different acids in supercritical carbon dioxide. Four different algorithms such as radial basis function artificial neural network, Multi-layer Perceptron (MLP) artificial neural network (ANN), Least squares support vector machine (LSSVM) and adaptive neuro-fuzzy inference system (ANFIS) are developed to predict the solubility of different acids in carbon dioxide based on the temperature, pressure, hydrogen number, carbon number, molecular weight, and acid dissociation constant of acid. In the purpose of best evaluation of proposed models, different graphical and statistical analyses and also a novel sensitivity analysis are carried out. The present study proposed the great manners for best acid solubility estimation in supercritical carbon dioxide, which can be helpful for engineers and chemists to predict operational conditions in industries.

The intensive care units in North West London are part of one of the oldest critical carenetworks in the UK, forming a mature and established strategic alliance to shareresources, experience and knowledge for the benefit of its patients. North WestLondon saw an early surge in COVID-19 admissions, which urgently threatened thecapacity of some of its intensive care units even before the UK government announcedlockdown. The pre-existing relationships and culture within the network allowed itsmembers to unite and work rapidly to develop agile and innovative solutions, protectingany individual unit from becoming overwhelmed, and ultimately protecting its patients.Within a short 50-day period 223 patients were transferred within the network todistribute pressures. This unprecedented number of critical care transfers, combinedwith the creation of extra capacity and new pathways, allowed the region to continue tooffer timely and unrationed access to critical care for all patients who would benefitfrom admission. This extraordinary response is a testament to the power and benefitsof a regionally networked approach to critical care, and the lessons learned maybenefit other healthcare providers, managers and policy makers, especially in regionscurrently facing new outbreaks of COVID-19.

In this work we identify combinations of technological activities that signal the presence local capabilities in a country to successfully export a product. We use country-level patent and trade data to generate a multi-layer network, and we apply maximization of entropy to generate synthetic data to effectively divide signal from noise. We show that in several sectors the signal far exceed the noise. Our exercise provides robust evidence of the presence of synergies between technologies to explain trade performances in specific markets. This can be highly useful for policy makers, to inform industrial and innovation policies.

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

In recent years, online social networks have received important consideration in spatial modelling fields given the critical information that can be extracted from them for events in real time; one of the most latent issues is that regarding various natural disasters such as earthquakes. Although it is possible to retrieve data from these social networks with embedded geographic information provided by GPS, in many cases this is not possible. An alternative solution is to reconstruct specific locations using probabilistic language models, more specifically those based on Name Entity Recognition (NER), which extracts names from a user’s description about an event occurring in a specific place (e.g., a collapsed building on a specific avenue). In this work, we present a methodology to use twitter as a social sensor system for disasters. The methodology scores NER locations with a kernel density estimation function for different subtopics originating from a natural disaster and that maps them into a geographic space is proposed. The proposed methodology is evaluated with tweets related to the 2017 earthquake in Mexico.

Selected by in vitro techniques (SELEX, cell-SELEX), aptamers are strands of DNA or RNA molecules able to bind a wide range of targets, from small molecules to live cells, and even tissues, with high affinity and specificity. Due to their efficient targeting ability, aptamers are extensively used in different fields of applications. For example, they ensure high performance as cancer-related markers or in recognizing cancer cells. Actually, they represent a promising way for early diagnosis (biosensors) and to deliver imaging agents and drugs, in both cancer imaging and therapy (therapeutic aptamers). Aptamer-based biosensors (aptasensors) have attracted particular attention over the last decades, so as the possibility of using aptamers in disease therapy in substitution of monoclonal antibodies. The paper briefly reviews the most recent literature on this topic, both concerning the advances in biomedical applications and in the development of electrical aptasensors. The investigation concerning the bioelectronics features of aptamers, to be implemented in the development of electrical nanobiosensors, is also reviewed. To this aim, some recent results of a theoretical/computational framework for modelling the electrical properties of biomolecules (Proteotronics) are reported.

In the field of autonomous vehicles, lane detection and control plays an important role. In autonomous driving the vehicle has to follow the path to avoid the collision. A deep learning technique is used to detect the curved path in autonomous vehicles. In this paper a customized lane detection algorithm was implemented to detect the curvature of the lane. A ground truth labelling tool box for deep learning is used to detect the curved path in autonomous vehicle. By mapping point to point in each frame 80-90% computing efficiency and accuracy is achieved in detecting path.

This paper proposes several LabVIEW applications to accomplish the data acquisition, processing, features extraction and real-time classification of the electroencephalographic (EEG) signal detected by the embedded sensor of the NeuroSky Mindwave Mobile headset. The LabVIEW applications are aimed at the implementation of a Brain-Computer Interface system, which is necessary to people with neuromotor disabilities. It is analyzed a novel approach regarding the preparation and automatic generation of the EEG dataset by identifying the most relevant multiple mixtures between selected EEG rhythms (both time and frequency domains of raw signal, delta, theta, alpha, beta, gamma) and extracted statistical features (mean, median, standard deviation, route mean square, Kurtosis coefficient and others). The acquired raw EEG signal is processed and segmented into temporal sequences corresponding to the detection of the multiple voluntary eye-blinks EEG patterns. The main LabVIEW application accomplished the optimal real-time artificial neural networks techniques for the classification of the EEG temporal sequences corresponding to the four states: 0 - No Eye-Blink Detected; 1 - One Eye-Blink Detected; 2 – Two Eye-Blinks Detected and 3 – Three Eye-Blinks Detected. Nevertheless, the application can be used to classify other EEG patterns corresponding to different cognitive tasks, since the whole functionality and working principle could estimate the labels associated with various classes.

Conservation of natural habitats in human-dominated landscapes is critical for halting biodiversity loss. Maintaining habitat quantity and connectivity requires landscape-level collective action, which results from environmental decisions made by individual land owners. We investigate how individual decision making in a rural collective translates into quantitative differences in landscape-level environmental outcomes. Behavioral science has become a critical domain of knowledge in conservation, but little attention has been paid to how multiple behavioral drivers determine the success of collective environmental action. We developed a social-ecological model for landscape-level conservation using a detailed data set of 600 land owners in New Zealand. With the model, we tested whether the effect of social influence networks on collective conservation action was altered by their interplay with land owners’ personal characteristics, connections to cross-scale actors and local environmental contexts. Interactions between multiple behavioral drivers determined the environmental outcomes of collective action in unexpected ways by modifying, muting or amplifying the effects of single drivers. Importantly, we detected a social-ecological mechanism for rapid change in the extent of protected habitats, which can explain highly successful or failed environmental outcomes of collective conservation. Further, when environmentally desirable and undesirable behaviors spread simultaneously through the social network, homophily and network cohesion hinder desirable environmental outcomes. This effect can be modified by other drivers such as social responses to local environmental change. Thus, understanding how the antagonistic and synergistic effects of behavioral drivers can be best utilized in conservation will benefit biodiversity and ensure benefits that humans obtain from biodiversity.

Clinical work conducted over the last seventeen years at the EEG Institute in Los Angeles and by other neurofeedback providers around the world has demonstrated the utility of extending frequency-based neurofeedback deep into the infra-low frequency (ILF) region, using the method of endogenous neuromodulation described herein. The method is characterized by the absence of any overt reinforcements, which makes it possible to extend the clinical reach to extremely low frequencies. As the training frequency is lowered, the signal becomes more difficult to discriminate, and ultimately it can only be discerned by the brain itself, in the process of endogenous neuromodulation. The method emulates how the brain does skill learning in general: It must observe itself performing the skill, with feedback on its performance. While the immediate target of ILF neurofeedback is enhanced self-regulatory competence--with symptomatic relief and functional recovery the secondary consequences, progressive lowering of the target frequencies has led to improved outcomes in application to challenging dysfunctions such as episodic suicidality, migraine, seizures, and bipolar mood swings. The work has also yielded insights into how the frequency domain is organized. The training proceeds best at frequencies that are specific to each individual, and these are referred to as optimal response frequencies (ORFs). These frequencies differ for various placements but stand in two fixed relationships to one another, one that holds over the EEG spectral range, and another that holds over the entire ILF range. Training in the ILF region engages the dynamics of the glial-neuronal networks, which govern tonic, resting state regulation. The collective clinical experience with ILF neuromodulation within a large practitioner network supports the case for making protocol-based, individualized ‘homeodynamic’ regulation a therapeutic priority, particularly for our most impacted clinical populations: addiction, trauma formations, traumatic brain injury, and the dementias. The case is made for further outcome studies and foundational research.

This study is framed on the Information Theory as a constructive criterion to generate probabilistic distributions –through the elaboration of Bayesian Networks- and to reduce the uncertainty in the occurrence and relationship between two key psychological variables associated with the sports’ performance: Self-Determined Motivation and Competitive Anxiety. We analyzed 674 universitary students/athletes who competed in the 2017 Universitary Games (Universiade) in México, from 44 universities, with an average age of 21 years old (SD = 2.07), and with a sportive experience of 8.61 years of average (SD = 5.15). Methods: Regarding the data analysis, first of all a CHAID algorithm was carried out for to know the independence links among variables, and then two Bayesian networks (BN) were elaborated. The validation of the BN revealed AUC values ranging from 0.5 to 0.92. Subsequently, various instantations were carried out with hypothetical values applied to the “bottom” variables. Results showed two probability trees that have Extrinisic Motivation and Amotivation at the top, while the anxiety/activation due to the worry for performance was at the bottom of probabilities. The instantiations carried out support the existence of these probabilistic relationships, demonstrating the little influence on the competition anxiety generated by the intrinsic motivation. In conclusion, the reduction of the uncertainty made up by the restricted BN may aloe to re-introduce Information Theory principles in psychosocial studies, allowing authors to obtain useful probabilities values upon target psychological variables related with sportive performance.

We introduce a modelling framework for the investigation of on-line machine learning processes in non-stationary environments. We exemplify the approach in terms of two specific model situations: In the first, we consider the learning of a classification scheme from clustered data by means of prototype-based Learning Vector Quantization (LVQ). In the second, we study the training of layered neural networks with sigmoidal activations for the purpose of regression. In both cases, the target, i.e. the classification or regression scheme, is considered to change continuously while the system is trained from a stream of labeled data. We extend and apply methods borrowed from statistical physics which have been used frequently for the exact description of training dynamics in stationary environments. Extensions of the approach allow for the computation of typical learning curves in the presence of concept drift in a variety of model situations. First results are presented and discussed for stochastic drift processes in classification and regression problems. They indicate that LVQ is capable of tracking a classification scheme under drift to a non-trivial extent. Furthermore, we show that concept drift can cause the persistence of sub-optimal plateau states in gradient based training of layered neural networks for regression.

We propose a novel credit risk measurement model for Corporate Default Swap spreads, that combines vector autoregressive regression with correlation networks. We focus on the sovereign CDS spreads of a collection of countries, that can be regarded as idiosyncratic measures of credit risk. We model them by means of a vector autoregressive regression model, composed by a time dependent country specific component, and by a contemporaneous component that describes contagion effects among countries. To disentangle the two components, we employ correlation networks, derived from the correlation matrix between the reduced form residuals. The proposed model is applied to ten countries that are representative of the recent financial crisis: top borrowing/lending countries, and peripheral European countries. The empirical findings show that the proposed model is a good predictor of CDS spreads movements, and that the contemporaneous component decreases prediction errors with respect to a simpler autoregressive model. From an applied viewpoint, core countries appear to import risk, as contagion increases their CDS spread, whereas peripheral countries appear as exporters of risk. Greece is an unfortunate exception, as its spreads seem to increase for both idiosyncratic factors and contagion effects.

The ongoing revolution in Deep Learning is redefining the nature of computing that is driven by the increasing amount of pattern classification and cognitive tasks. Specialized digital hardware for deep learning still holds its predominance due to the flexibility offered by the software implementation and maturity of algorithms. However, it is being increasingly desired that cognitive computing occurs at the edge, i.e. on hand-held devices that are energy constrained, which is energy prohibitive when employing digital von Neumann architectures. Recent explorations in digital neuromorphic hardware have shown promise, but offer low neurosynaptic density needed for scaling to applications such as intelligent cognitive assistants (ICA). Large-scale integration of nanoscale emerging memory devices with Complementary Metal Oxide Semiconductor (CMOS) mixed-signal integrated circuits can herald a new generation of Neuromorphic computers that will transcend the von Neumann bottleneck for cognitive computing tasks. Such hybrid Neuromorphic System-on-a-chip (NeuSoC) architectures promise machine learning capability at chip-scale form factor, and several orders of magnitude improvement in energy efficiency. Practical demonstration of such architectures has been limited as performance of emerging memory devices falls short of the expected behavior from the idealized memristor-based analog synapses, or weights, and novel machine learning algorithms are needed to take advantage of the device behavior. In this work, we review the challenges involved and present a pathway to realize ultra-low-power mixed-signal NeuSoC, from device arrays and circuits to spike-based deep learning algorithms, with ‘brain-like’ energy-efficiency.

In factory automation systems, hybrid wired/wireless networks are often deployed to connect devices of difficult reachability such as those mounted on mobile equipment. A widespread version of these networks makes use of Access Points (APs) to implement wireless extensions of Real--Time Ethernet (RTE) networks via the IEEE 802.11 Wireless LAN (WLAN). Unfortunately, APs may introduce random delays in packet forwarding, mainly related to the their internal behaviors (e.g. code processing times) that negatively impact on the whole performance of the automation systems. Consequently, the knowledge of these delays represent a crucial design information. This paper presents an original and effective method to measure the delays introduced by APs, exploiting a hybrid loop-back link and a simple set-up with moderate instrumentation requirements. The method, which requires an initial calibration by means of a reference AP, has been successfully tested on some commercial APs. As it will be shown, the proposed measurement procedure is general and, as such, can be profitably adopted in even different scenarios.

An explosive growth in vehicular wireless services and applications gives rise to spectrum resource starvation. Cognitive radio has been used to vehicular networks to mitigate the impending spectrum starvation problem by allowing vehicles to fully exploit spectrum opportunities unoccupied by licensed users. Efficient and effective detection of licensed user is a critical issue to realize cognitive radio applications. However, spectrum sensing in vehicular environments is a very challenging task due to vehicles mobility. For instance, vehicle mobility has a large effect on the wireless channel, thereby impacting the detection performance of spectrum sensing. Thus, gargantuan efforts have been made in order to analyze the fading properties of mobile radio channel in vehicular environments. Indeed, numerous studies have demonstrated that the wireless channel in vehicular environments can be characterized by a temporally correlated Rayleigh fading. In this paper, we focus on energy detection for spectrum sensing and a counting rule for cooperative sensing based on Neyman-Pearson criteria. Further, we go into the effect of the sensing and reporting channels condition on spectrum sensing performance under temporally correlated Rayleigh sensing channel. For local and cooperative sensing, we derive some alternative expressions for average probability of miss detection. The pertinent numerical and simulating results are provided to further validate our theoretical analyses under a variety of scenarios.