Many cognitive functions face a decline in the healthy elderly. Within the cognitive domains, both attentional processes and executive functions are impaired with aging. Attention includes three attentional networks, i.e., alerting, orienting, and executive control that showed a hemispheric lateralized pattern in adults. This lateralized pattern could have a role in modulating the efficiency of attentional networks. For these reasons could be relevant to analyze the age-related change of hemispheric specialization of attentional networks. This study aims to clarify this aspect with a lateralized version of the ANTI-Fruit. One hundred sixty-seven participants took part in this study. They are divided in three age groups: early adulthood (N=57; Range: 20-30); late adulthood (N=57; Range 31-64) and elderly/older people (N=57; Range: 65-87). Results confirm the previous outcomes on the efficiency and interactions among attentional networks. Moreover, an age-related generalized slowness was evidenced. These findings also support the hypothesis of a hemispheric asymmetry reduction in elderly/older adults. This pattern could partially explain the decrease in attentional functioning in elderly/older age.

In this article, the evolution in space and in time of the coronavirus pandemic is studied by utilizing a neural network with a self-organizing nature for the spatial analysis of data, and a fuzzy fractal method for capturing the temporal trends of the time series of the countries. Self-organizing neural networks possess the capability for clustering countries in the space domain based on their similar characteristics with respect to their coronavirus cases. In this form enabling finding the countries that are having similar behavior and thus can benefit from utilizing the same methods in fighting the virus propagation. To validate the approach, publicly available datasets of coronavirus cases worldwide have been used. In addition, a fuzzy fractal approach is utilized for the temporal analysis of time series of the countries. Then, a hybrid combination of both the self-organizing maps and the fuzzy fractal approach is proposed for efficient COVID-19 forecasting of the countries. Relevant conclusions have emerged from this study, that may be of great help in putting forward the best possible strategies in fighting the virus pandemic. A lot of the existing works concerned with the Coronavirus have look at the problem mostly from the temporal viewpoint that is of course relevant, but we strongly believe that the combination of both aspects of the problem is relevant to improve the forecasting ability. The most relevant contribution of this article is the proposal of combining neural networks with a self-organizing nature for clustering countries with high similarity and the fuzzy fractal approach for being able to forecast the times series and help in planning control actions for the Coronavirus pandemic.

In this paper, the Group Method of Data Handling (GMDH) type of neural networks is used for the inductance calculation of variable inductors. The relation between the inductance of the inductor in the linear and nonlinear regions is investigated, and parameters such as the voltage across the inductor, bias current, and ac current are taken into account. The experimental setup is used for generating the data needed for training the neural network. Over 800 experiments were conducted and were used for training and validation of the neural network results. The results are compared with the reluctance equivalent circuit method, and they show a much better accuracy. The proposed method can be used for the calculation of various magnetic components, and it is not limited to variable inductors.

Although cooperative social networks are considered key to human evolution, emphasis has usually been placed on the functions of men’s cooperative networks. What do women's networks look like? Do they resemble or differ from men's and what does this suggest about evolutionarily inherited gender differences in reproductive and social strategies? In this paper, we test the ‘universal gender differences’ hypothesis positing gender-specific network structures against the ‘gender reversal’ hypothesis that posits women's networks looking more 'masculine' under matriliny. Specifically, we ask whether men's friendship networks are always larger than women's and we investigate measures of centrality by gender and descent system. To do so, we use tools from social network analysis and data on men’s and women’s friendship ties in matrilineal and patrilineal Mosuo communities. In tentative support of the gender reversal hypothesis, we find that women's friendship networks in matriliny are relatively large. Measures of centrality and generalized linear models otherwise reveal greater differences between communities than between men and women. The data and analyses we present are primarily descriptive given limitations of sample size and sampling strategy. Nonetheless, our results provide support for the flexible application of social relationships across genders and clearly challenge the predominant narrative of universal gender differences across space and time.

In this paper, we propose methods for brain tumor detection in MRI images based on ensemble learning. We build upon prior research on ensemble methods by testing the concatenation of pre-trained models: features extracted via transfer learning are merged and segmented by classification algorithms or a stacked ensemble of those algorithms. The proposed approach achieved accuracy scores of 0.98 , outperforming a benchmark VGG-16 model. Considerations to granular computing are given in the paper as well.

As a system becomes more complex, at first, its description and analysis becomes more complicated. However, a further increase in the system’s complexity often makes this analysis simpler. A classical example is Central Limit Theorem: when we have a few independent sources of uncertainty, the resulting uncertainty is very difficult to describe, but as the number of such sources increases, the resulting distribution get close to an easy-to-analyze normal one – and indeed, normal distributions are ubiquitous. We show that such limit theorems make analysis of complex systems easier – i.e., lead to blessing of dimensionality phenomenon – for all the aspects of these systems: the corresponding transformation, the system’s uncertainty, and the desired result of the system’s analysis.

The present study aims to analyze scientific production about technological cooperation networks in biotechnology sector, based on bibliometrics network analysis. We used the Gephi software to identify groups of partnerships, proving that the cooperation relationship is a practice used, re-sulting technological development. Findings identify that in the path for new resources that com-plement skills and competences universities are an important player in this cooperative ecosystem, and The United States is a large hub, with an extensive network of global cooperation. A strong role of its researchers in the publication of scientific articles in cooperation is highlighted. This study contributes to the advancement of the discussion about cooperative networks, as well as to the development of policies aimed at the biotechnology sector advancements

Conventionally, partial differential equations (PDE) problems are solved numerically through discretization process by using finite difference approximations. The algebraic systems generated by this process are then finalized by using an iterative method. Recently, scientists invented a short cut approach, without discretization process, to solve the PDE problems, namely by using machine learning (ML). This is potential to make scientific machine learning as a new sub-field of research. Thus, given the interest in developing ML for solving PDEs, it makes an abundance of an easy-to-use methods that allows researchers to quickly set up and solve problems. In this review paper, we discussed at least three methods for solving high dimensional of PDEs, namely PyDEns, NeuroDiffEq, and Nangs, which are all based on artificial neural networks (ANNs). ANN is one of the methods under ML which proven to be a universal estimator function. Comparison of numerical results presented in solving the classical PDEs such as heat, wave, and Poisson equations, to look at the accuracy and efficiency of the methods. The results showed that the NeuroDiffEq and Nangs algorithms performed better to solve higher dimensional of PDEs than the PyDEns.

Social capital creates a synergy that brings many benefits to members of a community. Thus, the main objective of this article was to examine whether social capital can improve a society's food security. If yes, how? To answer these questions, a systematic literature review was conducted using the Prisma approach. The output of this method led to finding 39 related articles. Precise studying these articles illustrated that social capital improves food security through two mechanisms of knowledge sharing and product sharing (i.e., sharing food products). It revealed that social capital through improving the food security pillars (i.e., food availability, food accessibility, food utilization, and food system stability) affects food security. In other words, the interaction among the members of the community results in sharing food products and information among community members, and this facilitates food availability and access to food. There are many shreds of evidence in the literature that sharing food and food product among the community member decreases household food security and provides the healthy nutrition to the vulnerable families and improve the food utilization pillar of food security. In addition, it is disclosed that belonging to the social networks increases the resilience of the community members and decreases the vulnerability of the community that subsequently strengthens the stability of a food system. This study contributes to the common literature on food security and social capital by providing a conceptual model based on the literature. In addition to researchers, policymakers can use the finding of this study to provide solutions to address food insecurity problems.

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

Motivated by the way animals react in nature, we introduce a fully-connected neural-network model, which incorporates the external pattern presented to the system as a fundamental tool of the recognition process. In this new scenario, in the absence of this external field, memories are not attractors inside basins of attraction, as in usual attractor neural networks, although basins may be created according to the external pattern, thus allowing storing a much larger number of memories. The key point consists in calibrating the influence of the external pattern such as to cancel the noise generated by those memories not correlated with the external pattern.We illustrate how this proposal works by including this new contribution in the standard Hopfield model, showing a significant increase in its recognition capacity (typically by a factor $10^{2}$). As an additional feature of this model, we show its ability to react promptly to changes in the external environment, a crucial attribute of living beings. This procedure can be applied to a wide variety of neural-network models to increase considerably their recognition and reaction capabilities.

State-of-the-art remote sensing scene classification methods employ different Convolutional Neural Network architectures for achieving very high classification performance. A trait shared by the majority of these methods is that the class associated with each example is ascertained by examining the activations of the last fully connected layer, and the networks are trained to minimize the cross-entropy between predictions extracted from this layer and ground-truth annotations. In this work, we extend this paradigm by introducing an additional output branch which maps the inputs to low dimensional representations, effectively extracting additional feature representations of the inputs. The proposed model imposes additional distance constrains on these representations with respect to identified class representatives, in addition to the traditional categorical cross-entropy between predictions and ground-truth. By extending the typical cross-entropy loss function with a distance learning function, our proposed approach achieves significant gains across a wide set of benchmark datasets in terms of classification, while providing additional evidence related to class membership and classification confidence.

We explored the statistics of filtering of simple patterns on a number of deterministic and random graphs as a tractable simple example of information processing in complex systems. In this problem, multiple inputs map to the same output, and the statistics of filtering is represented by the distribution of this degeneracy. For a few simple filter patterns on a ring we obtained an exact solution of the problem and described numerically more difficult filter setups. For each of the filter patterns and networks we found a few numbers essentially describing the statistics of filtering and compared them for different networks. Our results for networks with diverse architectures appear to be essentially determined by two factors: whether the graphs structure is deterministic or random, and the vertex degree. We find that filtering in random graphs produces a much richer statistics than in deterministic graphs. This statistical richness is reduced by increasing the graph’s degree.

This last decade, the amount of data exchanged in the Internet increased by over a staggering factor of 100, and is expected to exceed well over the 500 exabytes by 2020. This phenomenon is mainly due to the evolution of high speed broadband Internet and, more specifically, the popularization and wide spread use of smartphones and associated accessible data plans. Although 4G with its long-term evolution (LTE) technology is seen as a mature technology, there is continual improvement to its radio technology and architecture such as in the scope of the LTE Advanced standard, a major enhancement of LTE. But for the long run, the next generation of telecommunication (5G) is considered and is gaining considerable momentum from both industry and researchers. In addition, with the deployment of the Internet of Things (IoT) applications, smart cities, vehicular networks, e-health systems, and Industry 4.0, a new plethora of 5G services has emerged with very diverging and technologically challenging design requirements. These include: high mobile data volume per area, high number of devices connected per area, high data rates, longer battery life for low-power devices, and reduced end-to-end latency. Several technologies are being developed to meet these new requirements. Among these we list ultra-densification, millimeter Wave usage, antennas with massive multiple-input multiple-output (MIMO), antenna beamforming to increase spacial diversity, edge/fog computing, among others. Each of these technologies brings its own design issues and challenges. For instance, ultra-densification and MIMO will increase the complexity to estimate channel condition and traditional channel state information (CSI) estimation techniques are no longer suitable due to the complexity of the new scenarios. As a result, new approaches to evaluate network condition such as by continuously collecting and monitoring key performance indicators become necessary. Timely decisions are needed to ensure the correct operation of such network. In this context, deep learning (DL) models could be seen as one of the main tools that can be used to process monitoring data and automate decisions. As these models are able to extract relevant features from raw data (images, texts, and other types of unstructured data), the integration between 5G and DL looks promising and one that requires exploring. As main contributions, this paper presents a systematic review about how DL is being applied to solve some 5G issues. We examine data from the last decade and the works that addressed diverse 5G problems, such as physical medium state estimation, network traffic prediction, user device location prediction, self network management, among others. We also discuss the main research challenges when using DL models in 5G scenarios and identify several issues that deserve further consideration.

Smartphone has become one of the most revolutionary devices in the history of computing. With various kinds of applications, the scope of smartphone has been significantly broadened in the past few years including almost every aspect in our daily life. However, due to the limited on-board resources such as CPU, storage, network bandwidth and battery power, smartphones and the mobile network serving them bring new challenges that have not been encountered in the traditional computing and networking environments. This dissertation focuses on the research areas of improving the network architecture and enhancing the current applications on smartphones. It mainly investigates the areas in the following two directions for three representative categories of mobile services. - In the first direction, the dissertation aims to develop new communication models for smartphone Ad-Hoc networks to achieve efficient communication in the proximity. It is motivated by the fact that smartphone Ad-Hoc networks can help improve the current location-based services and propel new applications. Moreover, the new communication models provide complementary alternatives to the traditional infrastructure-based wireless networks. - In the second direction, the dissertation focuses on improving the other two categories of services, cloud storage services and real-time video streaming services for mobile devices. In the field of cloud storage, we introduce a cloud-assisted approach to provide a set of advanced file operations, such as encryption, decryption and compression, on smartphones. Furthermore, by utilizing the on-board Near Field Communication(NFC) module, we develop an algorithm to securely share the files between mobile devices. For the services of real-time video streaming, we propose approaches that identify a user’s status by analyzing the accelerometer data and then, dynamically adjust the buffer mechanism to save network bandwidth on smartphones.

The latest methods based on deep learning have achieved amazing results regarding the complex work of inpainting large missing areas in an image. This type of method generally attempts to generate one single "optimal" inpainting result, ignoring many other plausible results. However, considering the uncertainty of the inpainting task, one sole result can hardly be regarded as a desired regeneration of the missing area. In view of this weakness, which is related to the design of the previous algorithms, we propose a novel deep generative model equipped with a brand new style extractor which can extract the style noise (a latent vector) from the ground truth image. Once obtained, the extracted style noise and the ground truth image are both input into the generator. We also craft a consistency loss that guides the generated image to approximate the ground truth. Meanwhile, the same extractor captures the style noise from the generated image, which is forced to approach the input noise according to the consistency loss. After iterations, our generator is able to learn the styles corresponding to multiple sets of noise. The proposed model can generate a (sufficiently large) number of inpainting results consistent with the context semantics of the image. Moreover, we check the effectiveness of our model on three databases, i.e., CelebA, Agricultural Disease, and MauFlex. Compared to state-of-the-art inpainting methods, this model is able to offer desirable inpainting results with both a better quality and higher diversity. The code and model will be made available on https://github.com/vivitsai/SEGAN.

For any positive integer n ≥ 2, the Erdős-Straus Conjecture claims that the Diophantine equation 4/n = 1/x + 1/y + 1/z has a solution where x, y, z are also positive integers. In this paper, a directed network based on this equation is generated, with properties such as its average clustering coefficient, average path length, degree distributions, and largest strongly connected component analysed to reveal some underlying trends about the nature of the conjecture. Potential connections between different numbers, that result from satisfying a source-solution relationship for this equation, are described using the appropriate number-theoretic interpretations wherever possible, while conjectures backed by these trends are made in other instances. Additionally, a directed configuration model is used to show that the origin of several results is the degree sequence of the network. Metrics relating to the prime number nodes, specifically their in and out degrees, are also explored to yield some intriguing observations. On the whole, the aim is to highlight the viability of complex networks as a computational tool to study this general class of problems pertaining to fixed-length unit fraction splits.

The Sentinel-2 satellite mission offers high resolution multispectral time series image data, enabling the production of detailed land cover maps globally. At this scale, the trade-off between processing time and result quality is a central design decision. Currently, this machine learning task is usually performed using pixelwise classification methods. The radical shift of the computer vision field away from hand engineered image features and towards more automation by representation learning comes with many promises, including higher quality results and less engineering effort. In this paper we assess fully convolutional neural networks architectures as replacements for a Random Forest classifier in an operational context for the production of high resolution land cover maps with Sentinel-2 time series at the country scale. Our contributions include a framework for working with Sentinel-2 L2A time series image data, an adaptation of the U-Net model for dealing with sparse annotation data while maintaining high resolution output, and an analysis of those results in the context of operational production of land cover maps.

Buildings have started to play a critical role in the stability and resilience of modern smart grids, leading to a refocusing of large scale energy management strategies from the supply side to the consumer side. When the buildings integrate local renewable energy generation in the form of renewable energy resources they become prosumers and this reflects into additional complexity into the operation of the interconnected complex energy systems. A class of methods of modelling the energy consumption patterns of the building have recently emerged as black-box input-output approaches with the ability to capture underlying consumption trends. These make use and require large quantities of quality data produces by non-deterministic processes underlying the energy consumption. We present an application of a class of neural networks, namely deep learning techniques for time series sequence modelling with the goal of accurate and reliable building energy load forecasting. The Recurrent Neural Network implementation uses Long Short-Term Memory layers in increasing density of nodes to quantify prediction accuracy. The case study is illustrated on four university buildings from temperate climates over one year of operation using a reference benchmarking dataset that allows replicable results. The obtained results are discussed in terms of accuracy metrics and computational and network architecture aspects and are considered suitable for further used in future in situ energy management at the building and neighbourhood levels.

It's challenging to achieve robust lane detection depending on single frame when considering complicated scenarios. In order to detect more credible lane markings by using sequential frames, a novel approach to fusing vision and Inertial Measurement Unit (IMU) is proposed in this paper. The hough space is employed as the space where lane markings are stored and it's calculated by three steps. Firstly, a basic hough space is extracted by Hough Transform and primary line segments are extracted from it. In order to measure the possibility about line segments belong to lane markings, a CNNs based classifier is introduced to transform the basic hough space into a probabilistic space by using the networks outputs. However, this probabilistic hough space based on single frame is easily disturbed. In the third step, a filtering process is employed to smooth the probabilistic hough space by using sequential information. Pose information provided by IMU is applied to align hough spaces extracted at different times to each other. The final hough space is used to eliminate line segments with low possibility and output those with high confidence as the result. Experiments demonstrate that the proposed approach has achieved a good performance.

The objective of this article was to forecast the ultimate failure load laminate stacking sequence combination on bonding joints which are exposed to tensile strength by using artificial neural networks. We have glass fiber composite materials with three different sequence combinations ([0°/90°], [±45°], [0°/90°/±45°]). Various adherend thicknesses and also ductile type adhesive was used in the experiment. The bonding geometry is a single lap and has four types of overlap angles 30°, 45°, 60°, 75° respectively. The experimental results demonstrate that composite laminate stacking sequence profoundly affects the bonding joints of failure load. Taking experimental results into account, Levenberg–Marquardt learning algorithm model was used by preferring a three layer forward on ANN so as to discipline network. In order to procure a precise ANN tool, an integrate methodology of experimental method has been used. The outcomes are used to ensure the experimental data’s to the ANN. The method of ANN permits surveying much adequately the probabilities of composite laminate stacking sequence combination using the prevalent ones which are [0°/90°], [±45°] and [0°/90°/±45°]. Testing data and training results were quite well 0.998, 0.997 and 0.998 in turn. Consequences acquired can be used by engineers who are interested in the composite material design to enhance failure load.

This paper proposes a hybrid medium access control (MAC) protocol for wireless sensor network (WSN) data gathering, employing unmanned aerial vehicles (UAV). The UAV sends a beacon frame periodically to inform sensor nodes regarding its presence. Afterward, each sensor node which receives beacon frame contends to send registration frame to the UAV. The UAV will transmit the second beacon frame to the registered nodes to notify their transmission schedule. The time-slot scheme is used for the transmission schedule. The transmission schedule of each sensor is determined based on their priority. Specifically, the priority of each sensor is determined during the registration process. Furthermore, the architecture of UAV-WSN data gathering system is introduced in this paper. Simulations are performed, showing that the proposed MAC protocol achieves fairness while enhancing network performance.

Complementary Metal-Oxide-Semiconductor (CMOS) is a typical image sensor that has a wide range of applications. However, considering the limitations of the weather condition and hardware cost, it is hard to capture high-resolution images by CMOS sensor. Recently, Super-Resolution (SR) techniques for image restoration has been gaining attentions due to its excellent performance. Under the powerful learning ability, Generative Adversarial Networks (GANs) have been proved to achieve great success. In this paper, we propose the Advanced Generative Adversarial Networks (AGAN) to efficiently correct these issues; 1) we design a Laplacian pyramid framework as pre-trained module, which is beneficial to provide multi-scale features for our input. 2) at each feature block, a convolutional skip-connections network, which may contain some latent information, is significant for generative model to reconstruct a plausible-looking image; 3) considering that edge details usually play an important role in image generation, a novel perceptual loss function is defined to train and seek optimal parameters. It is effective to achieve excellent and compelling quality captured by CMOS sensor. Quantitative and qualitative evaluations have been demonstrated that our algorithm not only fully takes advantage of Convolutional Neural Networks (CNNs) to improve the image quality, but also performs better than previous GAN algorithms for super-resolution task.

Centralized/Cloud Radio Access Networks (C-RAN) are deployed in converged fixed-mobile networks to exploit the flexibility coming from joint application of Network Function Virtualization (NFV) and Software Defined Networking (SDN). In this context, optical links connecting C-RAN nodes, possibly based on the Ethernet standards, may carry traffic with different requirements in terms of latency and throughput. This paper considers the problem of traffic aggregation on C-RAN optical Ethernet links with latency control for fronthaul traffic and throughput capability for backhaul traffic. Integrated hybrid nework technique is applied to show how time transparency can be enforced for Ethernet encapsulated Common Public Radio Interface (CPRI) traffic while allowing statistical multiplexing of backhaul traffic. Simulation results show the effectiveness of segmentation of backhaul traffic to allow exploitation of the available bandwidth even with high capacity CPRI options.

In wireless sensor networks, there is no a central controller to enforce cooperation between nodes. Therefore, nodes may generate selfish behavior to conserve their energy resources. In this paper, we address the problems of transmission power minimization and energy balance in wireless sensor networks using a topology control algorithm. We considered the energy efficiency and energy balance of the nodes, and an improved optimization-integrated utility function is designed by introducing the Theil index. Based on this, a topological control game model of energy balance is established, and it is proved that the topological game model is an ordinal potential game with Pareto optimality. Additionally, an energy-balanced topology control game algorithm (EBTG) is proposed to construct topologies. The simulation and comparison show that, compared with other topological control algorithms based on game theory, the EBTG algorithm can improve energy balance and energy efficiency while reducing the transmitting power of nodes, thus prolonging the network lifetime.

This study is framed on the Information Theory as a constructive criterion to generate probabilistic distributions –through the elaboration of Bayesian Networks- and to reduce the uncertainty in the occurrence and relationship between two key psychological variables associated with the sports’ performance: Self-Determined Motivation and Competitive Anxiety. We analyzed 674 universitary students/athletes who competed in the 2017 Universitary Games (Universiade) in México, from 44 universities, with an average age of 21 years old (SD = 2.07), and with a sportive experience of 8.61 years of average (SD = 5.15). Methods: Regarding the data analysis, first of all a CHAID algorithm was carried out for to know the independence links among variables, and then two Bayesian networks (BN) were elaborated. The validation of the BN revealed AUC values ranging from 0.5 to 0.92. Subsequently, various instantations were carried out with hypothetical values applied to the “bottom” variables. Results showed two probability trees that have Extrinisic Motivation and Amotivation at the top, while the anxiety/activation due to the worry for performance was at the bottom of probabilities. The instantiations carried out support the existence of these probabilistic relationships, demonstrating the little influence on the competition anxiety generated by the intrinsic motivation. In conclusion, the reduction of the uncertainty made up by the restricted BN may aloe to re-introduce Information Theory principles in psychosocial studies, allowing authors to obtain useful probabilities values upon target psychological variables related with sportive performance.

We propose a novel credit risk measurement model for Corporate Default Swap spreads, that combines vector autoregressive regression with correlation networks. We focus on the sovereign CDS spreads of a collection of countries, that can be regarded as idiosyncratic measures of credit risk. We model them by means of a vector autoregressive regression model, composed by a time dependent country specific component, and by a contemporaneous component that describes contagion effects among countries. To disentangle the two components, we employ correlation networks, derived from the correlation matrix between the reduced form residuals. The proposed model is applied to ten countries that are representative of the recent financial crisis: top borrowing/lending countries, and peripheral European countries. The empirical findings show that the proposed model is a good predictor of CDS spreads movements, and that the contemporaneous component decreases prediction errors with respect to a simpler autoregressive model. From an applied viewpoint, core countries appear to import risk, as contagion increases their CDS spread, whereas peripheral countries appear as exporters of risk. Greece is an unfortunate exception, as its spreads seem to increase for both idiosyncratic factors and contagion effects.

1). As on-the-ground projects come into existence and continue to expand to adapt to climate change and empower women, it is important to understand their location within TANs. Using the Bhungroo technology as a case study, we aim to assess the potential of TANs to increase the scope and scale of local projects as well as the ability of similar and emerging projects to create social change at local levels. 2). We do so by analyzing interview and earned media hits data from the UNFCCC Momentum for Change. 3). We find that while TANs may help increase the scale and scope of projects, increasing their ability to effectively reach more people and areas is still up for debate 4). We conclude by considering how women’s political participation may be enhanced by similar projects.

We consider a random dynamical system arising in a model of associative memory. This system can be seen as a small (stochastic and deterministic) perturbation of a determinstic system having two weak attractors which are destroyed after the perturbation. We show, with a computer aided proof, that the system has a kind of chaotic itineracy. Typical orbits are globally chaotic, while they spend relatively long time visiting attractor's ruins.

Hydrogels evolved as an outstanding carrier material for local and controlled drug delivery that tend to the shortcomings of old conventional dosage forms for small drugs (NSAIDS) and large peptides and proteins. Aqueous swellable and crosslinked polymeric network structure of hydrogels is composed of various natural, synthetic and semisynthetic biodegradable polymers. Hydrogels have remarkable properties of functionality, reversibility, sterilizability, and biocompatibility. All these dynamic properties of hydrogels have increased the interest in their use as a carrier for peptides and proteins to be released slowly in a sustained manner. The therapeutical peptide and proteins are remarkable therapeutic agents in today’s world that allows the treatment of severe, chronic and life‐threatening diseases, such as diabetes, rheumatoid arthritis, hepatitis in an easy manner. Despite few limitations, hydrogels provide fine tuning of proteins and peptides delivery with enormous impact in clinical medicine. The primary objective of this article is to review current issues concerned with the therapeutics peptides and proteins and impact of remarkable properties of hydrogels on these therapeutic agents. Different routes for pharmaceutical peptides and proteins and superiority over other drugs candidates are presented. The article will also review literature concerning classification of hydrogels on different basis, polymers used, release mechanisms their physical and chemical characteristics and diverse applications.

The comprehensibility of good predictive models learned from high-dimensional gene expression data is attractive because it can lead to biomarker discovery. Several good classifiers provide comparable predictive performance but differ in their abilities to summarize the observed data. We extend a Bayesian Rule Learning (BRL-GSS) algorithm, previously shown to be a significantly better predictor than other classical approaches in this domain. It searches a space of Bayesian networks using a decision tree representation of its parameters with global constraints, and infers a set of IF-THEN rules. The number of parameters and therefore the number of rules are combinatorial to the number of predictor variables in the model. We relax these global constraints to a more generalizable local structure (BRL-LSS). BRL-LSS entails more parsimonious set of rules because it does not have to generate all combinatorial rules. The search space of local structures is much richer than the space of global structures. We design the BRL-LSS with the same worst-case time-complexity as BRL-GSS while exploring a richer and more complex model space. We measure predictive performance using Area Under the ROC curve (AUC) and Accuracy. We measure model parsimony performance by noting the average number of rules and variables needed to describe the observed data. We evaluate the predictive and parsimony performance of BRL-GSS, BRL-LSS and the state-of-the-art C4.5 decision tree algorithm, across 10-fold cross-validation using ten microarray gene-expression diagnostic datasets. In these experiments, we observe that BRL-LSS is similar to BRL-GSS in terms of predictive performance, while generating a much more parsimonious set of rules to explain the same observed data. BRL-LSS also needs fewer variables than C4.5 to explain the data with similar predictive performance. We also conduct a feasibility study to demonstrate the general applicability of our BRL methods on the newer RNA sequencing gene-expression data.

An existing power grid is going through a massive transformation. Smart grid technology is a radical approach for improvisation in prevailing power grid. Integration of electrical and communication infrastructure is inevitable for the deployment of Smart grid network. Smart grid technology is characterized by full duplex communication, automatic metering infrastructure, renewable energy integration, distribution automation and complete monitoring and control of entire power grid. Wireless sensor networks (WSNs) are small micro electrical mechanical systems which are accomplished to collect and communicate the data from surroundings. WSNs can be used for monitoring and control of smart grid assets. Security of wireless sensor based communication network is a major concern for researchers and developers. The limited processing capabilities of wireless sensor networks make them more vulnerable to cyber-attacks. The countermeasures against cyber-attacks must be less complex with an ability to offer confidentiality, data readiness and integrity. The address oriented design and development approach for usual communication network requires a paradigm shift to design data oriented WSN architecture. WSN security is an inevitable part of smart grid cyber security. This paper is expected to serve as a comprehensive assessment and analysis of communication standards, cyber security issues and solutions for WSN based smart grid infrastructure.

We propose an advanced filtering scheme based on Recurrent Neural Networks (RNNs) and Deep Learning to enable efficient control strategies for Vertical Farming (VF) applications.  We demonstrate that the best RNN model incorporates five neuron layers, with the first and second containing ninety Long Short-Term Memory neurons.  The third layer implements one Gated Recurrent Units neuron.  The fourth segment incorporates one RNN network, while the output layer is designed by using a single neuron exhibiting a rectified linear activation function.  By utilizing this RNN digital filter, we introduce two variations: (1) A scaled RNN model to tune the filter to the signal of interest, and (2) A moving average filter to eliminate harmonic oscillations of the output waveforms. The RNN models are contrasted with conventional digital Butterworth, Chebyshev I, Chebyshev II, and Elliptic Infinite Impulse Response (IIR) configurations.  The RNN digital filtering schemes avoid introducing unwanted oscillations, which makes them more suitable for VF than their IIR counterparts.  Finally, by utilizing the advanced features of scaling of the RNN model, we demonstrate that the RNN digital filter can be pH selective, as opposed to conventional IIR filters.

: In the last years, materializations of neuromorphic circuits based on nanophotonic arrangements have been proposed, which contain complete optical circuits, laser, photodetectors, photonic crystals, optical fibers, flat waveguides, and other passive optical elements of nanostructured materials, which eliminate the time of simultaneous processing of big groups of data, taking advantage of the quantum perspective and thus highly increasing the potentials of contemporary intelligent computational systems. This article is an effort to record and study the research that has been conducted concerning the methods of development and materialization of neuromorphic circuits of Neural Networks of nanophotonic arrangements. In particular, an investigative study of the methods of developing nanophotonic neuromorphic processors, their originality in neuronic architectural structure, their training methods and their optimization has been realized along with the study of special issues such as optical activation functions and cost functions.

In this work we identify combinations of technological activities that signal the presence local capabilities in a country to successfully export a product. We use country-level patent and trade data to generate a multi-layer network, and we apply maximization of entropy to generate synthetic data to effectively divide signal from noise. We show that in several sectors the signal far exceed the noise. Our exercise provides robust evidence of the presence of synergies between technologies to explain trade performances in specific markets. This can be highly useful for policy makers, to inform industrial and innovation policies.

One of the biggest challenges in characterizing 2-D image topographies is finding a low-dimensional parameter set that can succinctly describe, not so much image patterns themselves, but the nature of these patterns. The 2-D Cluster Variation Method (CVM), introduced by Kikuchi in 1951, can characterize very local image pattern distributions using configuration variables, identifying nearest-neighbor, next-nearest-neighbor, and triplet configurations. Using the 2-D CVM, we can characterize 2-D topographies using just two parameters; the activation enthalpy and the interaction enthalpy. Initial investigations with two different representative topographies (``scale-free-like'' and ``rich club-like'') produce interesting results when brought to a CVM free energy minimum. Additional phase space investigations, where one of these two parameters has been set to zero, identify useful parameter ranges. Careful comparison of the analytically-predicted configuration variables versus those obtained when performing computational free energy minimization on a 2-D grid show that the computational results differ significantly from the analytic solution. The 2-D CVM can potentially function as a secondary free energy minimization within the hidden layer of a neural network, providing a basis for extending node activations over time and allowing temporal correlation of patterns.

In order for robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities in order to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged on top of an object to securely grab it between the robotic gripper and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the application of deep learning methods in task generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. A number of the most promising approaches are evaluated and the most successful for grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is identified as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

Fault detection in transmission lines plays a role in maintaining the dependability and steadiness of power networks. Traditional methods for identifying faults often struggle to handle the diverse nature of real world fault situations. Machine learning (ML) algorithms offer a data centered approach that can adjust and learn from datasets potentially overcoming the limitations of traditional approaches. This document presents a review of progress in using ML for detecting faults in transmission lines. By drawing insights from a variety of studies we explore how ML algorithms have evolved in fault detection, including techniques like networks, recurrent neural networks featuring Long Short Term Memory and convolutional neural networks. We delve into the spectrum of applications where ML is used for fault detection across fault scenarios and operational settings. Additionally we discuss the obstacles and prospects linked to putting ML based fault detection systems into practice such as challenges with data quality, model interpretability and integration with existing grid monitoring systems. Lastly we outline future research paths focused on pushing forward the boundaries of fault detection, in power transmission systems through approaches and collaborative endeavors involving academia, industry players and policymakers. In general, this review highlights how machine learning has the power to revolutionize fault detection methods enhancing the resilience and dependability of power systems.

Autonomous mobile robots are essential to the industry, and human-robot interactions are becoming more common nowadays. These interactions require that the robots navigate scenarios with static and dynamic obstacles in a safely manner, avoiding collisions. This paper presents a physical implementation of a method for dynamic obstacle avoidance using a Long Short-Term Memory (LSTM) neural network that obtains information from the mobile robot’s LiDAR for it to be capable of navigating through scenarios with static and dynamic obstacles while avoiding collisions and reaching its goal. The model is implemented using a TurtleBot3 mobile robot within an OptiTrack Motion Capture (MoCap) system for obtaining its position at any given time. The user operates the robot through these scenarios, recording its LiDAR readings, target point, position inside the MoCap system, and its linear and angular velocities, all of which serve as the input for the LSTM network. The model is trained on data from multiple user-operated trajectories across five different scenarios, outputting the linear and angular velocities for the mobile robot. Physical experiments prove that the model is successful in allowing the mobile robot to reach the target point in each scenario while avoiding the dynamic obstacle, with a validation accuracy of 98.02%.

Being able to express broad families of equivariant or invariant attributed graph functions is a popular measuring stick of whether graph neural networks should be employed in practical applications. However, it is equally important to learn deep local minima of losses (i.e., with much smaller loss values than other minima), even when architectures cannot express global minima. In this work we introduce the architectural property of attracting GNN optimization trajectories to local minima as a means of achieving smaller losses. We take first steps in satisfying this property for losses defined over attributed undirected unweighted graphs with a novel architecture, called Universal Local Attractor (ULA). The latter refines each dimension of end-to-end trained node feature embeddings based on graph structure to track the optimization trajectories of losses satisfying some mild conditions. The refined dimensions are then linearly pooled to create predictions. We experiment on 10 tasks, from node classification to clique detection, on which ULA is comparable with or significantly outperforms popular alternatives of similar or greater theoretical expressive power.

This paper explores the application of Random Matrix Theory (RMT) as a methodological enhancement for portfolio selection within financial markets. Traditional approaches to portfolio optimization often rely on historical estimates of correlation matrices, particularly susceptible to instability. To address this challenge, we combine a data preprocessing technique based on the Hilbert transformation of returns with RMT to refine the accuracy and robustness of correlation matrix estimation. By contrasting empirical correlations with those derived from random matrices, we uncover non-random properties and underlying relationships within financial data. We then utilize this methodology to construct the correlation network dependence structure used in portfolio optimization. The empirical analysis presented in this paper validates the effectiveness of RMT in enhancing portfolio diversification and risk management strategies. This research contributes by offering investors and portfolio managers with methodological insights to construct portfolios that are more stable, robust, and diversified. At the same time, it advances our comprehension of the intricate statistical principles underlying multivariate financial data.

Visual Sensor Networks (VSNs) have been the focus of numerous studies, emphasizing the quality of the information they generate. The primary goal of these networks is to capture data from an area, extract the pertinent information from the visual scene, and facilitate communication. However, the presence of objects in the study area can impacted the network's efficiency, linking the quality of acquired data directly to the positioning of the cameras. Strategically positioning multiple cameras in a potentially complex area, while ensuring effective communication between nodes, presents a challenging issue in VSNs applications. This paper introduces a specific method to enhance the deployment of visual sensors in indoor environments. The research addresses the theme of multi-objective optimization of VSN deployment, integrating various criteria: maximizing overall visual coverage, maximizing the observation of zones of interest, maximizing observation redundancy of zones of interest and ensuring communication connectivity for data transfers. To tackle this problem, we simulate the observed environment incorporating cameras, obstacles, and considering zones of interest. Camera positioning is performed while considering visual constraints and the scene's characteristics. The quality of positioning is evaluated based on the defined objective functions. Initially, a comparative study is conducted with a state-of-the-art approach, integrating the first three objective functions. Subsequently, we incorporate the fourth objective function to ensure data transfers. The proposed method demonstrates efficient camera network deployments in indoor areas, considering global coverage and observation redundancy. In contrast to the state-of-the-art, these results are achieved in areas with visual obstacles while ensuring communication connectivity between the different cameras.

The aim of this study is to develop an African Neutral Network (ANN) model for predicting temperature and relative humidity in the greenhouse during the calendar year. Input data are ambient temperature and relative humidity outside of the greenhouse chosen for a typical meteorological year for the location of the object and the values of temperature and relative humidity of the air in the greenhouse, obtained as a result of a TRNSYS dynamic simulation of the thermal load of the facility. The goal was to show that our ANN model is capable of making predictions over extended time period. The TRNSYS model was created on a real object, taking into account all relevant parameters, in order to describe the dynamic behavior of the object as good as possible. The ANN model is formed of 3 layers, where the number of neurons in the hidden layer is obtained by training different types in order to reach the optimal number of neurons, and the values of the learning rate and epochs are also varied. The activation functions were respectively the hyperbolic tangent in the hidden layer and the linear function in the output layer. The Root Mean Square Error (RMSE), Mean Absolute Error (MAE) and Correlation Coefficient were chosen as the statistical criteria for measuring of the network performance. MAE and RMSE showed that the model with 6 neurons in the hidden layer gave the best results of data prediction in relation to the input data. Statistical analysis of output shows that, the RMSE and Mean Absolute Error (MAE) between the measured and predicted temperature was 0.3166 °C and 0.1002°, and the relative humidity RMSE and MAE was 5.9% and 3.4%, respectively, which can satisfy the demand of greenhouse climate control. The results of the study showed that the model can be used with satisfactory accuracy to predict the parameters of the internal environment, in relation to the complex simulation of the thermal load of the object.

Nowadays the dynamism induced by the constant change of strategic decisions on the markets produces an extra difficulty in the management of an organization. The strategic decisions made by managers can become obsolete in a short period of time. One of the major difficulties in managing a commercial organization is to predict, with some precision degree, the impact some strategic decisions have on the financial results. Business Intelligence (BI) is an area widely used to help managers to make strategic decisions. But the methods used, behind the scenes, to achieve the conclusions are kept secret by BI company-based services. Modelling the environment can be a good option to study the impact of an action, provided by a strategic decision, in a real environment. A good model should give an approximate result of an action applied to a previous state of the environment. Artificial Neural Networks (ANNs) are proven to be excellent in modeling environments with some level of data noise. The same strategic action can have different results in different organizations. A tool that allows an evaluation of a strategic action applied to an environment should have a major importance in the management scope. Modeling the environment should save time and money for the organization to improve the performance of the strategic plan. If one evaluates the state of the environment after a strategic action being applied, it can be possible to mitigate the risk of failure of the strategic plan. As we will be able to verify, it is possible to use ANNs to model strategic environments that should allow the prediction of sales and operating results by the used strategies with some precision, although the level of success will be directly related with the user’s necessity.

Cellular Technology came into existence in Japan in 1979. From that time, we have seen many advances in technology. Currently, most of the person uses either 4G or 5G, among which 5G is a newer technology. 4G network was the first network to use LTE. LTE stands for Long Term Evaluation. Most people get confused between 4G and LTE, they assume both to be the same. In reality, LTE has evolved on the 4G technology. It was first introduced in 2008 to provide higher efficiency and data rates to the cellular network. It was designed to evolve the performance of the networks which includes the evolution of hardware components, optimization of software, power and cost efficiency. This work presents a study on LTE, LTE-A and VoLTE technology. We also discussed about the several packet scheduling algorithms that are being used for transmission of packets. It brings out new opportunities for the researchers to work on increasing the efficiency of those algorithms by modifications.

Accurate estimations of actual evapotranspiration (ETa) are fundamental for various environmental issues. Artificial Intelligence-based models are considered a promising alternative to the most common direct ETa estimation techniques and indirect methods by remote sensing (RS)-based surface energy balance models. Artificial Neural Networks (ANN) are proven to be suitable for predicting reference evapotranspiration and ETa based on RS data. The aim of this study is to develop a methodology based on ANNs for estimating daily ETa values using NDVI and land surface temperature, coupled with limited site-specific climatic variables at a large irrigation catchment. Two scenarios were implemented by the ANN model. Data from only the 38 days of satellite overpass dates was selected in Scenario-I, while the 769-day data included the satellite overpass dates and other days located between two satellite overpass acquisitions in Scenario-II. An irrigation scheme in the Mediterranean region of Turkiye was selected, and a total of 38 Landsat images, and local climatic data were used in 2021 and 2022. Results showed that R2 values in Scenario-I and II were acknowledgeably high for training (0.79 and 0.86), testing (0.75 and 0.81), and the entire dataset (0.76 and 0.84), respectively. Results of the new model in two scenarios showed acceptable agreement with ETa-METRIC values. The proposed ANN model demonstrated the potential of obtaining daily ETa using limited climatic data and RS imagery.

The escalating reliance on revolutionary online web services has introduced heightened security risks, with persistent challenges posed by phishing despite extensive security measures. Traditional phishing systems, reliant on machine learning and manual features, struggle with evolving tactics. Recent advances in deep learning offer promising avenues for tackling novel phishing challenges and malicious URLs. This paper introduces a two-phase stack generalized model named AntiPhishStack, designed to detect phishing sites. The model leverages the learning of URLs and character-level TF-IDF features symmetrically, enhancing its ability to combat emerging phishing threats. In Phase I, features are trained on a base machine learning classifier, employing K-fold cross-validation for robust mean prediction. Phase II employs a two-layered stacked-based LSTM network with five adaptive optimizers for dynamic compilation, ensuring premier prediction on these features. Additionally, the symmetrical predictions from both phases are optimized and integrated to train a meta-XGBoost classifier, contributing to a final robust prediction. This work's significance lies in advancing phishing detection with AntiPhishStack, operating without prior phishing-specific feature knowledge. Experimental validation on two benchmark datasets, comprising benign and phishing or malicious URLs, demonstrates the model's exceptional performance, achieving a notable 96.04% accuracy. This research adds value to the ongoing discourse on symmetry and asymmetry in information security and provides a forward-thinking solution for enhancing network security in the face of evolving cyber threats.

Convolutional neural networks (CNNs) have proven to be a very efficient class of machine learning (ML) architectures for handling multidimensional data by maintaining data locality, especially in the field of computer vision. Data pooling, a major component of CNNs, plays a crucial role for extracting important features of the input data and downsampling its dimensionality. Multidimensional pooling, however, is not efficiently implemented in existing ML algorithms. In particular, quantum machine learning (QML) algorithms have a tendency to ignore data locality for higher dimensions by representing/flattening multidimensional data as simple one-dimensional data. In this work, we propose using the quantum Haar transform (QHT) and quantum partial measurement for performing generalized pooling operations on multidimensional data. We present the corresponding decoherence-optimized quantum circuits for the proposed techniques along with their theoretical circuit depth analysis. Our experimental work was conducted using multidimensional data, ranging from 1-D audio data, to 2-D image data, to 3-D hyperspectral data, to demonstrate the scalability of the proposed methods. In our experiments, we utilized both noisy and noise-free quantum simulations on a state-of-the-art quantum simulator from IBM Quantum. We also show the efficiency of our proposed techniques for multidimensional data by reporting the fidelity of results.

Background: Genome-wide association studies (GWAS) have shed light on various complex diseases and traits, by detecting more than 400,000 associated genetic loci. This number is expected to drastically increase because of the use of novel artificial intelligence methods offering new ways to study the effects of variants. Deep learning using artificial neural networks (ANN) is a sub-field of artificial intelligence, which simulates how the human brain learns. We aimed at assessing the potential of deep learning in human genetic studies of Alzheimer’s Disease (AD) and how these compare to the traditional statistical methods used in GWAS, by simultaneously testing the two approaches on the same dataset, while discovering new genetic loci associated to AD. Methods: To address this aim, phenotypic and genome-wide SNP data from the UK Biobank was analysed on a binary outcome, AD diagnosis, in two different data balance options, of one-to-one and one-to-two case-control datasets, using 2,764 cases vs 2,764 controls and 5,528 controls respectively matched on gender, age, ethnicity, PC1-20 and genotyping array. Genetic data handling and GWAS were performed using PLINK, whereas neural networks were trained using GenNet, a new ANN tool, with the same datasets, separated into training (60%), validation (20%) and test (20%) sets. Neural network layers were determined using biological knowledge, by annotating SNPs to genes and genes to AD related pathways, using ANNOVAR annotations followed by GeneSCF and KEGG. Results: Significant associations were detected between four SNPs linked to two different genes and AD for the 1 to 1 case-control study design and six SNPs linked to four different genes for the 1 to 2 case-control study design by using PLINK. All identified regions have been previously associated to AD. GenNet identified twelve SNPs on seven genes to be associated with AD, all with biological plausibility, achieving an AUC of 0.80 when using three biologically determined layers and 0.73 when using two layers at the neural networks. No common top SNPs were identified between the machine learning and GWAS models. Conclusion: This is one of the first studies attempting to compare the traditional GWAS to more sophisticated state-of-art methods for understanding the genetic architecture of complex phenotypes using the same dataset. More systematic comparisons with such approaches on real data are needed to enable best practises for machine learning in the analysis of genome-wide genetic data.

OSI model used to be common network model for years. In the case of ad hoc networks with dynamic topology and difficult radio communications conditions, gradual departure is happening from the classical kind of OSI network model with a clear delineation of layers (physical, channel, network, transport, application) to the cross-layer approach. The layers of the network model in ad hoc networks strongly influence each other. Thus, the cross-layer approach can improve the performance of an ad hoc network by jointly developing protocols using interaction and collaborative optimisation of multiple layers. The existing cross-layer methods classification is too complicated, because it’s based on the whole manifold of network model layers combinations, regardless their importance. In this work, we review ad hoc networks cross-layer methods, propose the new useful classification of cross-layer methods, and show future research directions in ad hoc networks cross-layer methods development. The proposed classification can help to simplify the goal-oriented cross-layer protocol development.

In the intricate domain of text analysis, syntactic dependency trees play a crucial role in unraveling the web of relations among entities embedded in the text. These trees provide a structural roadmap, guiding us through the complex syntax to pinpoint the interactions and connections between different entities. However, the challenge lies in sifting through this intricate structure to extract relevant information, a task that requires precision and discernment. Traditional approaches often rely on rule-based pruning methods to simplify these dependency structures, focusing on certain parts while discarding others. Yet, this approach has its pitfalls, as it can overlook critical nuances and connections that are vital for a comprehensive understanding of the text. Addressing this gap, our research introduces the Syntactic Dependency-Aware Neural Networks (SDANNs), a groundbreaking model designed to harness the full power of the entire dependency tree. This approach marks a significant departure from the conventional methods. Instead of the rigid rule-based pruning, SDANNs implement a more flexible and dynamic 'soft-pruning' technique. This method allows the model to adaptively focus on the sub-structures within the dependency tree that are most relevant for understanding the relationships between entities. By doing so, it ensures that no vital information is overlooked, and all potential connections are considered. The efficacy of SDANNs is not just theoretical but has been empirically validated through extensive testing and evaluations across a wide range of tasks. These tasks include the extraction of complex relations spanning multiple sentences, as well as detailed analyses at the sentence level. In each of these scenarios, SDANNs have demonstrated a remarkable ability to leverage the full structural complexity of dependency trees. This capability sets them apart from existing models, enabling a more nuanced and comprehensive analysis of textual relations. The results of these evaluations consistently show that SDANNs not only meet but significantly exceed the performance of prior models. This superiority is evident in the way SDANNs handle the multifaceted and often subtle interactions within the text, offering insights that were previously inaccessible with conventional methods. In summary, the Syntactic Dependency-Aware Neural Networks represent a significant advancement in the field of text analysis. By fully embracing the complexity of syntactic dependency trees and employing a sophisticated 'soft-pruning' approach, SDANNs open new avenues for exploring and understanding the intricate relationships that exist within written language. This model stands as a testament to the potential of combining advanced neural network architectures with a deep understanding of linguistic structures, paving the way for more accurate, nuanced, and comprehensive analyses of text.

Artificial intelligence techniques are now widely used in various agricultural applications, including the detection of devastating diseases such as late blight (Phytophthora infestans) and early blight (Alternaria solani) affecting potato (Solanum Tuberorsum L.) crops. In this paper, we present a mobile application for potato crop pest detection based on deep neural networks. The images were taken from the PlantVillage dataset with a batch of 1000 images for each of the three identified classes. An exploratory analysis of the architectures used for early and late blight diagnosis in potatoes was performed, achieving an accuracy of 98.76%, with MobileNetv2. Based on the results obtained, an offline mobile application was implemented, supported on devices with Android 4.1 or later, also featuring an information section on the 27 pests affecting potato crops and a gallery of symptoms. For future work, segmentation techniques will be used to highlight the damaged region in the potato leaf by evaluating its extent and possibly identifying different types of pests affecting the same plant.

The reliance on cloud computing services and related technologies has increased due to their many benefits, including resource sharing and the need for organizations to maintain their competitive advantage in the digital market. Also, the pace of cloud growth has significantly increased because of COVID-19. Many companies and businesses have shifted their core processes to the cloud for seamless operations during the pandemic. This migration of legacy systems to the cloud creates many opportunities for businesses. However, on the other hand, it may also bring substantial challenges. Hence, a careful decision is needed to align with company goals. In this paper, we demonstrate the need and advantages of cloud computing, followed by highlighting AWS's characteristics as one of the leading cloud service providers. We also discuss the merger of AWS with SDN to improve cloud data security and performance. The outcomes of this study can provide a data migration strategy and guide decision-makers toward a secure and sustainable migration to a cloud computing environment.

This research investigates the implementation of complex exponential-based neurons in FPGA, which can pave the way for implementing bio-inspired spiking neural networks to compensate for the existing computational constraints in conventional artificial neural networks. The increasing use of extensive neural networks and the complexity of models in handling big data lead to higher power consumption and delays. Hence, finding solutions to reduce computational complexity is crucial for addressing power consumption challenges. The complex exponential form effectively encodes oscillating features like frequency, amplitude, and phase shift, streamlining the demanding calculations typical of conventional artificial neurons through levering simple phase addition of complex exponential functions. The article implements such a two-neuron and a multi-neuron neural model using Xilinx system generator and Vivado design suite, employing 8-bit, 16-bit, and 32-bit fixed-point data format representations. The study evaluates the accuracy of the proposed neuron model across different FPGA implementations while also providing a detailed analysis of operating frequency, power consumption, and resource usage for the hardware implementations. BRAM-based Vivado designs outperformed Simulink regarding speed, power, and resource efficiency. Specifically, the Vivado BRAM-based approach supported up to 128 neurons, showcasing optimal LUT and FF resource utilization. Such outcomes accommodate choosing the optimal design procedure for implementing spiking neural networks on FPGAs.

s: The lack of historical employment data for college graduates, the need to solve the system cold-start problem and the consideration of reciprocity of job recommendation in job recommendation, lead to low recommendation satisfaction and immature application of the existing job recommendation methods. The article presents a new approach to job recommendation using college graduates as the object of study. In the screening stage, a semantic keyword iterative algorithm is applied to compute the similarity between the resume and recruitment texts. This algorithm enhances the intersectionality of keywords in the calculation process, maximizing the utilization of resume information to enhance the accuracy of text similarity calculations. The ranking phase utilizes in-school data to build a social network between college graduates and graduated students, and solves the system's cold-start problem by using the social network to recommend jobs for college graduates where graduated students are employed. Building upon the amalgamation of the semantic keyword iterative algorithm and the social network job recommendation method outlined above, we introduce a dual-dimensional matching approach involving specialty and salary. This enhancement is designed to elevate the reciprocity of job recommendations. The analysis of the results indicates that the average satisfaction rate (AR) and normalized discounted cumulative gain (NDCG) values for the newly proposed job recommendation method surpass those of other methods, demonstrating its superior effectiveness. The method caters to the preferences of graduate job seekers, aligns with job recruitment requirements, and offers extensive job search assistance to a broad spectrum of graduates.

This paper aims to analyze the intellectual structure and research fronts in application information security in smart cities to identify research boundaries, trends, and new opportunities in the area. It applies bibliometric analyses to identify the main authors and their influences on the information security and smart city area. Moreover, this analysis focuses on journals indexed in Scopus databases. The results indicate that there is an opportunity for further advances in the adoption of information security policies in government institutions. Moreover, the production indicators presented herein are useful for the planning and implementation of information security policies, and the knowledge of the scientific community about smart cities. The bibliometric analysis provides support for the visualization of the leading research technical collaboration networks among authors, co-authors, countries, and research areas. The methodology offers a broader view of the application information security in smarty city areas and makes it possible to assist new research that may contribute to further advances. The smart city topic has been receiving much attention in recent years, but to the best of our knowledge, there is no research on reporting new possibilities for advances. Therefore, this article may contribute to an emerging body of literature that explores the nature of application information security and smart city research productivity to assist researchers in better understanding the current emerging of the area.

Network neuroscience delves into comprehending the intricate arrangement and interactions within the neural networks of the brain. By merging insights from both neuroscience and network theory, it investigates the brain's structure and function through the lens of interconnected nodes (symbolizing brain regions) and edges (symbolizing the connections among these regions) forming a dynamic network. Graph metrics play a pivotal role in neuroscience by providing quantifiable insights into the intricate connectivity patterns within the brain's neural networks. Frequently, nodes are extracted from functional or structural atlases, which can lead to diverse shapes and sizes. Nevertheless, our understanding of how these differing node characteristics and definitions impact the computed graph metrics in neuroimaging data remains limited. This study adopts a data-driven methodology to delineate functional nodes, subsequently examining the influence of their sizes on resultant graph metrics. By employing the Neuromark framework, an entirely automated independent component analysis (ICA) is applied to resting state fMRI data. Through this, functional network connectivity (FNC) matrices are computed—capturing Pearson correlations between component-time courses—while employing a proportional threshold to streamline node connections based on these correlations. Subsequently, various global and local graph metrics are computed, offering insights into network characteristics. Global metrics provide an overarching summary of the network structure, while local measures delve into structural intricacies at the individual component level. Node sizes are computed based on voxel counts surpassing a designated threshold. Next, we calculated the Pearson correlation between the obtained node sizes and the graph metrics, which we term 'node-metric coupling' (NMC). Our findings revealed consistent and noteworthy correlations between the values of graph metrics and the dimensions of brain nodes. To delve deeper into the implications of this correlation, we examined the node-metric coupling within a dataset comprising Alzheimer's disease, mild cognitive impairment, and control subjects. The disparities observed in node-metric coupling among these groups underscore the necessity of accounting for this factor during analysis. The two principal outcomes of this study are as follows: Firstly, the substantial interplay between varying node sizes within a given atlas and the resultant graph metrics; and secondly, the potential utility of node-metric coupling as a viable biomarker for brain disorders. These discoveries hold significant ramifications. While comparing studies employing diverse atlases is already a challenge, our work highlights an additional, critical source of variability: accounting for node sizes. Consequently, the association between intra-atlas node size and graph metric should be thoughtfully acknowledged in future neuroimaging investigations.

Over the years, network analysis became a promising strategy to analyze complex system, i.e. systems composed by a large number of interacting elements. In particular, multilayer networks have emerged as a powerful framework for modelling and analysing complex systems with multiple types of interactions. Network analysis can be applied to pharmacogenomics to gain insights into the interactions between genes, drugs, and diseases. By integrating network analysis techniques with pharmacogenomic data, the goal consists to uncover complex relationships and identify key genes to use in pathway enrichment analysis to figure out biological pathways involved in drug response and adverse reactions. In this study, we model omics, diseases and drugs data together through the multilayer network representation. Then, we mined the multilayer network with a community detection algorithm by obtaining top communities. After that, we used the identified list of genes from the communities to perform pathway enrichment analysis (PEA) to figure out the biological function affected form the selected genes. The results show that the genes forming the top community have the multiple roles through different pathways.

The definition of artificial intelligence (AI) is the capacity of a computer or machine to mimic or simulate human intelligence. AI has been applied in different areas, including medicine. In cardiology, AI techniques have revolutionized the field of cardiac diagnosis, enabling the detection and prediction of cardiovascular diseases to be more accurate and efficient. This article provides an overview of machine learning, deep learning, and neural networks as they pertain to cardiac diagnosis. We will investigate how these techniques harness the power of data and algorithms to analyze complex patterns in cardiac data, thereby facilitating early detection, risk assessment, and treatment decision-making.

In cold-climate regions, road salt is used as a de-icer for winter road maintenance. The applied road salt melts ice and snow on roads, being washed off through storm sewer systems into nearby urban streams, harming the freshwater ecosystem. Addressing the gap in the knowledge regarding the use of deep learning approaches for urban stream water quality forecasting, the present work discusses our implementation of a “Graph Neural Network” - “Sample and Aggregate” (GNN-SAGE) model for forecasting chloride concentrations in the Credit River in Ontario, Canada. The proposed GNN-SAGE is compared to other models, including a Deep Neural Network based transformer (DNN-Transformer) and a benchmarking persistence model for 6 hours forecasting horizon. Ac-cording to the results, the GNN-SAGE model surpasses other models in providing accurate predic-tions of chloride concentrations within the assessed prediction window. Also, a SHAP analysis provides insight into the variables that influence the model’s forecasting, showing the impact of the spatiotemporal neighbouring data from the network and the seasonality variables on the model’s result. The GNN-SAGE model shows potential for use in real-time forecasting of water quality in urban streams, aiding in the development of regulatory policies to protect the vulnerable freshwater ecosystems in urban areas.

Deep neural networks with powerful auto-optimization tools have been widely applied in various research fields, e.g., NLP and computer vision. However, existing neural network architectures typically are constructed using different inductive biases, e.g., preconceptions, expecting to decrease parameter search space during training, reduce computational cost or introduce expert knowledge in the neural network design. As an alternative, Multilayer Perceptron (MLP) provides much better freedom for exploration, has a lower inductive bias than convolutional neural networks (CNNs), and offers good flexibility in learning complex patterns. Even though, such neural architectures are commonly built in a flat Euclidean space, which is not necessarily the optimal space for any data, and is especially not good for modeling hierarchical correlations. Hyperbolic neural networks (HNNs) have gained attention for their ability to capture hierarchical structures present in complex data types like graphs. Recently, there has been an increasing interest to extend HNNs to computer vision tasks, motivated by the observations that images possess rich hierarchical relations. However, this is generally applied by employing a Euclidean backbone for learning higher-level semantic representations and only incorporating a hyperbolic classifier for classification, which, we argue, does not make full use of the advantage of hyperbolic space. Considering the recovery of the attention-free Multilayer Perceptron(MLP), in this paper, we extend it to non-Euclidean space and propose a novel architecture, named Hyperbolic Res-MLP (HR-MLP), that leverages fully hyperbolic layers to learn feature embeddings and perform image classification in an end-to-end fashion. With the help of the proposed Lorentz cross-patch and cross-channel layers, we can directly perform operations in the hyperbolic domain with fewer parameters, making it faster to train and providing comparatively better performance than its Euclidean counterpart. Experiments on CIFAR10, CIFAR100, and MiniImageNet demonstrate a comparable and superior performance when compared to Euclidean baselines. Our code is available at (https://github.com/Ahmad-Omar-Ahsan/HR-MLP)

To describe the hysteresis nonlinearities in smart actuators, numerous models have been presented in the literature, among which the Preisach operator would be the most effective one due to its capability in capturing multi-loop or sophisticated hysteresis curves. When such an operator is coupled with uncertain nonlinear dynamics, especially in noncanonical form, it is a challenging problem to develop techniques to cancel out the hysteresis effects, and at the same time achieve asymptotic tracking performance. To resolve this problem, in this paper, we investigate the problem of iterative inverse-based adaptive control for an uncertain noncanonical nonlinear systems with unknown input Preiasch hysteresis, and a new adaptive version of the closest match algorithm is proposed to compensate for the Preisach hysteresis. With our scheme, the stability and convergence of the closed-loop system can be established. The effectiveness of the proposed control scheme is illustrated by simulation and experiment results.

Prediction markets are heralded as powerful forecasting tools, but models to describe them often fail to capture the full complexity of the underlying mechanisms that drive price dynamics. To address this issue, we propose a model in which agents belong in a social network, have an opinion about the probability of a particular event to occur, and bet on the prediction market accordingly. Agents update their opinions about the event by interacting with their neighbours in the network, following the Deffuant model of opinion dynamics. Our results suggest that a simple market model that takes into account opinion formation dynamics is capable to replicate the empirical properties of historical prediction market time series, including volatility clustering and fat-tailed distribution of returns. Interestingly, the best results are obtained when there is the right level of variance in the opinions of the agents. Moreover, this paper provides a new way to indirectly validate opinion dynamics models against real data by using historical data obtained from PredictIt, an exchange platform whose data has never been used before to validate models of opinion diffusion.

Background and Objectives: There is a need to effectively manage the healthy aging of the rapidly increasing number of elderly people in an ultra-elderly society. The purpose of this study was to analyze the mediating effects of social networks and wisdom on the relationship between lifestyle habits and healthy aging in older adults with chronic diseases. Materials and Methods: Participants were 120 community-dwelling older adults aged 65 and older with at least one chronic disease. Data were collected from elderly people who met the criteria by visiting nursing care worker training centers, senior centers, social gatherings, and home welfare centers in D, G, and S cities from May 24 to June 23, 2023, with a questionnaire consisting of lifestyle habits, social networks, wisdom and healthy aging, and general characteristics. Results: The degree of healthy aging of the subjects was 3.56 out of 5, and there were differences in the degree of healthy aging according to age (F=3.76, p=0.026), spousal relationship (t=3.11, p=0.002), education (F=9.08, p<0.001), number of diseases (F=8.65, p<0.001), and economic level (t=-2.45, p=0.016). The most common diseases among the subjects were hypertension, hyperlipidemia, joint diseases and diabetes mellitus. Healthy aging was highly correlated with lifestyle habits (r=0.63, p<0.001), social networks (r=0.65, p<0.001), and wisdom (r=0.73, p<0.001). Social networks (β=0.46, p<0.001) and wisdom (β=0.55, p<0.001) had partial mediating effects (z=4.15, p<0.001; z=5.11, p<0.001) on the relationship between subjects' lifestyle habits and healthy aging. Conclusions: In order to increase the degree of healthy aging of the subjects, it is necessary to establish a mediating intervention program that manages to have a good lifestyle habits in daily life, increase social networks, and become wise.

Symbolic semantic understanding of staff images is an important part in music information retrieval. Due to the complex composition of staff symbols and the strong semantic correlation between symbol spaces, it is difficult to understand the pitch and duration of each note during performances. In this paper, we design a semantic understanding system for optical staff symbols. The system uses the YOLOv5 to implement optical staff’s low-level semantic understanding stage, which understands the pitch and duration in natural scales and other symbols that affect the pitch and duration. The proposed note encoding reconstruction algorithm is used to implement high-level semantic understanding stage. Such algorithm understands the logical, spatial, and temporal relationships between natural scales and other symbols based on music theory, and outputs digital codes for the pitch and duration of main notes during performances. The model is trained with a self-constructed SUSN dataset. Experimental results of YOLOv5 show that the precision is 0.989 and the recall is 0.972. For the system, the error rate is 0.031 and the omission rate is 0.021. The paper concludes by analysing the causes of semantic understanding errors and offers recommendations for further research. The results of this paper provide a method for multimodal music artificial intelligence applications such as notation recognition through listening, intelligent score flipping and automatic performance.

Deploying UAVs as aerial base stations is an exceptional approach to reinforce terrestrial infrastructure owing to their remarkable flexibility and superior agility. However, it is essential to design their flight trajectory effectively to make the most of UAV-assisted wireless communications. This paper presents a novel method for improving wireless connectivity between UAVs and terrestrial users through effective path planning. This is achieved by developing a goal-directed trajectory planning method using active inference. First, we create a global dictionary using TSPWP instances executed on various training examples. This dictionary contains letters representing available hotspots, tokens representing local paths, and words depicting complete trajectories and hotspot order. By using this world model, the UAV can understand the TSPWP’s decision-making grammar and how to use the available letters to form tokens and words at various levels of abstraction and time scales. With this knowledge, the UAV can assess encountered situations and deduce optimal routes based on the belief encoded in the world model. Our proposed method outperforms traditional Q-learning by providing fast, stable, and reliable solutions with good generalization ability.

Accurate seasonal weather forecasts are vital across a broad spectrum of applications, bearing significant environmental and socioeconomic implications. This importance renders the subject a matter of primary interest to a wide range of stakeholders, including the general public, agricultural sector, emergency responders, financial institutions, and policy strategists. The need for precision in long-term predictive models necessitates the development of innovative methodologies. These methodologies should be capable of deciphering atmospheric patterns and mechanisms with detail, especially at a local level, without the resource constraints that dynamical downscaling imposes. In response to this expanding demand, this study presents a novel solution, combining a stochastic deep learning methodology, specifically Generative Adversarial Networks (GANs), with a Digital Elevation Model (DEM). The cornerstone of the proposed model is the enhancement of gridded temperature fields from seasonal forecasts. The area of focus was the Hellenic region, wherein the spatial resolution is amplified from a coarse 1° x 1° grid to an impressively detailed 0.1° x 0.1° grid. This offers a transformative perspective for interpreting and employing this crucial meteorological data. The results suggest that the downscaled fields adequately approximate the actual spatial distribution, although the predicted values tend to slightly overestimate and in some cases underestimate the original ones. This study underlines the potential of this approach to significantly enhance the resolution and utility of weather forecasts, thereby contributing to a variety of sectors dependent on reliable meteorological data.

Automatic and real-time pose estimation is important in monitoring animal behavior, health and welfare. In this paper, we utilized pose estimation for monitoring farrowing process to prevent piglet mortality and preserve the health and welfare of sow. State-of-the-art Deep Learning (DL) methods have lately been used for animal pose estimation. The aim of this paper was to probe the generalization ability of five common DL networks (ResNet50, ResNet101, MobileNet, EfficientNet and DLCRNet) for sow and piglet pose estimation. These architectures predict body parts of several piglets and the sow directly from input video sequences. Real farrowing data from a commercial farm was used for training and validation of the proposed networks. The experimental results demonstrated that MobileNet was able to detect seven body parts of the sow with median test error of 0.61 pixels.

This paper proposes an encryption scheme for high pixel density images. Based on the application of the quantum random walk algorithm, the Long short-term memory (LSTM) can effectively solve the problem of low efficiency of the quantum random walk algorithm in generating large-scale pseudorandom matrices, and further improve the statistical properties of the pseudorandom matrices required for encryption. The LSTM is then divided into columns and fed into the LSTM in order for training. Due to the randomness of the input matrix, the LSTM cannot be trained effectively, so the output matrix is predicted to be highly random. The LSTM prediction matrix of the same size as the key matrix is generated based on the pixel density of the image to be encrypted, which can effectively complete the encryption of the image. In the statistical performance test, the proposed encryption scheme achieves an average information entropy of 7.9992, an average number of pixels changed rate (NPCR) of 99.6231%, an average uniform average change intensity (UACI) of 33.6029% and an average correlation of 0.0032. Finally, various noise simulation tests are also conducted to verify its robustness in real-world applications where common noise and attack interference are encountered.

For a mobile robot, navigation in a densely crowded space can be a challenging and sometimes impossible task, especially with traditional techniques. In this paper, we present a framework to train neural controllers for differential drive mobile robots which must safely navigate a crowded environment while trying to reach a target location. To learn the robot’s policy, we train a convolutional neural network using two reinforcement learning algorithms, Deep Q-Networks (DQN) and Asynchronous Advantage Actor Critic (A3C), and develop a training pipeline that allows to scale the process to several compute nodes. We show that the asynchronous training procedure in A3C can be leveraged to quickly train neural controllers and test them on a real robot in a crowded environment.

Skin detection, the process of distinguishing between skin and non-skin regions in a digital image, is widely used in a variety of applications ranging from hand gesture analysis to body part tracking to facial recognition. Skin detection is a challenging problem that has received a lot of attention from experts and proposals from the research community in the context of intelligent systems, but the lack of common benchmarks and unified testing protocols has hampered fairness among approaches. Comparisons are very difficult. Recently, the success of deep neural networks has had a major impact on the field of image segmentation detection, resulting in various successful models to date. In this work, we survey the most recent research in this field and propose fair comparisons between approaches using several different datasets. The main contributions of this work are: (i) a comprehensive literature review of approaches to skin color detection and a comparison of approaches that may help researchers and practitioners choose the best method for their application; (ii) a comprehensive list of datasets that report ground truth for skin detection; (iii) a framework for evaluating and combining different skin detection approaches. Moreover, we proposed an ensemble of convolutional neural networks and transformers that obtains state of the art performance. All the code is made publicly available at https://github.com/LorisNanni

When existing at emulsion interface and continuous phase, dispersibility of water-soluble flexible polymer chains has obvious effect on rheology and dielectric properties of whole emulsion. CNF Pickering emulsion is a good system to research these properties with respect to their microscopic phase structure, dielectric and rheological properties by using cellulose nanofibers (CNF) as water-soluble Pickering emulsifier, liquid Paraffin as oil phase and DDAB as a cationic auxiliary surfactant. The CNF- and DDAB-contents were systematically varied while the water to paraffin oil ratio remained constant to discern the influence of the Pickering emulsifiers. Polarized optical microscopic images revealed that the droplets have tendency to become smaller size for higher CNF content, but bigger size for higher DDAB content, which was proved by the fluorescent analysis for CNF dispersibility with varying DDAB content. The dielectric damping exhibits a minimum, whose value decreases with increasing DDAB- and CNF-content. Increasing the DDAB-content promotes solubilization of CNFs in the aqueous phase and will increase the overall viscosity and yield points. Similarly, a higher CNF-content leads to a higher viscosity and yield point, but at high DDAB-contents the viscosity function exhibits an S-shape at intermediate CNF-content. To evaluate the results further they were compared with CNF-dispersions (without oil-phase), which showed a surfactant effect slightly on maximum stress but strongly on yield stress τy, indicating DDAB can promote the formation of CNF network rather than the viscosity of whole system.

3D reconstruction from a single 2D input is a classic problem in the field of computer vision. With the advancements in deep learning, the performance of 3D reconstruction has also significantly improved. The reconstruction task is more difficult for objects with no textures or complex deformations. This paper serves as a review of recent literature on 3D reconstruction from a single view, with a focus on deep learning methods from 2018 to 2021. Due to lack of standard datasets or 3D shape representation methods, it is hard make direct comparisons between all reviewed methods. However, this paper reviews different approaches for reconstructing 3d shape as depth maps, surface normals, point clouds and meshes; along with various loss functions and evaluation metrics used to train and evaluate these methods.

When computers start to become a dominant part of technology around the 1950s, fundamental questions about reliable designs and robustness were of great relevance. Their development gave rise to the exploration of new questions such as what made brains reliable (since neurons can die) and how computers could get inspiration from neural systems. In parallel, the first Artificial Neural Networks came to life. Since then, the comparative view between brains and computers has been developed in new, sometimes unsuspected directions. With the rise of deep learning and the development of connectomics, an evolutionary look at how both hardware and neural complexity have evolved or designed is required. In this paper, we argue that important similarities have resulted both from convergent evolution (the inevitable outcome of architectural constraints) and inspiration of hardware and software principles guided by toy pictures of neurobiology. Moreover, dissimilarities and gaps originate from the lack of major innovations that have paved the way to biological computing (including brains) that are completely absent within the artificial domain. As it occurs within synthetic biocomputation, we can also ask whether alternative minds can emerge from A.I.\ designs. Here we take an evolutionary view of the problem and discuss the remarkable convergences between living and artificial designs and what are the pre-conditions to achieve artificial intelligence.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

The commonly-used large-scale knowledge bases have been facing challenges in open domain question answering tasks which are caused by the loose knowledge association and weak structural logic of triplet-based knowledge. To find a way out of this dilemma, this work proposes a novel metaknowledge enhanced approach for open domain question answering. We design an automatic approach to extract metaknowledge and build metaknowledge network from Wiki documents. For the purpose of representing the directional weighted graph with hierarchical and semantic features, we present an original graph encoder GE4MK to model the metaknowledge network. Then a metaknowledge enhanced graph reasoning model MEGr-Net is proposed for question answering, which aggregates both relational and neighboring interactions comparing with R-GCN and GAT. Experiments have proved the improvement of metaknowledge over main-stream triplet-based knowledge. We have found that the graph reasoning models and pre-trained language models also have influences on the metaknowledge enhanced question answering approaches.

In this paper, we examine two strategies for boosting the performance of ensembles of Siamese networks (SNNs) for image classification using two loss functions (Triplet and Binary Cross Entropy) and two methods for building the dissimilarity spaces (FULLY and DEEPER). With FULLY, the distance between a pattern and a prototype is calculated by comparing two images using the fully connected layer of the Siamese network. With DEEPER, each pattern is described using a deeper layer combined with dimensionality reduction. The basic design of the SNNs takes advantage of supervised k-means clustering for building the dissimilarity spaces that train a set of support vector machines, which are then combined by sum rule for a final decision. The robustness and versatility of this approach are demonstrated on several cross-domain image data sets, including a portrait data set, two bioimage and two animal vocalization data sets. Results show that the strategies employed in this work to increase the performance of dissimilarity image classification using SNN is closing the gap with standalone CNNs. Moreover, when our best system is combined with an ensemble of CNNs, the resulting performance is superior to an ensemble of CNNs, demonstrating that our new strategy is extracting additional information.

Diabetic retinopathy is the most common microvascular complication of diabetes mellitus and one of the leading causes of blindness globally. Due to the progressive nature of the disease, earlier detection and timely treatment can lead to substantial reductions in the incidence of irreversible vision-loss. Artificial intelligence (AI) screening systems have offered clinically acceptable and quicker results in detecting diabetic retinopathy from retinal fundus and optical coherence tomography (OCT) images. Thus, this systematic review and meta-analysis of relevant investigations was performed to document the performance of AI screening systems that were applied to fundus and OCT images of patients from diverse geographic locations including North America, Europe, Africa, Asia, and Australia. A systematic literature search on Medline, Global Health, and PubMed was performed and studies published between October 2015 and January 2020 were included. The search strategy was based on the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guidelines, and AI-based investigations were mandatory for studies inclusion. The abstracts, titles, and full-texts of potentially eligible studies were screened against inclusion and exclusion criteria. Twenty-one studies were included in this systematic review; 18 met inclusion criteria for the meta-analysis. The pooled sensitivity of the evaluated AI screening systems in detecting diabetic retinopathy was 0.93 (95% CI: 0.92-0.94) and the specificity was 0.88 (95% CI: 0.86-0.89). The included studies detailed training and external validation datasets, criteria for diabetic retinopathy case ascertainment, imaging modalities, DR-grading scales, and compared AI results to those of human graders (e.g., ophthalmologists, retinal specialists, trained nurses, and other healthcare providers) as a reference standard. The findings of this study showed that the majority AI screening systems demonstrated clinically acceptable levels of sensitivity and specificity for detecting referable diabetic retinopathy from retinal fundus and OCT photographs. Further improvement depends on the continual development of novel algorithms with large and gradable sets of images for training and validation. If cost-effectiveness ratios can be optimized, AI can become a financially sustainable and clinically effective intervention that can be incorporated into the healthcare systems of low-to-middle income countries (LMICs) and geographically remote locations. Combining screening technologies with treatment interventions such as anti-VEGF therapy, acellular capillary laser treatment, and vitreoretinal surgery can lead to substantial reductions in the incidence of irreversible vision-loss due to proliferative diabetic retinopathy.

The spread of the Coronavirus pandemic has been accompanied by an infodemic. The false information that is embedded in the infodemic affects people’s ability to have access to safety and follow proper procedures to mitigate the risks. Here, we present a novel supervised machine learning text mining algorithm that analyzes the content of a given news article and assign a label to it. The NeoNet algorithm is trained by noun-phrases features which contributes a network model. The algorithm was tested on a real-world dataset and predicted the label of never-seem articles and flags ones that are suspicious or disputed. In five different fold comparisons, NeoNet surpassed prominent contemporary algorithm such as Neural Networks, SVM, and Random Forests. The analysis shows that the NeoNet algorithm predicts a label of an article with a 100% precision using a non-pruned model. This highlights the promise of detecting disputed online contents that may contribute negatively to the COVID-19 pandemic. Indeed, using machine learning combined with powerful text mining and network science provide the necessary tools to counter the spread of misinformation, disinformation, fake news, rumors, and conspiracy theories that is associated with the COVID19 Infodemic.

Dynamical system tools offer a complementary approach to detailed biophysical seizure modeling, with a high potential for clinical applications. This review describes the theoretical framework that provides a basis for theorizing certain properties of seizures and for their classification according to their dynamical properties at onset and offset. We describe various modeling approaches spanning different scales, from single neurons to large-scale networks. This narrative review provides an accessible overview of this field, including non-exhaustive examples of key recent works.

Alcohol consumption is now common practice worldwide, and functional brain networks are beginning to reveal the complex interactions observed with alcohol consumption and abstinence. The autonomic nervous system (ANS) has a well-documented relationship with alcohol use, and a growing body of research is finding links between the ANS and functional brain networks. This study recruited everyday drinkers in an effort to uncover the relationship between alcohol abstinence, ANS function, and whole brain functional brain networks. Participants (n=29), 24-60 years-of-age, consumed moderate levels of alcohol regularly (males 2.4 (±0.26) drinks/day, females 2.3 (±0.96) drinks/day). ANS function, specifically cardiac vagal tone, was assessed using the Porges-Bohrer method for calculating respiratory sinus arrhythmia (PBRSA). Functional brain networks were generated from resting-state MRI scans obtained following 3-day periods of typical consumption and abstinence. A multi-task mixed-effects regression model determined the influences of HRV and drinking state on functional network connectivity. Results showed differences in the relationship between the strength of network connections and clustering coefficients across drinking states, moderated by PBRSA. Increases in connection strength between highly clustered nodes during abstinence as PBRSA increases demonstrates a greater possible range of topological configurations at high PBRSA values. This novel finding begins to shed light on the complex interactions between typical alcohol abstinence and physiological responses of the central and autonomic nervous system.

The forecast of electricity demand has been a recurrent research topic for decades, due to its economical and strategic relevance. Several Machine Learning (ML) techniques have evolved in parallel with the complexity of the electric grid. This paper reviews a wide selection of approaches that have used Artificial Neural Networks (ANN) to forecast electricity demand, aiming to help newcomers and experienced researchers to appraise the common practices and to detect areas where there is room for improvement in the face of the current widespread deployment of smart meters and sensors, which yields an unprecedented amount of data to work with. The review looks at the specific problems tackled by each one of the selected papers, at the results attained by their algorithms, and at the strategies followed to validate and compare the results. This way, it is possible to highlight some peculiarities and algorithm configurations that seem to consistently outperform others in specific settings.

Despite gender equality being present in the social and political sphere, we still encounter aspects that are characteristic of sexism. Such aspects impact upon gender inequality and different types of violence towards women. The present article aims to examine the behaviour of adolescents from Huelva with regards to ambivalent sexism towards women on social networks and their influence on health. Further, we seek to uncover adolescent’s perceptions with regards to gender differences in the use of social networks, the relationship between sexism and women's emotional well-being was observed. The study sample was formed by young people aged between 14 and 16 years who were residing in rural and urban zones in the south of Spain. A mixed methods approach was taken. At a quantitative level, a sample of 400 young people was recruited. These were administered a questionnaire about sexism which was composed of two scales and has been validated at a national and international level. At a qualitative level, the study counted on 33 young people who participated in in-depth discussions via interviews and discussion groups. The results showed that sexism emerges in adolescence in the analysed sample from the south of Spain. This favoured a digital gender gap and was reinforced through social networks such as Instagram and Snapchat. Rising awareness and a critical view of the aforementioned sexism was shown on the behalf of females, particularly those from urban backgrounds.

Created in 1905, the Société des Artistes Meridionaux organized annual exhibitions in Toulouse, in order to promote regional arts and (re)created a "Latin" - and modern - style. Based on a corpus of 11,486 artworks exhibited at the SAM between 1907 and 1939, this paper seeks to measure the contours and particularities of the Salons des Artistes Meridionaux, using a computational approach.

Being a combination of the conference call, talkback radio, audio podcast, and an online video chat, Clubhouse is a new social networking app that gained over 10 million users and over $100 in valuation in just 8 months. Unlike other social networks, it offers a real-time streaming audio chat that does not ask users to share any unnecessary information like exchanging text messages, conducting video calls, or sharing photos. Instead, Clubhouse users can listen to real-time conversations, contribute to these conversations and create their own conversations for the others to listen and to interact with. Often nicknamed a “Silicon Valley’s hottest start-up”, Clubhouse positions itself as an “exclusive” and “alternative” social network that attracts various celebrities and people who just want to talk to each other. Launched in March 2020, amidst the COVID-19 pandemic with its social distancing and lockdowns, Clubhouse offered its users a space for the digital group psychotherapy where people could solve their problems by talking them through with strangers. However, it is unclear what is going to happen to this new social network in the post-pandemic world after all of its hype eventually evaporates. This paper discusses the possible underlying motives for the Clubhouse creation and its real purposes. Moreover, it looks at the three possible scenarios of its further development.

Recently, much attention has been devoted to finding highly efficient and powerful activation functions for CNN layers. Because activation functions inject different nonlinearities between layers that affect performance, varying them is one method for building robust ensembles of CNNs. The objective of this study is to examine the performance of CNN ensembles made with different activation functions, including six new ones presented here: 2D Mexican ReLU, TanELU, MeLU+GaLU, Symmetric MeLU, Symmetric GaLU, and Flexible MeLU. The highest performing ensemble was built with CNNs having different activation layers that randomly replaced the standard ReLU. A comprehensive evaluation of the proposed approach was conducted across fifteen biomedical data sets representing various classification tasks. The proposed method was tested on two basic CNN architectures: Vgg16 and ResNet50. Results demonstrate the superiority in performance of this approach. The MATLAB source code for this study will be available at https://github.com/LorisNanni.

This research investigated the effects of social isolation on frailty and health outcomes and tested whether these associations varied across different levels of frailty. We performed a multivariate analysis of data from the first wave of the FRéLE study among 1,643 Canadian older adults aged 65 years and over. We assessed social isolation using social participation, social networks, and support from various social ties, namely, friends, children, extended family, and partner. Frailty predicted disability, comorbidity, depression, and cognitive decline. Less social participation was associated with IADLs, depression, and cognitive decline. The absence of friends was associated with depression and cognitive impairment. Less social support from children and partner was related to comorbidity, depression, and cognitive decline. Overall, social isolation is linked to mental health, rather than physical health. The associations of having no siblings, receiving less support from friends, and participating less in social activities with ADL limitations, depression, and cognitive decline were higher among frail than pre-frail and robust older adults. This study corroborates the pivotal role of social connectedness, particularly the quality of relationships, on the mental health of older adults. Public health policies on social relationships are paramount to ameliorate the health status of frail older adults.

In this paper, we propose and evaluate two mechanisms aimed at improving the communication reliability of IEEE 802.15g SUN (Smart Utility Networks) in industrial scenarios: RTS (Re-Transmission Shaping), which uses acknowledgements to track channel conditions and dynamically adapt the number of re-transmissions per packet, and AMS (Adaptive Modulation Selection), which makes use of reinforcement learning based on MAB (Multi-Armed Bandits) to choose the modulation that provides the best reliability for each packet re-transmission. The evaluation of both mechanisms is performed through computer simulations using a dataset obtained from a real-world deployment and two widely used metrics, the PDR (Packet Delivery Ratio) and the RNP (Required Number of Packet transmissions). The PDR measures the ratio between received and transmitted packets, whereas the RNP is the number of packet repetitions before a successful transmission. The results show that both mechanisms allow to increase the communication reliability while not jeopardizing the battery life-time constraints of end devices. For example, when three re-transmissions per packet are allowed, the PDR reaches 98/96\% with a RNP of 2.03/1.32 using RTS and AMS, respectively. Additionally, the combination of both proposed mechanisms allows to reach a 99% PDR with a RNP of 1.7, making IEEE 802.15.4g SUN compliant with the stringent data delivery requirements of industrial applications.

Packet re-transmissions are a common technique to improve link reliability in low-power wireless networks. However, since packet re-transmissions increase the end-device energy consumption and the network load, a maximum number of re-transmissions per packet is typically set, also considering the duty-cycle limitations imposed by radio-frequency regulations. Moreover, the number of re-transmissions per packet is typically set to a constant value, meaning that all packet re-transmissions are treated the same regardless of actual channel conditions (i.e., multi-path propagation or internal/external interference effects). Taking that into account, in this paper we propose and evaluate the concept of re-transmission shaping, a mechanism that manages packet re-transmissions to maximize link reliability, while minimizing energy consumption and meeting radio-frequency regulation constraints. The proposed re-transmission shaping mechanism operates by keeping track of unused packet re-transmissions and allocating additional retransmission when the instantaneous link quality decreases due to channel impairments. To evaluate the re-transmission shaping mechanism we use trace-based simulations using a IEEE 802.15.4g SUN data-set and two widely used metrics, the PDR (Packet Delivery Ratio) and the RNP (Required Number of Packets). The obtained results show that re-transmission shaping is a useful mechanism to improve link reliability of low-power wireless communications, as it can increase PDR from 77.9% to 99.2% while sustaining a RNP of 2.35 re-transmissions per packet, when compared to using a single re-transmission per packet.

In recent years, wireless networks have undoubtedly become a convenient way to connect to the Internet and provide connection to everyone in any corner of the world. In fact, in this era, people are connected to the internet almost everyday and wireless networks give us this privilege in a seamless manner. A wireless network normally consists of access points and nodes where the access points are responsible to amplify the wireless signals, while the nodes are the gadgets that are receiving these signals. However, with such great convenience provided, many challenges are also faced by the users and stakeholders. With no physical connection to devices, wireless networks are evidently more vulnerable to invisible cyber attacks. In this research paper, it the security issues that cause issues in the wireless networks are discussed. Furthermore, an analytical review of privacy challenges found in these networks is performed; these challenges are segregated into security issues and privacy issues. The paper will then present the methods used in conducting a survey and gathering the research results along with further discussion on the results obtained through this study. Finally, a suitable solution is proposed to prevent and overcome the intrusions faced in terms of security and privacy in wireless network scenarios through detection and response mechanism for mitigation of the problems.

Boolean functions and networks are commonly used in the modeling and analysis of complex biological systems, and this paradigm is highly relevant in other important areas in data science and decision making, such as in the medical field and in the finance industry. In a Boolean model, the truth state of a variable is either 0 or 1 at a given time. Despite its apparent simplicity, Boolean networks are surprisingly relevant in many areas of application such as in bioinformatics to model gene expressions and interactions. In the latter case, a gene is either ``on" or ``off" depending on its expression level. Despite the promising utility of Boolean modeling, in most practical applications the Boolean network is not known. Automated learning of a Boolean network and Boolean functions, from data, is a challenging task due in part to the large number of unknowns (including both the structure of the network and the functions) to be estimated, for which a brute force approach would be exponentially complex. In this paper we develop a new information theoretic methodology that we show to be significantly more efficient than previous approaches. Building on the recently developed optimal causation entropy principle (oCSE), that we proved can correctly infer networks distinguishing between direct versus indirect connections, we develop here an efficient algorithm that furthermore infers a Boolean network (including both its structure and function) based on data observed from the evolving states at nodes. We call this new inference method, Boolean optimal causation entropy (BoCSE), which we will show that our method is both computationally efficient and also resilient to noise. Furthermore, it allows for selection of a set of features that best explains the process, a statement that can be described as a networked Boolean function reduced order model. We highlight our method to the feature selection in several real-world examples: (1) diagnosis of urinary diseases, (2) Cardiac SPECT diagnosis, (3) informative positions in the game Tic-Tac-Toe, and (4) risk causality analysis of loans in default status. Our proposed method is effective and efficient in all examples.

Retinopathy is a human eye disease that causes changes in retinal blood vessels that leads to bleed, leak fluid and vision impairment. Symptoms of retinopathy are blurred vision, changes in color perception, red spots, and eye pain. In this paper, a new methodology based on Convolutional Neural Networks (CNN) is developed and proposed to diagnose and give a decision about the presence of retinopathy. The CNN model is trained by different images of eyes that have retinopathy and those which do not have retinopathy. The performance of the proposed model is compared with the related methods of DREAM, KNN, GD-CNN and SVM. Experimental results show that the proposed CNN performs better.

With the widespread of embedded sensing capabilities of mobile devices, there has been unprecedented development of context-aware solutions. This allows the proliferation of various intelligent applications such as those for remote health and lifestyle monitoring, intelligent personalized services, etc. However, activity context recognition based on multivariate time series signals obtained from mobile devices in unconstrained conditions is naturally prone to imbalance class problems. This means that recognition models tend to predict classes with the majority number of samples whilst ignoring classes with the least number of samples, resulting in poor generalization. To address this problem, we propose to augment the time series signals from inertia sensors with signals from ambient sensing to train deep convolutional neural networks (DCNN) models. DCNN provides the characteristics that capture local dependency and scale invariance of these combined sensor signals. Consequently, we developed a DCNN model using only inertial sensor signals and then developed another model that combined signals from both inertia and ambient sensors aiming to investigate the class imbalance problem by improving the performance of the recognition model. Evaluation and analysis of the proposed system using data with imbalanced classes show that the system achieved better recognition accuracy when data from inertial sensors are combined with those from ambient sensors such as environment noise level and illumination, with an overall improvement of 5.3% accuracy.

This paper analyzes the robust dissipativity of uncertain stochastic generalized neural networks (USGNNs) with Markovian jumping parameters and time-varying delays. In practical applications most of the systems refer to uncertainties, hence, the norm-bounded parameter uncertainties and stochastic disturbance are considered. Then, by constructing an appropriate Lyapunov-Krasovskii functional (LKF) and by employing integral inequalities LMI-based sufficient conditions of the considered systems are established. Numerical simulations are given to show the merit of the presented results.

This paper investigates the use of deep learning techniques to perform energy demand forecasting. Specifically, the authors have adapted a deep neural network originally thought for image classification and composed of a convolutional neural network (CNN) followed by a multilayered fully connected artificial neural network (ANN). The convolutional part of the network was fed with a grid of temperature forecasting data distributed in the area of interest in order to extract a featured temperature. The subsequent ANN is then fed with this calculated temperature along with other data related to the timing of the forecast. The proposed structure was first trained and then used in a real setting aimed to provide the French energy demand forecast using ARPEGE forecasting weather data. The results show that the performance of this approach is in the line of the performance provided by the reference RTE subscription-based service, which opens the possibility to obtain high accuracy forecasting using widely accessible deep learning techniques through open-source machine learning platforms.

Physical measurements might display range values extending towards infinite. The occurrence of infinity in physical equations, such as the black hole singularities, is a troublesome issue that causes many theories to break down when assessing extreme events. Different methods, such as re-normalization, have been proposed to avoid detrimental infinity. Here a novel technique is proposed, based on physical geometrical considerations and the Alexander Horned sphere, that permits to undermine infinity in physical equations. In this unconventional approach, a continuous monodimensional line becomes an assembly of countless bidimensional lines that superimpose in quantifiable knots and bifurcations.

Systems Engineering is an ubiquitous discipline of Engineering overlapping industrial, chemical, mechanical, manufacturing, control, software, electrical, and civil engineering. It provides tools for dealing with the complexity and dynamics related to the optimisation of physical, natural, and virtual systems management. This paper presents a review of how multi-agent systems and complex networks theory are brought together to address Systems Engineering and management problems. The review also encompasses current and future research directions both for theoretical fundamentals and applications in Industry. This is made by considering trends such as mesoscale, multiscale, and multilayer networks; along with the state-of-art analysis on network dynamics and intelligent networks. Critical and smart infrastructure, manufacturing processes, and supply chain networks are instances of research topics for which this literature review is highly relevant.

The EigenAnt algorithm has been proposed to find the shortest path between two nodes with a proof of convergence. Two novel features are noticeable in EigenAnt compared to the conventional ant colony optimization algorithms. Pheromone evaporation in the EigenAnt algorithm is done locally for the selected path and it does not use heuristic information in its selection phase. On the other hand, a simple version of ant colony optimization that also does not use heuristic information has been used for analyzing convergence, considering parameter impact analysis, in the problem of finding the shortest path for 1-node binary chain problems. In this paper, we propose to improve the EigenAnt algorithm by adding additional parameters in such a way as to be able to take advantage of the analysis developed for the simple ant colony optimization algorithm. We demonstrate through our analysis that since the Improved EigenAnt algorithm has one parameter more than ant colony optimization algorithms, tuning of convergence speed is decoupled from tuning of convergence features in the algorithm. Thus, IEigenAnt, which can be interpreted as having two uncorrelated intensification and diversification components, makes it possible to achieve a balance between intensification and diversification. In order to illustrate the advantages of this decoupling, we present experimental results for the routing network problem.

Online Social Networks (OSNs), such as Facebook and Twitter, have become a very important part of many people’s daily lives. Unfortunately, the high popularity of these platforms makes them very attractive to spammers. Machine-learning (ML) techniques have been widely used as a tool to address many cybersecurity application problems (such as spam and malware detection). However, most of the proposed approaches do not consider the presence of adversaries that target the defense mechanism itself. Adversaries can launch sophisticated attacks to undermine deployed spam detectors either during training or the prediction (test) phase. Not considering these adversarial activities at the design stage makes OSNs’ spam detectors prone to a range of adversarial attacks. This paper thus surveys the attacks against Twitter spam detectors in an adversarial environment. In addition, a general taxonomy of potential adversarial attacks is proposed by applying common frameworks from the literature. Examples of adversarial activities on Twitter were provided after observing Arabic trending hashtags. A new type of spam tweet (Adversarial spam tweet), which can be used to undermine deployed classifier, were found. In addition, possible countermeasures that could increase the robustness of Twitter spam detectors against such attacks are investigated.

Opportunistic routing has emerged as one of the prominent solutions for efficient data delivery in ad hoc networks especially in highly dynamic scenarios. Opportunistic routing uses the broadcasting nature of the wireless medium to increase the number of potential forwarding nodes in the network, thereby improving the delivery rate. But most of the proposed opportunistic routing protocols suffer from increased duplicate data forwarding at the intermediate nodes in the network which leads to increase in traffic and reduced efficiency. We propose a novel method which uses acknowledgements for controlling the data forwarding by intermediate nodes and thereby eliminating most of the duplicate forwarding in the network. Simulation results show that our proposed method is much more efficient that all the major existing opportunistic protocols.