Adaptive bitrate (ABR) algorithms optimize the quality of streaming experiences for users in client-side video players especially in unreliable or slow mobile networks. Several rule-based heuristic algorithms can achieve stable performance, but they sometimes fail to adapt properly to changing network conditions. Fluctuating bandwidth may cause algorithms to default to behavior that creates a negative experience for the user. ABR algorithms can be generated with reinforcement learning, a decision-making paradigm in which an agent learns to make optimal choices through interactions with an environment. Training reinforcement learning algorithms for bitrate streaming requires building a simulator for an agent to experience interactions quickly; training an agent in the real environment is infeasible due to the long step times in real environments. This project explores using supervised learning to construct a world-model, or a learned simulator, from recorded interactions. A reinforcement learning agent trained inside of the learned model, rather than a simulator, can outperform rule-based heuristics. Furthermore, agents trained inside the learned world-model can outperform model-free agents in low sample regimes. This work highlights the potential for world-models to quickly learn simulators, and to be used to generate optimal policies.

Currently, the most important challenge in any assessment of state-of-the-art sensor technology and its reliability is to achieve road traffic safety targets. The research reported in this paper is focused on the design of a procedure for evaluating the reliability of Internet-of-Things (IoT) sensors and the use of a Cyber-Physical System (CPS) for the implementation of that evaluation procedure to gauge reliability. An important requirement for the generation of real critical situations under safety conditions is the capability of managing a co-simulation environment, in which both real and virtual data sensory information can be processed. An IoT case study that consists of a LiDAR-based collaborative map is then proposed, in which both real and virtual computing nodes with their corresponding sensors exchange information. Specifically, the sensor chosen for this study is a Ibeo Lux 4-layer LiDAR sensor with IoT added capabilities. Implementation is through an artificial-intelligence-based modeling library for sensor data-prediction error, at a local level, and a self-learning-based decision-making model supported on a Q-learning method, at a global level. Its aim is to determine the best model behavior and to trigger the updating procedure, if required. Finally, an experimental evaluation of this framework is also performed using simulated and real data

The problem addressed in this article consists of the motion control of a quadrotor, comprising model disturbances and uncertainties. In order to tackle model uncertainty, adaptive control based on reinforcement learning is used. The distinctive feature of this article, in comparison with other works on quadrotor control using reinforcement learning is the exploration of the underlying optimal control problem in which a quadratic cost and a linear dynamics allow an algorithm that runs in real time. Instead of identifying a plant model, adaptation is obtained by approximating the performance index given by the Q-function using directional forgetting recursive least squares that rely on a linear regressor build from quadratic functions of input/output data. The adaptive algorithm proposed is tested in simulation in a cascade control structure that drives a quadrotor. Simulations show the improvement in performance that results when the proposed algorithm is turned on.

The need to develop novel lightweight materials and their manufacturing processes is sets out to meet the new aerospace, automotive and construction requirements. Within this context, this research work is proposed to develop a novel thermoplastic composite material with high mechanical properties. These composites will be based on thermoplastic matrixes made from polyamide and 35% short glass fiber filled-polyamide reinforced with different types of fabrics. As reinforcement, glass fiber fabrics will be used as the base. They will be treated with different processes, both chemical and physical, to promote adherence to the matrix. Textile overmoulding technology was selected for manufacturing these composites. This technology was primarily developed to manufacture aesthetic lined components and has achieved a great implantation. Once these new composites are manufactured, they will be submitted to different tests to evaluate their behavior regarding adhesion, impact strength and stiffness. It is expected an improvement on stiffness and impact absorption.

Most European cities are characterized by very large areas, often formed by buildings with low quality, from a series of point of view. The possibility of renovating them is strategic to improve both the quality of life and to the possibility of economic recovery for building companies. In the last decades, the attention of the scientific community has been addressed to the energy renovation, thanks to the strong activities of the European Community in this field. However, since a relevant part of the EC territory is at risk of earthquake, the possibility to combine both energy and seismic renovation actions may be strategic for many countries. In particular, Italy and Romania are linked by a common social tradition that springs from the Roman Empire. Nowadays, this link is stronger, thanks to common interests in social, cultural and business fields. Therefore, the investigation of possible synergies for seismic and energy renovation strategies may be really interesting for both countries. This paper represents the first step in this direction. After an overview of regulations and common practices for buildings with reinforced concrete structures, in both states, some key combined renovation interventions will be described and discussed, as well as advantages and perspectives of integrated renovation approaches.

The structural performance of reinforced concrete relies heavily on the bond between reinforcement and concrete. In nonlinear finite element analyses, bond is either modelled by merged, also called perfect bond, or coincident with slip, also called bond-slip, approaches. Here, the performance of these two approaches for the modelling of failure of reinforced concrete was investigated using a damage-plasticity constitutive model in LS-DYNA. Firstly, the influence of element size on the response of tension-stiffening analyses with the two modelling approaches was investigated. Then, the results of the two approaches were compared for plain and fibre reinforced tension stiffening and a drop weight impact test. It was shown that only the coincident with slip approach provided mesh insensitive results. However, both approaches were capable of reproducing the overall response of the experiments in the form of load and displacements satisfactorily for the meshes used.

We discuss the implementation of a suite of virtual diagnostics at the FACET-II facility currently under commissioning at SLAC National Accelerator Laboratory. The diagnostics will be used for prediction of the longitudinal phase space along the linac, spectral reconstruction of the bunch profile and non-destructive inference of transverse beam quality (emittance) using edge radiation at the injector dogleg and bunch compressor locations. These measurements will be folded in to adaptive feedbacks and ML-based reinforcement learning controls to improve the stability and optimize the performance of the machine for different experimental configurations. In this paper we describe each of these diagnostics with expected measurement results based on simulation data and discuss progress towards implementation in regular operations.

Natural fibers are being increasingly used in different areas of engineering, including as composite reinforcement. Among these fibers, carauá stands out for its good mechanical properties and adherence to resin. Nevertheless, little is known about the behavior of this material in the manufacture of a composite or whether classic failure theory can be used in this case. In this context, the present study assesses the mechanical properties of two laminas made of unidirectional curauá fiber with volumetric fiber percentages of 30 % and 22 %, and compares the results with the values obtained for four failure criteria reported in the literature, using analysis of variance (ANOVA). To that end, tensile tests were conducted in the direction of the fiber and at other loading angles, in addition to iosipescu shear tests. The results show that the maximum stress criterion does not represent the failure behavior of these materials and that the best was the Hashin criterion.

Composite fiber materials are superior materials due to their high strength and light weight. Composites reflect the properties of their constituents, which is proportional to the volume fraction of each phase. There are different fiber reinforcement types and each affects it’s flexural, tensile and compression strength. When selecting a composite for a specific application, the forces excreted on the composite must be known in order to determine the reinforcement type. Unidirectional fiber reinforcement will allow very strong load resistance but only in one direction where as a random orientated fiber reinforcement can resist less load but can maintain this quota in all directions. These materials are said to be anisotropic. Certain composite fibers, taking into consideration there weights, are physically stronger than conventional metals. This research deals with the analysis of three composite materials with different reinforcement types, volume fraction and phase content. It was found that material A (glass epoxy) was the strongest in the longitudinal direction with a flexural strength of 534 MPa in the longitudinal and 420 MPa in the transverse direction. The flexural stresses of material B (glass silicone) and material C (glass polyester) where both found in the 120 to 135 MPa range. Differences were due to their differences in matrix composition and reinforcement type.

The conducted investigation encompassed the comprehensive integration of mechanical, envi-ronmental, chemical, and microstructural evaluations of a composite amalgamating sandy soil and a synthetic polymer at two distinct concentrations (2.5% and %) across multiple curing in-tervals (0, 1, 2, 4, 7, 15, 30, and 45 days). The studied soil originates from an environmentally sig-nificant protected area in Brazil. The implementation of mechanisms for soil improvement in the region must adhere to technical criteria without causing environmental harm. Direct shear testing was conducted, permeability was assessed, and microstructure analysis and XRD and XRF/EDX studies of both the soil and composites were conducted. It was observed that longer curing times yielded improved results in shear stress, friction angle, and cohesive intercept, with SP_5% exhibiting the highest values compared to the soil and SP_2.5%. Adding the polymeric so-lution to the soil contributed to cementation and cohesion gains in the substrate. Through mi-crostructural characterization, the polymer's role as a cementing agent for the grains is evident, forming a film on the grains and binding them together. Based on the analyses and studies con-ducted in the research, it can be concluded that there is technical feasibility for applying the pol-ymeric solution at both dosages in geotechnical projects.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

The demand for explainable and transparent models increases with the continued success of reinforcement learning. In this article, we explore the potential of generating shallow decision trees (DT) as simple and transparent surrogate models for opaque deep reinforcement learning (DRL) agents. We investigate three algorithms for generating training data for axis-parallel and oblique DTs with the help of DRL agents ("oracles") and evaluate these methods on classic control problems from OpenAI Gym. The results show that one of our newly developed algorithms, the iterative training, outperforms traditional sampling algorithms, resulting in well-performing DTs that often even surpass the oracle from which they were trained. Even higher dimensional problems can be solved with surprisingly shallow DTs. We discuss the advantages and disadvantages of different sampling methods and insights into the decision-making process made possible by the transparent nature of DTs. Our work contributes to the development of not only powerful but also explainable RL agents and highlights the potential of DTs as a simple and effective alternative to complex DRL models.

With the rapid development of the Internet of Things (IoT), there are dramatic increasing number of devices in the network, which causes the challenge that only using infrastructure such as based station cannot provide service with all devices with high quality. Therefore, due to their flexibility and economy, unmanned aerial vehicles (UAV) are widely used to increase the performance of IoT networks. UAVs can not only provide communication services for IoT devices in the absence of a network, but they can also perform video surveillance, cargo transportation, pesticide spraying, and other specialized tasks. However, due to the complexity of the scenario and the need for real-time decision making, it is challenging to schedule UAVs in the network using traditional optimization methods, and growing attention has focused on using AI to optimize UAVs in the network. In this paper, we focus on the AI-enabled UAV optimization method in IoT networks and give a comprehensive scope on what and how to use AI-enabled methods to increase the performance of UAV-assisted IoT networks. Moreover, a brief analysis of the challenges of using AI methods in IoT networks and some potential research directions are given.

The widespread adoption of electromobility constitutes one of the measures designed to reduce air pollution caused by traditional fossil fuels. However, several factors are currently impending this process, ranging from insufficient charging infrastructure, battery capacity, long queueing and charging time, to psychological factors. On top of range anxiety, the frustration of the EV drivers is further fueled by the lack the uncertainty of finding an available charging point on their route. To address this issue, we propose a solution that comes to bypass the limitations of the Reserve now function of the OCPP standard, enabling drivers to make charging reservations for the upcoming days, especially when planning a longer trip. We created an algorithm that generates reservation intervals based on the charging station's reservation and transaction history. Subsequently, we ran a series of test cases that yielded promising results, with no overlapping reservations.

For Synthetic Aperture Radar (SAR) image registration, successive processes following feature extraction are required by both the traditional feature-based method and the deep learning method. Among these processes, the feature matching process—whose time and space complexity are related to the number of feature points extracted from sensed and reference images, as well as the dimension of feature descriptors—proves to be particularly time-consuming. Additionally, the successive processes introduce data sharing and memory occupancy issues, requiring an elaborate design to prevent memory leaks. To address these challenges, this paper introduces the OptionEM-based reinforcement learning framework to achieve end-to-end SAR image registration. This framework outputs registered images directly without requiring feature matching and calculation of the transformation matrix, leading to significant processing time savings. The Transformer architecture is employed to learn image features, while a correlation network is introduced to learn the correlation and transformation matrix between image pairs. Reinforcement learning, as a decision process, can dynamically correct errors, making it more efficient and robust compared to supervised learning mechanisms like deep learning. We present a hierarchical reinforcement learning framework combined with episodic memory to mitigate the inherent problem of invalid exploration in generalized reinforcement learning algorithms. This approach effectively combines coarse and fine registration, further enhancing training efficiency. Experiments conducted on three sets of SAR images, acquired by TerraSAR-X and Sentinel-1A, demonstrate that the proposed method’s average runtime is sub-second, achieving subpixel registration accuracy.

Joints between walls are very important for structural analysis of each masonry building at the global and local level. This issue was often neglected in case of traditional joints and relatively squat walls. Nowadays the issue of wall joints is becoming particularly important due to the continuous strive for simplifying structures, introducing new technologies and materials. Eurocode 6 and other standards (USA, Canadian, Chinese, and Japanese) recommend inspecting joints between walls, but no detail procedures have been specified. This paper presents our own tests on joints between walls made of autoclaved aerated concrete (AAC) masonry units. Tests included reference models composed of two wall panels joined perpendicularly with a masonry bond (6 models), traditional steel and modified connectors (12 models). A shape and size of test models and structure of a test stand were determined on the basis of the analysis of the current knowledge, pilot studies and numerical analyses of FEM. The analysis referred to the morphology and failure mechanism of models. Load-displacement relationships for different types of joints were compared and obtained results were referred to results for reference models. A mechanism of cracking and failure was found to vary, and clear differences in behaviour and load capacity of each type of joints were observed. Individual working phases of joints were determined and defined, and the empirical approach was suggested to determine forces and displacement of wall joints.

In this study, we examine the relationship of bank level lending and borrowing decisions and the risk preferences on the dynamics of the interbank lending We develop an agent-based model that incorporates individual bank decisions using the temporal difference reinforcement learning algorithm with empirical data of 6600 S. banks. The model can successfully replicate the key characteristics of interbank lending and borrowing relationships documented in the recent literatur A key finding of this study is that risk preferences at individual bank level can lead to unique interbank market structures which are suggestive of the capacity that the market responds to surprising

Modern engineering faces challenges in ensuring technical standards for service, durability, and sustainability. Political, administrative, and budgetary factors, coupled with climate change, pose tasks to structural integrity, affecting industries and economies. Marine infrastructures represent a strategic asset of the country as it handles a large part of the economic exchanges. This article analyzes five essential factors that play a fundamental role in the performance analysis of coastal structures: Chloride-induced corrosion, degradation models, maintenance strategies, monitoring, and climate change. Starting with reinforcement corrosion, considered as the main cause of distress, particularly in coastal zones for the long-term behavior of structures. Additional pressure from the influences of climate change is becoming evident and extreme, leading to reduction in capacity. To guarantee the lifespan, degradation models contribute by estimating the long-term performance of the asset as a strategic piece to the development of effective maintenance solutions. Additionally, quantifying the condition of the structure from monitoring data, plays a crucial part that provides information on the current situation of the structure. Finally, this review summarizes the challenges associated with the maintenance of aging marine structures considering aspects such as corrosion, monitoring, and the future challenges this area will face due to climate change.

Transforming Small-Scale LNG Business, Enhancing Efficiency and Resilience in an Evolving Supply Chain In various industries, innovative systems have proven their value due to their efficiency and adaptability. A prime example of this lies in the rapid growth of the liquefied natural gas (LNG) market. LNG, a fuel derived from natural gas, has gained significant traction in recent years. In light of this, we aim to explore optimal strategies for small-scale LNG businesses, with a focus on revolutionizing their supply chain to ensure adaptability and sustainability. Our objective is to enhance efficiency and sturdiness in this evolving sector. By devising innovative methods and implementing cutting-edge technologies, we aim to revolutionize the small-scale LNG market, paving the way for a more optimized and resilient supply chain. Through this transformation, we strive to create a sustainable and adaptable framework that will drive the growth and success of a small-scale LNG businesses.LNG' ability to be transported and stored more cost-effectively in its reduced volume compared to natural gas in its original state is a significant advantage. The distribution network for LNG starts at numerous supply terminals and extends to a diverse range of consumption centers, each with varying tank capacities. In the broader economic context, the establishment of efficient routes for LNG Truck tank plays a critical role.To tackle the challenge of selecting a pickup location and determining optimal destinations with specific unloading volumes for liquefied natural gas (LNG), this research presents an innovative solution utilizing state-of-the-art machine learning techniques. The proposed approach combines the power of reinforcement learning, recurrent neural networks, online learning, and graph theory. By leveraging these cutting-edge techniques, we aim to develop an intelligent system that can effectively determine the most efficient pickup location and sequence of destinations for LNG delivery. This system will take into account various factors such as transportation costs tank capacity, and demand fluctuations. Through the integration of reinforcement learning, the system will continuously learn and improve its decision-making process in real-time. The recurrent neural networks will allow for the analysis of historical aim to model and optimize the complex network of pickup and delivery routes, considering factors such as distance, capacity constraints, and operational efficiencies. With this innovative approach, we strive to revolutionize the selection and planning process for LNG pickup and delivery, ultimately enhancing efficiency and reducing cost within the LNG supply chain.Improving the distribution network offers several financial benefits, including cost reduction, faster delivery times, more affordable distribution, and enhanced efficiency in the utilization of tanker trucks for LNG transportation. By optimizing the distribution network, transit costs associated with LNG transportation can be significantly lowered. This can be achieved through intelligent route planning, taking into account factors such as distance, traffic conditions, and fuel consumption. Minimizing transit costs contributes to overall savings for businesses operating in the LNG market. Faster delivery times are another advantage of an enhanced distribution network. By designing efficient routes and eliminating unnecessary detours or delays, the time taken for LNG to reach its intended destinations can be reduced. This not only improves customer satisfaction but also allows for more frequent deliveries and better coordination of supply and demand. Cheaper distribution is a direct outcome of an optimized distribution network. By strategically planning pickup locations, destinations, and intermediate stops, the costs associated with transferring LNG between terminals and consumption centres can be minimized. This leads to savings in transportation expenses, ultimately benefiting both businesses and end-users. Efficient utilization of tanker trucks is crucial for maximizing profitability in the LNG industry. An improved distribution network enables better allocation of resources, ensuring that tanker trucks are utilized optimally. This includes reducing empty or underutilized trips, maximizing load capacities, and minimizing idle time. Such efficiency improvements translate to cost savings and increased revenue for businesses involved in LNG transportation. Overall, the financial gains from improving the distribution network are substantial. Lower transit costs, faster delivery times, cheaper distribution, and more efficient use of tanker trucks contribute to increased profitability, competitiveness, and sustainability in the LNG market.

Machine learning forks into three main branches such as supervised learning, unsupervised learning, and reinforcement learning where reinforcement learning is much potential to artificial intelligence (AI) applications because it solves real problems by progressive process in which possible solutions are improved and finetuned continuously. The progressive approach, which reflects ability of adaptation, is appropriate to the real world where most events occur and change continuously and unexpectedly. Moreover, data is getting too huge for supervised learning and unsupervised learning to draw valuable knowledge from such huge data at one time. Bayesian optimization (BO) models an optimization problem as a probabilistic form called surrogate model and then directly maximizes an acquisition function created from such surrogate model in order to maximize implicitly and indirectly the target function for finding out solution of the optimization problem. A popular surrogate model is Gaussian process regression model. The process of maximizing acquisition function is based on updating posterior probability of surrogate model repeatedly, which is improved after every iteration. Taking advantages of acquisition function or utility function is also common in decision theory but the semantic meaning behind BO is that BO solves problems by progressive and adaptive approach via updating surrogate model from a small piece of data at each time, according to ideology of reinforcement learning. Undoubtedly, BO is a reinforcement learning algorithm with many potential applications and thus it is surveyed in this research with attention to its mathematical ideas. Moreover, the solution of optimization problem is important to not only applied mathematics but also AI.

The Unmanned Aerial Vehicles (UAVs), used in civilian applications such as emergency medical deliveries, precision agriculture, wireless communication provisioning, etc., face the challenge of limited flight time due to their reliance on the on-board battery. Therefore, developing efficient mechanisms for in-situ power transfer to recharge UAV batteries hold potential in extending their mission time. In this paper, we study the use of far-field wireless power transfer (WPT) technique from specialized, transmitter UAVs (tUAVs) carrying Multiple Input Multiple Output (MIMO) antennas for transferring wireless power to receiver UAVs (rUAVs) in a mission. The tUAVs can fly and adjust their distance to the rUAVs to maximize energy transfer. The use of MIMO antennas further boost the energy reception by narrowing the energy beam toward the rUAVs. The complexity of their dynamic operating environment increases with the growing number of tUAVs, and rUAVs with varying levels of energy consumption and residual power. We propose an intelligent trajectory selection algorithm for the tUAVs based on a deep reinforcement learning model called Proximal Policy Optimization (PPO) to optimize the energy transfer gain. Simulation results demonstrate that with the use of PPO, the system achieves a tenfold flight time extension compared to no wireless recharging. Further, PPO outperforms the benchmark movement strategies of ’Traveling Salesman Problem’ and ’Low Battery First’ when used by the tUAVs.

Recommendation systems are crucial in navigating the vast digital market. However, user data’s dynamic and non-stationary nature often hinders their efficacy. Traditional models struggle to adapt to the evolving preferences and behaviours inherent in user interaction data, posing a significant challenge for accurate prediction and personalisation. Addressing this, we propose a novel theoretical framework, the Non-stationary Transformer, designed to capture and leverage the temporal dynamics within data effectively. This approach enhances the traditional transformer architecture by introducing mechanisms accounting for non-stationary elements, offering a robust and adaptable solution for recommendation systems. Our experimental analysis, encompassing deep learning and reinforcement learning paradigms, demonstrates the framework’s superiority over benchmark models. The empirical results confirm the efficacy of our proposed framework, which not only provides significant performance enhancements, approximately 8% in Logloss reduction and up to 2% increase in F1 score but also underscores its potential applicability across accumulative reward scenarios. These findings advocate adopting Non-stationary Transformer models to tackle the complexities of today’s recommendation tasks.

Unmanned aerial vehicles (UAVs)-based communication system is a promising solution to meet coverage and capacity requirements of future wireless networks. However, UAV-enabled communications is constrained with its coverage, energy consumption, and flying regulations, and the number of works focusing on the sustainability aspect of UAV-assisted networking has been limited in the literature so far. In this paper, we propose a solution to this limitation; particularly, we design a $Q$-learning-based UAV positioning scheme for sustainable wireless connectivity considering key constraints, that are, altitude regulations, non-flight zones, and transmit power. The objective is to find the optimal position of the UAV base station (BS) and minimize the energy consumption while maximizing the number of users covered. Moreover, a weighting mechanism is developed, where the energy consumption and number of users covered can be prioritized according to network/battery conditions. The proposed Q-learning-based solution is compared to the baseline k-means clustering method, where the UAV BS is positioned at the centroid location that minimizes the cumulative distance between the UAV BS and the users. The results demonstrate that the proposed solution outperforms the baseline k-means clustering-based method in terms of the number of users covered while achieving the desired minimization of the energy consumption.

The performance of a normal-strength SHCC under impact loading was studied using the results obtained from a split Hopkinson tension bar (SHTB). The focus of the investigation is to explain the mechanisms behind the peculiar rate-dependent behavior of SHCC under tensile loading. With the help of frames obtained by high-speed cameras and the subsequent Digital Image Correlation (DIC) analysis, the stress-strain relation of the SHCC obtained in SHTB was analyzed. The investigation of the composite’s behavior was supported by constituent-level experiments on the non-reinforced matrix of the SHCC and on the fiber-matrix bond. In the case of the constituent matrix, the well-known apparent increase in the tensile strength of the cement-based matrix and its influence on the behavior of SHCC was studied. For this purpose, experiments on the SHCC specimens with different geometries were performed in the SHTB. The results obtained from these experiments and those obtained by DIC show that commonly used analytical models, in which the specimen is assumed elastic, cannot capture the effects of structural inertia on the results. Thus, an alternative novel method based on the results of DIC has been used to explain and quantify the contribution of structural inertia. The rate-dependent behavior of the fiber-matrix bond was studied by performing high-speed single fiber pullout tests in a miniaturized split Hopkinson tension bar. This novel experimental technique enabled explanation of the rate-dependent bridging action of the fibers in SHCC. Based on the results, the enhanced behavior of SHCC under impact loading is explained.

This paper investigates the cooperative anti-jamming distributed channel selection problem in UAV communication networks. Considering the existence of malicious jamming and co-channel interference, a location-aware cooperative anti-jamming scheme is designed for the purpose of maximizing the users' utilities. Users in the UAV group cooperate with each other via location information sharing. When the received interference energy is lower than mutual interference threshold, users conduct channel selection strategies independently. Otherwise, users take joint actions with a cooperative anti-jamming pattern under the impact of mutual interference. Aimed at the independent anti-jamming channel selection problem under no mutual interference, a Markov Decision Process framework is introduced, whereas for the cooperative anti-jamming channel selection case under the influence of co-channel mutual interference, a Markov game framework is employed. Furthermore, motivated by reinforcement learning with a ``Cooperation-Decision-Feedback-Adjustment" idea, we design a location-aware cooperative anti-jamming distributed channel selection algorithm (LCADCSA) to obtain the optimal anti-jamming channel strategies for the users with a distributed way. In addition, the channel switching cost and cooperation cost, which have great impact on the users' utilities, are introduced. Finally, simulation results show that the proposed algorithm converges to a stable solution with which the UAV group can avoid the malicious jamming as well as co-channel interference effectively.

In our work, using the analysis of DNA barcodes and morphology (wing color, male genitalia, sphragis shape in females), we show that the group of species close to P. mnemosyne is represented by two phylogenetic lineages, the western and eastern ones. The eastern lineage includes P. stubbendorfii, P. glacialis and P. hoenei. The western lineage includes three morphologically similar species, P. mnemosyne (Western Eurasia), P. turatii (southwestern Europe) and P. nubilosus stat. nov. (Turkmenistan and NE Iran), as well as P. ariadne (Altai). The latter species differs from the rest of the group in the presence of red spots on the wings. Parnassius mnemosyne s.s. is represented by four differentiated mitochondrial clusters that show clear association with specific geographic regions. We propose to interpret them as subspecies: P. mnemosyne mnemosyne (Central and Eastern Europe, N Caucasus, N Turkey), P. mnemosyne adolphi (the Middle East), P. mnemosyne orientalis (Tian Shan) and P. mnemosyne gigantea (Gissar-Alai in Central Asia). We demonstrate that in P. ariadne the red spots on the wing evolved as a reversion to the ancestral wing pattern. This reversion is observed in Altai, where the distribution areas of the western lineage, represented by P. ariadne, and the eastern lineage, represented by P. stubbendorfii, overlap. These two species hybridize in Altai, and we hypothesize that the color change in P. ariadne is the result of reinforcement of prezygotic isolation in the contact zone. Lectotype of Parnassius mnemosyne var. nubilosus Christoph, 1873 is designated.

Renovation, restoration, remodeling, refurbishment, and retrofitting of build-ings often imply modifying the behavior of the structural system. Modification sometimes includes applying forces (i.e., concentrated loads) to beams that before were subjected to distributed loads only. For a reinforced concrete structure, the new condition causes a beam to bear a concentrated load with the crack pattern that was produced by the distributed loads that acted in the past. If the concentrated load is applied at or near the beam’s midspan, the new shear demand reaches the maximum around the midspan. But around the midspan, the cracks are vertical or quasi-vertical, and no inclined bar is present. So, the actual shear capacity around the midspan not only is low, but also can be substantially lower than the new demand. In order to bring the beam capacity up to the demand, fiber-reinforced-polymer composites can be used. This paper presents a design method to increase the concentrated load-carrying capacity of reinforced concrete beams whose load distribution has to be changed from distributed to concentrated, and an analytical model to pre-dict the concentrated load-carrying capacity of a beam in the strengthened state.

Abstract: This paper is focusing on the stabilisation of soil using jute fibre as soil stabilizer. Stabilisation is the process of modifying the properties of a soil to improve its engineering performance and used it for a variety of engineering works. This study examines the potential of soil stabilization with jute fibre when it is cut into roughly 30mm lengths as stabilizer. The varying percentages like 0.5%, 1%, 1.5 and 2% of pieces of jute fibre were used and mixed it with soil. The laboratory tests such as California Bearing Ratio (CBR) test, modified compaction tests and direct shear strength tests have been conducted to observe the change in engineering properties of soil. On the basis of the experiments performed, it can be concluded that the stabilization of soil using 30mm pieces of jute as stabilizer improves the strength characteristics of the soil so that it becomes usable as one of the reinforcing material for the construction of roadways, parking areas, site development projects, airports and many other situations where sub-soils are not suitable for construction.

The present paper deals with the retrofitting of unreinforced masonry (URM) buildings, subjected to in-plane shear and out of-plane loading when struck by an earthquake. After an introductive comparison between some of the latest punctual and continuous active retrofitting methods, the authors focused on the two most effective active continuous techniques, the CAM system and the Φ system, which also improve the box-type behavior of buildings. These two retrofitting systems allow us to increase both the static and dynamic load-bearing capacity of masonry buildings. Nevertheless, information on how they actually modify the stress field in static conditions is lacking and sometimes questionable, in the literature. Therefore, we performed a static analysis in the plane of Mohr/Coulomb, with the dual intent to clarify which of the two is preferable under static conditions and whether the models currently used to design the retrofitting systems are fully adequate.

In the history of high-performance polymer composite parts with continuous in-plane fibre reinforcement, the comparatively moderate structural-mechanical properties in their out-of- plane-z-direction and the limited load carrying capability between individual reinforcement layers within the laminated structures have always been one of the greatest challenges. Plenty of research work has been carried out to improve load transfer capability as well as fracture toughness for crack opening events between the reinforcement layers by means of out-of-plane fibre reinforcement implementation, for example by sewing or z-pinning technologies. However, the results have not become established across a wide range of applications so far, because the technologies used have led to considerable losses of in-plane strength properties. In this paper first results are presented for a new method of a low fraction z-fibre reinforcement by means of very thin diameter laser drilled holes filled with short carbon fibres, demonstrating potential to improve Mode II fracture toughness.

Plasma technology shows tremendous potential for revolutionizing oncology research and treatment. Reactive oxygen and nitrogen species, electromagnetic emissions generated through gas plasma jets, have attracted significant attention due to their selective cytotoxicity towards cancer cells. To leverage the full potential of plasma medicine, researchers have explored the use of mathematical models and various subsets of machine learning, such as reinforcement learning, and deep learning. This review emphasizes the significant application of AI algorithms in the adaptive plasma system, paving the way for precision and dynamic cancer treatment. Realizing the full potential of AI in plasma medicine, requires research efforts, data sharing and interdisciplinary collaborations. Unravelling the complex mechanisms, developing real-time diagnostics, and optimizing AI models will be crucial to harness the true power of plasma technology in oncology. The integration of personalized and dynamic plasma therapies, alongside AI and diagnostic sensors, presents a transformative approach to cancer treatment with the potential to improve outcomes globally.

In the past decades, the world is actively working towards the global goal of net-zero emission. To decrease emissions, there is a notable trend of electrification in transportation, which is a transition from traditional fuel-based systems to electrical power systems onboard different transportation platforms. For this transition, it is important to study the electrical structure, specifically the onboard microgrid, powered by various energy sources. In this paper, traditional energy management strategies for onboard microgrid systems are discussed, which usually require complicated optimization algorithms and high computation capabilities. Driven by the recent advancements in information technologies, artificial intelligence and digital twin have gained much interest within the transportation sector. These technologies can effectively utilize data to achieve intelligent decision-making, optimize resource utilization, and save energy consumption. This paper presents an overview of the usage of these emerging information technologies in energy management strategies, providing an overall summary and classification of the practical applications. In addition, after examining the potential challenges associated with artificial intelligence and digital twin, this paper also discusses future trends in this field.

To improve the interfacial bonding of sisal fiber reinforced polylactide biocomposites, polylactide (PLA) and sisal fibers (SF) were melt-blended to fabricate bio-based composites via in situ reactive interfacial compatibilization with the addition of an epoxy-functionalized oligomer (ADR). The FTIR analysis and SEM characterization demonstrated that PLA molecular chain was bonded to the fiber surface and epoxy-functionalized oligomer played a hinge-like role between sisal fibers and PLA matrix, which resulted in improved interfacial adhesion between fibers and PLA matrix. The interfacial reaction and microstructures of composites were further investigated by thermal and rheological analyses, which indicated that the mobility of the PLA molecular chain in composites was restricted because of the introduction of ADR oligomer, which in turn reflected the improved interfacial interaction between SF and PLA matrix. These conclusions were further investigated by the calculated activation energies of glass transition relaxation (△Ea) of composites via dynamic mechanical analysis. The mechanical properties of PLA/SF composites were simultaneously reinforced and toughened via addition of ADR oligomer. The interfacial interaction and structure-properties relationship of composites are key points of this study.

Aiming at the problem of hypersonic morphing vehicle avoiding no-fly zones and reaching the target, an improved predictor-corrector guidance method is proposed. Firstly, the aircraft motion model and the constraint model are established. Then, the basic algorithm is given, the Q-learning method is used to design the attack angle and sweep angle scheme to ensure that the aircraft can fly over the low-altitude zones. The B-spline curve is used to design the location of flight path points and the bank angle scheme is designed according to the predictor-corrector method, so that the aircraft can fly around to avoid high-altitude zones. Next, Monte Carlo reinforcement learning(MCRL) method is used to improve predictor-corrector method and Deep Neural Network(DNN) is used to fit reward function. The improved method can generate trajectory with better performance. Simulation results verify the effectiveness of the proposed algorithm.

Serious damage caused by floor heave in the coal given chamber of a vertical coal bunker is one of the challenges faced in underground coal mines. Engineering practice shows that it is more difficult to maintain the coal given chamber (CGC) than a roadway. More importantly, repairing the CGC during mining practice will pose major safety risks and reduce production. Based on the case of the serious collapse that occurred in the bearing structure of the CGC at the lower part of the 214# coal bunker in Xiashijie mine, China, this work analysed (i) the main factors influencing floor heave and (ii) the failure mechanism of the load-bearing structure in the CGC using FLAC^2D numerical models and expansion experiment. The analysis results indicate that: the floor heave, caused mainly by mine water, is the basic reason leading to the instability and repeated failure of the CGC in the 214# coal bunker. Then a new coal bunker, without building the CGC, is proposed and put into practice to replace the 214# coal bunker. The FLAC^3D software program is adopted to establish the numerical model of the wall-mounted coal bunker (WMCB), and the stability of the rock surrounding the WMCB is simulated and analysed. The results show that: (1) the rock surrounding the sandstone segment is basically stable. (2) The surrounding rock in the coal seam segment, which moves into the inside of the bunker, is the main zone of deformation for the entire rock mass surrounding the bunker. Then the surrounding rock is controlled effectively by means of high-strength bolt–cable combined supporting technology. According to the geological conditions of the WMCB, the self-bearing system, which includes (i) H-steel beams, (ii) H-steel brackets, and (iii) self-locking anchor cables, is established and serves as a substitute for the CGC to transfer the whole weight of the bunker to stable surrounding rock. The stability of the new coal bunker has been verified by field testing, and the coal mine has gained economic benefit to a value of 158.026174 million RMB over three years. The new WMCB thus made production more effective and can provide helpful references for construction of vertical bunkers under similar geological conditions.

This systematic literature review explores the burgeoning use of Artificial Intelligence (AI) in manufacturing systems, in line with the principles of Industry 4.0 and the growth of smart factories. In this landscape, AI is crucial in addressing the complexity and dynamism of contemporary manufacturing processes, including machine breakdowns, fluctuating orders and unpredictable job arrivals. This systematic literature review, conducted using the Scopus database and bibliometric tools, pursues two primary objectives. First, it identifies the prevailing trends in solving scheduling problems with AI and identifies the most commonly used AI techniques in the literature. Secondly, it analyses how authors have successfully employed AI to address production scheduling challenges in real-world industrial settings and assesses the benefits obtained by companies. The dynamic nature of manufacturing systems requires adaptive scheduling paradigms. AI, including Particle Swarm Optimization, Neural Networks, and Reinforcement Learning, is applied to optimize production processes, predict machine failures, and achieve substantial benefits. In real-world applications, these AI-driven solutions have led to reduced production costs, enhanced energy efficiency, and more efficient scheduling processes. AI is increasingly recognized as an essential tool in addressing the evolving challenges of modern manufacturing environments.

Electronic devices are sensitive to electromagnetic (EM) emissions requiring electromagnetic shielding protection to assure good operation, preventing noise, malfunctioning, or even burning. To assure protection, it is important to develop suitable material and design solutions for electronic enclosures. Most common enclosures are made with metal alloys by traditional manufacturing methods. However, resourcing to thermoplastic composites combined with additive manufac-turing (AM) technologies emerges as an alternative that enables to fabricate complex parts that are lightweight, consolidated and oxidation and corrosion resistant. In this research, an AM technique based in material extrusion was used to print 2 mm thick specimens with a multi-material made of micro-carbon fiber (CF) filled polyamide, reinforced, at specific layers, by continuous carbon fibers stacked with a 90° rotation to each other. Specimens electromagnetic shielding effectiveness (EMSE) was evaluated in the frequency band of 0.03 – 3 GHz by coaxial transmission line method. De-pending on the number of CF layers, the EM shielding obtained can up to 70 dB, with a specific shielding up to 60 dB.cm3/g, predominantly by absorption mechanism, being 22 times higher that without the CF layers. These findings fundament this innovative approach for lightweight cus-tomizable solutions for EM shielding applications.

It is necessary to address the scarcity of crushed stones for pavement structural layers. So fly ash can be proved to be promising solution as more than 270 tonnes of fly ash is generated in India. Though, numerous research has been conducted for the use of fly ash intreated and untreated form, high volume of fine particles and brittleness of the stabilized fly ash pose a great problem for its use in subbase and base. Moreover, stiffness or modulus of stabilized fly ash is vital elastic parameter which is used for mechanistic pavement design. Hence, in this study an extensive experimental investigation is carried out to study its strength and stiffness properties such as compressive strength, indirect tensile strength and flexural strength, cyclic indirect tensile modulus and flexural modulus of fiber reinforced cement stabilized fly ash, stone dust, aggregate mixtures. The stone dust and aggregates have been added to enhance the gradation of the composite’s mixture. The study presents the effect of fiber on strength and stiffness properties. The experimental result reveals that addition of polypropylene (PP) fibers up to 0.25 wt.% enhances the compressive strength and any further addition of fiber results in decrease of the strength. However, indirect tensile strength and flexural strength increases with increase in fiber percentage up to 0.5 wt.%. Cement content is observed to be the dominant parameter for stabilized materials. Suitable relationships have been developed between strength and modulus parameters for stabilized mixtures. Based on the strength and stiffness study, 70% fly ash and 30% stone dust-aggregate and 60% fly ash and 40% stone dust-aggregate with 6% cement can be considered for the base layer. Based on the indirect tensile strength and flexural strength behavior, 0.35% is considered as the optimum fiber percentage.

This work describes a new transducer prototype for continuous monitoring both in the structural and geotechnical fields. The transducer is synthetically constituted by a wire of optical fiber embedded between two fiber tapes (fiberglass or carbon fiber) and glued by a matrix of polyester resin. The fiber optical wire ends have been connected to a control unit whose detection system is based on Brillouin optical time-domain frequency analysis. Three laboratory tests were carried out to evaluate the sensor's reliability and accuracy. In each experiment, the transducer was applied to a sample of inclinometer casing sets in different configurations and with different constraint conditions. The experimental data collected were compared with theoretical models and with data obtained from the use of different measuring instruments to perform validation and calibration of the transducer at the same time. Several diagrams allow comparing the transducer and highlighting its suitability for monitoring and maintenance of structures. The characteristic of the transducer suggests its use as a mixed system for reinforcing and monitoring, especially in lifetime maintenance of critical infrastructures such as transportation and service networks, and historical heritage.

Among all the active confinement techniques, the use of pre-tensioned stainless steel straps has recently gained much attention. The flexibility of the stainless steel straps allows us to bend and pass them through the thickness of the masonry, thus creating a three-dimensional strengthening system between the two opposite facings. The use of the same perforation for the passage of several straps closed in a loop generates a continuous strengthening system that prevents parts of the structure from falling and injuring the occupants during seismic events. However, the perforations can nullify the in-plane strengthening, as they act as cylindrical hinges and make the reinforcement system labile for certain strap arrangements. Diagonal compression tests on square masonry panels performed in the present study show that the straps improve neither strength nor ductility when running along the mortar head and bed joints, arranged in square meshes. Conversely, they improve both strength and ductility when the straps make angles of 45° with the mortar joints. Furthermore, the experimental results show that the straps exert an anisotropic effect that decreases the apparent in-plane Poisson ratio. They also provide new insights into the diagonal compression test and allow formulating a new proposal for the pseudo-ductility factor.

Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level of com- pression strength while two points on the article are pushed towards each otherand include objects such as ropes (1D), fabrics (2D) and bags (3D). In general, CDOs’ many degrees of freedom (DoF) introduce severe self-occlusion and complex state-action dynamics as significant obstacles for perception and manipulation systems. These challenges exacerbate existing issues of modern robotic control methods such as imitation learning (IL) and reinforcement learning (RL). This review focuses on the application details of data-driven control methods on four major task families in this domain: cloth-shaping, rope manipulation, dressing and bag manip- ulation. Furthermore, we identify specific inductive biases in these four domains that present challenges for more general IL and RL algorithms, and summarise the future direction for the development of the field.

Rapid search and localization for nuclear sources can be an important aspect in preventing human harm from illicit material in dirty bombs or from contamination. In the case of a single mobile radiation detector, there are numerous challenges to overcome such as weak source intensity, multiple sources, background radiation, and the presence of obstructions, i.e., a non-convex environment. In this work, we investigate the sequential decision making capability of deep reinforcement learning in the nuclear source search context. A novel neural network architecture (RAD-A2C) based on the actor critic (A2C) framework and a particle filter gated recurrent unit for localization is proposed. Performance is studied in a randomized 20 x 20 m convex and non-convex environment across a range of signal-to-noise ratio (SNR)s for a single detector and single source. RAD-A2C performance is compared to both an information-driven controller that uses a bootstrap particle filter and to a gradient search (GS) algorithm. We find that the RAD-A2C has comparable performance to the information-driven controller across SNR in a convex environment and at lower computational complexity per action. The RAD-A2C far outperforms the GS algorithm in the non-convex environment with greater than 95% median completion rate for up to seven obstructions.

Detecting, tracking, and classifying unmanned aerial vehicles (UAVs) in a swarm presents significant challenges due to their small and diverse radar cross-sections, multiple flight altitudes, velocities, and close trajectories. To overcome these challenges, adjustments of the radar parameters and/or position of the radar (for airborne platforms) are often required during runtime. The runtime adjustments help to overcome the anomalies in the detection, tracking, and classification of UAVs. The runtime adjustments are performed either manually or through fixed algorithms, each of which can have its limitations for complex and dynamic scenarios. In this work, we propose the use of multi-agent reinforcement learning (RL) to carry out the runtime adjustment of the radar parameters and position of the radar platform. The radar used in our work is a multibeam multifunction phased array radar (MMPAR) placed onboard UAVs. The simulations show the cognitive adjustment of the MMPAR parameters and position of the airborne platform using RL helps to overcome anomalies in the detection, tracking, and classification of UAVs in a swarm. A comparison with other artificial intelligence (AI) algorithms shows that RL performs better due to runtime learning of the environment through rewards.

In the dynamic and complex environment of industrial control rooms, operators are often inundated with a multitude of tasks and alerts, which can lead to an overwhelming situation known as task overload. This state can precipitate decision fatigue and a heavier reliance on cognitive biases, potentially compromising the decision-making process. To mitigate such risks, the implementation of decision support systems becomes crucial. These systems are designed to assist operators in making swift and well-informed decisions, particularly when they sense their own judgment may be faltering. Our research introduces an AI-based framework that leverages dynamic influence diagrams and reinforcement learning to construct an effective decision support system. The cornerstone of this framework is the creation of a robust, interpretable, and efficient tool that supports control room operators during critical process disturbances. By integrating expert knowledge, the dynamic influence diagram forms a comprehensive model that captures the uncertainties inherent in complex industrial processes. It is adept at anomaly detection and recommending optimal actions. Moreover, this model is enhanced through a strategic partnership with reinforcement learning algorithms, which fine-tune the recommendations to be more context-specific and precise. The ultimate goal of our framework is to provide operators with a live, reliable decision support system that can significantly improve their response during process upsets. This paper outlines the development of our AI framework and its application within a simulated control room environment. Our findings indicate that the use of decision support systems can lead to improved operator performance and reduced cognitive workload. However, it also reveals a trade-off with situation awareness, which tends to diminish as operators may become overly reliant on the system’s guidance. Trust emerges as a critical factor in the adoption and effectiveness of decision support systems. Our research underscores the importance of balancing the benefits of decision support with the need for maintaining operator engagement and comprehension during process operations.

The area of Central and Eastern Europe, and thus Poland, is not exposed to effects of seismic actions. Any possible tremors can be caused by coal or copper mining. Wind, rheological effects, the impact of other objects or a non-uniform substrate are the predominant types of loading included in calculations for stiffening walls. The majority of buildings in Poland, as in most other European countries, are low, medium-high brick buildings. Some traditional materials, like solid brick (>10% of construction materials market) are still used. But autoclaved aerated concrete (AAC) and cement-sand calcium-silicate (Ca-Si) elements with thin joints are prevailing (>70% of the market) on the Polish market. Adding reinforcement only to bed joints in a wall is a satisfactory solution (in addition to confining) for seismic actions occurring in Poland that improves ULS and SLS. This paper presents results from our own tests on testing horizontal shear walls without reinforcement and with different types of reinforcement. This discussion includes 51 walls made of solid brick (CB) reinforced with steel bars and steel trusses, results from tests on 15 walls made of calcium-silicate (Ca-Si) and AAC masonry units reinforced with steel trusses and plastic meshes. Taking into account our own tests and those conducted by other authors, empirical relationships were determined on the basis of more than 90 walls. They are applicable to design and construction phase to determine the likely effect of reinforcement on cracking stress that damage shear deformation and wall stiffness.

This research delves into the realm of predictive modeling within artificial intelligence (AI) and introduces an innovative ensemble approach designed to enhance prognostic precision. The proposed methodology, characterized by its ebullient nature, leverages the collective wisdom of diverse predictive models, synthesizing a comprehensive and robust framework. The pursuit of parsimony are paramount, underscoring the need for efficient model architectures that balance predictive acuracy and computational efficiency. Our study meticulously explores the amalgamation of diverse algorithms, encapsulating the intrinsic complexity of real-world phenomena. We navigate the intricate landscape of feature selection, algorithmic diversity, and model combination, fostering a holistic understanding of the prognostic process. The ebullient ensemble emerges as a dynamic solution, harnessing the synergy of constituent models while mitigating the risk of overfitting. To validate the efficacy of our approach, extensive experiments are conducted on diverse datasets, spanning domains such as healthcare, finance, and natural language processing. Comparative analyses demonstrate the superior predictive performance of our ensemble model in comparison to individual algorithms and traditional ensemble methods. Additionally, we delve into interpretability aspects, elucidating the underlying mechanisms that contribute to the model's prognostic prowess. Our research advances the frontier of predictive modeling in AI, offering a nuanced and sophisticated paradigm for prognostication. The ebullient ensemble approach stands as a testament to the synergy achievable through the amalgamation of diverse predictive models, providing a pragmatic and parsimonious avenue for enhanced prognostic acuracy in artificial intelligence applications.