This paper develops a methodology to control the navigation of an autonomous ship robot from an initial state to a final. To solve the problem the following approach is used: The ship robot system is modelled as a control system of six ordinary differential equations involving six state variables and three control variables. After having computed the system Hamiltonian, the feasible controls for optimality are derived from the normal equations of optimality as functions of the state and costate variables. Such controls are substituted into the state and the costate equations and give a combined control-free state-costate system of ordinary differential equations which is solved numerically by using a developed Matlab computer program. Associated computational simulations are designed and provided to show the reliability of the approach.

Veterans face difficulties accessing vital health and community services, especially in rural areas. Autonomous vehicles (AVs) can revolutionize transportation by enhancing access, safety and efficiency. Yet, there is limited knowledge about how Veterans perceive AVs. This study fills this gap by assessing Veterans' AV perceptions before and after exposure to an autonomous shuttle (AS). Using a multi-method approach, 23 participants completed pre- and post-AS Autonomous Vehicle User Perception Survey (AVUPS), with 10 participants also taking part in post-AS focus groups. Following exposure to the AS, differences were observed for three out of the four AVUPS domains: an increase in Intention to Use (p < 0.01), a decrease in Perceived Barriers (p < 0.05), and an increase in Total Acceptance (p = 0.01); Well-being remained unchanged (p = 0.81). Feedback from focus groups uncovered six qualitative themes: Perceived Benefits (n=70), Safety (n=66), Shuttle Experience (n=47), AV Adoption (n=44), Experience with AVs (n=17), and Perception Change (n=10). This study underscores AVs' potential to alleviate transportation challenges faced by Veterans, contributing to more inclusive transportation solutions. The research offers insights for future policies and interventions aimed at integrating AV technology into the transportation system, particularly for mobility-vulnerable Veterans in rural and urban settings.

Different methodologies are being used to study the effects of autonomous vehicle (AV) in the mixed traffic indicating the interaction among autonomous and human-driven vehicles. Micro-scopic simulation tools are popular in such assessment as it offers scope to experiment in eco-nomical, robust, and optimistic way. Lack of reliable real-world data to calibrate and evaluate the connected autonomous vehicles (CAV) simulation model is a major challenge. One interesting methodology could be dealing the CAVs as conventional human driven vehicles and predict its possible characteristics based on the simulation inputs. The conventional human driven vehicles from real world, in this methodology, come to aid as benchmark to offer the measure of effective-ness (MoE) for the calibration and validation. For the three most common driving modules, a sensitivity analysis of the driving behaviors of AVs and an effect assessment of CAVs in a mixed traffic environment were done to explore the human alike autonomous technology. The findings show that, up to a point, which is directly re-lated to the quantity of interacting vehicles, the impact of CAVs is typically favorable. This study validates the approach and supports past studies by showing that CAVs perform better in traffic than AVs for traffic performance and safety aspects. On top of that, the sensitivity analysis has shown that enhancements in technology are required for obtaining the maximum advantages.

Over the years, Artificial Intelligence (AI) has seen a steady progress in development and evolution that can aid many sectors. Today, AI plays an essential role in the Fourth Industrial Revolution, and it is making its way into the military sector as well. Many countries are actively looking into AI military technology. Some of these innovations include image recognition, text analysis, Self-driving vehicles (SDV), gaming, robotic process automation (RPA) & Robotic and Autonomous Systems (RAS), and Autonomous Weapons Systems (AWS). In this research, we discuss the advantages of each innovation mentioned and analyze the many different cybersecurity threats that awaken due to military artificial intelligence systems. We then discuss the open research areas to better improve the current state of military artificial intelligence applications in terms of ethics, system security, proper strategy plan, accepted responsibility matrix, and introduction of relevant laws.

Urban transportation in the next few decades will shift worldwide towards electrification and automation, with the final aim of increasing energy efficiency and safety for passengers. Such a big change requires strong collaboration and efforts among public administration, research and stakeholders in developing, testing and promoting these technologies in the public transportation. Working in this direction, in the present work the impact of the introduction of driverless electric minibuses, for the first and last mile transportation, in the public service is studied. More specifically, this paper covers a state of the art in terms of technological background for automation, energy efficiency via electrification, and the current state of the legal framework in Europe with focus on the Baltic Sea Region.

Consistent increment of road traffic in cities is remained a threat to traffic performance and causes confliction. The researcher repeatedly emphasized the connected autonomous vehicles (CAVs) as stronger solution to deal with traffic related issues. While having autonomous system in the dedicated lanes is found to be safe by many investigators because of predictable surrounding maneuvers, in contrast, the mixed lane states remain questionable. Different methodologies are being used to study the effects of autonomous vehicles (AVs) in the mixed traffic. Microscopic simulation tools are popular in such cases as it offers scope to experiment in cheap, robust, and optimistic way. One interesting methodology to deal with CAVs is considering it as conventional human driven vehicles and predict its possible characteristics based on the simulation inputs. One big challenge is, as there is no regular real-world data to calibrate and to validate the simulated model for CAVs. This is where conventional human driven vehicles from real world, come to aid as benchmark to offer the measure of effectiveness (MoE) for the calibration and validation. For the three most common driving modules, a sensitivity analysis of the driving behaviors of autonomous vehicles (AVs) and an effect assessment of CAVs in a mixed traffic environment were done to explore the human alike autonomous technology. The findings show that, up to a point, which is directly related to the quantity of interacting vehicles, the impact of CAVs is typically favorable. This study supports earlier research by demonstrating that CAVs outperform AVs in traffic. In addition, the sensitivity analysis has shown that technical and infrastructural advances are necessary to achieve the greatest benefits.

The development of autonomous vehicles is becoming increasingly popular and gathering real world data is considered a valuable task. Many datasets have been published recently in the autonomous vehicle sector, with synthetic datasets gaining particular interest due to availability and cost. For a real implementation and correct evaluation of vehicles at higher levels of autonomy it is also necessary to consider human interaction, which is precisely something that lacks in existing datasets. In this article the UPCT dataset is presented, a public dataset containing high quality, multimodal data obtained using state of the art sensors and equipment installed onboard the UPCT’s CICar autonomous vehicle. The dataset includes data from a variety of perception sensors including 3D LiDAR, cameras, IMU, GPS, encoders, as well as driver biometric data and driver behaviour questionnaires. In addition to the dataset, the software developed for data synchronisation and processing has been made available. The quality of the dataset was validated using an end-to-end neural network model with multiple inputs to obtain speed and steering wheel angle and obtained very promising results.

The increasing number of robots around us will soon create a demand for connecting these robots in order to achieve goal-driven teamwork in heterogeneous multi-robot systems. In this paper, we focus on robot teamwork specifically in dynamic environments. While the conceptual modeling of multi-agent teamwork has been studied extensively during the last two decades, related engineering concerns have not received the same degree of attention. Therefore, this paper makes two contributions. The analysis part discusses general design challenges that apply to robot teamwork in dynamic application domains. The constructive part presents a review of existing engineering approaches for challenges that arise with dynamically changing runtime conditions. An exhaustive survey of robot teamwork aspects would be beyond the scope of this paper. Instead, we aim at creating awareness for the manifold dimensions of the design space and highlight state-of-the-art technical solutions for dynamically adaptive teamwork, thus pointing at open research questions that need to be tackled in future work.

The main functions of the automated systems rely on the advanced sensors for detection and perception of the environment around the vehicle. Radars and cameras are commonly utilized to detect the potential obstacles and vehicles ahead on the road. Nevertheless, cameras can generate spurious detections in the extreme weather conditions such as fog, rain, dust, snow, dark, and heavy sunlight in the sky. Due to limitations in vertical field view of the radars, single radars are not reliable to detect the height of the targets precisely. In this paper, a triple radar arrangement (long-range, medium-range, and short-range radars) based on sensor fusion technique is proposed to detect objects with different size in level 2 Advanced Driver-Assistance (ADAS) system. The typical objects including truck, pedestrians, and animals are detected in different scenarios. The developed model considered ISO 26262 and ISO/PAS 21448 to reasonably address insufficient robustness and inability of the sensors. The models of sensor and level 2 ADAS systems are developed using MATLAB toolbox and Simulink. Sensor detection performance is determined by running simulations with triple radar setup. Obtained results demonstrate that the proposed approach generates accurate detections of targets in all tested scenarios.

The increased demand and use of autonomous vehicles and advanced driver-assistance systems has been constrained by an incidence of accidents involving errors with the perception layer’s functionality. In tandem, recent papers have noted the lack of standardized, independent testing formats and insufficient methods with which to analyze, verify and qualify LiDAR-based data and categorization. While camera-based approaches benefit from an ample amount of research, camera images can be unreliable in situations with impaired visibility such as dim lighting and fog. This paper aims to introduce a novel method based entirely on LiDAR data with the capability to detect anomalous patterns as well as complementing other performance evaluators using a Copula-based approach. With a promising set of preliminary results, this methodology may be used to evaluate an algorithm’s confidence score, the impact conditions may have on LiDAR data and detect cases in which LiDAR data may be insufficient or otherwise unusable.

3D object detection is essential for an accurate and reliable autonomous driving system. Currently, the methods used by the state-of-the-art two-stage detectors are not flexible enough and their fea-ture extraction capabilities are very limited to cope effectively with the disorder and irregularity of point clouds. In this paper, we combine the advantages of both PV-RCNN and PAConv (Position Adaptive Convolution) to create a completely new network, FANet, in order to overcome the ir-regularity and disorder of point clouds. The convolution in our network builds convolutional ker-nels from a basic weight matrix, whose combined coefficients are learned adaptively by LearnNet from relative points. This network allows for flexible modeling of complex spatial variations and geometric structures in the 3D point cloud, enabling better extraction of point cloud features and producing high-quality 3D proposal boxes. Compared to other methods, FANet is superior in terms of 3D object detection accuracy. Extensive experiments on the KITTI dataset have shown a signif-icant improvement in our approach.

Fires pose a significant threat to human life and property. An autonomous fire detection and fighting robot has the potential to mitigate the challenges associated with firefighting. This paper presents the implementation of an autonomous fire detection and fighting robot equipped with sensors, algorithms, and actuators to detect, locate, and suppress fires autonomously. The robot's mechanical and electrical components were designed, prototyped, and tested in a controlled environment to evaluate its ability to navigate through obstacles, detect fires, and suppress them autonomously. The results show that the robot effectively detects and suppresses fires, making it a promising solution for firefighting applications. The study contributes to the development of autonomous robots for firefighting, enhancing the safety of firefighters and the effectiveness of firefighting operations.

While machine learning models are powering more and more everyday devices, there is a growing need for explaining them. This especially applies to the use of Deep Reinforcement Learning in solutions that require security, such as vehicle motion planning. In this paper, we propose a method of understanding what the RL agent’s decision is based on. The method relies on conducting statistical analysis on a massive set of state-decisions samples. It indicates which input features have an impact on the agent’s decision and the relationships between decisions, the significance of the input features, and their values. The method allows us for determining whether the process of making a decision by the agent is coherent with human intuition and what contradicts it. We applied the proposed method to the RL motion planning agent which is supposed to drive a vehicle safely and efficiently on a highway. We find out that making such analysis allows for a better understanding agent’s decisions, inspecting its behavior, debugging the ANN model, and verifying the correctness of input values, which increases its credibility.

The world is facing a great technological transformation towards full autonomous vehicles, where optimists predict that by 2030, autonomous vehicles will be sufficiently reliable, affordable and common to displace most human driving. To cope with these trends, reliable perception systems must enable vehicles to hear and see all the surroundings, being light detection and ranging (LiDAR) sensors a key instrument for recreating a 3D visualization of the world in real time. However, perception systems must rely in accurate measurements of the environment. Thus, sensors must be calibrated and benchmarked before being placed on the market or assembled in a car. This article presents an Evaluation and Testing Platform for Automotive LiDAR sensors with the main goal of testing not only commercially available sensors, but also sensor prototypes currently under development in Bosch Automotive Electronics division. The testing system can benchmark any LiDAR sensor under different conditions, recreating the expected driving environment to which such devices are normally subjected. To characterize and validate the sensor under test, the platform evaluates several parameters such as the field of view (FoV), angular resolution, sensor’s range, etc. This project results from a partnership between the University of Minho and Bosch Car Multimedia Portugal, S.A.

As a result of extensive research in the field of mobile robots (rovers) and swarms, a number of algorithms exist to assist them for executing a mission in the three levels of software architecture: strategic (interaction loop level), tactic (planning) and operational (sensing, control and actuation). They allow them to achieve their goals while adapting to their environment through a multitude of methods designed for each situation. For this reason, a literature review of the latest research conducted in previous years is required to identify new research trends in human-swarm interaction applied to help humans in hazardous environment such as militarized zone. In this paper, we will present some interesting algorithms for interactive and autonomous mobile robots acting in swarms in an open and crowded environment. A discussion will focus on comparing different algorithms and their advantages and disadvantages.

The paper presents models of path and control planning for parking, docking, and movement of autonomous vehicles at low speeds considering space constraints. Given the low speed of motion, and in order to test and approve the proposed algorithms, vehicle kinematic models are used. Recent works on the development of parking algorithms for autonomous vehicles are reviewed. Bicycle kinematic models for vehicle motion are considered for three basic types of vehicles: passenger car, long wheelbase truck, and articulated vehicles with and without steered semitrailer axes. Mathematical descriptions of systems of differential equations in matrix form and expressions for determining the linearization elements of nonlinear motion equations that increase the speed of finding the optimal solution are presented. Options are proposed for describing the interaction of vehicle overall dimensions with the space boundaries, within which a maneuver should be performed. An original algorithm that considers numerous constraints is developed for determining vehicle permissible positions within the closed boundaries of the parking area, which are directly used in the iterative process of searching for the optimal plan solution using nonlinear model predictive control (NMPC). The process of using NMPC to find the best trajectories and control laws while moving in a semi-limited space of constant curvature (turnabouts, roundabouts) are described. Simulation tests were used to validate the proposed models for both constrained and unconstrained conditions and the output (state-space) and control parameters' dependencies are shown. The proposed models represent an initial effort to model the movement of autonomous vehicles for parking and has the potential for other highway applications.

Motivated by Autonomous vehicle idea and driving safety issues, driver assistance system such as Active braking, Cruise Control, Lane departure warning lane keeping and etc. has become a very active research area. However, this paper presents the performance and robustness analysis of a model predictive control and proportional integral derivative control for lane keeping maneuvers of an autonomous vehicle using computer vision simulation studies. A simulation study was carried out where a vehicle model based on single tracked bicycle model was developed in MATLAB/SIMULINK environment together with a vision dynamic system. Both PID controller and MPC were simulated to maintain the desired reference trajectory of the vehicle by controlling steering angle. Further performance and robustness analysis were carried out and the simulation results show that the proposed control system for the PID control achieved its objective even though it was less robust in maintaining its performance under various conditions like vehicle load change, different longitudinal speed and different cornering stiffness. While in the case of MPC the optimizer made sure that the predicted future trajectory of the vehicle output tracks the desired reference trajectory and was more robust in maintaining its performance under same conditions as in PID.

The relative position of the orchard robot to the rows of fruit trees is an important parameter for achieving autonomous navigations. The current methods for estimating the position parameters between rows of orchard robots obtain low parameter accuracy, and to address this problem, this paper proposes a machine vision-based method for detecting the relative position of orchard robots and fruit tree rows. Firstly, the fruit tree trunk is identified based on the improved YOLOv4 model; secondly, the camera coordinates of the tree trunk are calculated from the principle of binocular camera triangulation, and the ground projection coordinates of the tree trunk are obtained through coordinate conversion; finally, the midpoints of the projection coordinates of different sides are combined and the navigation path is obtained by linear fitting with the least squares method, and the position parameters of the orchard robot are obtained through calculation. The experimental results show that the average accuracy and average recall of the improved YOLOv4 model for fruit tree trunk detection are 97.05% and 95.42%, respectively, which are 5.92 and 7.91 percentage points higher than those of the original YOLOv4 model. The average errors of heading angle and lateral deviation estimates obtained based on the method in this paper are 0.57° and 0.02 m. The method can accurately calculate heading angle and lateral deviation values at different positions between rows, and can provide a reference for autonomous visual navigation of orchard robots.

The Self-determination theory and The Vallerand's Hierarchical Model has been studied with different types of social factors that can bring different consequences. The purpose of this work was if responsibility and social climate could predict the social and prosocial behaviors and vio-lence. For this, 429 students (M = 11.46, SD = 1.92) participated in this study answering a ques-tionnaire with five variables: school climate, responsibility, motivation, satisfaction of psycholog-ical needs, prosocial and antisocial behaviors and violence. The main results saw that the most part of variables were correlated positive and directly except with antisocial behaviors and vio-lence. On the other hand, prediction model (X2 = 584.145 (98); RMSEA = 0.104 [90% CI = 0.096, 0.112]; TLI = 0.849; CFI = 0.894) showed that responsibility and school climate can predict psy-chological basic needs and these needs, can improve the autonomous motivation and finally have positive consequences improving prosocial behaviors and reducing antisocial behaviors and vio-lence. In conclusion, school climate and responsibility can improve positive consequences to the classroom, specifically, prosocial behaviors and reducing violence and antisocial behaviors.

This investigation explores a novel path-planning and optimization strategy for multiple cooperative robotic agents, applied in a fully observable and dynamically changing obstacle field. Current dynamic path planning strategies employ static algorithms operating over incremental time-steps. We propose a cooperative multi-agent (CMA) based algorithm, based on natural flocking of animals, using vector operations. It is preferred over more common graph search algorithms like A* as it can be easily applied for dynamic environments. CMA algorithm executes obstacle avoidance using static potential fields around obstacles, that scale based on relative motion. Optimization strategies including interpolation and Bezier curves are applied to the algorithm. To validate effectiveness, CMA algorithm is compared with A* using static obstacles due to lack of equivalent algorithms for dynamic environments. CMA performed comparably to A* with difference ranging from -0.2% to 1.3%. CMA algorithm is applied experimentally to achieve comparable performance, with an error range of -0.5% to 5.2%. These errors are attributed to the limitations of the Kinect V1 sensor used for obstacle detection. The algorithm was finally implemented in a 3D simulated space, indicating that it is possible to apply with drones. This algorithm shows promise for application in warehouse and inventory automation, especially when the workspace is observable.

This paper investigates a novel concept of using cycloidal propellers to augment the maneuverability of unmanned underwater vehicles. Cycloidal propellers are cross-flow propellers that utilize 360$^{\circ}$ thrust vectoring to provide agile maneuvering to surface vessels like yachts, tug boats, buoy tenders and double ended ferries, but have yet to be utilized on present-day unmanned and autonomous marine vehicles. Through 360$^{\circ}$ thrust vectoring, cycloidal propellers enable surface vessels to execute spot turns, and surge in forward and backward directions with equal ease. Such compact maneuvers are difficult to execute with the conventional screw propeller-rudder setup found on marine vehicles today. On unmanned and autonomous marine vehicles, cycloidal propellers can potentially enable controlled and decoupled maneuvering in all six degrees-of-freedom while overcoming disturbances like waves and currents, and extreme flow conditions like cavitation and ventilation. This is critical for marine vehicles operating at low speeds and in restricted waters. Therefore, the objective of this paper is to study the maneuvering characteristics of a UUV driven by a screw propeller and control fins only, and compare it to that of the UUV augmented with retractable cycloidal propellers. The cases considered are a turning circle maneuver, a low-speed 180$^{\circ}$ turn and a low-speed heave maneuver. A six degrees-of-freedom motion prediction model that accounts for the non-linear and coupled loads on an underwater vehicle is developed and validated. Simulation results showed that compared to conventional propulsion systems, cycloidal propellers could potentially enable more swift, compact and decoupled maneuvers in unmanned marine vehicles. Integrated with robust control systems, cycloidal propellers can be explored for use in dynamic positioning, ocean exploration, station-keeping, seakeeping and teaming of unmanned and autonomous marine vehicles.

The rapid urbanization has exerted tremendous pressure on natural systems in mountains. As a measure of sustainable use of natural resources, ecological footprint is an important basis for judging whether the development of a country or region is within the biocapacity. Taking Dali Bai Autonomous Prefecture as an example, this study comprehensively analyzes the impact of human activities on mountain resources and environment from the three aspects of urbanization, land use and ecological carrying capacity. The results show that Dali Prefecture with the urbanization rate of 33% is still in the accelerated stage of urbanization. The urban space presents the core-periphery feature, and the central city is the focus of human existence and living activities. The per capita ecological footprint is 1.14 hm2/person higher than the ecological carrying capacity, meaning Dali Prefecture is in an ecological deficit state. This indicates that there is an uncoordinated state between urbanization and environment. Arable land is the main source of per capita ecological footprint in the prefecture. However, the urban expansion overly occupies the arable land in the plain sub-region, leading the arable land to an ecological deficit state. In the future, the development of the mountainous area should focus on the protection of arable land and choose a new sustainable path.

This study determines the threshold for the computational rate of actuator motor controllers for unmanned underwater vehicles necessary to accurately follow discontinuous square wave commands. Motors must track challenging square-wave inputs, and identification of key computational rates permit application of deterministic artificial intelligence (D.A.I.) to achieve tracking to a machine-precision degree of accuracy in direct comparison to other state-of-art approaches. All modeling approaches are validated in MATLAB simulations where the motor process is discretized at varying step-sizes (inversely proportional to computational rate). At a large step-size (fast computational rate), discrete D.A.I. shows a mean error more than three times larger than that of a ubiquitous model-following approach. Yet, at a smaller step size (slower computational rate), the mean error decreases by a factor of 10, only three percent larger than that of continuous D.A.I. Hence, the performance of discrete D.A.I. is critically affected by the sampling period for discretization of the system equations and computational rate. Discrete D.A.I. should be avoided when small step-size discretization is unavailable. In fact, continuous D.A.I. has surpassed all modeling approaches which makes it the safest and most viable solution to future commercial applications in unmanned underwater vehicles.

Background: Waste management is one of the challenges facing cities around the world. In Africa, where the increase in the urban population and the growing demand for consumer goods are driving up the rate of waste production, waste collection and disposal are posing serious problems, not only for municipal and central government officials, but also and above all for the local population. In Togo, and more specifically in the city of Lomé and the surrounding area (Greater Lomé), as in other African cities, the average annual production is estimated at 305340 tonnes, of which 89428 tonnes are collected and buried, giving a collection rate of 29.29%. A tiny proportion of the waste collected (9,000 tonnes, or 2.95%) is recycled as compost by associations and/or NGOs. The three key players who share this task are the local authority, the formal sector and the informal sector. Objective: The aim of this study is to assess the current state of waste management in Greater Lomé, which poses a major threat to public health, socio-economic development and the environment. Material and methods: To this end, documentary research and surveys carried out on two types of waste management stakeholder, namely formal and informal, in the five districts of Greater Lomé enabled us to make a general diagnosis. Results: However, despite the efforts made by the stakeholders involved in waste management, it appears that the transformation of solid household waste into compost remains the most suitable endogenous method for recovering fermentable waste and returning it to the soil, in order to improve the organization of waste management in the city of Lomé, reduce the quantity of waste to be landfilled and clean up the city. KEYWORDS: Urban waste, management, composting, collection, treatment, autonomous district of Greater Lomé.

High-rise building fires pose a serious threat to the lives and property safety of the people. The lack of reliable and accurate positioning means is one of the main difficulties faced by rescue. In the absence of prior knowledge of the high-rise building fire environment, the coverage deployment of mobile base stations is a challenging problem that has not received much attention in the literature. This paper studies the problem of autonomous optimal deployment of base stations in high-rise building fire environment based on UAV group. A novel problem formulation is proposed that solves the non line of sight (NLOS) positioning problem in complex unknown environment. The purpose of this paper is to realize the coverage and deployment of mobile base stations in complex and unknown fire environment. The NLOS positioning problem in the fire field environment is turned into the line of sight (LOS) positioning problem through the optimization algorithm. And there are more than three LOS base stations nearby any point in the fire field. A control law which is formulated in a mathematically precise problem statement is developed that guarantees to meet mobile base stations deployment goal and to avoid collision. Finally, positioning accuracy of our method and that of common method were compared. The simulation result showed that the positioning accuracy of simulated firefighter in the fire field environment was improved greatly.

With advances in the development of autonomous vehicles (AVs), more attention has been paid to the effects caused by adverse weather conditions on them. It is well known that the performance of self-driving vehicles is reduced when they are exposed to stressors that impair visibility or generate water or snow accumulation on sensor surfaces. This paper proposes a model to quantify weather precipitation, such as rain and snow, perceived by moving vehicles based on outdoor data. The modelling covers a wide range of parameters, such as varying wind direction and realistic particle size distributions. The model allows the calculation of precipitation intensity on inclined surfaces of different orientations and on a circular driving path. The modelling results were partially validated against direct measurements carried out by a test vehicle. The model outputs showed strong correlation with the experimental data for both rain and snow. Mitigation strategies for heavy precipitation on vehicles can be developed and correlations between precipitation rate and accumulation level can be traced using the presented analytical model. Dimensional Analysis of the problem has highlighted the critical parameters that can help the design of future experiments. The obtained results highlight the importance of the angle of the sensing surface on the perceived precipitation level. The proposed model is used to analyze optimal orientations for minimization of the precipitation flux, which can help to determine the positioning of sensors on the surface of autonomous vehicles.

Navigation is the most challenging issue in autonomous vehicles. Researchers in the current era have developed many Artificial Intelligence techniques to navigate, generate paths, and avoid obstacles for optimum path planning for autonomous vehicles. Different studies have investigated bio-inspired techniques to overcome the navigation issue, including obstacle avoidance. This paper uses new meta-heuristic optimization techniques called Dragonfly Algorithm (DA) to set the goal by detecting and avoiding obstacles with minimum human interference. For effective results, the Dragonfly-Fuzzy hybrid algorithm is analyzed over the unstructured environment because individual techniques may not be sure of an optimal solution over all configurations. The main advantage of the proposed hybrid controller is that it combines the multiple features of different approaches into a single controller. This paper compares simulation and experimental findings over various environmental conditions to the individual algorithm. Regarding time and path optimization, the hybrid Dragonfly-Fuzzy controller performs better than the respective controller.

The Complete Coverage Path Planning (CCPP) is a key technology in the field of agricultural robot, and has great significance for improving the efficiency and quality of tillage, fertilization, harvesting and other agricultural robot operations, as well as reducing the operation energy consumption. The traditional boustrophedon or heuristic search algorithm based CCPP methods, when coping with the field with irregular boundaries, obstacles and other complex environments, still face many problems and challenges, such as large repeated work areas, multiple turns or U-turns, low operation efficiency and prone to local optimum. In order to solve the above problems, an improved-genetic-algorithm-based CCPP method was proposed in this paper, which introduces the idea of chromosome pairs and multi-points mutation to improve its global optimization ability in complex environments, reduce the repeated work areas and the number of turns and U-turns, and thereby improve the operation efficiency. The simulation and experimental results on simple regular fields showed that the proposed improved genetic algorithm-based CCPP method achieved the comparable performance with the traditional boustrophedon-based CCPP method. However, on the complex irregular fields, although the proposed CCPP method increased the number of turns by 13.76%, the area of repeated operation and the number of U-turns were decreased by 38.54% and 35.00% respectively, and saves the battery voltage by 7.82% on average compared to the boustrophedon-based CCPP method. This proved that the proposed CCPP method has strong adaptive capacity to the environment, and has practical application value in improving the efficiency and quality of agricultural machinery operations, and reducing the energy consumption.

3D object detection is crucial for autonomous driving to understand the driving environment. Since the pooling operation causes information loss in the standard CNN, we have designed a wavelet multiresolution analysis-based 3D object detection network without a pooling operation. Additionally, instead of using a single filter like the standard convolution, we use the lower-frequency and higher-frequency coefficients as a filter. These filters capture more relevant parts than a single filter, enlarging the receptive field. The model comprises a discrete wavelet transform (DWT) and an inverse wavelet transform (IWT) with skip connections to encourage feature reuse for contrasting and expanding layers. The IWT enriches the feature representation by fully recovering the lost details during the downsampling operation. Element-wise summation is used for the skip connections to decrease the computational burden. We train the model for the Haar and Daubechies (Db4) wavelets. The two-level wavelet decomposition result shows that we can build a lightweight model without losing significant performance. The experimental results on the KITTI’s BEV and 3D evaluation benchmark show our model outperforms the Pointpillars base model by up to 14 \% while reducing the number of trainable parameters. Code will be released.

This study presents the substantiation, development, and analysis of a technique for planning the autonomous vehicle (AV) motion reference parameters. The trajectory plan, speed and acceleration distributions, including other AV's kinematic parameters, are determined using sequential optimization. The study objectives are based on an analysis of the fundamental problems of AV motion planning summarized in this area's latest publications. The proposed approach combines the basic principles of the finite element method (FEM) and nonlinear optimization with nonlinear constraints. First, the generalization on representing an investigated function by finite elements (FE) is briefly described. A one-dimension FE with two nodes and three degrees of freedom (DOF) in a node was chosen as the basic one, corresponding to the 5th-degree polynomial. Next, a method for determining the motion trajectory is presented. The following are considered: formation of a restricted space for the AV's allowable maneuvering, the geometry of motion trajectory and its relation with vehicle steerability parameters, cost functions and their influences on the desirable trajectory's nature, compliance of nonlinear restrictions of the node parameters with the motion area boundaries. At the second stage, a technique for optimizing AV speed and acceleration redistribution is presented. The model considers possible combinations of cost functions, conditions of limiting the kinematic parameters with the tire slip critical speed, maximum speed level, maximum longitudinal acceleration, and critical lateral acceleration. In the simulation section, several variants of trajectories were searched and compared. Several versions of distributing the longitudinal speed and acceleration curves are determined, and their comparative analysis is fulfilled. At the end of the paper, the advantages and drawbacks of the proposed technique are noted. The conclusion is made regarding the options for improving the method in further studies.

Accurately estimating the current state of local traffic scenes is one of the key problems in the development of software components for automated vehicles. In addition to details on free space and drivability, static and dynamic traffic participants, information on the semantics may also be included in the desired representation. Multi-layer grid maps allow to include all this information in a common representation. However, most existing grid mapping approaches only process range sensor measurements such as LIDAR and Radar and solely model occupancy without semantic states. In order to add sensor redundancy and diversity it is desired to add vision based sensor setups in a common grid map representation. In this work, we present a semantic evidential grid mapping pipeline including estimates for eight semantic classes that is designed for straightforward fusion with range sensor data. Unlike in other publication our representation explicitly models uncertainties in the evdiential model. We present results of our grid mapping pipeline based on a monocular vision setup and a stereo vision setup. Our mapping resulsts are accurate and dense mapping due to the incorporation of a disparity- or depth-based ground surface estimation in the inverse perspective mapping. We conclude this paper by providing a detailed quantitative evaluation based on real traffic scenarios in the Kitti odometry benchmark and demonstrating the advantages compared to other semantic grid mapping approaches.

This paper outlines a new methodology for developing strategy for supply chain integration of Autonomous Electrical Vehicles (AEV) to the Internet of Things (IoT). The methodology consists of external architecture and internal design that anticipates the business strategy in the development process. The methodology is designed to anticipate the impact of developments in new road transport technologies, such as Tesla Truck or Tesla Pickup. Since the methodology is designed to anticipate the impact of non-existing technologies, it represents green-field analysis. Green-field is defined as a new and non-existent operation. Green-field strategy architecture in this paper is presented as a process of accepting the world and acting upon that version of the world. The results of the analysis are presented as pathways and outcomes, emerging from the interrelated relationship between AEV and IoT. The emerging methodology is applied through two case studies to evaluate the impact to environment, performance and operationalisation. The methodology proposes architecture and design for integrating AEV and IoT in the supply chain strategy, and a set of new evaluation criteria that promote acceptance of Artificial Intelligence (AI) in the design process. The main contribution to knowledge is a new methodology for integrating AEV and the IoT to the supply chains. The paper applies interplay between inductive and deductive case study and grounded theory approach to build upon the concept of supply chain architecture and contribute to knowledge to the topic of formulating green-field integrated AEV- IoT supply chain strategy.

The key to ensuring the sustainability of transportation operations on the roads is to manage traffic flows homogeneously. By homogenizing the behavior of various drivers, traffic operation can be optimized, and traffic safety can be improved. However, the advent of autonomous vehicles is expected to have a major impact on the homogeneity of sustainable transportation operations. In this study, a method of driving in harmony with surrounding vehicles was studied to minimize the impact of autonomous vehicles on current traffic operation. In particular, in this study, a methodology was developed to optimize the driving behavior of autonomous vehicles by analyzing the driving behavior of following vehicles using spectrum analysis. Specifically, a method for calculating three indicators that can analyze the driving behavior of a following vehicle, such as reaction time, stimulus adaptation index, and collision risk avoidance index, was proposed. These indices produced consistent and robust results for all traffic conditions. If these indicators are used, it is expected that sustainable traffic management will be possible even when autonomous vehicles and human drivers are mixed on the road.

The rapid development of Deep Learning brought novel methodologies for 3D Object Detection using LiDAR sensing technology. These improvements in precision and inference speed performances lead to notable high performance and real-time inference, which is especially important for self-driving purposes. However, the developments carried by these approaches overwhelm the research process in this area since new methods, new technologies, and software versions lead to different project necessities, specifications and requirements. Moreover, the improvements brought by the new methods may be due to improvements in newer versions of deep learning frameworks and not just the novelty and innovation of the model architecture. Thus, it became crucial to create a framework with the same software versions, specifications and requirements that accommodate all these methodologies and allow the easy introduction of new methods and models. A framework is proposed that abstracts the implementation, reusing and building of novel methods and models. The main idea is to facilitate the representation of state-of-the-art (SoA) approaches and simultaneously encourage the implementation of new approaches by reusing, improving and innovating modules in the proposed framework, which has the same software specifications to allow a fair comparison. This makes it possible to determine if the key innovation approach outperforms the current SoA by comparing models in a framework with the same software specifications and requirements.

This paper provides a comprehensive overview of recent advancements in autonomous electric vehicle (AEV) within the specified region. It elaborates on the progress and comparative analysis of diverse subsystems, including energy storage, cell balancing for battery systems, vehicle charger layouts, electric vehicle motor mechanisms, and braking systems. Furthermore, this paper showcases several prototype autonomous electric vehicles as conclusive study findings.

The ever-burgeoning growth of autonomous unmanned aerial vehicles (UAVs) has demonstrated a promising platform for utilization in real-world applications. In particular, UAV equipped with a vision system could be leveraged for surveillance applications. This paper proposes a learning-based UAV system for achieving autonomous surveillance, in which the UAV can be of assistance in autonomously detecting, tracking, and following a target object without human intervention. Specifically, we adopted the YOLOv4-Tiny algorithm for semantic object detection and then consolidated it with a 3D object pose estimation method and Kalman Filter to enhance the perception performance. In addition, a back-end UAV path planning for surveillance maneuver is integrated to complete the fully autonomous system. The perception module is assessed on a quadrotor UAV, while the whole system is validated through flight experiments. The experiment results verified the robustness, effectiveness, and reliability of the autonomous object tracking UAV system in performing surveillance tasks. The source code is released to the research community for future reference.

The control of air quality in museums or storages is of fundamental interest for the conservation of historic artifacts. The present work reports an example of application of RFID sensors developed in the European project SensMat and dedicated to this issue. The sensors are based on the varia-tion of property of an RFID tag coupled to a sensitive silver thin film exposed to the environment. As it will be described in the paper, such low cost sensors are interrogated by a commercial reader and provide the environmental corrosivity index and thus the presence of pollutants. The selected case study concerns the monitoring of pollution by H2S in a building dedicated to conservation and restoration of archeological and historical woods. The ability of sensors to map spatially the corrosivity within buildings is highlighted.

This paper describes and demonstrates an autonomous robotic team that can rapidly learn the characteristics of environments that it has never seen before. The flexible paradigm is easily scalable to multi-robot, multi-sensor autonomous teams, and is relevant to satellite calibration/validation and the creation of new remote sensing data products. A case study is described for the rapid characterisation of the aquatic environment, over a period of just a few minutes we acquired thousands of training data points. This training data allowed our machine learning algorithms to rapidly learn by example and provide wide area maps of the composition of the environment. Along side these larger autonomous robots two smaller robots that can be deployed by a single individual were also deployed (a walking robot and a robotic hover-board), observing significant small scale spatial variability.

Scientific and technological advances in telecommunications and onboard electronics, and advances in sustainability standards, dictated major changes to various industrial sectors, including the automotive industry, where hard and soft approaches to manufacturing are vying for market dominance. This work presents a prospective analysis of the autonomous vehicle (AV) market, analyzing three of the main US AV technology firms, Tesla, Waymo and Apple. Their designs and solutions are compared, and prospective scenarios were constructed based on an analysis of their strengths, weaknesses, opportunities and threats (SWOT). The results suggest that Tesla currently exhibits the greatest market leadership in the group studied. However, it was concluded that in the medium term, Waymo would surpass Tesla and assume market leadership. In the long run, it was concluded that Apple will overcome its rivals and dominate this market.

In this paper, we introduce a computational procedure that enables autonomous LEO laser trackers endowed with INSs to increase the current accuracy when shooting at middle distant medium-size LEO debris targets. The code is designed for the trackers to throw the targets into the Atmosphere by means of ablations. In case that the targets are eclipsed to the trackers by the Earth, the motions of the trackers and targets are modeled by equations that contain post-Newtonian terms accounting for the curvature of space. Otherwise, when the approaching targets become visible for the trackers, we additionally use more accurate equations, which allow to account for the local bending of the laser beams aimed at the targets. We observe that under certain circumstances the correct shooting configurations that allow to safely and efficiently shoot down the targets, differ from the current estimations by distances that may be larger than the size of many targets. In short, this procedure enables to estimate the optimal shooting instants for any middle distant medium-size LEO debris target.

In this contribution, different lane-keeping control strategies for Autonomous Ground Vehicles (AGV) have been analyzed and compared. The AGV must be oriented and kept within a given reference path using the front wheel steering angle as the control action for a specific longitudinal velocity. While non-linear models can describe the lateral dynamics of the vehicle in an accurate manner, they might lead to difficulties when computing some real-time control laws such as Model Predictive Control (MPC). Linear Parameter Varying (LPV) models can provide a trade-off between computational complexity and model accuracy. Another way to reduce computational complexity is to explore other control strategies, for example, the one based on the Inverse Kinematic Bicycle model (IKIBI). Additionally, AGV sensors typically work at different measurement acquisition frequencies so that Kalman Filters (KF) are usually needed for sensor fusion. If these frequencies are slower than the actuation rate, a multi-rate KF may be needed. The two control strategies (MPC using a LPV model and IKIBI) have been compared in simulations over a circuit path in the presence of process and measurement Gaussian noise. The MPC controller has shown to provide a more accurate lane-keeping behavior than an IKIBI control strategy. Finally, it has been seen that Dual-Rate Extended Kalman Filters (DREKF) constitute an essential tool when only slow and noisy sensor feedback is available in an AGV lane-keeping application.

Existing rammed earth construction methods have disadvantages such as increased initial costs for manufacturing the large formwork and increased labor costs owing to the labor-intensive construction techniques involved. To address the limitations of existing rammed earth construction methods, an autonomous rammed earth construction method is introduced herein. As this autonomous rammed earth construction method uses a modular formwork, alternative materials must be used in the construction to satisfy the requirements for the early-age binder performance. Accordingly, this study evaluates the use of an epoxy emulsion composed of epoxy and a hardener to enhance the performance of the binder. Preliminary experiments were conducted to determine the optimal formulation of the epoxy emulsion, following which the compressive strength, water loosening, shrinkage, rate of mass change, and microstructure of several red clay binder specimens with and without epoxy emulsion were analyzed at early ages. The results confirmed that the epoxy emulsion can be applied to satisfy the performance requirements for autonomous rammed earth construction by improving the durability and strength of the binder at early ages.

In passing maneuvers on two-lane highways, assessing the needed distance and the potential power reserve to ensure the required speed mode of the passing vehicle is a critical task of speed planning. This task must meet several mutually exclusive conditions that lead to successful maneuver. The paper addresses three main aspects. First, the issues of rational distribution of the speed of the passing vehicle for overtaking a long commercial vehicle on two-lane highways are discussed. The factors that affect maneuver effectiveness are analyzed, considering safety and cost. Second, a heuristic algorithm is then proposed based on the rationale for choosing the necessary space and time for overtaking. The initial prediction's sensitivity to fluctuations of current measurements of the position and speed of the overtaking participants is examined. Third, an optimization technique for passing vehicle speed distribution over the overtaking time using the finite element method is presented. The adaptive model predictive control is applied for tracking the references being generated. The presented model is illustrated using simulation.

In this paper, we study the existence of the random -pullback attractor of a non-autonomous local modified stochastic Swift-Hohenberg equation with multiplicative noise in stratonovich sense. It is shown that a random -pullback attractor exists in when its external force has exponential growth. Due to the stochastic term, the estimate are delicate, we overcome this difficulty by using the Ornstein-Uhlenbeck(O-U) transformation and its properties.

This paper proposes a novel micro-grid structure, which can operate fully-autonomously with inherent seamless switching. It can operate independently in both grid-connected and islanded mode as a self-governed entity without relying on the utility grid. An AC/DC/AC converter is employed as the interface between the micro-grid and the utility grid, which enables the two entities to have different voltages in grid-connected mode. Seamless switching between operation modes can be achieved naturally. The micro-grid is regulated to exchange predefined amount of power with the utility grid in grid-connected mode. This will benefit the power dispatching algorithm of the power system. The predefined power is estimated based on power forecasting of local renewable generations and loads with consideration of the Sate of Charge (SOC) of the battery, and is updated and broadcasted every certain period. A small scale AC micro-grid with a rotating generator, battery storage and solar arrays etc. is built for investigation. Matlab/Simulink results are provided to validate the robustness and flexibility of proposed micro-grid and its operation strategy.

Several design methods and principles have been presented so far, in order to guide the design of autonomous operations. Putting the required efforts into learning and using the methods for designing autonomous operations is a daunting task. Experiences so far have shown that the use of methods meant to the help the design process are often ignored. One reason could be that the design guidelines are too complex and contain much information often not relevant for the project at hand, and therefore there is no easy way to distinguish what is important from what is not. This is an issue that needs to be solved with our approach. In this article, the Autonomous Job Analysis (AJA) method is presented. The proposed methodology is created in order to guide the design of autonomous operations in maritime systems by breaking them down in to sub-operations in order to reveal challenges, needs and limitations regarding autonomous behavior. The canvas contains the categories of the AJA method on a single page format -the canvas- and each category is supported with questions to be asked during the design procedure, as well as example answers. We will describe the AJA method and the AJA canvas in detail, and present a use case scenario of an autonomous operation in order to show how they can be applied. The particular use-case is the design of an autonomous operation for the detection, inspection and tracking of a waste water plume.

For autonomous driving, perception is a primary and essential element that fundamentally deals with the insight into the ego vehicle’s environment through sensors. Perception is a challenging task suffering from dynamic objects and continuous environmental changes. The issue gets worse due to interrupting the quality of perception by adverse weather like snow, rain, fog, night light, sand storm, strong daylight, etc. In this work, we have tried to improve camera-based perception accuracy, such as autonomous driving-related object detection in adverse weather. We proposed the improvement of YOLOv8-based object detection in adverse weather through transfer learning using merged data from various harsh weather datasets. Two prosperous open-source datasets (ACDC and DAWN) and their merged dataset were used to detect primary objects on the road in harsh weather. A set of training weights were collected from training on the individual datasets, their merged version, and several subsets of those datasets according to their characteristics. A comparison between the training weights also occurred by evaluating the detection performance on the above-mentioned datasets and their subsets. The evaluation revealed that using custom datasets for training significantly improves the detection performance compared to the YOLOv8 base weights. And using more images through the feature-related data merging technique steadily increases the object detection performance.

Reinforcement Learning (RL) has demonstrated considerable potential in solving challenges across various domains, notably in autonomous driving. Nevertheless, implementing RL in autonomous driving comes with its own set of difficulties, such as the overestimation phenomenon, extensive learning time, and sparse reward problems. Although solutions like Hindsight Experience Replay (HER) have been proposed to alleviate these issues, the direct utilization of RL in autonomous vehicles remains constrained due to the intricate fusion of information and the possibility of system failures during the learning process. In this paper, we present a novel RL-based autonomous driving system technology that combines Obstacle Dependent Gaussian (ODG) RL, Soft Actor-Critic (SAC), and meta-learning algorithms. Our approach addresses key issues in RL, including the overestimation phenomenon and sparse reward problems, by incorporating prior knowledge derived from the ODG algorithm. We evaluated our proposed algorithm on official F1 circuits, using high-fidelity racing simulations with complex dynamics. The results demonstrate exceptional performance, with our method achieving up to 89% faster learning speed compared to existing algorithms in these environments.

In the context of partial autonomy, where autonomous vehicles and humans share control of the vehicle, bringing out-of-the-loop drivers back into the loop is a significant challenge. While warning signal design guidelines are commonly used to provide alerts, few studies have examined each signal in depth with an emphasis on the autonomous environment. This study aims to fill this gap by investigating visual, auditory, and tactile stimuli and modifying their sub-attributes to explore variations related to age, gender, and other individual backgrounds. A driving simulator was utilized to create a realistic driving environment and measure participants' reaction times in takeover request situations. Analysis of the data revealed correlations between age and reaction times for auditory and tactile signals, with interaction effects observed between age and sub-attribute intensity. Additionally, participants exhibited varying reaction time patterns in response to different sub-attribute intensities. By evaluating individual differences in perception based on modality characteristics, often overlooked in prior research, this study serves as a foundational contribution to future research in the field.

This paper presents an analysis of the sensitivity of controlling an autonomous surface object among a group of encountered objects to the inaccuracy of state control process data. For this purpose, a safe and optimal model of the control process was defined. An algorithm for determining the optimal and safe trajectory of an object, based on the multi-object game model, was developed; for comparative analysis, an algorithm for calculating only the optimal trajectory, not taking into account the maneuverability of other objects, was additionally developed. First, simulation-based studies of the algorithms enabled a comparative analysis of a number of different acceptable strategies for optimally shifting the trajectory of maneuvering objects from a single initial direction. Thereafter, the main goal of this paper was implemented: an analysis of the sensitivity characteristics of safe control, assessed with the risk of collision, both on the inaccuracy of navigation data and on the number of possible control strategies. Finally, final conclusions and a plan for further research on the subject of the paper were formulated.

In the context of Shared Autonomous Vehicles, the need to monitor the environment inside the car will be crucial. This article focuses on the application of deep learning algorithms to detect objects, namely lost/forgotten items to inform the passengers, and aggressive items to monitoring if violent actions may arise between passengers. For object detection algorithms was used public datasets (COCO and TAO) to train state-of-the-art algorithms, such as YOLOv5. For violent action detection was used the MoLa InCar dataset to train on state-of-the-art algorithms such as I3D, R(2+1)D, SlowFast, TSN and TSM. At the end an embedded automotive solution was used to demonstrate both methods running in real-time.

Adaptive Cruise Control (ACC) is useful in the most dangerous maneuvers such as braking and acceleration. This study assesses how ACC modifies traffic flows by analysing the differences be-tween manual and autonomous driving in connected and autonomous vehicles (CAVs). Using a platoon of 80 vehicles, tested in pairs on the road, it was possible to define the speed trends during braking and acceleration and the reaction times to the driving maneuvers (PRT, TH, TCC) with a kinematic data detector. The interactions between the CAV and the driver, have been studied in-novatively, i.e through gaze analysis. Situations of potential danger, characterized by the braking of the vehicle that precedes the car with the driver equipped with the eye tracker tool, have been recreated, considering the influence of the driver’s ACC experience. Results statistically confirmed that with the ACC switched on the reaction times are greater than manual driving (2.4/3.8 sec); this can lead to a reduction in road safety, further motivated by the rapid decrease in speed. The interpolation between automated and human data, finally, has allowed the detection of some criticalities of the system that are fundamental in order to reach the second level of automation.

Fog, haze, or smoke are usual atmospheric phenomena that dramatically compromise the overall visibility of any scene, critically affecting features such as illumination, contrast, and contour detection of objects. The decrease in visibility compromises the performance of computer vision algorithms such as pattern recognition and segmentation, some of them very relevant for decision-making for the security or autonomous vehicle industries. Several dehazing methods have been proposed, however, to the best of our knowledge, all proposed metrics compare the defogged image to its ground truth for evaluation of the defogging algorithms, or need to estimate parameters through physical models. This fact hinders progress in the field as obtaining proper ground truth images is costly and time-consuming, and physical parameters greatly depend on the scene conditions. This paper aims to tackle this issue by proposing a contour-based metric for image defogging evaluation that does not need a ground truth image. The proposed metric only requires the original hazy RGB image and the RGB image after the defogging procedure. A comparison of the proposed metric with metrics currently used in the NTIRE 2018 defogging challenge is performed to prove its effectiveness in a general situation, showing comparable results to conventional metrics.

This paper concerns a new methodology for accuracy assessment of global positioning system verified experimentally with LiDAR (Light Detection and Ranging) data alignment at continent scale for autonomous driving safety analysis. Accuracy of GPS (Global Positioning System) positioning of an autonomous driving vehicle within a lane on the road is one of the key safety considerations. Safety is addressed as a geometry of the problem, where the aim is to maintain knowledge that the vehicle (its bounding box) is within its lane. Accuracy of GPS positioning is checked by comparing it with mobile mapping tracks in the recorded high definition source. The aim of the comparison is to see if the GPS positioning remains accurate up to the dimensions of the lane where the vehicle is driving. For this reason, a new methodology is proposed. Methodology is composed of six elements: 1) Mobile mapping system minimal setup, 2) Global positioning data processing, 3) LiDAR data processing, 4) Alignment algorithm, 5) Accuracy assessment confirmation and 6) Autonomous driving safety analysis. The research challenge is to assess positioning accuracy of moving cars taking into account the constraints of the coverage of limited access highways in the United States of America. The available coverage limits the possibility of repeatable measurements and introduces an important challenge being the lack the ground truth data. State-of-the-art methods are not applicable for this particular application, therefore a novel approach is proposed. The method is to align all the available LiDAR car trajectories to confirm the GNSS+INS (Global Navigation Satellite System + Inertial Navigation System) accuracy. For this reason, the use of LiDAR metric measurements for data alignment implemented using SLAM (Simultaneous Localization and Mapping) was investigated, assuring no systematic drift by applying GNSS+INS constraints. SLAM implementation used state-of-the-art observation equations and the Weighted Non-Linear Least Square optimization technique that enables integration of the required constraints. The methodology was verified experimentally using arbitrarily chosen measurement instruments (NovAtel GNSS+INS, LiDAR Velodyne HDL32) mounted onto mobile mapping systems. The accuracy was assessed and confirmed by the alignment of 32785 trajectories with total length of 1,159,956.9~km and of total $186.4*10^{9}$~optimized parameters (six degrees of freedom of poses) that cover the United States region in the 2016--2019 period. It is demonstrated that the alignment improves the trajectories, thus final map is consistent. The proposed methodology extends the existing methods of global positioning system accuracy assessment focusing on realistic environmental and driving conditions. The impact of global positioning system accuracy on autonomous car safety is discussed. It is shown that 99\% of the assessed data satisfies the safety requirements (driving within lanes of 3.6~m) for Mid-Size (width 1.85~m, length 4.87~m) vehicle and 95\% for 6-Wheel Pickup (width 2.03--2.43~m, length 5.32--6.76~m). The conclusion is that this methodology has great potential for global positioning accuracy assessment at global scale for autonomous driving applications. LiDAR data alignment is introduced as a novel approach to GNSS+INS accuracy confirmation. Further research is needed to solve the identified challenges.

Considering the significant advancements in autonomous vehicle technology, research in this field is of interest to researchers. To drive vehicles autonomously, controlling steer angle, gas hatch, and brakes need to be learned. The behavioral cloning method is used to imitate humans’ driving behavior. We created a dataset of driving in different routes and conditions and using the designed model, the output used for controlling the vehicle is obtained. In this paper, the Learning of Self-driving Vehicles Based on Real Driving Behavior Using Deep Neural Network Techniques (LSV-DNN) is proposed. We designed a convolutional network which uses the real driving data obtained through the vehicle’s camera and computer. The response of the driver is during driving is recorded in different situations and by converting the real driver’s driving video to images and transferring the data to an excel file, obstacle detection is carried out with the best accuracy and speed using the Yolo algorithm version 3. This way, the network learns the response of the driver to obstacles in different locations and the network is trained with the Yolo algorithm version 3 and the output of obstacle detection. Then, it outputs the steer angle and amount of brake, gas, and vehicle acceleration. The LSV-DNN is evaluated here via extensive simulations carried out in Python and TensorFlow environment. We evaluated the network error using the loss function. By comparing other methods which were conducted on the simulator’s data, we obtained good performance results for the designed network on the data from KITTI benchmark, the data collected using a private vehicle, and the data we collected.

In the field of autonomous vehicles, lane detection and control plays an important role. In autonomous driving the vehicle has to follow the path to avoid the collision. A deep learning technique is used to detect the curved path in autonomous vehicles. In this paper a customized lane detection algorithm was implemented to detect the curvature of the lane. A ground truth labelling tool box for deep learning is used to detect the curved path in autonomous vehicle. By mapping point to point in each frame 80-90% computing efficiency and accuracy is achieved in detecting path.

Autonomous driving vehicles rely on sensors for the robust perception of surroundings. Such vehicles are equipped with multiple perceptive sensors with a high level of redundancy to ensure safety and reliability in any driving condition. However, multi-sensor, such as camera, LiDAR and radar, systems bring up the requirements related to sensor calibration and synchronization, which are the fundamental blocks of any autonomous system. On the other hand, sensor fusion and integration have become important aspects of autonomous driving research and directly determine the efficiency and accuracy of advanced functions such as object detection and path planning. Classical model-based estimation and data-driven models are two mainstream approaches to achieving such integration. Most recent research is shifting to the latter, showing high robustness in real-world applications but requiring large quantities of data to be collected, synchronized, and properly categorized. To generalize the implementation of the multi-sensor perceptive system, we introduce an end-to-end generic sensor dataset collection framework that includes both hardware deploying solutions and sensor fusion algorithms. The framework prototype integrates a diverse set of sensors, such as cameras, LiDAR, and radar. Furthermore, we present a universal toolbox to calibrate and synchronize three types of sensors based on their characteristics. The framework also includes the fusion algorithms, which utilize the merits of three sensors , namely, camera, LiDAR and radar, and fuse their sensory information in a manner that is helpful for object detection and tracking research. The generality of this framework makes it applicable in any robotic or autonomous applications, also suitable for quick and large-scale practical deployment.

For the emerging autonomous swarm technology, from the perspective of systems science and systems engineering, there must be some novel elements and methods to aggregate multiple systems into a group, which distinguish with the general components with specific functions, and we expect to provide the presentation of their existence in the swarm development processes. The inspiration of our methodology origins from the integration of swarm ontology, multi-paradigm modeling, multi-agent system, cyber-physical system, etc. Therefore, we choose the model-driven technology as a framework to acquire an approach of model representation across the multiple levels of abstraction and composition. The autonomous strategic mechanism is defined and formed in parallel with ConOps analysis and systems design, so as to effectively solve the cognitive problem of emergence caused by the nonlinear causation among individual and whole behaviors. This approach highlights to use the MBSE processes and their artifacts to embed the meso mechanism to integrate the operational and the functional, and which means to connect the macro and micro aspects in formalism and so to become a whole with its expected goals, and then to verify and validate within a L-V-C simulation environment.

Autonomous systems and intelligent machines are involved in almost all areas of human activity and they are now more and more present in our everyday life. The reason for this extensive use certainly resides in all the benefits these machines offer to the users. In experimental settings, numerous studies have demonstrated the positive effects that the introduction of autonomous systems have on human decision-making and performance. However, studies have shown in addition that the introduction of these systems can have important negative effects as well. Considering that autonomous systems are now introduced in sensitive domains like the military or medicine, we need more than ever a comprehensive understanding of the effects they cause on human performance and decision-making, and particularly in tasks and contexts with a social or moral dimension. The aim of this narrative review is threefold. First, we will provide an overview of the main effects on a human agent’s decision-making and performance produced by the introduction of autonomous systems. Second, we will review the conditions identified as underlying factors of these effects, and see how current models of human – autonomous systems interaction integrate those conditions. Third, we will conclude this review by highlighting new directions for future investigations.

Object segmentation is still considered a challenging problem in autonomous driving, particularly in consideration of real world conditions. Following this line of research, this paper approaches the problem of object segmentation using LiDAR-camera fusion and semi-supervised learning implemented in a fully-convolutional neural network. Our method is tested on real-world data acquired using our custom vehicle iseAuto shuttle. The data include all-weather scenarios, featuring night and rainy weather. In this work, it is shown that LiDAR-camera fusion with only a few annotated scenarios and semi-supervised learning, it is possible to achieve robust performance on real-world data in a multi-class object segmentation problem. The performance of our algorithm is measured in terms of intersection over union, precision, recall and area-under-the-curve average precision. Our network achieves 82% IoU in vehicle detection in day fair scenarios and 64% IoU in vehicle segmentation in night rain scenarios.

To validate the accuracy and reliability of onboard sensors for object detection and localization in driver assistance, as well as autonomous driving applications under realistic conditions (indoors and outdoors), a novel tracking system is presented. This tracking system is developed to determine the position and orientation of a slow-moving vehicle (e.g. car during parking maneuvers), independent of the onboard sensors, during test maneuvers within a reference environment. One requirement is a 6 degree of freedom (DoF) pose with a position uncertainty below 5 mm (3σ), an orientation uncertainty below 0.3° (3σ) at a frequency higher than 20 Hz, and a latency smaller than 500 ms. To compare the results from the reference system with the vehicle’s onboard system, a synchronization via Precision Time Protocol (PTP) and a system interoperability to Robot Operating System (ROS) is implemented. The developed system combines motion capture cameras mounted in a 360° panorama view set-up on the vehicle with robotic total stations. A point cloud of the test site serves as a digital twin of the environment, in which the movement of the vehicle is simulated. Results have shown that the fused measurements of these sensors complement each other, so that the accuracy requirements for the 6 DoF pose can be met, while allowing a flexible installation in different environments.

Autonomous weapons systems (AWS), sometimes referred to as “killer robots”, are receiving evermore attention, both in public discourse as well as by scholars and policymakers. Much of this interest is connected with emerging ethical and legal problems linked to increasing autonomy in weapons systems, but there is a general underappreciation for the ways in which existing law might impact on these new technologies. In this paper, we argue that as AWS become more sophisticated and increasingly more capable than flesh-and-blood soldiers, it will increasingly be the case that such soldiers are “in the power” of those AWS which fight against them. This implies that such soldiers ought to be considered hors de combat, and not targeted. In arguing for this point, we draw out a broader conclusion regarding hors de combat status, namely that it must be viewed contextually, with close reference to the capabilities of combatants on both sides of any discreet engagement. Given this point, and the fact that AWS may come in many shapes and sizes, and can be made for many different missions, we argue that each particular AWS will likely need its own standard for when enemy soldiers are deemed hors de combat. We conclude by examining how these nuanced views of hors de combat status might impact on meaningful human control of AWS.

The important characteristic that could assist in autonomous navigation is the ability of a mobile robot to concurrently construct a map for an unknown environment and localize itself within the same environment. This computational problem is known as Simultaneous Localization and Mapping (SLAM). In literature, researchers have studied this approach extensively and have proposed a lot of improvement towards it. More so, we are experiencing a steady transition of this technology to industries. However, there are still setbacks limiting the full acceptance of this technology even though the research had been conducted over the last 30 years. Thus, to determine the problems facing SLAM, this paper conducted a review on various foundation and recent SLAM algorithms. Challenges and open issues alongside the research direction for this area were discussed. However, towards addressing the problem discussed, a novel SLAM technique will be proposed.

This article presents a state-of-the-art literature review to understand people’s perceptions and opinions of Autonomous Vehicles (AVs) and the factors that influence AV adoption. A strategic literature search was conducted to select articles for this review. Most of the articles were published within the last five years and they used a household questionnaire survey to collect data. Mostly, they used statistical and econometric methods to evaluate the factors that affect people’s intentions to adopt AVs. The results show that psychological factors often appear as the most important internal factors of people’s willingness to adopt AVs. Additionally, other internal factors such as the socioeconomic profile of individuals and their household, and knowledge and familiarity with AV technologies would affect AV adoption tendencies. User attributes also indirectly affect AV adoption by influencing the psychological factors of users. We identify several critical external factors such as opportunities (e.g., safety and security, low congestion, energy use) and challenges (e.g., system failure, privacy breach, and legal issues), while another influential group includes transportation factors (e.g., travel mode, distance, and time), urban form (e.g., urban/rural, density, land use diversity), affinity to new technology, and the institutional regulatory environment. We discuss some recommendations for policy makers, auto industries, and private stakeholders to formulate policies and strategies to increase market share of AVs. Finally, we identify some limitations of previous studies and provide a blueprint for future research on AV adoption.

The use of digital twins for the development of Autonomous Maritime Surface Vessels (AMSVs) has enormous potential to resolve the increasing need for water-based navigation and safety at the seas. Aiming at the problem of lack of broad and integrated digital twin implementations with live data along with the absence of a digital twin-driven framework for AMSV design and development, an application framework for the development of a fully autonomous vessel using an integrated digital twin in a 3D simulation environment has been presented. Our framework has four layers to ensure that the simulation and the real-world boat as well as the environment are as close as possible. Åboat, an experimental research platform for maritime automation and autonomous surface ship applications, equipped with two trolling electric motors, cameras, LiDARs, IMU and GPS has been used as the case study to provide a proof of concept. Åboat and its sensors, alongwith the environment have been replicated in a 3D simulation environment. Using the proposed application framework, we develop obstacle detection and path planning systems based on machine learning which leverage live data from a 3D simulation environment to mirror the complex dynamics of the real world.

With the current technological transformation in the automotive industry, autonomous vehicles are getting closer to the Society of Automative Engineers (SAE) automation level 5. This level corresponds to the full vehicle automation, where the driving system autonomously monitors and navigates the environment. With SAE-level 5, the concept of a Shared Autonomous Vehicle (SAV) will soon become a reality and mainstream. The main purpose of an SAV is to allow unrelated passengers to share an autonomous vehicle without a driver/moderator inside the shared space. However, to ensure their safety and well-being until they reach their final destination, it is required an active monitoring of all passengers. In this context, this article presents a microphone-based sensor system that is able to localize sound events inside an SAV. The solution is composed of a Micro-Electro-Mechanical System (MEMS) microphone array with a circular geometry connected to an embedded processing platform that resorts to Field-Programmable Gate Array (FPGA) technology to successfully process in hardware the sound localization algorithms.

This work aims to develop an autonomous system for the unmanned aerial vehicle (UAV) to land on a moving platform such as the automobile or marine vessels, providing a promising solution for a long-endurance flight operation, a large mission coverage range, and a convenient recharging ground station. Different from most state-of-the-art UAV landing frameworks which rely on UAV’s onboard computers and sensors, the proposed system fully depends on the computation unit situated on the ground vehicle/marine vessel to serve as a landing guidance system. Such novel configuration can therefore lighten the burden of the UAV and computation power on the ground vehicle/marine vessel could be enhanced. In particular, we exploit a sensor fusion-based algorithm for the guidance system to perform UAV localization, whilst a control method based upon trajectory optimization is integrated. Indoor and outdoor experiments are conducted and the result shows that a precise autonomous landing on a 43 X 43 cm platform could be performed.

As Automated Driving Systems (ADS) technology gets assimilated into the market, the driver’s obligation will be changed to a supervisory role. A key point to consider is the driver’s engagement in the secondary task to maintain the driver/user in the control loop. The paper’s objective is to monitor driver engagement with a game and identify any impacts the task has on hazard recognition. We designed a driving simulation using Unity3D and incorporated three tasks: No-task, AR-Video, and AR-Game tasks. The driver engaged in an AR object interception game while monitoring the road for threatening road scenarios. From the results, there was less than 1 second difference between the means of gaming task (mean = 2.55s, std = 0.1002s) to no-task (mean = 2.55s, std = 0.1002s). Game scoring followed three profiles/phases: learning, saturation, and decline profile. From the profiles, it is possible to quantify/infer drivers’ engagement with the game task. The paper proposes alternative monitoring that has utility, i.e., entertaining the user. Further experiments AR-Game focusing on real-world car environment will be performed to confirm the performance following the recommendations derived from the current test.

The market for autonomous vehicles (AV) is expected to experience significant growth over the coming decades and to revolutionize the future of transportation and mobility. The AV is a vehicle that is capable of perceiving its environment and perform driving tasks safely and efficiently with little or no human intervention and is anticipated to eventually replace conventional vehicles. Self-driving vehicles employ various sensors to sense and perceive their surroundings and, also rely on advances in 5G communication technology to achieve this objective. Sensors are fundamental to the perception of surroundings and the development of sensor technologies associated with AVs has advanced at a significant pace in recent years. Despite remarkable advancements, sensors can still fail to operate as required, due to for example, hardware defects, noise and environment conditions. Hence, it is not desirable to rely on a single sensor for any autonomous driving task. The practical approaches shown in recent research is to incorporate multiple, complementary sensors to overcome the shortcomings of individual sensors operating independently. This article reviews the technical performance and capabilities of sensors applicable to autonomous vehicles, mainly focusing on vision cameras, LiDAR and Radar sensors. The review also considers the compatibility of sensors with various software systems enabling the multi-sensor fusion approach for obstacle detection. This review article concludes by highlighting some of the challenges and possible future research directions.

The current study investigated the use of two-dimensional spatial distribution mapping representing the chlorophyll-a level in a river generated via an unmanned aerial vehicle (UAV) and an unmanned surface vehicle (USV). A domestically developed UAV (Remo-M, Uconsystem Inc., Korea) and a USV developed by our research team were used to collect data from the Nae Seong stream in Korea. An adaptation of the “Data Cleaner” tool was developed and used for USV data processing and analysis. The operation of the autonomous USV was successful. Four previously described indices for quantifying algal blooms in rivers were utilized to create chlorophyll-a images, the normalized difference vegetation index (NDVI), the normalized green red difference index, the green normalized difference vegetation index (GNDVI), and the normalized difference red edge index. The suitability of the linear regression analysis of the correlation between the spectral indices obtained using the UAV and the in situ chlorophyll-a data obtained using the USV was evaluated with the coefficient of determination (R2) at a significance level of p &lt; 0.001. In field application and correlational analysis the NDVI was strongly correlated with chlorophyll-a (R2 = 0.88, p < 0.001), and the GNDVI was moderately correlated with chlorophyll-a (R2 = 0.74, p < 0.001). The map of chlorophyll-a was successfully quantified using the UAV and USV hybrid platforms.

Visual-inertial integrated navigation system (VINS) has been extensively studied over the past decades to provide accurate and low-cost positioning solutions for autonomous systems. Satisfactory performance can be obtained in an ideal scenario with sufficient and static environment features. However, there are usually numerous dynamic objects in deep urban areas, and these moving objects can severely distort the feature tracking process which is fatal to the feature-based VINS. The well-known method mitigates the effects of dynamic objects is to detect the vehicles using deep neural networks and remove the features belongs to the surrounding vehicle. However, excessive exclusion of features can severely distort the geometry of feature distribution, leading to limited visual measurements. Instead of directly eliminating the features from dynamic objects, this paper proposes to adopt the visual measurement model based on the quality of feature tracking to improve the performance of VINS. Firstly, a self-tuning covariance estimation approach is proposed to model the uncertainty of each feature measurements by integrating two parts: 1) the geometry of feature distribution (GFD), 2) the quality of feature tracking. Secondly, an adaptive M-estimator is proposed to correct the measurement residual model to further mitigate the impacts of outlier measurements, such as the dynamic features. Different from the conventional M-estimator, the proposed method effectively alleviates the reliance of excessive parameterization of M-estimator. Experiments are conducted in a typical urban area of Hong Kong with numerous dynamic objects, and the results show that the proposed method could effectively mitigate the effects of dynamic objects and improved accuracy of VINS is obtained when compared with the conventional method.

Autonomous aerial refueling technology is an effective solution to extend flight duration of unmanned aerial vehicles, and also a great challenge due to its high risk. For autonomous probe-and-drogue refueling tasks, relative navigation to provide relative position between the receiver aircraft and the refueling drogue is the first and essential step, and vision-based method is the most frequently used. A new monocular vision navigation sensor with image processing strategy consisting of the drogue detection method and the tracking method is developed for autonomous aerial refueling in this paper. In the drogue detection method, thresholding and mathematical morphology method are adopted to eliminate image interference, and contours extraction method is applied to obtain all contours, which are then subsequently checked to achieve target contour of drogue. In the tracking method, a rectangle of interest (ROI) of current frame image is determined by positioning results of last frame, and then processed by the previous drogue detection method. Finally, the proposed image processing strategy in monocular vision navigation sensor is validated using real flight images, which are captured from an autonomous aerial refueling testbed using a micro six-rotor aircraft as receiver aircraft.

In this paper we consider a lattice dynamical system generated by a non-autonomous parabolic equation modeling suspension flows. We prove the existence of uniform attractor for this system.

The accessibility of public transportation is also known as the last mile problem, and it is one of the main obstacles that affect travelers to choose public transport. Although autonomous vehicles (AVs) have made much progress, they have not been officially put into commercial use. This paper adopts stated preference experiments to explore the impact of shared AVs on train trips’ last-mile travel behavior and takes Wuhan as an example for case analysis. First of all, this paper establishes a structural equation model (SEM) based on the theory of planned behavior to explore the latent psychological variables, including travelers’ attitudes (ATTs), subjective norms (SNs), perceived behavior control (PBC), and behavioral intention to use (BIU) toward AVs. These latent psychological variables are incorporated into the latent class (LC) logit model to establish a hybrid model to study the factors and degree of influence on the travel mode choice for the last mile of train trips. The results show that travelers have preference heterogeneity for the travel mode choice of the last mile of train trips. Through the analysis of LCs, education, career, and income significantly impact the classification of LCs. The latent psychological variables towards AVs have a significant impact on the travel behavior of respondents, but the impacts vary among different segments. Elastic analysis results illustrate that a 1% increase in the travel cost for shared AV in segment 1 leads to a 7.598% decrease in the choice probability of shared AV. Respondents from different segments vary significantly in their willingness to pay, and the value of travel time for high-income groups is relatively higher.

AVs suffer reduced maneuverability and performance due to the degradation in sensor performances in fog. Such degradation causes significant object detection errors essential for AVs' safety-critical conditions. For instance, YOLOv5 performs significantly well under favorable weather but suffers miss detections and false positives due to atmospheric scattering caused by fog particles. Existing deep object detection techniques often exhibit a high degree of accuracy. The drawback is being sluggish at object detection in fog. Object detection methods with fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persist. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar's object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image on the camera image. Using the attention mechanism, we emphasized and improved important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our result shows that the proposed method significantly enhances the detection of distant and small objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed with an accuracy of 0.849 at 69 fps.

Autonomous vehicles (AVs) may not only reduce parking demand, but also free up on-street parking spaces. From the perspective of bus priority, converting on-street parking lots into dedicated bus lanes can both ensure bus priority and accommodate non-bus traffic, helping to reduce congestion and pollution. In order to study the impact of conversion of on-street parking lots to bus lanes on traffic flow, a microscopic simulation framework based on VISSIM is proposed in this paper. Data was collected using the floating car method and video recording method to quantify the factors affecting traffic flow due to the conversion of on-street parking. The VISSIM simulation model was then calibrated. According to the proportion of the on-street parking lots into a bus lane, the on-street parking lots conversion simulation model of different scenarios was established, and the influence of different on-street parking lots conversion ratio on traffic efficiency and pollution emission was quantitatively analyzed. Finally, the optimization method based on bus lane network connectivity is discussed. The results indicate that: When the on-street parking lots conversion ratio is approximately 100%, bus speed increases by 21.03%, bus delays decrease by 14.27%, and bus parking instances decrease by 11.31%. Total emissions are negatively correlated with vehicle speed. As the conversion rate of on-street parking increases, the emissions of road segments and the entire road network gradually decrease. At a conversion ratio of 100%, the average total emissions for road segments have the highest reduction rate, decreasing by 4.12%. At a conversion ratio of 50%, the average emission total for the road network shows the largest reduction, falling by 2.88%.

The capabilities of autonomous mobile robotic systems have been steadily improving due to recent advancements in computer science, engineering, and related disciplines such as cognitive science. In controlled environments, autonomous robots have been able to achieve relatively high levels of autonomy. In more unstructured environments, however, the realisation of autonomous mobile robots remains challenging due to limitations in the robots’ external environment understanding. Many autonomous mobile robots use classical, learning-based or hybrid approaches for navigation. The classical navigation approach typically includes robot perception, localisation, environmental mapping, path planning and motion control stages. More recent learning-based methods may replace the complete navigation pipeline or selected stages of the classical approach. For effective deployment, autonomous robots need to be able to understand their external environments at a sophisticated level according to their intended applications. Therefore, in addition to robot perception, scene analysis and higher-level scene understanding (e.g., traversable/non-traversable, and rough or smooth terrain) are required for autonomous robot navigation in unstructured outdoor environments. A wide number of alternative approaches have been proposed in recent years to attempt to address these scene understanding requirements. This paper provides a comprehensive review and critical analysis of these methods in the context of their applications to the problems of robot perception and scene understanding in unstructured environments, and the related problems of localisation, environment mapping and path planning. State-of-the-art sensor fusion methods and multimodal scene understanding approaches are also discussed and evaluated within this context. The paper concludes with an in-depth discussion regarding the current state of the autonomous ground robot navigation challenge in unstructured outdoor environments and the most promising future research directions to overcome these challenges.

The paper presents the measurement campaign carried out on a real-world motorway stretch of Hungary with the participation of both industrial and academic partners from Austria and Hungary. The measurement included vehicle based as well as infrastructure based sensor data. The obtained results will be extremely useful for future automotive R&amp;D activities due to the available ground truth for static and dynamic content. The aim of the measurement campaign was twofold. On the one hand, road geometry was mapped with high precision in order to build Ultra High Definition (UHD) map of the test road. On the other hand, the vehicles - equipped with differential Global Navigation Satellite Systems (GNSS) for ground truth localization - carried out special test scenarios while collecting detailed data using different sensors. All test runs were recorded by both vehicles and infrastructure. As a complementary task, the available 5G network was monitored and tested. The paper also showcases application examples based on the measurement campaign data, in which the added value of having access to the ground truth labeling and the created UHD map of the motorway section becomes apparent. In order to present our work transparently, a part of the measured data have been shared openly such that interested automotive as well as academic parties may use it for their own purposes.

Autonomous driving systems are increasingly becoming a necessary trend towards building smart cities of the future. Numerous proposals have been presented in recent years to tackle particular aspects of the working pipeline towards creating a functional end-to-end system, such as object detection, tracking, path planning, sentiment or intent detection. Nevertheless, few efforts have been made to systematically compile all of these systems into a single proposal that effectively considers the real challenges these systems will have on the road, such as real-time computation, hardware capabilities, etc. This paper has reviewed various techniques towards proposing our own end-to-end autonomous vehicle system, considering the latest state on the art on computer vision, DSs, path planning, and parallelization.

This paper presents control algorithms enabling autonomous heterogeneous trucks to drive in platoons. Heterogeneous trucks imply that the hardware information (e.g., truck length, break, accelerator, or engine) of a truck may be distinct from that of another truck. We define a platoon as a collection of trucks where a manually driven truck (leader truck) is followed by several automatically controlled following trucks. The proposed approach is to make every autonomous truck keep following the leader's trajectory while maintaining a designated distance from its predecessor truck. As far as we know, this paper is unique in developing both lateral maneuver and speed control considering a platoon of heterogeneous trucks. The efficiency of the proposed approach is verified using simulations.

This study reports on empirical findings of participatory design workshops for the development of a supportive user experience design system in the automotive. Identifying and addressing this area with traditional research methods is problematic due to the different UX design perspectives that might be conflicting and the related automotive domain limitations. To help resolve this problem, we conducted research with 12 User Experience (UX) designers through individual participatory prototyping activities to gain insights on their explicit, observable, tacit and latent needs. These activities allowed us to explore their motivation to use different technologies; the system's architecture; detailed features of interactivity and describe user needs including Efficiency, Effectiveness, Engagement, Naturalness, Ease of Use, Information retrieval, Self-Image awareness, Politeness, and Flexibility. Our analysis led us to design implications that translate participants' needs into UX design goals, informing practitioners on how to develop relevant systems further.

In autonomous driving systems, high-speed and real-time image processing, along with object recognition, are crucial technologies. This paper builds upon the research achievements in in-dustrial item sorting systems and proposes an object recognition and sorting system for auton-omous driving. In industrial sorting lines, goods sorting robots often need to work at high speeds to efficiently sort large volumes of items. This poses a challenge to the robot's real-time vision and sorting capabilities, making it both practical and economically viable to implement a real-time and low-cost sorting system in a real-world industrial sorting line. Existing sorting systems have limitations such as high cost, high computing resource consumption, and high power consump-tion. These issues lead to the fact that existing sorting systems are typically used only in large industrial plants. In this paper, we design a high-speed, low-cost, low-resource-consumption FPGA (Field-Programmable Gate Array) based item sorting system that achieves similar perfor-mance to current mainstream sorting systems at a lower cost and consumption than existing sorting systems. The recognition part employs a morphological recognition method, which segments the image using a frame difference algorithm and then extracts the color and shape features of the items. To handle sorting, a six-degree-of-freedom robotic arm is introduced in the sorting segment. The improved cubic B-spline interpolation algorithm is employed to plan the motion trajectory and consequently control the robotic arm to execute the corresponding actions. Through a series of experiments, this system achieves an average recognition delay of 25.26ms, ensures smooth operation of the gripping motion trajectory, minimizes resource consumption, and reduces implementation costs.

The vast majority of autonomous driving systems are limited to applications on roads with clear lane markings and are implemented using commercial grade sensing systems coupled with specialized graphic accelerator hardware. This research reviews an alternative approach for autonomously steering vehicles that eliminates the dependency on road markings and specialized hardware. A combination of machine vision, machine learning and artificial intelligence based on popular pre-trained Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) was used to drive a vehicle along roads lacking lane markings (unmarked roads). The team developed and tested this approach on the ACTor (Autonomous Camus TranspORt) vehicle - an autonomous vehicle development and research platform coupled with a low-cost webcam based sensing system and minimal computational resources. The proposed solution was evaluated on real-world roads and varying environmental conditions. It was found that this solution may be used to successfully navigate unmarked roads autonomously with acceptable road following behavior.

The presence of fog in the background can prevent small and distant objects from being detected, let alone tracked. Under safety-critical conditions, multi-object tracking models require faster-tracking speed while maintaining high object-tracking accuracy. The original DeepSORT algorithm used YOLOv4 for the detection phase, and a simple neural network for deep appearance descriptor. Consequently, the feature map generated loses relevant details about the track being matched with a given detection in fog. Targets with a high degree of appearance similarity on the detection frame are more likely to be mismatched, resulting in identity switches or track failures in heavy fog. We propose an improved multi-object tracking model based on the DeepSORT algorithm to im-prove tracking accuracy and speed under foggy weather conditions. First, we employed our camera-radar fusion network (CR-YOLOnet) in the detection phase for faster and more accurate object detection. We proposed an appearance feature network to replace the basic convolutional neural network. We incorporated GhostNet to take the place of the traditional convolutional layers to generate more features and reduce computational complexities and cost. We adopted a segmentation module and fed the semantic labels of the corresponding input frame to add rich semantic information to the low-level appearance feature maps. Our proposed method outperformed YOLOv5 + DeepSORT with a 35.15% increase in multi-object tracking accuracy, a 32.65% increase in multi-object tracking precision, the speed increased by 37.56%, and identity switches decreased by 46.81%.

In the era of electrification and artificial intelligence, direct current motors are widely utilized with numerous innovative adaptive and learning methods. Traditional methods utilize model-based algebraic techniques with system identification, such as recursive least squares, extended least squares, and autoregressive moving averages. The new method known as deterministic artificial intelligence asserts physical-based process dynamics to achieve target trajectory tracking. There are two common autonomous trajectory generation algorithms: sinusoidal function and Pontryagin's based generation algorithm. This thesis aims to simulate model-following and deterministic artificial intelligence methods using sinusoidal and Pontryagin's methods and compare their performance difference when following challenging step function slew maneuver.

This paper aims at computing feasible control strategies and the corresponding feasible state trajectories to drive an autonomous rear-axle bicycle robot from a given initial state to a final state such that the total running cost is minimized. Pontryagin’s Minimum Principle is applied and derives the optimality conditions from which the feasible control functions, expressed as functions of state and costate variables, are substituted into the combined state-costate system to obtain a new free-control state-costate nonlinear system of ordinary differential equations. A computer program was written in Scilab to solve the combined state-costate system and obtain the feasible state functions, the feasible costate functions and the feasible control functions. Associated Computational Simulations were provided to show the effectiveness and the reliability of the approach.

This article addresses the problem of formation control of a quadrotor and one (or more) marine vehicles operating at the surface of the water with the end goal of encircling the boundary of a chemical spill, enabling such vehicles to carry and release chemical dispersants used during ocean cleanup missions to break-up oil molecules. Firstly, the mathematical models of the Medusa class of marine robots and quadrotor aircrafts are introduced, followed by the design of single vehicle motion controllers that allow these vehicles to follow a parameterized path individually using Lyapunov based techniques. At a second stage, a distributed controller using event triggered communications is introduced, enabling the vehicles to perform cooperative path following missions according to a pre-defined geometric formation. In the next step, a real time path planning algorithm is developed that makes use of a camera sensor, installed on-board the quadrotor. This sensor enables the detection in the image of which pixels encode parts of a chemical spill boundary and use them to generate and update in real time a set of smooth B-spline based paths for all the vehicles to follow cooperatively. The performance of the complete system is evaluated by resorting to 3-D simulation software, making it possible to simulate visually a chemical spill. Results from real water trials are also provided for parts of the system, where two Medusa vehicles are required to perform a static lawn-mowing path following mission cooperatively at the surface of the water.

In this paper, we present a complete, flexible and safe convex-optimization-based method to solve speed planning problems over a fixed path for autonomous driving in both static and dynamic environments. Our contributions are five fold. First, we summarize the most common constraints raised in various autonomous driving scenarios as the requirements for speed planner developments and metrics to measure the capacity of existing speed planners roughly for autonomous driving. Second, we introduce a more general, flexible and complete speed planning mathematical model including all the summarized constraints compared to the state-of-the-art speed planners, which addresses limitations of existing methods and is able to provide smooth, safety-guaranteed, dynamic-feasible, and time-efficient speed profiles. Third, we emphasize comfort while guaranteeing fundamental motion safety without sacrificing the mobility of cars by treating the comfort box constraint as a semi-hard constraint in optimization via slack variables and penalty functions, which distinguishes our method from existing ones. Fourth, we demonstrate that our problem preserves convexity with the added constraints, thus global optimality of solutions is guaranteed. Fifth, we showcase how our formulation can be used in various autonomous driving scenarios by providing several challenging case studies in both static and dynamic environments. A range of numerical experiments and challenging realistic speed planning case studies have depicted that the proposed method outperforms existing speed planners for autonomous driving in terms of constraint type covered, optimality, safety, mobility and flexibility.

Automotive manufacturers and suppliers develop new vehicle systems, such as Advanced Driver Assistance Systems (ADAS), to increase traffic safety and driving comfort. ADAS are technologies that provide drivers with essential information or take over demanding driving tasks. More complex and intelligent vehicle systems are being developed toward fully autonomous and cooperative driving. Apart from the technical development challenges, training of drivers with these complex vehicle systems represents an important concern for automotive manufacturers. This paper highlights the new evolving requirements concerning the training of drivers with future complex vehicle systems. In accordance with these requirements, a new training concept is introduced, and a prototype of a training platform is implemented for utilization in future driving schools. The developed training platform has a scalable and modular architecture so that more than one driving simulator can be networked to a common driving instructor unit. The participating driving simulators provide fully immersive visualization to the drivers by utilizing head-mounted displays instead of conventional display screens and projectors. The driving instructor unit consists of a computer with a developed software tool for training session control, monitoring, and evaluation. Moreover, the driving instructor can use a head-mounted display to participate interactively within the same virtual environment of any selected driver. A simulation model of an autonomous driving system was implemented and integrated in the participating driving simulators. Using this simulation model, training sessions were conducted with the help of a group of test drivers and professional driving instructors to prove the validity of the developed concept and show the usability of the implemented training platform.

In this paper, modelling, simulation and verification of multi-agent manufacturing system with application of bio-inspired techniques are addressed. To this end, the new solution of abstract architecture for control and coordination decentralized systems - CODESA is suggested. Centralized architecture suffers from various problems, such as rigidity, scalability, low fault-tolerance or very limited flexibility, agility, energy efficiency and productivity. Prime is concrete application of CODESA in manufacturing domain. The undesirable characteristics of emergent behaviour are the problem to achieve optimization and impossibility to predict future states of the system. CODESA-Prime has been tested by simulations for automatic guided vehicle (AGV) systems guided by magnetic tape in Ella Software Platform.

The home is becoming a key location for healthcare delivery, including the use of technology driven by autonomous systems (AS) to monitor and support healthcare plans. Using the example of a smart mirror, this paper describes the outcomes of focus groups with people with multiple sclerosis (MS; n=6) and people who have had a stroke (n=15) to understand their attitudes towards the use of AS for healthcare in the home. We thematic analysis to analyse the data. The results indicate that the use of such technology depends on the level of adaptability and responsiveness to the users’ specific circumstances, including their relationships with the healthcare system. A smart mirror would need to support manual entry, responsive goal setting, effective aggregation of data sources and integration with other technology, have a range of input methods, be supportive rather than prescriptive in messaging, and give the user full control of their data. Barriers to adoption include a perceived lack of portability and practicality, lack of accessibility and inclusivity, a sense of redundancy, being overwhelmed by multiple technological devices, and a lack of trust in data sharing. These results inform the development and deployment of future health technologies based on the lived experiences of people with health conditions who require ongoing care.

In various domains such as energy, manufacturing, and maritime, cyber-physical systems (CPS) have seen increased interest. Both academia and industry have focused on the cybersecurity aspects of such systems. The assessment of cyber risks in CPS is a popular research area with many existing approaches that aim to suggest relevant methods and practices. However, few works have addressed the extensive and objective evaluation of the proposed approaches. In this paper, a standard-aligned evaluation methodology is presented and empirically conducted to evaluate a newly proposed cyber risk assessment approach for CPS. The approach, which is called FMECA-ATT&CK is based on Failure Mode, Effects & Criticality Analysis (FMECA) risk assessment process and enriched with the semantics and encoded knowledge in the Adversarial Tactics, Techniques, and Common Knowledge framework (ATT&CK). Several experts were involved in conducting two risk assessment processes, FMECA-ATT\&CK and Bow-Tie, against two use cases in different application domains, particularly an autonomous passenger ship (APS) as a maritime use case and a digital substation as an energy use case. This allows for the evaluation of the approach based on a group of characteristics, namely, applicability, feasibility, accuracy, comprehensiveness, adaptability, scalability, and usability. The results highlight the positive utility of FMECA-ATT&CK in model-based, design-level, and component-level cyber risk assessment of CPS with several identified directions for improvements. Moreover, the standard-aligned evaluation method and the evaluation characteristics have been demonstrated as enablers for the thorough evaluation of cyber risk assessment methods.

The recent advancements in the field of communication have led data sharing to become an integral part of today's smart cities with the evolution of concepts such as the internet of vehicles (IoV) paradigm. As a part of IoV, Electric Vehicles (EVs) have recently gained momentum as authorities have started expanding their Low Emission Zones (LEZ) in an effort to build green cities with low carbon footprints. Energy is one of the key requirements of EVs not only to support the smooth and sustainable operation of EV itself but to also ensure connectivity between the vehicles and infrastructure with controlling devices like sensors and actuators installed within an EV. In this context, renewable energy sources (such as wind energy) dramatically play their parts in the automobile sector towards designing the energy harvesting electric vehicles (EH-EV) to pare the energy reliance on the national grid. In this article, a novel approach is presented to achieve electric generation due to vehicle mobility to support the communication primitives in electric vehicles which enables plenty of IoV use cases in the presence of surplus energy at hand. A small-scale wind turbine is designed to harness wind power for converting it into mechanical power. This power is then fed to the onboard DC generator to produce electrical energy. Furthermore, the acquired power is processed through a regulation circuitry to consequently achieve the desired power supply for the end load, i.e. the batteries installed. The suitable orientation for efficient power generation is proposed on ANSYS-based aerodynamics analysis. The voltages induced by DC generator at No-Load condition are 35V while at Full-Load 25V are generated at rated current of 6.9A, along with the generation of power at around 100W (at constant voltage) at the rated speed of 90 mph for nominal battery charging. Moreover, the acquired data can be monitored via an android application interface by using a Bluetooth module.

In emergency scenarios service vehicles must identify potential route(s) and use the best available route. However, route identification requires intelligent decision-support systems which generally use non-traditional approaches with tools characterised by flexible non-hierarchical structures. Conventional models using group decision-support systems have been applied; however, when used in smart urban environments, emergency response services have limitations in their ability to identify unobstructed paths (routes) in dynamic operating environments. In this paper we introduce a novel path planning method for autonomous vehicle control in emergency situations. The proposed model uses self-organizing maps in an integrated Spiral STC algorithm termed the: Hybrid SOM-Spiral STC model which uses hedge algebras and \emph{Kansei} evaluation in group decision-support. The proposed model has been designed to quantify qualitative factors using sensor derived data processed with human sensibilities and preferences in emergency decision support. The experimental results show that the proposed model achieves significant improvements in group decision-support under dynamic uncertainty. We posit that our novel approach holds the prospect of improvements in the provision of emergency services.

Among the possible improvements of Autonomous Emergency Braking (AEB) systems, reducing the intensity of the automatic braking process by studying the kinematics and general behavior of the pedestrian while crossing is crucial to determine the progressiveness of the braking, or replacing part of the braking process by an evasive maneuver when a collision is imminent. This paper proposes the integration of an autonomous avoidance system (Automatic Emergency Steering, AES) that acts directly on the steering system to generate an evasive maneuver and avoid a possible pedestrian collision (OPREVU-AES system), as well as the assessment of its effectiveness compared to a commercial AEB system. OPREVU and VULNEUREA are research projects in which INSIA and CEDINT have cooperated to improve driving assistance systems and the safety of pedestrians and cyclists through Virtual Reality (VR) techniques. The analysis of the kinematic and dynamic response of the OPREVU-AES system is conducted in CarSim© software. The effectiveness evaluation procedure is based on the reconstruction of a sample of road vehicle-to-pedestrian crashes (INSIA-UPM database), using the PCCrash® software, and taking as an indicator the probability of head injury severity (ISP). The results show that the AEB system would have prevented part of the collisions, especially after the incorporation of the OPREVU-AES system. In most of the cases where avoidance is not possible, a significant reduction of the ISP is achieved.

This paper develops feasible control strategies and associated system responses to bring an autonomous front-axle bicycle robot from specified initial conditions to final conditions such that a specific performance index is minimized. To solve the problem, the following approach is used: The feasible controls derived from the normal equations of optimality are substituted into the state and the costate systems and form a combined control-free state-costate system which is vectorized to enable and ease the application of a numerical method. A computer program written in Matlab computer programming language, codes a fourth-order Runge-Kutta numerical method and then solve the combined state-costate system of ordinary differential equations. The obtained results are the feasible bicycle robot trajectory, the feasible state functions, the feasible costate functions and the feasible control functions. Associated Computational Simulations are designed and provided to persuade on the effectiveness and the reliability of the approach.

Imaging lidars are one of the hottest topics in the optronics industry. The need to sense the surroundings of every autonomous vehicle has pushed forward a career to decide the final solution to be implemented. The diversity of state-of-the art approaches to the solution brings, however, a large uncertainty towards such decision. This results often in contradictory claims from different manufacturers and developers. Within this paper we intend to provide an introductory overview of the technology linked to imaging lidars for autonomous vehicles. We start with the main single-point measurement principles, and then present the different imaging strategies implemented 8 in the different solutions. An overview of the main components most frequently used in practice is also presented. Finally, a brief section on pending issues for lidar development has been included, 10 in order to discuss some of the problems which still need to be solved before an efficient final implementation.Beyond this introduction, the reader is provided with a detailed bibliography containing both relevant books and state of the art papers.

Autonomous and cooperative vehicle systems represent a key priority in the automotive realm. Networked driving simulation can be utilized as a safe, cost-effective experimental replica of real traffic environments in order to support and accelerate the development of such systems. In networked driving simulation, different independent systems collaborate to achieve a common task: multi-driver traffic scenario simulation. Yet distinct system complexity levels are necessary to fulfill the requirements of various application scenarios, such as development of vehicle systems, analysis of driving behavior, and training of drivers. With myriad alternatives of available systems and components, developers of networked driving simulation are typically confronted with high design complexity. There are no systematic approaches to date for the design of networked driving simulation in accordance with the specific requirements of the concerned application scenarios. This paper presents a novel design method for networked driving simulation. The method consists mainly of a procedure model that is accompanied by a configuration software. The procedure model includes the necessary phases for the systematic design of application-oriented platforms for networked driving simulation. The configuration software embeds supportive decision-making processes that enable developers to apply the design method and easily create different system models. The design method was validated by generating system models and developing platforms of networked driving simulation for three different application scenarios.

In modern security situations, tracking multiple human objects in real-time within challenging urban environments is a critical capability for enhancing situational awareness, minimizing response time, and increasing overall operational effectiveness. Tracking multiple entities enables informed decision-making, risk mitigation, and the safeguarding of civil-military operations to ensure safety and mission success. This paper presents a multi-modal electro-optical/infrared (EO/IR) and radio frequency (RF) fused sensing (MEIRFS) platform for real-time human object detection, recognition, classification, and tracking in challenging environments. By utilizing different sensors in a complementary manner, the robustness of the sensing system is enhanced, enabling reliable detection and recognition results across various situations. Specifically designed Radar tag and thermal tag can be used to discriminate friendly and non-friendly objects. The system incorporates deep learning-based image fusion and human object recognition and tracking (HORT) algorithms to ensure accurate situation assessment. After integrating into an all-terrain robot, multiple ground tests were conducted to verify the consistent HORT in various environments. The MEIRFS sensor system has been designed to meet the Size, Weight, Power, and Cost (SWaP-C) requirements for installation on autonomous ground and aerial vehicles.

Abstract: The Micro-Electro-Mechanical System (MEMS) LiDAR point cloud in autonomous vehicles has a large deflection range, which results in slow registration speed and poor applicability. To maximize speed, an improved NDT (Normal Distribution Transform) method that integrates point cloud density features has been proposed. First, the point cloud is reduced using a modified voxel filter and a pass-through filter. Next, the ISS (Intrinsic Shape Signature) algorithm is utilized to analyze the point cloud features and extract keypoints, the 4PCS (4-Point Congruent Sets) algorithm is then employed to calculate the initial pose under the constraints of the keypoint set to complete the coarse registration. Finally, the self-adaptive segmentation model is constructed by using KD-tree to obtain the density features of keypoints, and the NDT algorithm is combined with this model to form an SSM-NDT algorithm, which is used for fine registration. Each algorithm was compared on the autonomous vehicle dataset PandaSet and actual collected data sets, the results show that the novel method increases the speed by at least 60% and takes into account good registration accuracy and strong anti-interference.