The relative position of the orchard robot to the rows of fruit trees is an important parameter for achieving autonomous navigations. The current methods for estimating the position parameters between rows of orchard robots obtain low parameter accuracy, and to address this problem, this paper proposes a machine vision-based method for detecting the relative position of orchard robots and fruit tree rows. Firstly, the fruit tree trunk is identified based on the improved YOLOv4 model; secondly, the camera coordinates of the tree trunk are calculated from the principle of binocular camera triangulation, and the ground projection coordinates of the tree trunk are obtained through coordinate conversion; finally, the midpoints of the projection coordinates of different sides are combined and the navigation path is obtained by linear fitting with the least squares method, and the position parameters of the orchard robot are obtained through calculation. The experimental results show that the average accuracy and average recall of the improved YOLOv4 model for fruit tree trunk detection are 97.05% and 95.42%, respectively, which are 5.92 and 7.91 percentage points higher than those of the original YOLOv4 model. The average errors of heading angle and lateral deviation estimates obtained based on the method in this paper are 0.57° and 0.02 m. The method can accurately calculate heading angle and lateral deviation values at different positions between rows, and can provide a reference for autonomous visual navigation of orchard robots.

(1) Background: The social robot interaction design is critical in determining acceptance and user experience. However, few studies have systematically discussed the current focus and future research directions of social robot interaction design from a bibliometric perspective. Therefore, in order to identify the latest research progress and evolution trajectory of research hotspots in social robot interaction design over the last decade. (2) Methods: based on 2416 papers related to social robot interaction design collected in the Web of Science (WOS) database, a comprehensive review was conducted by using bibliometrics to draw a knowledge map using VOSviewer and CiteSpace in an integrated manner. (3) Conclusions: The current research hotspots of social robot interaction design mainly focus on #1the study of human-robot relationships in social robot, #2Research on the Emotional Design of Social Robot, #3research on social robot for children's psychotherapy, #4research on companion robot for elderly rehabilitation, and #5research on educational social robot. The reference co-citation identifies the classic literature that forms the basis of the current research, which provides theoretical guidance and methods for the current research. Finally, we discuss several future research directions and challenges in this field.

The development of artificial intelligence systems assumes that a machine can independently generate an algorithm of actions or a control system to solve the tasks. To do this, the machine must have a formal description of the problem and possess computational methods for solving it. The article deals with the problem of optimal control, which is the main task in the development of control systems, insofar as all systems being developed must be optimal from the point of view of a certain criterion. However, there are certain difficulties in implementing the resulting optimal control modes. The paper considers an extended formulation of the optimal control problem, which implies the creation of such systems that would have the necessary properties for its practical implementation. To solve it, an adaptive synthesized optimal control approach based on the use of numerical methods of machine learning is proposed. The method moves the control object, optimally changing the position of the stable equilibrium point in the presence of some initial position uncertainty. As a result, from all possible synthesized controls, he chooses one that is less sensitive to changes in the initial states. As an example, the optimal control problem of quadcopter with complex phase constraints is considered. To solve this problem? according to the proposed approach, the control synthesis problem is firstly solved to obtain a stable equilibrium point in the state space by a machine learning method of symbolic regression. After that optimal positions of the stable equilibrium point are searched according to source functional from the optimal control problem by particle swarm optimization algorithm. It is shown that such approach allows generating the control system automatically by computer basing on the formal statement of the problem and then directly implementing it onboard as far as they have already had a stabilization system inserted.

As a typical visual positioning system, monocular ranging is widely used in various fields. However, when the distance increases, there is a greater error. YOLOv8 network has the advantages of fast recognition speed and high accuracy. This paper proposes a method by combining YOLOv8 network recognition with a monocular ranging method to achieve target localization and grasping for the NAO robots. By establishing a visual distance error compensation model and applying it to correct the estimation results of the monocular distance measurement model, the accuracy of the NAO robot's long-distance monocular visual positioning is improved. Additionally, a grasping control strategy based on pose interpolation is proposed. Throughout, the proposed method's advantage in measurement accuracy was confirmed via experiments, and the grasping strategy has been implemented to accurately grasp the target object.

The vast majority of autonomous driving systems are limited to applications on roads with clear lane markings and are implemented using commercial grade sensing systems coupled with specialized graphic accelerator hardware. This research reviews an alternative approach for autonomously steering vehicles that eliminates the dependency on road markings and specialized hardware. A combination of machine vision, machine learning and artificial intelligence based on popular pre-trained Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) was used to drive a vehicle along roads lacking lane markings (unmarked roads). The team developed and tested this approach on the ACTor (Autonomous Camus TranspORt) vehicle - an autonomous vehicle development and research platform coupled with a low-cost webcam based sensing system and minimal computational resources. The proposed solution was evaluated on real-world roads and varying environmental conditions. It was found that this solution may be used to successfully navigate unmarked roads autonomously with acceptable road following behavior.

High-rise building fires pose a serious threat to the lives and property safety of the people. The lack of reliable and accurate positioning means is one of the main difficulties faced by rescue. In the absence of prior knowledge of the high-rise building fire environment, the coverage deployment of mobile base stations is a challenging problem that has not received much attention in the literature. This paper studies the problem of autonomous optimal deployment of base stations in high-rise building fire environment based on UAV group. A novel problem formulation is proposed that solves the non line of sight (NLOS) positioning problem in complex unknown environment. The purpose of this paper is to realize the coverage and deployment of mobile base stations in complex and unknown fire environment. The NLOS positioning problem in the fire field environment is turned into the line of sight (LOS) positioning problem through the optimization algorithm. And there are more than three LOS base stations nearby any point in the fire field. A control law which is formulated in a mathematically precise problem statement is developed that guarantees to meet mobile base stations deployment goal and to avoid collision. Finally, positioning accuracy of our method and that of common method were compared. The simulation result showed that the positioning accuracy of simulated firefighter in the fire field environment was improved greatly.

Teachability has been extensively studied under the context of making industrial robots to be programmable and reprogrammable. However, it is only recently that the artificial intelligence (AI) research community is accelerating the research works with the objective of making humanoid robots and many other robots to be teachable under the context of using natural languages. We human beings spend many years to learn knowledge and skills despite our extraordinary mental capabilities of being teachable with the use of natural languages. Therefore, if we would like to develop human-like robots such as humanoid robots, it is inevitable for us to face the issue of making future humanoid robots to be teachable with the use of natural languages as well. In this paper, we present the key details of a top-down design for achieving a teachable mind which consists of two major processes: the first one is the process which enables humanoid robots to gain innate mental capabilities of transforming incoming signals into meaningful crisp data, and the second one is the process which enables humanoid robots to gain innate mental capabilities of undertaking incremental and deep learning with the main focus of associating conceptual labels in a natural language to meaningful crisp data. These two processes consist of the two necessary and sufficient conditions for future humanoid robots to be teachable with the use of natural languages. In addition, this paper outlines a very likely new finding underlying human brain’s neural systems as well as the obvious mathematics underlying artificial deep neural networks. These outlines provide us the strong reason to separate the study of mind from the study of brain. Hopefully, the content discussed in this paper will help the AI research community to venture into the right direction which is to make future humanoid robots, non-humanoid robots, and many other systems to achieve human-like self-intelligence at cognitive level with the use of natural languages.

In the field of robotics education, introductory courses would ideally utilize heavy industrial arms for hands-on learning. This would provide students with valuable experience in joint programming, which involves direct control of each joint motor in the arm to accomplish desired path planning and differential movements. This practice requires consideration of the physical dynamics of the arm. However, the use of heavy industrial arms has several drawbacks. They are large and expensive, require specialized maintenance, can pose safety risks, and they typically do not allow for direct control of the joint motors. One solution is to use a small, lightweight, toy-like arm. While these are cost-effective and provide direct access to the joint motors without posing safety risks, their lightweight construction means they exhibit minimal dynamic behavior, which limits their educational value. Another solution involves a robotic arm simulator that uses a virtual arm. However, a virtual arm doesn't offer the same level of hands-on engagement and excitement as a physical arm. We propose a hybrid solution that combines a small physical arm with a virtual arm. This approach provides students with the experience of working with an industrial arm, but without the associated difficulties. We demonstrate how this approach successfully improved the completion rate of joint programming assignments, offering a promising solution for practical robotics education.

Solid-state LiDAR offers multiple advantages over mechanism mechanical LiDAR, including higher durability, improved coverage ratio, and lower prices. However, solid-state LiDARs typically possess a narrow field of view, making them less suitable for odometry and mapping systems, especially for mobile autonomous systems. To address this issue, we propose a novel rotating solid-state LiDAR system that incorporates a servo motor to continuously rotate the solid-state LiDAR, expanding the horizontal field of view to 360∘. Additionally, we propose a multi-sensor fusion odometry and mapping algorithm for our developed sensory system that integrates an IMU, wheel encoder, motor encoder and the LiDAR into an iterated Kalman filter to obtain a robust odometry estimation. Through comprehensive experiments, we demonstrate the effectiveness of our proposed approach in both outdoor open environments and narrow indoor environments.

With the emergence of new VR/AR technologies, the question arises of how they can be used in human-swarm interaction. Where are the limitations and boundaries of conventional interfaces, and how can VR/AR overcome them? To find out, a user study was conducted. The subjects were able to interact with an autonomously acting swarm of drones using both a conventional desktop interface (Desktop-HSI) and a newly developed VR interface (VR-HSI).The resulting assessments are used as a basis for determining the extent to which this new technology can be applied in human-swarm interaction. The technical basis was an already tested simulation software that was expanded with a network interface to allow interacting with a drone swarm using connected HSIs (Human-Swarm Interfaces). Standardized communication was emphasized to enable the development of HSIs with different requirements. Specifically for this work, a VR-HSI was developed with Unity and a desktop-HSI with Java and their performance regarding human-swarm interaction was evaluated.

Autonomous driving vehicles rely on sensors for the robust perception of surroundings. Such vehicles are equipped with multiple perceptive sensors with a high level of redundancy to ensure safety and reliability in any driving condition. However, multi-sensor, such as camera, LiDAR and radar, systems bring up the requirements related to sensor calibration and synchronization, which are the fundamental blocks of any autonomous system. On the other hand, sensor fusion and integration have become important aspects of autonomous driving research and directly determine the efficiency and accuracy of advanced functions such as object detection and path planning. Classical model-based estimation and data-driven models are two mainstream approaches to achieving such integration. Most recent research is shifting to the latter, showing high robustness in real-world applications but requiring large quantities of data to be collected, synchronized, and properly categorized. To generalize the implementation of the multi-sensor perceptive system, we introduce an end-to-end generic sensor dataset collection framework that includes both hardware deploying solutions and sensor fusion algorithms. The framework prototype integrates a diverse set of sensors, such as cameras, LiDAR, and radar. Furthermore, we present a universal toolbox to calibrate and synchronize three types of sensors based on their characteristics. The framework also includes the fusion algorithms, which utilize the merits of three sensors , namely, camera, LiDAR and radar, and fuse their sensory information in a manner that is helpful for object detection and tracking research. The generality of this framework makes it applicable in any robotic or autonomous applications, also suitable for quick and large-scale practical deployment.

Generating localized haptic feedback on touch displays has been a challenge in recent years. In this study, we introduce a haptic interface using transparent thin-film PVDF actuators to address this issue. The transparency feature allows for mounting the actuators at any location beneath the display, enabling localized haptic feedback as the generated vibration is primarily evident on the mounting area. Two different configurations are designed, simulated and prepared to explore the effectiveness of the proposed approach. The first configuration is used to characterize the haptic interface. Modal and forced-vibration analysis are performed to identify important design characteristics based on human factor considerations. Subsequent 2AFC psychophysics experiments validate the characteristics. In the second configuration, eight actuators are attached to the touch surface in a 2x4 matrix formation and excited at different voltage amplitudes. Human experiments are conducted based on the results from corresponding forced-vibration analysis. The results show that subjects demonstrate an accuracy of 96% in identifying locations with haptic feedback when the actuators are excited with 232 Vpp. Overall, our study demonstrates the effectiveness of the haptic interface equipped with PVDF-type actuators in achieving localized haptic feedback on touch displays.

In this paper is shown the dynamic modeling and design of a passivity based controller for the RV-3SB robot. Firstly, the dynamic modeling of the of the Mitsubishi Rv-3SB robot is done by the Euler-Lagrange formulation in order to obtain a decoupled dynamic model considering the actuators orientation besides the position of this analyzed robot. It is important to remark that the dynamic model of the RV-3SB robot is done based in the kinematic model obtention in which is developed by the implementation of screw theory. Then the passivity based controller is obtained by separating the end effector variables and the actuator variables by making an appropriate coordinate transformation. The passivity based controller is obtained by selecting an appropriate storage function and by the Lyapunov theory the passivity based control law is obtained in order to drive the error variaable, which is the difference between the measured end effector position variable and the end effector desired position variable. The passivity based controller makes that the error variable reach the origin in finite time taking into consideration the dissipation properties of the proposed controller in order to stabilizes the desired end effector position. A numerical simulation experiement is performed in order to validate the theoretical results obtained in this research study. It is verified by numerical experimentation that the proposed control strategy is efficient and effective in order to drive the error variable to the origin in comparison with other modified techniques found in the literature. Finally, the appropriate discussion and conclusion of this research study are provided.

In this paper is presented the design and syntheis of a dynamic output feedback neural network controller for a non-holonomic mobile robot. First the dynamic model of a non-holonomic mobile robot is presented, in which these constraints are considered for the mathematical derivation of a feasable representation for this kind of robot. Then two control strategies are provided based on kinematic control for this kind of robot. The first control strategy is based on driftless control, this means, that considering that the velocity vector of the mobile robot is orthogonal to its restriction a dynamic output feedback and neural network controller is designed in order that the control action would be zero only when the velocity of the mobile robot is zero. The Lyapunov stability theorem is implemented in order to find a suitable control law. Then another control strategy is designed for trajectory tracking purposes, which similar to the driftless controller, a kinematic control scheme is provided but suitable to implement in more sophisticated hardware. In both control strategy a dynamic control law is provided along with a feedforward neural network controller, so in this way, by the Lyapunov theory the stability and convergence to the origin of the mobile robot position coordinates is ensured. Finally, two numerical experiment are presented in order to validate the theoretical results synthetized in this research study. Discussions and conclusions are provided in order to analyze the results found in this research study.

As the global population rapidly ages with longer life expectancy and declining birth rates, the need for healthcare services and caregivers for older adults is increasing. Current research envisions addressing this shortage by introducing domestic service robots to assist with daily activities. The successful integration of robots as domestic service providers in our lives requires them to possess efficient manipulation capabilities, provide effective physical assistance, and have adaptive control frameworks that enable them to develop social understanding during human-robot interaction. In this context, human factors, especially quantifiable ones, represent a necessary component. The objective of this paper is to conduct an unbiased review encompassing studies on human factors studied in research involving physical interactions and strong manipulation capabilities. We identified the prevalent human factors in physical human-robot interaction (pHRI), noted the factors typically addressed together and determined the frequently utilized assessment approaches. Additionally, we gathered and categorized proposed quantification approaches based on measurable data for each human factor. We also formed a map of common contexts and applications addressed in pHRI for a comprehensive understanding and easier navigation of the field. We found out that most of the studies in direct pHRI (when there is direct physical contact) focus on social behaviors with belief being the most commonly addressed human factor type. Task collaboration is moderately investigated, while physical assistance is rarely studied. In contrast, indirect pHRI (when the physical contact is mediated via a third item) studies often involve industrial settings, with physical ergonomics being the most frequently investigated human factor. More research is needed on human factors in direct and indirect physical assistance applications, including studies that combine physical social behaviors with physical assistance tasks. We also found that while the predominant approach in most studies involves the use of questionnaires as the main method of quantification, there is a recent trend that seeks to address quantification approaches based on measurable data.

Analytical mechanics is the most basic discipline. The basic principles of analytical mechanics should also be applicable to general deformed objects. However, the virtual displacement principle proposed by analytical mechanics is only applicable to particle systems and rigid body systems, but not to general deformed objects. In this paper, the generalized virtual displacement principle of general deformed objects (such as, elastic objects, plastic objects, elasto-platic objects and flexible objects etc ) is derived by the method of analytical mechanics, which is also applicable to particle systems and rigid body systems. First of all, according to the method of analytical mechanics, the external force, internal force, constraint reaction force and elastic recovery force of the deformed object system under the equilibrium state are analyzed, and the concepts of virtual displacement, ideal constraint and virtual work are introduced, and the generalized virtual displacement principle (also called generalized virtual work principle) of deformed objects is proposed; secondly, vector form, coordinate component form and generalized coordinate form of generalized virtual displacement principle of deformed object are given; thirdly, as the application of the principle, the virtual displacement principle of deformed objects in plane polar coordinate system, space cylindrical coordinate system and spherical coordinate system is given; finally, a brief conclusion is drawn. This work unifies the virtual displacement principle of elastic object, plastic, elastoplastic etc deformed object systems and rigid object systems with the basic method of analytical mechanics. It is a basic principle for dealing with the static problems of deformed objects. This work also lays a foundation for the further study of the dynamics of deformed object systems.

We propose a deep reinforcement learning based manipulator path tracking method to solve the computationally difficult and non-unique problem of manipulator path tracking methods based on inverse kinematics. By transforming the path tracking task into a sequence decision problem, our method adopts an end-to-end learning method for closed-loop control and avoids the process of finding the inverse solution. We first explored the feasibility of the deep reinforcement learning method in the path tracking of the manipulator. After verifying the feasibility, the path tracking of the multi-degree-of-freedom(multi-DOF) manipulator was realized by combining the maximum entropy deep reinforcement learning algorithm. The experimental results show that our method has a good effect on the path tracking of the manipulator, which not only avoids the process of finding the inverse kinematics solution, but also requires no dynamic model. Therefore, we believe that our method has great significance in the study of manipulator path tracking.

The Complete Coverage Path Planning (CCPP) is a key technology in the field of agricultural robot, and has great significance for improving the efficiency and quality of tillage, fertilization, harvesting and other agricultural robot operations, as well as reducing the operation energy consumption. The traditional boustrophedon or heuristic search algorithm based CCPP methods, when coping with the field with irregular boundaries, obstacles and other complex environments, still face many problems and challenges, such as large repeated work areas, multiple turns or U-turns, low operation efficiency and prone to local optimum. In order to solve the above problems, an improved-genetic-algorithm-based CCPP method was proposed in this paper, which introduces the idea of chromosome pairs and multi-points mutation to improve its global optimization ability in complex environments, reduce the repeated work areas and the number of turns and U-turns, and thereby improve the operation efficiency. The simulation and experimental results on simple regular fields showed that the proposed improved genetic algorithm-based CCPP method achieved the comparable performance with the traditional boustrophedon-based CCPP method. However, on the complex irregular fields, although the proposed CCPP method increased the number of turns by 13.76%, the area of repeated operation and the number of U-turns were decreased by 38.54% and 35.00% respectively, and saves the battery voltage by 7.82% on average compared to the boustrophedon-based CCPP method. This proved that the proposed CCPP method has strong adaptive capacity to the environment, and has practical application value in improving the efficiency and quality of agricultural machinery operations, and reducing the energy consumption.

Abstract: This study aimed to compare the effcacy of robot-assisted and manual cannula insertion in simulated big-bubble deep anterior lamellar keratoplasty (DALK). Novice surgeons with no prior experience in performing DALK were trained to perform the procedure using manual or robot-assisted techniques. The results showed that both methods could generate an airtight tunnel in the porcine cornea, and result in successful generation of a deep stromal demarcation plane representing suffcient depth reached for big-bubble generation in most cases. However, the combination of intraoperative OCT and robotic assistance received a signifcant increase in the depth of achieved detachment in non-perforated cases, comprising a mean of 89% as opposed to 85% of the cornea in manual trials. This research suggests that robot-assisted DALK may offer certain advantages over manual techniques, particularly when used in conjunction with intraoperative OCT.

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.

Children with Autism Spectrum Disorder have deficits in social interaction and expressing and understanding emotions. Many robots for children with ASD have been proposed. However, few studies were found about how to design a social robot for children with ASD. Studies reviewed employed non-experimental studies to evaluate a social robot, but the methodology to design a social robot is rare. This study proposes a design path for a social robot for emotional communi-cation for children with ASD, following User-Centered Design approach. This design path is ap-plied with a study case, evaluated with an expert group on psychologist, human-robot interaction, human-computer interaction, and parents of children with ASD. Results show than following the design path proposed to design a social robot to communication emotions for children ASD is favorable.

Robot Operating System 2 (ROS 2) is a robotic software that uses a set of Quality of Service (QoS) policies to manage the quality of robot data transmissions in a network, such as the RELIABLE and KEEP_LAST options. In ROS 2 node communication, the RELIABLE connection guarantees that all message data can be properly sent from the publisher to the subscriber. However, strict reliability is not guaranteed if the RELIABLE connection uses the KEEP_LAST option to transmit the robot data in the publish-subscribe communication. This study aims to analyze the efficiency of local cache, cache control, and QoS balancing optimization to improve ROS 2 node communication when using the RELIABLE and KEEP_LAST options to transmit multi-robot data in Aggregated Robot Processing (ARP) architecture. Our idea in local cache and cache control is to streamline the sensor data output before processing it when the sensor device produces the data with the same value in a row. Furthermore, QoS balancing optimization aims to balance the DEPTH and DEADLINE QoS configuration to determine the rates and buffer size in ROS 2 node communication. This study shows that combining local cache and QoS balancing optimization improves multi-robot data transmission and cooperation in ARP architecture.

In the paper we suggest an implementation of the non-commutative logic and apply its operators for decision-making in the group of autonomous agents. The suggested operators extend the uninorm and absorbing norm aggregators and use an additional asymmetry parameter that defines the “level of non-commutativity”. The value of this parameter is specified using the perception bias of humans measured in the experiments. The suggested operators and decision-making method are illustrated by simulated behavior of mobile robots in the group.

Urban scene point cloud pose significant challenges for registration due to its large data volume, similar scenarios and dynamic objects. In this paper, we propose PCRMLP, a model for urban scene point cloud registration that achieves comparable registration performance to prior learning-based methods. Compared to previous works which focus on extracting features and estimating correspondence, the model estimates the transformation implicitly from concrete instances. An instance-level urban scene representation method is introduced to extract instance descriptors via semantic segmentation and DBSCAN, which enable the model to obtain robust instance features, filter dynamic objects and estimate transformation in a more logical manner. Then a lightweight network consisting of MLPs is employed to obtain transformation in an encoder-decoder manner. We validate the approach on KITTI dataset. Experimental results demonstrate that PCRMLP can obtain a satisfactory coarse transformation from instance descriptors just in 0.0028s. With a subsequent ICP refinement module, the proposed method achieves higher registration accuracy and computational efficiency than prior learning-based works.

For the emerging autonomous swarm technology, from the perspective of systems science and systems engineering, there must be some novel elements and methods to aggregate multiple systems into a group, which distinguish with the general components with specific functions, and we expect to provide the presentation of their existence in the swarm development processes. The inspiration of our methodology origins from the integration of swarm ontology, multi-paradigm modeling, multi-agent system, cyber-physical system, etc. Therefore, we choose the model-driven technology as a framework to acquire an approach of model representation across the multiple levels of abstraction and composition. The autonomous strategic mechanism is defined and formed in parallel with ConOps analysis and systems design, so as to effectively solve the cognitive problem of emergence caused by the nonlinear causation among individual and whole behaviors. This approach highlights to use the MBSE processes and their artifacts to embed the meso mechanism to integrate the operational and the functional, and which means to connect the macro and micro aspects in formalism and so to become a whole with its expected goals, and then to verify and validate within a L-V-C simulation environment.

Simultaneous Localization and Mapping (SLAM) is considered as a challenge in environments with many moving objects. This paper proposes a novel LiDAR Inertial Odometry framework, ID-LIO, for dynamic scenes that builds on LIO-SAM. To detect the pointclouds on the moving objects, a dynamic point detection method is integrated, which is based on pseudo occupancy along the spatial dimension. Then, we present a dynamic points propagation and removal algorithm based on indexed points to remove more dynamic points in the local map along the temporal dimension and update the status of the point features in keyframes. In the LiDAR odometry module, a delay removal strategy is proposed for history keyframes and the sliding window-based optimization includes the LIDAR measurement with dynamic weights to reduce error from dynamic points in keyframes. We perform the experiments both on the public low dynamic and highly dynamic data set. The results show that the proposed method greatly increases the localization accuracy in high dynamic environments. And the ATE(Absolute Trajectory Error) average RMSE((Root Mean Square Error) of our ID-LIO can be improved by 67% and 85% in the UrbanLoco-CAMarketStreet dataset and UrbanNav-HK-Medium-Urban-1 dataset respectively when compared with LIO-SAM.

Factory safety inspections are crucial for ensuring safe production. However, manual inspections present issues such as low efficiency and high workload. Inspection robots provide an efficient and reliable solution for completing patrol tasks. The development of robot localization and path planning technologies provides guarantees for factory inspection robots to autonomously complete inspection tasks in complex environments. This paper studies mapping and localization, as well as path planning methods for robots in order to meet the application requirements of factory inspections. Two SLAM application systems based on multiple-line laser radar and vision are designed for different scenarios in consideration of the limitations of cameras and laser sensors in terms of their own characteristics and applicability in different environments. To address the issue of low efficiency in inspection tasks, a hybrid path planning algorithm that integrates the A-star algorithm and time elasticity band algorithm is proposed. This algorithm effectively solves the problem of path planning in complex environments that is prone to falling into local optimal solutions, thereby improving the inspection efficiency of robots. Experimental tests show that the designed SLAM and path planning methods can meet the needs of robot inspection in complex scenes and have good reliability and stability. The code used in this article is open source and can be accessed at https://github.com/Mxiii99/RSPP_CS.git.

We introduce a novel hybrid Transformer-CNN architecture for robotic grasp detection, designed to enhance the accuracy of grasping unknown objects. Our proposed architecture has two key designs. Firstly, we develop a hierarchical transformer as the encoder, incorporating the external attention to effectively capture the correlation features across the data. Secondly, the decoder is constructed with cross-layer connections to efficiently fuse multi-scale features. Channel attention is introduced in the decoder to model the correlation between channels and to adaptively recalibrate the channel correlation feature response, thereby increasing the weight of the effective channels. Our method is evaluated on the Cornell and Jacquard public datasets, achieving an image-wise detection accuracy of 98.3% and 95.8% on each dataset, respectively. Additionally, we achieve object-wise detection accuracy of 96.9% and 92.4% on the same datasets. A physical experiment is also performed using the Elite 6Dof robot, with a grasping accuracy rate of 93.3%, demonstrating the proposed method's ability to grasp unknown objects in real-world scenarios. The results of this study show that our proposed method outperforms other state-of-the-art methods.

Limited accessibility in some parts of Indonesia causes difficulties in logistic distribution, especially for emergency and medical supplies. Emerging drone cargo technology is a potential solution to improve logistic distribution in those areas. However, implementing drone cargo technology involves unknown risks, both in technical and non-technical aspects. Since data on drone operations in Indonesia is limited, a new method is explored to build a Bayesian Network (BN) model for risk analysis of drone crashes in Indonesia’s outermost and underdeveloped areas. The method optimizes the modelling process, in which significant risk factors are selected based on three drone operator companies’ experiences, which include wind speed, rain intensity, and system component failure or malfunction. Real wind speed and rain probability data are then implemented in the model. The operator’s data shows that wind speed contributes to drone crashes, which can be appropriately modelled in the BN model. The model produced a probability of safe operation of 94.1%, comparable to the annual operator’s data. The result shows that most operations are safe, with a minimum case of crashing and no case of harming human life.

In the field of vision-based robot grasping, effectively leveraging RGB and depth information to accurately determine the position and pose of a target is a critical issue. To address this challenge, we propose a tri-stream cross-modal fusion architecture for 2-DoF visual grasp detection. This architecture facilitates the interaction of RGB and depth bilateral information and is designed to efficiently aggregate multiscale information. Our novel modal interaction module (MIM) with spatial-wise cross-attention algorithm adaptively captures cross-modal feature information. Meanwhile, the channel interaction modules (CIM) further enhance the aggregation of different modal streams. In addition, we efficiently aggregate global multiscale information through a hierarchical structure with skipping connections. To evaluate the performance of our proposed method, we conduct validation experiments on standard public datasets and real robot grasping experiments. We achieve the image-wise detection accuracy of 99.4% and 96.7% on Cornell and Jacquard datasets respectively. The object-wise detection accuracy reaches 97.8% and 94.6% on the same datasets. Furthermore, physical experiments using the 6-DoF Elite robot demonstrate a success rate of 94.5%. These experiments highlight the superior accuracy of our proposed method.

Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level of com- pression strength while two points on the article are pushed towards each otherand include objects such as ropes (1D), fabrics (2D) and bags (3D). In general, CDOs’ many degrees of freedom (DoF) introduce severe self-occlusion and complex state-action dynamics as significant obstacles for perception and manipulation systems. These challenges exacerbate existing issues of modern robotic control methods such as imitation learning (IL) and reinforcement learning (RL). This review focuses on the application details of data-driven control methods on four major task families in this domain: cloth-shaping, rope manipulation, dressing and bag manip- ulation. Furthermore, we identify specific inductive biases in these four domains that present challenges for more general IL and RL algorithms, and summarise the future direction for the development of the field.

In this discussion paper, I give an account for non-experts of, arguably, quantum dynamics in the brain, underlying the modeling of affective behavior of humanoid robots in the making. Outreach to the larger audience inevitably leads to abbreviations and simplifications; nonetheless, I try to offer the backgrounds of why it is important to study the virtual aspects of ‘people’ we meet online, what dimensions play a role in assessing such creatures, what humanities, psychology, communication, and computer science provide to help us understand how we become attached to non-existent others. As its capstone for the time being, an approach derived from physics is discussed for a robot to handle emotional ambiguity and vagueness of its user. Two computational models, Silicon and Quantum Coppélia, are discussed for their potential and limitations in explaining human affective behavior while dealing with mediated characters.

Inspired by the reflective and deliberative control mechanisms used in cognitive architectures such as SOAR and Sigma, we propose an alternative decision mechanism driven by architectural appraisals allowing robots to overcome impasses. The presented work builds on and improves on our previous work on a generally applicable decision mechanism with roots in the Standard Model of the Mind and the Generalized Cognitive Hour-glass Model. The proposed decision mechanism provides automatic context-dependent switching between exploration-oriented, goal-oriented, and backtracking behavior, allowing a robot to overcome impasses. A simulation study of two applications utilizing the proposed decision mechanism is presented demonstrating the applicability of the proposed decision mechanism.

Rapid advancements in the fifth generation (5G) communication technology and mobile edge computing (MEC) paradigm lead to the proliferation of unmanned aerial vehicles (UAV) in urban air mobility (UAM) networks, which provide intelligent services for diversified smart city scenarios. Meanwhile, the widely deployed internet of drones (IoD) in smart cities also brings up new concerns on performance, security, and privacy. The centralized framework adopted by conventional UAM networks is not adequate to handle high mobility and dynamicity. Moreover, it is necessary to ensure device authentication, data integrity, and privacy preservation in UAM networks. Thanks to characteristics of decentralization, traceability, and unalterability, Blockchain is recognized as a promising technology to enhance security and privacy for UAM networks. In this paper, we introduce LightMAN, a lightweight microchained fabric for data assurance and resilience-oriented UAM networks. LightMAN is tailored for small-scale permissioned UAV networks, in which a microchain acts as a lightweight distributed ledger for security guarantees. Thus, participants are enabled to authenticate drones and verify the genuineness of data that is sent to/from drones without relying on a third-party agency. In addition, a hybrid on-chain and off-chain storage strategy is adopted that not only improves performance (e.g,.latency and throughput) but also ensures privacy preservation for sensitive information in UAM networks. A proof-of-concept prototype is implemented and tested on a Micro Air Vehicle Link (MAVLink) simulator. The experimental evaluation validates the feasibility and effectiveness of the proposed LightMAN solution.

Imitation Learning is a discipline of Machine Learning primarily concerned with replicating observed behavior of agents known to perform well on a given task, collected in demonstration data sets. In this paper, we set out to introduce a pipeline for collecting demonstrations and training models that can produce motion plans for industrial robots. Object throwing is defined as the motivating use case. Multiple input data modalities are surveyed, and motion capture is selected as the most practicable. Two model architectures operating autoregressively are examined -- feedforward and recurrent neural networks. Trained models execute throws on a real robot successfully, and a battery of quantitative evaluation metrics is proposed, including extrapolated throw accuracy estimates. Recurrent neural networks outperform feedforward ones in most respects, with the best models having an assessed mean throw error on the order of 0.1...0.2 m at distances of 1.5...2.0 m. The data collection, pre-processing, and model training aspects of our proposed approach show promise, but further work is required in developing Cartesian motion planning tools before it is suitable for application in production.

Quadrotor drones have rapidly gained interest recently. Numerous studies are underway for the commercial use of autonomous drones, and especially the distribution businesses are taking serious reviews on drone delivery services. However, there are still many concerns about urban drone operations. The risk of failures and accidents makes it difficult to provide drone-based services in the real world with ease. There have been many studies that introduced supplementary methods to handle drone failures and emergencies. However, we discovered the limitation of the existing methods. The majority of approaches were improving PID-based control algorithms which is the dominant drone control method. This type of low-level approach lacks situation awareness and the ability to handle unexpected situations. This study introduces an event-based control methodology that takes a high-level diagnosing approach that can implement situation awareness via time-window. While leaving the low-level controller to involve in operating the drone for most of the time in normal situations, our controller operates at a higher level and detects unexpected behaviors and abnormal situations of the drone. We tested our method with real-time 3D computer simulation environments with Unreal Engine[15] and AirSim[31]. We were able to verify that our approach can provide enhanced double safety and better ensure safe drone operations. We hope our discovery to possibly contribute to the advance of real-world drone services in the near future.

This study observes, interprets, and analyses the knowledge production in the research field of Human–Robot Interaction (HRI). It intends to foreground the hidden assumptions that are often taken for granted when roboticist design and conduct their research. By doing so, this study demonstrates how these assumptions influence the result of their research. Based on data collected through sociological field observation, this study argues that the current practise in HRI research is highly anthropocentric. In short, the robots are designed to be like human instead of for human. Therefore, the human–robot relationship embodies the existing power relations between human beings. These relations generate inequality, hierarchy, and dominance, which are the opposite of the common imagination of the robotised future among roboticists. For the purpose of enabling the robotised future closer to their ideal, this study suggests that HRI researchers to go beyond the conventional methodology, to allow a human–robot relationship that realises reciprocity.

Self-Driving Vehicles or Autonomous Driving (AD) have emerged as the prime field of research in Artificial Intelligence and Machine Learning of late. The indicated market share of existing vehicles might be supplanted by these self-driving vehicles within the next few decades. While AD may appear to be relatively easy, in fact, it is quite the contrary owing to involvement and coordination amongst various kinds of systems. Numerous research studies are being conducted at various stages of these AD systems. While some find the various stages of the AD Pipeline beneficial, others tend to rely on Computer Vision mostly. This paper attempts to summarise the recent developments in Autonomous Vehicle architecture. Although some people might seem to be sceptical about the pragmatic use of AD as an alternative to existing vehicles, the plethora of research and experiments being conducted suggests the opposite. Indeed, there are many challenges to implementing AD in the real world, but significant progress made in the last couple of years indicates general acceptance of AD in upcoming years.

By combining stochastic variational inference with message passing algorithms we show how to solve the highly complex problem of navigation and avoidance in distributed multi-robot systems in a computationally tractable manner, allowing online implementation. Subsequently, the proposed variational method lends itself to more flexible solutions than prior methodologies. Furthermore, the derived method is verified both through simulations with multiple mobile robots and a real world experiment with two mobile robots. In both cases the robots shares the operating space and needs to cross each other’s paths multiple times without colliding.

The real challenge in Human Robot Interaction (HRI) is to build machines capable of perceiving human emotions so that robots can interact with humans in a proper manner. It is well known from the literature that emotion varies accordingly to many factors. Among these, gender represents one of the most influencing one, and so an appropriate gender-dependent emotion recognition system is recommended. In this paper, a two-level hierarchical Speech Emotion Recognition (SER) system is proposed: the first level is represented by the Gender Recognition (GR) module for the speaker’s gender identification; the second is a gender-specific SER block. Specifically for this work, the attention was focused on the optimisation of the first level of the proposed architecture. The system was designed to be installed on social robots for hospitalised and living at home elderly patients monitoring. Hence, the importance of reducing the software computational effort of the architecture also minimizing the hardware bulkiness, in order for the system to be suitable for social robots. The algorithm was executed on the Raspberry Pi hardware. For the training, the Italian emotional database EMOVO was used. Results show a GR accuracy value of 97.8%, comparable with the ones found in literature.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

The use of Attitude and Heading Reference Systems (AHRS) for orientation estimation is now common practice in a wide range of applications, e.g., robotics and human motion tracking, aerial vehicles and aerospace, gaming and virtual reality, indoor pedestrian navigation and maritime navigation. The integration of the high-rate measurements can provide very accurate estimates, but these can suffer from errors accumulation due to the sensors drift over longer time scales. To overcome this issue, inertial sensors are typically combined with additional sensors and techniques. As an example, camera-based solutions have drawn a large attention by the community, thanks to their low-costs and easy hardware setup; moreover, impressive results have been demonstrated in the context of Deep Learning. This work presents the preliminary results obtained by DOES , a supportive Deep Learning method specifically designed for maritime navigation, which aims at improving the roll and pitch estimations obtained by common AHRS. DOES recovers these estimations through the analysis of the frames acquired by a low-cost camera pointing the horizon at sea. The training has been performed on the novel ROPIS dataset, presented in the context of this work, acquired using the FrameWO application developed for the scope. Promising results encourage to test other network backbones and to further expand the dataset, improving the accuracy of the results and the range of applications of the method.

We transformed the existing learning program Language Shower, which is used in some Norwegian day-care centers in the Grorud district of Oslo municipality, into a digital solution using an app for smartphone or tablet with the option for further enhancement of presentation by a NAO robot. The solution was tested in several iterations and multiple day-care centers over several weeks. Measurements of the children’s progress across learning sessions indicate a positive impact of the program using a robot as compared to the program without robot. In-situ observations and interviews with day care center staff confirmed the solution’s many advantages, but also revealed some important areas for improvement. In particular, the speech recognition needs to be more flexible and robust, and special measures have to be in place to handle children speaking simultaneously.

Maze navigation using one or more robots has become a recurring challenge in scientific literature and real life practice, with fleets having to find faster and better ways to navigate environments such as a travel hub (e.g. airports) or to evacuate a disaster zone. Many methods have been used to solve this issue, including the implementation of a variety of sensors and other signal receiving systems. Most interestingly, camera-based techniques have increasingly become more popular in this kind of applications, given their robustness and scalability. In this paper, we have implemented an end-to-end strategy to address this scenario, allowing a robot to solve a maze in an autonomous way, by using computer vision and path planning. In addition, this robot shares the generated knowledge to another by means of communication protocols, having to adapt its mechanical characteristics to be able to solve the same challenge. The paper presents experimental validation of the four components of this solution, namely camera calibration, maze mapping, path planning and robot communication. Finally, we present the integration and functionality of these methods applied in a pair of NAO robots.

Obstacle-avoidance robots have become an essential field of study in recent years. This paper analyzes two cases that extend reactive systems focused on obstacle detection and its avoidance. The scenarios explored get data from their environments through sensors and generate information for the models based on artificial intelligence to obtain a reactive decision. The main contribution is focused on the discussion of aspects that allow comparing both approaches, such as the heuristic approach implemented, requirements, restrictions, response time, and performance. The first case presents a mobile robot that applies fuzzy logic to achieve soft turning basing its decision on depth image information. The second case introduces a mobile robot based on multi-layer perceptron and ultrasonic sensors to decide how to move in an uncontrolled environment. The analysis of both options offers perspectives to choose between reactive obstacle-avoidance systems based on ultrasonic or Kinect sensors, models that infer optimal decisions applying fuzzy logic or artificial neural networks, with key elements and methods to design mobile robots with wheels. Therefore, we show how AI or Fuzzy Logic techniques allow us to design mobile robots that learn from their “ experience ” by making them safe and adjustable for new tasks, unlike traditional robots that use large programs to perform a specific task.

Purpose: The ongoing COVID-19 crisis has created the need for social distancing between medical staff and patients, therefore, healthcare robotics is increasingly important as regards infectious control. The purpose of this study was to design and fabricate a remote controlled transport robot that could provide an optimum technology base for developing countries, having dual functions of telepresence and delivery operations inside or outside buildings, is easy to assemble and also easily able to be cleaned using standard chemical agents.Methods: This machine was designed and fabricated to incorporate two main functions; delivery and telepresence. The robot consists of a base frame, DC motors for driving and steering systems, actuator motor for driving wheel elevation, Wi-Fi AP/Repeater, network camera, and a necessary a back-up power system.Results: This robot can be used both indoors and outdoors. It can carry loads of more than 80 kg. The machine can cross obstacles greater than 3 cm. It can be cleaned by disinfectant agents. An actuator motor can lift the driving wheels above the surface to prevent gear damage. Conclusion: This article demonstrates the concept of a healthcare telepresence and delivery robot that can provide distancing during the present COVID-19 crisis, using optimum technology for low and middle-income countries. In the future, the researcher should consider development of the delivery controls, combined with the telepresence system using the internet of things, to improve the navigation system, the manipulator system for supporting multi-floor transportation, and also other multi-functional purposes.

This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person’s state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the Message Queue Telemetry Transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) System developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person’s face in the image captured by the UAV’s on-board camera and classify the emotion among seven possible ones (surprise, fear, happiness, sadness, disgust, anger or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.

Robotic Process Automation (RPA) is a fast growing field inside Business Process Automation (BPA). RPA deals with software robots that use human application interface to do some repetitive tasks like starting programs, filling the forms, clicking on buttons etc. Some RPA software tools like Blue Prism, Rapise and UiPath became popular during last years but there are still some problems with them starting with their high price and difficulties to adapt to the real use cases. On the other hand, Optoklik is a relatively small RPA tool developed to be highly adaptable to the real cases and still easy to use. This paper presents the main functions of Optoklik and discusses its usage in automation of different actions that use human application interface.

In the last decade, the objectives outlined by the needs of personal robotics have led to the rise of new biologically-inspired techniques for arm motion planning. This paper presents a literature review of the most recent research on the generation of human-like arm movements in humanoid and manipulation robotic systems. Search methods and inclusion criteria are described. The studies are analysed taking into consideration the sources of publication, the experimental settings, the type of movements, the technical approach, and the human motor principles that have been used to inspire and assess human-likeness. Results show that there is a strong focus on the generation of single-arm reaching movements and biomimetic-based methods. However, there has been poor attention to manipulation, obstacle-avoidance mechanisms, and dual-arm motion generation. For these reasons, human-like arm motion generation may not fully respect human behavioural and neurological key features and may result restricted to specific tasks of human-robot interaction. Limitations and challenges are discussed to provide meaningful directions for future investigations.

Unmanned aerial vehicles (UAVs) represent a new model of social robots for home care of dependent persons. In this regard, this article introduces a study on people’s feeling of safety and comfort while watching the monitoring trajectory of a quadrotor dedicated to determining their condition. Three main parameters are evaluated: the relative monitoring altitude, the monitoring velocity and the shape of the monitoring path around the person (ellipsoidal or circular). For this purpose, a new trajectory generator based on a state machine, which is successfully implemented and simulated in MATLAB/Simulink®, is described. The study is carried out with 37 participants using a virtual reality (VR) platform based on two modules, UAV Simulator and VR Visualiser, both communicating through the MQTT protocol. The participants’ preferences have been a high relative monitoring altitude, a high monitoring velocity and a circular path. These choices are a starting point for the design of trustworthy socially assistive UAVs flying in real homes.

Emotion plays a powerful role in humans’ interaction with robots. In order to express more human-friendly emotions, robots need the capability of contextual appraisal that expresses the emotional relevance of various targets in the spatiotemporal situation. In this paper, an emotional appraisal system is proposed in this study to cope with such contexts. Specifically, the Ortony, Clore, and Collins model is abstracted and simplified to approximate an emotional appraisal model in the form of a sentence-based cognitive system. The contextual emotion appraisal is modeled by formulating the emotional relationships among multiple targets and the emotional transition with events and time passing. To verify the proposed robotic system’s feasibility, simulations were conducted for scenarios where it emotional interacts with humans manipulating liked or disliked objects on a table. This experiment demonstrated that the robot's emotion can variously change over time like human by using a proposed formula for emotional valence, which is moderated by emotion appraisal of occurring events.

Positioning is an essential aspect of robot navigation, and visual odometry an important technique for continuous updating the internal information about robot position, especially indoors without GPS. Visual odometry is using one or more cameras to find visual clues and estimate robot movements in 3D relatively. Recent progress has been made, especially with fully integrated systems such as the RealSense T265 from Intel, which is the focus of this article. We compare between each other three visual odometry systems and one wheel odometry, on a ground robot. We do so in 8 scenarios, varying the speed, the number of visual features, and with or without humans walking in the field of view. We continuously measure the position error in translation and rotation thanks to a ground truth positioning system. Our result show that all odometry systems are challenged, but in different ways. In average, ORB-SLAM2 has the poorer results, while the RealSense T265 and the Zed Mini have comparable performance. In conclusion, a single odometry system might still not be sufficient, so using multiple instances and sensor fusion approaches are necessary while waiting for additional research and further improved products.

Estimation and planning play a vital role in the construction of an autonomous navigation framework. However, these problems are often considered separately, while planning gives robot a free-collision path towards the desired goal, estimation algorithm presents the executed trajectory in the sense that it has to be closed to the ground truth path as much as possible. Recently, a unified probabilistic framework, which supports solving these problems simultaneously, dubbed STEAP has been proposed. Nevertheless, its current version is only designated for an omni wheels robot, which allows robot to move and turn in vertical direction. Differential drive robot, on the other hand, though limited to move along only one direction, has been used in various situations due to its flexibility and lower cost in hardware designing. Thus, in this extension, our aim is to control a differential drive robot via STEAP. Moreover, in a more complicated environment such as labyrinth or maze, the original STEAP sometimes fails to find a path. Indeed, this problem is mainly caused by the poor initialization and the non-linearity in optimizer constraints. In our implementation, instead of dealing with these constraints, we employ a global planner algorithm such as Dijkstra or RRT to treat STEAP as an effective local planner module that focus on following the global path. Consequently, the experimental results show that the extended STEAP not only able to navigate a differential drive robot but also in a more complicated and unstructured environment.

The increasing number of robots around us will soon create a demand for connecting these robots in order to achieve goal-driven teamwork in heterogeneous multi-robot systems. In this paper, we focus on robot teamwork specifically in dynamic environments. While the conceptual modeling of multi-agent teamwork has been studied extensively during the last two decades, related engineering concerns have not received the same degree of attention. Therefore, this paper makes two contributions. The analysis part discusses general design challenges that apply to robot teamwork in dynamic application domains. The constructive part presents a review of existing engineering approaches for challenges that arise with dynamically changing runtime conditions. An exhaustive survey of robot teamwork aspects would be beyond the scope of this paper. Instead, we aim at creating awareness for the manifold dimensions of the design space and highlight state-of-the-art technical solutions for dynamically adaptive teamwork, thus pointing at open research questions that need to be tackled in future work.

Consider a robot that is navigating in a space modeled by a graph, and that wants to know its current location. It can send a signal to determine how far it is from each landmark among a set of fixed landmarks. We study the problem of computing the minimum required number of landmarks, and where they should be placed so that the robot can always determine its location. Since the problem is an NP-complete problem, the robot's responses to the actions are slow. To accelerate this response, we can use the parallel version of this problem. In this work, we introduce a new parallel implementation for determining the metric dimension of a given graph. We run the proposed algorithm on a symmetric multi-processing (SMP) cluster using C programming language and the Message Passing Interface (MPI) library. Finally, we run our implementation on four categories of graphs (the tracks in which the robot moves): a cycle graph Cn, a path graph Pn, a triangular snake graph and a ladder graph Ln. Preliminary computational results indicate that the metric dimension problem is an NP-complete problem and prove the ability of the proposed algorithm to achieve a speedup of 6 for 8 processors.

We present an Arduino-based automatic robotic system which is used for cutting grass or lawns, mostly healthy grass which needs to cut neatly like in a public park or a private garden. The purpose of this proposed project is to design a programmable automatic pattern design grass cutting robot with solar power which no longer requires time-consuming manual grass-cutting, and that can be operated wirelessly using an Android Smartphone via Bluetooth from a safe distance which is capable of cutting the grass in indeed required shapes and patterns; the cutting blade can also be adjusted to maintain the different length of the grass. The main focus was to design a prototype that can work with a little or no Physical user interaction. The proposed work is accomplished by using an Arduino microcontroller, DC geared Motors, IR obstacle detection sensor, motor shield, relay module, DC battery, solar panel, and Bluetooth module. The grass-cutting robot system can be moved to the location in the lawn remotely where the user wants to cut the grass directly or in desired patterns. The user can press the desired pattern button from the mobile application, and the system will start cutting grass in the similar design such as a circle, spiral, rectangle, and continue pattern. Also, with the assistance of sensors positioned at the front of the vehicle, an automatic barrier detection system is introduced to enhance safety measurements to prevent any risks. IR obstacle detector sensors are used to detect obstacles, if any obstacle is found in front of the robot while traveling; it avoids the barrier by taking a right/right turn or stop automatically appropriately, thereby preventing the collision. Also, the main aim of this project is the formation of a grass cutter that relieves the user from mowing their own grasses and reduces environmental and noise pollution. The proposed system is designed as a lab-scale prototype to experimentally validate the efficiency, accuracy, and affordability of the systems. The experimental results prove that the proposed work has all in one capability (Simple and Pattern based grass cutting with mobile-application, obstacle detection), is very easy to use, and can be easily assembled in a simple hardware circuit. We note that the systems proposed can be implemented on a large scale under real conditions in the future, which will be useful in robotics applications and cutting grass in playing grounds such as cricket, football, and hockey, etc.

Nowadays, security is a top priority. In fact, biometrics uses cutting-edge technologies to identify terrorists and criminals. But the practice of distinguishing humans based on intrinsic physical or behavior traits goes back thousands of years. With the widespread use of computers in the late 20th century, new possibilities for digital biometrics emerged and new technologies were generously used. Among these, we remember high resolution security video cameras and drones. So, the aim of the present project is to study and explain the features of these technologies, especially the ones of the the Phantom 4 Pro+ aircraft and analyze its operating methods in order to identify human faces during live streaming of videos. For this purpose, it will be used Paul Viola and Michael Jones’ face detection algorithm, which includes Haar features and cascade classifiers to identify faces, eyes and ears of an individual.

Since it was proposed, the Robot Operating System (ROS) has fostered solutions for various problems in robotics in the form of ROS packages. One of these problems is Simultaneous Localization and Mapping (SLAM), a problem solved by computing the robot pose and a map of its environment of operation at the same time. The increasingly availability of robot kits ready to be programmed and also of RGB-D sensors often pose the question of which SLAM package should be used given the application requirements. When the SLAM subsystem must deliver estimates for robot navigation, as is the case of applications involving autonomous navigation, this question is even more relevant. This work introduces an experimental analysis of GMapping and RTAB-Map, two ROS compatible SLAM packages, regarding their SLAM accuracy, quality of produced maps and use of produced maps in navigation tasks. Our analysis aims ground robots equipped with RGB-D sensors for indoor environments and is supported by experiments conducted on datasets from simulation, benchmarks and from our own robot.

We first review the literature on machine behavior which may contain the interaction between machines, and then discuss the methodology and the related case involving collaboration between robots to instantiate the concept with AI empowerment. The navigation case aims to a security application with autonomous control and roadside agent embedded in a mobile edge computing structure. In the studied navigation based on the artificial potential field method, robots need to use position information to calculate the moving direction frequently. In the case of high motion speed as well as GPS positioning error, the path trajectory may show a sharp change of direction. In order to mitigate the trajectory oscillation, this paper proposes a path planning design where training process and motion direction prediction are integrated by using artificial neural network. The auxiliary navigation agent near multiple obstacles can first extract the past movement information of the robot and then determines whether there is a serious path jitter event. Computer simulation analysis shows that the combination of autonomous control and cooperative behavior can effectively reduce the path jitter so as to achieve a fast and safe path planning.

The cooperation between humans and robots is becoming increasingly important in our society. Consequently, there is a growing interest in the development of models that can enhance the interaction between humans and robots. A key challenge in the Human-Robot Interaction (HRI) field is to provide robots with cognitive and affective capabilities, developing architectures that let them establish empathetic relationships with users. Several models have been proposed in recent years to solve this open-challenge. This work provides a survey of the most relevant attempts/works. In details, it offers an overview of the architectures present in literature focusing on three specific aspects of HRI: the development of adaptive behavioural models, the design of cognitive architectures, and the ability to establish empathy with the user. The research was conducted within two databases: Scopus and Web of Science. Accurate exclusion criteria were applied to screen the 1007 articles found (at the end 30 articles were selected). For each work, an evaluation of the model is made. Pros and cons of each work are detailed by analysing the aspects that can be improved so that an enjoyable interaction between robots and users can be established.

Robotic path planning is a field of research which is gaining traction given the broad domains of interest to which path planning is an important systemic requirement; the aim being to optimise the efficacy of robotic movements in a defined operational environment. For example, robots have been employed in many domains including: cleaning robots (such as vacuum cleaners), automated paint spraying robots, window cleaning robots, forest monitoring robots, agricultural robots (often driven using satellite and geostationary positional satellite data). Additionally, mobile robotic systems have been utilised in disaster areas and locations hazardous to humans (such as war zones in mine clearance). The coverage path planning problem describes an approach which is designed to determine the path that traverses all points in a defined operational environment while avoiding static and dynamic (moving) obstacles. In this paper we present our proposed Smooth-STC model, the aim of the model being to identify an optimal path, avoid all obstacles, prevent (or at least minimise) backtracking, and maximise the coverage in any defined operational environment. The experimental results in a simulation show that, in uncertain environments, our proposed smooth STC method achieves an almost absolute coverage rate and demonstrates improvement when measured against alternative conventional algorithms.

Indoor scene recognition has great significance for intelligent applications such as mobile robots, location-based services (LBS) and so on. Wherever we are or whatever we do, we are under a specific scene. The human brain can easily discern a scene with a quick glance. However, for a machine to achieve this purpose, on one hand, it often requires plenty of well-annotated data which is time-consuming and labor-intensive. On the other hand, it is hard to learn effective visual representations due to large intra-category variation and inter-categories similarity of indoor scenes. To solve these problems, in this paper, we adopted an unsupervised visual representation learning method which can learn from unlabeled data with a Siamese Convolutional Neural Network (Siamese ConvNet) and graph-based constraints. Specifically, we first mined relationships between unlabeled samples with a graph structure. And then, these relationships can be used as supervision for representation learning with a Siamese network. In this method, firstly, a k-NN graph would be constructed by taking each image as a node in the graph and its k nearest neighbors are linked to form the edges. Then, with this graph, cycle consistency and geodesic distance would be considered as criteria for positive and negative pairs mining respectively. In other words, by detecting cycles in the graph, images with large differences but in the same cycle can be considered as same category (positive pairs). By computing geodesic distance instead of Euclidean distance from one node to another, two nodes with large geodesic distance can be regarded as in different categories (negative pairs). After that, visual representations of indoor scenes can be learned by a Siamese network in an unsupervised manner with the mined pairs as inputs. In order to evaluate the proposed method, we tested it on two scene-centric datasets, MIT67 and Places365. Experiments with different number of categories have been conducted to excavate the potential of proposed method. The results demonstrated that semantic visual representations for indoor scenes can be learned in this unsupervised manner. In addition, with the learned visual representations, indoor scene recognition models trained with the learned representations and a few of labeled samples can achieve competitive performance compared to the state-of-the-art approaches.

We report on an exploratory study conducted at a graduate school in Sweden with a humanoid robot, Baxter. First, we describe a list of potentially useful capabilities for a robot teaching assistant derived from brainstorming and interviews with faculty members, teachers, and students. These selected capabilities consist of reading, greeting, alerting, remote operation, clarification, and motion. Second, we present feedback on how the robot's capabilities, demonstrated in part with the Wizard of Oz approach, were perceived, and iteratively adapted over the course of several lectures, using the \EP tool. Third, we discuss observations and findings regarding the capabilities and the development process. Our findings suggest that using a social robot as a teaching assistant is promising using the chosen capabilities. We find that personalizing the capabilities and the role of embodiment are important topics to be considered in future work.

In this paper, we look at how Artificial Swarm Intelligence can evolve using evolutionary algorithms that try to minimize the sensory surprise of the system. We will show how to apply the free-energy principle, borrowed from statistical physics, to quantitatively describe the optimization method (sensory surprise minimization), which can be used to support lifelong learning. We provide our ideas about how to combine this optimization method with evolutionary algorithms in order to boost the development of specialized Artificial Neural Networks, which define the proprioceptive configuration of particular robotic units that are part of a swarm. We consider how optimization of the free-energy can promote the homeostasis of the swarm system, i.e. ensures that the system remains within its sensory boundaries throughout its active lifetime. We will show how complex distributed cognitive systems can be build in the form of hierarchical modular system, which consists of specialized micro-intelligent agents connected through information channels. We will also consider the co-evolution of various robotic swarm units, which can result in development of proprioception and a comprehensive awareness of the properties of the environment. And finally, we will give a brief outline of how this system can be implemented in practice and of our progress in this area.

Several studies have analyzed human gait data obtained from inertial gyroscope and accelerometer sensors mounted on different parts of the body. In this article, we take a step further in gait analysis and provide a methodology for predicting the movements of the missing parts of the legs. In particular, we propose a method, called GaIn, to control non-invasive, robotic, prosthetic legs. GaIn can infer the movements of both missing shanks and feet for humans suffering from double trans-femoral amputation using biologically inspired recurrent neural networks. Predictions are performed for casual walking related activities such as walking, taking stairs, and running based on thigh movement. In our experimental tests, GaIn achieved a 4.55 degree prediction error for shank movements on average. However, a patient's intention to stand up and sit down cannot be inferred from thigh movements. In fact, intention causes thigh movements while the shanks and feet remain roughly still. The GaIn system can be triggered by thigh muscle activities measured with electromyography (EMG) sensors to make robotic prosthetic legs perform standing up and sitting down actions. The GaIn system has low prediction latency and is fast and computationally inexpensive to be deployed on mobile platforms and portable devices.

The disaster response operational strategies requires tool that a may provide time bound clear picture of potential spots. Natural disaster sometimes comes slowly like increment of water level resulting flood or early warning of tsunami whereas in manmade disasters like 1CBRNE attack or chemical accident or industrial structure collapse or leakage through a pipeline of some toxic hazardous gas requires very accurate and quick response strategies. 2Unmanned Aerial System is commercially used tools present in the market and also used by military organization for various operations throughout the world. The accuracy and time bound pictorial representation of the spots by these tow tools makes them very useful for providing clear picture of potential disaster sites and enabling decision makers to take decision on these representation. Apart of these the potential to deliver important material faster than any other mode also makes these equipment and technology a very important asset for making disaster risk reduction strategies. This paper elaborates the efficacy and utility of Unmanned Aerial System or Drones in developing robust and time bound strategies for disaster risk reduction. This paper also evaluates some experiences and describes some initiatives using Unmanned Aerial System to support disaster risk reduction strategies and post disaster decision making efforts.

Service robots operating in indoor environments should recognize dynamic changes from sensors, such as RGB-D camera, and recall the past context. Therefore, we propose a context query-processing framework, comprising spatio-temporal robotic context query language (ST-RCQL) and spatio-temporal robotic context query-processing system (ST-RCQP), for service robots. We designed them based on the spatio-temporal context ontology. ST-RCQL can query not only the current context knowledge but also the past. In addition, ST-RCQL includes a variety of time operators and time constants, and thus queries can be written very efficiently. The ST-RCQP is a query-processing system equipped with a perception handler, working memory, and backward reasoner for real-time query-processing. Moreover, ST-RCQP accelerates query-processing speed by building a spatio-temporal index in the working memory, where percepts are stored. Through various qualitative and quantitative experiments, we demonstrate the high efficiency and performance of the proposed context query-processing framework.

Due to the limitations on the capabilities of current robots regarding task learning and performance, imitation is an efficient social learning approach that endows a robot with the ability to transmit and reproduce human postures, actions, behaviors, etc., as a human does. Stable whole-body imitation and task-oriented teleoperation via imitation are challenging issues. In this paper, a novel comprehensive and unrestricted real-time whole-body imitation system for humanoid robots is designed and developed. To map human motions to a robot, an analytical method called geometrical analysis based on link vectors and virtual joints (GA-LVVJ) is proposed. In addition, a real-time locomotion method is employed to realize a natural mode of operation. To achieve safe mode switching, a filter strategy is proposed. Then, two quantitative vector-set-based methods of similarity evaluation focusing on the whole body and local links, called the Whole-Body-Focused (WBF) method and the Local-Link-Focused (LLF) method, respectively, are proposed and compared. Two experiments conducted to verify the effectiveness of the proposed methods and system are reported. Specifically, the first experiment validates the good stability and similarity features of our system, and the second experiment verifies the effectiveness with which complicated tasks can be executed. At last, an imitation learning mechanism in which the joint angles of demonstrators are mapped by GA-LVVJ is presented and developed to extend the proposed system.

The paper presents an innovative hexapod walking robot built with 3-UPU parallel mechanism. In the robot, the parallel mechanism is used as both an actuator to generate walking and also a connecting body to connect two groups of three legs, thus enables the robot to walk with simple gait by very few motors. In the paper, the forward and inverse kinematics solutions are obtained. The workspace of the parallel mechanism is analyzed using limit boundary search method. The walking stability of the robot is analyzed, which yields the robot’s maximum step length. The gait planning of the hexapod walking robot is studied for walking on both flat and uneven terrains. The new robot, combining the advantages of parallel robot and walking robot, has a large carrying capacity, strong passing ability, flexible turning ability, and simple gait control for its deployment for uneven terrain.

Robotic decision-support systems must facilitate a robots interactions with their environment, this demands adaptability. Adaptability relates to awareness of the environment and `self-awareness', human behaviour exemplifies the concept of awareness to arrive at an optimal choice of action or decision based on reasoning and inference with learned preferences. A similar conceptual approach is required to implement awareness in autonomous robotic systems which must adapt to the current dynamic environment (the context of use). By incorporating `self-awareness' with knowledge of a Robot's preferences (in decision making) the decision maker interface should adapt to the current context of use. This paper proposes a novel approach to enable an autonomous robotics which implements path planning combining adaptation with knowledge reasoning techniques and hedge algebra to enable an autonomous robot to realise optimal coverage path planning under dynamic uncertainty. The results for a cleaning robot show that using our proposed approach demonstrated the capability to avoid both static and dynamic obstacles while achieving optimal path planning with increased efficiency. The proposed approach achieves the multiple decision-making objectives (path planning) with a high-coverage and low repetition rates. Compared to other current approaches, the proposed approach has demonstrated improved performance over the conventional robot control algorithms.

In this work we report on our effort to design and implement an early introduction to basic robotics principles for children at kindergarten age. The humanoid robot Pepper, which is a great platform for human-robot interaction experiments, was presenting the lecture by reading out the contents to the children making use of its speech synthesis capability. One of the main challenges of this effort was to explain complex robotics contents in a way that pre-school children could follow the basic principles and ideas using examples from their world of experience. A quiz in a Runaround-game-show style after the lecture activated the children to recap the contents they acquired about how mobile robots work in principle. Besides the thrill being exposed to a mobile robot that would also react to the children, they were very excited and at the same time very concentrated. What sets apart our effort from other work is that part of the lecturing is actually done by a robot itself and that a quiz at the end of the lesson is done using robots as well. To the best of our knowledge this is one of only few attempts to use Pepper not as a tele-teaching tool, but as the teacher itself in order to engage pre-school children with complex robotics contents. We got very positive feedback from the children as well as from their educators.

The important characteristic that could assist in autonomous navigation is the ability of a mobile robot to concurrently construct a map for an unknown environment and localize itself within the same environment. This computational problem is known as Simultaneous Localization and Mapping (SLAM). In literature, researchers have studied this approach extensively and have proposed a lot of improvement towards it. More so, we are experiencing a steady transition of this technology to industries. However, there are still setbacks limiting the full acceptance of this technology even though the research had been conducted over the last 30 years. Thus, to determine the problems facing SLAM, this paper conducted a review on various foundation and recent SLAM algorithms. Challenges and open issues alongside the research direction for this area were discussed. However, towards addressing the problem discussed, a novel SLAM technique will be proposed.

Bipedal locomotion remains one of the major open challenges of humanoid robotics. The common approaches are based on simple reduced model dynamics to generate walking trajectories, often neglecting the whole-body dynamics of the robots. As motions in nature are often considered as optimal with respect to certain criteria, in this work we present an optimal control based approach that allows us to generate optimized walking motions using a precise whole-body dynamic model of the robot, in contrast with the common approaches. The optimal control problem is formulated to minimize a set of desired objective functions with respect to physical constraints of the robot and contact constraints of the walking phases. We apply the method with combinations of different objective criteria to the model of a reduced version of the iCub humanoid robot of 15 internal DOF. The obtained trajectories are executed on the real robot and we carry out a discussion on the differences between the outcomes of this approach with the classic approaches.

Global teacher shortage is a serious concern with grave implications for the future of education. This calls for novel ways of addressing teacher roles. The economic benefits of tireless labour inspires the need for teachers who are unlimited by natural human demands, highlighting consideration for the affordances of robotics and Artificial Intelligence in Education (AIED) as currently obtainable in other areas of human life. This however demands designing robotic personalities that can take on independent teacher roles despite strong opinions that robots will not be able to fully replace humans in the classroom of the future. In this paper, we argue for a future classroom with independent robot teachers, highlighting the minimum capabilities required of such personalities in terms of personality, instructional delivery, social interaction and affect. We describe our project on the design of a robot teacher based on these. Possible directions for future system development and studies are highlighted.

This paper deals with the analytical modeling and control of rectilinear snake robots. During recent times snake robots have created much interest among researchers. The rectilinear pattern gait is one of the four biological snake locomotion modes. Rectilinear snakes have been widely used in rescue operations especially in rough terrains especially in narrow spaces where human intervention is not easy. Computational analysis of rectilinear motion is done using MATLAB.

Using insights from cybernetics and an information-based understanding of biological systems, a precise, scientifically inspired, definition of free-will is offered and the essential requirements for an agent to possess it in principle are set out. These are: a) there must be a self to self-determine; b) there must be a non-zero probability of more than one option being enacted; c) there must be an internal means of choosing among options (which is not merely random, since randomness is not a choice). For (a) to be fulfilled, the agent of self-determination must be organisationally closed (a `Kantian whole'). For (c) to be fulfilled: d) options must be generated from an internal model of the self which can calculate future states contingent on possible responses; e) choosing among these options requires their evaluation using an internally generated goal defined on an objective function representing the overall `master function' of the agent and f) for `deep free-will', at least two nested levels of choice and goal (d-e) must be enacted by the agent. The agent must also be able to enact its choice in physical reality. The only systems known to meet all these criteria are living organisms, not just humans, but a wide range of organisms. The main impediment to free-will in present-day artificial robots, is their lack of being a Kantian whole. Consciousness does not seem to be a requirement and the minimum complexity for a free-will system may be quite low and include relatively simple life-forms that are at least able to learn.