This paper proposes the application of force-projecting bilateral control to a master-follower teleoperation system with a pneumatic manipulator on the follower side, and evaluates its effectiveness. The proposed method directly projects the operating force on the master side to the driving force on the follower side, eliminating the need for both position control and external force detection on the follower side, thereby solving the problem of low rigidity and response delay of pneumatic manipulators and providing highly stable sensor-less force presentation against variable environments. In this study, dynamic response analyses of a 1-DOF master-follower system were performed by numerical simulation using a linear system model, followed by experimental verification by implementing an actual system with an external force estimator. The results showed that the proposed force-projecting bilateral control has significantly higher positioning rigidity and better force control stability than the conventional force-reflecting bilateral control. A theoretical consideration was also given using equivalent transformation of force transfer functions to provide evidence for the high stability.

Research on bidirectional human-machine interfaces will enable the smooth interaction with robotic platforms in contexts ranging from industry to tele-medicine and rescue. This paper introduces a bidirectional communication system to achieve multisensory telepresence during the gestural control of an industrial robotic arm. We complement the gesture-based control by means of a tactile-feedback strategy grounding on a spiking artificial neuron model. Force and motion from the robot are converted in neuromorphic haptic stimuli delivered on the user’s hand through a vibro-tactile glove. Untrained personnel participated in an experimental task benchmarking a pick-and-place operation. The robot end-effector was used to sequentially press six buttons, illuminated according to a random sequence, and comparing the tasks executed without and with tactile feedback. The results demonstrated the reliability of the hand tracking strategy developed for controlling the robotic arm, and the effectiveness of a neuronal spiking model for encoding hand displacement and exerted forces in order to promote a fluid embodiment of the haptic interface and control strategy. The main contribution of this paper is in presenting a robotic arm under gesture-based remote control with multisensory telepresence, demonstrating for the first time that a spiking haptic interface can be used to effectively deliver on the skin surface a sequence of stimuli emulating the neural code of the mechanoreceptors beneath.

Due to the limitations on the capabilities of current robots regarding task learning and performance, imitation is an efficient social learning approach that endows a robot with the ability to transmit and reproduce human postures, actions, behaviors, etc., as a human does. Stable whole-body imitation and task-oriented teleoperation via imitation are challenging issues. In this paper, a novel comprehensive and unrestricted real-time whole-body imitation system for humanoid robots is designed and developed. To map human motions to a robot, an analytical method called geometrical analysis based on link vectors and virtual joints (GA-LVVJ) is proposed. In addition, a real-time locomotion method is employed to realize a natural mode of operation. To achieve safe mode switching, a filter strategy is proposed. Then, two quantitative vector-set-based methods of similarity evaluation focusing on the whole body and local links, called the Whole-Body-Focused (WBF) method and the Local-Link-Focused (LLF) method, respectively, are proposed and compared. Two experiments conducted to verify the effectiveness of the proposed methods and system are reported. Specifically, the first experiment validates the good stability and similarity features of our system, and the second experiment verifies the effectiveness with which complicated tasks can be executed. At last, an imitation learning mechanism in which the joint angles of demonstrators are mapped by GA-LVVJ is presented and developed to extend the proposed system.

Supermedia streams transfer video, audio, haptic and other sensory data. Real -time transfering of supermedia streams over the Internet is quite challenging. This paper outlines the proposed protocols for transferring supermedia streams over the Internet. Moreover, it describes the Quality of Service (QoS) requirements for supermedia applications that a network has to fulfill. Extensive simulations and experiments for the performance evaluation of transport protocols for real time transferring HEVC streams with supermedia data are carried out. Complements, differences and relevancies between simulation and real world experiments are discussed. The metrics that are measured for the performance evaluation are delay, jitter, throughput, efficiency, packet loss and one proposed by the authors, packet arrival deviation. The simulation tests reveal which protocols could be used for the transfer of real-time supermedia data with a HEVC video stream.

The advancements in the study of the human sense of touch are fueling the field of haptics. This is paving the way for augmenting the sensory perception during objects palpation in tele-surgery, and reproducing the information through tactile feedback. Here, we present a novel tele-palpation apparatus that enables the user to detect nodules with various distinct stiffness buried in an ad-hoc polymeric phantom. The contact force measured by the platform was encoded using a neuromorphic model and reproduced on the index fingertip of a remote user through a haptic glove embedding a piezoelectric disk. We assessed the effectiveness of this feedback in allowing nodule identification under two experimental conditions of real-time telepresence: In Line of Sight (ILS), where the platform was placed in the visible range of a user; and the more demanding Not In Line of Sight (NILS), with the platform being 50 km apart. We found that the entailed percentage of identification was higher for stiffer inclusions with respect to the softer ones (average of 74% within the duration of the task), in both telepresence conditions evaluated. These promising results call for further exploration of tactile augmentation technology for telepresence in medical interventions.