Working Paper Article Version 1 This version is not peer-reviewed

Federated Imitation Learning: A Privacy Considered Imitation Learning Framework for Cloud Robotic Systems with Heterogeneous Sensor Data

Version 1 : Received: 19 October 2019 / Approved: 20 October 2019 / Online: 20 October 2019 (15:47:22 CEST)

How to cite: Liu, B.; Wang, L.; Liu, M.; Xu, C. Federated Imitation Learning: A Privacy Considered Imitation Learning Framework for Cloud Robotic Systems with Heterogeneous Sensor Data. Preprints 2019, 2019100234 Liu, B.; Wang, L.; Liu, M.; Xu, C. Federated Imitation Learning: A Privacy Considered Imitation Learning Framework for Cloud Robotic Systems with Heterogeneous Sensor Data. Preprints 2019, 2019100234

Abstract

Humans are capable of learning a new behavior by observing others perform the skill. Similarly, robots can also implement this by imitation learning. Furthermore, if with external guidance, humans can master the new behavior more efficiently. So how can robots achieve this? To address the issue, we present Federated Imitation Learning (FIL) in the paper. Firstly, a knowledge fusion algorithm is proposed for the cloud fusing knowledge from local robots. Then, a knowledge transfer scheme is presented to facilitate local robots acquiring knowledge from the cloud. With FIL, a robot is capable of utilizing knowledge from other robots to increase its imitation learning in accuracy and training efficiency. FIL considers information privacy and data heterogeneity when robots share knowledge. It is suitable to be deployed in cloud robotic systems. Finally, we conduct experiments of a simplified self-driving task for robots (cars). The experimental results demonstrate that FIL increases imitation learning efficiency and accuracy of local robots in cloud robotic systems.

Subject Areas

federated learning; imitation learning; cloud robotic system

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.