Version 1
: Received: 2 February 2022 / Approved: 4 February 2022 / Online: 4 February 2022 (14:30:40 CET)
How to cite:
Schulte, J.; Kocherovsky, M.; Paul, N.; Pleune, M.; Chung, C.-J. Human-Vehicle Leader-Follower Control using Deep Learning-Driven Gesture Recognition. Preprints2022, 2022020076. https://doi.org/10.20944/preprints202202.0076.v1
Schulte, J.; Kocherovsky, M.; Paul, N.; Pleune, M.; Chung, C.-J. Human-Vehicle Leader-Follower Control using Deep Learning-Driven Gesture Recognition. Preprints 2022, 2022020076. https://doi.org/10.20944/preprints202202.0076.v1
Schulte, J.; Kocherovsky, M.; Paul, N.; Pleune, M.; Chung, C.-J. Human-Vehicle Leader-Follower Control using Deep Learning-Driven Gesture Recognition. Preprints2022, 2022020076. https://doi.org/10.20944/preprints202202.0076.v1
APA Style
Schulte, J., Kocherovsky, M., Paul, N., Pleune, M., & Chung, C. J. (2022). Human-Vehicle Leader-Follower Control using Deep Learning-Driven Gesture Recognition. Preprints. https://doi.org/10.20944/preprints202202.0076.v1
Chicago/Turabian Style
Schulte, J., Mitchell Pleune and Chan-Jin Chung. 2022 "Human-Vehicle Leader-Follower Control using Deep Learning-Driven Gesture Recognition" Preprints. https://doi.org/10.20944/preprints202202.0076.v1
Abstract
Leader-follower autonomy (LFA) systems have so far only focused on vehicles following other vehicles. Though there have been several decades of research into this topic, there has not yet been any work on human-vehicle leader-follower systems. We present a system in which an autonomous vehicle — our ACTor 1 platform — can follow a human leader who controls the vehicle through gestures. We successfully developed a modular pipeline that uses artificial intelligence/deep learning to recognize hand-and-body gestures from a user in view of the vehicle’s camera and translate those gestures into physical action by the vehicle. We demonstrate our work using our ACTor 1 platform, a modified Polaris Gem 2 electric vehicle. This work has numerous applications, such as material transport in industrial contexts.
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.