Submitted:
24 July 2025
Posted:
25 July 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. ARGUS System Functionalities
2.1. Access Control and Monitoring
2.2. Incident Management
2.3. Perimeter Monitoring and Report Generation
3. Methodology
3.1. Integrated hardware and sensors
- The Raspberry Pi board video interface management, facial identification, and responsible for local processing of real-time data currents;
- Dedicated to network traffic analysis and infiltration detection on a ZimaBoard, running Snort and Suricata in parallel;
- An Arduino microcontroller that is used to interface with temperature, acoustic and touch/speed sensors;
- A comprehensive sensor suit, which includes ultrasonic sensor, 2D lidar, PIR, a directional microphone and an infrared camera, which are all climbed on an autonomous mobile chassis.
3.2. Software Architecture and Technologies Used
- OpenCV and MediaPipe for real-time video stream processing and facial recognition tasks;
- YOLOv8, manually trained, for detecting bladed weapons, suspicious objects, and vehicles;
- Snort and Suricata, deployed on the ZimaBoard, for identifying unauthorized scans and malicious traffic;
- CRON jobs for scheduled and automated report generation;
- Flask to manage the local API interface and inter-module communication;
- RabbitMQ as the backbone for asynchronous messaging between system components.
3.3. Operational Flow and Data Management
- whether a person is authorized, using multi-angle facial recognition;
- whether the individual is carrying a bladed weapon, through object classification algorithms;
- whether suspicious network activity is occurring, such as scans or unauthorized access attempts.
- automatically send real-time alerts via email and SMS to designated security personnel;
- log the events in the system and activate additional ARGUS units using distributed messaging protocols.
4. Experimental Evolution and Results
- message formatting;
- event logging and storage;
- alert prioritization logic;
- future scalability requirements.
5. Evaluation of visual detection capabilities
- Facial recognition of authorized/unauthorized persons;
- Detection of edged weapons (knives, batons, blunt objects) carried by suspicious persons.
- Face detection using the MediaPipe Face Detection model;
- Person recognition by comparing facial landmarks with the registered set;
- Weapon detection using the YOLOv8 model trained on a custom set of images (with edged weapon labels).
- integration of additional IR cameras;
- improvement of the training dataset with low-light images;
- adaptation of AI models through fine-tuning techniques for various environmental conditions.
6. Conclusions and Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| ARGUS | Autonomous Robotic Guard System |
| DoS | Denial-of-Service |
| IDS | Intrusion Detection Systems |
| LiDAR | Light Detection and Ranging |
| ML | Machine Learning |
| PIR | Passive Infrared |
| SLAM | Simultaneous Localization and Mapping |
| UMAD | University of Macau Anomaly Detection Benchmark Dataset |
References
- R. Soler, A. Moudni, G. Roskowski, X. Yu, M. Gormov and J. Saniie, “Autonomous Patrol and Threat Detection Through Integrated Mapping and Computer Vision,” 2024 IEEE International Conference on Electro Information Technology (eIT), Eau Claire, WI, USA, 2024, pp. 398-403. [CrossRef]
- J. Zhou, X. Wang, M. Chang, K. Chen, H. Li and Z. Xu, “Design and Implementation of an Intelligent Security Patrol Robot with Nighttime Dynamic Object Detection Functionality,” 2024 China Automation Congress (CAC), Qingdao, China, 2024, pp. 5409-5414. [CrossRef]
- Z. Zhang, P. Wang and K. Zhang, “Research on Path Planning Optimization for Patrol Robot based on Sparse Subspace Clustering Algorithm,” 2024 International Conference on New Power System and Power Electronics (NPSPE), Dalian, China, 2024, pp. 154-159. [CrossRef]
- C. Choe, S. Lee and N. Sung, “Scene Change Detection for Robotic Patrol System,” 2024 Eighth IEEE International Conference on Robotic Computing (IRC), Tokyo, Japan, 2024, pp. 114-115. [CrossRef]
- M. S. Sepeeh, S. A. -L. Nagarajan, M. E. O. Nguba, H. F. Jamahori, S. A. Zulkifli and R. Jackson, “Development of Autonomous Mobile Robot Based IoTs Integration for Surveillance Guard,” 2024 IEEE 22nd Student Conference on Research and Development (SCOReD), Selangor, Malaysia, 2024, pp. 323-327. [CrossRef]
- V. V. Kumar, M. Shrimali, N. Shaik, R. K. N, N. Garg and R. Maranan, “Navigating the Dark: Advances in Robotic Night Patrol with D-Block Mask Electric EEL Dense Nested R-CNN for Enhanced Safety,” 2024 4th International Conference on Sustainable Expert Systems (ICSES), Kaski, Nepal, 2024, pp. 1034-1041. [CrossRef]
- B. Yaragani, S. S. Raju, S. R. Ragi, S. V. Cheemala and A. Lohith, “Women Safety Night Patrolling Robot Using Raspberry Pi 3,” 2024 International Conference on Computing and Intelligent Reality Technologies (ICCIRT), Coimbatore, India, 2024, pp. 1-6. [CrossRef]
- S. -H. Lee, Y. Jung and S. -W. Seo, “Imagination-Augmented Hierarchical Reinforcement Learning for Safe and Interactive Autonomous Driving in Urban Environments,” in IEEE Transactions on Intelligent Transportation Systems, vol. 25, no. 12, pp. 19522-19535, Dec. 2024. [CrossRef]
- H. Mochizuki and R. Kiyohara, “Stationary Human Detection Method Using 2D LiDAR,” 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC), Osaka, Japan, 2024, pp. 1699-1704. [CrossRef]
- C. -W. Chen, G. -Y. Lee and J. -S. Liu, “Human-Robot Collaboration in Unmanned Aerial Vehicle River Patrol Application,” 2024 International Conference on Advanced Robotics and Intelligent Systems (ARIS), Taipei, Taiwan, 2024, pp. 1-6. [CrossRef]
- W. Zezhao, C. Haitao, H. Zhenkun, K. Lingyu and W. Luyao, “Application of UAV Autonomous Flight Path Planning Technology in Power Inspection System,” 2024 IEEE 4th International Conference on Electronic Technology, Communication and Information (ICETCI), Changchun, China, 2024, pp. 1208-1212. [CrossRef]
- D. Zhang, Z. Liu, X. Wang, J. Qi, Y. Zhou and Q. Zhou, “Research on Aircraft Patrol Inspection Method Using UAV Based on YOLO Algorithm,” 2024 4th International Conference on Electronic Information Engineering and Computer (EIECT), Shenzhen, China, 2024, pp. 412-415. [CrossRef]
- L. Echefu, T. Alam and A. A. R. Newaz, “Randomized Multi-Robot Patrolling with Unidirectional Visibility,” 2024 21st International Conference on Ubiquitous Robots (UR), New York, NY, USA, 2024, pp. 324-329. [CrossRef]
- M. Xu, C. Li, C. Liu, S. Wang and Y. Tian, “Autonomous Location and Obstacle Avoidance of Inspection Robots Based on Multi-modal Information,” 2024 3rd International Conference on Energy, Power and Electrical Technology (ICEPET), Chengdu, China, 2024, pp. 1948-1954. [CrossRef]
- M. S. Azim Mohd Saufi, W. Nurshazwani Wan Zakaria and R. Tomari, “Security Patrolling System for Autonomous Navigation of Service Mobile Robot,” 2024 IEEE 2nd International Conference on Electrical Engineering, Computer and Information Technology (ICEECIT), Jember, Indonesia, 2024, pp. 308-313. [CrossRef]
- C. Li and S. Guo, “Study on the Backstepping Sliding Mode-Based Tracking Control Method for the SUR,” 2024 IEEE International Conference on Mechatronics and Automation (ICMA), Tianjin, China, 2024, pp. 1759-1764. [CrossRef]
- N. R, P. U. S, M. Mohan, N. S, A. Mohan and J. Samuel, “Voice Controlled Moving Robot for Smart Surveillance,” 2024 5th International Conference on Circuits, Control, Communication and Computing (I4C), Bangalore, India, 2024, pp. 354-359. [CrossRef]
- D. Li, L. Chen, C. -Z. Xu and H. Kong, “UMAD: University of Macau Anomaly Detection Benchmark Dataset,” 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, United Arab Emirates, 2024, pp. 5836-5843. [CrossRef]
- Q. Zhang et al., “E-Argus: Drones Detection by Side-Channel Signatures via Electromagnetic Radiation,” in IEEE Transactions on Intelligent Transportation Systems, vol. 25, no. 11, pp. 18978-18991, Nov. 2024. [CrossRef]
- Fen Xu, ZhengXi Li and Kui Yuan, “The design and implementation of an autonomous campus patrol robot,” 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, 2007, pp. 250-255. [CrossRef]
- S. -W. Hsiao and C. -N. Wu, “A KE, DSM and ISM Based Approach for Patrol Robot Development,” 2018 International Conference on Control and Robots (ICCR), Hong Kong, China, 2018, pp. 30-34. [CrossRef]
- Jihong Lee et al., “Operating a six-legged outdoor patrol robot,” 2007 International Conference on Control, Automation and Systems, Seoul, Korea (South), 2007, pp. 1034-1039. [CrossRef]
- Q. Yang, F. Xu, D. Qu, Y. Hong and Y. Zhuang, “Ground Moving Target Tracking for a Patrol Robot Based on Monocular Vision,” 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Honolulu, HI, USA, 2017, pp. 159-163. [CrossRef]
- F. Lastname, “Design and Implementation of Intelligent Patrol Robot for Secondary Equipment Based on Lidar Technology,” 2019 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC), Macao, China, 2019, pp. 1-4. [CrossRef]









| Characteristic | Face Recognition | Weapon Detection |
|---|---|---|
| Average Processing Time (ms) | 180 | 240 |
| Detection Accuracy (%) | 92.7 | 89.3 |
| False Positive Rate (%) | 3.2 | 4.1 |
| False Negative Rate (%) | 4.1 | 5.8 |
| Testing Conditions | Natural and Artificial Light | Natural and Artificial Light |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).