Submitted:
17 December 2024
Posted:
18 December 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
1.1. Introduction of Research Needs and Research Background
- (1)
- High-caliber, accurately annotated datasets are indispensable for the development of Human Activity Recognition (HAR) models; however, the acquisition of such datasets necessitates considerable time and financial investment. Furthermore, a significant deficiency in the diversity of activities and participant demographics is observed within numerous datasets.
- (2)
- Sensor Constraints: Wearable devices equipped with accelerometers and gyroscopes are subject to constraints, notably with respect to energy autonomy, data retention capacity, and communication range. Experimental limitations may impact the feasibility of uninterrupted activity surveillance.
- (3)
- Identifying complex or overlapping activities continues to present a formidable challenge within the field. The detection of simple activities such as walking or running is more straightforward; however, the accurate classification of more complex activities that encompass multiple actions or require interactions with objects presents a greater challenge.
- (4)
- Real-time processing presents a significant challenge in the implementation of Human Activity Recognition (HAR) systems, particularly when aiming for low-latency data processing. The computational requirements of sophisticated algorithms are substantial, and their deployment is further complicated in resource-limited contexts such as mobile devices.
- (5)
- Privacy Concerns: The integration of wearable sensors for continuous health monitoring elicits significant concerns regarding the protection of personal privacy. Implementing protocols for the collection, storage, and processing of data that safeguard user privacy is of paramount importance.
1.2. Introduction of Mechanomyography (MMG) and Surface Electromyography (sEMG) in Human Activity Recognition
- (1)
- Sensitivity to Different Aspects:
- (2)
- Complementary Use:
- (3)
- Ease of Use:
1.3. Introduction of Regression Algorithm in Human Activity Recognition
- (1)
- Data Quality and Availability
- (2)
- Sensor Limitations
- (3)
- Algorithmic Challenges
- (4)
- User Variability and Adaptation
- (5)
- Contextual Understanding
1.4. Introduction of Mechanomyography Extraction
- (1)
- Utilize microphone sensors to collect MMG signals
- (2)
- Reduce limb movements during the experiment
- (3)
- Remove gesture artifact by filter
- (1)
- Signal integrity within Myoelectric signals, specifically those categorized as Multi-channel MMG signals, is frequently compromised by the presence of noise. This noise contamination is attributable to a multitude of variables, including but not limited to, the displacement of skin, the positioning of sensors, and the transmission of ambient vibrations. The difficulty in acquiring pristine and dependable data is thereby heightened.
- (2)
- Sensitivity Variability in MMG Sensors: Variations in the sensitivity of MMG sensors can introduce discrepancies during the data acquisition phase. High amplitude sensitivity is essential for the detection of minute muscle vibrations; however, this elevated sensitivity may concurrently augment the levels of noise encountered.
- (3)
- The current literature demonstrates a deficiency in standardized methodologies for the collection and subsequent analysis of MMG data. This absence of uniform protocols presents a significant obstacle to the comparative assessment of findings among disparate studies.
- (4)
- Data interpretation: The analysis of myoelectric manifestations of gastrocnemius activity necessitates the deployment of advanced algorithms and computational models, which currently remain in the phase of active refinement and development. The intricacy associated with the coordination of muscular movements contributes significantly to the challenge encountered in this domain.
- (5)
- Integration of MMG Measurement Modalities with Complementary Sensing Techniques: The amalgamation of Mechanomyography (MMG) with additional sensing modalities, such as electromyography (EMG) or accelerometry, enhances the breadth of physiological insights obtained. However, this concatenation of data streams necessitates sophisticated methodologies for data integration and subsequent analysis, thereby increasing the complexity associated with data fusion and interpretive processes.
1.5. Introduction of This Research
2. Materials and Methods
2.1. Experimental Process
2.2. MMG Signal Extraction Method Based on ICEEMDAN Algorithm
2.3. Human Joint Rotation Angle Estimation Model Based on SMA-BLS
2.3.1. Broad Learning System
- (1)
- Data Preparation:
- (2)
- Initialize Feature Nodes (FNs):
- (3)
- Enhancement Nodes (ENs) Generation:
- (4)
- Ridge Regression for Output Mapping:
- (5)
- Model Training and Prediction
- (6)
- Incremental Learning:
2.3.2. Slime Mould Algorithm
- (1)
- Initialization:
- (2)
- Fitness Evaluation:
- (3)
- Position Update:
- (4)
- Boundary Handling:
- (5)
- Fitness Re-evaluation:
- (6)
- Iteration:
3. Results
3.1. The Results of MMG Signal Extraction
3.2. The Results of MMG Signal Preprocessing
- (1)
- DC offset elimination;
- (2)
- Full-wave rectification;
- (3)
- Linear envelope extraction
- (4)
- Normalization.
3.3. Joint Angle Prediciotn Results
3.3.1. Forecasting Test Result of Single Person and Multi-Person
3.3.2. Forecasting Test Result of Different MMG Extraction Methods
3.3.3. Forecasting Test Result of Different Forecast Methods
| Method | MSE | RMSE | MAE | R2 | Training Time(s) | Forecast Time(ms) |
| SMA-BLS | 0.0017 | 0.0362 | 0.0095 | 0.971 | 195±15.48 | 14.15±0.95 |
| BLS | 0.0041 | 0.0661 | 0.0601 | 0.936 | 15±1.25 | 14.56±0.99 |
| CNN | 0.0046 | 0.0727 | 0.0657 | 0.938 | 268±16.58 | 30.15±2.81 |
| SVM | 0.0032 | 0.0536 | 0.0531 | 0.943 | 308±19.52 | 29.84±2.12 |
| BP | 0.0047 | 0.0679 | 0.0657 | 0.939 | 136.28±16.74 | 29.2±2.9 |
| ELM | 0.0041 | 0.0606 | 0.0803 | 0.938 | 291±20.54 | 31.48±3.21 |
| RF | 0.0045 | 0.0667 | 0.0801 | 0.935 | 251±20.81 | 36.58±3.51 |
| RBF | 0.0045 | 0.0673 | 0.0641 | 0.931 | 261±11.69 | 19.85±1.84 |
| LSTM | 0.0042 | 0.0682 | 0.0784 | 0.920 | 61.28±4.95 | 24.19±2.6 |
3.3.4. Forecasting Test Result of Different Processing Parameters
4. Discussion
- (1)
- Adaptive Noise Addition:
- (2)
- Complete Ensemble Approach:
- (3)
- Mode Mixing Reduction:
- (4)
- Computational Efficiency:
- (1)
- Incremental Learning:
- (2)
- Flat Network Structure:
- (3)
- Fast Training Speed:
- (4)
- High Accuracy:
- (5)
- BLS exhibits a low computational overhead due to the reduced number of parameters that necessitate optimization, thereby diminishing overall computational expenses and energy usage. This attribute is particularly advantageous in both cloud-centric and edge computing infrastructures.
- (1)
- Foraging Behavior:
- (2)
- Adaptability:
- (3)
- Self-Organization:
5. Conclusions
- (1)
- Signal Extraction and Processing:
- (2)
- Model Development:
- (3)
- Application Potential:
- (4)
- Validation and Performance:
Future Work:
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Vélez-Guerrero M A, Callejas-Cuervo M, Mazzoleni S. Artificial intelligence-based wearable robotic exoskeletons for upper limb rehabilitation: A review[J]. Sensors, 2021, 21(6): 2146. [CrossRef]
- Rodríguez-Fernández A, Lobo-Prat J, Font-Llagunes J M. Systematic review on wearable lower-limb exoskeletons for gait training in neuromuscular impairments[J]. Journal of neuroengineering and rehabilitation, 2021, 18(1): 22. [CrossRef]
- Crea S, Beckerle P, De Looze M, et al. Occupational exoskeletons: A roadmap toward large-scale adoption. Methodology and challenges of bringing exoskeletons to workplaces[J]. Wearable Technologies, 2021, 2: e11. [CrossRef]
- Jing H, Zheng T, Zhang Q, et al. Human Operation Augmentation through Wearable Robotic Limb Integrated with Mixed Reality Device[J]. Biomimetics, 2023, 8(6): 479. [CrossRef]
- Martinez-Hernandez U, Metcalfe B, Assaf T, et al. Wearable assistive robotics: A perspective on current challenges and future trends[J]. Sensors, 2021, 21(20): 6751. [CrossRef]
- Thalman C, Artemiadis P. A review of soft wearable robots that provide active assistance: Trends, common actuation methods, fabrication, and applications[J]. Wearable Technologies, 2020, 1: e3. [CrossRef]
- Gu F, Chung M H, Chignell M, et al. A survey on deep learning for human activity recognition[J]. ACM Computing Surveys (CSUR), 2021, 54(8): 1-34. [CrossRef]
- Kaseris M, Kostavelis I, Malassiotis S. A Comprehensive Survey on Deep Learning Methods in Human Activity Recognition[J]. Machine Learning and Knowledge Extraction, 2024, 6(2): 842-876. [CrossRef]
- Meng Z, Zhang M, Guo C, et al. Recent progress in sensing and computing techniques for human activity recognition and motion analysis[J]. Electronics, 2020, 9(9): 1357. [CrossRef]
- Minoru Shinohara; Motoki Kouzaki; Takeshi Yoshihisa; Tetsuo Fukunaga; "Mechanomyography of The Human Quadriceps Muscle During Incremental Cycle Ergometry", EUROPEAN JOURNAL OF APPLIED PHYSIOLOGY AND OCCUPATIONAL, 1997.
- Ugur Sahin; Ferat Sahin; "Pattern Recognition with Surface EMG Signal Based Wavelet Transformation", 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, 2012.
- Alexandre Balbinot; Gabriela Favieiro; "A Neuro-fuzzy System for Characterization of Arm Movements", SENSORS (BASEL, SWITZERLAND), 2013.
- Ondrej Kainz; Frantisek Jakab; "Approach to Hand Tracking and Gesture Recognition Based on Depth-Sensing Cameras and EMG Monitoring", ACTA INFORMATICA PRAGENSIA, 2014.
- Andrea, E. Frank; Alyssa Kubota; Laurel D. Riek; "Wearable Activity Recognition for Robust Human-robot Teaming in Safety-critical Environments Via Hybrid Neural Networks", 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT, 2019.
- Ali Moin; Andy Zhou; Abbas Rahimi; Alisha Menon; Simone Benatti; George Alexandrov; Senam Tamakloe; Jonathan Ting; Natasha Yamamoto; Yasser Khan; Fred Burghardt; Luca Benini; Ana C. Arias; Jan M. Rabaey; "A Wearable Biosensing System with In-sensor Adaptive Machine Learning for Hand Gesture Recognition", NATURE ELECTRONICS, 2020.
- Andrés Jaramillo-Yánez; Marco E Benalcázar; Elisa Mena-Maldonado; "Real-Time Hand Gesture Recognition Using Surface Electromyography and Machine Learning: A Systematic Literature Review", SENSORS (BASEL, SWITZERLAND), 2020.
- X. Sheng; Xuecong Ding; Weichao Guo; Lei Hua; Mian Wang; Xiangyang Zhu; "Toward An Integrated Multi-Modal SEMG/MMG/NIRS Sensing System for Human–Machine Interface Robust to Muscular Fatigue", IEEE SENSORS JOURNAL, 2021.
- Dorra Trabelsi; Samer Mohammed; Yacine Amirat; Latifa Oukhellou; "Activity Recognition Using Body Mounted Sensors: An Unsupervised Learning Based Approach", THE 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, 2012.
- Faicel Chamroukhi; Samer Mohammed; Dorra Trabelsi; Latifa Oukhellou; Yacine Amirat; "Joint Segmentation Of Multivariate Time Series With Hidden Process Regression For Human Activity Recognition", ARXIV-STAT.ML, 2013.
- Dorra Trabelsi; Samer Mohammed; Faicel Chamroukhi; Latifa Oukhellou; Yacine Amirat; "An Unsupervised Approach For Automatic Activity Recognition Based On Hidden Markov Model Regression", ARXIV-STAT.ML, 2013. (IF: 4).
- Michael S. Ryoo; Thomas J. Fuchs; Lu Xia; Jake K. Aggarwal; Larry H. Matthies; "Robot-Centric Activity Prediction from First-Person Videos: What Will They Do to Me?", 2015 10TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT, 2015.
- Skyler Seto; Wenyu Zhang; Yichen Zhou; "Multivariate Time Series Classification Using Dynamic Time Warping Template Selection For Human Activity Recognition", ARXIV-CS.AI, 2015.
- Khaled Safi; Samer Mohammed; Ferhat Attal; Mohamad Khalil; Yacine Amirat; "Recognition of Different Daily Living Activities Using Hidden Markov Model Regression", 2016 3RD MIDDLE EAST CONFERENCE ON BIOMEDICAL ENGINEERING, 2016.
- Faisal Sikder; Dilip Sarkar; "Log-Sum Distance Measures and Its Application to Human-Activity Monitoring and Recognition Using Data From Motion Sensors", IEEE SENSORS JOURNAL, 2017.
- Lu Peng; Shan Liu; Rui Liu; Lin Wang; "Effective Long Short-term Memory with Differential Evolution Algorithm for Electricity Price Prediction", ENERGY, 2018.
- Jacek Trelinski; Bogdan Kwolek; "Ensemble of Multi-channel CNNs for Multi-class Time-Series Classification. Depth-Based Human Activity Recognition", 2020.
- Wen Qi; Hang Su; Andrea Aliverti; "A Smartphone-Based Adaptive Recognition and Real-Time Monitoring System for Human Activities", IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2020.
- M. A. Islam, K. Sundaraj, R. B. Ahmad, N. U. Ahamed and M. A. Ali, "Mechanomyography Sensor Development, Related Signal Processing, and Applications: A Systematic Review," in IEEE Sensors Journal, vol. 13, no. 7, pp. 2499-2516, July 2013. [CrossRef]
- Y. Shi, W. Dong, W. Lin and Y. Gao, "Soft Wearable Robots: Development Status and Technical Challenges," in Sensors, vol. 22, no. 19, Art. no. 7584, Oct 2022. [CrossRef]
- Y. Shi, W. Dong, W. Lin, L. He, X. Wang, P. Li and Y. Gao, "Human Joint Torque Estimation Based on Mechanomyography for Upper Extremity Exosuit," in Electronics, vol. 11, no. 9, Art. no. 1335, Apr 2022. [CrossRef]
- M. O. Ibitoye, N. A. Hamzaid, J. M. Zuniga and A. K. A. Wahab, "Mechanomyography and muscle function assessment: A review of current state and prospects," in Clinical Biomechanics, vol. 29, no. 6, pp. 691-704, June 2014. [CrossRef]
- D. Wang, H. Wu, C. Xie and L. Gao, "Suppression of Motion Artifacts in Multichannel Mechanomyography Using Multivariate Empirical Mode Decomposition," in IEEE Sensors Journal, vol. 19, no. 14, pp. 5732-5739, 15 July15, 2019. [CrossRef]
- Li, L. Gao, W. Lu, D. Wang, H. Cao and G. Zhang, "A Novel Noise Suppression and Artifact Removal Method of Mechanomyography Based on RLS, IGWO-VMD, and CEEMDAN," in Journal of Sensors, vol. 2022, Art. no. 4239211. [CrossRef]
- L. J. Christiano and T. J. Fitzgerald, "The band pass filter," in international economic review, vol. 44, no. 2, pp. 435-465, June 2003. [CrossRef]
- S. F. Hussin, G. Birasamy and Z. Hamid, "Design of butterworth band-pass filter," in Politeknik & Kolej Komuniti Journal of Engineering and Technology, vol. 1, no. 1, Dec 2016.
- J. Casson, D. C. Yates, S. Patel and E. Rodriguez-Villegas, "An analogue bandpass filter realisation of the Continuous Wavelet Transform," 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France, 2007, pp. 1850-1854. [CrossRef]
- N. Rehman and D. P. Mandic. "Multivariate empirical mode decomposition." in Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 466, no. 2117, pp. 1291-1302, Dec 2009. [CrossRef]
- Y. Lei, J. Lin, Z. He and M. J. Zuo, "A review on empirical mode decomposition in fault diagnosis of rotating machinery," in Mechanical systems and signal processing, vol. 35, no. 1-2, pp. 108-126, Feb 2013. [CrossRef]
- M. Barbosh, P. Singh and A. Sadhu, "Empirical mode decomposition and its variants: A review with applications in structural health monitoring." in Smart Materials and Structures, vol. 29, no. 9, Aug 2020, Art. no. 093001. [CrossRef]
- Ran C, Xiao P, Luo Z, et al. Identification of pipeline intrusion signals based on ICEEMDAN-FE-AIT and F-ELM in the uwDAS system[J]. IEEE Sensors Journal, 2024.
- Kou Z, Yang F, Wu J, et al. Application of ICEEMDAN energy entropy and AFSA-SVM for fault diagnosis of hoist sheave bearing[J]. Entropy, 2020, 22(12): 1347. [CrossRef]
- Emeksiz C, Tan M. Wind speed estimation using novelty hybrid adaptive estimation model based on decomposition and deep learning methods (ICEEMDAN-CNN)[J]. Energy, 2022, 249: 123785. [CrossRef]
- Li X, Bu J, Yang Z, et al. A denoising method for loaded coal-rock charge signals based on a joint algorithm of IWT and ICEEMDAN[J]. IEEE Access, 2024. [CrossRef]
- Gong X, Zhang T, Chen C L P, et al. Research review for broad learning system: Algorithms, theory, and applications[J]. IEEE Transactions on Cybernetics, 2021, 52(9): 8922-8950. [CrossRef]
- Chen C L P, Liu Z. Broad learning system: An effective and efficient incremental learning system without the need for deep architecture[J]. IEEE transactions on neural networks and learning systems, 2017, 29(1): 10-24. [CrossRef]
- Zhang L, Li J, Lu G, et al. Analysis and variants of broad learning system[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 52(1): 334-344. [CrossRef]
- Li S, Chen H, Wang M, et al. Slime mould algorithm: A new method for stochastic optimization[J]. Future generation computer systems, 2020, 111: 300-323. [CrossRef]
- Chen H, Li C, Mafarja M, et al. Slime mould algorithm: a comprehensive review of recent variants and applications[J]. International Journal of Systems Science, 2023, 54(1): 204-235. [CrossRef]
- Gharehchopogh F S, Ucan A, Ibrikci T, et al. Slime mould algorithm: A comprehensive survey of its variants and applications[J]. Archives of Computational Methods in Engineering, 2023, 30(4): 2683-2723. [CrossRef]










| Parameters | Value |
| L2 regularization parameters and enhanced node reduction ratio | 0.968 |
| Number of windows in feature layer | 50 |
| Number of feature nodes per window in feature layer | 49 |
| The number of nodes in the enhancement layer | 199 |
| Subject Number | MSE | RMSE | MAE | R2 |
| 1 | 0.0019 | 0.0420 | 0.0102 | 0.953 |
| 2 | 0.0015 | 0.0329 | 0.0094 | 0.977 |
| 3 | 0.0021 | 0.0426 | 0.0131 | 0.939 |
| 4 | 0.0022 | 0.0430 | 0.0168 | 0.949 |
| 5 | 0.0026 | 0.0473 | 0.0193 | 0.934 |
| 6 | 0.0026 | 0.0470 | 0.0196 | 0.932 |
| 7 | 0.0029 | 0.0510 | 0.0232 | 0.938 |
| 8 | 0.0018 | 0.0406 | 0.0212 | 0.957 |
| 9 | 0.0026 | 0.0469 | 0.0287 | 0.943 |
| 10 | 0.0028 | 0.0490 | 0.0294 | 0.938 |
| 11 | 0.0025 | 0.0463 | 0.0279 | 0.934 |
| 12 | 0.0032 | 0.0525 | 0.0374 | 0.924 |
| Method | MSE | RMSE | MAE | R2 |
| SMA-BLS | 0.0017 | 0.0362 | 0.0095 | 0.971 |
| BLS | 0.0041 | 0.0661 | 0.0601 | 0.936 |
| Method | MSE | RMSE | MAE | R2 |
| ICEEMDAN | 0.0017 | 0.0362 | 0.0095 | 0.971 |
| ESMD | 0.0026 | 0.0492 | 0.0191 | 0.944 |
| FEMD | 0.0028 | 0.0494 | 0.0294 | 0.939 |
| VMD | 0.0038 | 0.0601 | 0.0415 | 0.924 |
| CEEMD | 0.0042 | 0.0685 | 0.0526 | 0.915 |
| EEMD | 0.0047 | 0.0705 | 0.0661 | 0.903 |
| EMD | 0.0048 | 0.0721 | 0.0659 | 0.902 |
| Parameters | MSE | RMSE | MAE | R2 |
| MMG Envelope order = 2 | 0.0017 | 0.0362 | 0.0095 | 0.971 |
| MMG Envelope order = 4 | 0.0039 | 0.0642 | 0.0542 | 0.936 |
| MMG Envelope order = 6 | 0.0036 | 0.0625 | 0.0561 | 0.938 |
| MMG Envelope order = 8 | 0.0048 | 0.0751 | 0.0652 | 0.921 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).