Submitted:
21 June 2023
Posted:
21 June 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Knee rehabilitation Background Information
3. Proposed System Architecture
3.1. Data aquition and experimentation setup
4. Machine Learning Process
4.1. Machine Learning Model Training
- Window size is 5000ms and Window increase 50ms. The window size is the size of the raw features that is used for the training. The window increase is used to artificially create more features (and feed the learning block with more information)
- The number of training cycles was chosen to be 50 and the learning rate was 0.0005.
4.2. Machine Learning Model Creation
4.3. Machine Learning Event Detection-Classification
| Prediction | Length | Anomaly | Accuracy |
|---|---|---|---|
| 45 | 10 sec | -0,21 | 100% |
| 60 | 5 sec | -0,16 | 100% |
| 20 | 15 sec | -0,12 | 100% |
| 120 | 15 sec | -0,34 | 100% |
| 120 | 15 sec | -0,27 | 100% |
| 90 | 15 sec | -0,25 | 100% |
| 90 | 15 sec | -0,23 | 100% |
| 60 | 15 sec | -0,26 | 100% |
| 60 | 15 sec | -0,27 | 100% |
| 45 | 15 sec | -0,20 | 100% |
| 45 | 15 sec | -0,19 | 100% |
| 20 | 15 sec | -0,25 | 100% |
| 20 | 15 sec | -0,17 | 100% |
4.4. Edge computing implementation and performance evaluation
- One of the critical challenges when executing a ML at the cloud stem from the great volume to data that need to be acquired from the sensors and transferred wirelessly. This is especially pronounced when low bandwidth IoT communication technologies are utilized like the highly popular and widely integrated BLE communication protocol. In such cases the wireless network can easily fall into high congestion scenarios with negative effects on throughput, transmission delay and data transfer reliability metrics. This is where edge computing paradigm comes into play and can drastically reduce all these negative effects since instead of continuously streaming all the sensor raw data, the embedded platform can just send a single event detected, when it is detected. This can drastically reduce the required bandwidth effectively avoiding congestion situation as well as allowing for higher number of wireless sensors to share the same transmission medium. This case is clearly depicted in the proposed system case as follow: For each classification a batch of 60kbytes must be transferred to the cloud server. This exact transfer is achieved through a USB cable. Using the sensors of the embedded device, and before the execution of the algorithm, the sampling is completed and the data are used right away with no need for any sample transfer. In the cloud method the whole batch of measurements is transferred from the Arduino to the cloud, which is 60 kb, while in the on-device method, only the result of the prediction is transferred via BLE, which is 2-3 bytes. So, there is a bandwidth reduction of 99,9%. If consider that no event is identified (e.g. because the user is resting) then as it can easily be understood the bandwidth conservation can reach 100%.
- Another advantage promised by edge computing is reduced event detection latency in the sense that the need for data to be transferred to the cloud infrastructure to actually detect the event is effectively omitted. Such approach can significantly improve the real-time data processing and feedback provision. This is especially critical in cases where virtual coaching is offered where monitoring and feedback on specific exercises need to comply with strict time constrained demands. With the on-device method the process of sending data from the Arduino to the edge impulse platform that is on the cloud using a USB cable is bypassed. In the cloud method there is the extra step of uploading the sample data, which requires approximately 13 sec, while the ‘on device’ algorithm needs about 8 seconds. So, the on-device method achieves 39% time reduction in the prediction process.
- Furthermore, the fact that only detected events need to be wirelessly transmitted instead of continuously streaming all raw acquired data, allows the system to deactivate the wireless interface for extended periods of time contributing to power conservation. Considered that the wireless interfaces on such low power IoT devices comprises one of the most power-hungry components, it is easily extracted that such capability can drastically increase the lifetime and autonomy of respective devices being a possibly critical feature when commercialization is considered.
- Finally, a qualitative advantage concerns user privacy and safety of the data comprising an equally important advantage of edge computing especially in the health domain. Edge devices have the ability to discard information that need to be kept private, as only certain information and with special encoding.
4.5. Challenges for future work
5. Conclusions
Acknowledgments
Ethical Statements
References
- Spekowius, G.; Wendler, T. (Eds.) . Advances in healthcare technology: shaping the future of medical care; Springer Science & Business Media, 2006; Volume 6.
- Czaja, S.; Beach, S.; Charness, N.; Schulz, R. Older adults and the adoption of healthcare technology: Opportunities and challenges. Technologies for active aging, 2013; pp. 27-46. [CrossRef]
- Sundaravadivel, P. , Kougianos, E., Mohanty, S. P., & Ganapathiraju, M. K. Everything you wanted to know about smart health care: Evaluating the different technologies and components of the internet of things for better health. IEEE Consumer Electronics Magazine, 2017; Volume 7(1), pp. 18-28. [CrossRef]
- Poitras, I. , Dupuis, F., Bielmann, M., Campeau-Lecours, A., Mercier, C., Bouyer, L. J., & Roy, J. S. Validity and reliability of wearable sensors for joint angle estimation: A systematic review. Sensors, 2019; Volume 19(7), pp. 1555. [CrossRef]
- Dejnabadi, H. , Jolles, B. M., & Aminian, K. A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes. IEEE Transactions on Biomedical Engineering, 2005; Volume 52(8), pp. 1478-1484. [CrossRef]
- Godfrey, A. C. R. M. D. O. G. , Conway, R., Meagher, D., & ÓLaighin, G. Direct measurement of human movement by accelerometry. Medical engineering & physics, 2008; Volume 30(10), pp. 1364-1386. [CrossRef]
- Tsoukas, V. , Boumpa, E., Giannakas, G., & Kakarountas, A. A review of machine learning and tinyml in healthcare. In 25th Pan-Hellenic Conference on Informatics 2021; pp. 69-73.
- Fedorov, I., Stamenovic, M., Jensen, C., Yang, L. C., Mandell, A., Gan, Y., ... & Whatmough, P. N. TinyLSTMs: Efficient neural speech enhancement for hearing aids. 2020; arXiv preprint arXiv:2005.11138. arXiv:2005.11138. [CrossRef]
- Fyntanidou, B. , Zouka, M., Apostolopoulou, A., Bamidis, P. D., Billis, A., Mitsopoulos, K.,... & Fourlis, A.. IoT-based smart triage of Covid-19 suspicious cases in the Emergency Department. In 2020 IEEE Globecom Workshops, 2020; pp. 1-6.
- Gupta, S. , Jain, S., Roy, B., & Deb, A. A TinyML Approach to Human Activity Recognition. In Journal of Physics: Conference Series, 2022 ; Vol. 2273, No. 1, p. 012025. IOP Publishing. [CrossRef]
- Warden, P. , & Situnayake, D. Tinyml: Machine learning with tensorflow lite on arduino and ultra-low-power microcontrollers. O'Reilly Media, 2019.
- Weber, M. D. , & Woodall, W. R.. Knee rehabilitation. Physical Rehabilitation of the Injured Athlete; Expert Consult-Online and Print, 2012; 377.
- American Orthopaedic Society for Sports Medicine:. 2023. Available online: https://www.sportsmed.org (accessed on 29 March 2023).
- Inacio, M. , Paxton, E. W., Graves, S. E., Namba, R. S., & Nemes, S. Projected increase in total knee arthroplasty in the United States - an alternative projection model. Osteoarthritis and cartilage, 2017; 25(11), 1797–1803. [CrossRef]
- Bell, K. M. , Onyeukwu, C., Smith, C. N., Oh, A., Devito Dabbs, A., Piva, S. R.,... & McClincy, M. P. A portable system for remote rehabilitation following a total knee replacement: a pilot randomized controlled clinical study. Sensors, 2020; Volume 20(21), pp. 6118. [CrossRef]
- Burland, J. P. , Outerleys, J. B., Lattermann, C., & Davis, I. S. Reliability of wearable sensors to assess impact metrics during sport-specific tasks. Journal of sports sciences, 2021; Volume 39(4), pp. 406-411. [CrossRef]
- Luna, I.E.; Kehlet, H.; Peterson, B.; Wede, H.R.; Hoevsgaard, S.J.; Aasvang, E.K. Early patient-reported outcomes versus objective function after total hip and knee arthroplasty. Bone Jt. J. 2017; Volume 99-B, pp. 1167–1175. [CrossRef]
- Yi, C. , Jiang, F., Bhuiyan, M. Z. A., Yang, C., Gao, X., Guo, H.,... & Su, S. Smart healthcare-oriented online prediction of lower-limb kinematics and kinetics based on data-driven neural signal decoding. Future Generation Computer Systems, 2021; Volume 114, pp. 96-105. [CrossRef]
- Edge Impulse. Available online: https://www.edgeimpulse.com/ (accessed on 21 February 2023).
- Arduino, cc. Available online:. Available online: https://docs.arduino.cc/hardware/nano-33-ble-sense (accessed on 21 February 2023).
- Antonopoulos, C. P. , Antonopoulos, K., Panagiotou, C., & Voros, N. S. Tackling Critical Challenges towards Efficient CyberPhysical Components & Services Interconnection: The ATLAS CPS Platform Approach. Journal of Signal Processing Systems, 2019; Volume 91(11-12), pp. 1273-1281. [CrossRef]
- Knee angle recognition dataset. Available online: https://www.kaggle.com/datasets/billskarm/knee-range-of-motion (accessed on 18 March 2023).








| Activity | Required Knee Range of Motion |
|---|---|
| Walk without a Limp | 70o |
| Safely climb stairs | 83o |
| Safely descend stairs | 90o |
| Get in and out of car | 100o |
| Get up from chair | 105o |
| Ride a Bike | 115o |
| Garden | 117o |
| Squat | 125o |
| Number of training Cycles | 50 |
| Learning Rate | 0.0005 |
| Validation set size | 20% |
| Sampling Frequency | 62,5 (Hz) |
| Input layer | 33 features |
| First Dense layer | 20 neurons |
| Second Dense layer | 10 neurons |
| Accuracy | F1 | |||||||
|---|---|---|---|---|---|---|---|---|
| 20 | 45 | 60 | 90 | 120 | Overall | |||
| Training | Goniometer | 100% | 100% | 99,5% | 94,9% | 93,65% | 97,61% | 0,98 |
| Goniometer on knee | 100% | 100% | 95,7% | 100% | 100% | 99,1% | 0,99 | |
| Knee brace | 100% | 100% | 100% | 100% | 100% | 100% | 1.00 | |
| Classification | Goniometer | 87,2% | 76,6% | 84,2% | 99,8% | 99,5% | 88,45% | 0,92 |
| Goniometer on knee | 100% | 69,7% | 73,4% | 76,4% | 79,6% | 78,54% | 0,84 | |
| Knee brace | 100% | 100% | 100% | 100% | 100% | 100% | 1.00 | |
| Cloud | On Device | ||
|---|---|---|---|
| Classification | Goniometer | 88,45% | 87,4% |
| Goniometer on knee | 78,54% | 80,03% | |
| Knee brace | 100% | 100% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).