Submitted:
17 October 2024
Posted:
17 October 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
- Use of wireless pressure sensor-embedded smart insole to collect dynamic plantar pressure data during gait for classification of healthy and diabetic feet.
- Use of feature extraction from the dynamic plantar pressure data obtained from smart insoles, which can classify healthy and diabetic feet accurately.
- Performance comparison of different machine learning models and identify the optimal model for classification of diabetic feet.
- Comparing the statistic-based and machine learning models for healthy and diabetic feet classification.
2. Related Work
2.1. Manual Inspections by Healthcare Providers
2.2. Foot Thermal Analysis
2.3. Foot Imaging Analysis
2.4. Plantar Pressure Analysis
3. Materials and Methods
3.1. Smart Insole (SuraSole)
3.1.1. Calibration
3.1.2. Validation
3.2. Data Collection
3.3. Data Preprocessing
- Peak plantar pressure (PPP): The maximum amount of pressure exerted on the plantar surface (smart insole) of the foot during gait.
-
Pressure time integral (PTI): The cumulative pressure experienced by the foot over over the duration of the gait cycle. It provides a summary of the total pressure distribution and load on the footwhere P(t) = pressure at a given time interval .
- Forefoot-to-rearfoot ratio (F/R ratio): The distribution of pressure between the front part of the foot (forefoot) and the rear part of the foot (rearfoot).
4. Experiments and Results
- Phase 1 Statistical Significance Test: The objective of this experiment is to compute which parameters are significant for classification. We applied an independent sample t-test on the 18 extracted parameters. The significant parameters will be selected for the next phase of experiment.
- Phase 2 Statistic-based Classification Model: The objective of this experiment is to classify healthy and diabetic feet based on the selected significant parameters from Phase 1. Threshold values were extracted from each significant parameter for this classification model. The model was assessed based on the accuracy, sensitivity, specificity, and F1-score performance metrics.
- Phase 3 Machine Learning Classification Model: The objective of this experiment is to classify healthy and diabetic feet using machine learning (ML) models. Specifically, nine ML models were utilized: Support Vector Machine (SVM), Random Forest (RF), Logistic Regression (LR), Naive Bayes (NB), Decision Tree (DT), K-Nearest Neighbor (KNN), Extreme Gradient Boosting (XGBoost), Light Gradient-Boosting Machine (LightGBM), and Adaptive Boosting (AdaBoost). Deep learning models were excluded due to their lack of transparency and high computational demands [36,37], making traditional machine learning models more suitable for tasks requiring interpretability, such as healthcare [38]. These ML models were assessed based on performance metrics, including accuracy, sensitivity, specificity, F1-score, and Area Under Curve (AUC).
Phase 1: Statistical Significance Test
Phase 2: Statistic-based Classification Model
Phase 3: Machine Learning Classification Model
4.0.1. Principal Component Analysis (PCA)
5. Discussion
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- “Facts & figures,” International Diabetes Federation. https://idf.org/about-diabetes/diabetes-facts-figures/ (accessed Aug. 03, 2023).
- Zhang Y, Lazzarini PA, McPhail SM, van Netten JJ, Armstrong DG, Pacella RE (2020) Global disability burdens of diabetes related lower-extremity complications in 1990 and 2016. Diabetes Care 43(5):964–974. [CrossRef]
- Armstrong DG, Boulton AJM, Bus SA (2017) Diabetic foot ulcers and their recurrence. N Engl J Med 376(24):2367–2375. https:// doi.org/10.1056/NEJMra1615439.
- Lazzarini PA, Hurn SE, Kuys SS et al (2017) The silent overall burden of foot disease in a representative hospitalised population. Int Wound J 14(4):716–728. [CrossRef]
- Lo, Z. J. , Surendra, N. K., Saxena, A., & Car, J. (2021). Clinical and economic burden of diabetic foot ulcers: A 5-year longitudinal multi-ethnic cohort study from the tropics. International wound journal, 18(3), 375–386. [CrossRef]
- Astrada, A., Nakagami, G., & Sanada, H. (2024). Challenges in Biofilm Identification in Diabetic Foot Infections: Review of Literature. The international journal of lower extremity wounds, 15347346241273112. Advance online publication. [CrossRef]
- “monofilament testing in diabetic foot - Primary Care Notebook,” https://primarycarenotebook.com/simplepage.cfm?ID=x2020063010498191128 (accessed Jan. 13, 2023).
- Cruz-Vega, I., Hernandez-Contreras, D., Peregrina-Barreto, H., Rangel-Magdaleno, J. J., & Ramirez-Cortes, J. M. (2020). Deep Learning Classification for Diabetic Foot Thermograms. Sensors (Basel, Switzerland), 20(6), 1762. [CrossRef]
- Khandakar A, Chowdhury MEH, Ibne Reaz MB, et al. A machine learning model for early detection of diabetic foot using thermogram images. Comput Biol Med. 2021;137:104838. [CrossRef]
- K. Munadi et al., “A Deep Learning Method for Early Detection of Diabetic Foot Using Decision Fusion and Thermal Images,” Applied Sciences, vol. 12, no. 15, p. 7524, Jul. 2022. [CrossRef]
- "Diabetic foot ulcer classification using sequential cnn algorithm." International Research Journal Of Modernization In Engineering Technology And Science (2024). [CrossRef]
- M. Goyal, N. D. Reeves, A. K. Davison, S. Rajbhandari, J. Spragg and M. H. Yap, "DFUNet: Convolutional Neural Networks for Diabetic Foot Ulcer Classification," in IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 4, no. 5, pp. 728-739, Oct. 2020. [CrossRef]
- S, Sudha. "Detection of Diabetic Foot Ulcers Using Dense Net Framework." International journal of innovative research in information security, 10 (2024). [CrossRef]
- Garima, Verma. "Leveraging smart image processing techniques for early detection of foot ulcers using a deep learning network." Polish Journal of Radiology, (2024). [CrossRef]
- Fernando ME, Crowther RG, Lazzarini PA, et al. Plantar pressures are higher in cases with diabetic foot ulcers compared to controls despite a longer stance phase duration. BMC Endocr Disord. 2016;16(1):51. Published 2016 Sep 15. [CrossRef]
- Ahsan M, Shanab AA, Nuhmani S. Plantar Pressure Distribution Among Diabetes and Healthy Participants: A Cross-sectional Study. Int J Prev Med. 2021;12:88. Published 2021 Jul 9. [CrossRef]
- Luger E, Nissan M, Karpf A, Steinberg E, Dekel S. Dynamic pressures on the diabetic foot. Foot Ankle Int. 2001;22(9):715-719. [CrossRef]
- Jay, Dicharry., Jason, R., Franz., Ugo, Della, Croce., Robert, P., Wilder., Patrick, O., Riley., D., Casey, Kerrigan. "Differences in Static and Dynamic Measures in Evaluation of Talonavicular Mobility in Gait." Journal of Orthopaedic & Sports Physical Therapy, 39 (2009).:628-634. [CrossRef]
- “Monofilament testing withstands critiques | Lower Extremity Review Magazine,” lermagazine.com, Jan. 17, 2012. https://lermagazine.com/article/monofilament-testing-withstands-critiques (accessed Feb. 11, 2023).
- Ashok, Bhargavi & K.A, Sunitha & Janarthan, Kumar. (2020). Plantar temperature and vibration perception in patients with diabetes: A cross-sectional study. Biocybernetics and Biomedical Engineering. 40. 1600-1610. [CrossRef]
- Adam, Muhammad et al. “Computer aided diagnosis of diabetic foot using infrared thermography: A review.” Computers in biology and medicine vol. 91 (2017): 326-336. [CrossRef]
- Hernandez-Contreras, D. & Peregrina-Barreto, Hayde & Rangel-Magdaleno, José & Gonzalez, Jesus. (2016). Narrative Review: Diabetic Foot and Infrared Thermography. Infrared Physics & Technology. 78. [CrossRef]
- Aylwin PE, Racinais S, Bermon S, Lloyd A, Hodder S, Havenith G. The use of infrared thermography for the dynamic measurement of skin temperature of moving athletes during competition; methodological issues. Physiol Meas. 2021;42(8):10.1088/1361-6579/ac1872. Published 2021 Aug 2. [CrossRef]
- Leyla, Gödekmerdan, Önder. "Imaging Modalities in Radiology: X-ray, CT, MRI, and Ultrasound." (2023). [CrossRef]
- V. Thambawita, I. Strümke, S. A. Hicks, P. Halvorsen, S. Parasa, and M. A. Riegler, “Impact of Image Resolution on Deep Learning Performance in Endoscopy Image Classification: An Experimental Study Using a Large Dataset of Endoscopic Images,” Diagnostics, vol. 11, no. 12, p. 2183, Nov. 2021. [CrossRef]
- MacWilliams, Bruce & Armstrong, P.F.. (2000). Clinical applications of plantar pressure measurement in pediatric orthopedics. Pediatr. Gait. [CrossRef]
- Malindu, E., Fernando., Robert, G., Crowther., Elise, Pappas., Peter, A, Lazzarini., Margaret, Cunningham., Kunwarjit, S., Sangla., Petra, Buttner., Jonathan, Golledge. "Plantar pressure in diabetic peripheral neuropathy patients with active foot ulceration, previous ulceration and no history of ulceration: A meta-analysis of observational studies." (2014).
- Kevin, R., Murphy., Brett, Myors. "Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests." (1998).
- Robert, V., Hogg., Elliot, A., Tanis. Probability and Statistical Inference. (1977).
- Bzdok, D., Altman, N. & Krzywinski, M. Statistics versus machine learning. Nat Methods 15, 233–234 (2018),. [CrossRef]
- Christina, Orphanidou., David, Wong. Machine Learning Models for Multidimensional Clinical Data. (2017).177-216. [CrossRef]
- Yifan, Li., Xiaohui, Yu., Nick, Koudas. (2021). Data Acquisition for Improving Machine Learning Models. D: arXiv. [CrossRef]
- Wenjuan, Wang., Martin, Kiik., Niels, Peek., Vasa, Curcin., Iain, J., Marshall., Anthony, Rudd., Yanzhong, Wang., Abdel, Douiri., Charles, D.A., Wolfe., Benjamin, Bray. "A systematic review of machine learning models for predicting outcomes of stroke with structured data." PLOS ONE, 15 (2020).:1-16. [CrossRef]
- “Biomechanics and life sciences | Kistler,” www.kistler.com. https://www.kistler.com/INT/en/biomechanics-and-life-sciences/C00000187 (accessed June. 21, 2023).
- F. Schoonjans, “Sample size calculation: Bland-Altman plot,” MedCalc. https://www.medcalc.org/manual/sample-size-bland-altman.php.
- Talaei Khoei, T., Ould Slimane, H. & Kaabouch, N. Deep learning: systematic review, models, challenges, and research directions. Neural Comput & Applic 35, 23103–23124 (2023). [CrossRef]
- "Understanding from Machine Learning Models." The British Journal for the Philosophy of Science, 73 (2022). [CrossRef]
- Nikita, Silaparasetty. (2020). Machine Learning vs. Deep Learning. 57-65. [CrossRef]
- Caselli A, Pham H, Giurini JM, Armstrong DG, Veves A. The forefoot-to-rearfoot plantar pressure ratio is increased in severe diabetic neuropathy and can predict foot ulceration. Diabetes Care. 2002;25(6):1066-1071. [CrossRef]
- L. Buitinck, G. Louppe, M. Blondel, F. Pedregosa, A. Mueller, et al., "API design for machine learning software: experiences from the scikit-learn project," European Conference on Machine Learning and Principles and Practices of Knowledge Discovery in Databases, Sep 2013, Prague, Czech Republic.
- “What is Boosting? Guide to Boosting in Machine Learning - AWS,” Amazon Web Services, Inc. https://aws.amazon.com/what-is/boosting/.
- “Beginners Guide to Naive Bayes Algorithm in Python,” Analytics Vidhya, Jan. 16, 2021. https://www.analyticsvidhya.com/blog/2021/01/a-guide-to-the-naive-bayes-algorithm/.
- LaValle, Steven M., Michael S. Branicky, and Stephen R. Lindemann. “On the Relationship between Classical Grid Search and Probabilistic Roadmaps.” The International Journal of Robotics Research 23, no. 7–8 (August 2004): 673–92. [CrossRef]
- AdaBoost Algorithm in Machine Learning. AlmaBetter. (n.d.). https://www.almabetter.com/bytes/tutorials/data-science/adaboost-algorithm.











| Parameter | Abbreviation | Healthy (126) | Diabetes (117) | t | P value | ||||
|---|---|---|---|---|---|---|---|---|---|
| Mean | SD | Means | SD | ||||||
| Peak Plantar Pressure | Left foot | Forefoot | PPP_FL | 102.87 | 32.78 | 126.35 | 43.47 | -4.7 | 0.000004* |
| Midfoot | PPP_ML | 74.23 | 31.59 | 87.56 | 45.85 | -2.6 | 0.0097* | ||
| Heel | PPP_HL | 167.48 | 63.19 | 167.02 | 60.75 | 0.05 | 0.954 | ||
| Entire foot | PPP_Left | 361.27 | 89.4 | 422.26 | 123.53 | -4.36 | 0.00002* | ||
| Right foot | Forefoot | PPP_FR | 110.92 | 33.13 | 121.66 | 34.81 | -2.45 | 0.0149* | |
| Midfoot | PPP_MR | 84.37 | 33.43 | 90.44 | 51.89 | -1.07 | 0.2857 | ||
| Heel | PPP_HR | 158.46 | 39.1 | 146.71 | 51.66 | 1.98 | 0.0489* | ||
| Entirefoot | PPP_Right | 378.51 | 85.58 | 417.5 | 93.86 | -3.36 | 0.0009* | ||
| Pressure Time Integral | Left foot | Forefoot | PTI_FL | 31.47 | 11.82 | 42.74 | 20.2 | -5.23 | 4.52E-07* |
| Midfoot | PTI_ML | 21.58 | 13.78 | 29.91 | 22.23 | -3.46 | 0.000655* | ||
| Heel | PTI_HL | 48.77 | 22.64 | 53.61 | 28.39 | -1.45 | 0.1464 | ||
| Entirefoot | PTI_Left | 177.7 | 48.77 | 222.53 | 82.44 | -5.08 | 8.80E-07* | ||
| Right foot | Forefoot | PTI_FR | 34.63 | 13.49 | 39.91 | 16.09 | -2.74 | 0.0065* | |
| Midfoot | PTI_MR | 25.56 | 13.98 | 28.73 | 24.33 | -1.22 | 0.221 | ||
| Heel | PTI_HR | 46.59 | 18.96 | 42.78 | 20.97 | 1.47 | 0.1407 | ||
| Entirefoot | PTI_Right | 187.95 | 47.2 | 202.2 | 61.36 | -2.009 | 0.0457* | ||
| Forefoot-to-rearfoot ratio | Left foot | F/R_Left | 0.77 | 0.31 | 0.87 | 0.27 | -2.7 | 0.0073* | |
| Right foot | F/R_Right | 0.79 | 0.25 | 0.98 | 0.36 | -4.78 | 0.000003* | ||
| ML model | Optimal hyperparameter |
|---|---|
| SVM | {’C’: 1, ’kernel’: ’rbf’} |
| LR | {’C’: 1} |
| DT | {’criterion’: ’gini’, ’max_depth’: 4} |
| kNN | {’metric’: ’manhattan’, ’n_neighbors’: 15, ’weights’: ’distance’} |
| RF | {’n_estimators’: 5} |
| NB | {’var_smoothing’: 0.01} |
| LightGBM | {’learning rate’: 0.01, ’max_depth’: 3, ’n_estimators’: 500} |
| XGBoost | {’learning rate’: 0.1, ’max_depth’: 3, ’n_estimators’: 500} |
| AdaBoost | {’learning rate’: 0.1, ’n_estimators’: 200} |
| Evaluation Metrics | Statistic-based classification model |
ML classification models | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PTI_FL | F/R_Left | SVM | LR | DT | KNN | RF | NB | LightGBM | XGBoost | AdaBoost | |
| Accuracy | 0.67 | 0.64 | 0.67 | 0.67 | 0.67 | 0.73 | 0.74 | 0.75 | 0.75 | 0.81 | 0.85 |
| Sensitivity | 0.36 | 0.92 | 0.56 | 0.58 | 0.58 | 0.50 | 0.56 | 0.61 | 0.64 | 0.72 | 0.83 |
| Specificity | 0.97 | 0.38 | 0.78 | 0.76 | 0.76 | 0.95 | 0.92 | 0.89 | 0.86 | 0.89 | 0.86 |
| F1-Score | 0.52 | 0.72 | 0.63 | 0.64 | 0.64 | 0.64 | 0.68 | 0.71 | 0.72 | 0.79 | 0.85 |
| AUC | — | — | 0.88 | 0.76 | 0.69 | 0.87 | 0.85 | 0.83 | 0.86 | 0.88 | 0.88 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).