Submitted:
16 October 2024
Posted:
17 October 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Experimental Design
2.1.1. Participants
2.1.2. Equipment
2.1.3. Coding of Infant Position
2.2. Data Pre-Processing
2.2.1. Synchronisation of Movement and Audio-Video Data
2.3. Class Selection and Parameter Extraction
2.3.1. Identifying Relevant Classes
2.3.2. Extracting Features and Composition of Feature Groups
2.4. Classifier Selection
2.5. Classifier Performance Evaluation
2.6. Importance of Different Features Groups
2.6.1. Ablation Experiments
2.6.2. SHAP Values
2.7. Correlation between Annotated and Predicted Time in Position
3. Results
3.1. Classifier Comparison
3.1.1. Sensor Placement and Classifier Comparison
3.2. CatBoost Performance Evaluation: Trunk & Legs
3.2.1. Confusion Matrices
3.2.2. Ablation Experiments
One Feature Group at a Time vs All Feature Groups
Excluding a Single Feature Group
3.2.3. SHAP Values
3.2.4. Correlation between Manually Annotated and Predicted Time in a Given Body Position
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A





Appendix B

References
- Laudańska, Z.; López Pérez, D.; Radkowska, A.; Babis, K.; Malinowska-Korczak, A.; Wallot, S.; Tomalski, P. Changes in the Complexity of Limb Movements during the First Year of Life across Different Tasks. Entropy 2022, 24(4), 552. [CrossRef]
- Kretch, K. S.; Franchak, J. M.; Adolph, K. E. Crawling and Walking Infants See the World Differently. Child Dev. 2013, 85(4), 1503–1518. [CrossRef]
- Bouten, C. V.; Westerterp, K. R.; Verduin, M.; Janssen, J. Assessment of Energy Expenditure for Physical Activity Using a Triax—AI. Age (Yr) 1994, 23(1.8), 21–27.
- Najafi, B.; Aminian, K.; Loew, F.; Blanc, Y.; Robert, P. A. Measurement of Stand-Sit and Sit-Stand Transitions Using a Miniature Gyroscope and Its Application in Fall Risk Evaluation in the Elderly. IEEE Trans. Biomed. Eng. 2002, 49(8), 843–851. [CrossRef]
- Qiang, L.; Stankovic, J. A.; Hanson, M. A.; Barth, A. T.; Lach, J.; Gang, Z. Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information. In Proc. Sixth Int. Workshop Wearable Implantable Body Sens. Networks; IEEE: Berkeley, CA, USA, 3–5 June 2009; pp. 138–143. [CrossRef]
- Bianchi, F.; Redmond, S. J.; Narayanan, M. R.; Cerutti, S.; Celler, B. G.; Lovell, N. H. Falls Event Detection Using Triaxial Accelerometry and Barometric Pressure Measurement. In Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc.; IEEE: Minneapolis, MN, USA, 3–6 September 2009; pp. 6111–6114. [CrossRef]
- Ohtaki, Y.; Susumago, M.; Suzuki, A.; Sagawa, K.; Nagatomi, R.; Inooka, H. Automatic Classification of Ambulatory Movements and Evaluation of Energy Consumptions Utilising Accelerometers and a Barometer. Microsyst. Technol. 2005, 11, 1034–1040. [CrossRef]
- Wang, J.; Redmond, S. J.; Voleno, M.; Narayanan, M. R.; Wang, N.; Cerutti, S.; Lovell, N. H. Energy Expenditure Estimation During Normal Ambulation Using Triaxial Accelerometry and Barometric Pressure. Physiol. Meas. 2012, 33(11), 1811–1830. [CrossRef]
- Altun, K.; Barshan, B. Human Activity Recognition Using Inertial/Magnetic Sensor Units. In Hum. Behav. Unders; Salah, A. A., Gevers, T., Sebe, N., Vinciarelli, A., Eds.; Springer: 2010; Vol. 6219, pp. 38–51. [CrossRef]
- Bamberg, S. J. M.; Benbasat, A. Y.; Scarborough, D. M.; Krebs, D. E.; Paradiso, J. A. Gait Analysis Using a Shoe-Integrated Wireless Sensor System. IEEE Trans. Inf. Technol. Biomed. 2008, 12(4), 413–423. [CrossRef]
- Preece, S. J.; Goulermas, J. Y.; Kenney, L. P. J.; Howard, D. A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities from Accelerometer Data. IEEE Trans. Biomed. Eng. 2009, 56(3), 871–879. [CrossRef]
- Ferrari, A.; Micucci, D.; Mobilio, M.; Napoletano, P. Human Activities Recognition Using Accelerometer and Gyroscope. In Proc. 2019; Springer Int. Publ.: Cham, Switzerland, 2019; pp. 357–362. [CrossRef]
- Franchak, J. M.; Scott, V.; Luo, C. A Contactless Method for Measuring Full-Day, Naturalistic Motor Behavior Using Wearable Inertial Sensors. Front. Psychol. 2021, 12, 701343. [CrossRef]
- Zhao, W.; Adolph, A. L.; Puyau, M. R.; Vohra, F. A.; Butte, N. F.; Zakeri, I. F. Support Vector Machines Classifiers of Physical Activities in Preschoolers. Physiol. Rep. 2013, 1(3), e00006. [CrossRef]
- Gjoreski, H.; Gams, M. Accelerometer Data Preparation for Activity Recognition. In Proc. Int. Multiconf. Inf. Soc.; Ljubljana, Slovenia, 10–14 October 2011.
- Airaksinen, M.; Gallen, A.; Kivi, A.; Vijayakrishnan, P.; Häyrinen, T.; Ilén, E.; Räsänen, O.; Haataja, L. M.; Vanhatalo, S. Intelligent Wearable Allows Out-of-the-Lab Tracking of Developing Motor Abilities in Infants. Commun. Med. 2022, 2(1), 69. [CrossRef]
- Airaksinen, M.; Räsänen, O.; Ilén, E.; Häyrinen, T.; Kivi, A.; Marchi, V.; Gallen, A.; Blom, S.; Varhe, A.; Kaartinen, N.; Haataja, L.; Vanhatalo, S. Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensors. Sci. Rep. 2020, 10(1), 1–12. [CrossRef]
- Taylor, E.; Airaksinen, M.; Gallen, A.; Immonen, T.; Ilén, E.; Palsa, T.; Haataja, L.; Vanhatalo, S. Quantified Assessment of Infant's Gross Motor Abilities Using a Multisensor Wearable. J. Vis. Exp. 2024, 207, e65949. [CrossRef]
- Pirttikangas, S.; Fujinami, K.; Seppanen, T. Feature Selection and Activity Recognition from Wearable Sensors. In Proc. Third Int. Symp. Ubiquitous Comput. Syst.; Springer: Seoul, Korea, 11–13 October 2006; Vol. 4239, pp. 516–527. [CrossRef]
- Wang, J. H.; Ding, J. J.; Chen, Y.; Chen, H. H. Real-Time Accelerometer-Based Gait Recognition Using Adaptive Windowed Wavelet Transforms. In Proc. IEEE Asia Pac. Conf. Circuits Syst.; Kaohsiung, Taiwan, 2–5 December 2012; pp. 591–594. [CrossRef]
- Mannini, A.; Intille, S.S.; Rosenberger, M.; Sabatini, A.M.; Haskell, W. Activity Recognition Using a Single Accelerometer Placed at the Wrist or Ankle. Med. Sci. Sports Exerc. 2013, 45(11), 2193–2203. [CrossRef]
- Stikic, M.; Huynh, T.; van Laerhoven, K.; Schiele, B. ADL Recognition Based on the Combination of RFID and Accelerometer Sensing. In Proc. Second Int. Conf. Pervasive Comput. Technol. Healthc.; Tampere, Finland, 30 January–1 February 2008; pp. 258–263. [CrossRef]
- Figo, D.; Diniz, P.C.; Ferreira, D.R.; Cardoso, J.M. Preprocessing techniques for context recognition from accelerometer data. Pers. Ubiquitous Comput. 2010, 14, 645–662. [CrossRef]
- Jasiewicz, J. M.; Allum, J. H. J.; Middleton, J. W.; Barriskill, A.; Condie, P.; Purcell, B.; Li, R. C. T. Gait Event Detection Using Linear Accelerometers or Angular Velocity Transducers in Able-Bodied and Spinal-Cord Injured Individuals. Gait Posture 2006, 24, 502–509. [CrossRef]
- Laudańska, Z.; López Pérez, D.; Kozioł, A.; Radkowska, A.; Babis, K.; Malinowska-Korczak, A.; Tomalski, P. Longitudinal Changes in Infants’ Rhythmic Arm Movements during Rattle-Shaking Play with Mothers. Front. Psychol. 2022, 13. [CrossRef]
- Maurer, U.; Smailagic, A.; Siewiorek, D.; Deisher, M. Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions. In Proc. Int. Workshop Wearable Implantable Body Sensor Networks; Cambridge, MA, USA, 3–5 April 2006; pp 113–116. [CrossRef]
- Parkka, J.; Ermes, M.; Korpipaa, P.; Mantyjarvi, J.; Peltola, J.; Korhonen, I. Activity classification using realistic data from wearable sensors. IEEE Trans. Inf. Technol. Biomed. 2006, 10, 119–128. [CrossRef]
- Chakravarthi, B.; Prabhu Prasad, B. M.; Chethana, B.; Kumar, B. N. P. Real-Time Human Motion Tracking and Reconstruction Using IMU Sensors. In Proc. 2022 Int. Conf. Electr. Comput. Energy Technol. (ICECET); Prague, Czech Republic, 2022; pp 1–5. [CrossRef]
- Hendry, D.; Rohl, A. L.; Rasmussen, C. L.; Zabatiero, J.; Cliff, D. P.; Smith, S. S.; ...; Campbell, A. Objective Measurement of Posture and Movement in Young Children Using Wearable Sensors and Customized Mathematical Approaches: A Systematic Review. Sensors 2023, 23(24), 9661. [CrossRef]
- Sennheiser. e 914. Sennheiser. https://en-us.sennheiser.com/instrument-microphone-studio-recording-music-e-914.
- Chow, J. C.; Hol, J. D.; Luinge, H. Tightly-Coupled Joint User Self-Calibration of Accelerometers, Gyroscopes, and Magnetometers. Drones 2018, 2(1), 6. [CrossRef]
- Xsens Technologies B.V. MTw Awinda. Xsens Technologies B.V. https://www.xsens.com/products/awinda.
- Paulich, M.; Schepers, M.; Rudigkeit, N.; Bellusci, G. Xsens MTw Awinda: Miniature Wireless Inertial-Magnetic Motion Tracker for Highly Accurate 3D Kinematic Applications. In Proc. IEEE/ASME Int. Conf. Adv. Intell. Mechatronics (AIM); Auckland, New Zealand, 9–12 July 2018.
- Thurman, S.L.; Corbetta, D. Spatial exploration and changes in infant-mother dyads around transitions in infant locomotion. Dev. Psychol. 2017, 53(7), 1207. [CrossRef]
- Yumang, A. N.; Rupido, C. S.; Panelo, F. V. Analyzing Effects of Daily Activities on Sitting Posture Using Sensor Fusion with Mahony Filter. In Proc. 2023 IEEE 15th Int. Conf. Humanoid, Nanotechnology, Inf. Technol., Commun. Control, Environ. Manag. (HNICEM); Coron, Palawan, Philippines, 2023; pp 1–6. [CrossRef]
- Xu, M.; Goldfain, A.; Chowdhury, A. R.; DelloStritto, J. Towards Accelerometry Based Static Posture Identification. In Proc. 2011 IEEE Consumer Commun. Networking Conf. (CCNC); IEEE: Las Vegas, NV, USA, 2011; pp 29–33. [CrossRef]
- Franchak, J.M.; Tang, M.; Rousey, H.; Luo, C. Long-form recording of infant body position in the home using wearable inertial sensors. Behav. Res. Methods 2023, 1-20. [CrossRef]
- Trost, S.G.; Cliff, D.P.; Ahmadi, M.N.; Tuc, N.V.; Hagenbuchner, M. Sensor-enabled activity class recognition in preschoolers: Hip versus wrist data. Med. Sci. Sports Exerc. 2018, 50, 634–641. [CrossRef]
- Ahmadi, M.N.; Pavey, T.G.; Trost, S.G. Machine learning models for classifying physical activity in free-living preschool children. Sensors 2020, 20, 5. [CrossRef]
- Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; Vanderplas, J.; Passos, A.; Cournapeau, D.; Brucher, M.; Perrot, M.; Duchesnay, E. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830.
- Prokhorenkova, L.; Gusev, G.; Vorobev, A.; Dorogush, A. V.; Gulin, A. CatBoost: Unbiased Boosting with Categorical Features. In Proc. 32nd Int. Conf. Neural Inf. Process. Syst.; Montréal, Canada, 3–8 December 2018. [CrossRef]
- Olson, R. S.; La Cava, W.; Mustahsan, Z.; Varik, A.; Moore, J. H. Data-Driven Advice for Applying Machine Learning to Bioinformatics Problems. In Proc. Biocomputing 2018; Kohala Coast, Hawaii, USA, 3–7 January 2018; pp 192–203. [CrossRef]
- Scott, M.; Su-In, L. A Unified Approach to Interpreting Model Predictions. Adv. Neural Inf. Process. Syst. 2017, 30, 4765–4774.
- Banos, O.; Galvez, J.-M.; Damas, M.; Pomares, H.; Rojas, I. Window size impact in human activity recognition. Sensors 2014, 14, 6474–6499. [CrossRef]
- Kretch, K. S.; Koziol, N. A.; Marcinowski, E. C.; Kane, A. E.; Inamdar, K.; Brown, E. D.; Bovaird, J. A.; Harbourne, R. T.; Hsu, L.-Y.; Lobo, M. A.; Dusing, S. C. Infant Posture and Caregiver-Provided Cognitive Opportunities in Typically Developing Infants and Infants with Motor Delay. Dev. Psychobiol. 2022, 64(1), Article e22233. [CrossRef]
- Ghazi, M. A.; Zhou, J.; Havens, K. L.; Smith, B. A. Accelerometer Thresholds for Estimating Physical Activity Intensity Levels in Infants: A Preliminary Study. Sensors 2024, 24(14), 4436. [CrossRef]
- Oh, J.; Ordoñez, E. L. T.; Velasquez, E.; Mejía, M.; Grazioso, M. D. P.; Rohloff, P.; Smith, B. A. Early Full-Day Leg Movement Kinematics and Swaddling Patterns in Infants in Rural Guatemala: A Pilot Study. PLoS One 2024, 19(2), e0298652. [CrossRef]
- Ghazi, M.; Prosser, L.; Kolobe, T.; Fagg, A.; Skorup, J.; Pierce, S.; Smith, B. Measuring Spontaneous Leg Movement of Infants At-Risk for Cerebral Palsy: Preliminary Findings. Arch. Phys. Med. Rehabil. 2024, 105(4), e13–e14. [CrossRef]
- Kulvicius, T.; Zhang, D.; Poustka, L.; Bölte, S.; Jahn, L.; Flügge, S.; Kraft, M.; Zweckstetter, M.; Nielsen-Saines, K.; Wörgötter, F.; Marschik, P. B. Deep Learning Empowered Sensor Fusion Boosts Infant Movement Classification. arXiv, 2024. [CrossRef]













![]() |
|
Time Point |
Rattles | Book-sharing | Manipulative | ||||||
| Mean age [months] | SE [months] |
No. visits | Mean age [months] | SE [months] |
No. visits | Mean age [months] | SE [months] |
No. visits | |
| 4 months | 4.36 | 0.29 | 61 | 4.36 | 0.28 | 63 | 4.35 | 0.28 | 65 |
| 6 months | 6.59 | 0.40 | 74 | 6.61 | 0.39 | 76 | 6.61 | 0.40 | 72 |
| 9 months | 9.06 | 0.35 | 71 | 9.08 | 0.35 | 70 | 9.06 | 0.35 | 72 |
| 12 months | 12.14 | 0.52 | 73 | 12.16 | 0.51 | 72 | 12.13 | 0.53 | 69 |
| Static Position | Annotated Position | Definition |
| Hands&Knees | hands and knees | The infant is on their hands and knees or feet with their stomach lifted off the ground and is not moving. Alternately, the infant is on two knees or feet and one hand, with the other hand used to interact with an object. |
| crawling | The infant moves on their hands and knees with their stomach off the ground. | |
| Prone | pivoting | The infant is lying prone and rotating or turning in a small area on the floor without moving forward or backwards. |
| prone | The infant is lying flat on their stomach. | |
| side lying | The infant is lying on their side with their torso oriented sideways. | |
| belly crawling | The infant moves forward by sliding their belly along the ground. | |
| Sitting | supported sitting by the caregiver |
The infant sits upright on their bottom with their back supported by the caregiver, and their legs either extended in front or folded beneath them. |
| supported sitting using own hands as support |
The infant is sitting on their bottom, leaning to one side with the support of their arm, and their legs extended in front or to the side. | |
| independent sitting | The infant sits Upright on their bottom with their legs in front or folded beneath them, without leaning on any external support. | |
| Supine | supine | The infant is lying flat on their back. |
| Upright | supported stand | The infant is standing upright with straight legs and feet on the floor while being supported by the caregiver and not moving. |
| standing upright | The infant is standing upright with straight legs and feet on the floor but is not moving. | |
| walking | The infant is moving upright with legs straight and feet on the floor. | |
| supported walking | The infant walks upright with legs straight and feet on the floor, supported by the caregiver’s hands. |
| Signal | Abbr. | |
| Accelerometer | Acc | |
| Magnetometer | Mag | |
| Gyroscope | Gyro | |
| Euclidean Norm | Norm | |
| High-Pass Filtered | HP | |
| Low-Pass Filtered | LP | |
| 3 separate signals from the X, Y, and Z axis of the chosen device/modality Mag, Gyro or Acc | X, Y, Z |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
