Submitted:
22 January 2024
Posted:
23 January 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Methodologies
2.1. System Architecture
- ■
- Operation System: Window’s 10 Professional (×64);
- ■
- CPU: Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz);
- ■
- Memory: 16 GB DDR3 1333 MHz;
- ■
- Developer Interface: TensorfloW-Keras (Spyder4.2.0);
- ■
- Program: Python3.6;
- ■
- Webcam: E-books E-PCC072 (1080 p/30 fps);
- ■
- Dynamic Resolution: 1920 × 1080.
2.2. Independent components analysis, ICA
2.3. Particle Swarm Optimization, PSO
2.4. Region of interest (ROI) and Palm Images
2.5. Heart Rate and Heart Rate Variability, HRV
2.5.1. Waveform Processing
2.5.2. Frequency Domain Transformation
2.5.3. Bandpass filter, BF
2.5.4. Power Spectral Density, PSD
2.6. Detrended Fluctuation Analysis, DFA
2.7. Normalization
3. Results
3.1. Metrics
3.2. Distance
3.3. Illumination
3.4. Measurement time
3.5. Comparisons for Forehead images and Palm images
4. Discussion
5. Conclusions
References
- Trimmel, M. Relationship of Heart Rate Variability (HRV) Parameters Including pNNxx With the Subjective Experience of Stress, Depression, Well-Being, and EveryDay Trait Moods (TRIM-T): A Pilot Study. The Ergonomics Open Journal 2015, 8, 32–37. [Google Scholar] [CrossRef]
- Liao, D.; Cai, J.; Brancati, F.L.; Folsom, A.; Barnes, R.W.; Tyroler, H.A.; Heiss, G. Association of vagal tone with serum insulin, glucose, and diabetes mellitus The ARIC Study. Diabetes Res. Clin. Pract. 1995, 30, 211–221. [Google Scholar] [CrossRef] [PubMed]
- Duanping, L.; Mercedes, C.; Gregory, W.E.; Wayne, E.C.; Gerardo, H. Lower heart rate variability is associated with the development of coronary heart disease in individuals with diabetes: The atherosclerosis risk in communities (ARIC) study. Diabetes 2002, 51, 3524–3531. [Google Scholar] [CrossRef]
- Allen, J.; Overbeck, K.; Stansby, G.; Murray, A. Photoplethysmography assessments in cardiovascular disease. Meas. Control. 2006, 39, 80–83. [Google Scholar] [CrossRef]
- Mannapperuma, K.; Holton, B.D.; Lesniewski, P.J.; Thomas, J.C. Performance limits of ICA-based heart rate identification techniques in imaging photoplethysmography. Physiol. Meas. 2015, 36, 67–83. [Google Scholar] [CrossRef] [PubMed]
- Wang, W.; den Brinker, A.C.; Stuijk, S.; de Haan, G. Algorithmic Principles of Remote PPG. IEEE Trans. Biomed. Eng. 2017, 64, 1479–1491. [Google Scholar] [CrossRef] [PubMed]
- Wang, C.; Pun, T.; Chanel, G. A Comparative Survey of Methods for Remote Heart Rate Detection from Frontal Face Videos. Front. Bioeng. Biotechnol. 2018, 6, 33. [Google Scholar] [CrossRef] [PubMed]
- Zhang, B.; Li, H.; Xu, L.; Lin, Q.; Yao, Y.; Greenwald, S.E. Noncontact Heart Rate Measurement Using a Webcam, Based on Joint Blind Source Separation and a Skin Reflection Model: For a Wide Range of Imaging Conditions. Journal of Sensors 2021, 2021, 18. [Google Scholar] [CrossRef]
- Qi, L.; Yu, H.; Xu, L.; Mpanda, R.; Greenwald, S.E. Robust heart-rate estimation from facial videos using Project_ICA. Physiol Meas 2019, 40(8), 085007. [Google Scholar] [CrossRef] [PubMed]
- Burton, T.; Saiko, G.; Cao, M.; Douplik, A. Remote photoplesymography unmasks glabrous skin temporal lead over non-glabrous. In Proceedings of the 2022 IEEE Photonics Conference (IPC), Vancouver, BC, Canada, 2022; pp. 1–2. [Google Scholar] [CrossRef]
- Unursaikhan, B.; Tanaka, N.; Sun, G.; Watanabe, S.; Yoshii, M.; Funahashi, K.; Sekimoto, F.; Hayashibara, F.; Yoshizawa, Y.; Choimaa, L.; Matsui, T. Development of a Novel Web Camera Based Contact Free Major Depressive Disorder Screening System Using Autonomic Nervous Responses Induced by a Mental Task and Its Clinical Application. Applied Sciences 2021, 10(5), 1650. [Google Scholar] [CrossRef] [PubMed]
- Al Fahoum, A.S.; Abu Al Haija, A.O.; Alshraideh, H.A. Identification of Coronary Artery Diseases Using Photoplethysmography Signals and Practical Feature Selection Process. Bioengineering 2023, 10, 249. [Google Scholar] [CrossRef] [PubMed]
- Su, T.J.; Hung, Y.C.; Pan, T.S.; Lin, W.H.; Wang, S.M.; Lee, Y.C. Estimation of Heart Rate and Heart Rate Variability with Real-Time Images Based on Independent Component Analysis and Particle Swarm Optimization. Appl. Sci. 2023, 13, 7605. [Google Scholar] [CrossRef]
- Herault, J.; Jutten, C. Space or time adaptive signal processing by neural network models. In Neural Networks for Computing; AIP Publishing: College Park, MD, USA, 1986; pp. 206–211. [Google Scholar] [CrossRef]
- Poli, R.; Kennedy, J.; Blackwell, T. Particle swarm optimization. Swarm Intell 2007, 1, 33–57. [Google Scholar] [CrossRef]
- C. Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines”, [Online]. 2019. Available online: http://arxiv.org/abs/1906.08172.
- Grishchenko, V. Bazarevsky, MediaPipe holistic—simultaneous face, hand and pose prediction, on device. Google AI Blog, Google, 10 Dec 2020.
- Kemp, A.H.; Quintana, D.S.; Gray, M.A.; Felmingham, K.L.; BroWn, K.; Gatt, J.M. Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis. Biological Psychiatry 2010, 67(11), 74-1067. [Google Scholar] [CrossRef] [PubMed]
- Kaufmann, T.; Sütterlin, S.; Schulz, S.M.; Vögele, C. ARTiiFACT: a tool for heart rate artifact processing and heart rate variability analysis. Behav Res Methods 2011, 43, 1161–1170. [Google Scholar] [CrossRef] [PubMed]
- Tarvainen, M.P.; Niskanen, J.P.; Lipponen, J.A.; Ranta-ahoa, P.O.; Karjalainen, P.A. Kubios HRV–Heart rate variability analysis softWare. Comput Methods Programs Biomed 2014, 113, 210–220. [Google Scholar] [CrossRef] [PubMed]
- Köhler, B.U.; Hennig, C.; Orglmeister, R. The Principles of SoftWare QRS Detection-RevieWing and Comparing Algorithms for Detecting this Important ECG Waveform. IEEE Eng. Med. Biol. 2002, 21, 42–57. [Google Scholar] [CrossRef]
- Ranjan, R.; Bansal, A.; Zheng, J.; Xu, H.; Gleason, J.; Lu, B.; Nanduri, A.; Chen, J.C.; Castillo, C.D.; Chellappa, R. A Fast and Accurate System for Face Detection, Identification, and Verification. IEEE Transactions on Biometrics 2019, 1(2), 82–96. [Google Scholar] [CrossRef]
- Liu, X.; Wei, W.; Kuang, H.; Ma, X. Heart Rate Measurement Based on 3D Central Difference Convolution With Attention Mechanism. Remote Sensing 2022, 22(2), 688. [Google Scholar] [CrossRef]









| Distance | 15 CM | 50 CM | ||||||
| Items | Heart Rate | SDNN | LF | HF | Heart Rate | SDNN | LF | HF |
| Metrics | ||||||||
| RMSE | 1.10 bpm | 1.85 ms | 1.77% | 1.77% | 2.97 bpm | 2.8 ms | 4% | 4% |
| MAPE | 1.5% | 4.87% | 2.425% | 3.95% | 3.075% | 8.9% | 6.375% | 8.9% |
| 0.9562 | 0.8762 | 0.923 | 0.9237 | 0.7807 | 0.7807 | 0.6806 | 0.7397 | |
| Items | Below 200 lumens | 350~550 lumens | 600 lumens or more |
| Metrics | |||
| RMSE | 6.04 bpm | 1.10 bpm | 5.55 bpm |
| MAPE | 7% | 1.5% | 6% |
| 0.2843 | 0.9562 | 0.561 |
| Method | Palm images (This study) | Forehead images [13] | ||||||
| Items | Heart Rate | SDNN | LF | HF | Heart Rate | SDNN | LF | HF |
| Metrics | ||||||||
| RMSE | 2.00 bpm | 1.85 ms | 1.77% | 1.77% | 2.09 bpm | 2.80 ms | 2.11% | 2.11% |
| MAPE | 1.5% | 4.87% | 2.42% | 3.95% | 2.2% | 9.40% | 2.86% | 4.13% |
| 0.8697 | 0.8762 | 0.9237 | 0.9237 | 0.8237 | 0.7654 | 0.9095 | 0.9095 | |
| Function | Proposed method | Su [13] | Lin Qi [9] | Zhang [8] |
| ROI | Palm images | Face Partial | full face (including facial features) | full face(Without facial features) |
| Signal Adjustment Level | YES | YES | YES | NO |
| ICA | PSO-ICA | PSO-ICA | Project-ICA | JADE-ICA |
| Bandpass filter | 0.4~10Hz | 0.4~10Hz | 0.7~4Hz | 0.7~4Hz |
| HRV Formula | YES | YES | NO | NO |
| Continuous measurement of physiological parameter | YES | YES | YES | NO |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).