In this work, an algorithm was developed to measure the respiration rate for an embedded device that can be used by a field robot for relief operation. With this algorithm, the rate measurement was calculated based on direct influences of respiratory-induced intensity variation (RIIV) on blood flow in cardiovascular pathways. For that, a photoplethysmogram (PPG) sensor was used to determine changes in heartbeat frequencies. The PPG sensor readings were filtered using an Information Filter and a Fast Fourier transform (FFT) to determine the state of RIIV. With a relatively light initialization, the information filter can estimate unknown variables based on a series of measurements containing noise and other inaccuraties. Therefore, this filter is suitable for application on an embedded device. For faster calculation time in the implementation, the FFT analysis was calculated only for a major peak in the frequency domain. Test and measurement of respiration rate was conducted based on the device algorithm and spirometer. Heartbeat measurement was also evaluated by comparing the heartbeat data of the PPG sensor and the medical tool kit. Based on the test, the implemented algorithm can measure respiration rate with about 80% accuracy compared with the spirometer.

Remote Photoplethysmography (rPPG) has emerged as a non-intrusive and promising physiological sensing capability in HCI research, gradually extending its applications in health-monitoring and clinical care contexts. With advanced machine learning models, recent datasets collected in real-world conditions have gradually enhanced the performance of rPPG methods in recovering heart-rate and heart-rate variability metrics. However, the signal quality of reference ground-truth PPG data in existing datasets is by and large neglected, while poor quality references negatively influence models. Here, this work introduces a new imaging blood volume pulse (iBVP) dataset of synchronized RGB and thermal infrared videos with PPG ground-truth signals from the ear and its high resolution signal quality labels, for the first time. Participants perform rhythmic breathing, head-movement, and stress-inducing tasks, which help reflect real-world variations in psycho-physiological states. This work conducts dense (per sample) signal quality assessment to discard noisy segments of ground-truth and corresponding video frames. We further present a novel end-to-end machine learning framework, iBVPNet that features an efficient and effective spatio-temporal feature aggregation for reliable estimation of BVP signals. Finally, this work examines the feasibility of extracting BVP signals from thermal video frames, which is underexplored. The iBVP dataset and source codes are publicly available for research use.

Non-invasive heart rate (HR) monitoring is important in clinical settings as it plays a critical role in diagnosing a range of health conditions and assessing well-being. Presently, the gold standards for HR measurement are all based on sensors which require skin contact. Apart from inconvenience, contact sensors have proven problematic in certain scenarios – they cannot be used when mechanical isolation of the patient is imperative (burn victims, patients with shaky hands and feet), cause skin damage to premature babies in the ICU and increase the risk of spreading infections. Non-contact HR monitoring using a camera has been recently shown to be a viable alternative. It is now possible to record cardiac-synchronous blood volume variations from facial videos of human subjects under ambient lighting. These variations produce corresponding changes in skin reflectance which can be extracted as a raw reflectance photoplethysmography (rPPG) signal and processed to reveal HR. In this project, an algorithmic framework for webcam-based HR detection was successfully implemented in MATLAB. The investigation was based on 100 self-captured videos (dark-skinned subject) and 48 videos (from 12 subjects, all but one fair-skinned) obtained from COHFACE – an online database of facial videos and corresponding physiological signals. While the performance metrics (mean error, SNR) of the rPPG signals obtained from the self-captured videos were poor (best case mean error of 22%), they were good enough to demonstrate the success of the implementation. The poor results were primarily imputed to skin tone as rPPG SNR is known to be particularly low for dark tones. The results of the COHFACE videos were far superior, with mean error ranging from 3% to 15% (among 8 different rPPG signals) and 0% to 9% under ambient and dedicated lighting, respectively. This investigation sets the foundation for future research directed at optimizing rPPG performance metrics for dark-skinned subjects.

Speckle Plethysmography (SPG) and Photoplethysmography (PPG) are different biophotonics technologies that allow for measurement of hemodynamics. As the difference between SPG and PPG under low perfusion conditions is not fully understood, a Cold Pressor Test (CPT) was used to modulate blood pressure and peripheral circulation. A custom-built setup simultaneously derived SPG and PPG from the same video streams at two wavelengths (639 nm and 850 nm). SPG and PPG were measured at right index finger location before and during CPT using finger Arterial Pressure (fiAP) as reference. The effect of CPT on Alternating Component amplitude (AC) and Signal-to-Noise-Ratio (SNR) of dual-wavelength SPG and PPG signals was analysed across participants. Furthermore, waveform differences between SPG, PPG, and fiAP based on frequency harmonic ratios, were analysed for each subject (n=10). Both PPG and SPG at 850 nm show a significant reduction during CPT for both AC and SNR. However, SPG showed significantly higher and more stable SNR than PPG in both study phases. Harmonic ratios were found substantially higher in SPG than PPG. Therefore, in low perfusion conditions, SPG seems to offer a more robust pulse wave monitoring with higher harmonic ratios than PPG.

Cardiac monitoring based on wearable photoplethysmography (PPG) is widespread because of its usability and low cost. Unfortunately, PPG is negatively affected by various types of disruptions, which could introduce errors to the algorithm that extracts Pulse Rate Variability (PRV). This study aims to identify the nature of such artifacts caused by various types of factors under the conditions of precisely planned experiments. We also propose methods for their reduction based solely on the PPG signal while preserving the frequency content of PRV. The accuracy of PRV derived from PPG was compared to Heart Rate Variability (HRV) derived from the accompanying recorded ECG. The results indicate that filtering PPG signals using the Discrete Wavelet Transform and its inverse (DWT/IDWT) is suitable for removing slow components and high-frequency noise. Moreover, the main benefit of amplitude demodulation is better preparation of the PPG to determine the duration of pulse cycles and reduce the impact of some other artifacts. Postprocessing applied to HRV and PRV indicates that the correction of outliers based on local statistical measures of signals and the AR model is only important when PPG is of low-quality and has no effect under good signal quality. The main conclusion is that DWT/IDWT, followed by amplitude demodulation, enables the proper preparation of the PPG signal for the subsequent use of PRV extraction algorithms. However, postprocessing in the proposed form should be applied more in the situations of observed strong artifacts than in motionless laboratory experiments.

Animal welfare remains a very important issue in the livestock sector but monitoring animal welfare in an objective and continuous way remains a serious challenge. Monitoring animal welfare based upon physiological measurements instead of audio-visual scoring of behaviour would be a step forward. One of the obvious physiological signals related to welfare and stress is heart rate. The objective of this research was to measure heart rate (beat per minutes) on pigs with technology that soon will be affordable. Affordable heart rate monitoring is done today at large scale on humans using the Photo Plethysmography (PPG) technology. We used PPG sensors on pig’s body to test whether it allows getting reliable heart rate signal. A continuous wavelet transform (CWT)-based algorithm is developed to decouple the cardiac pulse waves from the pig. Three different wavelets, namely 2^nd, 4^th and 6^th order Derivative of Gaussian (DOG, are tested. We show results of the developed PPG-based algorithm against electrocardiograms (ECG) as a reference measure for heart rate and this for an anesthetized versus a non-anesthetised animal. We tested three different anatomical body positions (ear, leg and tail) and give results for each body position of the sensor. In summary, it can be concluded that the agreement between PPG-based heart rate technique and reference sensor goes from 91 to 95 percentage. In this paper we showed the potential of using the PPG-based technology to assess pig’s hear rate.

The chicken embryo is a widely used experimental animal-model in many studies such as developmental biology and to study the physiological responses and adaptation to altered environments as well as for cancer and neurobiology research. Embryonic heart rate is an important physiological variable useful as an index reflecting the embryo's natural activity and is considered one of the most difficult parameters to measure. An acceptable measurement technique of embryonic heart rate should provide a reliable cardiac signal quality while maintaining adequate gas exchange through the eggshell along the incubation and embryonic developmental period. In this paper, we presented a detailed design and methodology for a non-invasive PPG-based prototype (Egg-PPG) for real-time and continuous monitoring of embryonic heart rate during incubation. An automatic embryonic cardiac wave detection algorithm, based on normalised spectral entropy, is described. The developed algorithm successfully estimated the embryonic heart rate with 98.7% accuracy. We believe that the developed overall system presented in this paper is showing a promising solution for non-invasion, real-time monitoring of embryonic cardiac signal, which can be used in both experimental studies (e.g., developmental embryology and cardiovascular research) and in industrial incubation applications.

This study investigates the suitability of the timestamp approach algorithm for predicting blood pressure (BP) using wearable and comfortable devices, showcasing its accuracy even with low-frequency sampled signals. Developed within the SINTEC European project, the algorithm utilizes Electrocardiogram (ECG) and Photoplethysmogram (PPG) sensors, demonstrating promising results in both laboratory and hospital settings. The research emphasizes the algorithm’s potential to transform continuous and non-invasive BP monitoring through wearable technology, offering frequent measurements with minimal discomfort. While the study shows promise, further exploration is needed, focusing on optimizing machine learning coefficients for long-term monitoring applications and addressing potential changes over time. Technological improvements, including the implementation of edge computing algorithms, hold the key to enhancing BP accuracy, denoising techniques, and integrating alarm systems for future wearable solutions. This study emphasizes the adaptability of the algorithm for diverse healthcare environments, paving the way for broader applications in convenient and reliable BP monitoring.

With the advent of modern technologies, the healthcare industry is moving towards a more Personalised smart care model. The enablers of such care models are the Internet of Things (IoT) and Artificial Intelligence. These technologies collect and analyse data from persons in care to alert relevant parties if any anomaly is detected in a patient’s regular pattern. However, such reliance on IoT devices to capture continuous data extends the attack surfaces and demands high-security measures. Both patients and devices need to be authenticated to mitigate a large number of attack vectors. The biometric authentication method has been seen as a promising technique in these scenarios. To this end, this paper proposes an AI-based multimodal biometric authentication model for single and group-based users’ device-level authentication that increases protection against the traditional single modal approach. To test the efficacy of the proposed model, a series of AI models are trained and tested using physiological biometric features such as ECG (Electrocardiogram) and PPG (Photoplethysmography) signals from five publicly available datasets from Physionet and Mendeley data repositories. The multimodal fusion authentication model shows promising results with 99.8% accuracy and an Equal Error Rate (EER) of 0.16.

While the importance of continuous monitoring of electrocardiographic (ECG) or photoplethysmographic (PPG) signals to detect cardiac anomalies is generally accepted in preventative medicine, there remain major barriers to its actual widespread adoption. Most notably, current approaches tend to lack real-time capability, exhibit high computational cost, and be based on restrictive modeling assumptions or require large amounts of training data. We propose a lightweight and model-free approach for the online detection of cardiac anomalies such as ectopic beats in ECG or PPG signals based on the change detection capabilities of Singular Spectrum Analysis (SSA) and nonparametric rank-based cumulative sum (CUSUM) control charts. The procedure is able to quickly detect anomalies without requiring the identification of fiducial points such as R-peaks and is computationally significantly less demanding than previously proposed SSA-based approaches. Therefore, the proposed procedure is equally well suited for standalone use and as an add-on to complement existing (e.g. heart rate (HR) estimation) procedures.

A new circuit model of the self-powered device for heart rate measurement is presented in this paper. This device consists of piezoelectric energy harvester (PEH), power management circuit (PMC) with energy storage, microcontroller, Photoplethysmography (PPG) sensor, and Wi-Fi module. The PEH is placed under the insole to harvest the pressure energy from human foot-step to generate ac power. In our model, a PEH is represented by sine voltage source, where its parameters were taken from experiments with 20 volunteers. The PMC is simplified by a switch with gain δ placed in series with the main circuit. The model of the main circuit is RC elements in parallel, where C is the capacitance of the storage device, and R is the equivalent parallel resistance of the microcontroller, PPG sensor, and Wi-Fi modules, respectively. The value of R depends on the power and current absorbed by those modules during sleep, deep sleep, sense, and transmit modes which collected from the datasheet. Finally, the proposed circuit model of the self-powered device was built and simulated in SPICE. The simulation results were compared with the laboratory experiment using commercial devices. Based on the results, the proposed model had small gaps compared to the real self-powered devices in terms of average current, voltage, power and efficiency.

Nowadays, wearable devices for human health monitoring are increasingly become popular and widely used. Typically, the wearable device is small size and operates with batteries. Therefore, the wearable device acquires bio-signals and transfers to smartphones or personal computers (PC) via WiFi/ Bluetooth for processing data. To reduce power consumption is one of the most important challenges of designing wearable devices. To solve this problem, the proposed signal quality valuation (SQV) method can be select the high-quality signal and reduce the transfer time to other devices. In this paper, the proposed SQV and data compression method rely on real-time PPG signals analysis to retain important information of PPG signal, improve performance and power consumption of PPG devices. Besides, we also proposed Heuristic rules for heart rate (HR) estimation with compression data. The experimental results show that the highest compression ratio (CR) is 387.8 with BIDMC Physionet database (sampling frequencies of 125 Hz) and HR error as 1.43 bpm for averaging absolute error (avAE), the standard deviation absolute error (sdAE as 0.4) and relative error mean (avRE as 0.019). The proposed real-time PPG measurement system (sampling frequency as 100/ 200/ 400 Hz) reduce power consumption and open the new structure for healthcare application systems

Improper sitting positions are known as the primary reason for back pain and the emergence of musculoskeletal disorders (MSD) among individuals who spend prolonged time working with computer screens, keyboards, and mice. At the same time, it is well understood that automated technological tools can play an important role in the process of unhealthy habit alteration, so plenty of research efforts are focused on research and technology development (RTD) activities that aim to provide support to the prevention of back pain or the development of MSD. Here, we report on creating a new resource in support of RTD activities aiming at the automated detection of improper sitting positions. It consists of multimodal multisensory recordings of 100 persons made with a video recorder, camera, and wrist-attached sensors that capture physiological signals (PPG, EDA, Skin temperature), as well as motion sensors (three-axis accelerometer). Our multimodal multisensory dataset (MMD-MSD) opens new opportunities for modeling the body stance (sitting posture and movements), physiological state (stress level, attention, emotional arousal, valence), and performance (success rate on the Stroop test) of people working with a computer. Finally, we demonstrate two use cases: improper neck posture detection from pictures and cognitive load detection from physiological signals.