Next Article in Journal
Transfer-Learning-Based Temperature Uncertainty Reduction Algorithm for Large Scale Oil Tank Ground Settlement Monitoring
Next Article in Special Issue
Atrial Fibrillation Detection with Single-Lead Electrocardiogram Based on Temporal Convolutional Network–ResNet
Previous Article in Journal
Analysis of 5G and LTE Signals for Opportunistic Navigation and Time Holdover
Previous Article in Special Issue
Multimodal Assessment of Cognitive Workload Using Neural, Subjective and Behavioural Measures in Smart Factory Settings
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Benchmarking of Sensor Configurations and Measurement Sites for Out-of-the-Lab Photoplethysmography

by
Max Nobre Supelnic
1,*,
Afonso Fortes Ferreira
2,
Patrícia Justo Bota
1,3,
Luís Brás-Rosário
4,5 and
Hugo Plácido da Silva
1,3
1
Department of Bioengineering (DBE), Instituto Superior Técnico (IST), 1049-001 Lisbon, Portugal
2
Instituto de Engenharia de Sistemas e Computadores—Microsistemas e Nanotecnologias (INESC MN), 1000-029 Lisbon, Portugal
3
Instituto de Telecomunicações (IT), 1049-001 Lisbon, Portugal
4
Cardiology Department, Santa Maria University Hospital (CHLN), Lisbon Academic Medical Centre, 1649-028 Lisbon, Portugal
5
Cardiovascular Centre of the University of Lisbon, Lisbon School of Medicine, 1649-028 Lisbon, Portugal
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(1), 214; https://doi.org/10.3390/s24010214
Submission received: 27 November 2023 / Revised: 17 December 2023 / Accepted: 28 December 2023 / Published: 29 December 2023

Abstract

:
Photoplethysmography (PPG) is used for heart-rate monitoring in a variety of contexts and applications due to its versatility and simplicity. These applications, namely studies involving PPG data acquisition during day-to-day activities, require reliable and continuous measurements, which are often performed at the index finger or wrist. However, some PPG sensors are susceptible to saturation, motion artifacts, and discomfort upon their use. In this paper, an off-the-shelf PPG sensor was benchmarked and modified to improve signal saturation. Moreover, this paper explores the feasibility of using an optimized sensor in the lower limb as an alternative measurement site. Data were collected from 28 subjects with ages ranging from 18 to 59 years. To validate the sensors’ performance, signal saturation and quality, wave morphology, performance of automatic systolic peak detection, and heart-rate estimation, were compared. For the upper and lower limb locations, the index finger and the first toe were used as reference locations, respectively. Lowering the amplification stage of the PPG sensor resulted in a significant reduction in signal saturation, from 18% to 0.5%. Systolic peak detection at rest using an automatic algorithm showed a sensitivity and precision of 0.99 each. The posterior wrist and upper arm showed pulse wave morphology correlations of 0.93 and 0.92, respectively. For these locations, peak detection sensitivity and precision were 0.95, 0.94 and 0.89, 0.89, respectively. Overall, the adjusted PPG sensors are a good alternative for obtaining high-quality signals at the fingertips, and for new measurement sites, the posterior pulse and the upper arm allow for high-quality signal extraction.

1. Introduction

Cardiovascular diseases are the leading cause of death worldwide, with 17.9 million deaths each year [1,2], and there is a high prevalence of chronic cardiovascular disease that is the major cause of hospital admissions. Since chronic patients are ambulatory, there has been a growing interest in wearable devices capable of monitoring cardiovascular parameters on a daily basis [3]. Wearable devices are becoming a part of our daily routines, ranging from smartwatches to fitness trackers or even smart clothes [4,5,6]. Along with the commodities they offer, health monitoring technology has also branched into these devices, with the latest advances allowing for continuous health monitoring outside clinical settings [7]. At the same time, these devices are becoming increasingly accurate, meeting clinical standards [8,9]. Photoplethysmography is a must-have sensor in wearable devices for heart-rate monitoring, due to its simplicity, versatility, and non-invasiveness. Most often, these sensors are used at the fingertips due to their widely spread and shallow vascular bed [10], and, consequently, high signal amplitudes can be obtained [11]. While in an experimental setting these body parts are preferred, for lifestyle activity data collection they are impractical, and also much more susceptible to motion artifacts [8]. A caveat of PPG sensors is their tendency to saturate, which does not provide meaningful clinical information [12,13]. On top of this, when applying common biosignal filtering techniques, saturated portions lead to distorted filtered signal, a ringing effect, which in turn contributes to inaccurate peak detection and extracted features [12,14,15,16]. Consequently, alternative measurement sites need to be explored and validated to ensure that high-quality signals can be obtained. While many different anatomic regions are being used in research to obtain unsaturated data, a systemic analysis of the accuracy and quality of these new signals has not been made. Moreover, health parameters, such as heart rate (HR) and heart-rate variability (HRV), need to be accurately derived. In this paper, we evaluated the following anatomical sites: for the upper limbs, the anterior upper arm, posterior and anterior wrist, middle finger, and index finger regions; while for the lower limbs, the medial ankle and second left toe.

2. Background

2.1. Photoplethysmography

Photoplethysmography is a non-invasive method of measuring blood volume changes in the human body. Incident light with a specific wavelength is used to extract optical properties from the microvascular bed of the skin and modulate the pulsatile blood flow [17].
PPG sensors consist of a photoemitter (PE) and a photodetector (PD). The light emitted from the source is absorbed, scattered, and reflected by the human body’s tissues. The PD’s position dictates whether the PPG is transmissive or reflective, as seen in Figure 1. In both of these types, the blood flow is modulated by the amount of light that is transiently absorbed by the skin. Transmissive PPGs have the PD attached across the body part, acquiring a signal based on the attenuation of the light crossing it. Reflective-type PPGs have the PD positioned side by side with the PE. In this case, the obtained signal comes from the scattering and reflection of the light. Transmissive PPGs are capable of more stable readings than reflective PPGs. However, reflectance mode PPG is more easily implemented, especially in wearable devices, since both the PE and the PD can be integrated in close proximity to each other [10,18].
The intensity of the captured light depends on various biological factors, such as tissue opacity of the interposed skin, connective tissue, bone, and also the amount of blood in the capillary vessels. Blood has a higher absorption coefficient than the other bodily components; therefore, variations in blood volume, such as arterial pulsation, account for the measurable cardiac cycle variations observed in the PPG signal [10].
Although different wavelengths have been used for PPG acquisitions, higher wavelengths can reach higher depths of penetration, with the wavelength of 660 nm being able to reach subcutaneous tissues. Red wavelengths, 640–660 nm, and infrared wavelengths, 880–940 nm, are commonly used for PPG readings [19]. Nonetheless, PPG sensors working in these ranges are significantly influenced by heat radiation from human skin. For instance, when comparing PPG signals using these wavelengths upon varying temperatures, the correlation between the signal and the biological feature being studied is weaker [20]. To overcome this, green wavelengths (around 525 nm) can be used, because they are not affected as much by both temperature effects and motion artifacts [19,20,21].
The PPG signal comprises two main components, the pulsatile or cardiac cycle (CCC) and superimposed or basal (BC) components. The pulsatile component originates from the blood volume variations created by the cardiac activity. As such, this signal portion depends on the cardiac phases, namely the systolic and diastolic phases. By isolating a single PPG pulse, four main fiducial points can be seen, as shown in Figure 2.
The foot or onset corresponds to the beginning of the pulse (in the systolic phase), followed by the systolic peak, which is the maximum peak of the pulse signal, occurring after. The rising edge of the signal from onset to peak thus represents the rising blood volume within the measured body area. Next, a depression called the dicrotic notch occurs, as the aortic valve closes, followed by a lower peak, the diastolic peak. This second local maximum represents the reflected Windkessel wave [23,24]. The CCC component can thus be used to estimate cardiac-related features such as heart rate, heart rate variability, and blood pressure. Since these variations are synchronized with the cardiac cycle, they are also related to vasodilation, vasomotor, and vascular tones. The superimposed component, or nonpulsatile component, is mainly influenced by tissue composition and basic blood volume within the measurement site, and is often attenuated through signal conditioning [25]. This component is affected by internal parameters such as breathing, thermoregulation, and the activity of the sympathetic nervous system. Moreover, external parameters such as ambient light can also affect this signal component [10]. Because the amplitude of the PPG signal depends on the aforementioned internal and external factors, its measuring unit is considered arbitrary.

2.2. Measuring Sites

The most common measurement site for PPG signals is the finger. Being a peripheral part of the body with high blood perfusion allows for high signal amplitude [26]. The key disadvantage of this site is tied to the susceptibility of the sensor to motion artifacts. During daily activities, the fingers are constantly moving, creating a significant amount of motion noise which, in turn, compromises the measured signal [27]. Other measurement sites have been described in the literature, such as the earlobe, the wrist, the arm, or the ankle.
The earlobe has a much higher blood perfusion than the other measurement sites, even when compared to the finger, making it very attractive for obtaining high amplitude [28]. Earlobe sensors are also very easy to fabricate, but since the most common approach is with a spring-loaded ear clip, their use in long-term recordings becomes uncomfortable for the subject.
The wrist’s main advantages as a measurement site are its ease of use and discreetness. Many sensors are adapted into smartwatches, becoming a part of the subject’s usual garments, not requiring the volunteer to use any other equipment. The signal amplitude is lower than at the finger, but it is also less susceptible to motion artifacts [29,30].
The upper arm is also used despite the lower signal amplitude, due to its proximity to human arteries and its potential to be inserted into clothing, becoming just as comfortable as a wrist sensor [31].
The ankle, while less common, has a significant potential for implementing PPG data collection in discreet form factors. Being one of the farthest extremities of the body from the heart, it allows for the collection of peripheral blood perfusion data more accurately, helping detect conditions such as peripheral artery disease or peripheral vascular disease. It can also be easily integrated into undergarments such as socks to allow for constant monitoring without sacrificing comfort [22,32,33,34].

3. Materials and Methods

3.1. Data Collection

Two signal acquisition devices were used, consisting of the BITalino (r)evolution Plugged (PLUX, S.A., Lisbon, Portugal) and the ScientISST CORE (https://www.scientisst.com/).
Both these devices have been validated for their use in biosignal acquisitions, including PPG monitoring in research contexts. For instance, the BITalino device has been widely used within the research community for biosignal acquisitions [35,36,37,38,39,40]. Moreover, the ScientISST CORE [41] is a novel signal acquisition board especially developed for biomedical applications, and has also been used in similar research contexts [22,42,43,44,45]. For the BITalino, the 10-bit ADC was used, and for the ScientISST CORE, the 23-bit ADC was used. All data were collected with a sampling rate of 1000 Hz.
Among various PPG sensors available, off-the-shelf reflective-mode sensors were used for PPG acquisition (Pulse Sensor from World Famous Electronics LLC, New York, NY, USA). These sensors were selected for their cost-effectiveness, open-source hardware, and established usage in prior research [46,47,48,49,50,51,52,53,54,55]. As an analog sensor, various strategies can be employed to enhance its performance. These approaches encompass adjustments to the PD sensor, modifications to LED characteristics, changes in transimpedance amplification, and enhancements to signal conditioning.
Within the first strategy, exploring the fine-tuning of sensor sensitivity or adjusting the wavelength between the LED and the PD sensor were potential avenues. The second strategy involved the analysis of LED intensity or wavelength. Both strategies would necessitate either new specific parts or the ability to modify existing circuit components.
Our chosen approach, the third strategy, focused on adjusting transimpedance amplification. This allowed us to modify the final signal gain simply by replacing a specific resistance with another of the desired value.
Alternatively, addressing the saturation issue through signal conditioning would require a restructuring of the circuit’s filtering section to achieve a different outcome. However, this path posed challenges, as increased filtration might not guarantee the elimination of saturation and could potentially introduce artifacts resembling the correct waveform but inaccurately represented.
Given the array of optimization strategies, we opted for the modification of transimpedance amplification due to its significant impact on the output signal in a straightforward manner. This decision streamlines implementation for future researchers, ensuring accessibility and ease of adoption in subsequent studies. As mentioned before, the gain of the amplification stage was tuned, which, by hypothesis, can either reduce signal saturation or increase sensitivity. As shown in Figure 3, the amplification stage of the circuit has a fixed gain, as given by Equation (1) [56]:
A v = 1 + R 6 R 5
With the original resistance values of the sensor (R6 = 3.3 MOhm and R5 = 10 kOhm), the gain is 331. The amplification gain can thus be tuned by changing the resistance value of resistor R6.
To collect the data, fine-tuned sensors (Figure 4 and Figure 5) were used in different measurement sites, as seen in Table 1.
Moreover, the ScientISST CORE was covered by a 3D-printed enclosure, with an internally connected PPG sensor with G_high (See Table 1). The box has an opening where the PPG sensor is placed, allowing for data collection. To fit the 3D-printed box, a socket was also 3D-printed and sewn into an elastic band (Figure 5).
Data were collected from 28 volunteers in three setups. Due to synchronization issues and low signal quality, only 21 experiments were processed from the first setup, 22 from the second setup, and 20 from the third setup. Subjects were asked for anthropometric data, namely age, weight, and height. (Table 2). For the age, to further protect the volunteer’s privacy, it was asked through 5 different age ranges. As such, the median will be the age range that was most selected.
An experimental protocol was employed to obtain PPG data at rest and while performing an everyday action (writing on a computer). New measurement sites were also tested to explore their potential. Overall, three experimental setups were used (Figure 6).
First Setup
  • BITalino connected sensors:
    G_low sensor on the left hand’s middle finger (G_lowMidBit);
    G_def sensor on the left hand’s index finger (G_defIndBit).
  • ScientISST connected sensors:
    G_high box sensor on the left arm, three fingers above the anterior elbow (G_highArmSci);
    G_high sensor placed above the ulnar styloid process on the left anterior pulse (G_highAntSci).
Second Setup
  • BITalino connected sensors:
    G_low sensor on the left hand’s middle finger (G_lowMidBit);
    G_def sensor on the left hand’s index finger (G_defIndBit).
  • ScientISST connected sensors:
    G_high box sensor on the left arm, three fingers above the anterior elbow (G_highArmSci);
    G_high sensor placed above the ulnar styloid process on the left posterior pulse (G_highPosSci).
Third Setup
  • BITalino connected sensors:
    G_low sensor on the left hand’s middle finger (G_lowMidBit).
  • ScientISST connected sensors:
    G_high box sensor on the left leg, above the medial ankle (G_highAnkSci);
    G_def sensor placed on the second toe of the left foot (G_defToeBit).
To temporally align the signals acquired by the two devices, optical synchronization was employed, using an LED and a light sensor operating in the visible spectrum. The LED was connected to a digital output pin of the BITalino, and the light sensor (LUX sensor from PLUX, S.A., Lisbon, Portugal) was connected to an analog input channel of the ScientISST. In the experiments, synchronization was performed by triggering a brief pulse on the LED and recording the respective light pulse at the LUX sensor.
Two minutes of at-rest recording was conducted for the three setups. Then, in the first two setups, another two minutes were recorded while the volunteer copied a text on the computer. To more easily address each of the sensors, the abbreviations shown in Table 1 will be used.

3.2. Data Processing

In order to establish the upper limit of saturation on the measurement device, we conducted experiments to determine a range of ADC values for each specific fine-tuned sensor. These sensors were tested while connected to the respective acquisition board, as outlined in Table 1. During each experiment, the signal saturation was measured for a duration of 10 seconds (s) by directing the LED light from an additional sensor directly onto the sensor being tested in that particular moment.
We iteratively determined the amplitude threshold for signal saturation by analyzing the statistical results of each test. This process was repeated for each sensor until 10 s of saturation were achieved. To process the obtained signals, a manual threshold was defined to classify each sample as either saturated or not.
To calculate statistical values, we followed a method similar to [12], considering signal saturation at the upper limit as the mean value of the samples above the defined threshold subtracted by one standard deviation ( μ 1 × σ ). This subtraction resulted in a more conservative threshold that included more values of saturation. To prevent the detection of outliers, only one standard deviation was subtracted.

3.3. Quality Evaluation

To evaluate the signals, they were initially categorized into two sections: ‘at-rest’ and ‘movement.’ The first 2 min of signals from the first two setups were designated as at-rest periods, while the remaining signal data received the movement label. Signals from the third setup were uniformly labeled as at-rest.
To assess signal quality, we leveraged the periodicity of the signal, employing spectral entropy (SE), calculated using the formula based on Shannon’s entropy:
S E ( f 1 , f 2 ) = f 1 f 2 P ^ ( f ) log 2 ( P ^ ( f ) ) log 2 ( N )
Here, P ^ ( f ) represents an estimate of the power spectral density at frequency f, and N is the number of frequency bins in the range [ f 1 , f 2 ] . The SE metric yields a value based on the frequency distribution in the analyzed signal portion. High entropy indicates a uniform distribution of power frequency across the spectrum, while low entropy suggests a ’peak’ in the power density spectrum, where the power at a certain frequency is significantly higher than the rest [57]. This metric is translated into a range of 0 to 1, representing pure periodic signals on one end and random noise on the other.
For PPG signals, SE serves as a valuable quality indicator, revealing the prominence of the signal’s periodicity. A poor-quality signal is associated with values higher than 0.8 [58,59]. In each signal portion, consecutive 4 s intervals between 1 Hz and 3 Hz were used to calculate SE values [60]. The average of these SE values was computed per signal, and a final average per sensor was obtained. This process was repeated for non-saturated signals.
A comparison of pulse waves was conducted between sensors to determine their correlation. Signal pairs were created for each experiment. In the first two layouts, the G_lowMidBit signal was paired with all other signals. In the third layout, two pairs were formed: G_lowMidBit with G_defToeSci and G_defToeSci with G_highAnkSci.
Using BioSPPy [61], each signal underwent initial processing through a 4th-order Butterworth bandpass filter with critical frequencies [1 Hz, 8 Hz]. PPG peaks were extracted using Elgendi’s peak detection algorithm [62] with a peak window of 0.18, a beat window of 0.69, and a beat offset of 0.01 [63]. The signals were visually inspected to ensure that the peak waveforms co-occurred in both recordings. The next step involved selecting a pulse wave, normalizing the data, and synchronizing once more (i.e., prior to optical synchronization) to account for small delays arising from different measurement sites. The following correlation features were calculated:
  • Pearson Correlation Coefficient (PCC)—PCC is a statistical measure of the degree of linear correlation between two variables calculated as:
    P C C ( x , y ) = c o v ( x , y ) σ x σ y
    with c o v ( x , y ) being the covariance of two variables and σ x the standard deviation of the variable [64].
  • Cosine Similarity (CS)—CS is a measure of similarity between two vectors obtained with:
    C S ( x , y ) = x · y x y
  • Normalized Euclidean Distance (nED)—nED is the normalized distance between two points, computed as:
    n E D ( x , y ) = ( x y ) 2
    with x and y being the normalized versions of signals x and y. The signals were normalized using min–max scaling, with 0 as the minimum value and 1 as the maximum value.
To assess automatic peak detection in the signals collected by each sensor in every experiment, a ground truth was established through manual annotation of the systolic peaks [65]. In the first and second setups, the G_lowMidBit signal was utilized, while in the third setup, G_defToeSci was employed. G_lowMidBit was chosen because the sensor with default parameters often saturated in systolic peak regions. G_defToeSci was selected as it closely replicates the anatomical structure of the index finger (the standard location for PPG acquisition) and demonstrated higher signal amplitude than the ankle. Subsequently, the respective ground truth was compared to the automatically detected peaks in each signal.
A true positive was recorded if a ground-truth peak had a corresponding automatic peak within a 50-millisecond range. Conversely, if no automatic peak existed within that range, it was classified as a false negative. All automatic peaks without a corresponding ground-truth peak were deemed false positives. Using these values from the confusion matrix, the sensitivity and precision of the automatic peak detector were calculated.
For each signal, the HR was estimated based on the temporal differences between consecutive systolic peaks, measured in Beats Per Minute (BPM). This metric was calculated from both the automatic peaks and the manual ones (ground truth). Additionally, we assessed the statistical variability of HR, including the mean and standard deviation.
Next, we determined the difference between the mean HR computed from the automatic peaks and the ground-truth peaks. These differences were then averaged across all subjects and layouts for each sensor, providing the statistical variability of the HR estimation error within the test population. This variability was characterized by the mean and standard deviation of the differences in mean HRs per sensor [22].
Alongside the mean HR difference, the percentual error was also calculated through the following formula [66]:
E r r o r = A u t o m a t i c H R G r o u n d T r u t h H R G r o u n d T r u t h H R
The peak-to-peak intervals were also used to plot Poincaré plots.

4. Results

4.1. Saturation

After conducting the saturation experiment, the results in Table 3 indicate a notable variance between the minimum saturation values of each sensor and the corresponding mean and median. This disparity underscores that saturation is not an instantaneous process. Consequently, employing statistical values is justified for determining the final saturation threshold, rather than relying on a simple manual approach.
By applying these updated thresholds to the collected signals, we calculated the mean saturation percentage for each measurement site, as shown in Table 4. As anticipated, the original sensor, G_defIndBit, exhibited high saturation at 18.554%. This aligns with the observed pronounced signal saturation during systolic peaks, where the amplitude increased within the defined saturation range.
On the other hand, the lower gain sensor, G_lowMidBit, while not completely eliminating saturation, demonstrated a significant improvement in signal quality, with a mean saturation of only 0.479%. An illustrative example is presented in Figure 7.
The sensors used in the new measurement sites, namely the G_high sensors that were applied to the wrist, arm, and ankle, have almost no saturation, since for these locations, the signal amplitude was dampened (lower sensitivity).

4.2. Signal Quality

After calculating the mean Spectral Entropies (mSEs) for each sensor during both signal periods (refer to Table 5 and Table 6), all signals exhibited high quality, with mSEs consistently below 0.8. Notably, sensors on the fingers displayed the lowest mSEs, closely followed by the posterior wrist and arm sensors. An unexpected outcome emerged with the G_defIndBit sensor registering the lowest mSE. This anomaly can be attributed to saturation, resulting in reduced entropy due to continuous constant values.
To validate this proposition, examining the mSE of the non-saturated signal revealed an increase for G_defIndBit from 0.572 to 0.605. Although it approached the other mSEs, it remained the lowest value. The mSEs obtained during movement periods exhibited slightly higher values, yet still below the 0.8 quality threshold. Swarm plots were generated for both at-rest (see Figure 8) and movement (see Figure 9) periods.

4.3. Signal Correlation

To assess wave morphology, signal pairs were assigned (refer to Table 7 and Table 8). Examining the resting signal portions (see Table 7), the pairing of G_defIndBit with G_lowMidBit reveals that the sensor gain change successfully maintained wave morphology, yielding a PCC of 0.835 and a CS of 0.828. The saturation issue with the original sensor, G_defIndBit, may explain why this correlation is not higher. Nonetheless, all tested sites demonstrated robust results, with PCC and CS consistently above 0.8. The posterior pulse and arm, boasting PCCs of 0.928 and 0.916, respectively, exhibited the highest correlations.
Analyzing the nEDs, the highest values corresponded to the default finger sensor paired with the low-gain sensor. Wrist and arm measurements displayed similar values, while lower limb sites (ankle and toe) exhibited higher distances.
Turning attention to the movement section of the signals (see Table 8), a reduction in values is evident, likely attributed to movement artifacts, a well-known noise source to which PPG sensors are susceptible. In this specific movement scenario, computer work, a smaller correlation reduction can be observed in the G_highArmSci and G_highPosSci signals.

4.4. Peak Detection

After comparing the ground truths with various signals in both scenarios (refer to Table 9 and Table 10), several conclusions can be drawn. In the at-rest data, the values for G_lowMidBit, both at 0.99, directly compare the ground truth created from this signal with its automatic detection. The nearly unitary values highlight the high precision of the automatic algorithm employed. Conversely, G_defIndBit values are lower, as anticipated, due to the higher saturation of the signal.
The original sensor, G_defIndBit, exhibits saturation specifically within the systolic peak of the PPG waveform. This saturation results in a waveform segment characterized by a persistent ’plateau’ of constant signal, deviating from the typical peak morphology, a global maximum followed by a decreasing phase. The absence of the correct morphology poses challenges for algorithms in accurately identifying the systolic peak, leading to diminished sensitivity and precision in peak detection.
In general, sensors in the new measurement sites demonstrate high precision and sensitivity in systolic peak detection, with the posterior wrist performing the best, boasting a mean sensitivity of 0.95 and mean precision of 0.94. However, analyzing the movement data reveals that all signals were rendered unusable for peak detection, with sensitivities hovering near 0.

4.5. Heart Rate Extraction

After assessing peak detection precision, HR difference, and percentual error, tables were generated for both at-rest and movement segments (refer to Table 11 and Table 12). Notably, G_lowMidBit exhibited excellent results compared to G_defIndBit, due to both sensors being in a similar anatomical location, with G_lowMidBit displaying a higher saturation percentage. In the new measurement sites, G_highArmSci, G_highPosSci, and G_highAntSci also demonstrated very low HR differences, all below 2 BPM. However, G_highAnkSci, with a mean HR difference of 7 BPM, exhibited a considerably higher value.
During movement periods, overall HR differences tended to be higher than during at-rest periods. Examining the percent error of various sensors, G_lowMidBit displayed an error of only 0.361%, while all other sensors, except for G_highAnkSci, maintained a percent error below 5%. This threshold is commonly used to assess acceptable error in clinical devices [66].
Poincaré graphics were also generated for each signal (see Figure 10, Figure 11, Figure 12, Figure 13, Figure 14, Figure 15, Figure 16 and Figure 17). Healthy shapes and sizes, resembling a comet symmetric with the identity line [67], were observed in various graphics from each sensor. This indicates that heart rate variability could be accurately studied using these signals.

5. Discussion

The main objectives of this work were twofold: first, to address the saturation issue observed in the original PulseSensor PPG sensor, and second, to evaluate the feasibility of alternative measurement sites for obtaining clear PPG signals.
To address saturation, we conducted a comparative analysis between the original sensor (G_defIndBit) and a proposed lower gain version (G_lowMidBit). While the mean saturation percentage exhibited a significant decrease, it did not reach zero. Examination of SE values indicated noteworthy changes only in the original sensor (0.032 and 0.043 during at-rest and movement periods, respectively). This suggests that the newly fine-tuned sensors experience minimal overall saturation, which is insufficient to distort the main frequency peak of the signals.
Although there are discernible differences in the original signal, they are not pronounced because saturation primarily occurs around the peak of a clean PPG, representing a small portion of the overall signal. However, even this minor difference in saturation can prevent accurate feature extraction. Notably, wave morphology maintained a high correlation, and systolic peak detection showed significant improvement. Furthermore, heart rate extraction demonstrated much greater precision.
Regarding the new measurement sites, both anterior and posterior wrist locations exhibited no significant saturation, displayed good signal quality based on spectral entropy, and maintained favorable wave morphology when compared to the G_lowMidBit signal. The posterior sensor yielded slightly superior results compared to the anterior sensor across various measures, particularly in detecting systolic peaks and calculating HR differences. Consequently, the posterior wrist emerges as the preferred region for wrist PPG data collection. This preference aligns with prior research supporting the use of the posterior wrist as a measurement site [68,69,70,71], with consistent findings [66,72].
Similarly, the upper arm site demonstrated values comparable to the wrist locations, justifying its use in blood pressure estimation [73]. In contrast, the ankle sensor exhibited poorer results, characterized by higher spectral entropy, lower wave morphology similarity, and reduced sensitivity to systolic peaks. Nevertheless, signal results were still relatively high, suggesting potential resolution through adjustments to the sensor’s gain or signal processing. Past studies have also explored this area for heart rate and blood pressure extraction, highlighting its potential [34,74].
Results from movement segments of the signals underscore motion artifacts as the primary challenge for PPG sensors in daily life recordings. Spectral entropy increased during these segments, yet wave morphology comparisons remained consistently high. This anomaly may be attributed to comparisons made among signals affected by similar movement artifacts, maintaining similar wave morphologies but no longer representing a clean PPG waveform. This observation is reinforced by the notably low sensitivities and precisions in systolic peak detection. Despite prior proposals suggesting the upper arm as a more motion artifact-resistant measurement site [75], our analysis of collected motion data did not corroborate this proposition.

6. Conclusions

In summary, our research successfully demonstrated that an alternative PPG sensor built on open-source hardware, readily available in the commercial market, is capable of collecting signals of superior quality. This study contributes to advancing the current state of the art by conducting a comprehensive analysis of innovative PPG sensors designed for various body locations and novel anatomical sites. Specifically, we found that reducing the default sensor’s gain effectively mitigated saturation issues and improved its ability to capture high-quality signals. Also, when equipped with suitable sensors, the posterior wrist and arm can yield readings of comparable quality to the established gold standard for PPG data collection, i.e. fingertip measurements.

7. Future Work

Limitations of this study are the restricted age range and the number of volunteers from whom data were collected. It is well-established that peripheral arterial circulation undergoes changes with age, primarily attributed to increased arterial stiffness [76]. This physiological shift may impact or distort PPG signals when derived from different anatomical locations [77]. Age has also been identified as an independent predictor of the second derivative plethysmogram wave [78].
Given these considerations, it is crucial to recognize the potential influence of age on signal quality and waveform characteristics. Future investigations should encompass a broader range of age groups to ensure that the newly proposed measurement sites and sensors maintain consistent signal quality across diverse age scenarios. This approach would contribute to a more comprehensive understanding of the generalizability and robustness of the findings. Nevertheless, the study herein described constitutes a fundamental prerequisite and an important stepping stone for these subsequent studies to be developed.
The saturation of the original sensor was not entirely eliminated, reason for which further small adjustments can be implemented to completely rectify this issue. Additionally, exploring the possibility of increasing the gain for the sensor adapted to ankle measurements may yield improved results.
In future work, it would be advantageous to incorporate a quality metric that evaluates not only the similarity of wave morphology but also its accuracy in relation to an optimal waveform.

Author Contributions

Conceptualization, M.N.S., H.P.d.S., L.B-R., A.F.F. and P.J.B.; methodology, M.N.S., H.P.d.S., L.B.-R., A.F.F. and P.J.B.; software, M.N.S., A.F.F. and P.J.B.; validation, M.N.S. and L.B.-R.; formal analysis, M.N.S.; investigation, M.N.S.; resources, H.P.d.S., L.B.-R. and A.F.F.; data curation, M.N.S., A.F.F. and P.J.B.; writing—original draft preparation, M.N.S.; writing—review and editing, all authors; visualization, M.N.S.; supervision, all authors; project administration, H.P.d.S. and L.B.-R.; funding acquisition, H.P.d.S., P.J.B. and L.B.-R. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by AIDFM in a grant in the project DSAIPA/AI/0122/2020 “Aplicações Móveis Baseadas em Inteligência Artificial para Resposta de Saúde Pública” supported by the “Fundação para a Ciência e a Tecnologia, IP.P./MCTES” through national funds (PIDDAC) and FCT—Fundação para a Ciência e a Tecnologia, grant 2020.06675.BD. This work was also partially supported by the Ministry of Economy and Competitiveness of the Spanish Government co-founded by the ERDF (BISH project) under Grant PID2021-123087OB-I00, and by the Fundação para a Ciência e Tecnologia (FCT)/Ministério da Ciência, Tecnologia e Ensino Superior (MCTES) through national funds and when applicable co-funded by EU funds under the projects UIDB/50008/2020, and Scientific Employment Stimulus-Individual Call-2022.04901.CEECIND.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Instituto Superior Técnico, University of Lisbon (ethical opinion Ref. n.° 9/2022 “Feasibility of e-Textiles for Physiological Measurements at the Foot” issued on 7 June 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
PPGPhotoplethysmography
PEPhotoemitter
PDPhotodetector
CCCCardiac Cycle Component
BCBasal Component
ADCAnalog-to-Digital Converter
BMIBody Mass Index
SESpectral Entropy
PCCPearson Correlation Coefficient
CSCosine Similarity
nEDNormalized Euclidean Distance
BPMBeats per Minute
mSEmean Spectral Entropy
HRHeart Rate

References

  1. Cardiovascular Diseases. Available online: https://www.who.int/health-topics/cardiovascular-diseases (accessed on 17 November 2023).
  2. Benjamin, E.J.; Muntner, P.; Alonso, A.; Bittencourt, M.S.; Callaway, C.W.; Carson, A.P.; Chamberlain, A.M.; Chang, A.R.; Cheng, S.; Das, S.R.; et al. Heart Disease and Stroke Statistics—2019 Update: A Report From the American Heart Association. Circulation 2019, 139, e56–e528. [Google Scholar] [CrossRef] [PubMed]
  3. Mizuno, A.; Changolkar, S.; Patel, M.S. Wearable Devices to Monitor and Reduce the Risk of Cardiovascular Disease: Evidence and Opportunities. Annu. Rev. Med. 2021, 72, 459–471. [Google Scholar] [CrossRef] [PubMed]
  4. Navalta, J.W.; Ramirez, G.G.; Maxwell, C.; Radzak, K.N.; McGinnis, G.R. Validity and Reliability of Three Commercially Available Smart Sports Bras during Treadmill Walking and Running. Sci. Rep. 2020, 10, 7397. [Google Scholar] [CrossRef] [PubMed]
  5. Cosoli, G.; Antognoli, L.; Veroli, V.; Scalise, L. Accuracy and Precision of Wearable Devices for Real-Time Monitoring of Swimming Athletes. Sensors 2022, 22, 4726. [Google Scholar] [CrossRef] [PubMed]
  6. Muggeridge, D.J.; Hickson, K.; Davies, A.V.; Giggins, O.M.; Megson, I.L.; Gorely, T.; Crabtree, D.R. Measurement of Heart Rate Using the Polar OH1 and Fitbit Charge 3 Wearable Devices in Healthy Adults During Light, Moderate, Vigorous, and Sprint-Based Exercise: Validation Study. JMIR MHealth UHealth 2021, 9, e25313. [Google Scholar] [CrossRef] [PubMed]
  7. Jin, H.; Abu-Raya, Y.S.; Haick, H. Advanced Materials for Health Monitoring with Skin-Based Wearable Devices. Adv. Healthc. Mater. 2017, 6, 1700024. [Google Scholar] [CrossRef] [PubMed]
  8. Castaneda, D.; Esparza, A.; Ghamari, M.; Soltanpur, C.; Nazeran, H. A review on wearable photoplethysmography sensors and their potential future applications in health care. Int. J. Biosens. Bioelectron. 2018, 4, 195–202. [Google Scholar] [CrossRef]
  9. Izmailova, E.S.; Wagner, J.A.; Perakslis, E.D. Wearable Devices in Clinical Trials: Hype and Hypothesis. Clin. Pharmacol. Ther. 2018, 104, 42–52. [Google Scholar] [CrossRef]
  10. Park, J.; Seok, H.S.; Kim, S.S.; Shin, H. Photoplethysmogram Analysis and Applications: An Integrative Review. Front. Physiol. 2022, 12, 808451. [Google Scholar] [CrossRef]
  11. Tamura, T. Current progress of photoplethysmography and SPO2 for health monitoring. Biomed. Eng. Lett. 2019, 9, 21–36. [Google Scholar] [CrossRef]
  12. Narendra Kumar Reddy, G.; Sabarimalai Manikandan, M.; Narasimha Murty, N.V.L. On-Device Integrated PPG Quality Assessment and Sensor Disconnection/Saturation Detection System for IoT Health Monitoring. IEEE Trans. Instrum. Meas. 2020, 69, 6351–6361. [Google Scholar] [CrossRef]
  13. Uria-Rivas, R.; Rodriguez-Sanchez, M.C.; Santos, O.C.; Vaquero, J.; Boticario, J.G. Impact of Physiological Signals Acquisition in the Emotional Support Provided in Learning Scenarios. Sensors 2019, 19, 4520. [Google Scholar] [CrossRef] [PubMed]
  14. Papapanagiotou, V.; Diou, C.; Zhou, L.; van den Boer, J.; Mars, M.; Delopoulos, A. A Novel Chewing Detection System Based on PPG, Audio, and Accelerometry. IEEE J. Biomed. Health Inform. 2017, 21, 607–618. [Google Scholar] [CrossRef] [PubMed]
  15. Fay, T.H.; Hendrik Kloppers, P. The Gibbs’ phenomenon. Int. J. Math. Educ. Sci. Technol. 2001, 32, 73–89. [Google Scholar] [CrossRef]
  16. Leske, S.; Dalal, S.S. Reducing power line noise in EEG and MEG data via spectrum interpolation. NeuroImage 2019, 189, 763–776. [Google Scholar] [CrossRef] [PubMed]
  17. Elgendi, M.; Fletcher, R.; Liang, Y.; Howard, N.; Lovell, N.H.; Abbott, D.; Lim, K.; Ward, R. The use of photoplethysmography for assessing hypertension. NPJ Digit. Med. 2019, 2, 60. [Google Scholar] [CrossRef] [PubMed]
  18. Nijboer, J.A.; Dorlas, J.C.; Mahieu, H.F. Photoelectric plethysmography-some fundamental aspects of the reflection and transmission methods. Clin. Phys. Physiol. Meas. 1981, 2, 205–215. [Google Scholar] [CrossRef]
  19. Maeda, Y.; Sekine, M.; Tamura, T.; Moriya, A.; Suzuki, T.; Kameyama, K. Comparison of reflected green light and infrared photoplethysmography. In Proceedings of the 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008; pp. 2270–2272. [Google Scholar] [CrossRef]
  20. Maeda, Y.; Sekine, M.; Tamura, T. The advantages of wearable green reflected photoplethysmography. J. Med. Syst. 2011, 35, 829–834. [Google Scholar] [CrossRef]
  21. Matsumura, K.; Toda, S.; Kato, Y. RGB and Near-Infrared Light Reflectance/Transmittance Photoplethysmography for Measuring Heart Rate During Motion. IEEE Access 2020, 8, 80233–80242. [Google Scholar] [CrossRef]
  22. Ferreira, A.F.; da Silva, H.P.; Alves, H.; Marques, N.; Fred, A. Feasibility of Electrodermal Activity and Photoplethysmography Data Acquisition at the Foot Using a Sock Form Factor. Sensors 2023, 23, 620. [Google Scholar] [CrossRef]
  23. Suboh, M.Z.; Jaafar, R.; Nayan, N.A.; Harun, N.H.; Mohamad, M.S.F. Analysis on Four Derivative Waveforms of Photoplethysmogram (PPG) for Fiducial Point Detection. Front. Public Health 2022, 10, 920946. [Google Scholar] [CrossRef] [PubMed]
  24. Fujita, D.; Suzuki, A. Evaluation of the Possible Use of PPG Waveform Features Measured at Low Sampling Rate. IEEE Access 2019, 7, 58361–58367. [Google Scholar] [CrossRef]
  25. Scardulla, F.; Cosoli, G.; Spinsante, S.; Poli, A.; Iadarola, G.; Pernice, R.; Busacca, A.; Pasta, S.; Scalise, L.; D’Acquisto, L. Photoplethysmograhic sensors, potential and limitations: Is it time for regulation? A comprehensive review. Measurement 2023, 218, 113150. [Google Scholar] [CrossRef]
  26. Rhee, S.; Yang, B.H.; Asada, H. Artifact-resistant power-efficient design of finger-ring plethysmographic sensors. IEEE Trans. Biomed. Eng. 2001, 48, 795–805. [Google Scholar] [CrossRef] [PubMed]
  27. Tamura, T.; Maeda, Y.; Sekine, M.; Yoshida, M. Wearable Photoplethysmographic Sensors—Past and Present. Electronics 2014, 3, 282–302. [Google Scholar] [CrossRef]
  28. Tur, E.; Tur, M.; Maibach, H.I.; Guy, R.H. Basal Perfusion of the Cutaneous Microcirculation: Measurements as a Function of Anatomic Position. J. Investig. Dermatol. 1983, 81, 442–446. [Google Scholar] [CrossRef] [PubMed]
  29. Jung, J.; Lee, J. ZigBee Device Access Control and Reliable Data Transmission in ZigBee Based Health Monitoring System. In Proceedings of the 2008 10th International Conference on Advanced Communication Technology, Gangwon, Republic of Korea, 17–20 February 2008; Volume 1, pp. 795–797. [Google Scholar] [CrossRef]
  30. Lee, Y.; Shin, H.; Jo, J.; Lee, Y.K. Development of a wristwatch-type PPG array sensor module. In Proceedings of the 2011 IEEE International Conference on Consumer Electronics-Berlin (ICCE-Berlin), Berlin, Germany, 6–8 September 2011; pp. 168–171. [Google Scholar] [CrossRef]
  31. Maguire, M.; Ward, T.E. The Design and Clinical Use of a Reflective Brachial Photoplethysmograph; NUIM/SS/–/2002/04, Signals and Systems Research Group, National University of Ireland: Maynooth, Ireland, 2002. [Google Scholar]
  32. Ro, D.H.; Moon, H.J.; Kim, J.H.; Lee, K.M.; Kim, S.J.; Lee, D.Y. Photoplethysmography and continuous-wave Doppler ultrasound as a complementary test to ankle-brachial index in detection of stenotic peripheral arterial disease. Angiology 2013, 64, 314–320. [Google Scholar] [CrossRef]
  33. Perpetuini, D.; Chiarelli, A.M.; Cardone, D.; Rinella, S.; Massimino, S.; Bianco, F.; Bucciarelli, V.; Vinciguerra, V.; Fallica, G.; Perciavalle, V.; et al. Photoplethysmographic Prediction of the Ankle-Brachial Pressure Index through a Machine Learning Approach. Appl. Sci. 2020, 10, 2137. [Google Scholar] [CrossRef]
  34. Jönsson, B.; Laurent, C.; Skau, T.; Lindberg, L.G. A New Probe for Ankle Systolic Pressure Measurement Using Photoplethysmography (PPG). Ann. Biomed. Eng. 2005, 33, 232–239. [Google Scholar] [CrossRef]
  35. Rodrigues, L.M.; Rocha, C.; Ferreira, H.; Silva, H. Different lasers reveal different skin microcirculatory flowmotion—Data from the wavelet transform analysis of human hindlimb perfusion. Sci. Rep. 2019, 9, 16951. [Google Scholar] [CrossRef]
  36. Raposo, A.; da Silva, H.P.; Sanches, J. Camera-based Photoplethysmography (cbPPG) using smartphone rear and frontal cameras: An experimental study. In Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), virtual, 1–5 November 2021; pp. 7091–7094. [Google Scholar] [CrossRef]
  37. Kutt, K.; Drążyk, D.; Bobek, S.; Nalepa, G.J. Personality-Based Affective Adaptation Methods for Intelligent Systems. Sensors 2021, 21, 163. [Google Scholar] [CrossRef] [PubMed]
  38. Valente, J.; Godinho, L.; Pintado, C.; Baptista, C.; Kozlova, V.; Marques, L.; Fred, A.; Plácido da Silva, H. Neuroorganoleptics: Organoleptic Testing Based on Psychophysiological Sensing. Foods 2021, 10, 1974. [Google Scholar] [CrossRef] [PubMed]
  39. Swoboda, D.; Boasen, J.; Léger, P.M.; Pourchon, R.; Sénécal, S. Comparing the Effectiveness of Speech and Physiological Features in Explaining Emotional Responses during Voice User Interface Interactions. Appl. Sci. 2022, 12, 1269. [Google Scholar] [CrossRef]
  40. Krokidis, M.G.; Dimitrakopoulos, G.N.; Vrahatis, A.G.; Tzouvelekis, C.; Drakoulis, D.; Papavassileiou, F.; Exarchos, T.P.; Vlamos, P. A Sensor-Based Perspective in Early-Stage Parkinson’s Disease: Current State and the Need for Machine Learning Processes. Sensors 2022, 22, 409. [Google Scholar] [CrossRef] [PubMed]
  41. ScientISST SENSE. Available online: https://www.scientisst.com/sense (accessed on 15 November 2023).
  42. Bolaños, T.A.; da Silva, H.P. Towards Opportunistic Electrocardiography (ECG) Sensing in Mobile Devices. In Proceedings of the 2023 IEEE 7th Portuguese Meeting on Bioengineering (ENBENG), Porto, Portugal, 22–23 June 2023; pp. 163–166. [Google Scholar] [CrossRef]
  43. Pereira, L.; Plácido da Silva, H. A Novel Smart Chair System for Posture Classification and Invisible ECG Monitoring. Sensors 2023, 23, 719. [Google Scholar] [CrossRef] [PubMed]
  44. Monteiro, S.M.; Silva, H.P.d. A Novel Approach to Simultaneous Phonocardiography and Electrocardiography During Auscultation. IEEE Access 2023, 11, 78224–78236. [Google Scholar] [CrossRef]
  45. Areias Saraiva, J.; Abreu, M.; Carmo, A.S.; Plácido da Silva, H.; Fred, A. ScientISST MOVE: Annotated Wearable Multimodal Biosignals recorded during Everyday Life Activities in Naturalistic Environments. Circulation 2023, 101, e215–e220. [Google Scholar] [CrossRef]
  46. Heartbeats in Your Project, Lickety-Split ♥. Available online: https://pulsesensor.com/ (accessed on 13 November 2023).
  47. Gitman, Y.; Murphy, J. PulseSensor BLE Heart Rate Monitor with nRF52. In Heartbeat Sensor Projects with PulseSensor: Prototyping Devices with Biofeedback; Gitman, Y., Murphy, J., Eds.; Apress: Berkeley, CA, USA, 2023; pp. 241–254. [Google Scholar] [CrossRef]
  48. Wohingati, G.W.; Subari, A. Alat Pengukur Detak Jantung Menggunakan Pulsesensor Berbasis Arduino Uno R3 Yang Diintegrasikan Dengan Bluetooth. Gema Teknol. 2013, 17. [Google Scholar] [CrossRef]
  49. Ve Gokhan Ertas, I.H. Experimental analysis of optical sensors in detecting heart beat. In Proceedings of the 2017 Medical Technologies National Congress (TIPTEKNO), Trabzon, Turkey, 12–14 October 2017; pp. 1–4. [Google Scholar] [CrossRef]
  50. Jamme, C.; Persand, K.D.; Soto-Romero, G.; Vigué, A. S3Bike: An Electrically Assisted Cycle Monitored in Heart Beat to Help People with Heart Problem—Tests and Choice of the Best Heart Rate Sensor. In Proceedings of the 5th International Congress on Sport Sciences Research and Technology Support, Funchal, Madeira, Portugal, 30–31 October 2017; pp. 107–110. [Google Scholar] [CrossRef]
  51. Devis, Y.; Irawan, Y.; Junadhi; Zoromi, F.; Herianto; Amartha, M.R. Monitoring System of Heart Rate, Temperature and Infusion in Patients Based on Microcontroller (Arduino Uno). J. Phys. Conf. Ser. 2021, 1845, 012069. [Google Scholar] [CrossRef]
  52. Wang, Q. A Design and Research of Sports Smart Wearable Devices. In Proceedings of the 2020 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA), Tianjin, China, 26–28 June 2020; pp. 91–94. [Google Scholar] [CrossRef]
  53. Ma, H.; Fan, X.J.; Yin, X.Y. The Design of Wearable Sub-Health Monitoring System. Appl. Mech. Mater. 2015, 727–728, 670–674. [Google Scholar] [CrossRef]
  54. Morales, J.M.; Díaz-Piedra, C.; Di Stasi, L.L.; Martínez-Cañada, P.; Romero, S. Low-cost Remote Monitoring of Biomedical Signals. In Lecture Notes in Computer Science, Proceedings of the Artificial Computation in Biology and Medicine, Elche, Spain, 1–5 June 2015; Ferrández Vicente, J.M., Álvarez Sánchez, J.R., de la Paz López, F., Toledo-Moreo, F.J., Adeli, H., Eds.; Springer: Cham, Switzerland, 2015; pp. 288–295. [Google Scholar] [CrossRef]
  55. He, X.; Goubran, R.A.; Liu, X.P. Wrist pulse measurement and analysis using Eulerian video magnification. In Proceedings of the 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Las Vegas, NV, USA, 24–27 February 2016; pp. 41–44. [Google Scholar] [CrossRef]
  56. Tuning Pulse Sensor. Available online: https://www.afonso-ferreira.net/projects/tuning-pulse-sensor (accessed on 12 November 2023).
  57. Rezek, I.; Roberts, S. Stochastic complexity measures for physiological signal analysis. IEEE Trans. Biomed. Eng. 1998, 45, 1186–1191. [Google Scholar] [CrossRef] [PubMed]
  58. Böttcher, S.; Vieluf, S.; Bruno, E.; Joseph, B.; Epitashvili, N.; Biondi, A.; Zabler, N.; Glasstetter, M.; Dümpelmann, M.; Van Laerhoven, K.; et al. Data quality evaluation in wearable monitoring. Sci. Rep. 2022, 12, 21412. [Google Scholar] [CrossRef] [PubMed]
  59. Nasseri, M.; Nurse, E.; Glasstetter, M.; Böttcher, S.; Gregg, N.M.; Laks Nandakumar, A.; Joseph, B.; Pal Attia, T.; Viana, P.F.; Bruno, E.; et al. Signal quality and patient experience with wearable devices for epilepsy management. Epilepsia 2020, 61, S25–S35. [Google Scholar] [CrossRef] [PubMed]
  60. Abreu, M.; Carmo, A.S.; Peralta, A.R.; Sá, F.; Plácido Da Silva, H.; Bentes, C.; Fred, A.L. PreEpiSeizures: Description and outcomes of physiological data acquisition using wearable devices during video-EEG monitoring in people with epilepsy. Front. Physiol. 2023, 14, 1248899. [Google Scholar] [CrossRef] [PubMed]
  61. Carreiras, C.; Alves, A.P.; Lourenço, A.; Canento, F.; Silva, H.; Fred, A. BioSPPy: Biosignal Processing in Python. 2015. Available online: https://github.com/PIA-Group/BioSPPy/ (accessed on 12 November 2023).
  62. Elgendi, M.; Norton, I.; Brearley, M.; Abbott, D.; Schuurmans, D. Systolic Peak Detection in Acceleration Photoplethysmograms Measured from Emergency Responders in Tropical Conditions. PLoS ONE 2013, 8, e76585. [Google Scholar] [CrossRef] [PubMed]
  63. Silva, R.; Salvador, G.; Bota, P.; Fred, A.; Plácido da Silva, H. Impact of sampling rate and interpolation on photoplethysmography and electrodermal activity signals’ waveform morphology and feature extraction. Neural Comput. Appl. 2023, 35, 5661–5677. [Google Scholar] [CrossRef]
  64. Profillidis, V.A.; Botzoris, G.N. (Eds.) Chapter 5—Statistical methods for transport demand modeling. In Modeling of Transport Demand; Elsevier: Amsterdam, The Netherlands, 2019; pp. 163–224. [Google Scholar] [CrossRef]
  65. Event Annotator for Biosignals. Available online: https://www.afonso-ferreira.net/projects/event-annotator-for-biosignals (accessed on 12 November 2023).
  66. Shcherbina, A.; Mattsson, C.M.; Waggott, D.; Salisbury, H.; Christle, J.W.; Hastie, T.; Wheeler, M.T.; Ashley, E.A. Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort. J. Pers. Med. 2017, 7, 3. [Google Scholar] [CrossRef]
  67. Poincaré Graph. Available online: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwiB2dG3gr-CAxUqr5UCHUKyDK8QFnoECBQQAQ&url=https%3A%2F%2Ffiles.btlnet.com%2Fproduct-document%2F9792e3d5-3dbf-45d8-9e84-5c964a6a8602%2FBTL-Cardiopoint_WP_Poincare-graph_EN400_9792e3d5-3dbf-45d8-9e84-5c964a6a8602_original.pdf&usg=AOvVaw00BT8mAQ9CaV6QycMUAjbV&opi=89978449 (accessed on 12 November 2023).
  68. Pradhan, N.; Rajan, S.; Adler, A. Evaluation of the signal quality of wrist-based photoplethysmography. Physiol. Meas. 2019, 40, 065008. [Google Scholar] [CrossRef]
  69. Jang, D.G.; Kwon, U.K.; Yoon, S.K.; Park, C.; Ku, Y.; Noh, S.W.; Kim, Y.H. A Simple and Robust Method for Determining the Quality of Cardiovascular Signals Using the Signal Similarity. In Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA, 18–21 July 2018; pp. 478–481. [Google Scholar] [CrossRef]
  70. Moscato, S.; Lo Giudice, S.; Massaro, G.; Chiari, L. Wrist Photoplethysmography Signal Quality Assessment for Reliable Heart Rate Estimate and Morphological Analysis. Sensors 2022, 22, 5831. [Google Scholar] [CrossRef]
  71. Pereira, T.; Gadhoumi, K.; Ma, M.; Liu, X.; Xiao, R.; Colorado, R.A.; Keenan, K.J.; Meisel, K.; Hu, X. A Supervised Approach to Robust Photoplethysmography Quality Assessment. IEEE J. Biomed. Health Inform. 2020, 24, 649–657. [Google Scholar] [CrossRef]
  72. Wallen, M.P.; Gomersall, S.R.; Keating, S.E.; Wisløff, U.; Coombes, J.S. Accuracy of Heart Rate Watches: Implications for Weight Management. PLoS ONE 2016, 11, e0154420. [Google Scholar] [CrossRef] [PubMed]
  73. Wang, C.F.; Wang, T.Y.; Kuo, P.H.; Wang, H.L.; Li, S.Z.; Lin, C.M.; Chan, S.C.; Liu, T.Y.; Lo, Y.C.; Lin, S.H.; et al. Upper-Arm Photoplethysmographic Sensor with One-Time Calibration for Long-Term Blood Pressure Monitoring. Biosensors 2023, 13, 321. [Google Scholar] [CrossRef] [PubMed]
  74. Jarchi, D.; Casson, A.J. Estimation of heart rate from foot worn photoplethysmography sensors during fast bike exercise. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016. [Google Scholar] [CrossRef]
  75. Maeda, Y.; Sekine, M.; Tamura, T. Relationship Between Measurement Site and Motion Artifacts in Wearable Reflected Photoplethysmography. J. Med. Syst. 2011, 35, 969–976. [Google Scholar] [CrossRef] [PubMed]
  76. Ahn, J.M. New Aging Index Using Signal Features of Both Photoplethysmograms and Acceleration Plethysmograms. Healthc. Inform. Res. 2017, 23, 53–59. [Google Scholar] [CrossRef]
  77. Allen, J.; Murray, A. Age-related changes in peripheral pulse timing characteristics at the ears, fingers and toes. J. Hum. Hypertens. 2002, 16, 711–717. [Google Scholar] [CrossRef]
  78. Park, Y.J.; Lee, J.M.; Kwon, S.H. Association of the second derivative of photoplethysmogram with age, hemodynamic, autonomic, adiposity, and emotional factors. Medicine 2019, 98, e18091. [Google Scholar] [CrossRef]
Figure 1. Transmissive PPG on the left (A), reflective PPG on the right (B). Extracted from [10].
Figure 1. Transmissive PPG on the left (A), reflective PPG on the right (B). Extracted from [10].
Sensors 24 00214 g001
Figure 2. Normal PPG waveform of the CCC component. Adapted from [22].
Figure 2. Normal PPG waveform of the CCC component. Adapted from [22].
Sensors 24 00214 g002
Figure 3. PulseSensor circuit schematics. Extracted from [56].
Figure 3. PulseSensor circuit schematics. Extracted from [56].
Sensors 24 00214 g003
Figure 4. BITalino microprocessor and attached sensors. From left to right: G_low PPG sensor, G_def PPG sensor, LED.
Figure 4. BITalino microprocessor and attached sensors. From left to right: G_low PPG sensor, G_def PPG sensor, LED.
Sensors 24 00214 g004
Figure 5. From left to right: G_high PPG sensor, G_def PPG sensor, ScientISST microprocessor inside 3D printed box with G_high PPG sensor inserted and Lux connected. Above the sensors is the elastic band with the 3D-printed socket attached.
Figure 5. From left to right: G_high PPG sensor, G_def PPG sensor, ScientISST microprocessor inside 3D printed box with G_high PPG sensor inserted and Lux connected. Above the sensors is the elastic band with the 3D-printed socket attached.
Sensors 24 00214 g005
Figure 6. Diagram of the sensor placement in each of the layouts. The first and second layouts correspond to the anterior and posterior wrist positions, respectively.
Figure 6. Diagram of the sensor placement in each of the layouts. The first and second layouts correspond to the anterior and posterior wrist positions, respectively.
Sensors 24 00214 g006
Figure 7. Raw signal comparison between sensors G_defIndBit (in Red) and G_lowMidBit (in Blue).
Figure 7. Raw signal comparison between sensors G_defIndBit (in Red) and G_lowMidBit (in Blue).
Sensors 24 00214 g007
Figure 8. Spectral entropies of the various signals per sensor in at-rest periods.
Figure 8. Spectral entropies of the various signals per sensor in at-rest periods.
Sensors 24 00214 g008
Figure 9. Spectral entropies of the various signals per sensor in movement periods.
Figure 9. Spectral entropies of the various signals per sensor in movement periods.
Sensors 24 00214 g009
Figure 10. Poincaré graph of the ground truth at rest.
Figure 10. Poincaré graph of the ground truth at rest.
Sensors 24 00214 g010
Figure 11. Poincaré Graph of the G_defIndBit at rest.
Figure 11. Poincaré Graph of the G_defIndBit at rest.
Sensors 24 00214 g011
Figure 12. Poincaré graph of the G_lowMidBit at rest.
Figure 12. Poincaré graph of the G_lowMidBit at rest.
Sensors 24 00214 g012
Figure 13. Poincaré graph of the G_highAntSci at rest.
Figure 13. Poincaré graph of the G_highAntSci at rest.
Sensors 24 00214 g013
Figure 14. Poincaré graph of the G_highPosSci at rest.
Figure 14. Poincaré graph of the G_highPosSci at rest.
Sensors 24 00214 g014
Figure 15. Poincaré graph of the G_highArmSci at rest.
Figure 15. Poincaré graph of the G_highArmSci at rest.
Sensors 24 00214 g015
Figure 16. Poincaré graph of the G_defToeSci at rest.
Figure 16. Poincaré graph of the G_defToeSci at rest.
Sensors 24 00214 g016
Figure 17. Poincaré graph of the G_highAnkSci at rest.
Figure 17. Poincaré graph of the G_highAnkSci at rest.
Sensors 24 00214 g017
Table 1. Summary of sensor abbreviations, their R6 resistance value, sensor type, the anatomical site, the device they are connected to, and the sample range of the signal.
Table 1. Summary of sensor abbreviations, their R6 resistance value, sensor type, the anatomical site, the device they are connected to, and the sample range of the signal.
AbreviationR6 (M Ω )Sensor TypeAnatomical SiteDeviceSample Range
G_lowMidBit1G_lowLeft Hand’s Middle FingerBITalino[0–1023]
G_defIndBit3.3G_defLeft Hand’s Index FingerBITalino[0–1023]
G_highArmSci10G_highLeft Anterior ArmScientISST[0–8,388,607]
G_highPosSci10G_highLeft Posterior WristScientISST[0–8,388,607]
G_highAntSci10G_highLeft Anterior WristScientISST[0–8,388,607]
G_defToeSci3.3G_defLeft Foot’s Second ToeScientISST[0–8,388,607]
G_highAnkSci10G_highLeft Medial AnkleScientISST[0–8,388,607]
Table 2. Volunteers’ anthropometric data. The values are shown as median (min, max). For age, age ranges are used.
Table 2. Volunteers’ anthropometric data. The values are shown as median (min, max). For age, age ranges are used.
ParameterAll Subjects, n = 28
Age[18–29] (18 to 59)
Height, m1.69 (1.6 to 1.86)
Weight, kg64.5 (45 to 100)
Body Mass Index (BMI), kg/m 2 22.19 (15.94 to 30.86)
Table 3. Statistical sample values for saturation in different gain sensors.
Table 3. Statistical sample values for saturation in different gain sensors.
Sensor TypeMinMaxMedianMeanN° of Samples
G_defBit901977975974 ± 314,396
G_lowBit901978976975 ± 813,939
G_defSci8,001,7208,298,3048,061,4808,061,040 ± 768113,624
G_highSci8,001,9008,272,0808,208,3608,205,810 ± 11,77211,556
Table 4. Percentage of saturated signal in each sensor type and measurement site.
Table 4. Percentage of saturated signal in each sensor type and measurement site.
SensorMean Saturation (%)N° of Signals
G_lowMidBit0.479 ± 1.29468
G_defIndBit18.554 ± 11.87143
G_highArmSci0.474 ± 1.21043
G_highPosSci<0.001 ± 022
G_highAntSci<0.001 ± 021
G_defToeSci<0.001 ± 020
G_highAnkSci0.100 ± 0.33120
Table 5. Mean spectral entropy for each signal type in at-rest periods.
Table 5. Mean spectral entropy for each signal type in at-rest periods.
SensorMean SEMean SE without SaturationN° of Signals
G_lowMidBit0.629 ± 0.0610.629 ± 0.06143
G_defIndBit0.572 ± 0.0770.605 ± 0.05643
G_highArmSci0.643 ± 0.0610.644 ± 0.06143
G_highPosSci0.639 ± 0.0570.639 ± 0.05722
G_highAntSci0.683 ± 0.0550.683 ± 0.05521
G_defToeSci0.674 ± 0.6280.674 ± 0.06320
G_highAnkSci0.747 ± 0.0660.746 ± 0.06520
Table 6. Mean spectral entropy for each signal type in movement periods.
Table 6. Mean spectral entropy for each signal type in movement periods.
SensorMean SEMean SE without SaturationN° of Signals
G_lowMidBit0.658 ± 0.0470.657 ± 0.04643
G_defIndBit0.626 ± 0.0860.669 ± 0.10043
G_highArmSci0.637 ± 0.1910.634 ± 0.19043
G_highPosSci0.702 ± 0.1380.702 ± 0.13822
G_highAntSci0.733 ± 0.2160.733 ± 0.21621
Table 7. Signal correlation metrics between different sensors and different measurement sites for the at-rest periods. Three parameters were used: the Pearson Correlation Coefficient, the Cosine Similarity, and the Normalized Euclidean Distance.
Table 7. Signal correlation metrics between different sensors and different measurement sites for the at-rest periods. Three parameters were used: the Pearson Correlation Coefficient, the Cosine Similarity, and the Normalized Euclidean Distance.
Sensor PairPCCCSnEDN° of Signals
G_lowMidBit/
G_defIndBit
0.835 ± 0.0940.828 ± 0.0885.438 ± 2.18243
G_lowMidBit/
G_highArmSci
0.916 ± 0.0550.914 ± 0.0563.892 ± 1.26943
G_lowMidBit/
G_highAntSci
0.911 ± 0.0710.909 ± 0.0713.810 ± 1.67021
G_lowMidBit/
G_highPosSci
0.928 ± 0.0510.927 ± 0.0523.614 ± 1.36722
G_lowMidBit/
G_defToeSci
0.879 ± 0.0790.875 ± 0.0804.892 ± 1.82320
G_defToeSci/
G_highAnkSci
0.808 ± 0.1310.803 ± 0.1305.578 ± 2.33120
Table 8. Signal correlation metrics between different sensors and different measurement sites for the movement periods. Three parameters were used: the Pearson Correlation Coefficient, the Cosine Similarity, and the Normalized Euclidean Distance.
Table 8. Signal correlation metrics between different sensors and different measurement sites for the movement periods. Three parameters were used: the Pearson Correlation Coefficient, the Cosine Similarity, and the Normalized Euclidean Distance.
Sensor PairPCCCSnEDN° of Signals
G_lowMidBit/
G_defIndBit
0.840 ± 0.1200.832 ± 0.1165.185 ± 2.45743
G_lowMidBit/
G_highArmSci
0.879 ± 0.0950.875 ± 0.0954.635 ± 2.11343
G_lowMidBit/
G_highAntSci
0.807 ± 0.1550.799 ± 0.1575.983 ± 3.03921
G_lowMidBit/
G_highPosSci
0.860 ± 0.1150.855 ± 0.1165.034 ± 2.27422
Table 9. Mean sensitivity and mean precision of peak detection using Elgendi’s algorithm for at-rest periods.
Table 9. Mean sensitivity and mean precision of peak detection using Elgendi’s algorithm for at-rest periods.
SensorSensitivityPrecisionN° of Signals
G_lowMidBit0.99 ± 0.010.99 ± 0.0143
G_defIndBit0.72 ± 0.250.71 ± 0.2643
G_highArmSci0.89 ± 0.220.89 ± 0.2243
G_highPosSci0.95 ± 0.110.94 ± 0.1222
G_highAntSci0.84 ± 0.260.84 ± 0.2621
G_defToeSci0.81 ± 0.300.78 ± 0.3020
G_highAnkSci0.74 ± 0.190.72 ± 0.2020
Table 10. Mean sensitivity and mean precision of peak detection using Elgendi’s algorithm for movement periods.
Table 10. Mean sensitivity and mean precision of peak detection using Elgendi’s algorithm for movement periods.
SensorSensitivityPrecisionN° of Signals
G_lowMidBit0.019 ± 0.0190.020 ± 0.02043
G_defIndBit0.017 ± 0.0170.017 ± 0.01743
G_highArmSci0.018 ± 0.0180.018 ± 0.01843
G_highPosSci0.020 ± 0.0200.020 ± 0.02122
G_highAntSci0.018 ± 0.0160.018 ± 0.01621
Table 11. Mean heart rate difference in beats per minute and percent error between each sensor and the respective ground truth in the at-rest periods.
Table 11. Mean heart rate difference in beats per minute and percent error between each sensor and the respective ground truth in the at-rest periods.
SensorMean HR Difference (BPM)Percent Error (%)N° of Signals
G_lowMidBit0.241 ± 0.5570.361 ± 0.84843
G_defIndBit3.005 ± 6.7714.620 ± 11.18043
G_highArmSci1.268 ± 3.9781.848 ± 6.01743
G_highPosSci1.183 ± 2.9931.832 ± 5.03922
G_highAntSci1.892 ± 1.9682.669 ± 3.00721
G_defToeSci1.491 ± 3.0192.138 ± 4.44120
G_highAnkSci7.076 ± 9.25810.820 ± 15.89420
Table 12. Mean heart rate difference in beats per minute and percentual error between each sensor and the respective ground truth in the movement periods.
Table 12. Mean heart rate difference in beats per minute and percentual error between each sensor and the respective ground truth in the movement periods.
SignalMean HR Difference (BPM)Percent Error (%)N° of Signals
G_lowMidBit0.811 ± 1.3251.067 ± 1.69243
G_defIndBit1.938 ± 2.7932.640 ± 4.13443
G_highArmSci2.426 ± 4.2933.418 ± 6.63143
G_highPosSci4.575 ± 5.0176.279 ± 7.21222
G_highAntSci7.200 ± 6.1939.421 ± 8.39621
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Supelnic, M.N.; Ferreira, A.F.; Bota, P.J.; Brás-Rosário, L.; Plácido da Silva, H. Benchmarking of Sensor Configurations and Measurement Sites for Out-of-the-Lab Photoplethysmography. Sensors 2024, 24, 214. https://doi.org/10.3390/s24010214

AMA Style

Supelnic MN, Ferreira AF, Bota PJ, Brás-Rosário L, Plácido da Silva H. Benchmarking of Sensor Configurations and Measurement Sites for Out-of-the-Lab Photoplethysmography. Sensors. 2024; 24(1):214. https://doi.org/10.3390/s24010214

Chicago/Turabian Style

Supelnic, Max Nobre, Afonso Fortes Ferreira, Patrícia Justo Bota, Luís Brás-Rosário, and Hugo Plácido da Silva. 2024. "Benchmarking of Sensor Configurations and Measurement Sites for Out-of-the-Lab Photoplethysmography" Sensors 24, no. 1: 214. https://doi.org/10.3390/s24010214

APA Style

Supelnic, M. N., Ferreira, A. F., Bota, P. J., Brás-Rosário, L., & Plácido da Silva, H. (2024). Benchmarking of Sensor Configurations and Measurement Sites for Out-of-the-Lab Photoplethysmography. Sensors, 24(1), 214. https://doi.org/10.3390/s24010214

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop