
Wearable devices have become essential for tracking heart rate (HR) and heart rate variability (HRV) during sleep, with Garmin and Fitbit emerging as leaders in this space. Garmin models like the Fenix 9 Pro demonstrated low mean absolute error (MAE), with deviations rarely exceeding 2 BPM, while Fitbit devices excelled in correlation, closely mirroring reference trends. These findings were benchmarked against the Polar H10 ECG chest strap, a gold standard for HR and HRV tracking, according to The Quantified Scientist.
Explore how Garmin’s precision in MAE and Fitbit’s strength in trend correlation cater to different user needs. You’ll also gain insight into the limitations of devices like the Apple Watch and Samsung Galaxy Watch Ultra 2, particularly in HRV accuracy. This breakdown provides a clear comparison to help you identify which wearables align best with your sleep and recovery tracking goals.
Garmin and Fitbit Lead in HRV and Sleep Heart Rate Tracking
TL;DR Key Takeaways :
- Garmin devices, such as the Garmin Circa and Fenix 9 Pro, demonstrated strong accuracy in heart rate tracking during sleep, with mean absolute error (MAE) as low as 0.7 BPM and deviations rarely exceeding 2 BPM.
- Fitbit devices, including the Fitbit Edge and Charge 6, excelled in correlation with reference data but struggled with very low heart rates, slightly overestimating values below 38 BPM.
- The Apple Watch and Amazfit Helio Strap showed mixed accuracy, with the Apple Watch exhibiting variability in heart rate readings and the Amazfit Helio Strap often detecting heart rates that were too high.
- HRV tracking revealed strengths and limitations: Garmin devices excelled in MAE, while Fitbit devices led in correlation. The Garmin Fenix 9 Pro effectively identified HRV trends, and the Fitbit Charge 6 showed good correlation but underestimated HRV in higher ranges.
- Challenges in wrist-based HR and HRV tracking persist due to poor signal quality, but advancements in wearable technology have significantly improved accuracy compared to devices from five to ten years ago.
Garmin and Fitbit devices have emerged as leaders in tracking heart rate (HR) and heart rate variability (HRV) during sleep. Various wearables were evaluated against the Polar H10 ECG chest strap, a widely recognized gold standard for HR and HRV tracking. The Polar H10, used by companies like Apple and Google, measures the heart’s electrical activity with high precision, making it an ideal reference for assessing wearable accuracy.
Garmin: Accuracy in Mean Absolute Error
Garmin devices, such as the Garmin Circa and Garmin Fenix 9 Pro, excelled in mean absolute error (MAE), which quantifies the average difference between a wearable’s readings and the reference device. The Garmin Circa showed an average error of approximately 0.7 BPM, with deviations typically ranging from 1 to 2 BPM and a maximum deviation of about 7 BPM.
Similarly, the Fenix 9 Pro delivered consistent results, with most data points closely aligning with the reference and deviations rarely exceeding 2 BPM. These results highlight Garmin’s reliability for heart rate tracking during sleep.
The Fenix 9 Pro also performed well in identifying HRV trends, effectively distinguishing the highest and lowest HRV nights. Minor deviations were noted, with slightly higher values in lower HRV ranges and slightly lower values in higher ranges. Comparable trends were observed in the Garmin Forerunner 170.
Unlock more potential in Garmin and Fitbit HRV tracking by reading previous articles we have written.
- Garmin CIRQA vs Google Fitbit Air: Which Fitness Tracker Suits You Best?
- Fitbit Air vs Garmin Cirqa vs Hume Band 2.0: Which One’s for You?
- Garmin CIRQA vs WHOOP 5.0: Which Fitness Tracker Should You Buy?
Fitbit: Strong Correlation but Low Heart Rate Limitation
Fitbit devices, including the Fitbit Edge and Fitbit Charge 6, demonstrated exceptional correlation, closely aligning with trends in the reference data. For example, the Fitbit Edge produced data points that followed the reference line, though it showed a slight systematic deviation by detecting marginally higher heart rates.
However, Fitbit devices struggled with very low heart rates. On a night when the reference device recorded heart rates as low as 35 BPM, the Fitbit Air and Edge reported no values below 38 BPM, slightly overestimating heart rates below this threshold. While this limitation is unlikely to affect most users, it could be significant for individuals with unusually low resting heart rates. It is unclear whether this issue stems from hardcoded constraints or insufficient low-heart-rate examples in Fitbit’s model.
The Fitbit Charge 6, described as an older device, showed strong correlation for HRV but tended to detect slightly lower HRV values in higher ranges. Despite this, Fitbit devices generally outperformed Garmin in correlation for both HR and HRV.
Apple Watch and Other Devices: Mixed Accuracy
The Apple Watch exhibited greater variability in heart rate readings compared to Garmin and Fitbit. It occasionally recorded heart rates that were too high or too low, with some peaks potentially caused by export artifacts. Similarly, the Amazfit Helio Strap struggled with accuracy, often detecting heart rates that were too high, as shown by pronounced peaks in its data. These discrepancies may result from calculating maximum heart rate in a given area rather than the average.
The Eight Sleep mattress could detect low heart rates but cannot measure heart rate when the user is out of bed, a limitation not shared by the reference device. Meanwhile, the Samsung Galaxy Watch Ultra 2 performed well for heart rate tracking, detecting resting heart rates of 43 BPM on a low night and 48 BPM on a higher night. However, its HRV data was deemed unreliable due to implausibly poor results.
HRV Tracking: Strengths and Limitations
In HRV tracking, Garmin and Fitbit devices excelled in different areas. Garmin devices performed strongly in mean absolute error, while Fitbit devices led in correlation. For instance, the Fitbit Charge 6 showed good correlation but tended to underestimate HRV values in higher ranges. Conversely, the Apple Watch Ultra 4 achieved a very good mean absolute error but lagged in correlation.
The Garmin Fenix 9 Pro and Forerunner 170 displayed minor deviations in HRV detection, with slightly higher values in lower HRV ranges and slightly lower values in higher ranges. Despite these deviations, the Fenix 9 Pro effectively identified trends, such as the highest and lowest HRV nights.
The Pivot Air, tested on the biceps, demonstrated both a low mean absolute error and high correlation but exhibited a systematic bias. Nevertheless, it provided useful insights for identifying high and low HRV nights.
Performance of Other Devices
Other devices, such as the HD Pod 6 and Polar Loop, performed well but did not match the accuracy of Garmin and Fitbit. For example, the HD Pod 6 came close to Garmin’s performance but fell slightly short. The Polar Loop, tested on the biceps, delivered acceptable heart rate results but was less impressive for HRV based on mean absolute error. Similarly, the Fitbit Air, also tested on the biceps, was adequate for heart rate but underwhelming for HRV.
The Luna Band performed well for resting heart rate but requires improvement overall. Meanwhile, the Samsung Galaxy Watch Ultra 2 excelled in heart rate tracking but fell short in HRV accuracy. Devices outside the top-performing group, such as the Amazfit Helio Strap, exhibited issues with either correlation or mean absolute error.
Challenges in Wearable Technology
The evaluation highlighted the challenges of measuring HR and HRV on the wrist, a location with poor signal quality. Accurately detecting individual distances between heartbeats is more difficult on the wrist compared to other body locations. Despite these challenges, the tested devices showed significant advancements over technology from five to ten years ago.
Most devices are assumed to calculate average heart rate over five-minute intervals unless otherwise specified. While the host continues to refine their code and filtering methods, these adjustments may lead to updates in their findings. For most users, the average heart rate and HRV data provided by these devices are likely sufficient.
Overall Performance and Considerations
When considering both HR and HRV tracking, Garmin devices stood out for their low mean absolute error, while Fitbit devices excelled in correlation. Other devices, such as the HD Pod 6, performed well but did not reach the same level of accuracy. Devices like the Luna Band showed promise for resting heart rate but require further refinement.
The Quantified Scientist highlights Garmin devices as strong performers in mean absolute error for both heart rate and HRV, while Fitbit devices excel in correlation, particularly for trend detection. The HD Pod 6 and Samsung Galaxy Watch Ultra 2 showed good results for heart rate but fell short in other areas, such as HRV accuracy. While all tested devices provide adequate average heart rate and HRV data for most users, those prioritizing specific metrics may find Garmin or Fitbit to be the better choice depending on their needs.
Media Credit: The Quantified Scientist
Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.