Title Assessing the Accuracy of Popular Commercial Technologies That Measure Resting Heart Rate and Heart Rate Variability.
Author Stone, Jason D; Ulman, Hana K; Tran, Kaylee; Thompson, Andrew G; Halter, Manuel D; Ramadan, Jad H; Stephenson, Mark; Finomore, Victor S Jr; Galster, Scott M; Rezai, Ali R; Hagen, Joshua A
Journal Front Sports Act Living Publication Year/Month 2021
PMID 33733234 PMCID PMC7956986
Affiliation + expend 1.Rockefeller Neuroscience Institute, West Virginia University, Morgantown, WV, United States.

Commercial off-the shelf (COTS) wearable devices continue development at unprecedented rates. An unfortunate consequence of their rapid commercialization is the lack of independent, third-party accuracy verification for reported physiological metrics of interest, such as heart rate (HR) and heart rate variability (HRV). To address these shortcomings, the present study examined the accuracy of seven COTS devices in assessing resting-state HR and root mean square of successive differences (rMSSD). Five healthy young adults generated 148 total trials, each of which compared COTS devices against a validation standard, multi-lead electrocardiogram (mECG). All devices accurately reported mean HR, according to absolute percent error summary statistics, although the highest mean absolute percent error (MAPE) was observed for CameraHRV (17.26%). The next highest MAPE for HR was nearly 15% less (HRV4Training, 2.34%). When measuring rMSSD, MAPE was again the highest for CameraHRV [112.36%, concordance correlation coefficient (CCC): 0.04], while the lowest MAPEs observed were from HRV4Training (4.10%; CCC: 0.98) and OURA (6.84%; CCC: 0.91). Our findings support extant literature that exposes varying degrees of veracity among COTS devices. To thoroughly address questionable claims from manufacturers, elucidate the accuracy of data parameters, and maximize the real-world applicative value of emerging devices, future research must continually evaluate COTS devices.

  • Copyright © 2023
    National Institute of Pathogen Biology, CAMS & PUMC, Bejing, China
    All rights reserved.