Researchers Struggle to Use Apple Watch in Studies Due to Sudden Algorithm Changes

Researchers are rethinking plans to use the Apple Watch in studies after finding inconsistencies in the data gathered by the device (via The Verge).

apple watch series 6 product red back
Inconsistencies in the Apple Watch's heart rate variability data are reportedly caused by Apple tweaking the device's algorithms, meaning that data from the same time period can change without warning. Associate professor of biostatistics at the Harvard T.H. Chan School of Public Health and developer of the Beiwe data platform, J.P. Onnela, told The Verge:

These algorithms are what we would call black boxes — they're not transparent. So it's impossible to know what's in them.

Research fellows at Brigham and Women's Hospital exported the heart rate data from Apple Watches for the same period of time, but several months apart. The data should have been identical, but since it is filtered through an algorithm prior to export it was drastically different.

Apple changes its algorithms regularly and without warning, so exporting the same data at different times may use different algorithms. Beyond heart rate variability, researchers looking into sleep tracking have experienced similar problems with changes to algorithms.

This mostly precludes commercial devices from being used by researchers, resulting in the need for devices specifically designed to collect data for scientific studies. While this is adequate for some studies, it heavily constrains research into the medical value of commercially available products for users. Some researchers say that Apple should publicize the changes it makes to algorithms or make the Apple Watch's raw data available.

Related Roundups: Apple Watch 11, Apple Watch SE 3
Related Forum: Apple Watch

Popular Stories

iOS 26

iOS 26.1 Coming Soon: New Features for Your iPhone and Release Date

Monday October 27, 2025 7:55 am PDT by
The upcoming iOS 26.1 update includes a handful of new features and changes for iPhones, including a toggle for changing the appearance of the Liquid Glass design, "slide to stop" for alarms in the Clock app, and more. Below, we outline key details about iOS 26.1. Release Date Given that Apple has yet to seed an iOS 26.1 Release Candidate, which is typically the final beta version, the...
iOS 26

6 New Things Your iPhone Can Do in iOS 26.1

Wednesday October 29, 2025 4:22 am PDT by
Apple is about to drop iOS 26.1, the first major point release since iOS 26 was rolled out in September, and there are at least six notable changes and improvements to look forward to. We've rounded them up below. Apple has already provided developers and public beta testers with the release candidate version of iOS 26.1, which means Apple will likely roll out the update to all compatible...
maxresdefault

Apple TV 4K Could Still Launch Before 2025 Ends: All the Rumored Features

Monday October 27, 2025 4:51 pm PDT by
Apple is designing an updated version of the Apple TV 4K, and rumors suggest that it could come out sometime in the next couple of months. We're not expecting a major overhaul with design changes, but even a simple chip upgrade will bring major improvements to Apple's set-top box. Subscribe to the MacRumors YouTube channel for more videos. We've rounded up all the latest Apple TV rumors. ...
iOS 26

Apple Seeds iOS 26.1, iPadOS 26.1, and macOS Tahoe 26.1 Release Candidates

Tuesday October 28, 2025 1:07 pm PDT by
Apple today provided developers and public beta testers with the release candidate versions of upcoming iOS 26.1, iPadOS 26.1, macOS Tahoe 26.1, tvOS 26.1, watchOS 26.1, and visionOS 26.1 updates for testing purposes. The RCs betas come a week after Apple released the fourth betas. The new betas can be downloaded from the Settings app on a compatible device by going to General > Software...
M6 MacBook Pro Feature 1

M6 MacBook Pro: Release Date, Pricing, and What to Expect

Monday October 27, 2025 9:15 am PDT by
Apple this month refreshed the 14-inch MacBook Pro base model with its new M5 chip, and higher-end 14-inch and 16-inch MacBook Pro models with M5 Pro and M5 Max chips are expected to follow in early 2026. However, these machines will represent the final update to the current design, with Apple reportedly developing a completely new version of the MacBook Pro packed with next-generation hardware...
iPhone 17 Pro Cosmic Orange

8 Reasons to Wait for Next Year's iPhone 18 Pro

Thursday October 30, 2025 4:42 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models at the same time, which is why we often get rumored features months ahead of launch. The iPhone 18 series is no different, and we already have a good idea of what to expect for the iPhone 18 Pro and iPhone 18 Pro Max. One thing worth...
macos tahoe

Here Are Apple's Release Notes for macOS Tahoe 26.1

Tuesday October 28, 2025 1:21 pm PDT by
Apple today provided developers and public beta testers with the release candidate version of macOS Tahoe 26.1, which means the update will likely see a public launch next week. The release candidate includes notes on what's in the update, so we have a full picture of the new features that Apple has included. macOS Tahoe 26.1 adds AutoMix support over AirPlay, improved FaceTime audio...
ipad mini 7 feature blue

OLED iPad Mini: Release Date, Pricing, and What to Expect

Wednesday October 29, 2025 7:13 am PDT by
Rumors are stoking excitement for the next-generation iPad mini that Apple is reportedly close to launching. So what should we expect from the successor to the iPad mini 7 that Apple released over a year ago? Read on to find out. Processor and Performance Apple is working on a next-generation version of the iPad mini (codename J510/J511) that features the A19 Pro chip, according to...
M5 MacBook Pro

Waiting for New Macs? Apple Just Shared Bad News

Friday October 31, 2025 7:32 am PDT by
Apple has just given a strong indication that it will not be releasing any additional new Macs for the remainder of the year. Apple's CFO Kevan Parekh dropped the hint during the company's earnings call on Thursday:On Mac, keep in mind, we expect to face a very difficult compare against the M4 MacBook Pro, Mac mini, and iMac launches in the year-ago quarter.Parekh essentially gave a heads up ...

Top Rated Comments

csfossett Avatar
56 months ago
I have to admit I find this incredibly disconcerting. I get that companies like Apple are commercially driven, and algorithms tend to be in service to that, but they're also touting the Apple Watch as a major healthcare related device. Shouldn't medical/biological diagnoses and research be driven purely by data and information, and not by what amounts to programming developed to interpret data in advance of receiving it?
Score: 45 Votes (Like | Disagree)
hailey bee Avatar
56 months ago
It's the same principle as with raw format in photos – pro users need raw data.
Score: 32 Votes (Like | Disagree)
rjohnstone Avatar
56 months ago

Everyone here is a medical expert apparently
You don't have to be a medical expert to understand data analysis.
If the baseline data is changed via an algorithm update, you need to know how that algorithm was changed to account the data discrepancy.
Without the info, the data becomes useless.
Score: 19 Votes (Like | Disagree)
Malus120 Avatar
56 months ago
This is so incredibly disappointing, and yet also so undeniably Apple.

It's both funny and sad that one of the few aspects of Steve Jobs Apple that Tim Cook has chosen not to change, the company's intense secrecy, continues to be its downfall in so many current and potential markets.

Apple is fortunate to be the only real player in the wearables market at the moment. Despite the complaints, I would imagine most researchers will continue to work with Apple for the time being as they're the only game in town. That said, just as in the pro and corporate markets, Apple will eventually struggle to retain research clients in the long run if it continues to cling to its asinine refusal to provide even a basic level of transparency.

If Apple wants to expand outside of the consumer market in a serious way it needs to understand that secrecy is not the asset it is there but a serious liability that many folks just aren't going to be willing or able to deal with.
Score: 18 Votes (Like | Disagree)
rjohnstone Avatar
56 months ago

Welcome to working with data. Getting and pre-processing data to improve quality uses upward of 70% of the project time. Data is constantly changing due to legal or technical issues or to make it better for users other than you. Any study based on data needs to be able to handle these changes.
In order for a study to account for the changes, it needs to know what was changed. It would need the raw data or the algorithms to compare, so they can account for those changes.
Since Apple doesn't provide that information, the data collected is largely useless.
Score: 18 Votes (Like | Disagree)
Mrjetsondc Avatar
56 months ago
Apple: this watch is your health monitor!

also Apple: lol psych thanks for the 400 bucks
Score: 17 Votes (Like | Disagree)