Apple Watch’s AI features for rewinding and recapping conversations begin beta testing

Apple’s AI-powered “Audio Intelligence” technology for the Apple Watch is now rolling out into beta testing, initially for developers in the iOS 27.3 update, after first being announced at the company’s Surprise and Shine hardware event in September. The technology includes a set of four opt-in AI features that allow Apple Watch Series 12 wearers to detect important sounds, identify songs, catch up on conversations, and take notes.

The sound recognition feature will help deaf and hard-of-hearing users identify important sounds like sirens, alarms, or doorbells from their watch, while the song recognition feature taps into Apple’s Shazam app to detect music playing in the background and identify the song name and artist.

However, the more potentially controversial features are those that listen to human conversations: Live Rewind and Siri Recaps.

Given the backlash to AI recording devices, like Meta’s AI glasses and other AI wearables, Apple has attempted to carve out a space where the features can be useful to Apple Watch owners, while still respecting the privacy of those around them.

With Live Rewind, the idea is to let you go back in time to see what someone just said, in case you missed it. For instance, if someone was giving you verbal directions or reading a long list of specials at a restaurant, you could double-press on the Watch’s digital crown to see what was said in the last 15 seconds as a text snippet displayed on the watch face. You can either view this snippet and then do nothing, and it will disappear permanently. Or you can save it to the standalone Siri app that shipped with iOS 27 for later access, which might be helpful if you’re trying to remember someone’s name or take a quick note from a fast-paced presentation.