The Apple Watch’s double tap gesture points at a new way to use wearables

  News, Rassegna Stampa
image_pdfimage_print

The coolest Apple Watch Series 9 and Ultra 2 feature wasn’t actually available when the watches launched last month. Double tap, which finally arrives today via the watchOS 10.1 update, lets you interact with the watch without ever needing to use the touchscreen. With a quick pinching motion, you can use it to scroll through the new smart stack of widgets in watchOS 10, pause or end timers, skip music tracks, and answer phone calls. It’s the sort of feature that you might read about and scoff at — until you’re unloading groceries from your car, hands full, and an important call comes through on your watch.

Depending on who you are, this kind of scenario might happen multiple times a day or once in a blue moon. In the past few weeks with the watchOS 10.1 beta, some days I completely forgot double tap existed. Either my hands were free, or muscle memory kicked in and I’d use the watch as I always have. Other days, when my to-do list felt as long as a CVS receipt, I morphed into a double tap fiend, so much so that I sometimes felt like a flamenco dancer snapping away with their castanets.

a:hover]:text-gray-63 [&>a:hover]:shadow-underline-black dark:[&>a:hover]:text-gray-bd dark:[&>a:hover]:shadow-underline-gray [&>a]:shadow-underline-gray-63 dark:[&>a]:text-gray-bd dark:[&>a]:shadow-underline-gray”>GIF by Amelia Holowaty Krales / The Verge

I got a rundown of how double tap works when I reviewed the Series 9 and Ultra 2, but it hits differently once you start using it in your day-to-day life. Controlling gadgets with gestures is often gimmicky — tech that seeks to show off rather than solve a problem. But double tap does solve a genuine problem and is born from accessible design that serves real needs. That, in turn, made me more curious about what went into creating the gesture, the tech behind it, its limitations, and what it implies for the future of smartwatches.

Double tap technically isn’t a new gesture so much. In 2021, Apple introduced Assistive Touch, an accessibility feature designed for people with limb differences or mobility issues. The idea was to give these folks a way to navigate through menus and control the Apple Watch without needing a second hand.

On the surface, it can seem like double tap is a rebadged version of Assistive Touch. That’s led to understandable confusion as to how the two features differ — and why double tap isn’t available on older Apple Watches that support Assistive Touch (Series 4 or later, including the first-gen SE and Ultra).

The short answer is that the Apple Watch Series 9 and Ultra 2 have a more powerful chip. Specifically, the new S9 features four neural engines for machine learning, which is what powers double tap. On older watches, Assistive Touch was run on the main CPU. But is that distinction really enough to make a difference?

a:hover]:text-gray-63 [&>a:hover]:shadow-underline-black dark:[&>a:hover]:text-gray-bd dark:[&>a:hover]:shadow-underline-gray [&>a]:shadow-underline-gray-63 dark:[&>a]:text-gray-bd dark:[&>a]:shadow-underline-gray”>GIF by Amelia Holowaty Krales / The Verge

Yes, according to David Clark, senior director of Apple Watch software engineering. “Because we’re on a purpose-built part of the processor, we’re not contending with all the other things the CPU is doing at any given time,” says Clark. The result is the Series 9 and Ultra 2 are 15 percent more accurate at detecting the double tap gesture, and the feature itself is much less power intensive.

I wouldn’t blame anyone for feeling skeptical. But there is an absurd amount of data that needs to be processed for double tap to work. At the most basic level, the algorithm that detects the double tap gesture is trained on data from the accelerometer, gyroscope, and optical heart rate sensor collected from the wrist.

a:hover]:text-gray-63 [&>a:hover]:shadow-underline-black dark:[&>a:hover]:text-gray-bd dark:[&>a:hover]:shadow-underline-gray [&>a]:shadow-underline-gray-63 dark:[&>a]:text-gray-bd dark:[&>a]:shadow-underline-gray”>Photo by Amelia Holowaty Krales / The Verge

If you know anything about wearable sensors, that’s not as simple as it sounds. Wrist data is incredibly tricky to work with because there’s a lot of noise in the signal. On top of calculating how light reflects off of blood pumping through your veins, smartwatch algorithms have to account for your arm (plus muscles, veins, and tendons) physically moving around during different activities like walking, running, and gesticulating. Another challenge is no two people have the exact same body. Differences in wrist size and limb length have to be taken into consideration.

Ironically, the years that Apple put into improving heart rate helped cut through that noise. According to Clark, “the gaps in reliable signals for heart rate” were what his team used to confirm subtler motions like the double tap gesture.

“Reliability also means that when you’re doing things that are almost like a tap, or a double tap, that we’re not erroneously triggering the gesture.”

“Reliability means that when you do the gesture, we’re able to detect it,” Clark says. “Reliability also means that when you’re doing things that are almost like a tap, or a double tap, that we’re not erroneously triggering the gesture. We got to make sure we’re able to detect the right thing through by tuning these things with the right scenarios.”

Meaning, the algorithm also has to be able to differentiate when someone is in motion, the type of activities they’re doing, and what other features they may be using on the watch at a given point in time. Streaming music or taking calls might seem unrelated to double tap, but the algorithm must be able to account for the noise introduced by subsystems like LTE and Bluetooth. That’s harder to do well when everything is done on the main CPU.

That’s the technical side of the equation. But practically speaking, it’s easier to see how Assistive Touch and double tap differ once you try using both.