iOS 15 Eye Tracking Accessibility Features
Apple introduced expanded support for third-party eye-tracking accessories in iOS 15, significantly enhancing device independence for individuals with severe physical and motor limitations. This update enabled compatible hardware to transform eye gaze into direct on-screen navigation, allowing users to control an iPhone or iPad without any physical touch. By deeply integrating eye-tracking functionality into the core operating system, iOS 15 established a more accessible, responsive, and customizable experience for gaze-based interaction.
Native Support for Third-Party Eye Trackers
With iOS 15, Apple integrated support for Made for iPhone (MFi) eye-tracking devices directly into the operating system. Rather than relying on proprietary, fragmented third-party software, external eye-tracking hardware could communicate natively with the device via AssistiveTouch, establishing a standardized connection across supported hardware.
Gaze-Driven Pointer Movement
Once an eye-tracking device is connected, iOS 15 allows the user's eye movements to guide an on-screen pointer. The system includes options to adjust:
- Tracking Sensitivity: Users can modify how quickly and fluidly the pointer moves across the screen.
- Pointer Smoothing: Reduces jitter caused by natural micro-movements of the eye, stabilizing target selection.
Dwell Control Integration
A key addition for eye tracking in iOS 15 is deep integration with Dwell Control. This feature enables users to perform actions simply by resting their gaze on a specific screen area for a predetermined amount of time. Options include:
- Custom Dwell Time: Adjusting the exact number of seconds required to confirm a selection.
- Automatic Tapping: Executing a primary click or tap automatically when the dwell timer finishes.
- Dwell Menus: Accessing quick menus for secondary actions like double-tapping, dragging, or long-pressing.
Full System Control via AssistiveTouch
Through the AssistiveTouch menu, eye-tracking users can execute system functions that previously required physical button presses or multi-finger gestures. By focusing their gaze on the AssistiveTouch menu, users can:
- Scroll through documents and web pages.
- Access the Home screen, App Switcher, and Control Center.
- Trigger Siri.
- Adjust hardware volume, lock the screen, or take screenshots.
On-Device Calibration
iOS 15 added integrated calibration settings for supported accessories. Users can calibrate and fine-tune their tracking accuracy directly within the Accessibility menu, ensuring the device accurately aligns the user's line of sight with the targeted pixels on the display.