How iOS 15 Live Text Detects Phone Numbers in Camera

Apple’s iOS 15 introduced Live Text, an on-device computer vision feature that identifies and interacts with text directly inside the native Camera viewfinder. By combining real-time optical character recognition (OCR) with intelligent data detection, Live Text recognizes phone numbers on physical objects—such as business cards, signs, and storefronts—and converts them into actionable links instantly without requiring the user to snap a photo.

On-Device Machine Learning and OCR

The detection process relies on the Apple Neural Engine integrated into A12 Bionic and newer processors. As the camera points at physical text, the Vision framework continuously analyzes the incoming video frames. Advanced deep learning models perform real-time text recognition locally on the device, ensuring low latency and user privacy since no image data is sent to external servers.

Contextual Data Detectors

Once the OCR engine extracts character strings from the viewfinder, iOS applies built-in Data Detectors. These algorithms analyze strings against international and local telephone numbering plans, standard formatting rules (such as country codes, area codes, hyphens, and parentheses), and surrounding context. This distinction allows the system to differentiate between random sequences of numbers, prices, addresses, and actual phone numbers.

User Interaction in the Viewfinder

When the Camera app identifies a phone number within the frame:

  1. Visual Framing: The camera highlights the text using a yellow bounding box.
  2. Activation: A dedicated Live Text indicator appears in the bottom-right corner of the viewfinder.
  3. Selection: Tapping the Live Text icon isolates and stabilizes the text area, bringing the detected elements into focus.
  4. Action Menu: The phone number becomes an interactive link. Tapping it triggers a contextual menu that allows users to place a call, send a message, initiate a FaceTime call, copy the number to the clipboard, or create a new contact in the Contacts app.