How Live Text on iOS 15 Navigates to Addresses

Apple’s Live Text feature in iOS 15 uses advanced on-device machine learning to recognize text captured by your camera or stored in your photos. When pointing your iPhone at a real-world sign containing a physical address, the operating system can parse the text, identify it as a geographic location, and pass that data directly to Apple Maps to launch turn-by-turn navigation with just a tap.

On-Device Optical Character Recognition (OCR)

Live Text relies on the Apple Neural Engine found in devices powered by the A12 Bionic chip or newer. When you point your camera at a sign—such as a storefront, street marker, or billboard—the Neural Engine runs computer vision models in real time to locate text patterns in the visual feed. The process takes place entirely on-device to ensure user privacy and near-instantaneous processing speeds.

Data Detectors and Natural Language Processing

Once the system detects raw text, it passes the data through Apple's built-in Data Detectors framework. This framework uses Natural Language Processing (NLP) models trained to recognize structured information, including phone numbers, URLs, dates, and postal addresses.

When the text matches standard address formats (such as house numbers, street names, postal codes, or city designations), iOS 15 flags that specific string as an actionable address rather than plain text.

User Interaction in Camera or Photos

  1. Detection: When an address is visible, a small yellow bracket frames the text, and the Live Text indicator icon appears in the lower-right corner of the viewfinder or photo viewer.
  2. Selection: Tapping the Live Text icon freezes the frame and highlights all detected text.
  3. Action: The parsed address automatically becomes an active hyperlink, denoted by an underline.

Initiating Turn-by-Turn Navigation

Tapping the recognized address opens a contextual menu powered by iOS system actions. From this menu:

  • Selecting Get Directions automatically opens Apple Maps with the recognized address already set as the destination.
  • Apple Maps performs a quick reverse-geocoding lookup to pinpoint the exact coordinates.
  • The app presents the optimal routes for driving, walking, transit, or cycling.
  • Pressing Go starts active turn-by-turn navigation immediately.

Alternatively, a long-press on the highlighted address displays a quick preview of the location in a mini Maps pop-up window, allowing you to confirm the destination before launching full navigation.