How iOS 15 Live Text Scans Book Text into Notes

Apple's iOS 15 introduced Live Text, an optical character recognition (OCR) feature integrated deeply into the operating system. This technology allows users to instantly capture typed prose from physical book pages and insert it directly into the Notes app without third-party scanning software. The following breakdown explains the underlying technology and the exact process for digitizing printed text straight into your digital notes.

The Underlying Technology

Live Text relies on on-device machine learning powered by the Apple Neural Engine found in the A12 Bionic chip and later. When your camera points at a printed book, the Neural Engine analyzes the visual feed in real time.

It executes deep learning models to identify script, segment letterforms, recognize language syntax, and distinguish printed words from margins, page creases, or background surfaces. Because all image processing occurs locally on the device, the conversion happens with zero latency and complete privacy, functioning even without an active internet connection.

How to Extract Book Text Directly into Notes

You can capture book pages without leaving the Notes app by utilizing the inline camera scanner:

  1. Open the Notes app on an iPhone or iPad running iOS 15 or later.
  2. Create a new note or open an existing one.
  3. Tap the Camera icon located in the toolbar above the keyboard.
  4. Select Scan Text from the pop-up menu. This replaces the keyboard area with a live camera viewfinder.
  5. Point the camera at the physical book page. The system will detect the printed text and outline the recognized passage with a yellow selection bracket.
  6. A live preview of the extracted prose will appear inside the note. Once the desired passage is captured accurately, tap Insert.

Formatting and Text Behavior

Once inserted, the captured passage behaves exactly like standard typed text. The system automatically preserves paragraph structures, punctuation, standard spaces, and capitalization from the physical page. Users can immediately edit words, search within the note, run spell check, or format the text with bolding, bullet points, and headers.