iOS Measure App: How It Works and Uses ARKit

Apple introduced the Measure app in iOS 12, transforming iPhones and iPads into functional digital tape measures using Augmented Reality (AR). This article covers what the Measure app is, explains how it leverages Apple's ARKit technology to calculate real-world physical dimensions through a device's camera, and examines its core capabilities and practical accuracy.

What Is the Measure App?

The Measure app is a built-in iOS utility designed to quickly gauge the size of real-world objects and spaces without a physical tape measure. Introduced as a native application in iOS 12, it combines the device’s camera, motion sensors, and processing power to calculate distances, measure dimensions, and automatically recognize the area of rectangular objects. In addition to linear measurements, the app incorporates a digital level tool—previously housed in the iOS Compass app—to check if surfaces are flat or plumb.

How the Measure App Uses ARKit

The Measure app is powered directly by ARKit, Apple’s augmented reality development framework. ARKit enables the device to understand and map the physical environment through several fundamental technologies:

  • Visual Inertial Odometry (VIO): ARKit combines raw sensor data from the device's motion sensors (accelerometer and gyroscope) with visual information captured by the camera. By analyzing changes between video frames, VIO tracks the device’s precise movement and orientation in three-dimensional space in real time.
  • Plane Detection: ARKit scans the environment to identify horizontal and vertical surfaces, such as floors, tables, and walls. Once a surface is identified, the Measure app can anchor virtual measurement points directly to that plane, ensuring the line remains physically grounded.
  • Feature Point Tracking: The camera looks for visual differences and distinct textures in the scene. By tracking how these "feature points" shift relative to the camera's perspective, ARKit constructs a spatial map and calculates the distance from the lens to the surface.
  • Raycasting and Coordinate Mapping: When a user taps the screen to drop a measurement pin, ARKit projects a virtual ray into the 3D environment to determine where it intersects with a detected surface. As the user moves the device and sets a second point, ARKit calculates the Euclidean distance between the two 3D coordinates and converts the value into imperial or metric units.

Key Features and Capabilities

  • Point-to-Point Measurement: Users can set starting and ending points manually to measure lengths, heights, and diagonal distances across flat or uneven surfaces.
  • Automatic Shape and Area Detection: When the camera recognizes a distinct rectangular object—such as a picture frame, document, or rug—ARKit automatically draws a bounding box around it, providing immediate length, width, and square area calculations with a single tap.
  • Continuous Guides: On supported devices, ARKit displays a dynamic virtual ruler and guide lines, snapping measurement points to edges and corners for improved alignment.
  • Measurement History and Capture: Users can save measurements as photos or copy the calculated dimensions directly to the clipboard for use in other applications.

Accuracy and Performance Factors

While the Measure app provides fast and practical estimations, its accuracy depends on environmental conditions. Because ARKit relies on visual cues, the app performs best in well-lit environments on surfaces with distinct textures. It can struggle in low-light conditions, on completely featureless white walls, or on reflective and transparent materials such as glass and polished metal. On newer Pro-tier devices equipped with a LiDAR Scanner, ARKit enhances the Measure app by using direct time-of-flight laser pulses to capture depth instantaneously, significantly improving measurement speed, precision, and low-light reliability.