ARKit 2 Furniture Preview in iOS 12 Shopping Apps
Third-party shopping apps can fully utilize Apple's ARKit 2 framework on iOS 12 to preview furniture and home decor directly within physical rooms. Released with iOS 12, ARKit 2 provided developers with advanced augmented reality capabilities that allowed retailers to display true-to-scale, photorealistic 3D models, helping consumers visualize how products fit their living spaces before purchasing.
Apple specifically engineered ARKit 2 to support retail use cases by improving environmental understanding and rendering accuracy. The framework introduced several key features that directly benefited furniture-previewing applications:
- Improved Plane Detection and World Tracking: ARKit 2 enhanced horizontal plane detection (for floors, carpets, and tabletops) and introduced vertical plane detection (for walls), ensuring virtual items like sofas, desks, and wall-mounted shelves align naturally with real surfaces.
- Persistent AR Experiences: Developers could enable users to map a room, place virtual furniture, close the app, and return later to find the items anchored in the exact same physical coordinates.
- Environment Texturing: ARKit 2 automatically generates cube maps of the real-world environment using the camera feed. This allows virtual furniture with reflective materials, such as polished wood, glass, or chrome, to realistically reflect the actual room and its lighting conditions.
- USDZ File Format and AR Quick Look: Introduced alongside iOS 12, the USDZ file format allowed 3D models to be integrated directly into third-party apps, Safari, and Messages. With AR Quick Look, shoppers could tap a product file and instantly view it in their room without requiring complex rendering engines.
Major retailers including IKEA, Wayfair, Target, and Houzz leveraged ARKit 2 on iOS 12 to minimize sizing errors and reduce product return rates by offering customers accurate scale, depth, and spatial awareness directly through their mobile devices.