Explained

What is LiDAR?

Actualized ambition: a complete overview of Apple's integration of cutting-edge sensor technology.

KIRI Team · Jan 21, 2025

LiDAR Technology: A Quick Summary

The term LiDAR stands for Light Detection and Ranging, which is a remote sensing technology that uses laser light to measure distances. By emitting pulsed laser light and measuring the time it takes for the pulses to return after reflecting off surfaces, LiDAR systems can create highly accurate, three-dimensional representations of the target environment or object. Originally used in fields such as aerospace and geology, LiDAR is now integrated into consumer devices like smartphones and tablets, enhancing practices such as 3D scanning and augmented reality. It provides precise 3D modeling for architecture and construction, aids cultural institutions in preserving historical sites, and helps the film and gaming industries create realistic visuals. In AR and VR, LiDAR enables seamless integration of digital content with the physical world.

Apple began incorporating LiDAR technology into its products starting in 2020, and KIRI Engine's LiDAR Scan mode is designed to take advantage of the hardware technology available on LiDAR-Equipped iPhone and iPad models.

LiDAR Scanner

Functionality

  • Distance measurement: LiDAR accurately measures distances by emitting laser pulses and calculating the time it takes for the light to return after reflecting off surfaces.
  • 3D mapping: Creates detailed three-dimensional maps and models of environments, objects, and terrain.
  • Spatial analysis: Provides precise spatial information for analyzing landscapes, structures, and environments.

How does KIRI Use LiDAR?

There are three different methods under KIRI Engine's LiDAR Scan mode, each serving a unique purpose.

  • Room Scan

This method is designed for capturing the geometry and layout of entire interiors. It utilizes the LiDAR sensor to quickly and accurately map out the dimensions and features of indoor spaces. It offers customization options for various design themes, precise measurements of distances, angles, and dimensions, and provides a 2D floor plan view. This can be particularly useful for applications in interior design, real estate, and architecture for quick visualizations.

  • Scene Scan

The Scene Scan method allows users to conduct a 360° scan of their surroundings using their phone, leveraging the LiDAR sensor to capture detailed spatial information over a broader area, creating the distance-accurate model of the environment effectively.

  • Object Capture

Object Capture is the latest integration made possible with iOS 17, which effectively performs high-fidelity local photogrammetry. By moving around the object and taking pictures, users can create highly detailed 3D models using this method.

Object Capture API

With the introduction of iOS 17, the Object Capture API has been significantly improved to allow real-time photogrammetry, revolutionizing local 3D model generation on iOS devices. This new capability is exclusive to iPhone Pro models (12 and up), taking advantage of the A-series chips and LiDAR sensors, to facilitate faster and more efficient 3D scanning. This local algorithm allows users to generate 3D models directly on their devices without the need for cloud uploads, which greatly enhances both speed and privacy.

Using LiDAR Object Capture

The primary export format for 3D models created using the Object Capture API is USDZ (Universal Scene Description Zip). USDZ files are particularly advantageous because they maintain high fidelity while being lightweight, making them ideal for real-time rendering in augmented reality environments. KIRI Engine features a complete AR viewer, allowing users to drag their Object Captured-models into their camera view and visualize the model in real time and space (AR).

While the technology is made possible with Apple's API, KIRI Engine greatly leverages its application design experience to provide users the most intuitive and seamless experience when using this scanning method. KIRI Engine users with LiDAR-Equipped iOS devices will have the most creative versatility thanks to the LiDAR advancements as well as the powerful cloud algorithms offered innately by KIRI Engine.