Apple ARKit is Augmented Reality SDK introduced in iOS 11.0, which integrates the iOS or visionOS device RGB camera data, Motion Sensor data and LiDAR Scanner data to produce robust AR experiences.
ARKit uses Visual Inertial Odometry (VIO) to accurately track the world around it. VIO fuses RGB camera sensor data at 60 fps with core-motion data at 1000 fps. These two inputs allow the device running iOS or visionOS to sense how it moves within a room with a high degree of accuracy, and without any additional calibration. With ARKit app, user is able to create and render 3D scenes using realitykit, scenekit, sprite-kit, and metal frameworks.
The latest version of ARKit has the following features in its arsenal: People Occlusion with depth channel semantics, LiDAR Sensor support for high quality Depth channel and better Scene Understanding, live Motion Capture allowing animate a 3D skeleton, simultaneous Front and Rear camera tracking, hand tracking, ability to track up to 3 faces with a TrueDepth camera, collaborative sessions between 6 users, Geo Tracking and many other useful features.
