Apple's advanced ML algorithm makes the 60 Hz ARDepthData including the depthMap and the confidenceMap, by processing the LiDAR output together with the frame images; Depth API for ARKit 4.
ARMeshAnchor is updated by processing constantly the last frames of the ARDepthData; Scene Geometry API for ARKit 3.5.
The confidenceMap reveals low confidences (reflectances) in larger distances than 4.5 m, or in shadow regions, or with inclined/dark/specular object surfaces.
ARConfidenceLevel: low - red, medium - dark, high - fogged.
The source codes of the App are available:
"Creating a Fog Effect Using Scene Depth"
https://developer.apple.com/documenta...
// Set to `true` to visualize confidence.
bool confidenceDebugVisualizationEnabled = false;
Tools used:
Apple iPad Pro LiDAR
Apple ARKit 4
Apple Metal API.
3-D, least squares, analytic geometry, differential geometry, principal curvature, principal direction, fitting, curve, surface, orthogonal distance fitting, robust fitting, point cloud, segmentation, region growing, outlier elimination, object recognition, reverse engineering, CAD CAM, BIM, augmented reality, occlusion, laser scanner, curve fitting, surface fitting, plane fitting, sphere fitting, cylinder fitting, cone fitting, torus fitting, piping, reducer, elbow, box, cuboid, radius, length, size, position, location, orientation, pose, rotation, axis, Software, ISO 10360-6, ARKit, ARCore, HoloLens, RealSense, FindSurface, LiDAR, ToF, laser scanner, iPad Pro, iPhone Pro
Информация по комментариям в разработке