Augmented Reality

NatML has first-class integration with Unity ARFoundation for adding machine learning to augmented reality applications. We do so by providing ML feature implementations for working with AR camera and depth images:
Making Predictions in AR
Making predictions on the AR camera image closely mirrors the steps we've outlined above. The only difference comes in how we create an image feature for prediction. Instead of using the MLImageFeature class, we will instead use the MLARImageFeature class. First, we need to acquire the current XRCpuImage from ARFoundation:
1
// Get the ARCameraManager
2
ARCameraManager cameraManager = ...;
3
// Get the latest camera image
4
XRCpuImage image;
5
cameraManager.TryAcquireLatestCpuImage(out image);
Copied!
Next, we create an MLARImageFeature from the XRCpuImage:
1
// Create an AR image feature
2
var imageFeature = new MLARImageFeature(image);
Copied!
From here, the rest of the prediction workflow remains the same.
Working with AR Depth
AR depth

Integrations - Previous

Media Devices

Next - Integrations

Video Recording

Last modified 1mo ago

Copy link

Contents

Making Predictions in AR

Working with AR Depth