Comment on page
Augmented Reality
Augmented Reality + Machine Learning = 🥰🥰🥰
NatML has first-class integration with Unity ARFoundation for adding machine learning to augmented reality applications. We do so by providing ML feature implementations for working with AR camera and depth images:
Making predictions on the AR camera image closely mirrors the steps we've outlined above. The only difference comes in how we create an image feature for prediction. Instead of using the
MLImageFeature
class, we will instead use the MLXRCpuImageFeature
class. First, we need to acquire the current XRCpuImage
from ARFoundation:// Get the ARCameraManager
ARCameraManager cameraManager = ...;
// Get the latest camera image
XRCpuImage image;
cameraManager.TryAcquireLatestCpuImage(out image);
Next, we create an
MLXRCpuImageFeature
from the XRCpuImage
:// Create an AR image feature
var imageFeature = new MLXRCpuImageFeature(image);
From here, the rest of the prediction workflow remains the same.
- AR depth
Last modified 11mo ago