NatML
Search…
Changelog
Tracking Changes

NatML

1.0.10

  • Improved prediction performance on Windows systems with dedicated GPU's.
  • Added MLArrayFeature constructors that accept NativeArray<T> native arrays to minimize memory copies.
  • Added setter accessors to MLArrayFeature indexers allowing for writing values to feature data.
  • Added MLAudioFeature.Contiguous method for decoding encoded audio feature into memory.
  • Added support for creating greyscale image MLEdgeFeature features from MLImageFeature features.
  • Added MLImageFeature.RegionOfInterest method for extracting an ROI from an image.
  • Added MLImageFeature.Contiguous method for decoding encoded image feature into memory.
  • Added MLDepthFeature.width convenience property for getting width of depth features.
  • Added MLDepthFeature.height convenience property for getting height of depth features.
  • Added MLImageType.interleaved property for checking whether image feature is interleaved or planar.
  • Added IMLCloudFeature interface to create cloud ML features for making cloud predictions.
  • Added "Clear Predictor Cache" menu item for clearing predictor cache in the editor.
  • Added NatMLHub.Subscribe method for making subscription requests to the NatML API.
  • Fixed memory leak when using certain vision predictors like Robust Video Matting.
  • Refactored MLHubModel class to MLCloudModel.
  • Refactored MLHubFeature class to MLCloudFeature.
  • Refactored HubDataType class to DataType.
  • Deprecated IMLHubFeature interface.
  • Removed MLAudioFeature.ReadToEnd method. Use MLAudioFeature.Contiguous method instead.

1.0.9

  • Added exclusive support for running CoreML graphs on iOS and macOS.
  • Added exclusive support for running TensorFlow Lite graphs on Android.
  • Added support for working with CoreML .mlmodel files in Unity projects.
  • Added support for working with TensorFlow Lite .tflite files in Unity projects.
  • Added support for Apple Silicon on macOS.
  • Added MLVideoFeature class for making ML predictions on video files.
  • Added MLVideoType feature type for inspecting video features.
  • Added MLDepthFeature abstract class for working with predictors that use depth data.
  • Added support for audio feature resampling in MLAudioFeature with sampleRate and channelCount fields.
  • Added MLEdgeFeature type for added type safety when authoring edge predictors.
  • Added MLImageFeature constructor which accepts a NativeArray<byte> pixel buffer.
  • Added MLImageFeature.width convenience property for getting width of image feature.
  • Added MLImageFeature.height convenience property for getting height of image feature.
  • Added MLImageFeature.CopyTo methods for copying pixel data from image feature.
  • Added MLAudioFeature constructor that accepts a NativeArray<float> to minimize memory copies.
  • Added MLAudioFeature path constructor for reading audio features from audio and video files.
  • Added MLAudioFeature.CopyTo methods for copying audio data from audio feature.
  • Added MLAudioFeature.FromStreamingAssets method for creating an audio feature from an audio file in the StreamingAssets folder.
  • Added MLAudioFeature.ToAudioClip method for converting audio feature to an AudioClip.
  • Added MLAudioFeature.ReadToEnd method to read audio data into memory for audio features backed by an audio file.
  • Added MLAudioType.FromFile method for inspecting the audio type of a video or audio file.
  • Added MLAudioType.FromAudioClip method for inspecting the audio type of an audio clip.
  • Added MLAudioType.FromVideoClip method for inspecting the audio type of a video clip.
  • Added MLAudioType.FromStreamingAssets method for inspecting the audio type of a video file in the StreamingAssets folder.
  • Added MLImageType constructor that accepts image channels.
  • Fixed MLImageFeature type incorrectly reporting 3 channels instead of 4.
  • Fixed MLImageFeature default normalization standard deviation having 0 for alpha channel.
  • Removed IMLModel interface as it has long been deprecated.
  • Removed IMLFeature interface as it has long been deprecated.

1.0.8

  • Fixed Cannot deserialize graph exception when deserializing cached predictors.
  • Fixed MLModelData being cached for DRAFT predictors.

1.0.7

1.0.6

  • Introduced Hub Predictors, which make predictions using server-side processing on NatML Hub.
  • Added MLHubModel class for authoring predictors that make cloud-based predictions using NatML Hub.
  • Added MLEdgeModel class for authoring predictors that make edge (on-device) predictions.
  • Added IMLHubFeature interface for creating server-side features when making predictions with NatML Hub.
  • Added IMLEdgeFeature interface for creating native features when making edge (on-device) predictions.
  • Added MLTextType feature type for inspecting MLTextFeature instances.
  • Added MLModelData.tag property to identify the predictor tag from NatML Hub.
  • Added MLModel.metadata dictionary for inspecting model metadata.
  • Added MLArrayFeature.Squeeze to remove singleton dimensions from an array feature.
  • Added MLArrayFeature.Flatten to flatten an array feature into one-dimensional array feature.
  • Added MLArrayFeature.ToArray to convert an array feature into a flattened primitive array.
  • Added MLImageFeature.ToTexture to convert an image feature into a Texture2D.
  • Added MLImageType.FromType static method for converting arbitrary feature types to image types.
  • Added implicit conversion from MLFeatureType to bool indicating if the type is non-null.
  • Added implicit conversion from MLTextFeature to string.
  • Fixed MLImageType image resolution constructor assuming planar format instead of interleaved format.
  • Moved IMLPredictor interface to the top-level NatSuite.ML namespace.
  • Moved IMLAsyncPredictor interface to the top-level NatSuite.ML namespace.
  • Deprecated IMLModel interface. Cast model to MLEdgeModel class instead.
  • Deprecated IMLFeature interface. Cast feature to IMLEdgeFeature interface instead.
  • Deprecated MLPredictorExtensions.GetImageSize static method. Use MLImageType.FromType instead.
  • Removed MLModelData.FromFile method. Use NatML Hub instead.
  • Removed MLModelData.FromStreamingAssets method. Use NatML Hub instead.
  • Removed MLPredictorExtensions.SerializeAudio method.
  • Removed MLPredictorExtensions.SerializeImage method.
  • Removed MLModel dictionary indexers. Use MLModel.metadata property instead.

1.0.5

  • Changed MLImageFeature.mean and std types to Vector4 to support normalization for alpha channel.
  • Fixed bitcode not being generated for iOS NatML.framework.
  • Removed metadata accessors from IMLModel interface. Cast to MLModel instead.

1.0.4

  • Added IMLAsyncPredictor interface for making server-side ML predictions with NatML Hub.
  • Added MLArrayFeature<T> constructor which accepts a native array feature for easy interop.
  • Added multi-indexing support to MLArrayFeature<T> for post-processing native array features.
  • Added MLArrayType.elementCount property to get the total number of elements for an array type.
  • Added MLArrayFeature<T>.shape property which returns the feature type's shape for convenience.
  • Added MLArrayFeature<T>.elementCount property which returns the feature type's element count for convenience.
  • Added MLArrayFeature<T>.CopyTo method to copy feature data into an array.
  • Added MLArrayFeature<T>.Permute method to create a shallow array view with permuted dimensions.
  • Added MLArrayFeature<T>.View method to create a shallow array view with a different shape.
  • Added MLPredictorExtensions.NonMaxSuppression method for working with detection models.
  • Added MLPredictorExtensions.GetImageSize method for making predictions with image features.
  • Added MLPredictorExtensions.SerializeAudio method for making Hub predictions with audio features.
  • Added MLPredictorExtensions.SerializeImage method for making Hub predictions with image features.
  • Fixed MLAsyncPredictor predictions never completing if backing predictor encountered exception.

1.0.3

  • Greatly improved performance and memory pressure when performing multi-indexing with MLArrayFeature<T>.
  • Added MLPredictorExtensions.RectifyAspect extension method for correcting detection rects from aspect-scaled images.
  • Fixed crash when making predictions with recurrent models on previous state features.
  • Fixed crash when getting native array feature shape for MLArrayFeature<T>.
  • Fixed memory leak when making predictions with image features on iOS and macOS.

1.0.2

  • Added MLModelData.audioFormat property for working with audio and speech ML models.
  • Added MLTextFeature for working with natural language processing models.
  • Exposed mean and std arrays in MLModelData.Normalization struct for models that require arbitrary normalization.
  • Removed generic MLClassificationPredictor and MLDenseClassificationPredictor predictors.
  • Removed ability to specify class labels for local .onnx file in project. Use NatML Hub instead.

1.0.0

  • First release.

NatMLX

1.0.5

  • Added support for NatML 1.0.9.
  • Fixed MLARImageFeature default normalization standard deviation having 0 for alpha channel.

1.0.4

  • Added support for Hub predictions to MLARImageFeature.
  • Added support for ARFoundation Remote when making predictions with camera images on macOS.

1.0.3

  • Changed MLARImageFeature.mean and std types to Vector4 to support normalization for alpha channel.
  • Fixed bitcode not being generated for iOS NatMLX.framework.

1.0.2

  • Added MLARDepthFeature for predictors that need depth data to compute outputs.
  • Added Tokenizers namespace with BERTTokenizer for natural language processing.

1.0.0

  • First release.