Package com.azure.resourcemanager.machinelearning.models

Class OnlineRequestSettings

java.lang.Object
com.azure.resourcemanager.machinelearning.models.OnlineRequestSettings
All Implemented Interfaces:
com.azure.json.JsonSerializable<OnlineRequestSettings>
public final class OnlineRequestSettings extends Object implements com.azure.json.JsonSerializable<OnlineRequestSettings>
Online deployment scoring requests configuration.

  • Constructor Details

    • OnlineRequestSettings

      public OnlineRequestSettings()
      Creates an instance of OnlineRequestSettings class.

  • Method Details

    • maxQueueWait

      public Duration maxQueueWait()
      Get the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase `request_timeout_ms` to account for any networking/queue delays).
      Returns:
      the maxQueueWait value.

    • withMaxQueueWait

      public OnlineRequestSettings withMaxQueueWait(Duration maxQueueWait)
      Set the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase `request_timeout_ms` to account for any networking/queue delays).
      Parameters:
      maxQueueWait - the maxQueueWait value to set.
      Returns:
      the OnlineRequestSettings object itself.

    • requestTimeout

      public Duration requestTimeout()
      Get the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.
      Returns:
      the requestTimeout value.

    • withRequestTimeout

      public OnlineRequestSettings withRequestTimeout(Duration requestTimeout)
      Set the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.
      Parameters:
      requestTimeout - the requestTimeout value to set.
      Returns:
      the OnlineRequestSettings object itself.

    • maxConcurrentRequestsPerInstance

      public Integer maxConcurrentRequestsPerInstance()
      Get the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
      Returns:
      the maxConcurrentRequestsPerInstance value.

    • withMaxConcurrentRequestsPerInstance

      public OnlineRequestSettings withMaxConcurrentRequestsPerInstance(Integer maxConcurrentRequestsPerInstance)
      Set the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
      Parameters:
      maxConcurrentRequestsPerInstance - the maxConcurrentRequestsPerInstance value to set.
      Returns:
      the OnlineRequestSettings object itself.

    • validate

      public void validate()
      Validates the instance.
      Throws:
      IllegalArgumentException - thrown if the instance is not valid.

    • toJson

      public com.azure.json.JsonWriter toJson(com.azure.json.JsonWriter jsonWriter) throws IOException
      Specified by:
      toJson in interface com.azure.json.JsonSerializable<OnlineRequestSettings>
      Throws:
      IOException

    • fromJson

      public static OnlineRequestSettings fromJson(com.azure.json.JsonReader jsonReader) throws IOException
      Reads an instance of OnlineRequestSettings from the JsonReader.
      Parameters:
      jsonReader - The JsonReader being read.
      Returns:
      An instance of OnlineRequestSettings if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.
      Throws:
      IOException - If an error occurs while reading the OnlineRequestSettings.