Package com.azure.search.documents.indexes.models

Class AzureOpenAITokenizerParameters

java.lang.Object
com.azure.search.documents.indexes.models.AzureOpenAITokenizerParameters
All Implemented Interfaces:
com.azure.json.JsonSerializable<AzureOpenAITokenizerParameters>
public final class AzureOpenAITokenizerParameters extends Object implements com.azure.json.JsonSerializable<AzureOpenAITokenizerParameters>
The AzureOpenAITokenizerParameters model.

  • Constructor Details

    • AzureOpenAITokenizerParameters

      public AzureOpenAITokenizerParameters()
      Creates an instance of AzureOpenAITokenizerParameters class.

  • Method Details

    • getEncoderModelName

      public SplitSkillEncoderModelName getEncoderModelName()
      Get the encoderModelName property: Only applies if the unit is set to azureOpenAITokens. Options include 'R50k_base', 'P50k_base', 'P50k_edit' and 'CL100k_base'. The default value is 'CL100k_base'.
      Returns:
      the encoderModelName value.

    • setEncoderModelName

      public AzureOpenAITokenizerParameters setEncoderModelName(SplitSkillEncoderModelName encoderModelName)
      Set the encoderModelName property: Only applies if the unit is set to azureOpenAITokens. Options include 'R50k_base', 'P50k_base', 'P50k_edit' and 'CL100k_base'. The default value is 'CL100k_base'.
      Parameters:
      encoderModelName - the encoderModelName value to set.
      Returns:
      the AzureOpenAITokenizerParameters object itself.

    • getAllowedSpecialTokens

      public List<String> getAllowedSpecialTokens()
      Get the allowedSpecialTokens property: (Optional) Only applies if the unit is set to azureOpenAITokens. This parameter defines a collection of special tokens that are permitted within the tokenization process.
      Returns:
      the allowedSpecialTokens value.

    • setAllowedSpecialTokens

      public AzureOpenAITokenizerParameters setAllowedSpecialTokens(List<String> allowedSpecialTokens)
      Set the allowedSpecialTokens property: (Optional) Only applies if the unit is set to azureOpenAITokens. This parameter defines a collection of special tokens that are permitted within the tokenization process.
      Parameters:
      allowedSpecialTokens - the allowedSpecialTokens value to set.
      Returns:
      the AzureOpenAITokenizerParameters object itself.

    • toJson

      public com.azure.json.JsonWriter toJson(com.azure.json.JsonWriter jsonWriter) throws IOException
      Specified by:
      toJson in interface com.azure.json.JsonSerializable<AzureOpenAITokenizerParameters>
      Throws:
      IOException

    • fromJson

      public static AzureOpenAITokenizerParameters fromJson(com.azure.json.JsonReader jsonReader) throws IOException
      Reads an instance of AzureOpenAITokenizerParameters from the JsonReader.
      Parameters:
      jsonReader - The JsonReader being read.
      Returns:
      An instance of AzureOpenAITokenizerParameters if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.
      Throws:
      IOException - If an error occurs while reading the AzureOpenAITokenizerParameters.