com.azure.search.models

Class MicrosoftLanguageTokenizer

java.lang.Object

com.azure.search.models.Tokenizer

com.azure.search.models.MicrosoftLanguageTokenizer

public final class MicrosoftLanguageTokenizer
extends Tokenizer

Divides text using language-specific rules.

Constructor Summary

Constructors

Constructor and Description
MicrosoftLanguageTokenizer()

Method Summary

Modifier and Type	Method and Description
MicrosoftTokenizerLanguage	getLanguage() Get the language property: The language to use.
Integer	getMaxTokenLength() Get the maxTokenLength property: The maximum token length.
Boolean	isSearchTokenizer() Get the isSearchTokenizer property: A value indicating how the tokenizer is used.
MicrosoftLanguageTokenizer	setIsSearchTokenizer(Boolean isSearchTokenizer) Set the isSearchTokenizer property: A value indicating how the tokenizer is used.
MicrosoftLanguageTokenizer	setLanguage(MicrosoftTokenizerLanguage language) Set the language property: The language to use.
MicrosoftLanguageTokenizer	setMaxTokenLength(Integer maxTokenLength) Set the maxTokenLength property: The maximum token length.

Methods inherited from class com.azure.search.models.Tokenizer

getName, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MicrosoftLanguageTokenizer

public MicrosoftLanguageTokenizer()

Method Detail

getMaxTokenLength

public Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length. Tokens longer than the maximum length are split. Maximum token length that can be used is 300 characters. Tokens longer than 300 characters are first split into tokens of length 300 and then each of those tokens is split based on the max token length set. Default is 255.

Returns:

the maxTokenLength value.

setMaxTokenLength

public MicrosoftLanguageTokenizer setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length. Tokens longer than the maximum length are split. Maximum token length that can be used is 300 characters. Tokens longer than 300 characters are first split into tokens of length 300 and then each of those tokens is split based on the max token length set. Default is 255.

Parameters:

maxTokenLength - the maxTokenLength value to set.

Returns:

the MicrosoftLanguageTokenizer object itself.

isSearchTokenizer

public Boolean isSearchTokenizer()

Get the isSearchTokenizer property: A value indicating how the tokenizer is used. Set to true if used as the search tokenizer, set to false if used as the indexing tokenizer. Default is false.

Returns:

the isSearchTokenizer value.

setIsSearchTokenizer

public MicrosoftLanguageTokenizer setIsSearchTokenizer(Boolean isSearchTokenizer)

Set the isSearchTokenizer property: A value indicating how the tokenizer is used. Set to true if used as the search tokenizer, set to false if used as the indexing tokenizer. Default is false.

Parameters:

isSearchTokenizer - the isSearchTokenizer value to set.

Returns:

the MicrosoftLanguageTokenizer object itself.

getLanguage

public MicrosoftTokenizerLanguage getLanguage()

Get the language property: The language to use. The default is English. Possible values include: 'bangla', 'bulgarian', 'catalan', 'chineseSimplified', 'chineseTraditional', 'croatian', 'czech', 'danish', 'dutch', 'english', 'french', 'german', 'greek', 'gujarati', 'hindi', 'icelandic', 'indonesian', 'italian', 'japanese', 'kannada', 'korean', 'malay', 'malayalam', 'marathi', 'norwegianBokmaal', 'polish', 'portuguese', 'portugueseBrazilian', 'punjabi', 'romanian', 'russian', 'serbianCyrillic', 'serbianLatin', 'slovenian', 'spanish', 'swedish', 'tamil', 'telugu', 'thai', 'ukrainian', 'urdu', 'vietnamese'.

Returns:

the language value.

setLanguage

public MicrosoftLanguageTokenizer setLanguage(MicrosoftTokenizerLanguage language)

Set the language property: The language to use. The default is English. Possible values include: 'bangla', 'bulgarian', 'catalan', 'chineseSimplified', 'chineseTraditional', 'croatian', 'czech', 'danish', 'dutch', 'english', 'french', 'german', 'greek', 'gujarati', 'hindi', 'icelandic', 'indonesian', 'italian', 'japanese', 'kannada', 'korean', 'malay', 'malayalam', 'marathi', 'norwegianBokmaal', 'polish', 'portuguese', 'portugueseBrazilian', 'punjabi', 'romanian', 'russian', 'serbianCyrillic', 'serbianLatin', 'slovenian', 'spanish', 'swedish', 'tamil', 'telugu', 'thai', 'ukrainian', 'urdu', 'vietnamese'.

Parameters:

language - the language value to set.

Returns:

the MicrosoftLanguageTokenizer object itself.