com.azure.search.models

Class StandardTokenizerV2

java.lang.Object

com.azure.search.models.Tokenizer

com.azure.search.models.StandardTokenizerV2

public final class StandardTokenizerV2
extends Tokenizer

Breaks text following the Unicode Text Segmentation rules. This tokenizer is implemented using Apache Lucene.

Constructor Summary

Constructors

Constructor and Description
StandardTokenizerV2()

Method Summary

Modifier and Type	Method and Description
Integer	getMaxTokenLength() Get the maxTokenLength property: The maximum token length.
StandardTokenizerV2	setMaxTokenLength(Integer maxTokenLength) Set the maxTokenLength property: The maximum token length.

Methods inherited from class com.azure.search.models.Tokenizer

getName, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StandardTokenizerV2

public StandardTokenizerV2()

Method Detail

getMaxTokenLength

public Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split. The maximum token length that can be used is 300 characters.

Returns:

the maxTokenLength value.

setMaxTokenLength

public StandardTokenizerV2 setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split. The maximum token length that can be used is 300 characters.

Parameters:

maxTokenLength - the maxTokenLength value to set.

Returns:

the StandardTokenizerV2 object itself.