com.azure.search.models

Class StandardTokenizer

java.lang.Object

com.azure.search.models.Tokenizer

com.azure.search.models.StandardTokenizer

public final class StandardTokenizer
extends Tokenizer

Breaks text following the Unicode Text Segmentation rules. This tokenizer is implemented using Apache Lucene.

Constructor Summary

Constructors

Constructor and Description
StandardTokenizer()

Method Summary

Modifier and Type	Method and Description
Integer	getMaxTokenLength() Get the maxTokenLength property: The maximum token length.
StandardTokenizer	setMaxTokenLength(Integer maxTokenLength) Set the maxTokenLength property: The maximum token length.

Methods inherited from class com.azure.search.models.Tokenizer

getName, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StandardTokenizer

public StandardTokenizer()

Method Detail

getMaxTokenLength

public Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split.

Returns:

the maxTokenLength value.

setMaxTokenLength

public StandardTokenizer setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split.

Parameters:

maxTokenLength - the maxTokenLength value to set.

Returns:

the StandardTokenizer object itself.