Type Alias MicrosoftTokenizerLanguage
MicrosoftTokenizerLanguage:
| "bangla"
| "bulgarian"
| "catalan"
| "chineseSimplified"
| "chineseTraditional"
| "croatian"
| "czech"
| "danish"
| "dutch"
| "english"
| "french"
| "german"
| "greek"
| "gujarati"
| "hindi"
| "icelandic"
| "indonesian"
| "italian"
| "japanese"
| "kannada"
| "korean"
| "malay"
| "malayalam"
| "marathi"
| "norwegianBokmaal"
| "polish"
| "portuguese"
| "portugueseBrazilian"
| "punjabi"
| "romanian"
| "russian"
| "serbianCyrillic"
| "serbianLatin"
| "slovenian"
| "spanish"
| "swedish"
| "tamil"
| "telugu"
| "thai"
| "ukrainian"
| "urdu"
| "vietnamese"
Defines values for MicrosoftTokenizerLanguage.