public final class LingPipeTokenizer extends Object implements TextTokenizer
A AbstractTokenizer implementation based on LingPipe's IndoEuropeanTokenizerFactory.
| Constructor and Description |
|---|
LingPipeTokenizer() |
public Iterator<Token> iterateTokens(String text)
iterateTokens in interface TextTokenizerCopyright © 2018. All rights reserved.