public class TokenParser
extends java.lang.Object
| Constructor | Description |
|---|---|
TokenParser() |
| Modifier and Type | Method | Description |
|---|---|---|
static Token[] |
makeTokens(java.lang.String text,
boolean tokenize) |
Convert the given string into tokens.
|
static Token[] |
parse(java.lang.String text) |
Returns an array of tokens that contains tokenized string.
|
static Token[] |
parse(java.lang.String text,
boolean optimize) |
Returns an array of tokens that contains tokenized string.
|
static java.util.List<Token[]> |
parseAsList(java.lang.String text) |
|
static java.util.Map<java.lang.String,Token[]> |
parseAsMap(java.lang.String text) |
|
static java.lang.String |
toString(Token[] tokens) |
Convert to string from the token array.
|
public static Token[] parse(java.lang.String text)
text - the string to parsepublic static Token[] parse(java.lang.String text, boolean optimize)
text - the string to parseoptimize - whether to optimize tokenspublic static java.util.List<Token[]> parseAsList(java.lang.String text)
public static java.util.Map<java.lang.String,Token[]> parseAsMap(java.lang.String text)
public static Token[] makeTokens(java.lang.String text, boolean tokenize)
text - the texttokenize - whether to tokenizepublic static java.lang.String toString(Token[] tokens)
tokens - the tokensCopyright © 2008–2018 The Aspectran Project. All rights reserved.