public class TokenizerUtils
extends java.lang.Object
Modifier and Type | Field and Description |
---|---|
protected static Abbreviations |
abbreviations |
Modifier | Constructor and Description |
---|---|
protected |
TokenizerUtils()
Don't allow instantiation, do allow overrides.
|
Modifier and Type | Method and Description |
---|---|
static java.lang.String |
getTokenType(java.lang.String token)
Get token type.
|
protected static Abbreviations abbreviations