public interface PostTokenizer
Modifier and Type | Method and Description |
---|---|
void |
close()
Close down the postTokenizer.
|
java.lang.String[] |
postTokenize(java.lang.String token)
Process a token after tokenization.
|
java.lang.String[] postTokenize(java.lang.String token)
token
- The token to process after tokenization.The minimally processed token is typically results in an original spelling.
The maximally processed token typically results in a partially or completely standardized spelling.
These may be identical.
void close()