public class TokenizerGateWrapper extends MorphAdornerGateWrapperBase
Modifier and Type | Class and Description |
---|---|
(package private) class |
TokenizerGateWrapper.TokenAnnotation
Hold a single token annotation.
|
Modifier and Type | Field and Description |
---|---|
protected SentenceSplitter |
sentenceSplitter
Sentence splitter.
|
protected WordTokenizer |
tokenizer
Word tokenizer.
|
alternateSpellingsURL, BASE_SENTENCE_ANNOTATION_TYPE_PARAMETER_NAME, BASE_TOKEN_ANNOTATION_TYPE_PARAMETER_NAME, baseSentenceAnnotationType, baseTokenAnnotationType, encoding, guesser, inputASName, lemmaSeparator, outputAnnotationType, outputASName, spellingsURL, spellingTokenizer, suffixLexicon, TAG_DOCUMENT_PARAMETER_NAME, TAG_INPUT_AS_PARAMETER_NAME, TAG_OUTPUT_AS_PARAMETER_NAME, tagSeparator, TOKEN_LEMMA_FEATURE_NAME, TOKEN_SPELLING_FEATURE_NAME, TOKEN_STANDARD_SPELLING_FEATURE_NAME, wordLexicon
ANNOTATION_COREF_FEATURE_NAME, DATE_ANNOTATION_TYPE, DATE_POSTED_ANNOTATION_TYPE, DOCUMENT_COREF_FEATURE_NAME, JOB_ID_ANNOTATION_TYPE, LOCATION_ANNOTATION_TYPE, LOOKUP_ANNOTATION_TYPE, LOOKUP_CLASS_FEATURE_NAME, LOOKUP_INSTANCE_FEATURE_NAME, LOOKUP_MAJOR_TYPE_FEATURE_NAME, LOOKUP_MINOR_TYPE_FEATURE_NAME, LOOKUP_ONTOLOGY_FEATURE_NAME, MONEY_ANNOTATION_TYPE, ORGANIZATION_ANNOTATION_TYPE, PERSON_ANNOTATION_TYPE, PERSON_GENDER_FEATURE_NAME, PR_NAMES, SENTENCE_ANNOTATION_TYPE, SPACE_TOKEN_ANNOTATION_TYPE, TOKEN_ANNOTATION_TYPE, TOKEN_CATEGORY_FEATURE_NAME, TOKEN_KIND_FEATURE_NAME, TOKEN_LENGTH_FEATURE_NAME, TOKEN_ORTH_FEATURE_NAME, TOKEN_STRING_FEATURE_NAME
Constructor and Description |
---|
TokenizerGateWrapper() |
Modifier and Type | Method and Description |
---|---|
void |
execute()
Perform adornment.
|
gate.Resource |
init()
Initialize resources.
|
addFeatures, checkGateResources, commonInit, getBaseSentenceAnnotationType, getBaseTokenAnnotationType, getEncoding, getInputASName, getLexicons, getOutputAnnotationType, getOutputASName, getPartOfSpeechGuesser, setBaseSentenceAnnotationType, setBaseTokenAnnotationType, setEncoding, setInputASName, setOutputAnnotationType, setOutputASName
getCorpus, getDocument, setCorpus, setDocument
addProgressListener, addStatusListener, cleanup, fireProcessFinished, fireProgressChanged, fireStatusChanged, interrupt, isInterrupted, reInit, removeProgressListener, removeStatusListener
checkParameterValues, getBeanInfo, getName, getParameterValue, getParameterValue, removeResourceListeners, setName, setParameterValue, setParameterValue, setParameterValues, setParameterValues, setResourceListeners
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
protected SentenceSplitter sentenceSplitter
protected WordTokenizer tokenizer
public gate.Resource init() throws gate.creole.ResourceInstantiationException
init
in interface gate.Resource
init
in class MorphAdornerGateWrapperBase
gate.creole.ResourceInstantiationException
public void execute() throws gate.creole.ExecutionException
MorphAdornerGateWrapperBase
execute
in interface gate.Executable
execute
in class MorphAdornerGateWrapperBase
gate.creole.ExecutionException