edu.stanford.nlp.pipeline
Class PTBTokenizerAnnotator

java.lang.Object
  edu.stanford.nlp.pipeline.TokenizerAnnotator
      edu.stanford.nlp.pipeline.PTBTokenizerAnnotator

All Implemented Interfaces:

Annotator

public class PTBTokenizerAnnotator
extends TokenizerAnnotator

This class will PTB tokenize the input string. It assumes that the original String is under the CoreAnnotations.TextAnnotation field and it will add the output from the InvertiblePTBTokenizer (List<CoreLabel>) under Annotation.TokensAnnotation.

Author:

Jenny Finkel

Nested Class Summary

Nested classes/interfaces inherited from interface edu.stanford.nlp.pipeline.Annotator

Annotator.Requirement

Field Summary

static java.lang.String

DEFAULT_OPTIONS

Fields inherited from interface edu.stanford.nlp.pipeline.Annotator

CLEAN_XML_REQUIREMENT, DETERMINISTIC_COREF_REQUIREMENT, GENDER_REQUIREMENT, GUTIME_REQUIREMENT, HEIDELTIME_REQUIREMENT, LEMMA_REQUIREMENT, NER_REQUIREMENT, NFL_REQUIREMENT, NFL_TOKENIZE_REQUIREMENT, NUMBER_REQUIREMENT, PARSE_AND_TAG, PARSE_REQUIREMENT, POS_REQUIREMENT, QUANTIFIABLE_ENTITY_NORMALIZATION_REQUIREMENT, SSPLIT_REQUIREMENT, STANFORD_CLEAN_XML, STANFORD_DETERMINISTIC_COREF, STANFORD_GENDER, STANFORD_LEMMA, STANFORD_NER, STANFORD_NFL, STANFORD_NFL_TOKENIZE, STANFORD_PARSE, STANFORD_POS, STANFORD_REGEXNER, STANFORD_SSPLIT, STANFORD_TOKENIZE, STANFORD_TRUECASE, STEM_REQUIREMENT, SUTIME_REQUIREMENT, TIME_WORDS_REQUIREMENT, TOKENIZE_AND_SSPLIT, TOKENIZE_REQUIREMENT, TOKENIZE_SSPLIT_NER, TOKENIZE_SSPLIT_PARSE, TOKENIZE_SSPLIT_PARSE_NER, TOKENIZE_SSPLIT_POS, TOKENIZE_SSPLIT_POS_LEMMA, TRUECASE_REQUIREMENT

Constructor Summary

PTBTokenizerAnnotator()

PTBTokenizerAnnotator(boolean verbose)

PTBTokenizerAnnotator(boolean verbose, java.lang.String options)

PTBTokenizerAnnotator(java.lang.String options)

Method Summary

Methods inherited from class edu.stanford.nlp.pipeline.TokenizerAnnotator

annotate, requirementsSatisfied, requires

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_OPTIONS

public static final java.lang.String DEFAULT_OPTIONS

See Also:

Constant Field Values

Constructor Detail

PTBTokenizerAnnotator

public PTBTokenizerAnnotator()

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(boolean verbose)

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(java.lang.String options)

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(boolean verbose,
                             java.lang.String options)