edu.stanford.nlp.pipeline
Class PTBTokenizerAnnotator

java.lang.Object
  edu.stanford.nlp.pipeline.TokenizerAnnotator
      edu.stanford.nlp.pipeline.PTBTokenizerAnnotator

All Implemented Interfaces:

Annotator

public class PTBTokenizerAnnotator
extends TokenizerAnnotator

This class will PTB tokenize the input string. It assumes that the original String is under the CoreAnnotations.TextAnnotation field and it will add the output from the InvertiblePTBTokenizer (List<CoreLabel>) under Annotation.TokensAnnotation.

Author:

Jenny Finkel

Field Summary

static java.lang.String

DEFAULT_OPTIONS

Constructor Summary

PTBTokenizerAnnotator()

PTBTokenizerAnnotator(boolean verbose)

PTBTokenizerAnnotator(boolean verbose, java.lang.String options)

PTBTokenizerAnnotator(java.lang.String options)

Method Summary

Methods inherited from class edu.stanford.nlp.pipeline.TokenizerAnnotator

annotate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_OPTIONS

public static final java.lang.String DEFAULT_OPTIONS

See Also:

Constant Field Values

Constructor Detail

PTBTokenizerAnnotator

public PTBTokenizerAnnotator()

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(boolean verbose)

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(java.lang.String options)

PTBTokenizerAnnotator

public PTBTokenizerAnnotator(boolean verbose,
                             java.lang.String options)