## Package edu.stanford.nlp.process

Interface Summary
LexedTokenFactory<T>: Constructs a token (of arbitrary type) from a String and its position in the underlying text.
ListProcessor<IN,OUT>: An interface for things that operate on a List.
Tokenizer<T>: Tokenizers break up text into individual Objects.

Class Summary
AbstractTokenizer<T>: An abstract tokenizer.
Americanize: Takes a HasWord or String and returns an Americanized version of it.
CoreLabelTokenFactory: Constructs `CoreLabel`s from Strings optionally with beginning and ending (character after the end) offset positions in an original text.
DocumentPreprocessor: Produces a list of sentences from either a plain text or XML document.
Morphology: Morphology computes the base form of English words, by removing just inflections (not derivational morphology).
PTBTokenizer<T extends HasWord>: Fast, rule-based tokenizer implementation, initially written to conform to the Penn Treebank tokenization conventions, but now providing a range of tokenization options over a broader space of Unicode text.
PTBTokenizer.PTBTokenizerFactory<T extends HasWord>: This class provides a factory which will vend instances of PTBTokenizer which wrap a provided Reader.
TokenizerAdapter: This class adapts between a `java.io.StreamTokenizer` and a `edu.stanford.nlp.process.Tokenizer`.
TransformXML<T>: Reads XML from an input file or stream and writes XML to an output file or stream, while transforming text appearing inside specified XML tags by applying a specified ``Function``.
TransformXML.SAXInterface<T>
WhitespaceTokenizer: A WhitespaceTokenizer is a tokenizer that splits on and discards only whitespace characters.
WhitespaceTokenizer.WhitespaceTokenizerFactory: A factory which vends WhitespaceTokenizers.
WordShapeClassifier: Provides static methods which map any String to another String indicative of its "word shape" -- e.g., whether capitalized, numeric, etc.
WordTokenFactory: Constructs a Word from a String.
WordToSentenceProcessor<IN>: Transforms a Document of Words into a Document of Sentences by grouping the Words.

Enum Summary
DocumentPreprocessor.DocType

Stanford NLP Group