edu.stanford.nlp.pipeline

Class AnnotatorImplementations

java.lang.Object

edu.stanford.nlp.pipeline.AnnotatorImplementations

public class AnnotatorImplementations
extends Object

A class abstracting the implementation of various annotators. Importantly, subclasses of this class can overwrite the implementation of these annotators by returning a different annotator, and StanfordCoreNLP will automatically load the new annotator instead.

Author:

Gabor Angeli

Constructor Summary

Constructors

Constructor and Description
AnnotatorImplementations()

Method Summary

Modifier and Type	Method and Description
CleanXmlAnnotator	cleanXML(Properties properties, String xmlTagsToRemove, String sentenceEndingTags, String dateTags, boolean allowFlawedXml) Clean XML input
Annotator	coref(Properties properties) Annotate for coreference
Annotator	custom(Properties properties, String property)
Annotator	dependencies(Properties properties) Annotate dependency relations in sentences
Annotator	gender(Properties properties, boolean verbose) Annotate for gender of tokens
Annotator	mentions(Properties properties, String name) Annotate mentions
Annotator	morpha(Properties properties, boolean verbose) Annotate lemmas
Annotator	natlog(Properties properties) Annotate operators (e.g., quantifiers) and polarity of tokens in a sentence
Annotator	ner(Properties properties) Annotate for named entities -- note that this combines multiple NER tag sets, and some auxiliary things (like temporal tagging)
Annotator	parse(Properties properties) Annotate parse trees
Annotator	posTagger(Properties properties) Part of speech tag
Annotator	quote(Properties properties) Annotate quotes and extract them like sentences
Annotator	relations(Properties properties) Annotate for relations expressed in sentences
Annotator	sentiment(Properties properties, String name) Annotate for sentiment in sentences
Annotator	tokenizer(Properties properties, boolean verbose, String options) Tokenize, emulating the Penn Treebank
Annotator	tokensRegexNER(Properties properties, String name) Run RegexNER -- rule-based NER based on a deterministic mapping file
Annotator	trueCase(Properties properties, String modelLoc, String classBias, String mixedCaseFileName, boolean verbose) Infer the original casing of tokens
Annotator	wordToSentences(Properties properties, boolean verbose, String boundaryTokenRegex, Set<String> boundaryToDiscard, Set<String> htmlElementsToDiscard, String newlineIsSentenceBreak, String boundaryMultiTokenRegex, Set<String> tokenRegexesToDiscard) Sentence split, in addition to a bunch of other things in this annotator (be careful to check the implementation!)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AnnotatorImplementations

public AnnotatorImplementations()

Method Detail

tokenizer

public Annotator tokenizer(Properties properties,
                           boolean verbose,
                           String options)

Tokenize, emulating the Penn Treebank

cleanXML

public CleanXmlAnnotator cleanXML(Properties properties,
                                  String xmlTagsToRemove,
                                  String sentenceEndingTags,
                                  String dateTags,
                                  boolean allowFlawedXml)

Clean XML input

wordToSentences

public Annotator wordToSentences(Properties properties,
                                 boolean verbose,
                                 String boundaryTokenRegex,
                                 Set<String> boundaryToDiscard,
                                 Set<String> htmlElementsToDiscard,
                                 String newlineIsSentenceBreak,
                                 String boundaryMultiTokenRegex,
                                 Set<String> tokenRegexesToDiscard)

Sentence split, in addition to a bunch of other things in this annotator (be careful to check the implementation!)

posTagger

public Annotator posTagger(Properties properties)

Part of speech tag

morpha

public Annotator morpha(Properties properties,
                        boolean verbose)

Annotate lemmas

ner

public Annotator ner(Properties properties)
              throws FileNotFoundException

Annotate for named entities -- note that this combines multiple NER tag sets, and some auxiliary things (like temporal tagging)

Throws:

FileNotFoundException

tokensRegexNER

public Annotator tokensRegexNER(Properties properties,
                                String name)

Run RegexNER -- rule-based NER based on a deterministic mapping file

mentions

public Annotator mentions(Properties properties,
                          String name)

Annotate mentions

gender

public Annotator gender(Properties properties,
                        boolean verbose)

Annotate for gender of tokens

parse

public Annotator parse(Properties properties)

Annotate parse trees

Parameters:

properties -

Returns:

custom

public Annotator custom(Properties properties,
                        String property)

trueCase

public Annotator trueCase(Properties properties,
                          String modelLoc,
                          String classBias,
                          String mixedCaseFileName,
                          boolean verbose)

Infer the original casing of tokens

coref

public Annotator coref(Properties properties)

Annotate for coreference

relations

public Annotator relations(Properties properties)

Annotate for relations expressed in sentences

sentiment

public Annotator sentiment(Properties properties,
                           String name)

Annotate for sentiment in sentences

dependencies

public Annotator dependencies(Properties properties)

Annotate dependency relations in sentences

natlog

public Annotator natlog(Properties properties)

Annotate operators (e.g., quantifiers) and polarity of tokens in a sentence

quote

public Annotator quote(Properties properties)

Annotate quotes and extract them like sentences