edu.stanford.nlp.pipeline
Class TokensRegexAnnotator

java.lang.Object
  edu.stanford.nlp.pipeline.TokensRegexAnnotator

All Implemented Interfaces:

Annotator

public class TokensRegexAnnotator
extends java.lang.Object
implements Annotator

Uses TokensRegex patterns to annotate tokens.

Configuration:

• rules - Name of file containing extraction rules (see CoreMapExpressionExtractor and SequenceMatchRules

Other options (can be set in rules file using options.xxx = ...)

• setTokenOffsets - whether to explicit set the token offsets of individual tokens (needed to token sequence matches to work)
• extractWithTokens - whether to return unmatched tokens as well
• flatten - whether to flatten matched expressions into individual tokens
• matchedExpressionsAnnotationKey - Annotation key where matched expressions are stored as a list

Multiple TokensRegexAnnotator can be configured using the same properties file by specifying difference prefix for the TokensRegexAnnotator

Author:

Angel Chang

Nested Class Summary

static class

TokensRegexAnnotator.Options

Constructor Summary

TokensRegexAnnotator(java.util.Properties props)

TokensRegexAnnotator(java.lang.String... files)

TokensRegexAnnotator(java.lang.String name, java.util.Properties props)

Method Summary

void	addTokenOffsets(CoreMap annotation)
void	annotate(Annotation annotation)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokensRegexAnnotator

public TokensRegexAnnotator(java.lang.String... files)

TokensRegexAnnotator

public TokensRegexAnnotator(java.lang.String name,
                            java.util.Properties props)

TokensRegexAnnotator

public TokensRegexAnnotator(java.util.Properties props)

Method Detail

addTokenOffsets

public void addTokenOffsets(CoreMap annotation)

annotate

public void annotate(Annotation annotation)

Specified by:

annotate in interface Annotator