edu.stanford.nlp.ling.tokensregex

Class CoreMapExpressionExtractor<T extends MatchedExpression>

java.lang.Object

edu.stanford.nlp.ling.tokensregex.CoreMapExpressionExtractor<T>

public class CoreMapExpressionExtractor<T extends MatchedExpression>
extends Object

Represents a list of assignment and extraction rules over sequence patterns. See SequenceMatchRules for syntax of rules.

Assignment rules are used to assign a value to a variable for later use in extraction rules or for expansions in patterns.

Extraction rules are used to extract text/tokens matching regular expressions. Extraction rules are grouped into stages, with each stage consisting of the following:

1. Matching of rules over text and tokens. These rules are applied directly on the text and tokens fields of the CoreMap.
2. Matching of composite rules. Matched expression are merged, and composite rules are applied recursively until no more changes to the matched expressions are detected.
3. Filtering of an invalid expression. In the final phase, a final filtering stage filters out invalid expressions.

The different stages are numbered and are applied in numeric order.

Author:

Angel Chang

See Also:

SequenceMatchRules

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CoreMapExpressionExtractor.Stage<T> Describes one stage of extraction.

Constructor Summary

Constructors

Constructor and Description
CoreMapExpressionExtractor() Creates an empty instance with no rules.
CoreMapExpressionExtractor(Env env) Creates a default instance with the specified environment.
CoreMapExpressionExtractor(Env env, List<SequenceMatchRules.Rule> rules) Creates an instance with the specified environment and list of rules

Method Summary

Modifier and Type	Method and Description
void	appendRules(List<SequenceMatchRules.Rule> rules) Add specified rules to this extractor
Pair<List<? extends CoreMap>,List<T>>	applyCompositeRule(SequenceMatchRules.ExtractRule<List<? extends CoreMap>,T> compositeExtractRule, List<? extends CoreMap> merged, List<T> matchedExpressions, int limit)
static CoreMapExpressionExtractor	createExtractorFromFile(Env env, String filename) Creates an extractor using the specified environment, and reading the rules from the given filename.
static CoreMapExpressionExtractor	createExtractorFromFiles(Env env, List<String> filenames) Creates an extractor using the specified environment, and reading the rules from the given filenames.
static CoreMapExpressionExtractor	createExtractorFromFiles(Env env, String... filenames) Creates an extractor using the specified environment, and reading the rules from the given filenames
static CoreMapExpressionExtractor	createExtractorFromString(Env env, String str) Creates an extractor using the specified environment, and reading the rules from the given string
List<CoreMap>	extractCoreMaps(CoreMap annotation) Returns list of coremaps that matches the specified rules
List<CoreMap>	extractCoreMapsMergedWithTokens(CoreMap annotation) Returns list of merged tokens and original tokens
List<CoreMap>	extractCoreMapsToList(List<CoreMap> res, CoreMap annotation)
List<T>	extractExpressions(CoreMap annotation)
List<CoreMap>	flatten(List<CoreMap> cms)
Env	getEnv()
Value	getValue(String varname)
void	setExtractRules(SequenceMatchRules.ExtractRule<CoreMap,T> basicExtractRule, SequenceMatchRules.ExtractRule<List<? extends CoreMap>,T> compositeExtractRule, java.util.function.Predicate<T> filterRule)
void	setLogger(Logger logger)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CoreMapExpressionExtractor

public CoreMapExpressionExtractor()

Creates an empty instance with no rules.

CoreMapExpressionExtractor

public CoreMapExpressionExtractor(Env env)

Creates a default instance with the specified environment. (use the default tokens annotation key as specified in the environment)

Parameters:

env - Environment to use for binding variables and applying rules

CoreMapExpressionExtractor

public CoreMapExpressionExtractor(Env env,
                                  List<SequenceMatchRules.Rule> rules)

Creates an instance with the specified environment and list of rules

Parameters:

env - Environment to use for binding variables and applying rules

rules - List of rules for this extractor

Method Detail

appendRules

public void appendRules(List<SequenceMatchRules.Rule> rules)

Add specified rules to this extractor

Parameters:

rules -

getEnv

public Env getEnv()

setLogger

public void setLogger(Logger logger)

setExtractRules

public void setExtractRules(SequenceMatchRules.ExtractRule<CoreMap,T> basicExtractRule,
                            SequenceMatchRules.ExtractRule<List<? extends CoreMap>,T> compositeExtractRule,
                            java.util.function.Predicate<T> filterRule)

createExtractorFromFiles

public static CoreMapExpressionExtractor createExtractorFromFiles(Env env,
                                                                  String... filenames)
                                                           throws RuntimeException

Creates an extractor using the specified environment, and reading the rules from the given filenames

Parameters:

env -

filenames -

Throws:

RuntimeException

createExtractorFromFiles

public static CoreMapExpressionExtractor createExtractorFromFiles(Env env,
                                                                  List<String> filenames)
                                                           throws RuntimeException

Creates an extractor using the specified environment, and reading the rules from the given filenames.

Parameters:

env -

filenames -

Throws:

RuntimeException

createExtractorFromFile

public static CoreMapExpressionExtractor createExtractorFromFile(Env env,
                                                                 String filename)
                                                          throws RuntimeException

Creates an extractor using the specified environment, and reading the rules from the given filename.

Parameters:

env -

filename -

Throws:

RuntimeException

createExtractorFromString

public static CoreMapExpressionExtractor createExtractorFromString(Env env,
                                                                   String str)
                                                            throws IOException,
                                                                   ParseException

Creates an extractor using the specified environment, and reading the rules from the given string

Parameters:

env -

str -

Throws:

IOException, - ParseException

IOException

ParseException

getValue

public Value getValue(String varname)

extractCoreMapsToList

public List<CoreMap> extractCoreMapsToList(List<CoreMap> res,
                                           CoreMap annotation)

extractCoreMaps

public List<CoreMap> extractCoreMaps(CoreMap annotation)

Returns list of coremaps that matches the specified rules

Parameters:

annotation -

extractCoreMapsMergedWithTokens

public List<CoreMap> extractCoreMapsMergedWithTokens(CoreMap annotation)

Returns list of merged tokens and original tokens

Parameters:

annotation -

flatten

public List<CoreMap> flatten(List<CoreMap> cms)

applyCompositeRule

public Pair<List<? extends CoreMap>,List<T>> applyCompositeRule(SequenceMatchRules.ExtractRule<List<? extends CoreMap>,T> compositeExtractRule,
                                                                List<? extends CoreMap> merged,
                                                                List<T> matchedExpressions,
                                                                int limit)

extractExpressions

public List<T> extractExpressions(CoreMap annotation)