edu.stanford.nlp.patterns.surface

Class InvertedIndexByTokens

java.lang.Object

edu.stanford.nlp.patterns.surface.InvertedIndexByTokens

All Implemented Interfaces:

Serializable

public class InvertedIndexByTokens
extends Object
implements Serializable

Creates an inverted index of (word or lemma) => {file1 => {sentid1, sentid2,.. }, file2 => {sentid1, sentid2, ...}}. (Commented out FileBackedCache because it currrently doesnt support changing the values)

Author:

Sonal Gupta (sonalg@stanford.edu)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
InvertedIndexByTokens(File invertedIndexDir, boolean lc, Set<String> stopWords, Set<String> specialWords, boolean batchProcessSents, String dirName)
InvertedIndexByTokens(Map<String,Hashtable<String,Set<String>>> index, boolean lc, Set<String> stopWords, Set<String> specialWords, boolean batchProcessSents, String dirName)

Method Summary

Methods

Modifier and Type	Method and Description
Map<String,Set<String>>	getFileSentIds(Set<String> words)
Map<String,Set<String>>	getFileSentIds(String word)
Map<String,Set<String>>	getFileSentIdsFromPats(Set<SurfacePattern> pats)
Set<String>	getKeySet()
Set<String>	getSpecialWordsList()
boolean	isBatchProcessed()
static InvertedIndexByTokens	loadIndex(String dir)
int	numAllEntries()
void	saveIndex(String dir)
int	size()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InvertedIndexByTokens

public InvertedIndexByTokens(File invertedIndexDir,
                     boolean lc,
                     Set<String> stopWords,
                     Set<String> specialWords,
                     boolean batchProcessSents,
                     String dirName)

InvertedIndexByTokens

public InvertedIndexByTokens(Map<String,Hashtable<String,Set<String>>> index,
                     boolean lc,
                     Set<String> stopWords,
                     Set<String> specialWords,
                     boolean batchProcessSents,
                     String dirName)

Method Detail

getFileSentIds

public Map<String,Set<String>> getFileSentIds(String word)

getFileSentIds

public Map<String,Set<String>> getFileSentIds(Set<String> words)

getFileSentIdsFromPats

public Map<String,Set<String>> getFileSentIdsFromPats(Set<SurfacePattern> pats)

getSpecialWordsList

public Set<String> getSpecialWordsList()

saveIndex

public void saveIndex(String dir)
               throws IOException

Throws:

IOException

loadIndex

public static InvertedIndexByTokens loadIndex(String dir)

size

public int size()

isBatchProcessed

public boolean isBatchProcessed()

numAllEntries

public int numAllEntries()

getKeySet

public Set<String> getKeySet()