edu.stanford.nlp.util

Class GoogleNGramsSQLBacked

java.lang.Object

edu.stanford.nlp.util.GoogleNGramsSQLBacked

public class GoogleNGramsSQLBacked
extends Object

To query Google Ngrams counts from SQL in a memory efficient manner. To get count of a phrase, use GoogleNGramsSQLBacked.getCount(phrase). Set this class options using Execution.fillOptions(GoogleNGramsSQLBacked.class, props); Created by Sonal Gupta

Constructor Summary

Constructors

Constructor and Description
GoogleNGramsSQLBacked()

Method Summary

Modifier and Type	Method and Description
static void	closeConnection()
static boolean	existsTable(String tablename)
static long	getCount(String str) Queries the SQL tables for the count of the phrase.
static List<Pair<String,Long>>	getCounts(Collection<String> strs)
static int	getTotalCount(int ngram) Note that this is really really slow for ngram > 1 TODO: make this fast (if we had been using mysql we could have)
static void	main(String[] args)
static void	populateTablesInSQL(String dir, Collection<Integer> typesOfPhrases)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GoogleNGramsSQLBacked

public GoogleNGramsSQLBacked()

Method Detail

existsTable

public static boolean existsTable(String tablename)
                           throws SQLException

Throws:

SQLException

getCount

public static long getCount(String str)

Queries the SQL tables for the count of the phrase. Returns -1 if the phrase doesn't exist

Parameters:

str - : phrase

Returns:

: count, if exists. -1 if not.

Throws:

SQLException

getCounts

public static List<Pair<String,Long>> getCounts(Collection<String> strs)
                                         throws SQLException

Throws:

SQLException

populateTablesInSQL

public static void populateTablesInSQL(String dir,
                                       Collection<Integer> typesOfPhrases)
                                throws SQLException

Throws:

SQLException

getTotalCount

public static int getTotalCount(int ngram)

Note that this is really really slow for ngram > 1 TODO: make this fast (if we had been using mysql we could have)

closeConnection

public static void closeConnection()
                            throws SQLException

Throws:

SQLException

main

public static void main(String[] args)