edu.stanford.nlp.process

Class LexerUtils

java.lang.Object

edu.stanford.nlp.process.LexerUtils

public class LexerUtils
extends Object

This class contains various static utility methods invoked by JFlex lexers. Having this utility code placed outside the lexers facilitates normal IDE code editing.

Author:

Christopher Manning

Method Summary

Modifier and Type	Method and Description
static String	minimallyNormalizeCurrency(String in) Still at least turn cp1252 euro symbol to Unicode one.
static String	normalizeAmp(String in) Convert an XML-escaped ampersand back into an ampersand.
static String	normalizeCurrency(String in)
static String	processCp1252misc(String arg)
static String	removeSoftHyphens(String in)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

normalizeCurrency

public static String normalizeCurrency(String in)

minimallyNormalizeCurrency

public static String minimallyNormalizeCurrency(String in)

Still at least turn cp1252 euro symbol to Unicode one.

removeSoftHyphens

public static String removeSoftHyphens(String in)

processCp1252misc

public static String processCp1252misc(String arg)

normalizeAmp

public static String normalizeAmp(String in)

Convert an XML-escaped ampersand back into an ampersand.