edu.stanford.nlp.international.arabic.process

Class IOBUtils

java.lang.Object

edu.stanford.nlp.international.arabic.process.IOBUtils

public class IOBUtils
extends Object

A class for converting strings to input suitable for processing by and IOB sequence model.

Author:

Spence Green

Method Summary

Methods

Modifier and Type	Method and Description
static String	getBoundaryCharacter()
static String	IOBToString(List<CoreLabel> labeledSequence, String prefixMarker, String suffixMarker) Convert a list of labeled characters to a String.
static List<CoreLabel>	StringToIOB(List<CoreLabel> tokenList, Character segMarker, boolean applyRewriteRules) Convert a String to a list of characters suitable for labeling in an IOB segmentation model.
static List<CoreLabel>	StringToIOB(String string) This version is for turning an unsegmented string to an IOB input, i.e., for processing raw text.
static List<CoreLabel>	StringToIOB(String str, Character segMarker)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getBoundaryCharacter

public static String getBoundaryCharacter()

StringToIOB

public static List<CoreLabel> StringToIOB(List<CoreLabel> tokenList,
                          Character segMarker,
                          boolean applyRewriteRules)

Convert a String to a list of characters suitable for labeling in an IOB segmentation model.

Parameters:

tokenList -

segMarker -

applyRewriteRules - add rewrite labels (for training data)

StringToIOB

public static List<CoreLabel> StringToIOB(String string)

This version is for turning an unsegmented string to an IOB input, i.e., for processing raw text.

Parameters:

string -

StringToIOB

public static List<CoreLabel> StringToIOB(String str,
                          Character segMarker)

IOBToString

public static String IOBToString(List<CoreLabel> labeledSequence,
                 String prefixMarker,
                 String suffixMarker)

Convert a list of labeled characters to a String. Include segmentation markers in the string.

Parameters:

labeledSequence -

prefixMarker -