Uses of Class
marf.nlp.util.NLPStreamTokenizer

Packages that use NLPStreamTokenizer

marf.nlp.Storage
marf.Stats.StatisticalEstimators

Uses of NLPStreamTokenizer in marf.nlp.Storage

Fields in marf.nlp.Storage declared as NLPStreamTokenizer

protected NLPStreamTokenizer

Corpus.oTokenizer Tokenizer to use to convert a raw string to WordStat tokens.

Methods in marf.nlp.Storage that return NLPStreamTokenizer

NLPStreamTokenizer

Corpus.getTokenizer()

Methods in marf.nlp.Storage with parameters of type NLPStreamTokenizer

void	Corpus.setTokenizer(NLPStreamTokenizer poTokenizer)

Uses of NLPStreamTokenizer in marf.Stats.StatisticalEstimators

Fields in marf.Stats.StatisticalEstimators declared as NLPStreamTokenizer

protected NLPStreamTokenizer

StatisticalEstimator.oStreamTokenizer Stream tokenizer for NLP processing to get word and non-word tokens from.

Methods in marf.Stats.StatisticalEstimators that return NLPStreamTokenizer

NLPStreamTokenizer	IStatisticalEstimator.getStreamTokenizer() Retrieves current stream tokenizer.
NLPStreamTokenizer	StatisticalEstimator.getStreamTokenizer()

Methods in marf.Stats.StatisticalEstimators with parameters of type NLPStreamTokenizer

void	IStatisticalEstimator.setStreamTokenizer(NLPStreamTokenizer poStreamTokenizer) Sets desired stream tokenizer.
void	StatisticalEstimator.setStreamTokenizer(NLPStreamTokenizer poStreamTokenizer)