org.dkpro.tc.features.pair.core.ngram.meta

Class LucenePFEBase

java.lang.Object

org.apache.uima.resource.Resource_ImplBase

org.apache.uima.fit.component.Resource_ImplBase

org.dkpro.tc.api.features.FeatureExtractorResource_ImplBase

org.dkpro.tc.features.ngram.base.NGramFeatureExtractorBase

org.dkpro.tc.features.ngram.base.LuceneFeatureExtractorBase

org.dkpro.tc.features.pair.core.ngram.meta.LucenePFEBase

All Implemented Interfaces:

org.apache.uima.fit.component.ExternalResourceAware, org.apache.uima.resource.Resource, MetaDependent

Direct Known Subclasses:

LuceneKeywordPFE

public abstract class LucenePFEBase
extends LuceneFeatureExtractorBase

Field Summary

Fields

Modifier and Type	Field and Description
protected String	fieldOfTheMoment
protected int	kngramUseTopK
protected boolean	ngramBinaryFeatureValuesCombos
protected int	ngramUseTopK1
protected int	ngramUseTopK2
static String	PARAM_NGRAM_BINARY_FEATURE_VALUES_COMBO Whether features should be marked with binary (occurs, doesn't occur in this document pair) values, versus the document count of the feature.
static String	PARAM_NGRAM_USE_TOP_K_VIEW1 Use this number of most frequent ngrams from View 1's.
static String	PARAM_NGRAM_USE_TOP_K_VIEW2 Use this number of most frequent ngrams from View 2's.
protected de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String>	topKSetView1
protected de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String>	topKSetView2
protected int	topNOfTheMoment

Fields inherited from class org.dkpro.tc.features.ngram.base.LuceneFeatureExtractorBase

forceRereadFromIndex, LUCENE_NGRAM_FIELD, luceneDir, PARAM_SOURCE_LOCATION

Fields inherited from class org.dkpro.tc.features.ngram.base.NGramFeatureExtractorBase

dfStore, filterPartialStopwordMatches, ngramFreqThreshold, ngramLowerCase, ngramMaxN, ngramMinN, ngramStopwordsFile, ngramUseTopK, PARAM_FILTER_PARTIAL_STOPWORD_MATCHES, PARAM_NGRAM_FREQ_THRESHOLD, PARAM_NGRAM_LOWER_CASE, PARAM_NGRAM_MAX_N, PARAM_NGRAM_MIN_N, PARAM_NGRAM_STOPWORDS_FILE, PARAM_NGRAM_USE_TOP_K, PARAM_TF_IDF_CALCULATION, prefix, stopwords, tfIdfCalculation, topKSet

Fields inherited from class org.dkpro.tc.api.features.FeatureExtractorResource_ImplBase

featureExtractorName, PARAM_UNIQUE_EXTRACTOR_NAME

Fields inherited from interface org.apache.uima.resource.Resource

PARAM_AGGREGATE_SOFA_MAPPINGS, PARAM_CONFIG_MANAGER, PARAM_CONFIG_PARAM_SETTINGS, PARAM_EXTERNAL_OVERRIDE_SETTINGS, PARAM_PERFORMANCE_TUNING_SETTINGS, PARAM_RESOURCE_MANAGER, PARAM_UIMA_CONTEXT

Constructor Summary

Constructors

Constructor and Description
LucenePFEBase()

Method Summary

Modifier and Type	Method and Description
protected Set<Feature>	addToFeatureArray(de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> viewNgrams, de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> topKSet, Set<Feature> features)
boolean	initialize(org.apache.uima.resource.ResourceSpecifier aSpecifier, Map<String,Object> aAdditionalParams)

Methods inherited from class org.dkpro.tc.features.ngram.base.LuceneFeatureExtractorBase

getFieldName, getTopN, getTopNgrams, logSelectionProcess, passesScreening

Methods inherited from class org.dkpro.tc.features.ngram.base.NGramFeatureExtractorBase

getFeaturePrefix

Methods inherited from class org.apache.uima.fit.component.Resource_ImplBase

afterResourcesInitialized, getLogger, getResourceName

Methods inherited from class org.apache.uima.resource.Resource_ImplBase

destroy, getCasManager, getMetaData, getRelativePathResolver, getResourceManager, getUimaContext, getUimaContextAdmin, setLogger, setMetaData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dkpro.tc.api.features.meta.MetaDependent

getMetaCollectorClasses

Field Detail

kngramUseTopK

protected int kngramUseTopK

PARAM_NGRAM_USE_TOP_K_VIEW1

public static final String PARAM_NGRAM_USE_TOP_K_VIEW1

Use this number of most frequent ngrams from View 1's.

See Also:

Constant Field Values

ngramUseTopK1

protected int ngramUseTopK1

PARAM_NGRAM_USE_TOP_K_VIEW2

public static final String PARAM_NGRAM_USE_TOP_K_VIEW2

Use this number of most frequent ngrams from View 2's.

See Also:

Constant Field Values

ngramUseTopK2

protected int ngramUseTopK2

PARAM_NGRAM_BINARY_FEATURE_VALUES_COMBO

public static final String PARAM_NGRAM_BINARY_FEATURE_VALUES_COMBO

Whether features should be marked with binary (occurs, doesn't occur in this document pair) values, versus the document count of the feature. In combo ngrams this is (doc1freq * doc2freq). Note this only applies to feature values; frequency selection of features is based on frequency across documents, not within documents.

See Also:

Constant Field Values

ngramBinaryFeatureValuesCombos

protected boolean ngramBinaryFeatureValuesCombos

topKSetView1

protected de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> topKSetView1

topKSetView2

protected de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> topKSetView2

fieldOfTheMoment

protected String fieldOfTheMoment

topNOfTheMoment

protected int topNOfTheMoment

Constructor Detail

LucenePFEBase

public LucenePFEBase()

Method Detail

initialize

public boolean initialize(org.apache.uima.resource.ResourceSpecifier aSpecifier,
                          Map<String,Object> aAdditionalParams)
                   throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.resource.Resource

Overrides:

initialize in class NGramFeatureExtractorBase

Throws:

org.apache.uima.resource.ResourceInitializationException

addToFeatureArray

protected Set<Feature> addToFeatureArray(de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> viewNgrams,
                                         de.tudarmstadt.ukp.dkpro.core.api.frequency.util.FrequencyDistribution<String> topKSet,
                                         Set<Feature> features)