Download Tilde`s wrapper system for CollTerm

Transcript
Contract no. 248347
A property file contains one parameter per line (comments are allowed only at the beginning
of each line starting with the symbol “#”; also empty lines are allowed). Each property starts
with an identifier, which is followed by an equation symbol “=”. The value of the property is
everything (trimming both end whitespaces) that is after the equation symbol.
All supported properties are:
1.
execPosTagger – specifies, whether POS-tagging has to be called for the input
data. If “true”, results will be saved in the annotated plaintext format. If “false”,
results will be saved in the tab-separated format.
2.
POSTagger – specifies which tagger to use in POS-tagging. Supported are all
“Tag.pm” supported values.
3.
Language – specifies which language to use in POS-tagging. Supported are all
“Tag.pm” supported values.
4.
execN – if “true”, n-grams of length “N” will be extracted (supported are n-grams
up to the length of four tokens).
5.
idfFileN - the path to an IDF list file that has been compiled using a general
domain corpus. The tool is bundled with three language IDF files precompiled
(Latvian, Lithuanian and English). For a format description see section 4.1.6.8.
6.
methodN – the CollTerm method to use for n-gram of length “N” extraction. The
available values are:
a. “dice” for the Dice coefficient
b. “mi” for the modified mutual information
c. “chisq” for the chi-square statistic
d. “ll” for the log-likelihood ratio and
e. “tscore” for the t-score statistic
7.
lambdaN – the weight of n-gram term candidates of length “N” if the mixed
prioritization term-tagging algorithm is used.
8.
lenN – the length of the extracted n-grams (the length has to be equal to “N”).
9.
minFreqN – the minimum frequency of an n-gram to be considered as a possible
term.
10.
thresholdN – the decimal threshold of extracted n-grams of length “N”. As
CollTerm will extract all n-grams, only the ones ranked higher than the threshold
will be used in tagging.
11.
phraseN – the phrase table to use for n-gram of length “N” extraction. The paths
to an existing local phrase table file. See section 4.1.5.6 for sample data. Note that
the sample property files have to be adjusted to reflect the user’s local system’s
paths!
12.
stopN – the stop-word list to use for n-gram of length “N” extraction. The paths to
an existing local stop-word list file. See section 4.1.5.6 for sample data. Note that
the sample property files have to be adjusted to reflect the user’s local system’s
paths!
D2.6 V3.0
Page 127 of 164