Download Tilde`s wrapper system for CollTerm
Transcript
Contract no. 248347 A property file contains one parameter per line (comments are allowed only at the beginning of each line starting with the symbol “#”; also empty lines are allowed). Each property starts with an identifier, which is followed by an equation symbol “=”. The value of the property is everything (trimming both end whitespaces) that is after the equation symbol. All supported properties are: 1. execPosTagger – specifies, whether POS-tagging has to be called for the input data. If “true”, results will be saved in the annotated plaintext format. If “false”, results will be saved in the tab-separated format. 2. POSTagger – specifies which tagger to use in POS-tagging. Supported are all “Tag.pm” supported values. 3. Language – specifies which language to use in POS-tagging. Supported are all “Tag.pm” supported values. 4. execN – if “true”, n-grams of length “N” will be extracted (supported are n-grams up to the length of four tokens). 5. idfFileN - the path to an IDF list file that has been compiled using a general domain corpus. The tool is bundled with three language IDF files precompiled (Latvian, Lithuanian and English). For a format description see section 4.1.6.8. 6. methodN – the CollTerm method to use for n-gram of length “N” extraction. The available values are: a. “dice” for the Dice coefficient b. “mi” for the modified mutual information c. “chisq” for the chi-square statistic d. “ll” for the log-likelihood ratio and e. “tscore” for the t-score statistic 7. lambdaN – the weight of n-gram term candidates of length “N” if the mixed prioritization term-tagging algorithm is used. 8. lenN – the length of the extracted n-grams (the length has to be equal to “N”). 9. minFreqN – the minimum frequency of an n-gram to be considered as a possible term. 10. thresholdN – the decimal threshold of extracted n-grams of length “N”. As CollTerm will extract all n-grams, only the ones ranked higher than the threshold will be used in tagging. 11. phraseN – the phrase table to use for n-gram of length “N” extraction. The paths to an existing local phrase table file. See section 4.1.5.6 for sample data. Note that the sample property files have to be adjusted to reflect the user’s local system’s paths! 12. stopN – the stop-word list to use for n-gram of length “N” extraction. The paths to an existing local stop-word list file. See section 4.1.5.6 for sample data. Note that the sample property files have to be adjusted to reflect the user’s local system’s paths! D2.6 V3.0 Page 127 of 164