Download NiuTrans Open Source Statistical Machine Translation System

64
Command
$ cd NiuTrans/bin/
$ ./NiuTrans.PhraseExtractor --SCORE \
-tab
../work/hierarchical.rule/hierarchical.phrase.pairs \
-tabinv
../work/hierarchical.rule/hierarchical.phrase.pairs.inv \
-ls2d
../work/lex/lex.s2d.sorted \
-ld2s
../work/lex/lex.d2s.sorted \
-out
../work/hierarchical.rule/hierarchical.rule.step1
where
--SCORE indicates that the program (NiuTrans.PhraseExtractor) runs in the ”scoring” mode. It scores
each hierarchical phrase-pairs, removes the replicated entries, and sort the table.
-tab specifies the file of extracted hierarchical phrases in ”source → target” direction.
-tabinv specifies the file of extracted hierarchical phrases in ”target → source” direction.
-ls2d specifies the lexical translation table in ”source → target” direction.
-ld2s specifies the lexical translation table in ”target → source” direction.
-out specifies the resulting hierarchical-rule table.
The optional parameters are:
-cutoffInit specifies the threshold for cutting off low-frequency initial phrase-pairs. e.g., ”-cutoffInit=1” means that the program would ignore the initial phrase-pairs that appear only once, while
”-cutoffInit=0” means that no initial phrases are discarded.
-cutoffHiero specifies the threshold for cutting off low-frequency hierarchical phrase-pairs.
-printFreq specifies whether the frequency information (the 5th field) is outputted.
-printAlign specifies whether the alignment information (the 6th field) is outputted.
-temp specifies the directory for sorting temporary files generated in the above procedure.
Output: in this step one file are generated under ”/NiuTrans/work/hierarchical.rule/”
Output (/NiuTrans/work/hierarchical.rule/)
- hierarcical.rule.step1
4.2.1.4
B hierarchical rule table
Hierarchical-Rule Table Filtering
In NiuTrans, the maximum number of translation options (according to Pr(τt (r)|τs (r))) can be set by users
(See following instructions).