Download Tilde`s wrapper system for CollTerm
Transcript
Contract no. 248347 2.4.2 Changes from previous version EMACC is now able to align multiple target documents to one source document and by doing so, it is possible that many source documents align to a target document; Fixed a bug where EMACC behaved randomly with the same set of parameters; Heavy memory optimization (hard disk matrices) which resolve “Out of memory” issues of EMACC when running on large document sets; Added a “simple” run mode for EMACC such that, for very large document collections, no EM is performed (it takes a very long time to complete); Added portable Perl code for running in both Windows and Linux environments. 2.4.3 Software dependencies and system requirements EMACC is entirely written in Perl and it works on a fairly recent version of Perl (5.8 or 5.10). The pre-computing of the initial document alignments distribution can be done in a parallel fashion (on a Linux cluster). If one wants to run in this mode, additional requirements must be met: SSH secure remote shell must be installed on the master node of the cluster; User “rion” must be allowed passwordless SSH access5 from the master node to each of the cluster nodes (the user name is not configurable); A NFS mount point6 must be read and write accessible to all the nodes of the cluster. The test-bed is a 4-node Linux cluster running Ubuntu Linux (versions beginning with 9.04 and newer). Nodes have one or two Intel Xeon processors, each with 4 cores. The RAM on each node varies between 6 and 8 GB and the NFS drive has around 8TB of storage available (although for smooth performance, depending on the size of the document collection, at least 10-20 GB of storage should be available). 2.4.4 Installation If “emacc2.pl” is going to be run on a cluster and assuming that Perl is already installed on all cluster nodes, one should go through each of the following steps to obtain a working setup of EMACC: Install a NFS server onto the master node of the cluster and NFS clients onto all nodes of the cluster. Mount the same NFS point (e.g. onto “/mnt/nfs”) in read and write modes on each node of the cluster; Edit the configuration file “emaccconf.pm” and setup all desired values (more on this in the next section); 5 To set up a SSH login without passwords authentication, see here: http://linuxproblem.org/art_9.html 6 To set up NFS on Ubuntu Linux, see here: https://help.ubuntu.com/community/SettingUpNFSHowTo D2.6 V3.0 Page 55 of 164