Download Tilde`s wrapper system for CollTerm

Transcript
Contract no. 248347
2.4.2





Changes from previous version
EMACC is now able to align multiple target documents to one source document
and by doing so, it is possible that many source documents align to a target
document;
Fixed a bug where EMACC behaved randomly with the same set of parameters;
Heavy memory optimization (hard disk matrices) which resolve “Out of memory”
issues of EMACC when running on large document sets;
Added a “simple” run mode for EMACC such that, for very large document
collections, no EM is performed (it takes a very long time to complete);
Added portable Perl code for running in both Windows and Linux environments.
2.4.3
Software dependencies and system requirements
EMACC is entirely written in Perl and it works on a fairly recent version of Perl (5.8 or
5.10). The pre-computing of the initial document alignments distribution can be done in a
parallel fashion (on a Linux cluster). If one wants to run in this mode, additional requirements
must be met:



SSH secure remote shell must be installed on the master node of the cluster;
User “rion” must be allowed passwordless SSH access5 from the master node to
each of the cluster nodes (the user name is not configurable);
A NFS mount point6 must be read and write accessible to all the nodes of the
cluster.
The test-bed is a 4-node Linux cluster running Ubuntu Linux (versions beginning with 9.04
and newer). Nodes have one or two Intel Xeon processors, each with 4 cores. The RAM on
each node varies between 6 and 8 GB and the NFS drive has around 8TB of storage available
(although for smooth performance, depending on the size of the document collection, at least
10-20 GB of storage should be available).
2.4.4
Installation
If “emacc2.pl” is going to be run on a cluster and assuming that Perl is already installed on
all cluster nodes, one should go through each of the following steps to obtain a working setup
of EMACC:


Install a NFS server onto the master node of the cluster and NFS clients onto all
nodes of the cluster. Mount the same NFS point (e.g. onto “/mnt/nfs”) in read and
write modes on each node of the cluster;
Edit the configuration file “emaccconf.pm” and setup all desired values (more on
this in the next section);
5
To set up a SSH login without passwords authentication, see here: http://linuxproblem.org/art_9.html
6
To set up NFS on Ubuntu Linux, see here: https://help.ubuntu.com/community/SettingUpNFSHowTo
D2.6 V3.0
Page 55 of 164