Download FreeLing User Manual - TALP

Transcript
Chapter 1
Introduction
The FreeLing package consists of a library providing language analysis services (such as morphological analysis, date recognition, PoS tagging, etc.)
The current version provides language identification, tokenizing, sentence splitting, morphological analysis, NE detection and classification, recognition of dates/numbers/physical magnitudes/currency/ratios, phonetic encoding, PoS tagging, shallow parsing, dependency parsing,
WN-based sense annotation, Word Sense Disambiguation, and coreference resolution. Future
versions are expected to improve performance in existing functionalities, as well as incorporate
new features.
FreeLing is designed to be used as an external library from any application requiring this kind
of services. Nevertheless, a sample main program is also provided as a basic interface to the library,
which enables the user to analyze text files from the command line.
1.1
What is FreeLing
FreeLing is a developer-oriented library providing language analysis services. If you want to
develop, say, a machine translation system, and you need some kind of linguistic processing of the
source text, your MT application can call FreeLing modules to do the required analysis.
In the directory src/main/simple_examples in FreeLing tarball, some sample programs are
provided to illustrate how an application program can call the library.
In the directory src/main/sample_analyzer a couple of more complex programs are provided,
which can be used either as a command line interface to the library to process texts, or as examples
of how to build customized applications using FreeLing.
1.2
What is NOT FreeLing
FreeLing is not a user-oriented text analysis tool. That is, it is not designed to be user friendly,
or to output results with a cute image, or in a certain format.
FreeLing results are linguistic analysis in a data structure. Each end-user application (e.g.
anything from a simple syntactic-tree drawing plugin to a complete machine translation system)
can access those data and process them as needed.
Nevertheless, FreeLing package provides a quite complete application program (analyzer) that
enables an end user with no programming skills to obtain the analysis of a text. See chapter 6 for
details.
This program offers a set of options that cover most of FreeLing capabilities. Nevertheless,
much more advantadge can be taken of FreeLing, and more information can be accessed if you
call FreeLing from your own application program.
1