Download as pdf

Basics
Deploy Configurations
Deploy Configurations
Contents
The Deploy module can make the scripts for deployment, installation, start and stop of the !NetarchiveSuite applications. In order to use this
module, it is necessary to make an special configuration file containing settings for the applications as well as special deploy settings. For more
information please refer to the Installation Manual.
Detailed Configurations
Heritrix Configurations
Heritrix Configurations
Contents
How to configure which Heritrix report has to be uploaded in the metadata ARC file
For configuration related to NetarchiveSuite, please refer to section on Detailed Configurations#Configure Heritrix process.
For more specific Heritrix configurations, please refer to Appendix B - Managing Heritrix Harvest Templates (order.xml) and Appendix C - Migrate
the Heritrix templates to NetarchiveSuite 3.6.0+ of this document.
The crawling in NetarchiveSuite uses by default Deduplication. This feature and how to disable it is described in Configuration Manual, Section
8.1.2.
How to configure which Heritrix report has to be uploaded in the metadata ARC file
Three settings properties control which heritrix reports are added to the metadata ARC file:
settingsharvesterharvestingmetadataheritrixFilePattern is a java pattern that allows you select which files in the crawl dir (not
recursively) to include in the metadata ARC.
settingsharvesterharvestingmetadatareportFilePattern is also a java pattern that controls which subset of the files selected by
heritrixFilePattern are to be considered as report files All the other files will be considered as setup files.
settingsharvesterharvestingmetadatalogFilePattern is a third java pattern that controls which files in the logs subdirectory of the
crawldir are to be added as log files to the metadata ARC.
Deploy Configurations
Wayback Configuration
Wayback Configuration
Contents
Requirements
Configuration
wayback.xml