Download Incremental crawling with Heritrix

12
Kristinn Sigurðsson
6. Andrei Z. Broder: On the Resemblance and Containment of Documents. IEEE
SEQUENCES '97, pages 21-29, 1998.
7. John Erik Halse et al.: Heritrix developer documentation. Accessed May 2005.
http://crawler.archive.org/articles/developer_manual.html
8. Kristinn Sigurðsson et al.: Heritrix user manual. Accessed May 2005.
http://crawler.archive.org/articles/user_manual.html
9. Berkeley DB Java Edition. Accessed May 2005.
http://www.sleepycat.com/products/je.shtml
10. J. Cho and H. Garcia-Molina: The evolution of the web and implications for an incremental
crawler. In Proc. of 26th Int. Conf. on Very Large Data Bases, pages 117-128, 2000.
11. Mark Pilgrim: What is RSS? Accessed May 2005.
http://www.xml.com/pub/a/2002/12/18/dive-into-xml.html
12. Internet Archive. Accessed May 2005. http://www.archive.org
13. Nedlib Factsheet. Accessed February 2005. http://www.kb.nl/nedlib/