Download fulltext - DiVA Portal

Transcript
4.4
User interface
4
Honeyscout
4.4.1 Heritrix
The stand alone web crawl application Heritrix is congured and controlled
solely from the web interface. Honeyscout makes use of JMX (see section 4.2.2),
thus there is no need to use web UI except if one would like to create a new
prole. Heritrix web interface does however provide a status page where the
progress of current jobs as well as nished and pending ones can be viewed.
This page can be interesting to view when using Honeyscout as it provides
statistics and estimations as seen in gure 11. The web interface is accessed
through a web browser on port 8080 and only accessible by localhost by default,
but this can be changed in the conguration.
Figure 11: Heritrix's status page.
4.4.2 Honeyscout engine feedback
There is no graphical user interface available for Honeyscout but informative
messages are written to the console. The type of messages given includes URLs
requested, crawl jobs sent to Heritrix and started ClamAV scans. Figure 12
shows a screenshot of how a running instance of Honeyscout may look like.
Figure 12: Screenshot of Honeyscout's status messages.
Finished jobs are saved with a name represented by the md5-sum of the seed
URL and timestamp, as can be seen in the scanning ... messages. This is
to make sure the names are unique. The long lines cut o in gure 12 are
output from the JMX client when starting a new job which proved hard to lter
out. Originally the Tiny HTTP Proxy script displayed a lot of more information
33