Download Paper - AV-Test

Transcript
EICAR 2000 Best Paper Proceedings
should only use parts of every collection (the more, the better, because of the mixture of
the samples) received, but should include only replicated samples where possible. The
reason is that anti-virus companies often only give samples of which they know that their
program will find. Sometimes viruses are added “ hard” to the database using a CRC sum
over the full length of the file and because of this only this file will be found by the scanner,
but not replicated samples. Examples for this are viruses like Zhengxi or SSR that are very
hard to detect.
As mentioned above more than one or two collections should be used, because the
“sponsors” of such collections will usually win the competitions with the best detection
score. Normally, such collections are sorted quite well (but always using different schemes
and different philosophies) and are usually free from non-malware, intended viruses, and
innocent programs. However, it will still contain some files (up to 1 or 2%), which do not
belong in such collections, even if all anti-virus programs are able to identify these files.
The reason these files make it into the collection is that the companies receive them often
enough (because they can be found in every badly sorted virus collection or most other
programs will find them), so they simply added detection for these files to satisfy such
people and keep them quiet. Another aspect is that the file contains a damaged virus
version, but most scanners will still find the virus or a part of it, because of an inexact
identification.
An often-used method for testers to get viruses is to download them from the Internet,
other network systems (like Fido) or from special virus exchange (VX) bulletin board
systems (BBSes) or FTP sites. Often, very complete-looking collections can be found
there with many unknown viruses and ones that are not detectable by most recent
scanners. However, the reason for this non-detection is that most collections contain a lot
of non-viral programs (trash). “ They contain huge numbers of viruses, non-viruses, Trojan
horses, joke programs, intended viruses (programs written with the obvious intent to write
a virus, but too buggy to replicate even once), corrupted files, text files, virus creation
tools, completely innocent files, and so on” (Bontchev 1993, Introduction). Therefore, if a
tester wants to get samples for a virus test set here, viruses should be separated very
carefully from the trash (usually more than 10%).
For this task, a file weeder utility can be extremely useful, which includes the information
about all known non-virus programs found in such collections. An example of such a tool is
DustBin written by Network Associates (formerly Dr. Solomon’s). Ideally all anti-virus
developers should be contributing to such a tool, so that cheating or mistakes caused by
inexact virus analyses are nearly impossible. Such weeders should include all TXT, ASM,
files with advertisements for BBS’es (BBS addy’s), not working viruses in DOC, XLS, EXE,
COM and SYS files, etc. This would solve a hard problem for testers who have to decide
which files to add or leave away. It goes without saying that such utilities have to be
updated on a regular basis (like anti-virus programs). To be as exact as possible and
avoiding false positives, it should not use old CRC32 checksums, but more professional
MD5 hashes and some more information on the files, like the type or length of segments in
the file.
There is still another possibility: The tester does not evaluate the detection rates of the
scanners at all using big collections, but using only good-sorted ITW ones. For the large
225