Download Paper - AV-Test
Transcript
EICAR 2000 Best Paper Proceedings should only use parts of every collection (the more, the better, because of the mixture of the samples) received, but should include only replicated samples where possible. The reason is that anti-virus companies often only give samples of which they know that their program will find. Sometimes viruses are added “ hard” to the database using a CRC sum over the full length of the file and because of this only this file will be found by the scanner, but not replicated samples. Examples for this are viruses like Zhengxi or SSR that are very hard to detect. As mentioned above more than one or two collections should be used, because the “sponsors” of such collections will usually win the competitions with the best detection score. Normally, such collections are sorted quite well (but always using different schemes and different philosophies) and are usually free from non-malware, intended viruses, and innocent programs. However, it will still contain some files (up to 1 or 2%), which do not belong in such collections, even if all anti-virus programs are able to identify these files. The reason these files make it into the collection is that the companies receive them often enough (because they can be found in every badly sorted virus collection or most other programs will find them), so they simply added detection for these files to satisfy such people and keep them quiet. Another aspect is that the file contains a damaged virus version, but most scanners will still find the virus or a part of it, because of an inexact identification. An often-used method for testers to get viruses is to download them from the Internet, other network systems (like Fido) or from special virus exchange (VX) bulletin board systems (BBSes) or FTP sites. Often, very complete-looking collections can be found there with many unknown viruses and ones that are not detectable by most recent scanners. However, the reason for this non-detection is that most collections contain a lot of non-viral programs (trash). “ They contain huge numbers of viruses, non-viruses, Trojan horses, joke programs, intended viruses (programs written with the obvious intent to write a virus, but too buggy to replicate even once), corrupted files, text files, virus creation tools, completely innocent files, and so on” (Bontchev 1993, Introduction). Therefore, if a tester wants to get samples for a virus test set here, viruses should be separated very carefully from the trash (usually more than 10%). For this task, a file weeder utility can be extremely useful, which includes the information about all known non-virus programs found in such collections. An example of such a tool is DustBin written by Network Associates (formerly Dr. Solomon’s). Ideally all anti-virus developers should be contributing to such a tool, so that cheating or mistakes caused by inexact virus analyses are nearly impossible. Such weeders should include all TXT, ASM, files with advertisements for BBS’es (BBS addy’s), not working viruses in DOC, XLS, EXE, COM and SYS files, etc. This would solve a hard problem for testers who have to decide which files to add or leave away. It goes without saying that such utilities have to be updated on a regular basis (like anti-virus programs). To be as exact as possible and avoiding false positives, it should not use old CRC32 checksums, but more professional MD5 hashes and some more information on the files, like the type or length of segments in the file. There is still another possibility: The tester does not evaluate the detection rates of the scanners at all using big collections, but using only good-sorted ITW ones. For the large 225