Download Paper - AV-Test

Transcript
EICAR 2000 Best Paper Proceedings
How to Get Products for Testing?
Obviously, testers have to use current versions of anti-virus programs from the anti-virus
companies. Therefore, the companies have to be informed about the deadlines of the test.
This includes the feedback deadlines such as responding on whether they want to take
part in the test or not (not answering means not), completing a survey with some facts
about the products (available OSes or where to buy it) and sending the products to the
reviewer including all updates which should be used.
It should be self-evident that if a company does not want to see their program tested, it will
not be tested. The reasons for declining to take part could include a desire to wait for
release of new versions or major updates soon, or a concern for performance. If they do
not want to take part in the test, because they know that their products are not very good,
the tester has offer two options. The first is, the tester will still test the program, but he has
to buy it in a shop and get the updates via internet or snail mail using the normal update
scheme. The second possibility is that the tester will make a notice about this fact in the
review only and the program will not be tested at all. It is worth noting that when a
company does not take part in any test and they may be forgotten, because users usually
buy only programs where they know what they will get for the money.
If there are too many companies who plan to release new major versions in near future, it
may be that the test should be postponed, because it will be outdated when published. If
an anti-virus company has only sent a beta version of the program, it should be tested
separately and without a final conclusion.
An invitation to the test has to be sent out to the companies usually one month before the
test starts to offer them enough time to decide whether they want to take part in the test or
not, and which versions of their programs should be submitted. Addresses of developers
can be found in (Link 1999).
The invitation which can be sent via (e-)mail or fax to the anti-virus company should
include at least the following topics:
-
The objective of the test, i.e., for which magazine (and issue, if known) or which
company is the test? This helps the anti-virus company to decide if the test is
interesting or not, and if it is the right target group.
-
Under which operating systems is the test is going to be performed (exact version)
-
The subject of the test, like finding the most zoo viruses only or the more important ITW
(“ in-the wild” , viruses which are known to be common) ones. Maybe tests about
disinfection or the virus guard special functions for small or medium companies like fast
update distribution and things like user-friendliness or the functionality should be
mentioned here.
-
It should be asked, which options/settings are recommended for the GUI (or commandline) version of the program in all tests - to scan for viruses and false positives, too. The
parameters have to be clearly documented and it should not be a paranoid long list.
222