New AV Product Testing Methods Stir Debate

[A Guy]

Under one of the new guidelines recently released by the antivirus vendor-backed Anti-Malware Testing Standards Organization (AMTSO), AV vendors could actually end up scoring lower malware-detection rates.

The AMTSO's so-called "whole-product testing" guideline requires that labs no longer test each feature of an AV tool separately, but instead use all of its features against malware samples -- a method that could hurt the 90-percent-range scores many AV vendors had been accustomed to, in some cases, according to one AMTSO member. The goal is to eliminate testing individual features in AV products and instead test them more holistically.

Source

A Guy

 

[marsmimar]

Oh joy ... I can see it now. The "what is the best AV" debate will really be heating up now.
My AV scored 89% and yours scored 88% ... nanny-nanny-boo-boo :roflmao:

 

[Night Hawk]

There's one part of that article that really sums things up the way they should be seen.

"We find it strange that expertise in the testing field is somehow seen as a disqualification, given the specialist expertise that characterizes the group," they blogged. "The relatively high scores achieved in established tests by major vendors do not necessarily reflect real world performance, but real-world detection cannot be measured in terms of product comparison with no checks on selection, classification and validation of malicious samples and URLs."

Selective products only! is the key term most of the so called independent test results are really determined by and not actual "Real World" totally non participant involved independent evaluations? That's what is actually sadly lacking.

People can always go on arguing which is better then what but never see results for every software on the market as well as various other factors as that pointed out. Favored results anyone?

Good read! A Guy