Antimalware consumers establish product value based on a number of different product attributes. Though brand recognition may be the most important, detection capabilities, engine performance, usability, scalability, and other features follow as the secondary drivers of customer perceived value. 3rd party product reviews are the trusted source by which consumers measure these attributes.
Unfortunately, many of the most reputable antimalware product reviews today evaluate value based upon threat spread vectors from years past. Modern malware uses a range of spread vectors including browser attacks, phishing campaigns, and targeted attacks to name a few. Many testing methodologies evaluate products against collections of threats after they have already emerged. Additionally, products are tested for simple detection of a sample, rather than using the threat vector by which the sample spreads.
NSS Labs has released new antimalware comparatives focused on real world testing methodologies, demonstrating an understanding that comparatives must be aligned with the security threats of today to have any genuine positive effect on computer security stakeholders. Antimalware stakeholders often argue that security organizations are not adequately protecting them. Security organizations dedicate resources to performing well in the tests consumers trust because it leads to an increased customer perception of value, which ultimately leads to revenue. Such focus distracts security companies from focusing entirely on the real world threats.
The solution to this viscous cycle is to either abandon initiatives to perform well in comparatives and risk depressed revenue, or change testing methodologies. By aligning industry testing methodologies with current threats, vendor obligations to the computing community can be unified as one research objective with the previously independent focus on performing well in the comparative reviews consumers trust. As malware threats become increasingly complex, so do our security products. To drive innovation and adequate products, the sources consumers trust must be aligned with consumer needs. Commendations to NSS Labs as they pioneer this initiative.
More information on the host malware protection tests from NSS Labs can be found at the following sites:
