A new anti-virus test paid for by nortan gave themselfs a perfect score!!

[Guest]

[jay2007tech]

I saw this at http://www.wilderssecurity.com/showthread.php?t=256947

We at Symantec engaged Dennis Labs to do a new type of test of security effectiveness. The results can be found here:

http://community.norton.com/norton/a...t-consumer.pdf

I know . . . I know . . . testing paid for by a vendor is suspect.

http://community.norton.com/norton/attachments/norton/ModBoard/58/1/PC-Virus-Protection-2010-DTL-Report-consumer.pdf

Symantec paid Dennis Labs to run a test and *******Hears the drums rolling******   Nortan with a perfect score.   OMG  An even bigger shock, It gave Avira Free the second worst score.  
Everybody knows Avira and A-Square is #1


Somebody pointed this out below,  Oh-no nortan caught with there pants down again.   ( Wouldn't be the first time either)  Time to give them the stick  I feel nortan is getting very aggressive and deceptive with their marketing.  I guess honest marketing would put them out of bussiness

Even weirder, there are some test cases for NIS (Norton) where it didn't alert nor block the threat, yet it is counted as "complete remediation" and "defended".

1 NIS None None None None None None
5 NIS None None None None None None
8 NIS None None None None None None
9 NIS None See note None None None None
13 NIS None None None None None None
21 NIS None See note None None None None
22 NIS None See note None None None None
23 NIS None See note None None None None
24 NIS None See note None Report Removed 2 tracking cookies    <----Tracking cookies are not threats
29 NIS None See note None Report Removed 2 tracking cookies    <----Tracking cookies are not infections
33 NIS None None None n/a n/a n/a
39 NIS None None None n/a n/a n/a


Unless I'm reading this wrong, according to the actual results shown on the table on pages 19-33 Norton was awarded "complete protection" on 12 test cases where there was no detection whatsoever and which should probably read "compromised".

[Melih]

That's why the world needs AMTSO compliant tests!

Melih

[Jaki]

That's why the world needs AMTSO compliant tests!

Melih

Anyone can claim that they are AMTSO compliant, well I think what you meant to say is the world needs AMTSO review board compliant tests.  


Peace.

[Kyle]

That's why the world needs AMTSO compliant tests!

Melih

Actions speak louder than words 

[xiulingmao]

about amtos tests: http://bit.ly/1OUNaw

[shadha]

Hello everyone,
I bought a new Acer laptop just recently and the first thing that came off was Norton. I my books it is not very good software and there is a lot of hype attached to it. When you pay some one for a service4 naturally you would want a very good result or can I even say "the best result". I hope that Dennis Labs isnt open to corruption but I cant see how norton got such a good result when it doesnt with other testers. Perhaps money speaks as loud as words, the more money the better the result the bigger the hype.
shadha

[Endymion]

Though anyone can claim compliance it looks that ATM no one is willing to have their test reviewed by AMTSO review board.

Hopefully the whole AMTSO will formally act and finally define what "AMTSO compliance" is and whenever claims would be enough to forsake review by AMTSO board.

[Jaki]

about amtos tests: http://bit.ly/1OUNaw

Thanks for the link. My first question to you is: "What kind of domain is your link it is seems to be a redirection"
My second question to you is per that quote:

" AMTSO does not consist only of vendors, testers (including AV-Comparatives), reviewers and publishers are also active and founding members of AMTSO.AMTSO has also a Review Analysis Board (RAB). Should a test claim to be AMTSO compliant or have a big media impact and someone feels that the test is not accurate (i.e. not following the fundamental principles of testing), they can submit it for review to the RAB. The Board will then check the test against the 9 principles and state whether the test is "compliant" or not. As the Board consists of AV vendor researchers, testers etc. who also have other things to do, it is not reasonable to expect that it will review ALL tests out there, and even less that it will review tests before they get released. This means that you will never see a test that can accurately be described as "AMTSO compliant" in advance."

Now if I understand well if abcd organization performs a test and claims to be AMTSO compliant therefore, the AMTSO review board can only double check such a claim if someone else or another organization like wxyz organization happen to have a problem with it and report it accordingly. Please correct if I'm wrong. This is very interesting.

Peace.

[xiulingmao]

Jaki: I not know, sorry only found link yesterday

[JamesFrance]

bit.ly seems to be a url shortening service often used by spammers to disguise email links.
http://www.mywot.com/en/scorecard/bit.ly

Off topic, sorry.

[Endymion]

I guess it is still up to debate if anybody is going to see tests featuring the likes of "AMTSO compliance review pending" or "AMTSO compliance reviewed"  instead of phrasing that implies compliance, such as "following AMTSO principles".

[Jaki]

Jaki: I not know, sorry only found link yesterday

So in summary as long as a testing organization follows the AMTSO principles that test should be considered AMTSO compliant. Consequently, a test should not be required to be reviewed by the AMTSO review board in order to be considered AMTSO complaint. Am I right or wrong and if I'm right this is becoming more and more interesting, very interesting. 

P.S.: by the way the proper link is:

http://www.av-comparatives.org/forum/index.php?page=Thread&postID=3415#post3415

Peace.

[Jaki]

bit.ly seems to be a url shortening service often used by spammers to disguise email links.
http://www.mywot.com/en/scorecard/bit.ly

Off topic, sorry.

Thanks for the info.

Peace.

[Endymion]

One of the issues that caused particularly lively debate centred around the question of what constitutes AMTSO compliance, whatever you might understand by that term. When a tester claims to be AMTSO compliant – and many have started to do that – or uses phrasing that implies compliance, such as "following AMTSO principles", what does that mean?

Well, up to now, such phrasing has meant less than you might think it does, because AMTSO hasn’t formally defined what "AMTSO compliance" actually is.

Until the whole AMTSO will provide a formal definition it looks there is still place for individual interpretations, though until then there is nothing which prevent any tester member of AMTSO to submit their current or upcoming tests/methodologies for review by AMTSO Review Analysis board.

Of course if nobody doubt that phrasing the likes of "following AMTSO principles" and "Pending AMTSO compliance review" holds different meanings...

[Jaki]

As a member of the AMTSO av-comparatives point of view is very enlightening. And with respect to compliance no further clarification is needed, to me. Compliance means acting according to certain accepted standards. In that respect, if a testing organization performs a test and acts according to AMTSO accepted standards such a test must be accepted as AMTSO compliant. Man, I cannot believe it, this is really interesting.


Peace.

[Tags:]