SSUpdater's Anti-Malware test [CLOSED]

[Guest]

[state.of.security]

For starters go get a clue, stop calling competitors "crapware" and stop comparing applications that are totally incomparable and have a completely different purpose and scope.

But why should I advise someone who pretends to be a "tester"; you should know better yourself. 

How come is Sunbelt Software my competitor?Also I am not comparing anything to anything, I my friend provide a service ,whether you like or not,to people who are obviously not like you, they choose and I test, it is as simple as that.
And I don't pretend to be anything, I'm doing this for a long time and I'm used to comments like yours, you may not like the results for whatever reason and that is your opinion, you accuse me of insulting somebody and it looks like you are trying to insult me.....prove to me that you know more then I do, do things better then I do and only then we can have a nice civilized conversation.
You will not as much as rise my eyebrow with this comments so don't waist your time

[doktornotor]

How come is Sunbelt Software my competitor?

Competitors as in participants in the test. Learn some English. (Also, for your convenience, waist != waste)

Also I am not comparing anything to anything, I my friend provide a service ,whether you like or not,to people who are obviously not like you, they choose and I test, it is as simple as that.

No, you provide a disservice to AV/antimalware users, since you try to compare apples and oranges.

And I don't pretend to be anything, I'm doing this for a long time and I'm used to comments like yours, you may not like the results for whatever reason and that is your opinion, you accuse me of insulting somebody and it looks like you are trying to insult me.....prove to me that you know more then me and that you do things  better then I do and only then we can have a nice civilized conversation.

Maybe you should start first and answer the questions about your tests - instead of calling some vendor "crapware". Very mature, very professional, surely makes everyone sure you are totally independent.

 

[sded]

Then is Comodo CIS ready to submit to AV comparatives also?  Methodology at http://www.av-comparatives.org/seiten/ergebnisse/methodology.pdf says they go back only 9 months for malware scoring, and do a pass or fail for malware discovered in the 27 months before that, for a 3 year window (FAQ 18).  Do not understand the 1995 reference.  Thought the AVC writeup was very illuminating-does SSUpdater have something similar?  Also, isn't there an impact of SSU not including any of the samples of the VB100 testing-all viruses known to be "in the wild" at the time of testing?  Seems to be a confusing scope of test discussion-is there something a bit more scientific that summarizes?

[panic]

Competitors as in participants in the test.

In fairness, I would say he was their competitor IF he produced software that competed in the same market segment.

 Learn some English. (Also, for your convenience, waist != waste)

Please consider that not all forum members are native English speakers. They can, and do, occasionally make errors in spelling, grammar and punctuation; as do you and I.

Agree to disagree, by all means. But please keep responses within the boundaries of the forum policies.

Ewen :-)

[washoe]

Saw other interesting discussion of this at http://www.wilderssecurity.com/showthread.php?t=223873 .  Think I will wait to try.  Bur still good results if confirmed by other.

[Vettetech]

The Results
(Name/Detection Rate)

1. a-squared Anti-Malware - 99.12%
2. AntiVir PE Premium - 98.88%
3. Avast! - 98.75%
4. Norton Antivirus - 98.69%
5. Ikarus Virus Utilities - 98.48%
6. Kaspersky Antivirus - 97.83%
7. BitDefender Antivirus-97.79%
8. F-Secure -97.21%
9. Zone Alarm-96.91%
10. Spy Emergency-95.64%
11. McAfee VirusScan Plus - 94.18%
12. Comodo Internet Security - 92.53%
13. Twister Anti-TrojanVirus - 92.49%
14. Rising Antivirus - 92.27%
15. Dr.Web- 92.04%
16. Norman Antivirus & Antispyware - 91.78%
17. Blink Personal Edition - 90.93%
18. PC Tools Internet Security - 89.77%
19. Nod32- 88.35%
20. AVG Antivirus - 87.45%
21. Microsoft Windows Live OneCare - 87.12%
22. MoonSecure Antivirus - 86.43%
23. Spy Sweeper with Antivirus - 84.64%
24. TrendMicro Internet Security- 84.13%
25. Spyware Terminator with Antivirus- 61.38%
26. VIPRE- 60.97%
27. 123 Spyware Free - 57.68%
28. Ad Aware - 28.04%
29. SuperAntiSpyware - 07.24%
30. Malwarebytes Anti-Malware - 02.66%

Speed and VB100 Award

1. a-squared Anti-Malware - average - N/A
2. AntiVir PE Premium - fast - Passed
3. Avast! - average - Passed
4. Norton Antivirus - average - Passed
5. Ikarus Virus Utilities - average - Failed(37 wildlist misses, 8 false positives)
6. Kaspersky Antivirus - average - Passed
7. BitDefender Antivirus - average - Failed(4 false positives)
8. F-Secure - average - Passed
9. Zone Alarm - average - N/A
10. Spy Emergency - very slow - N/A
11. McAfee VirusScan Plus - slow - Passed
12. Comodo Internet Security - fast - Passed
13. Twister Anti-TrojanVirus - average - N/A
14. Rising Antivirus - average - Passed
15. Dr.Web - average - N/A
16. Norman Antivirus & Antispyware - slow - Passed
17. Blink Personal Edition - average - N/A
18. PC Tools Internet Security - average - Passed
19. Nod32 - fast - Passed
20. AVG Antivirus - average - Passed
21. Microsoft Windows Live OneCare - average - N/A
22. MoonSecure Antivirus - very slow - N/A
23. Spy Sweeper with Antivirus - slow - Passed
24. TrendMicro Internet Security - average - Failed(3 wildlist misses, 2 false positives)
25. Spyware Terminator with Antivirus - slow - N/A
26. VIPRE - average - N/A
27. 123 Spyware Free - average - N/A
28. Ad Aware - average - N/A
29. SuperAntiSpyware - average - N/A
30. Malwarebytes Anti-Malware - average - N/A


Our Rating and User Experience Advised

1. a-squared Anti-Malware - Good - Expert
2. AntiVir PE Premium - Excellent - Average+
3. Avast! - Excellent - Average+
4. Norton Antivirus - Excellent - Novice
5. Ikarus Virus Utilities - Good - Expert
6. Kaspersky Antivirus - Very Good - Average
7. BitDefender Antivirus - Very Good - Average
8. F-Secure - Very Good - Novice
9. Zone Alarm - Good - Average
10. Spy Emergency - Very Good - Average
11. McAfee VirusScan Plus - Good - Novice
12. Comodo Internet Security - Good - Average
13. Twister Anti-TrojanVirus - Good - Average+
14. Rising Antivirus - Average - Average
15. Dr.Web - Average - Average
16. Norman Antivirus & Antispyware - Average - Novice
17. Blink Personal Edition - Average - Average+
18. PC Tools Internet Security - Average - Average
19. Nod32 - Average - Novice
20. AVG Antivirus - Average - Average
21. Microsoft Windows Live OneCare - Average - Average+
22. MoonSecure Antivirus - Average - Average+
23. Spy Sweeper with Antivirus - Average - Average
24. TrendMicro Internet Security - Average - Average
25. Spyware Terminator with Antivirus - Below Average - Average
26. VIPRE - Below Average - Average
27. 123 Spyware Free - Below Average - Average
28. Ad Aware - Poor - Average
29. SuperAntiSpyware - Poor - Novice
30. Malwarebytes Anti-Malware - Poor* - Novice


http://ssupdater.com/modules/Forums/index.php?showtopic=3746

[Vettetech]

CIS in its premier almost made the top 10. Norton #4 which is why I am using NIS 2009.

[xiuhcoatl]

.....Maybe many people don't know this but there is a large number of malware that came out of labs form the most popular AV products, so why help them???.....

SOS
I am not arguing with you but where do you get the info can you give some sources.  I have looked for verification of this and have found nothing but rumors in blogs.

Xui
(formally OD)

I did find this http://gauntlet.ucalgary.ca/story/7001
Posted: 2003-06-09 08:53:42
#1 - Dr Aycock's comments that they will be writing viruses conflict with Dr Barker's comments in the earlier story that they wouldn't be writing viruses.

Sadly, I suspect that viruses will be written on the course. This isn't just a shame because the students will find it impossible to get a job in the anti-virus industry. It's also very sad because learning how to write viruses gives you *no* benefits whatsoever in learning how to write anti-virus software.

It is never necessary to write self-replicating code to test a theory or examine new techniques which viruses could exploit in the future. Which is one of the reasons why anti-virus companies don't write viruses.
–Graham Cluley, Anti-virus expert, Sophos

[frogger]

yes i think it's good to see

[wellofsouls]

Welcome to Comodo forum

I know that the programs you tested were chosen by your forum users, and they chose them well, but I was wondering, how would score ClamWin. I think it is evolving quite well. What's your opinion?

I think MoonSecure is using the ClamAV engine, so ClamWin should be similar?

I was expecting that somebody will ask me about Outpost, the truth is that we planed to test 30 programs, and the votes left Outpost out of the top 30, I will keep an eye on it to see how good it really is.

As far as I understand, Outpost and PC Tools are both using VirusBuster engine, so they should be similar?

As for a-squared Anti-Malware, it may have a high detection rate for using Ikarus plus their own malware detection engine, but it has a SUPER HIGH false-positive rate too. Too many false positives to be really usable IMO.

I guess from your list it seems Norton is the best, since it receives an "excellent" rating with just a "novice" requirement for its users 

[xiuhcoatl]

....The method we use in our test is simple and effective, fresh install of Windows XP SP3 in the virtual environment, we place our malware sample inside, we make full clones on which we install programs, update them, configure them to their maximum capabilities, disconnect from the internet so no new updates are possible, run on demand scans and remove what is detected, and what is left is........well you can figure out the rest

How do you deal with VM aware malware. Wouldn't this skew your test results slightly?  Many of the files generated by a malware would fail to exist there by affecting detection results

Xiu

[Kyle]

[at]SS

Thanks for the answers.

You're really sturring up a hornets nest in some forums, Good work.

[Kyle]

There is already a discussion going on here;
http://forums.comodo.com/feedbackcommentsannouncementsnews_cis/ssupdaters_antimalware_test-t29030.0.html

[Vettetech]

But feedback isn't the proper place for this topic.

[solcroft]

- CAV passed VB100% certification and scores better than NOD32, AVG, Microsoft, Twister, DrWeb, et al, according to your test
- Labeling products as "crapware"; very professional indeed
- Attacks on other testing organizations that are actually *gasp* reputable, with no evidence to back up the diatribes
- Unheard of by the public, and unendorsed by reputable vendors
- Alleging that other test results are "untrustworthy" because some products score more than 95%, when 10 products did the very same on your own test
- Alleging that reputable antivirus vendors create malware, again with no evidence

Well, with all that said, your posts weren't completely useless, state.of.security - I got a good laugh out of them, at least.

[Tags:]