I recently conduced 2 tests, A pop up test comparing the number of pop ups between Comodo Internet Security v3.9.74199.494 and Online Armor Personal v3.5.0.9. Entire Report is below. In these particular tests, Online Armor had more pop ups then Comodo Internet Security did.
I would appreciate it if people contribute to this, Do there own tests so I can update the Excel Sheet. You can also test other products vs CIS if you wish. We are ideally testing v3.9 of CIS. So go ahead and share your thoughts and ideas! I am open to any suggestions or comments, But remember… Forum Policy Still Applies!!!
For anyone is not registered, or can’t open Excel here are the basic details:
Test 1 - Batch 1 - (OA VS CIS.zip attached)
Product Name And Version - 10 Applications Tested! Windows XP SP3 32bit. Production Machine.
Product Name And Version - 9 Applications Tested! Windows XP Professional Edition SP3 32bit. VMWare WorkStation.
Download Accelerator Plus v9.1.1.1
GOM Media Player v2.1.17.4710
Camfrog Video Chat v5.2
FileZilla v3.2.3.1
LimeWire Basic v5.1.2
Winamp Full v5.551
MagicISO v5.5.274
SpywareBlaster v4.2
mIRC v6.35
Format Used:
-Install
-Launch
-Update
Total Pop Ups CIS: 19
Total Pop Ups OA: 22
Notes
Both Comodo Internet Security and Online Armor were tested at Default Settings. Not even Alert Options were touched! It was simply “Allow” and move forward.
For Test 1, Testing environment was in Windows XP Home Edition SP3 32bit. This was my very own production machine I tested on. I used Revo Uninstaller to uninstall applications in between the testing of Comodo and Online Armor.
In Test 2, I fired up VMWare Workstation that was based on Windows XP Professional Edition SP3 32bit, Took a snapshot of it at clean state, and began the tests. After testing each application, All I had to do was restore to the snapshot and continue testing the products.
10 Applications were tested, Detailed in the Excel Document attached. Entire Report is also included.
Testing was based on 3 things: Install, Launch, Update. This was the testing format used.
CIS ver 3.9 is the version designed to be used by Novices with default configuration! Please feel free to contribute by increasing the no of applications we can test against.
Thank you again Josh good work!
PS: we are working on the rest to reduce these alerts almost to zero!.. thats ver4!!!
i see a bug in that. With Faststone capture, I had two popups. One to start, the second when I captured an image (it wanted to run the default image viewer software).
Yes. Legitimate Applications, And yep that’s the goal - By total default settings. This is PURELY a usability test.
These tests will prove very useful to novices and give a good indication where COMODO is at. So far, So good. :-TU So we would appreciate if people can add other applications to vs CIS v3.9.
CIS has Buffer Overflow protection which accounted for around 60% of the vulnerabilities in 2008. Confiker was exploiting Buffer overflow vulnerability. So I will let you be the judge.
As I always said, we built one of, if not, world’s best security first. And as I always promised we are delivering the Usability part! So you have an unparalled security with ever improving usability and now this amazing security is usable by a novice.
Being an Online Armor fanboy and moderator on there forums you are, If you are here to troll, Then I strongly invite you not to. This was an independent test made by my self, And ANYONE wanting to contribute may do so. And off course you can try other programs, and results may be different. This is again, An independent test and the first batch TESTED based on the Format used above.
This is just a starter, I hope more and more tests will come up. but we can’t expect that members are going to uninstall and reinstall several products just to make a comparison :), but if you want to, please do so
As Xan said, This is only a first test. And I said at first, I do welcome anyone to contribute so we can update the Excel Sheet ASAP - Even with other products.
First, when someone starts something to rate a products vs other product(s), then its a this vs that. I don’t see it in a different way.
Then, you imply that Leolas had predefined rules. Can’t we say the same for Exist about CIS? (This sort of comment leads to other, etc… Leads us nowhere.)
Why don’t you guys just make a video showing the settings, do the test and upload it to youtube/similar service and no one doubts it? That would be the best way. Otherwise, only mirrors and smoke.