Valkyrie Test

[Guest]

[morphiusz]

Hi.
I've just done my Valkyrie test.

I was testing 2 things:

• False positives (on 150 legit exe files)
• Detection test (on 200 malware samples)

1. Safe application set:

I collected 150 safe exe files. In general about 80-90% of these files were system's files.
Other was from various applications like:

- ashampoo buring studio
- wtw (IM software)
- Comodo Time Machine
- Expressivo
- FreeYouTubeToMP3Converter
- Comodo programs manager
- iSpy
- SpyShelter
- few drivers.

2. Unsafe application set.

Collected 200 unsafe files. They were fresh, some PUPs  were in this set.
I was very strict in rating and Valkyrie didn't pass some of those, because only its heuristics detectors didn't catch file (AV expert or CAV, CIMA said that's malware - I didn't  take this into account,I was testing only heuristic).

Results

SAFE APPLICATIONS

Total safe files: 150
Rated correctly by Valkyrie: 148
Score: 98.66%

Comment: Valkyrie is very reliable in detecing safe applications, false positives are very rare.


MALWARE APPLICATIONS:

Total malware files: 200
Rated as malware by Valkyrie: 170
Score: 85%

Comment: It's very good score, detection 85% of unknown malware. Test was strict.


Safe files rated as dangerous by Valkyrie:

http://valkyrie.comodo.com/Result.aspx?sha1=629a92efe4240f5ee4a3b540f5cec50cb8dd5bd3&&&query=0&filename=blastcln.exe
http://valkyrie.comodo.com/Result.aspx?sha1=3ade035011c02d02f470bd1ae125978584ec678b&&&query=0&filename=mpnotify.exe

Malware files rated by heuristic improperly:


http://valkyrie.comodo.com/Result.aspx?sha1=9a64975c4d4a417963df888c39bb15b28a841bae&&&query=1&filename=1.exe
http://valkyrie.comodo.com/Result.aspx?sha1=3cdbf8647015969eb1498e3d9170fe3777c6f68e&&query=0&&filename=Adriana-Lima-ScreenSaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=d3853d5af82d80bce9a158d13ff345ccd097afce&&query=0&&filename=Angelina-Jolie-Screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=08bba091c02dbd83f26ba89aeee65d848f6ae58f&&query=1&&filename=Aishwarya-Rai-ScreenSaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=c8e8a6f75c99259a703ba992702c38261a8e1a2b&&query=1&&filename=Beyonce-Knowles-ScreenSaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=7ce3066f1f26ba7dcf8fdc137c6588150c87ff99&&&query=1&filename=boanking.exe
http://valkyrie.comodo.com/Result.aspx?sha1=f4dbdc991f6103ec5c82c138b28d13d02cb12aa5&&&query=1&filename=brad-pitt-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=5d6150040a68411361ecafc0ff92c1b3ad88fe96&&&query=1&filename=Bruce-Willis-ScreenSaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=2573b87b970d8a59ca9ce0e6569e0de133d3c940&&query=1&&filename=camfrog%20.exe
http://valkyrie.comodo.com/Result.aspx?sha1=2b726e1abd7a9d67d9aa4768502dd4bfbdc5e3f6&&query=1&&filename=comedown_4597.exe
http://valkyrie.comodo.com/Result.aspx?sha1=858858393ca54543ce7a0c8e044eb760fde61894&&query=1&&filename=Daniel-Craig-Screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=9e50d56dfc5bcea4856b3d6249aeac07aa6ded86&&query=1&&filename=Denise-Milani-ScreenSaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=96411daf0306c5c871103abba30ff5e277e5a064&&query=1&&filename=FC544142.exe
http://valkyrie.comodo.com/Result.aspx?sha1=7094ed9aa8ac7dd5143122541628c53cec8f6ebc&&query=1&&filename=ie.exe
http://valkyrie.comodo.com/Result.aspx?sha1=c74571edf6fa0e6d8741f9c7219c238871500dc0&&query=1&&filename=inid.exe
http://valkyrie.comodo.com/Result.aspx?sha1=4eec2eda07b08e150fe53c02c160c8c6e91f487a&&query=0&&filename=jennie-finch-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=4ab5f8edb2670766d5944d596016bb3e7436d6a0&&query=0&&filename=jennifer-aniston-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=2c2ca553e893cddf24101a1bbf961e707acd40c8&&query=0&&filename=jennifer-lopez-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=77b39d4b62a36c168a58be2a12038c837526246f&&query=1&&filename=Jessica-Alba-Screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=e2eeb20121a1c3fd9a7cad73d6dbe18aa0fd74a8&&query=0&&filename=julia-roberts-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=9febc37764c890776743b4fa3ea18da0bcda6e1e&&query=0&&filename=kate-beckinsale-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=64c8591ff1dbdf9b2a475400120a3d33d195c5f3&&query=0&&filename=kirsten-dunst-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=299f9bea7f3f3f918ddabcb33792306500a16172&&query=0&&filename=long2897.exe
http://valkyrie.comodo.com/Result.aspx?sha1=f6845a25f6dc3ea57db8f7e05c329b0a6a2637ed&&query=0&&filename=mariah-carey-screensaver.exe
http://valkyrie.comodo.com/Result.aspx?sha1=e6194cce2a993ec267942d46d79942e0e293dac5&&query=1&&filename=MP4.exe
http://valkyrie.comodo.com/Result.aspx?sha1=901e1f8c4dbec0d6b15bbda3bbbab0bd693ff136&&query=1&&filename=mp4crack.exe
http://valkyrie.comodo.com/Result.aspx?sha1=ff0bc8e5949ff536c8c3fdca0fc478c5f1d94d68&&query=1&&filename=mp5.exe
http://valkyrie.comodo.com/Result.aspx?sha1=cb23b4c0ccf58b9daa6dbe1948f4093fa10019dc&&query=1&&filename=MultiPoster5.exe
http://valkyrie.comodo.com/Result.aspx?sha1=57a6e5c45f9fdb7ff370a3c1160f9da9510ef159&&query=1&&filename=multi-webcam-surveillance-system_setup.exe
http://valkyrie.comodo.com/Result.aspx?sha1=db8b99b4c923b93a749708a1243c1033e4b5d6dc&&query=1&&filename=Svchost.exe.exe


NOTE: I made comment with feedback to all files I've submitted. In total 350 comments for today 


Thanks.

[kagun]

Let me be the first to say that this what you posted is simply AMAZING man!!!! 

[disPPlay]

Great job morphiusz and thanks for sharing this information with us.

[w-e-v]

Great work Morphiusz!
Amazing job you did today.

You should definitely enter the COMODO Hall of Fame! 

Thanks for helping Valkyrie grow faster and better.

[kagun]

You should definitely enter the COMODO Hall of Fame! 

+1

[wasgij6]

valkyrie is definitely getting to be great. with some more work it will be a beast and nothing will get passed it
great job comodo

[Siketa]

Great job, Morph! 

[languy99]

good job, can't wait for valk to be integrated into CIS.

[Siketa]

I quoted your test at http://www.bug.hr/forum/topic/sigurnosni-softver/ultimativna-antivirus-tema-po/12723.aspx?page=467&jumpto=2182558&sort=asc&view=flat

Hope it's ok with you....

[morphiusz]

Sure 

[sdfsadfdfs]

by the way,anybody knows when would Valkyrie be added into cis???

[kagun]

I quoted your test at http://www.bug.hr/forum/topic/sigurnosni-softver/ultimativna-antivirus-tema-po/12723.aspx?page=467&jumpto=2182558&sort=asc&view=flat

Hope it's ok with you....

You defend Comodo nicely 

Ajde, da te malo naučim neke stvari....

 

[Siketa]

Thanks, Gakun....just doing my best to inform people and give them real facts about Comodo and not some blatant lies like Comodo haters do....

[kagun]

Yeah, those people just repeat like parrots what OTHERS told them without trying or verifying.
I applaud you for your effort, a really nice job 

[Siketa]

Yeah, those people just repeat like parrots what OTHERS told them without trying or verifying.
I applaud you for your effort, a really nice job  

Yeah....and when we tell them to make their own test all you can hear are excuses about lack of time, lack of certificates......blah, blah, blah....

[Tags:]