Author Topic: Valkyrie Test Results  (Read 33301 times)

Offline wasgij6

  • Global Moderator
  • Comodo's Hero
  • *****
  • Posts: 5493
Valkyrie Test Results
« on: November 18, 2012, 07:08:29 PM »
Here you can post your personal test for Valkyrie. Now that valkyrie is getting more mature it is becoming very powerful and reliable so feel free to post your personal test results here for detecting malware or safe files, remember valkyrie can do both, very well.

In my opinion its best to test valkyrie after removing anything CIS detects with local signatures or in the cloud. If there is anything that isnt detected as malware but you believe its truly is malware post it here with a virustotal link. Also if CIS isnt detecting a piece of malware its best to report the sample here. If you experience any bugs with the valkyrie site you can post them here

BTW if your experiencing any FPs with CIS, upload them to valkyrie and see the true power of the AI. I rarely see FPs from valkyrie.

Happy testing
https://valkyrie.comodo.com/
« Last Edit: September 02, 2015, 05:50:59 PM by wasgij6 »
| Win 10 Pro (x64) | UAC Disabled | CCAV | Intel i7 4770k | Asus Maximus VI Formula Mobo | Asus GeForce GTX 780 | G.Skill TridentX 32gb RAM | Samsung 850 Pro SSD |

Offline wasgij6

  • Global Moderator
  • Comodo's Hero
  • *****
  • Posts: 5493
Re: Valkyrie Test Results
« Reply #1 on: November 18, 2012, 07:23:56 PM »
Ill be the first to post a test. I download a multiple packs of malware totaling to 717 malware. I first check all the files in the cloud and with the local signatures and removed what they found. Combined they found 601/717 = 83.82%. Next i uploaded all the undetected files to valkyrie, 7/717 were not analyzed, valkyrie say they were non PE files, there were 3 files detected as "normal" (i will post the Virustotal links below), 1 file detected as "unknown" (linked below), and 105 detected as malware.

So with the combined detection of CIS and valkyrie they had an overall detection rate of 706/717 = 98.47%

Here are the files marked as "normal':
https://www.virustotal.com/file/d066ca2add17fb61d1d9dab17778647aabd0e46692798e3f25891e7404b542fc/analysis/1353284137/
http://v.comodo.com/Result.html?sha1=c5c0fb13ff5e42449a693bf1d93203c0d59d19c8&&query=0&&filename=157

https://www.virustotal.com/file/4ed953b7971195adca5c7aa7f68f8f0820a479905385a99b29cf6c473aef21d2/analysis/1353284148/
http://v.comodo.com/Result.html?sha1=939ed6b97095cab1beb0806452f4f90a08768791&&query=0&&filename=264

https://www.virustotal.com/file/9798722aaee046a5dcacae8a5893283af13188253096eb46a162fd6595f6c9e2/analysis/1353284157/
http://v.comodo.com/Result.html?sha1=f512b25239728515af658dfc8e521db83a99e910&&query=1&&filename=489

Some of these files might not even be malicious.

Here is the file the was marked "unknown":
https://www.virustotal.com/file/414ce188f46b54246631a09c6cd42198d4f045a673f396f69116068c676b9b69/analysis/1353284255/
http://v.comodo.com/Result.html?sha1=f3b063fd7099429a329b029eab64116f033af596&&query=0&&filename=238

All of the undetected samples have been submitted to comodo.

EDIT: i forgot to mention the samples were 24-48 hours old.
« Last Edit: November 18, 2012, 09:25:56 PM by wasgij6 »
| Win 10 Pro (x64) | UAC Disabled | CCAV | Intel i7 4770k | Asus Maximus VI Formula Mobo | Asus GeForce GTX 780 | G.Skill TridentX 32gb RAM | Samsung 850 Pro SSD |

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1498
  • BETA FORCE MEMBER
Re: Valkyrie Test Results
« Reply #2 on: November 18, 2012, 09:05:17 PM »
I LOVE this combined tests with CIS and VALK.... I just love it!
Please keep up the good testing work! ;)

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560
Re: Valkyrie Test Results
« Reply #3 on: November 19, 2012, 01:45:07 AM »
I will test it and post results probably friday or later, btw thanks valkyrie is improving and growing very well  :-TU

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560
Re: Valkyrie Test Results
« Reply #4 on: November 19, 2012, 05:58:33 AM »
150 pieces of malware.
Comodo local database + cloud lookup : it left 29 files. (80.6%) 3 safe files so I did not scan them with valk.
valkyrie scan of 26 files : 21 identified as malicious and only 5 as normal (most of the 5 ones = Adware).

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1498
  • BETA FORCE MEMBER
Re: Valkyrie Test Results
« Reply #5 on: November 20, 2012, 08:20:31 AM »
Great test spywar, and good results for COMODO team.

Could it be that with CAV and VALK (thanks to COMODO) we are witnessing perfection in detection? :D :D

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560
Re: Valkyrie Test Results
« Reply #6 on: December 07, 2012, 02:36:36 PM »
Hi today I have a malware pack which contains 341 files. (Thanks MalwareCenter).
Cis + cloud lookup : 83/341 (24.3%).
Valkyrie scan of the 258 files :
Number of files classified as Malware : 217
Number of files classified as Normal : 20
Number of files classified as NO PE file : 21
Percentage Valkyrie + CIS + cloud lookup : 300/341 (88%).
Many thanks to the devs.

Offline wasgij6

  • Global Moderator
  • Comodo's Hero
  • *****
  • Posts: 5493
Re: Valkyrie Test Results
« Reply #7 on: December 07, 2012, 03:10:32 PM »
did you upload the 20 marked as safe to Virustotal to see if they were actually malware?

great results BTW
| Win 10 Pro (x64) | UAC Disabled | CCAV | Intel i7 4770k | Asus Maximus VI Formula Mobo | Asus GeForce GTX 780 | G.Skill TridentX 32gb RAM | Samsung 850 Pro SSD |

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560
Re: Valkyrie Test Results
« Reply #8 on: December 07, 2012, 03:13:47 PM »
did you upload the 20 marked as safe to Virustotal to see if they were actually malware?

great results BTW
Oh no I forgot ...

Offline wasgij6

  • Global Moderator
  • Comodo's Hero
  • *****
  • Posts: 5493
Re: Valkyrie Test Results
« Reply #9 on: December 07, 2012, 03:15:55 PM »
ok i was just curious, nice work  :-TU
| Win 10 Pro (x64) | UAC Disabled | CCAV | Intel i7 4770k | Asus Maximus VI Formula Mobo | Asus GeForce GTX 780 | G.Skill TridentX 32gb RAM | Samsung 850 Pro SSD |

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1498
  • BETA FORCE MEMBER
Re: Valkyrie Test Results
« Reply #10 on: December 07, 2012, 06:53:18 PM »
Oh no I forgot ...
So, what is the final VIRUSTOTAL verdict for those 20? ;) :-TU

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560
Re: Valkyrie Test Results
« Reply #11 on: December 08, 2012, 01:55:09 AM »
So, what is the final VIRUSTOTAL verdict for those 20? ;) :-TU
I removed all of them but I suspect they were AdWare or probably clean file  ;)

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1498
  • BETA FORCE MEMBER
Re: Valkyrie Test Results
« Reply #12 on: December 08, 2012, 09:38:22 PM »
Super! Thanks and great job you did my friend!

Offline spywar

  • Malware Research Group
  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 9560

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1498
  • BETA FORCE MEMBER
Re: Valkyrie Test Results
« Reply #14 on: December 10, 2012, 04:04:20 PM »
Interesting, Valk increase doubly the detection rates. This is great.

Quote from: spywar link=topic=88429.msg641641#msg641641 date=1355172638
We can see AdHeuristic3 : malware.

[url
http://valkyrie.comodo.com/Result.html?sha1=3a71d0bd8ad5caef38272962195c9fb2395914d1&&query=0&&filename=3809B4D719AB9C678284DD938E3C0571[/url]
http://valkyrie.comodo.com/Result.html?sha1=23c91b3fa082e0bc2c038d42bde550ba7ac2e3c3&&query=0&&filename=DAF6A22138891814CD4710696DC9D537
Altough they are "malware" as per the AdHeuristic3, they are considered 99.9% "normal". How could that be?

 

Seo4Smf 2.0 © SmfMod.Com Smf Destek