Author Topic: Community team-based testing and evaluation of security products...  (Read 61997 times)

Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #15 on: June 28, 2011, 01:04:03 PM »
Very well, and I agree on all......
Shall we include a testing on BETA's? Obviously a non-finished product cannot be certified or measured, but maybe something like a small review like new features are this and that, and maybe a malware test just for a test drive or something....

I plan on working on test methodology and would need all the help I can get tomorrow about this time...
I will make a draft and set up guidelines and fill details later and present it for final approval from ALL team members....

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1324
  • BETA FORCE MEMBER
Re: Community team-based testing and evaluation of security products...
« Reply #16 on: June 28, 2011, 01:22:59 PM »
I guess BETAS would be just fine... for the ITs.
There is always someone who wants to know how its going to work their predilection product.
It is just matter to see how available the beta of the products are. And how much testers are available. :P

Whatever I can help with, let me know. I will like to support this community for sure.

Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #17 on: June 28, 2011, 01:38:03 PM »
Tomorrow I start work on the rules and guidelines....
I hope to finish it on Sunday so I can present it to review...
Next week, we start the project for website, brainstorming layout and what to use, making Youtube Channel and the rest...
If all goes well, we could see our first pilot test mid-july...
Then we go ballistic....

For website, we need shoutbox/chat integration, comments section, forum if needs be, social networking integration [share button]....
If the site needs to pay for traffic, maybe we could have some sort of ad support system....
I am a graphic effects whore so I would also like to see something like http://www.kaspersky.com/viruswatch3
and like my website www.xrl.us/gakungak

Many testers switch to Win7. I kinda want to stick to XP for a while because a lot of people
still use it... Or to make a switch to 7? Se7en is highly stable and resistant to viruses and I want malware to rape the system hard B-) :)

Offline Melih

  • CEO - Comodo
  • Administrator
  • Comodo's Hero
  • *****
  • Posts: 13553
    • Video Blog
Re: Community team-based testing and evaluation of security products...
« Reply #18 on: June 28, 2011, 02:13:27 PM »
great idea!

Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #19 on: June 28, 2011, 02:34:29 PM »
great idea!
Thanks, boss!  :) :-TU
I was inspired by your setting-the-testing-standard and AMTSO a while back so I thought, why not make a little initiative to see how it works out.... ;)
I have ambitions to make this as big as resources and time allows...
Unlike those organisations where they just provide the PDF document, I want to give:
1: PDF with detailed description of what happened
2: Video, so everyone can see what and how the test went
3: Discussion, where people can say their opinion and bring their criticism to the table towards a program or the tester, also share ideas and how to improve something...

I hope it all turns out okay...

Offline Melih

  • CEO - Comodo
  • Administrator
  • Comodo's Hero
  • *****
  • Posts: 13553
    • Video Blog
Re: Community team-based testing and evaluation of security products...
« Reply #20 on: June 28, 2011, 03:22:10 PM »
Thanks, boss!  :) :-TU
I was inspired by your setting-the-testing-standard and AMTSO a while back so I thought, why not make a little initiative to see how it works out.... ;)
I have ambitions to make this as big as resources and time allows...
Unlike those organisations where they just provide the PDF document, I want to give:
1: PDF with detailed description of what happened
2: Video, so everyone can see what and how the test went
3: Discussion, where people can say their opinion and bring their criticism to the table towards a program or the tester, also share ideas and how to improve something...

I hope it all turns out okay...

Good luck.

You can also incorporate real user feedback to your system..

sounds like a good system if implemented.

Offline w-e-v

  • Star Group
  • Comodo's Hero
  • *****
  • Posts: 1324
  • BETA FORCE MEMBER
Re: Community team-based testing and evaluation of security products...
« Reply #21 on: June 28, 2011, 06:32:37 PM »
Its actually cool when you have the same thoughts as Melih.

You can also incorporate real user feedback to your system..

And if any certification has to be given, I believe the users who visits and review the results are the one who should give the certification (like if a number of good reviews for a testing result is reached).

This is only a suggestion.

Cool eh!?  :-TU

Offline arjunpa

  • Comodo's Hero
  • *****
  • Posts: 392
  • Iam Cool
Re: Community team-based testing and evaluation of security products...
« Reply #22 on: June 28, 2011, 11:54:31 PM »
Tomorrow I start work on the rules and guidelines....
I hope to finish it on Sunday so I can present it to review...
Next week, we start the project for website, brainstorming layout and what to use, making Youtube Channel and the rest...
If all goes well, we could see our first pilot test mid-july...
Then we go ballistic....

For website, we need shoutbox/chat integration, comments section, forum if needs be, social networking integration [share button]....
If the site needs to pay for traffic, maybe we could have some sort of ad support system....
I am a graphic effects whore so I would also like to see something like http://www.kaspersky.com/viruswatch3
and like my website www.xrl.us/gakungak

Many testers switch to Win7. I kinda want to stick to XP for a while because a lot of people
still use it... Or to make a switch to 7? Se7en is highly stable and resistant to viruses and I want malware to rape the system hard B-) :)
About the chat, there's Cbox(http://www.cbox.ws/). There's one more(chatango) but  :-X . The chat itself will require moderation.
Core i5 750 [at] 2.66 GHz
MSI GD65 Motherboard
2 GB RAM
Sapphire HD 5770 1 GB

Offline Solarlynx

  • Comodo's Hero
  • *****
  • Posts: 1348
Re: Community team-based testing and evaluation of security products...
« Reply #23 on: June 29, 2011, 02:08:39 AM »
Unlike those organisations where they just provide the PDF document, I want to give:
1: PDF with detailed description of what happened
2: Video, so everyone can see what and how the test went
3: Discussion, where people can say their opinion and bring their criticism to the table towards a program or the tester, also share ideas and how to improve something...
:-TU
If it's possible to make such format of tests that  everyone can repeat any test then it only increases the credibility of the tests.

Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #24 on: June 29, 2011, 02:31:03 AM »
:-TU
If it's possible to make such format of tests that  everyone can repeat any test then it only increases the credibility of the tests.
That's how I want it to be, credible!
And fair and true test for all involved!
For the time being I'll have to do it in VMWare, but later if I can get a dedicated testing machine it would be even better!

About the chat, there's Cbox(http://www.cbox.ws/). There's one more(chatango) but  :-X . The chat itself will require moderation.
Very very very well done, man!  :) :-TU
Good luck.
You can also incorporate real user feedback to your system..
sounds like a good system if implemented.
That's what I plan to do... All details would be available for questioning and research and if there's a major deviation or anomaly or majority are not satisfied, all complaints will be reviewed and test repeated.
Since all this would be free, we would be severely restricted with time and resources [9-6 job, a child under way, girlfriend] I might not do tests every day but surely I can manage on weekends [saturday and sunday]....
In 10 hours, I start writing, wish me luck bro's :-)
As per suggestion, first post would be updated with dates so it's easier to keep track on what's new.... :)

Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #25 on: June 29, 2011, 01:39:04 PM »
As promised, on first post I uploaded what I wrote.
Beware, it's ugly and disorganized for the beginning, but I promise it would be nice  :)
If someone would read it and tell me opinions what to change, what to add etc so it's acceptable enough  :)

When Guidelines and Methodology is done, next objective would be to design how a test report would look like  :-TU

Offline Valentin N

  • Malware Research Group
  • Comodo's Hero
  • *****
  • Posts: 2867
  • Usability Study Group
    • My homepage at the moment
Re: Community team-based testing and evaluation of security products...
« Reply #26 on: June 29, 2011, 02:40:46 PM »
Sounds interesting :)

Could have you found any that is video responsible? If you want I could take my time and give you feedback.

I know very little HTML coding but when I know more I will help you; html coding is not as hard as java or c++.

I made my first video with Camstudio and it went quite good for beeing the first time. in other words I will help making reviews.

Regards,
            Valentin N
« Last Edit: June 29, 2011, 02:42:17 PM by Valentin N »
Skype: comodohelper (Personal)

CEVPN: Valentin N

CIS 6.3

Keep CTM alive by voting


Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #27 on: June 29, 2011, 02:48:16 PM »
Thanks!  :-TU
This is still in baby steps, you know, for now I want good foundation.
After that, rest is easy, more or less....
You could be my testing partner and while I test product X, you do Y and things will get faster and easier!
All under one channel....  :)
If we don't get video producer, then we would either have to try ourselves do video editing and effects or do without editing....

Offline Valentin N

  • Malware Research Group
  • Comodo's Hero
  • *****
  • Posts: 2867
  • Usability Study Group
    • My homepage at the moment
Re: Community team-based testing and evaluation of security products...
« Reply #28 on: June 29, 2011, 02:52:14 PM »
everything depends how professional you want it. Check your PM btw :)
Skype: comodohelper (Personal)

CEVPN: Valentin N

CIS 6.3

Keep CTM alive by voting


Offline kagun

  • Left the Forums
  • Comodo's Hero
  • *****
  • Posts: 1141
Re: Community team-based testing and evaluation of security products...
« Reply #29 on: June 29, 2011, 02:56:17 PM »
How about some intro animation with music with flashing text?
And probably to name this group something?
And we would need a logo and an organisation chart, to see who does what....
Also, custom made desktop wallpaper!
I already have the website guy on the team, we will try to start making something next week...
I will brainstorm that tomorrow.
I did, and I am impressed, you're in!  :-TU :)

 

Seo4Smf 2.0 © SmfMod.Com | Smf Destek