Is this the kind of test Comodo Prefer to Participate?

[Guest]

[Matty_R]

There is one part of the AMTSO review which i find a bit strange and IMO could do with some adjustment. The person who does an Analysis Request, whether that be me, you, the tester, Joe from down the pub must receive written support (evidenced by signatures) of at least 3 AMTSO individual members or representatives of such.
If the Filer (the one asking for the review) is a member then that counts for 1 of the 3.

What i would like to see happen is someone come forward and say we are going to do a test and we are going to do it to AMTSO guidlines. We have member A, B + C who are going to submit/sign for an analysis request and then the AMTSO shall (this is the tricky bit) solicit from it`s members voluteers to do the analysis.

It`s looks like it costs a few quid to join, i would hope that soon compliant tests are forthcoming otherwise what`s the point of being a member!

Matt

[Endymion]

There is one part of the AMTSO review which i find a bit strange and IMO could do with some adjustment. The person who does an Analysis Request, whether that be me, you, the tester, Joe from down the pub must receive written support (evidenced by signatures) of at least 3 AMTSO individual members or representatives of such.
If the Filer (the one asking for the review) is a member then that counts for 1 of the 3.

Indeed that's the paragraph 1.b from the "review process" section though it it would be strange if that was the reason that insofar seemingly prevented testers to file their own tests whenever due for imminent publication ( paragraph 1.b from "Procedures\Scope" section) since that draft was approved on May whereas instead such testers behaved in a way that elicited a public article  from a member of the AMTSO board of directors (which is entitled to appoint who will take part to the RAB each year) also stressing out that there is no formal definition of compliance yet.

Soon after the introduction paragraph of the AMTSO Analysis of Review Process document it was mentioned that changes to the procedures and processes are to be expected and hopefully these anticipated changes will address the current absence of peer reviewed tests in a less convoluted way and encourage testers to be used to submit their tests before publication now that they are affiliated with an organization that give them that possibility even more when their membership required a quid.

[Kyle]

One thing I'm wondering.. If AMTSO tests end up fading away... will comodo participate in any other tests? 

[Melih]

There is one part of the AMTSO review which i find a bit strange and IMO could do with some adjustment. The person who does an Analysis Request, whether that be me, you, the tester, Joe from down the pub must receive written support (evidenced by signatures) of at least 3 AMTSO individual members or representatives of such.
If the Filer (the one asking for the review) is a member then that counts for 1 of the 3.

What i would like to see happen is someone come forward and say we are going to do a test and we are going to do it to AMTSO guidlines. We have member A, B + C who are going to submit/sign for an analysis request and then the AMTSO shall (this is the tricky bit) solicit from it`s members voluteers to do the analysis.

It`s looks like it costs a few quid to join, i would hope that soon compliant tests are forthcoming otherwise what`s the point of being a member!

Matt

good few testing organisations are members. So they themselves would have enough votes to get their own tests accepted for a review...

melih

[panic]

One thing I'm wondering.. If AMTSO tests end up fading away... will comodo participate in any other tests? 

They would have to exist before they could fade away.

Give it time - it's not as easy as we would believe it to be.

[HeffeD]

They would have to exist before they could fade away.

Give it time - it's not as easy as we would believe it to be.

Maybe that's the point though. Is it so tough to devise a proper test that nobody will bother?

[panic]

Maybe that's the point though. Is it so tough to devise a proper test that nobody will bother?

I think it's more a case of it being so different to what people have been doing for 20 odd years.

Another thing to consider is that if a company produces an AMTSO compliant test suite, could this be perceived as saying their prior test methods had not kept pace with the changing nature of malware?

Just a thought.

Ewen :-)

[HeffeD]

Another thing to consider is that if a company produces an AMTSO compliant test suite, could this be perceived as saying their prior test methods had not kept pace with the changing nature of malware?

Yes, I guess this could very well be a concern to the testers. Although I think that even they have to know that as the face of malware changes, they need to change with it or be left behind. Look at Adaware and Spybot. The had the entire spyware/adware protection market. No competition but themselves. They had every opportunity to be the absolute kings, but instead of keeping up, they dropped behind.

I guess like you said, it may take time. I suppose all we can hope for is that they feel it's worth taking the time to change their methodology. Otherwise all testing will be largely irrelevant, as we are beginning to see...

[hkjoj]

One thing I'm wondering.. If AMTSO tests end up fading away... will comodo participate in any other tests? 

After reading and writing so much.  I already have no hope on this.
I'm lossing trust on Comodo and Melih.

[Melih]

One thing I'm wondering.. If AMTSO tests end up fading away... will comodo participate in any other tests? 

Comodo already participates in MANY tests.... From Matousec to some others....The issue is not about participation or not but which one Comodo would like to put its name to and stand behind. There is none today! We are working with a vendor or two...but too early..

I believe AMTSO has enough marketing pull that it will happen..

Melih

[Melih]

Well, here is the first to go thru AMTSO review according to this post

(http://forums.comodo.com/feedbackcommentsannouncementsnews_cis/petition_for_cis_to_be_tested_by_nsslabs-t46381.0.html;msg346362#msg346362)


Melih

[Endymion]

Then this mean that the final result of the analysis shall be posted publicly (Paragraph 11 from the "review process" section) hopefully soon enough.

I hope though to see fulfilled also the part that  mention that tests due for imminent publication can be submitted as well.

[Melih]

As soon as we all realised that NSS is already being reviewed by AMTSO, all the doubters about if any test will go to AMTSO review board or not went quiet


Melih

[languy99]

so is comodo going to be tested by NSS then?

[Melih]

so is comodo going to be tested by NSS then?

If/When AMTSO gives their blessing..we will request a test...

Melih

[Tags:]