However, these dozens of criteria are usually far easier to fit on top of a Next Gen ALM platform than vice versa.
Vendors, your input (i.e. how do you assess your own ALM tools) is more than welcome. You may want to evaluate your own tools before someone beats you to the punch. I will place raw results (from your feedback) into the spreadsheet mix. You may think some of these categories are difficult to assess, but the scoring is generally clear enough and flexible enough that you should be able to do a first pass in a few minutes (if you're familiar with your solution).
Have a great 2011!