Metrics versus Limits for a CM Tool
Another related area for CM tools, as for any system, is the set of quantifiable limitations on the tool. These are really a different form of metric - one that will change much more slowly over time. How about the following easy ones - I would hope they're all sufficiently high:
· Maximum number of directories/files supported
· Maximum file size
· Maximum revisions per file
· Maximum files per change
· Maximum number of problems
· Maximum number of changes
· Maximum number of branches
How Easy Is It For You to Make a New Metric Visible?
You'll need a tool that makes it easy to track metrics. If it's not, you'll find you're not using metrics as much as you should be. Ideally, your CM tool suite has suitable metrics functionality. There are a number of things to consider here.
First, you want it to be easy to obtain your metrics. Maybe you have an overnight job generating them. Or perhaps you can just go into the tool and query them easily as you need. Perhaps they come out as numbers, perhaps as graphs as well. Great. Even better if you can export your data to a graphical slicer and dicer (e.g., Excel spread sheet).
Next you need to be able to dig down into the metrics - why is this number what it is. Click on the extra-long or extra short bar on your bar graph and identify the specific items. Or zoom in on a cell of your tabular summary. This is more than a problem solving exercise, it's a learning exercise. You want to be able to understand the metrics, not just see them. You want to investigate anomalies too. Unfortunately, over-night generated metrics (as opposed to interactive ones) will require a bit more work to dig.