I certainly admire your courage to take on a task like this and I think it would be very worthwhile! Still, IMHO, the process will have a lot of 'chuck-holes' to negotiate.
1. Vibration - someone who has Saw "A" on a stand may experience much different vibration from someone who mounted the same saw to a bench. And doesn't the type of stock cut and type of blade influence this?
2. Price - to some extent price is pretty subjective. $150 is pocket change to some and a large portion of someone else's SS check.
3. Some saws that are more popular e.g., the DeWalt. And thus a few dozen users may weigh-in and rate a model. Other saws because of price, or some other factor, may only be in the hands of a couple users. It's clear that a larger number of raters will provide a more realistic view. (I know that when I'm at Amazon looking at reviews of products and I see a 5 Star rating, it's a lot different if there are 155 reviewers vs a single reviewer.)
4. Finally, those who have only owned and used one machine won't have any basis for comparison for some things like vibration or noise. I fall into this group.
I'll be happy to participate and rate my Delta 40-540.