Danny wanted me to pass this along, so I am:
I will say no more.
I love Danny to death, but I suspect he would fail in a double blind test with his highend gear vs. what we were using.Hey guys, Please pass these thoughts around if you like.
Those comparison are a ton of fun. I love doing those things.
A few criticisms that hopefully will be taken constructively (as intended).
You guys really need to step up into high end gear for that stuff. That gear is really what I consider budget or entry level gear. So you are leaving a lot on the table. For instance the imaging and sound stage can be improved by a significant margin with higher quality gear and then it will really separate which speakers convey or hinder those aspects.
Higher quality gear especially in the ability to drop the noise floor will also really help separate the speakers from one another. When the noise floor drops and the background levels from AC noise goes away then you can tell which speakers convey the dead space between the notes and which ones smear or cover that up with cheap or slow discharging caps.
You simply may not be hearing the real separating factors.
Another thing is room correction devices are in reality the kryptonite of the high end system. In a higher level system you realize that it sucks the life out of the music as it degrades the signal quality. You won't notice the negative effects with budget gear though. And it also doesn't really work. By that I mean it is placement based. Move the mic and you might as well start all over. It can improve the amplitude response below 200hz, but above that it can be disastrous. And you are not only fixing room related issues (or trying to fix room related issues), but you are correcting for speaker amplitude issues. So in a sense it is saying this is what we thought of the speakers after we had to correct them. So the evaluation has more to do with the system circumstances than the speakers.
The same can be said for in room response measurements. Those responses are room based and not speaker based. So it really says more about the room than the speakers.
If you are evaluating the speakers then post real speaker measurements (without the room response) so that real comparisons can be made. Then people really know something about the speakers themselves.
Check out this speaker shoot out that I assisted with. This is the measurement portion.
See the way they speakers were measured and what those measurements tell you about each speaker. That is valuable information. I don't know if you have the ability to take gated time window measurements or not. If you do have the ability and need help with it then I will be glad to help you.
I will say no more.