#10 ArkiMage:
The thing is, TPC _IS_ scientifically verifiable and audited by 3rd parties. MS pays merely for the equipment and the time (TPC charges everyone the same rate). Price has no effect on the outcome of their results.
Netcraft has yet to produce a document explaining how they collect their information, they do not have 3rd or even 2nd party auditors. For all we know, they could be throwing darts at a chart on the wall to come up with their numbers. Even if IIS were 99% and Apache 1%, I would still say they were complete BS and unverifiable.
As far as errors, Netcraft is full of them. There are many sites who show them running Solaris one day, and Win2K the other. There are days where Netcraft shows a site being down, yet the site comes up just fine on my browser.
The point is, Netcraft does not have reliable means of collecting data and who knows what kind of statistical analysis they're doing, if any on the numbers. Like I said, since they don't allow anyone to audit their numbers, they could be pulling them out of a hat for all we know.
Add to this a very slight bias towards *nix (if you read their various reports, they're always speaking flowery and glowing about Linux, and have a slight aire of condescention about Windows, not to mention the fact that they purposely ignore the real data anyone would care about which is which web server software runs the most hits or largest volume of traffic) it's obvious that they publish these numbers to make Apache and Linux look better. It would suggest a hidden agenda, or grave stupidity that they blindly ignore the more valuable numbers I mentioned above.
Let's assume, for a minute, that Netcraft's numbers are accurate to a respectable level (1% or so, maybe a little more).
It could very well be the case that a large majority of Apache sites are either domain holders (useless), my cat fluffy sites (ISP's who host gobs and gobs of low-hit personal web sites), and various other back-alley kind of sites, whereas IIS hosts a majority of the high traffic, high reliability/availability e-Commerce and business web sites.
Those would be much more telling and valuable numbers. But Netcraft has chosen to ignore these numbers and go solely with anonymous domain counting. And even then, they don't try to count servers, only domains. Their numbers are misleading because there could be a 5:1 ratio of domains to servers running Apache.
Anyhow, Netcraft's numbers are worthless because they aren't scientifically gathered, they aren't audited by reputible sources, and there is a slant or bias to the interpretation of results by Netcraft themselves.
-d
|