Tuesday, February 07, 2012

Traffic comparison: Alexa vs Google Trends vs Compete vs ComScore

I cringe every time someone pulls traffic/audience numbers from Alexa for competition/market research. Alexa is simply bullshit when it comes to Indian websites. But, what about other such tools? Have you ever wondered where & how these website traffic-research tools get their data?

Alexa

Here's what Alexa discloses (emphasis mine):
Alexa computes traffic rankings by analyzing the Web usage of millions of Alexa Toolbar users and data obtained from other, diverse traffic data sources.
[...]
The traffic data are based on the set of toolbars that use Alexa data, which may not be a representative sample of the global Internet population.
That's right. They get their data from people who download and install Alexa toolbars. They mention "other, diverse traffic data sources" about 8 times on that page, but fail to mention, even once, what those "other, diverse" sources could be.

Compete

Here's how Compete does it (emphasis mine):
Compete’s clickstream data are collected from a 2,000,000 member panel of US Internet users (about a 1% sample), using diverse sources.
[...]
Compete’s panel measures US, but not international users. Compete has worked diligently to develop what it believes is the largest and most diverse panel of online consumers in the United States.
Compete also fails to mention their "diverse sources", but at least they mention the sample size (2 million) and sample geography (US internet users) very clearly. Their claim of "about a 1% sample" is also correct: total internet users in North America are about 272 million (source).

ComScore

And here's ComScore's methodology:
Central to most comScore services is the comScore panel, the largest continuously measured consumer panel of its kind. With approximately 2 million worldwide consumers under continuous measurement
[...]
comScore recruits panelists through a variety of online methods designed to ensure a demographically-balanced and representative sample.

ComScore's methodology page is the biggest mish-mash of marketing gobbledygook I've ever seen. And a sample-size of 2 million worldwide is the biggest joke! That would make it a 0.1% sample size based on the world internet user population of approx 2 billion (source). Probably a 0.1% sample size is statistically significant on a global scale, but how does that distribution change for India? Is their sample size in India also statistically significant? They fail to mention that.

And I'm not sure what these "variety of online methods" to recruit panelists are. I have been spending at least 5-6 hours each-day on the Internet since the last 7 years, but have NEVER been solicited by ComScore to become a panelist. Neither has anyone I know.

Google Trends for Websites

Compare this to how Google Trends for Websites generates its data (emphasis mine):
Trends for Websites combines information from a variety of sources, such as aggregated Google search data, aggregated opt-in anonymous Google Analytics data, opt-in consumer panel data, and other third-party market research.
Google Search and Google Analytics are the core data-sources that power Google Trends for Websites. For the uninitiated, most websites in India would be getting 30% or more of their traffic from Google (paid + organic). Google Analytics is the most widely used analytics system on the Indian internet scene.

Conclusion

Now think - how many users have you seen (in India) with an Alexa toolbar installed? Is anyone you know on the ComScore panel? Compare that to how many people you've seen using Google Search? People entering domain names in Google (eg. enter 'flipkart.com' as search query on Google)? Websites that use Google Analytics for measuring+analyzing their visitor data?

I'd bet my money on Google Trends for Websites any day for researching the Indian internet scene. What about you?

6 comments:

  1. In my experience, Alexa is a pretty decent source of data for comparing traffic within the same country and especially within the same industry.

    But you are right, Google's data is excellent. I prefer viewing the data through Adplanner (http://www.google.com/adplanner) usually. They give actual number estimates and other data

    ReplyDelete
  2. Saurabh, I agree with Sameer above. Adplanner is usually better than trends and I sometimes use the adwords tools to measure term specific traffic. Is there a way you use trends? I find that it does not give hard facts and only comparative data.

    ReplyDelete
  3. Roshan / Sameer: It would be interesting to see cases where Google Trends for Websites and Adplanner data do not agree with each other. I checked for a couple of websites but both the tools were reporting pretty much the same data. Can you point me to some examples?

    In the end, the point being, that free tools provided by Google give better information than the expensive paid ones :-)

    ReplyDelete
  4. there are so many type of traffic comparison sites are available.in that we can easily analyse the traffic associated with site. alexa is one of the best.

    ReplyDelete
  5. It will be truly worthwhile to seek professional assistance from the Toronto SEO Experts, as they can help improving website visibility on SERPs, earn more traffic, and fetch better profits.

    ReplyDelete
  6. Really it is a worth to visit your blog to get more and more information on different topics. Really you are posting best articles all the time.
    dealstoall

    ReplyDelete