Analysing the Web

The background story

I wanted to investigate to current position of the web by analysing the most successful companies. Companies in this analysis are represented by unique domain+extension (domain.com). I'll refer to these as 'websites'.

How are these websites in ways of innovation and location. Are the most successful websites from America? Are Chinese websites a majority of the internet? Is the web made of porn? Are they implementing easy-access RSS feeds?

This page describes the quantitative analysis of web data gathered from various sources. And it shows the rough stats that you can use when source is appropriately credited (www.yvoschaap.com)

To compile a list of most significant websites I used the Alexa top 10,000 websites ranking. The top 10,000 websites represent ..% of total internet traffic (source). The top 500 websites represent 45% of internet traffic. Over 40% of alexa data is gathered by users outside the United States. cite.
Reach is defined by XXX. I calculate the percentage of reach by setting the sum of websites analyzed as 100%.

With the list of the top 10,000 websites I gathered information grabbing the website homepage, and looking for available: RSS feed, stylesheet and advertising network.
Plus data is gathered about domain reach, views, adult, language, inlinks, and location (ownership).
The downsides are that only toplevel domains with extension (domain.com) are uniquely counted. So to add a extra level of analysis, the websites google, yahoo, and ebay get a special treatment where they get reach and view of all their domain extension are added. Microsoft gets one listing of live.com, msn.*, microsoft.com and hotmail.com.

Alexa's data is over represented by English users. And 30% of adult site owners don't identify themselves. And I've heard stories about websites blocking access from Alexa toolbar users.

The textual analyses of the top 10,000 websites that represent XX% of total internet traffic is here.

Example stats:
Most adult content distributing countries.
Most websites owned by country
Biggest reach
Most linked websites
total reach of top 100, top 1,000 and top 10,000
Googles,yahoo,microsoft, ebay total domain reach (all extentions)
% adsense publishers
other advertising networks


Domain

Warning: mysql_connect() [function.mysql-connect]: Access denied for user 'directly_admin'@'localhost' (using password: YES) in /home/yvoschaa/public_html/webanalyse/index.php on line 76

Warning: mysql_select_db(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 77
# total reach data: 6,683,133 # total views data: 631,286 # total domains data: 9,999 (almost 10,000) ####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 97
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 99
#################################### # identified advertsing network: 1,038 #################################### # with country data: 6,141 #################################### # with language data: 9,095 ####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 112
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 114
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 121
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 123
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 129
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 131
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 138
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 140
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 146
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 148
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 154
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 156
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 161
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 163
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 169
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 171
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 177
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 179
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 185
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 187

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 193
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 195

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 201
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 203
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 209
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 211

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 217
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 219

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 225
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 227

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 232
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 234
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 240
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 242
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 248
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 250

Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 255
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 257
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 264
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 266
####################################
Warning: mysql_query(): supplied argument is not a valid MySQL-Link resource in /home/yvoschaa/public_html/webanalyse/index.php on line 272
Access denied for user 'directly_admin'@'localhost' (using password: YES)
Warning: mysql_fetch_array(): supplied argument is not a valid MySQL result resource in /home/yvoschaa/public_html/webanalyse/index.php on line 274

I don't represent any of the listed websites, nor any of the advertising networks.

Stylesheets found by: "<style" || "rel=stylesheet"
RSS found by: "application/rss+xml" || "rss.xml"
Advertising networks found by adcode characteristics. Some websites have specialised adverting network code, thus excluded.
Homepage is the "/" page or the first follow (some redirect to another).