Indexing traffic in under 4hr
Here is all the bot/indexer/scanners for the first 4 hrs of today from just one webserver: 13639 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) << Way too high for less then 4 hours of logging 656 Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org) << Way too high for less then 4 hours of logging 305 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 270 [...]