WMW gone from Google http://www.google.com/search?hl=en&lr=&q=webmasterworld.com http://www.google.com/search?q=site:webmasterworld.com Nothing there not even home page see the story http://blog.searchenginewatch.com/blog/051123-093904
wow thats quite a bold move. It would worry me that the forums would die down though as no new people would be comming through the engines. Still - it takes guts to ban all the engines from your site.
I'm sure they must know what they are doing, but the good I see it in it for them doesn't outweigh the bad. I'm (personally) too stupid to see the overall good in it I guess.
I found WMW via search engine results, and probably wouldn't have known about it otherwise. I consider myself web savvy, but sometimes I just miss out on websites, no matter how popular they are. Brett set the WMW robots.txt to disallow all robots. Read the link pachecus posted.
its there a way to just block most "rogue spiders" it seems sort of extreme and won't most "rogue spiders" ingnore the robots I have site rippers and email havesters that don't give a shit about robots.txt
Of course you could... One way would be to require a certain cookie that's generated with an md5 hashing function in JavaScript. Then if the spider doesn't do JavaScript and cookies, you could just block them. Would of course block some users that don't have cookies and JavaScript enabled, but that solution seems better to me. {shrug}
No loss.. Im not a fan of that site anyway. Anyone that wants to go there will have it bookmarked. I dont really see how it will affect them.
Because Brett Tabke wanted to be banned!!!!! Well, that didn't take long. I wrote on Monday about how WebmasterWorld head Brett Tabke decided to ban all search spiders including those from the major search engines in an effort to combat bandwidth loss and server sluggishness due to rogue spiders. Brett figured he had about 60 days until he'd see pages get dropped. It took two. I say they get listed again causing the site to get slow as a slug and then every one from WMW comes here!! er, didn't they just 'upgrade' the servers!!!!
If anybody checked WMW They would see <META NAME="GOOGLEBOT" CONTENT="NOARCHIVE"> <META NAME="ROBOTS" CONTENT="NOARCHIVE"> I still dont get this move really.
blog says it all to me. The reasoning is flawed, but at least a site is finally removed from google by choice. Seeing as how WMW is so close to google, I bet there was a little manual removal there, just to speed up this experiment - which I assume it is.
copy this code to a local html file.. the yahoo search still works for WW <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <html> <head> <title> Untitled </title> </head> <body> <table> <tr> <td> <form action=http://www.google.com/search target=_blank> <input TYPE="text" name="q"> <input type="submit" value="Google"> <input type="hidden" name="sitesearch" value="webmasterworld.com"> </form> </td> <td> <form action=http://search.yahoo.com/search target=_blank> <input TYPE="text" name="p"> <input type="submit" value="Yahoo"> <input type="hidden" name="vs" value="webmasterworld.com"> </form> </td> <td> <form action=http://search.msn.com/results.aspx target=_blank> <input TYPE="text" name="q"> <input type="submit" value="MSN"> <input type="hidden" name="q1" value="site:webmasterworld.com"> </form> </td> </tr> </table> </body> </html> -RonMo
Came across an interesting thread at WebMaster World. They are taking some extra-ordinary measures to try and reduce the number of rogue bots that are accessing their site. They are going to eliminate all robots from accessing the site completely. Apparently while at PubCon they had 12,000,000 pageviews attributable to Rogue Bots. This means none of the search engines will have their site or pages indexed. The question I pose is how many of you feel this is a problem for some or all of your sites? Are you seeing a substantial number of activity from bots that provide no real benefit and generate no real traffic? If so, what is your strategy for dealing with it? The WMW thread is here: http://www.webmasterworld.com/forum9/9593.htm
Well, I'm not sure how to monitor bots completely, but from my AWstats, I only have about 6 different bots visit my site.
WMW is completely out of google now. http://www.google.com/search?num=10...c2coff=1&q=www.webmasterworld.com&btnG=Search