Whats up with aviva directory and www.sex.com

This is quite strange. Click here and see http://www.google.com/search?q=site...=&rls=GGIC,GGIC:2006-20,GGIC:en&start=50&sa=N. Does this mean the Google bot searched for www.sex.com on this directory? Perv BOT!!!!

 

That is odd. 14,600 results, all with sex.com. Maybe it's some kind of new directory spamming/hacking technique, or, like you said, a perverted bot.

 

This only means that someone did a search a the aviva directory for the url sex.com. Google does crawl and spider search result pages. It is a old black hat trick that some people use to try and get links from .gov and .edu sites.

 

Interesting.

Should one disallow searches in their robots.txt?

http://www.google.com/search?q=site:avivadirectory.com

 

Yes I think that would help.

 

lol @ perverted bot

 

Well they did get quite a bit of backlinks huh?

 

Currently almost all the pages are shown as supplemental pages

 

I think is a problem with the previous directory there and after all this time Google still caches the old pages really perverted Google.

 

Google is on crack as always!!
Once i saw lots of Japanese/koreans related pages for one of my site and huh?? Then a week later it disappeared!! Googlebot must be male

 

It can be done to any site with a search feature that uses _GET....

I guess ill have to change it on my site to POST

 

! Ask ! is right about this one. Aviva originally used the old biz directory script. If you did a search on that script, it could produce pages like that.

For some reason Google has cached those pages even though they don't exist. Many of the old pages of the directory prior to the conversion to phpLD are still cached and listed as supplemental results.

I've talked to many people about getting rid of this, but no one seems to know how. If you have any suggestions, please PM me.

Aviva is still well indexed. You can check any of the pages to confirm this. The problem is just that with the site: command you need to wade through hundreds of supplemental results of pages that don't exist.

IMHO, Google is purposefully making the site: command useless by doing this sort of thing. There have been discussions about the site: command pulling up pages from other websites and also not showing accurate counts for number of pages. Loading the results with supplemental pages that don't exist is another way of making the command useless.

 

Hehehe c'mon onlinedude fess up!

You like it cos it confirms that your directory is really really sexy!

 

hahaha.. either that or Jeff got caught being a 'naughty naughty' boy this year!!!

 

it's not a perv bot, someone (probably intetionally) just linked to those search results

 

sometimes, those old cached pages might take months to get removed.