Google Proxy Cache Hack..any reasonable Solutions?

Discussion in 'Google' started by Slincon, Oct 26, 2007.

  1. #1
    Well by now everyone is aware of the Proxy Cache hack, and of course their's the only apparent solution. But the solution, which is linked to by everyone who discusses the issue, is far from practical - it requires have an additional sql table to track proxy ips, and curl to constantly access and update these ip lists. I have a site which is flat file and thus doesn't use database (and I did that intentionally), so I'm wondering if anyone knows a non-SQL way to solve the problem.

    Basically I'm trying to avoid using an SQL table and avoid using Curl/FSockOpen, etc. I mean it should be pretty simple, just detect google's ip addresses and then remove the no-index tag.. The solution at seoegghead seems to be using an sql databse and intended for wordpress blogs (I think).
     
    Slincon, Oct 26, 2007 IP
  2. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #2
    One very simple approach is to set up Google Alerts with the command:

    intitle:”site name” inurl:”cgi”

    When Google picks up the proxy scraping your page, you will be notified then you can just block their IP.

    The other way is instead of having a database and logging bad IP's, create a list of good IP's and via an IP detect serve the noindex/nofollow tag to everything not on the list.

    This can be done just via a PHP script.
     
    sweetfunny, Oct 26, 2007 IP
  3. iMarketingGuru

    iMarketingGuru Well-Known Member

    Messages:
    486
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    160
    #3
    There's a great script for proxy hacking - I believe the best was posted in syndk8.net - Check it out. I'll try to post the URL when I get a chance
     
    iMarketingGuru, Oct 26, 2007 IP
  4. Slincon

    Slincon Well-Known Member

    Messages:
    1,320
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    180
    #4
    couldn't find the script?

    anyone have a list of reputable google ips, I could probably piece it together myself I guess..but I'm hoping there's a really easy way to detect googlebot.
     
    Slincon, Oct 27, 2007 IP
  5. Slincon

    Slincon Well-Known Member

    Messages:
    1,320
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    180
    #5
    So I set this up http://www.seotest.uni.cc/googlebot-detect.php - now it's just a matter of getting it spidered.

    All I'm doing is checking if it's Googlebot, if it is don't show the nofollow meta tags - otherwise show it to everyone. I wanted the simplest way to do this so that it doesn't eat up resources (which the SEOEggHead script does badly). I'm just checking the useragent - it doesn't matter if someone spoofs this or not because in most cases the proxy isn't going to do that.

    Here's the source for it if anyone's interested, it's very simple:
    <?
    if(!stristr($_SERVER['HTTP_USER_AGENT'],'googlebot')) { 
    echo '<meta name="robots" content="noindex,nofollow" />';
    }
    ?>
    Code (markup):
    The flaws inherent here are the fact that both scripts rely on meta tags, and these web proxies can remove meta tags making both solutions practically pointless. There's no real way except to IP ban each offending address, and send a 404 header - which I'm testing right now (i'll post the code later if anyone's interested).
     
    Slincon, Oct 30, 2007 IP