1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Idea for robots.txt selective restrictions [done easy]

Discussion in 'robots.txt' started by iGeekSoftware, Jun 14, 2012.

0
  1. #1
    If you know a little php programming and .htaccess routing you can make a simple php script that handles the robots.txt contents according to your own rules: Time of day, IP address, etc...

    Just a thought, i thought it might interest someone.
     
    iGeekSoftware, Jun 14, 2012 IP
  2. atxsurf

    atxsurf Peon

    Messages:
    2,394
    Likes Received:
    21
    Best Answers:
    1
    Trophy Points:
    0
    #2
    the problem that the bots check the robots file only so often, not like every hour to see if you changed it
    so your idea may either don't work or backfire when google bot would check your robots file during certain times of the day and it would always tell it "don't crawl"
     
    atxsurf, Jul 3, 2012 IP