1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Robots help - The Tax Club

Discussion in 'robots.txt' started by thetaxclub, Dec 6, 2006.

  1. #1
    Hello Everyone

    I work for The Tax Club and I have a question I beleieve this is the right place for me to ask:

    Is there a limit to the length of a robots.txt file that Google will accept?

    We are trying to reconstruct a part of our site...

    Thank you in advance,

    Best Regards

    The Tax Club
     
    thetaxclub, Dec 6, 2006 IP
  2. Sketch5646

    Sketch5646 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    thanks for asking this question
     
    Sketch5646, Sep 28, 2010 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    It seems that Crawlers can read upto 5000 characters in robots.txt. I found this information on several blogs and forums but not sure if Google ever declared this :)
     
    manish.chauhan, Oct 6, 2010 IP