googlebot visits every day but...

Discussion in 'Site & Server Administration' started by breacher, Jul 6, 2005.

0
  1. #1
    ... only downloads and indexes the main page. Why? Has anyone else had this happen to them?
     
    breacher, Jul 6, 2005 IP
  2. iskandar

    iskandar Well-Known Member

    Messages:
    897
    Likes Received:
    83
    Best Answers:
    0
    Trophy Points:
    148
    #2
    Do you have robots.txt file? If you don't have it, create one. It helps a lot for me. AFTER you've created one, then submit your sitemap.
     
    iskandar, Jul 6, 2005 IP
  3. NewComputer

    NewComputer Well-Known Member

    Messages:
    2,021
    Likes Received:
    68
    Best Answers:
    0
    Trophy Points:
    188
    #3
    I would be wary of the sitemap idea... There is a lot of information floating around out there, some of it is really negative and if true, would not be wise to submit.
     
    NewComputer, Jul 6, 2005 IP
  4. breacher

    breacher Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I have one but it's empty.. am I supposed to put something in it?
     
    breacher, Jul 6, 2005 IP
  5. ServerUnion

    ServerUnion Peon

    Messages:
    3,611
    Likes Received:
    296
    Best Answers:
    0
    Trophy Points:
    0
    #5
    If you want the bots to have full access to all linked pages, keep the robots.txt file empty.

    These things just take time. Concentrate on optimizing your content and gaining links, the rest is just waiting. Good luck
     
    ServerUnion, Jul 6, 2005 IP