Googlebot

Discussion in 'Google' started by wil888, Aug 23, 2007.

0
  1. #1
    I have a sitemap link in the main page of my site but I dont want to submit it.

    Will Googlebot crawt my site if I dont submit a sitemap?
     
    wil888, Aug 23, 2007 IP
  2. Malok

    Malok Peon

    Messages:
    272
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Possibly. Sitemaps just make it easier to find stuff - doesn't mean that it won't find it.
     
    Malok, Aug 23, 2007 IP
  3. ErectADirectory

    ErectADirectory Guest

    Messages:
    656
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yes they will. For them to exclude it just exclude it in robots.txt

    All bots won't respect that but Googlebot will.
     
    ErectADirectory, Aug 23, 2007 IP
  4. zangief

    zangief Well-Known Member

    Messages:
    1,722
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    155
    #4
    You can also submit it from the robots.txt , google ,yahoo,msn made standarts for it.
    You can add
    Sitemap: <sitemap_location> in your robots.txt
     
    zangief, Aug 23, 2007 IP
  5. mhmdkhamis

    mhmdkhamis Well-Known Member

    Messages:
    1,097
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    145
    #5
    yes will do if you have more BL will crawl so good
     
    mhmdkhamis, Aug 23, 2007 IP
  6. Tipem

    Tipem Active Member

    Messages:
    93
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #6
    if you have some type of good linkbase your site should be crawled within a few days.
     
    Tipem, Aug 23, 2007 IP
  7. wil888

    wil888 Peon

    Messages:
    178
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    why in a few days. Not everyday? for the whole site?
     
    wil888, Aug 23, 2007 IP
  8. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #8
    you can add it your robots.txt file.

    sitemap:your-sitemap-file-url


    and one more question;

    why dont you want to submit your sitemap to google webmaster tools?
     
    trichnosis, Aug 23, 2007 IP
  9. Tearabite

    Tearabite Prominent Member

    Messages:
    4,629
    Likes Received:
    429
    Best Answers:
    0
    Trophy Points:
    300
    #9
    The frequency and depth of your Google-crawls depends on many factors such as age of the site, number of incoming links, PR, phase of the moon, and the mood of the GoogleBot.

    Basically, if your site is new, it wont get crawled very often..
     
    Tearabite, Aug 23, 2007 IP
  10. four27pm

    four27pm Banned

    Messages:
    408
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #10
    you should submit that, before sitemap help me out of supplemental results...
     
    four27pm, Aug 23, 2007 IP
  11. Jim4767

    Jim4767 Prominent Member

    Messages:
    4,738
    Likes Received:
    766
    Best Answers:
    10
    Trophy Points:
    305
    #11
    I suspect that the OP is talking about his .html sitemap when he speaks of having a link to it from his home page. I can't think of any reason not to allow Google to crawl that. And of course he should submit an .xml sitemap to Google Webmaster Tools (and also to Yahoo! Site Explorer).
     
    Jim4767, Aug 23, 2007 IP