Googlebot only crawling sitemap sites?

Discussion in 'Google' started by paxuh, Aug 7, 2008.

  1. #1
    I wonder if googlebot only crawl sites that are representet in sitemap.xml, or does it also crawl and index sites which are not included in the sitemap file?
     
    paxuh, Aug 7, 2008 IP
  2. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #2
    Adding a sitemap is good, but google also crawls sites without sitemaps.
     
    angilina, Aug 7, 2008 IP
    bobwrit likes this.
  3. paxuh

    paxuh Member

    Messages:
    68
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #3
    Ok, it's good to have that cleared up.

    Thanks for the answer, angilina.
     
    paxuh, Aug 7, 2008 IP
  4. ambrish@synapse

    ambrish@synapse Guest

    Messages:
    35
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I did not get the question and its answer also, please explain it..
     
    ambrish@synapse, Aug 9, 2008 IP
  5. Robbie Foster

    Robbie Foster Banned

    Messages:
    517
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Can anyone guide me how can I add a sitemap to my site? I tried that doing earlier but had a hard luck. Any help?
     
    Robbie Foster, Aug 9, 2008 IP
  6. tattoos

    tattoos Prominent Member

    Messages:
    1,903
    Likes Received:
    150
    Best Answers:
    0
    Trophy Points:
    335
    #6
    Q: Will Google Bot crawl and index a website that does not have a sitemap?

    A: Yes

    :D

    Cheers
    James
     
    tattoos, Aug 9, 2008 IP
  7. tattoos

    tattoos Prominent Member

    Messages:
    1,903
    Likes Received:
    150
    Best Answers:
    0
    Trophy Points:
    335
    #7
    You can make a txt site map in notepad, one URL per line.. then upload it to the root of your directory.

    If you want a .xml sitemap, then there are sites that do it (not sure of the addys) but I have been using GsiteCrawler.
    It works well.

    Cheers
    James
     
    tattoos, Aug 9, 2008 IP
  8. Lisha Christy

    Lisha Christy Banned

    Messages:
    64
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #8
    It will crawl in both cases.
    But the site with sitemaps have more chance.
     
    Lisha Christy, Aug 9, 2008 IP
  9. dpking

    dpking Peon

    Messages:
    1,021
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #9
    It will crawl both ways !!
     
    dpking, Aug 9, 2008 IP
  10. openid

    openid Peon

    Messages:
    51
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #10
    It will crawl in both cases. Sitemap helps in indexing your site better.
     
    openid, Aug 9, 2008 IP
  11. searchmaster

    searchmaster Active Member

    Messages:
    231
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    88
    #11
    It will pick the pages and pages within pages till he find one....

    sitemap helps webmasters, and site navigators and Google wants to help its readers...
     
    searchmaster, Aug 9, 2008 IP
  12. miranon

    miranon Peon

    Messages:
    209
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #12
    I have a sitemap with 200 links, google indexed only 50.
     
    miranon, Aug 11, 2008 IP
  13. dangerouslydead

    dangerouslydead Peon

    Messages:
    39
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Miranon has a point here that puzzles me too. I have submitted my sitemap and I have all the pages corss indexded nicely and still only a handful of pages appear on the search. Why?
     
    dangerouslydead, Aug 11, 2008 IP
  14. Smyrna

    Smyrna Peon

    Messages:
    133
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Google loves sitemaps so have one! and register it via webmaster tools
     
    Smyrna, Aug 11, 2008 IP