Sitemap + Spider

Discussion in 'Search Engine Optimization' started by mdrobiul, Jan 26, 2009.

  1. #1
    Please tell me: Some pages of my site are not listed in sitemap file. Which is of following sentence is correct:

    1. Google will surely find those pages if they are not disallowed by robots
    2. Google will find those pages but this is optional to google
     
    mdrobiul, Jan 26, 2009 IP
  2. MarbleHost.com

    MarbleHost.com Well-Known Member Affiliate Manager

    Messages:
    634
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    155
    #2
    3. Google will find those pages if they are linked from at least one another page AND the link is not with nofollow attribute AND they are not disallowed by robots.txt. :)
     
    MarbleHost.com, Jan 26, 2009 IP
  3. Max1m

    Max1m Well-Known Member

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    101
    #3
    Use Google Webmaster Tools, it will help you find problems with your robots.txt, sitemap, etc. Look at the information about robots.txt in google help.
     
    Max1m, Jan 26, 2009 IP
  4. SizTec.com

    SizTec.com Banned

    Messages:
    211
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes! I agree with MarbleHost.com! :)
     
    SizTec.com, Jan 26, 2009 IP