1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

XML sitemap and google webmaster tools

Discussion in 'Google Sitemaps' started by maso, Dec 3, 2010.

  1. #1
    Hello DPer's,

    I am having problem with my sitemap and google webmaster tools. I just having more and more crawl errors like 404 not found and robot.txt unreachable.

    does this thing is a problem?

    Check this image

    [​IMG]

    please help..

    I am confuse because it shows many URL's that is not existing. and I have no URLs like what it showing.
    SEMrush
     
    maso, Dec 3, 2010 IP
    SEMrush
  2. gocondo

    gocondo Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I have a similar problem. My domain used to be a Google blogger, and when I changed it to my own PHP code, Google still had the old blogger pages in the index. Until now I have 404 pages in my google webmaster about missing pages from the old blogger website which don't exist anymore. Here's what I tried but the problem was not solved:
    1. You can request to delete a page form the google index using your webmaster account. It's under the sitemap option.
    2. I added exclude to these old non-existing pages to my robots file.
    3. From the google webmaster you have an option to send a special request to google. I did it and they replied that they will reindex my site, but it never happended.
     
    gocondo, Dec 3, 2010 IP
  3. IronAddict

    IronAddict Active Member

    Messages:
    108
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    58
    #3
    Easiest way to fix this is to create redirect 301's in your htaccess. I do it when people link to my stuff but spell things wrong and things like that. What to keep Google happy and a lot of errors looks messy.
     
    IronAddict, Dec 3, 2010 IP
  4. googleseotool

    googleseotool Peon

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    301 redirect works nice only if your new site has the same page but with different URL. Google penalizes for using 301 instead of 404, for example for redirect from page that does not exists any more to main page of the site.

    So it's better to have 404 pages than not correct 301 redirects.
     
    googleseotool, Dec 10, 2010 IP
  5. IronAddict

    IronAddict Active Member

    Messages:
    108
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    58
    #5
    Interesting, I have never heard that. Can you do a 404 in the htaccess as well? If so what is the syntax?
     
    IronAddict, Dec 10, 2010 IP
  6. tedeu

    tedeu Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I had a site that was selling icons, and i used v3 of cubecart ...
    I bought another domain, and build another site with cubecart4...
    I used the 301 redirect and the site was not the same, but was all ok.
    So in my oppinion, that isn't your problem.
     
    tedeu, Dec 10, 2010 IP
  7. Kiranraj

    Kiranraj Peon

    Messages:
    1,582
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Update your XML sitemap & resubmit it in Google webmaster tool. It takes some time to deleted non-exist url's from the database
     
    Kiranraj, Dec 21, 2010 IP
  8. AyersDebbie

    AyersDebbie Peon

    Messages:
    55
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    you can try it by making your site map page in html as i know html site maps are too good so you should try your html site map have to clean html
     
    AyersDebbie, Dec 22, 2010 IP
  9. picachu

    picachu Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    html sitemap is not xml. you can not add html site map in webmaster account.
     
    picachu, Dec 27, 2010 IP
  10. harry009

    harry009 Active Member

    Messages:
    93
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    73
    #10
    .html or xml sitemap both are different sitemap one ....html sitemap for human and .xml for bots ..
     
    harry009, Dec 27, 2010 IP
  11. picachu

    picachu Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    html sitemap helps bots to find most pages, it is not only for humans
     
    picachu, Dec 28, 2010 IP
  12. Nosheen haroon

    Nosheen haroon Peon

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    how to remove unreachable error in webmaster?
     
    Nosheen haroon, Dec 30, 2010 IP
  13. wesley gibson

    wesley gibson Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    i think harry is right, xml site map is for google bot and html is for human being. google spider robots only reads xml site map, and html site map helps human for know about the structure of the website.
     
    wesley gibson, Dec 31, 2010 IP
  14. picachu

    picachu Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    I agree, html sitemap is for human in general. But googlebot also finds html sitemap, that contains links to all pages of your site. I think it also helps in indexing of site
     
    picachu, Jan 1, 2011 IP
  15. jim8688

    jim8688 Peon

    Messages:
    89
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Thanks sharing information about site map right now that the problem ..I have idea your share info
     
    jim8688, Jan 3, 2011 IP
  16. axxwe

    axxwe Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Hi! I take my site map from a generator.More actually.I uploaded the sitemap.xml on server and i submited on google toolmaster.
    Paths don't match. its the error.
    Soem suggestions?
    Thanks
     
    axxwe, Jan 7, 2011 IP
  17. Keppy

    Keppy Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #17
    ErrorDocument 404 your404page.html
     
    Keppy, Jan 7, 2011 IP
  18. zlori

    zlori Peon

    Messages:
    147
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Yes, if the links do not match from the generated sitemap, remove it asap! What is the exact error?
     
    zlori, Jan 21, 2011 IP
  19. zlori

    zlori Peon

    Messages:
    147
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Usually that reflects the fact that the server hosting your site / domain was unreachable and not the page so you cannot do anything about it.
    If you see many of these messages and pretty often, then you should think about changing your hosting company.

    It still can happen that you have some tricky tech team and their code takes that much to load that Google detects the page as unreachable (much less probable).
     
    zlori, Jan 21, 2011 IP
  20. zlori

    zlori Peon

    Messages:
    147
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Does it? Any further info on this?
     
    zlori, Jan 21, 2011 IP