Question about Google Webcrawl and Not found URL's

Discussion in 'Google' started by webmaster_TSU, Dec 13, 2007.

0
  1. #1
    I was looking at my webmaster tools, and the web crawl is showing 6 "Not found" URL's. I don't think there are links to these not found pages anymore, and my question is, how do I remove those URL's from that list? How do I fix the problem, basically. Do I have to update the robots.txt or anything?
     
    webmaster_TSU, Dec 13, 2007 IP
  2. leo

    leo Peon

    Messages:
    174
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Same for my website. The number of these "URLs not found" is changing from time to time, and so do the URLs themselves.

    But only very few of them correspond to old, i.e. previously used addresses - most of them are URLs that NEVER EXISTED. This means, it is impoosible that there might be links referring to them somewhere in the WWW. This is the strangest aspect of that observation.

    Comments on that would be welcome.

    Rgds
     
    leo, Dec 13, 2007 IP
  3. SeoSmarty

    SeoSmarty Banned

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I suggest that you wait a little bit. It will update data and remove the error within a week or two.
     
    SeoSmarty, Dec 13, 2007 IP
  4. leo

    leo Peon

    Messages:
    174
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Sorry to disappoint you: It updates data regularly, it does exchange some of the URLs, but replaces them by others which are equally unreal - and that's lasting already for months.
    Rgds
     
    leo, Dec 13, 2007 IP
  5. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #5
    This happened because of one of the following....

    A) You have a backlink pointing to an incorrect URL.

    B) You have a script of some short dumping a URL that doesn't exist and is getting pulled by the crawler bot.

    C) Some of your URLs are getting cut short because of dynamic url paths.

    D) Your site wasn't accessible at the time this happened.
     
    astup1didiot, Dec 13, 2007 IP
  6. webmaster_TSU

    webmaster_TSU Peon

    Messages:
    449
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Ok, so once Google crawls the page again, these URL's will be removed then, supposing I really don't have any links pointing to them, right?
     
    webmaster_TSU, Dec 13, 2007 IP
  7. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #7
    In theory, unless it can't attempt to crawl them again, in that case they can remain there for quite awhile, if they are not used URLs you can use the below method to get them removed....

    1. Login to your Google Webmasters Account...
    2. Select the site in question...
    3. Click Tools Tab on the left.
    4. Click Remove URLs hyperlink
    5. Follow the directions

    This should remove them, but in theory it doesn't matter one way or another, you could just wait it out or ignore it all together :)
     
    astup1didiot, Dec 13, 2007 IP
  8. webmaster_TSU

    webmaster_TSU Peon

    Messages:
    449
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Ok, thank you. Maybe it doesn't matter in reality, but I hate seeing those errors there, it's like...I don't like it not being "perfect" according to the Google crawl...and that bothers me for some reason.
     
    webmaster_TSU, Dec 13, 2007 IP