help google is crawling a cache of my site...

Discussion in 'Google' started by fallen1, Apr 4, 2008.

  1. #1
    my site shows 100+ not found web crawl errors basing from the google webmasters tool...

    when i checked it all of it was from the previous content site, that was deleted...google is crawling the cache of the site i think...

    i tried blocking the folder that existed before that google was crawling through robots.txt...but it is still crawling it when i checked it...

    please help...thanks
     
    fallen1, Apr 4, 2008 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    You need to remove the old pages from Google's index, since they were indexed prior to your robots.txt changes GoogleBot will still attempt to crawl them. Just use the "Remove URLs" in the tools section of Google Webmasters Central.
     
    astup1didiot, Apr 4, 2008 IP
  3. cellfanatic

    cellfanatic Peon

    Messages:
    18
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    So were you successful in removing the urls inside the webmaster tools on google?
     
    cellfanatic, Apr 4, 2008 IP
  4. fallen1

    fallen1 Peon

    Messages:
    857
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #4
    thanks...

    it is still pending...i chose the directory removal, because it is were most of the errors are...and will remove others next if the results are good...

    will keep you guys updated....

    thank you once again...:D
     
    fallen1, Apr 4, 2008 IP
  5. fallen1

    fallen1 Peon

    Messages:
    857
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #5
    i removed the whole directory, but so far its still the same finding the errors...

    the robots.txt restricted only three of the errors in the directory by disallowing the whole directory...

    is there another option?...do i have to re-include site?...but its ranking really quite well and not too confident in doing something that drastic...

    thanks...
     
    fallen1, Apr 6, 2008 IP