Google says i have 22 web crawl errors!

Discussion in 'Google' started by BiafranMan, Aug 11, 2008.

  1. #1
    "URLs restricted by robots.txt >> 22!"

    i dont have a robots.txt, i never made one!

    but i did notice in my index.php source code 3 days ago:

    <meta name='robots' content='noindex,nofollow' />
    Code (markup):
    i looked through my wordpress settings the next day and i had "I would like to block search engines, but allow normal visitors" check under setting>privacy

    i changed that immediately to "I would like my blog to be visible to everyone, including search engines (like Google, Sphere, Technorati) and archivers"

    after doing all that i found the webmaster tool and signed up and its say 22 urls restricted by robots. y does it say that even though i made it unprivate, and dont have a robots.txt anywhere?

    is it just that google hasnt recrawled the urls since i made it unprivate??? how do i tell/update google that those urls arent restricted anymore???when will google do this?
     
    BiafranMan, Aug 11, 2008 IP
  2. jellybeanz

    jellybeanz Peon

    Messages:
    359
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I think this is the likely reason.
     
    jellybeanz, Aug 11, 2008 IP
  3. fr@nc!z

    fr@nc!z Active Member

    Messages:
    1,545
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    80
    #3
    Wait for Google to RE-CRAWL your blog. ;)
     
    fr@nc!z, Aug 11, 2008 IP
  4. mcaronan

    mcaronan Peon

    Messages:
    441
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yep... Wait till spiders crawled your site. :eek:
     
    mcaronan, Aug 11, 2008 IP
  5. webcosmo

    webcosmo Notable Member

    Messages:
    5,840
    Likes Received:
    153
    Best Answers:
    2
    Trophy Points:
    255
    #5
    Submit your site to some high traffic sites like the popular social networking site. Generally that accelerates the crawling process.
     
    webcosmo, Aug 11, 2008 IP
  6. canam

    canam Peon

    Messages:
    475
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #6
    yep, give it some time, googlebot will be back, but it might take a little while because you basically told them to get lost at first
     
    canam, Aug 11, 2008 IP
  7. WishBone

    WishBone Peon

    Messages:
    2,566
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Pinging your blog and refreshing your sitemap could help.
     
    WishBone, Aug 11, 2008 IP
  8. zodiac

    zodiac Peon

    Messages:
    2,661
    Likes Received:
    82
    Best Answers:
    0
    Trophy Points:
    0
    #8
    i don't know if it will help,but it won't hurt.

    google bot goes to every page that has a link to it,even if there is a nofollow.
    once it's on there, it checks on site for nofollow/noindex.

    if your pages or site got deindexed,don't worry, google will see that it is doindex now and you'll get indexed.
    if you have backlinks,there is no need to tell google,they will know,but pinging might speed it up.
     
    zodiac, Aug 11, 2008 IP
  9. Jojosung

    Jojosung Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Yes!. Wait for Google to RE-CRAWL your Blog Site :)
     
    Jojosung, Aug 11, 2008 IP
  10. Jeremy Morgan

    Jeremy Morgan Peon

    Messages:
    322
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #10
    have you submitted an up to date sitemap? If so, don't sweat it, it will be recrawled and indexed soon.
     
    Jeremy Morgan, Aug 11, 2008 IP
  11. StrongMinder

    StrongMinder Banned

    Messages:
    223
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #11
    It wont hurt your SERP
     
    StrongMinder, Aug 11, 2008 IP
  12. BiafranMan

    BiafranMan Peon

    Messages:
    119
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    ok, thanks guys!
     
    BiafranMan, Aug 12, 2008 IP
  13. denharsh

    denharsh Peon

    Messages:
    167
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Drop Your blog link will have a look
     
    denharsh, Mar 1, 2009 IP