"Googlebot can't access your site" need help to resolve this message

Discussion in 'Google Analytics' started by sunilrana307, Oct 8, 2012.

  1. #1
    During last week i find "Google-bot can't access your site" message in my site's webmaster A/C. And i also found some 404 errors. i quickly resolved this error and also site fetched as Google. But this message again showing in my site. What i do after? Thanks in advance if anyone have valuable suggestion.
     
    sunilrana307, Oct 8, 2012 IP
  2. thanapa

    thanapa Well-Known Member

    Messages:
    527
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    125
    #2
    Best way to test this is add a new blog post or a page and check it is cached or not. If it is cached then don't worry. Please make sure to check your robots.txt and htaccess file also.
     
    thanapa, Oct 10, 2012 IP
  3. sunilrana307

    sunilrana307 Greenhorn

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #3
    Thanks Thanapa, i added a page as you suggested its more than twenty days but not cache by Google. And when i contact sites host company they asked, "restrict Google-Bot to come site so often" but how ? i don't know any suggestion.
     
    sunilrana307, Oct 14, 2012 IP
  4. seo-first

    seo-first Member

    Messages:
    309
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    33
    #4
    I am not sure what does this mean - "restrict Google-Bot to come site so often" and why he asked you the same.

    What you should check-
    1) Robots.txt
    See if your robots.txt file is blocking google bot to crawl your website

    if it is something like this
    User-agent: *
    Disallow: /

    Than change it to

    User-agent: *
    Disallow:

    This will allow all bots to crawl your website.

    If your robots.txt file is perfectly fine, then kindly share your website url.

    Thank you :)
     
    seo-first, Oct 15, 2012 IP
  5. kroyal

    kroyal Active Member

    Messages:
    54
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    61
    #5
    "What you should check-
    1) Robots.txt
    See if your robots.txt file is blocking google bot to crawl your website

    if it is something like this
    User-agent: *
    Disallow: /

    Than change it to

    User-agent: *
    Disallow:

    This will allow all bots to crawl your website.

    If your robots.txt file is perfectly fine, then kindly share your website url.

    Thank you :)"

    This is right you should check your robot.txt
     
    kroyal, Oct 15, 2012 IP
  6. pyanari

    pyanari Active Member

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    58
    #6
    type in message to google support
     
    pyanari, Nov 12, 2012 IP
  7. Saif Rizvi

    Saif Rizvi Member

    Messages:
    143
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    46
    #7

    Well this is the best technique to check why google bot is not accesiing your pages, might be possible you have submitted anty url or anyelse web page in robots.txt so that google bot is not accesing your web page.

    One more thing you can do is that just make a test page in blogs , pages or post and try to index it through google. If google indexes the web page then it is sure that there is error in making of robots.txt file.
     
    Saif Rizvi, Nov 14, 2012 IP
  8. rk7734

    rk7734 Peon

    Messages:
    44
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    check robot.txt file
     
    rk7734, Nov 16, 2012 IP
  9. sunilrana307

    sunilrana307 Greenhorn

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #9
    Hi all Thanks! For valuable suggestion.
    my robots file is OK. I just change in site's XML map <url><loc>website/</loc><changefreq>weekly</changefreq></url><url> it help me to resolve this issue.

    Thanks
     
    sunilrana307, Nov 23, 2012 IP