Google Stopped Crawling Custom Domains based on Blogpost

Check your cache date and you will know, It's also 30 July, same as everyone reporting.

and check for any of your page indexed after 1 Aug.

Today is 8 Aug and you made a post on 5 Aug

3 Column Vector Blogger Template 'Butterfly' - Download

Check if it's there in Google in any page. No it's not there even with your site name.


Also check for Googlebot in your logs, not normal Google visit.

 

yea right. Hope google solve this issue soon.

 

Everyone just check their robots.txt file. I just checked and here it is-

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

Sitemap: http://www.dailytechnologytips.com/feeds/posts/default?orderby=updated

WTF is this. Blogger generate the robots.txt file and it's changed how?

 

Check your robots.txt file

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

Sitemap: http://bloggertricks.com/feeds/posts/default?orderby=updated

 

I use Statcounter as well and there is no way that I know of to tell if Googlebot is crawling your site using this one counter system. The visits you use to see from Google were more than likely from Google employees that were surfing the Internet while using a Google IP address at work. Using RAW log data is the only way I know of to track Googlebot visits and separate them out from Google employees surfing the Internet at work either through leasure or to manual check a site out. RAW log data is not available through Blogger, but if you are hosting a blog on your own domain name - many Internet Service providers offer access to RAW log files and there are dozens of free software programs available for download to translate those RAW data files into useable information. Just remember that like all other big companies, Google employees also have access to the Internet at work and when they visit your site it will show a visit from Google which is not the same as Googlebot.

 

So what do we do to fix the problem?

 

Please check your Google webmaster the option to analyze your robot.txt file.

I can see blank text area with no contents.

 

huh? ill see what i can do,
did you fix the issue on your blog?

 

Information from my Robots

robots.txt URL http://www.amanzblog.com/robots.txt
Last downloaded 8 hours ago
Status 200 (Success) Help Help

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

Sitemap: http://www.amanzblog.com/feeds/posts/default?orderby=updated

 

URL RESULTS

Google Bot - Allowed
Ad Bot Goolge - Allowed

 

I don't know how to do the robots.txt thing but this might be the thing that gets me to switch to wordpress! That's a shame because I'd just gotten my blog to look really nice in blogspot and I'd spent so much time with it!

Someone PM me with a solution if one pops up and if it works I'll give you a rep.

 

no its someone using google accelerator or mobile access via google, its not a google crawler address.

 

It's too bad to know that there is no help and no answer from any Google employee on the thread i created in webmaster Group. We are using their service, if there is any problem, then they should tell us. Seriously hate Blogger now. Will move to wordpress very very soon.

 

Forsure Sunil. This is ridiculous. We paid money for our domains and we've worked hard to get our blogs looking nice. To have to switch to Wordpress (which is completely different. i've dabbled w/ wordpress before) That'd just be devastating.

Not to mention the fact that we'd have to start paying for hosting.

 

Could it have to do with all the "outages" blogger has been having lately?

 

I never expected such a service with company like Google, but on the other day, they are being harsh. If you are having a problem accessing my site, then let me know the problem in webmaster. what is this that sitemap is pending from many days. And no Google employee has 2 seconds to answer this problem which everyone is facing right now.

 

The best way to tell if your site has been crawled is to use your Google Webmaster Tools account. That will say quite clearly when Googlebot last successfully accessed your home page. It will also give you stats on web crawling, search queries, back links, etc., view your robots.txt file and let you submit a site map.

And if you haven't signed up, do so here:
http://www.google.com/webmasters/tools/

 

You did not read my posts above. I am using webmaster from quite long time. Problem is that sitemap is showing pending status from many days and the problem is with many blogs.

 

Same thing happen to me my two blogs i have on blogger with custom domains are not crawled since july 30 i dont know what is going on , sitemap status is pending since August 1.

 

Yep. It's the same thing with everyone....