Ok, after having some issues myself, I just wanted to post here and grab some input. Google hasn't crawled my site since November of last year, I've edited all the content and I've tweaked it so that it shouldn't have any problems, submitted the site to google, done the whole sitemaps deal and so on. I know it takes time, and I'm not asking for help, just want an insight as to why this may be happening? If it's happened to you? What do you do to get your site recognised more? I don't know the policy about posting links here, so I won't just incase
I have had this but usually there is a solution. first things that comes to mind is to check your html is valid. also check your robots.txt or meta tags is/are not blocking crawlers. Also you may be dropped for some reason, setup Google webmaster tools to check this.
I've got the google webmasters tool, and there is no reason robots.txt would be stopping the crawling, I've checked. Meta tags are fine - this is why it's odd that it's not being crawled. Check my profile for a link if you'd like to take a look
Google's cache of your homepage is from Jan 22 http://webcache.googleusercontent.c....com&cd=1&hl=en&ct=clnk&source=www.google.com Here's another page with a cache date earlier in January. http://webcache.googleusercontent.c....com&cd=2&hl=en&ct=clnk&source=www.google.com WMT's can sometimes be slow when updating information, so its better to check your server logs if your unsure. Cheers James
That's odd, I didn't check the cache. Server logs have been checked, everything still seems in order. Think Google hates me
Wow, how many times a day do you tweet your URL? Maybe Google have flagged you for spam! Dunno, but anyway... Just out of curiosity, why do you use these Geo tags? Do you only target your services to Wisconsin or is it for Google places or something similar? <meta name="geo.region" content="US-WI" /> <meta name="geo.placename" content="Kenosha" /> <meta name="geo.position" content="-14.270972;-170.132217" /> Code (markup): Cheers James
How often Google crawl my sites depends on how often I post new content. If I post every day they crawl every day. If I only post once a week, they slow down to once a week. One thing to avoid is pinging them too often - otherwise Google will see your site as spam. This can happen if you keep editing and saving content on a WP site - unless you use a plug-in to avoid the problem
If everything is in order and still google is not recognizing your site, then its time for you to give us your site name in this thread so we will check what is exactly wrong with your site and if its dumped in the sandbox
Oh the twitter thing, that's just a bot I made, it's been running for a few days. The geo tagging is just to state where we can be found so we getting positioned when google crawls us. The link is: www.w3theory.com Also, the Twitter bot is just tweeting from a database of tweets, but atm it's very small so it's just saying the same stuff over and over
Actually, just taken a look.....Google ignores the geo meta tags, so that's not the problem. I just also changed my robots.txt to see if that'll help
We tend to change the content daily, it will change more now that I've integrated the main site with our blog, news posts go to the blog, blog posts go to the news and vice versa
Yes your site last crawled at 2nd Feb, Social media optimization is more helps to easy index your pages.
Google will crawl your pages more frequently with high backlinks. Submit your URL to directories and social bookmarking websites
Good job. Keep adding new content regularly - the more often you add more content, the more often google will crawl your site.