Hello, I have got a new domain & i do posting regularly but my post are not crawled regularly. I wanted to know how can i improve my crawl rate ?
From my own experience, the crawl rate increases with the increase in website authority and site age. And make sure to use sitemaps and submit it to Google webmaster tools. Also check inside webmaster tools if there are any problems in robots.txt
Its easy, Go To Webmaster Tools> Site Configuration> Settings> And drag th Crawl Rate Slider to maximum and save.
Doing this, will sure increase the crawl rate.... but at the same time it increases the bandwidth usage with the crawl attempts. If you don't have anything new.... every few minutes.. it doesn't really make sense to drag the crawl slider to maximum..... Optimally, you only need a bot to go through your website when you have changes...... Post or add content to your website almost at the same time every day. This lets the bots know what time frames and frequencies you are usually making posts... this will also decrease the usage of your bandwidth.... This method has also been mentioned on google forums... One other thing is, if you make posts or add content let's say every day.. then you could also add the meta tag.. visit every day....Google it .. you'll know what to do
Sitemap is good Idea but it will only help when robots come to your site quickly !!, If robots are coming in every 48 hours then site map is not going to do anything alone..
Start building backlinks, it will make it more likely that the Googlebot will visit and crawl your site.