Google regularly visit my site for not crawling anything but there is a lot of things to crawl. Though i have break some news on internet they don't even crawl that and My ranking is decreasing day by day. This starts when i allow them to crawl my tags pages. Though now i block them via my robots.txt but still these pages in their index and they stop crawling but keep visiting. Please friends help me. I need your help.
check your robot txt or htaacess, make sure they are alright oh yah, make sure your source code is valid too
i think google is visiting means it should crawl the page. visiting the website but not crawling i am unable to understand. can any one make the point more clear?
they are coming and visiting and not indexing new contents........... IT'S very simple every time i'm going to your home ring the bell and get vanished. Google is doing same for me. HELP.................
How you know Google not crawling your site? Google bot is robot, program to download your site. It not mean index your site. Try get good back links, Google will index more.
because each time i opened my google webmaster tools they are showing that robots.txt last downloaded sometimes(perticular time) ago. but when i'm looking for the new pages in the search result there is no such result from my site. Other people copied my content and put a link to my site their content is in google's search result but not Mine. How irritating............ HELP...........ME........
create some back links to new content pages and check your internal link structure.Must be some probelm in internal links structure. Do you have "duplicate content" ?
Google not crawling your site this is the blog spot program to download your site Google bot is robot this is sitam also
for those people who are talking about back links My site has Google backlinks = 4,840 Yahoo backlinks = 171 Alexa backlinks = 65 Technorati inlinks = NA
See if you have "Duplicated Content" Google sometimes seem to avoid pages that seem to be a copied version of the previous crawl It could also be the due to tags you have some duplicated content. Also check with your internal link structure. What is the URL of your site?
I think the tags, especially those tags full of keywords would prevent crawlers from going deeply. Google does need time to re-crawl all your pages and paths since you have just block tags via your robots.txt.