Hello everyone... I think that we are forgetting something more important about a SEO. And thing help us to recover from Penguin affect. I am talking about Robots.txt file a file that help us in indexing on Google search. I am not perfect but It think that Robots.txt really help a lot. That's why I want help from Warrior that any one have Idea about it. Any change that make us indexing more fast in Google.
Warrior??? I think if you want to prevent the robots / spiders from accessing all or part of a website, then the Robot.txt file is helpful.
No I am trying for that how can more fast spider crawl me. Is robots.txt help me for that? I am not master in SEO but tring to to do something for everyone. To gain same ranking...
Here are some things that you could do. Anchor text diversity Link diversity Platform diversity Contextual links Excellent Onpage SEO
Also make sure you have high quality keyword rich content that you update on a regular basis. Quality Content is still important.
If your website has punished by Google Penguin robots.txt is not gonna help you. The only way to get out of it is to ensure your site do not have poor quality back links.
After being affected with penguin, I don't think you can recover using Robots.txt. I am still in search of getting something which can really make me out from the effect.
I also think that robot.txt file will not be helpfull in recovering from penguin update, by including more unique quality content in site and by getting more quality backlinks for site we can get rid from penguin update.
I'm sorry but you are confusing different issues. The robots.txt is there to prevent Google crawling anything you don't want it to crawl, it isn't something you can use to make it get crawled and indexed any faster. If you want absolutely everything on your site crawled you don't even need to have one. There is no way that this file can help you recover from Penguin.
You cant expect a file to bring back your website to a high rank position. Consider it as a learning curve and try not to repeat the things you've done.