What Is Robots.txt?

Thanks for sharing robots.txt

 

robots.txt is
User-agent: *
Allow: /

 

I need this information thanks for sharing.

 

Robots.txt is nothing but a convention of preventing co-spiders to visit full or part of your website, you can request to search engine's spiders to not index all or part of your website.

Note: You cannot force Search Engine's spider to do this

 

thank for information

 

wow its very useful tips i will used in my website.

 

Thanks for wonderful information.

 

Superb information dude...
Marvelous...

 

Can any one tel me about my this issue


when i am open my this blog www.no1searchengineoptimization.com/blog/ ( just open )

than its redirect to this URL http://www.no1searchengineoptimizati...tion.com/blog/

and this is no1searchengineoptimization.com website folder name in hosting Server.

Please tel me how to removed folder issue with this blog .

please rectify my this issue.


Thanks

 

posting this information here is very helpful.

 

really useful post. Thanks for your great work

 

Very Good article...Thanks to sharing information about Robots.txt...

 

i have multiple blogger blogs, there have a problem increase my traffic down and daily down, In adsense Site Diagnostics area "View detailed diagnostic information about the pages Google crawls to display relevant ads. "

Blocked URL > Reason Blocked : Robots.txt file > last Crowl Attempt

There have a big list of blocked url.
How can it be solved to clear block sites and regenerate my all traffic.