pls tell me what does it mean

in robots.txt file I am getting this:

User-agent: *
Disallow: /

Does it means that home page will not be creawled by the bots?

Pls let me know.

 

User-agent: *
Disallow: /

tells robots that obey robots txt to ignore all content on that domain.

have a read of http://www.robotstxt.org/robotstxt.html

vagrant

 

ignoring content on domain, yo

 

Yes, you got it right. This will tell bots to skip the domain altogether. If this is because of your wordpress settings, you can set the privacy settings to allow bots to access the blog.

 

Thanks for the reply.

 

Correct....good answers guys!