Please Guid me

I generate & upload a google robotex.txt file with following code:

User-Agent: *
Allow: /
Sitemap: <http://mobixone.com/sitemap.xml>

i saw google bot on my site but never saw yahoo bot on my site or live bot is it any problem with robotex.txt file?
in my yahoo site explorer there r only 3 pages they crawl.

 

User-Agent: *
Allow: /

Sitemap: http://mobixone.com/sitemap.xml

There is no problem with the robots file. You have allowed all the crawlers..

 

Generally Yahoo and especially MSN take longer to crawl a site than Googlebot.

 

after analyzing your robots.txt file, I found no reason that yahoo and MSN crawlers will not be following your website

 

yes m agree with you

 

I'm confused then, is it robot.txt or robotex.txt
also I thought there was only disallow?

thanks for the sitemap info

Cher

 

I mean, shouldn't it be

User-agent: *
Disallow:
Sitemap: <http://mobixone.com/sitemap.xml>

instead of

User-Agent: *
Allow: /
Sitemap: <http://mobixone.com/sitemap.xml>

This is the first time that I've had to do my own site map

Cher

 

yes, I am agree with you

 

Both are same. Both would allow crawlers to visit your websites.

 

manish is right i suppose, * will allow all search engine