dont worry about msn in anyway what so ever, if you work for Google then msn and yahoo etc etc will take care of them selves.
What is the specific format the robots.txt file would look like to specifiy the sitemap.xml? I am used to seeing robots.txt files used only for excluding things from being indexed.
It is just like: Sitemap: http://www.example.com/sitemap.xml For instance, see http://www.mapforums.com/robots.txt It is a relatively new thing in robots.txt Eric
should it be Sitemap: http://www.????com/sitemap.xml.gz or Sitemap: http://www.???.com/sitemap.xml.gz
does anyone know how long it takes them to index these pages after it picks up on them through the robots.txt file google and yahoo its around an hour before there indexed
Does the robots.txt file need other formating/information, or will this single line work? My site currently does not have one. (ok so i'm new at this )
MSN is indeed very slow at indexing all the pages of a website ... but even yahoo that utilizes the sitemap.txt.gz has only indexed about 20% of my site in a matter of 2 months ... (same as MSN without sitemap submission)
If they spider it anyway, what exaclty does the sitemap do for you? The sitemap tool builds the sitemap by spidering anyway so what is the diff?
Ranking is MSN is easier compared to Google & yahoo. get backlinks, include the keywords in meta tags & optimize the site well.
Yes, this is true but they don't index very many pages from each site. This is where a sitemap may help.
MSN Must be slow, all other search engines have a link to my site http://www.buythegoods.com. MSN has a Big Fat Zero next to it. Google and Aol must be the same. Ross
This is good to know.. I use the vBSEO sitemap generator and google picks them up automatically, but I have to submit them manually to yahoo, which I do every month or so. Do you know if MSN will be like Google or Yahoo? Eric