Hi there , I am new in this forum Well I need a little help or just explanation why is that? URLs restricted by robots.txt (1) In fact I delete all the meta tags in the index.html and my robots.txt is User-agent: * Disallow: /sorry/ Can any body advise me what is wrong? Thanks in Advance , you can see my site in my signature The site is http://www.foyerpoker.com I am newbie and the forum do not alowed me to include my signature either to edit the post.So this is extenstion to the previous post.Thanks again
Well, offhand, I would think it is because Google discovered a link within the "/sorry/" directory? But due to robots.txt it could not crawl and index it?
Thanks for the reply ! Well , I have put this Disallow only for some testing.In fact I have no /sorry directory http://www.foyerpoker.com/ In Sitemap URL restricted by robots.txt [?] Aug 16, 2006 Here is the SItemap Diagnosis.They are blocking me my index and they are saying that I am blocking it myself. So where is the bug? In me or in them? Thanks in Advance!
right now your site is down no DNS resolving no server response host unknown i guess you have first a few very basic work to complete successfully
My site is up : http://www.foyerpoker.com/en/index.html DNS is working too : * Dns resolving www.foyerpoker.com - * Dns resolved www.foyerpoker.com to 87.120.40.13 - * Dns resolving foyerpoker.com - * Dns resolved foyerpoker.com to 87.120.40.13 I have dedicated hosting and evr is UP and working. Maybe I am not doing sth right? I have send you private message Thanks in advance
I'm not seeing an issue here... you restrict gbot from looking at the contents of /sorry/... the message: URLs restricted by robots.txt (1) just says that Google sees your restriction and understands it. It will not look in there. That's not an error message, it's a confirmation. You should be fine... make sense?
yes In fact the error was that I had a netscape plugin which makes redirecting and google misunderstood that and gave me back robots.txt'error which is ridicilous Whatever , everything is working and stable now Thanks