View Full Version : What does this robots.txt text mean?
Jon12345
Jan 8th 2008, 4:48 am
I have this in robots.txt:
User-agent: *
Disallow: /dw/
What does that actually mean? What will it do?
Thanks,
Jon
Dr. XYZ
Jan 8th 2008, 5:00 am
That means that search engines must not get into your dw directory for indexing purposes.
ยท
Jon12345
Jan 8th 2008, 5:05 am
That's very odd...I don't have a dw directory. If I wanted to disallow 2 directories ("images" and "surveys"), how would the robots.txt file look?
Kuldeep1952
Jan 8th 2008, 6:03 am
To disallow the 2 directories ("images" and "surveys"), put each directory on a separate Disallow line
User-agent: *
Disallow: /images/
Disallow: /surveys/
Jon12345
Jan 8th 2008, 6:44 am
Thank you. :)
ld685
Jan 21st 2008, 3:56 pm
test signature
SwapsRulez
Jan 22nd 2008, 12:18 am
test signature
What does that mean ???? :confused:
catanich
Feb 2nd 2008, 2:28 pm
What does that mean ???? :confused:
Have you set up your User CP Signature (menu <User CP>
vBulletin® v3.6.8, Copyright ©2000-2008, Jelsoft Enterprises Ltd.