View Full Version : Difference between /category/ and /category disallowing ?
crystak
Dec 29th 2007, 6:17 am
The example in the title - what happens if I disallow /category or /category/ ?
Is it if you want for example the following:
domain.com/category page not to get indexed but want all the other
domain.com/category/news pages to be indexed for example ?
And which one does what ?
just-4-teens
Dec 29th 2007, 6:51 am
i dont think it makes a difference both would disallow category
crystak
Jan 1st 2008, 5:10 am
So is there no way I can stop the /category archive from getting indexed... but all my other posts that belong to that category e.g. /category/post to be indexed ?
SwapsRulez
Jan 13th 2008, 12:25 am
So is there no way I can stop the /category archive from getting indexed... but all my other posts that belong to that category e.g. /category/post to be indexed ?
Then you have to mention all the files & folders inside them in allow tag. But i think this will create the ambiguity for the bot & bot will destroy your site.. hehe... Just joking.. :p
vBulletin® v3.6.8, Copyright ©2000-2008, Jelsoft Enterprises Ltd.