Solicitors Mortgages
Apr 21st 2005, 7:06 pm
i have some settings on my .htaccess to ban certain areas,
if i then have a blank"" robots.txt file are those areas still blocked? :confused:
or are these totally different things ??
"" = fully spiderable...like this below
V
V
V
V
User-agent: *
Disallow:
if i then have a blank"" robots.txt file are those areas still blocked? :confused:
or are these totally different things ??
"" = fully spiderable...like this below
V
V
V
V
User-agent: *
Disallow: