This means what?

Discussion in 'Traffic Analysis' started by JEET, Jan 9, 2006.

  1. #1
    66.249.64.25 - - [03/Jan/2006:07:15:53 -0500] "GET /robots.txt HTTP/1.0" 301 230 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

    Did it get the file or not ?
    My Public_html has robots.txt but this subdomain does not has and neither is it indexed . This is what is creating confusion for me .
    Regards
    jeet
     
    JEET, Jan 9, 2006 IP
  2. just-4-teens

    just-4-teens Peon

    Messages:
    3,967
    Likes Received:
    168
    Best Answers:
    0
    Trophy Points:
    0
    #2
    looks to me as the robots.txt has a 301 redirect on it.
     
    just-4-teens, Jan 9, 2006 IP
  3. JEET

    JEET Notable Member

    Messages:
    3,832
    Likes Received:
    502
    Best Answers:
    19
    Trophy Points:
    265
    #3
    Hi,
    That is from the access logs of a subdomain I created for my main domain www.ad4business.com being the main domain.
    This subdomain is redirected from http://sss.ad4business.com to http://www.ad4business.com/sss/ using .htaccess I think .
    The C panel did the redirection .
    Neither google , nor MSn has indexed it .
    Although google shows "relevant" adsense ads on it .
    Those are just 30 articles I picked from a article database and I am trying something here before officially launching .
    Is the redirection causing the indexing problem ?

    In the above data from logs, did the bots find the robots.txt or do I have to put another one in the sub domain also ?
    Thanks for help.
     
    JEET, Jan 9, 2006 IP