I removed robot.txt

Discussion in 'General Marketing' started by Knight1234, Apr 19, 2008.

  1. #1
    Hey, guyz !!
    I removed robot.txt from my Site, will it effect my ranking anyways ? or its cool ? :p
     
    Knight1234, Apr 19, 2008 IP
  2. phplife

    phplife Peon

    Messages:
    36
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Removing your robots.txt file doesn't effect rankings. This file is used for exclusions to tell well behaved spiders not to index files on your website.

    So let's say you have a download dir that you don't want to appear in G. Well the gbot will honor your robots.txt file exclusions. However a person with a little bit of knowledge can use this file against you.

    Since it's a text file, they simply guess where this file is placed on your website, type it into the address bar and they get to see what files you don't want people to know about.

    A robots.txt file is not a form of protection or security. It's merely a standard that well behaved spiders honor.

    phplife
     
    phplife, Apr 19, 2008 IP
  3. hillord

    hillord Well-Known Member

    Messages:
    2,211
    Likes Received:
    59
    Best Answers:
    0
    Trophy Points:
    140
    #3
    good explanation there, phplife. i totally agree with this.
     
    hillord, Apr 19, 2008 IP
  4. Knight1234

    Knight1234 Peon

    Messages:
    345
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    hmm, well alright, :p
    ty
     
    Knight1234, Apr 19, 2008 IP
  5. chantown

    chantown Peon

    Messages:
    406
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    It doesn't affect anything.

    It just gives google rules for what to search for and not to on your site.
     
    chantown, Apr 19, 2008 IP