What is Blank Robots.txt File

Discussion in 'Search Engine Optimization' started by dril, Nov 11, 2010.

  1. #1
    Can anyone tell me some words on Blank Robots.txt File, Please
     
    dril, Nov 11, 2010 IP
  2. Grimm

    Grimm Peon

    Messages:
    3,072
    Likes Received:
    57
    Best Answers:
    0
    Trophy Points:
    0
    #2
    What is a blank txt file? What is a blank word doc file? What is a blank excel file? What is blank?
     
    Grimm, Nov 12, 2010 IP
  3. chestercaldwel

    chestercaldwel Peon

    Messages:
    326
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    If a search engine spider doesn't find a robots.txt file, it assumes that it can spider the whole site.
    First of all, it is simply good practice. If the robot is going to look for the file, for the one minute that it takes to create it, you may as well do it.
    Secondly, If the robot finds a blank robots.txt file, it knows that you have nothing to hide in you site. The spider knows it has your absolute permission to look at and index every page on your site, because you have left him the message with the robots.txt file. The spider knows that you are not trying to hide or cloak any pages and in our experience, that is seen by certain robots, as a good thing.
     
    chestercaldwel, Nov 12, 2010 IP
  4. smallbusinessguy

    smallbusinessguy Peon

    Messages:
    448
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Dont really understand your question... Try searching Google and you will come up with a definition of robots.txt file
     
    smallbusinessguy, Nov 12, 2010 IP
  5. rosesmark

    rosesmark Active Member

    Messages:
    542
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    75
    #5
    Their is not Blank Robots.txt

    Robots.txt allows you to specify which pages should not be crawled. Pages that don't get crawled can still rank for keywords and show up in search results.
     
    rosesmark, Nov 12, 2010 IP