Allow all robots robots.txt question

Discussion in 'Search Engine Optimization' started by pierrehs, Sep 22, 2011.

  1. #1
    Hello,
    In my robots.txt file I have a list of robots that are not allowed to be indexed on my site and for the rest I have to allow all other robots, but I would like to know the real difference between these two rules:

        User-agent: *
        Disallow:
    Code (markup):
    and this:

        User-agent: *
        Allow: /
    Code (markup):
    Thank you
     
    pierrehs, Sep 22, 2011 IP