Robots.txt problem (confused, help me out)

Discussion in 'Google' started by seodmb, Jun 16, 2009.

0
  1. #1
    Hello,
    I have just stopped a Links page from crawling by search engine robots by putting this line in my robots.txt

    User-agent: *
    Disallow: /links.php

    I am little bit confused and need a suggestion, is I am doing something wrong would the correct format be

    Disallow: /links/
    or i have done the right thing. Thanks for helping me out.
     
    seodmb, Jun 16, 2009 IP
  2. MervinKoops

    MervinKoops Member

    Messages:
    405
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    45
    #2
    If the page is links.php, then yes, you've done it correctly :)
     
    MervinKoops, Jun 16, 2009 IP
  3. SOULZRIPPER

    SOULZRIPPER Well-Known Member

    Messages:
    2,382
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    165
    #3
    User-agent: *
    Disallow: /links.php

    For the Php file

    Disallow: /links/

    If it's a folder..
     
    SOULZRIPPER, Jun 16, 2009 IP