Quick Reply need about Robots.txt file

Discussion in 'Search Engine Optimization' started by Rapid_SEO, Oct 12, 2010.

0
  1. #1
    Which is the better way to restrict Search Engines to index my Directory: "uploads" and the content in it?

    User-agent: *
    1: Disallow: /httpdocs/php/uploads/

    2: User-agent: *
    Disallow: /php/uploads/

    3: User-agent: *
    Disallow: /uploads/

    if I use /php/uploads/ will search engines not index my "PHP" Directory?
     
    Rapid_SEO, Oct 12, 2010 IP
  2. umar.daraz

    umar.daraz Active Member

    Messages:
    122
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #2
    You need to restrict the exact folder from where your file is coming.
     
    umar.daraz, Oct 12, 2010 IP
  3. Rapid_SEO

    Rapid_SEO Peon

    Messages:
    218
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #3
    One more question,
    can I hide robots.txt file from visitors like if someone open the link "/httpdocs/robots.txt" but I dont want to show that which directory is most important but Search Engines can still read this robots txt file, is there any way?
     
    Rapid_SEO, Oct 13, 2010 IP
  4. Alan Smith

    Alan Smith Active Member

    Messages:
    1,263
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #4
    I would like to prefer last option for restrict Search Engines.
    User-agent: *
    Disallow: /uploads/
    It is better from all.
     
    Alan Smith, Oct 28, 2010 IP