Robots.txt only homepage

Discussion in 'robots.txt' started by dropdrop, Jul 6, 2012.

0
  1. #1
    Hello DPers,

    I want to ask, how or what i should write on my robots.txt to allow Googlebot only for homepage, others page disallow, thanks for your further information.

    Regards,
    Dropdrop
     
    dropdrop, Jul 6, 2012 IP
  2. suvendug

    suvendug Member

    Messages:
    382
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #2
    Then you need to write Disallow: /pagename.html ...e.g. if your site is abcd.com and innerpage is abcd.com/service.html and you want to block service page then you need to write in robots Disallow: /service.html..please remember you need to write this code for all pages you want to block.
     
    suvendug, Jul 21, 2012 IP
  3. dropdrop

    dropdrop Active Member

    Messages:
    142
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #3
    So, there is no way for using regular expresion or something like that ?!
     
    dropdrop, Jul 21, 2012 IP
  4. suvendug

    suvendug Member

    Messages:
    382
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #4
    No..you don't need to write anything extra...
     
    suvendug, Jul 23, 2012 IP
  5. mr.siiin

    mr.siiin Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    for all robots is better
     
    mr.siiin, Jul 30, 2012 IP