robots.txt

Discussion in 'Websites' started by seoindiaweb, May 29, 2006.

0
  1. #1
    helloo there every1
    i m bit newbie:( in dis.. Can any1 tell me if i have insterted proper robots.txt on my site www.buyrimonabant.co.uk/robots.txt
    and is it necessary to insert robots command in all pages including index??

    Plz Comment;) Thanx in advance
     
    seoindiaweb, May 29, 2006 IP
  2. MatthewN

    MatthewN Well-Known Member

    Messages:
    859
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    195
    #2
    What are you trying to block? Any particular folders?
     
    MatthewN, May 29, 2006 IP
  3. seoindiaweb

    seoindiaweb Banned

    Messages:
    2,889
    Likes Received:
    200
    Best Answers:
    0
    Trophy Points:
    0
    #3
    No not at all.. i wann them to see all my pags n index them..

    Should i put robots command on all pages?? I think my robots.txt is perfect .. but i m unsure do i have to put robots tags in all pages including index or not?:(
     
    seoindiaweb, May 29, 2006 IP
  4. ludwig

    ludwig Notable Member

    Messages:
    2,253
    Likes Received:
    66
    Best Answers:
    0
    Trophy Points:
    225
    #4
    ludwig, May 29, 2006 IP