Robots Meta Tag

Discussion in 'Search Engine Optimization' started by Ferrarislave, Jun 12, 2006.

  1. #1
    Should I bother with it?
     
    Ferrarislave, Jun 12, 2006 IP
  2. Sem-Advance

    Sem-Advance Notable Member

    Messages:
    6,179
    Likes Received:
    296
    Best Answers:
    0
    Trophy Points:
    230
    #2
    I dont think so try a robots.txt file on the server.

    one & done instead of on each page

    Want to sell the car forum??
     
    Sem-Advance, Jun 12, 2006 IP
  3. Ferrarislave

    Ferrarislave Peon

    Messages:
    1,129
    Likes Received:
    38
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Ah, gotcha.

    And no the car forum is not for sale.
     
    Ferrarislave, Jun 12, 2006 IP
  4. 26global

    26global Peon

    Messages:
    100
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You don't need to bother, unless you Don't want robots spidering your site.
     
    26global, Jun 12, 2006 IP
  5. Ferrarislave

    Ferrarislave Peon

    Messages:
    1,129
    Likes Received:
    38
    Best Answers:
    0
    Trophy Points:
    0
    #5
    What I men is; do I need it? From my understand if you don't have one, spiders will visit your entire site. If you want to exclude certain things then it's wise to have it.
     
    Ferrarislave, Jun 12, 2006 IP
  6. ewc21

    ewc21 Peon

    Messages:
    455
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #6
    By default robots index your page and follow links, so if this is what you want, you don't need to bother about the robot meta tag. Otherwise you can specify your preference: "index,nofollow", "noindex,nofollow", etc.
     
    ewc21, Jun 12, 2006 IP
  7. KC TAN

    KC TAN Well-Known Member

    Messages:
    4,792
    Likes Received:
    353
    Best Answers:
    0
    Trophy Points:
    155
    #7
    Do not use Robots Meta Tag (difficult / quite a hassle to update many webpages and not all Search Engines honor them) :)

    Use robots.txt if you want to exclude certain parts of the website.
     
    KC TAN, Jun 13, 2006 IP