Should I add a robots follow meta tag to my pages?

Discussion in 'Search Engine Optimization' started by udaypal, Apr 3, 2012.

0
  1. #1
    How do we add robots follow meta tag?
     
    udaypal, Apr 3, 2012 IP
  2. iPhoneappsexpert

    iPhoneappsexpert Greenhorn

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #2
    <meta name="robots" content="index, follow"> is the default format which means that the site has permission to index and follow each and every page of your website. But this is the default one , you need not to use it until and unless you want some of your pages not to be indexed or followed by crawlers.

    You should use the tag where you want to access permission to crawlers for indexing particular pages and following corresponding links or vice-versa.

    The other basic robot meta tags are :

    <META name="ROBOTS" content="NOINDEX"> - it is used for a page that has no useful data on it.

    <META name="ROBOTS" content="NOFOLLOW, INDEX "> - It signifies to index that particular page but not to follow the links on that page.

    <META name="ROBOTS" content="NOINDEX,NOFOLLOW"> - Use this if you want crawlers not to index the page and also not to follow the links on that page.
     
    iPhoneappsexpert, Apr 3, 2012 IP
  3. imuncutno1

    imuncutno1 Well-Known Member

    Messages:
    603
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    170
    #3
    I used "Nofollow, Noindex" on my WP blog. However, that Google still indexed those pages I checked.
    I used WordPress SEO plugin.
     
    imuncutno1, Apr 3, 2012 IP
  4. neelj

    neelj Member

    Messages:
    99
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #4
    How do you explain a spider of a search engine you only want him to index just the first page of your website or
    he is allowed to index the whole website. You use the so called ROBOTS tag.

    The robots meta tag is not the same as the file called robots.txt
    You should use these two together. Both are used by the seach engines like Yahoo and Google.

    If you use this meta tag the wrong way you might shut the search engines out.
    So the influence of this meta tag is significant.


    <meta name="robots" content="selection">

    Example meta tag robots

    Add the following meta tag in the HTML source of your page:

    <meta name="robots" content="index, follow">

    The spider will now index your whole website.
    The spider will not only index the first webpage of your website but
    also all your other webpages.

    you are also allowed to type it like this:

    <meta name="robots" content="INDEX, FOLLOW">
    <META NAME="robots" CONTENT="INDEX, FOLLOW">
    <META NAME="robots" CONTENT="index follow">


    By changing the index to no-index and the follow to no-follow your are able to
    influence the behaviour of the spider.

    If you don't want the search engine spider to crawl through your whole website
    you use the following meta tag :

    <meta name="robots" content="index, nofollow">


    The spider will now only look at this page and stops there.

    <meta name="robots" content="noindex, follow">


    The spider will not look at this page but will crawl through the rest of the pages
    on your website.

    <meta name="robots" content="noindex, nofollow">

    The spider will not look at this page and will NOT crawl through the
    rest of your webpages.

    This metatag can also be typed with the / in the end of the tag:

    <meta name="robots" content="index, nofollow" />
    <meta name="robots" content="noindex, follow" />
    <meta name="robots" content="noindex, nofollow" />
     
    neelj, Apr 3, 2012 IP