On page Issue

Discussion in 'Search Engine Optimization' started by ashrafnarail, Oct 28, 2013.

0
  1. #1
    A site has
    <meta name="robots" content="index, follow" />
    Then again use
    <meta name="robots" content="noindex, nofollow" />

    Is it right for robots.txt format. Is it effect any negative issue at SEO?
     
    ashrafnarail, Oct 28, 2013 IP
  2. ryan_uk

    ryan_uk Illustrious Member

    Messages:
    3,983
    Likes Received:
    1,022
    Best Answers:
    33
    Trophy Points:
    465
    #2
    Where did you get this garbage question from?!? It makes no sense whatsoever. robots.txt has nothing to do with those meta tags. I suggest you search Google/Bing/whatever and read up on the topics of robots.txt and meta robots tags. (There is lots of information out there already.)
     
    ryan_uk, Oct 28, 2013 IP
    malky66 likes this.
  3. rayalfy

    rayalfy Well-Known Member

    Messages:
    48
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    158
    Digital Goods:
    1
    #3
    robots.txt file is a file uploaded to your root folder and is primarily meant to give instructions to robots.Metatags give search engines data about you site. As @ryan_uk has said, the file has nothing to do with meta tags
     
    rayalfy, Oct 29, 2013 IP
  4. Neeraj Thakur

    Neeraj Thakur Member

    Messages:
    27
    Likes Received:
    2
    Best Answers:
    1
    Trophy Points:
    33
    #4
    Following is the right format.
    <meta name="robots" content="index, follow">
    • The spider will now index your whole website.
    • The spider will not only index the first web-page of your website but also all your other web-pages.
    <meta name="robots" content="noindex" />

    The robots meta tag in the above example instructs all search engine not to show the page in search results. The value of the name attribute (robots) specifies that the directive applies to all crawlers. To address a specific crawler, replace the robots value of the name attribute with the name of the crawler that you are addressing. Specific crawlers are also known as user-agents (a crawler uses its user-agent to request a page.) Google's standard web crawler has the user-agent name Googlebot. To prevent only Googlebot from crawling your page, update the tag as follows:
     
    Neeraj Thakur, Oct 29, 2013 IP
  5. ashrafnarail

    ashrafnarail Well-Known Member

    Messages:
    42
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    113
    #5
    <meta name="robots" content="index, follow">
    Is it the right format? can I use it. Is it SEO friendly?
     
    ashrafnarail, Oct 29, 2013 IP
  6. Corestratagems

    Corestratagems Active Member

    Messages:
    122
    Likes Received:
    10
    Best Answers:
    1
    Trophy Points:
    63
    #6
    ashrafnarail, the real question is are you SEO friendly or are you a bull in the SEO china shop?
     
    Corestratagems, Oct 29, 2013 IP
  7. arshiabhardwaj21191

    arshiabhardwaj21191 Greenhorn

    Messages:
    22
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    23
    #7
    i dont know
    my robot.txt is currently:
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
     
    arshiabhardwaj21191, Oct 30, 2013 IP
    Kianu42 likes this.
  8. Kianu42

    Kianu42 Member

    Messages:
    510
    Likes Received:
    15
    Best Answers:
    5
    Trophy Points:
    43
    #8
    What she says.
    by the way, if you don't really know what to write in a robots.txt file, just use any of the available generators (come in many on page optimization tools).
     
    Kianu42, Oct 30, 2013 IP
  9. saimoom

    saimoom Member

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    31
    #9
    This will not effect your website. For more details you can see this post: http://www.shinemat.com/2012/10/robottxt-what-is-and-its-importance.html
     
    saimoom, Oct 30, 2013 IP
  10. instinctis

    instinctis Active Member

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #10
    To make it as short as possible:
    - all that starts with meta (tags) go only inside your html hage header
    - all that robots.txt is , is one file on the root of your site.

    They do not have any common points at all.
    - meta tags directives are just say some "suggestions" toward search engines to obey your tempo ... but of course they never will
    - the root txt file is again a bunch of "suggestions" towards search engines to treat differently various parts of your site ... but of course they never will (except maybe G)

    ... the bottom line is that none of these will not help much if at all on SEO.
     
    instinctis, Oct 30, 2013 IP