How can the meta robots tag impact how search engines crawl ?

Discussion in 'SEO' started by riteshvyas52, Jul 5, 2012.

  1. #1
    How can the meta robots tag impact how search engines crawl, index and display content on a web page?

     
    riteshvyas52, Jul 5, 2012 IP
  2. abhisal

    abhisal Peon

    Messages:
    16
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hey ritesh
    Meta robots tag are those tags who gives the clear cut idea to Google crawler, which page of your site have to crawl and index and which not....And search engine crawls your website as per your directions you give in the Robots.txt file and on the behalf of this file and Sitemap the Google Index your page and then show's them on the Google Search engine....
     
    abhisal, Jul 5, 2012 IP