1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Which is better Robots.txt or Meta Robots Tag?

Discussion in 'SEO' started by seo12, Jun 25, 2012.

0
Page 2 of 2
  1. Prakashets

    Prakashets Active Member

    Messages:
    106
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    58
    #21
    Both are importance for a website.
     
    Prakashets, Jul 6, 2012 IP
  2. webninjas

    webninjas Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    Yes i agree with danish001 we can disallow the files In robots.txt which file we want to avoid from crawler.
    Well i have first research on Meta robots tags and then i will tell you.
     
    webninjas, Jul 7, 2012 IP
  3. mikenielson143

    mikenielson143 Greenhorn

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    13
    #23
    Robot.txt is a text file and meta robot is HTML file. Robot.txt.It page level instruction.It can stop search engines to fetch the restricted contents but on the other side and to obey the meta robot tag first they need to fetch the contents at least and this will be counted towards bandwidth usage.If your web host prohibits you from uploading "robots.txt" to the root directory, or you simply wish to restrict crawlers from a few select pages on your site, an alternative to "robots.txt" is to use the robots meta tag.
     
    mikenielson143, Jul 12, 2012 IP
  4. danish001

    danish001 Well-Known Member

    Messages:
    634
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #24
    Hi Mikenielson,

    Can you help me on some basics question of seo i am confused.
    sitemap.xml, how to analysis a fresh website ?
     
    danish001, Jul 12, 2012 IP
  5. pducampus

    pducampus Peon

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #25
    I think Both are best for Web Site...........
     
    pducampus, Jul 12, 2012 IP
  6. ynavot

    ynavot Peon

    Messages:
    24
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #26
    Robots.txt can prevents (or allow) bots from accessing certain files/pages/directories.
    Robots Meta Tag let you to control whether to allow indexing of a certain page, or following outgoing links from that page.
     
    ynavot, Jul 13, 2012 IP
  7. veerenderseo

    veerenderseo Greenhorn

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #27
    Every one is saying "both are best"..Instead you can give a thumb for first right answer.
    Sorry friends (if hurted) but it is good way to participate in forum.
     
    veerenderseo, Jul 13, 2012 IP
  8. Elfen Lied

    Elfen Lied Banned

    Messages:
    485
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #28
    Both of them are used for crawling purpose If you block a page with robots.txt, Google bot will never crawl the page and will never read any meta tags on the page.If you allow a page with robots.txt but block it from being indexed using a meta tag, Google bot will access the page, read the meta tag, and subsequently not index it.
    1. Robots.txt won't stop a URL being displayed in Google serps.
    2. meta 'noindex' will stop a URL being displayed in Google serps.
     
    Elfen Lied, Jan 6, 2013 IP
  9. Erik11175

    Erik11175 Active Member

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    56
    #29
    You should use both for best results.
     
    Erik11175, Jan 6, 2013 IP
  10. nhadep496

    nhadep496 Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #30
    Well i have first research on Meta robots tags and then i will tell you.
     
    nhadep496, Jan 7, 2013 IP
  11. Soumyananda

    Soumyananda Member

    Messages:
    215
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #31
    Robot.txt contains information for the website. You can see the site by "birlamedisoft.com/robots.txt "
     
    Soumyananda, Jan 7, 2013 IP
  12. zafarmalik4

    zafarmalik4 Active Member

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    58
    #32
    Robots.txt and Meta Robots Tag are both important for well better website , Thanx every one.
     
    zafarmalik4, Jan 8, 2013 IP
  13. deeprajncc

    deeprajncc Member

    Messages:
    453
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #33
    I cannot ignore both robot txt and robot meta tag.
    You can use a special HTML <META> tag to tell robots not to index the content of a page, and/or not scan it for links to follow.
    <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
     
    deeprajncc, Jan 11, 2013 IP
Page 2 of 2