is robots are important for our site and how can i make a robot file for my website?

Discussion in 'SEO' started by asmindia, Sep 19, 2011.

  1. #1
    hey friends,
    please tell me how robots file takes a important role in our google ranking? How can i make a robot file for my website http://www.developtorise.com ?
    tell me all the important steps,
     
    asmindia, Sep 19, 2011 IP
  2. Foxtr0t

    Foxtr0t Peon

    Messages:
    39
    Likes Received:
    1
    Best Answers:
    1
    Trophy Points:
    0
    #2
    Google for robots.txt and/or sitemaps for info. If you don't know if you need them, you probably don't.
     
    Foxtr0t, Oct 3, 2011 IP
  3. seo.geek1

    seo.geek1 Peon

    Messages:
    87
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable. Robots are often used by search engines to categorize and archive web sites, or by webmasters to proofread source code. The standard is different from, but can be used in conjunction with, Sitemaps, a robot inclusion standard for websites.:)
     
    seo.geek1, Oct 4, 2011 IP
  4. monikajoshi

    monikajoshi Peon

    Messages:
    390
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You cannot ignore the importance of robot.txt protocol file which is to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable. you can create robot.txt file by your website Google Webmaster tools..
     
    monikajoshi, Oct 9, 2011 IP