1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Robots.txt

Discussion in 'robots.txt' started by allanswagger, Sep 2, 2010.

  1. #1
    How can i generate robots.txt file. give me the appropriate answer.

    Thanks.
    Allan swagger.
     
    allanswagger, Sep 2, 2010 IP
  2. stephan2307

    stephan2307 Well-Known Member

    Messages:
    1,277
    Likes Received:
    33
    Best Answers:
    7
    Trophy Points:
    150
    #2
    have you googled "robots.txt generator"? you will find a good selection of tools for you to generate this file.
     
    stephan2307, Sep 6, 2010 IP
    Abrar Tariq likes this.
  3. the.wizard

    the.wizard Member

    Messages:
    213
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    35
    #3
    for which plat form do you wanna use robot.txt,..
    more spesific please..
     
    the.wizard, Sep 7, 2010 IP
  4. allanswagger

    allanswagger Peon

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I want to use the robots.txt file for my blog.
     
    allanswagger, Sep 7, 2010 IP
  5. open-seo

    open-seo Peon

    Messages:
    115
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    use this site to create robot.txt file .. it's very simple task . Click Here
     
    open-seo, Sep 9, 2010 IP
  6. allanswagger

    allanswagger Peon

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Thanks for the suggestion.
     
    allanswagger, Sep 13, 2010 IP
  7. SeoDelo.com

    SeoDelo.com Peon

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You can use Google Webmaster Tools
     
    SeoDelo.com, Sep 30, 2010 IP
  8. costy1

    costy1 Greenhorn

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #8
    costy1, Sep 30, 2010 IP
  9. seoguy5

    seoguy5 Peon

    Messages:
    160
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    seoguy5, Oct 3, 2010 IP
  10. seo.raj

    seo.raj Active Member

    Messages:
    273
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    71
    #10
    No any blog allow user robots.txt file. Blogger by default allow all pages of blogs. robots.txt file used. If you didn't want page crawl by crawler then we use robots.txt file.
     
    seo.raj, Oct 6, 2010 IP
  11. vijay01

    vijay01 Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    how can make robort.txt for blog
     
    vijay01, Mar 23, 2011 IP
  12. sipud

    sipud Peon

    Messages:
    63
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    sipud, Apr 10, 2011 IP
  13. victa

    victa Peon

    Messages:
    400
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    robots.txt just a plain text file. you can use notepad to "generate" it. what you really need to know is the standard how to disallow the robots and which part of your site that need to be kept out from robots. if you want to allow all of your site to all robots, just put in your robots.txt:

    User-agent: *
    Disallow:
     
    victa, Apr 10, 2011 IP
  14. rajeev_seo

    rajeev_seo Peon

    Messages:
    211
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    You can use Google Webmaster Tools to generate robets txt .
     
    rajeev_seo, Apr 18, 2011 IP
  15. xavianer

    xavianer Active Member

    Messages:
    175
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    55
    #15
    Open an account with google.com/webmaster add your website. There you can generate robots.txt file.
     
    xavianer, Apr 19, 2011 IP
  16. patidarvijay

    patidarvijay Peon

    Messages:
    96
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    use Google Webmaster Tools to generate robets txt that is a best tool or you can google for other tools it is vest simple.
     
    patidarvijay, Apr 19, 2011 IP
  17. daeng palopo

    daeng palopo Member

    Messages:
    312
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #17
    ty for all.. i'm also have problem with robot txt.. :)
     
    daeng palopo, Apr 19, 2011 IP
  18. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #18
    It would be better if you can describe the specific problems you are facing in robots.txt so that we can review the same and could provide you a solution.
     
    manish.chauhan, May 4, 2011 IP