robots txt for my site!

Discussion in 'robots.txt' started by soul_of_god, Jul 8, 2009.

0
  1. #1
    i want index my site asap in google so i added the robots txt in my site like that
    User-Agent: *
    Allow: /

    is this right?:confused:
     
    soul_of_god, Jul 8, 2009 IP
  2. seo-free

    seo-free Well-Known Member

    Messages:
    224
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    133
    #2
    I think if you use this command it works the same..
    User-Agent: *
    disallow:

    And btw, there is no way you can index your pages in search engines by any effort. You have to wait for a right time and robots.txt file and sitemap does not give your confirmation that your site will be indexed=) .
     
    seo-free, Jul 10, 2009 IP
  3. soul_of_god

    soul_of_god Well-Known Member

    Messages:
    1,298
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    130
    #3
    so its mean robot txt doesn't work :confused:
     
    soul_of_god, Jul 10, 2009 IP
  4. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #4
    Allowing everything is the same as simply not having a robots.txt... If that's what you want, just delete the file.
     
    digitalpoint, Jul 10, 2009 IP
  5. danbcaut

    danbcaut Member

    Messages:
    14
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #5
    adding a robot.txt file will not force or speed up the indexing process. But it may
    be beneficial when the spiders DO start arriving - particularly if you have folders
    or pages that you do NOT want indexed.

    If you want to put out some "spider food" just go over to Squidoo.com and drop a
    couple of topic related articles with backlinks to your page(s)

    Wishing all the best
    Dan B. Cauthron
     
    danbcaut, Jul 10, 2009 IP