1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

What Is Robots.txt?

Discussion in 'robots.txt' started by VijayanKumar, Jun 9, 2011.

0
Page 2 of 2
  1. Darexs

    Darexs Active Member

    Messages:
    49
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    71
    #21
    Thanks for sharing robots.txt
     
    Darexs, Jul 23, 2011 IP
  2. Martinluo

    Martinluo Peon

    Messages:
    49
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    robots.txt is
    User-agent: *
    Allow: /
     
    Martinluo, Jul 30, 2011 IP
  3. satinderbal

    satinderbal Greenhorn

    Messages:
    41
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #23
    I need this information thanks for sharing.
     
    satinderbal, Aug 3, 2011 IP
  4. sam_driscoll

    sam_driscoll Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #24
    Robots.txt is nothing but a convention of preventing co-spiders to visit full or part of your website, you can request to search engine's spiders to not index all or part of your website.

    Note: You cannot force Search Engine's spider to do this
     
    sam_driscoll, Aug 7, 2011 IP
  5. seomartini

    seomartini Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #25
    thank for information
     
    seomartini, Aug 9, 2011 IP
  6. synchronous

    synchronous Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #26
    wow its very useful tips i will used in my website.
     
    synchronous, Aug 10, 2011 IP
  7. Kenank

    Kenank Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #27
    Thanks for wonderful information.
     
    Kenank, Aug 18, 2011 IP
  8. pukhtoogle

    pukhtoogle Member

    Messages:
    41
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #28
    Superb information dude...
    Marvelous...
     
    pukhtoogle, Aug 24, 2011 IP
  9. synchronous

    synchronous Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #29
    Can any one tel me about my this issue


    when i am open my this blog www.no1searchengineoptimization.com/blog/ ( just open )

    than its redirect to this URL http://www.no1searchengineoptimizati...tion.com/blog/

    and this is no1searchengineoptimization.com website folder name in hosting Server.

    Please tel me how to removed folder issue with this blog .

    please rectify my this issue.


    Thanks
     
    synchronous, Aug 24, 2011 IP
  10. jhon786

    jhon786 Peon

    Messages:
    62
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #30
    posting this information here is very helpful.
     
    jhon786, Aug 25, 2011 IP
  11. smartsolution

    smartsolution Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #31
    really useful post. Thanks for your great work
     
    smartsolution, Aug 27, 2011 IP
  12. aruninfo

    aruninfo Peon

    Messages:
    85
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #32
    Very Good article...Thanks to sharing information about Robots.txt...
     
    aruninfo, Sep 14, 2011 IP
  13. webgfx

    webgfx Member

    Messages:
    62
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #33
    i have multiple blogger blogs, there have a problem increase my traffic down and daily down, In adsense Site Diagnostics area "View detailed diagnostic information about the pages Google crawls to display relevant ads. "

    Blocked URL > Reason Blocked : Robots.txt file > last Crowl Attempt

    There have a big list of blocked url.
    How can it be solved to clear block sites and regenerate my all traffic.
     
    webgfx, Sep 14, 2011 IP
Page 2 of 2