IA Archiever

Discussion in 'All Other Search Engines' started by Nokia999, Nov 2, 2005.

  1. #1
    IA Archiever hits my website several time a day.What is it?
    If it is something like archiever then why it is archieving my website and who has granted it permission to archieve my website?
    How i can block it to visit my website?
    I am looking forward for your answers Thank You.
     
    Nokia999, Nov 2, 2005 IP
  2. eduardomaio

    eduardomaio Peon

    Messages:
    450
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Why block a robot that can be useful?

    It archives your website for "history" purposes at www.archive.org and it's used for data to www.alexa.com
     
    eduardomaio, Nov 2, 2005 IP
  3. Nokia999

    Nokia999 Guest

    Messages:
    1,488
    Likes Received:
    74
    Best Answers:
    0
    Trophy Points:
    0
    #3
    How is it useful?
    People no longer credit Alexa as an ranking authority.And it is archieving website without any permission.
    Is there anyway to block it?
     
    Nokia999, Nov 2, 2005 IP
  4. muchacho

    muchacho Active Member

    Messages:
    310
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    58
    #4
    Google also "archive" your site, and they didn't asked for your permission.

    If you want to block it, add this to your robots.txt file (or create it if you don't have it yet, put the file in your root of your domain)

    User-agent: ia_archiver
    Disallow: /
    Code (markup):
     
    muchacho, Nov 4, 2005 IP
  5. Nokia999

    Nokia999 Guest

    Messages:
    1,488
    Likes Received:
    74
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I am not sure how to react to new situation.
    Currently my robots.txt is
    User-agent: *
    Disallow:

    What it should be ?
     
    Nokia999, Nov 4, 2005 IP
  6. boohlick

    boohlick Banned

    Messages:
    736
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
    #6
    User-agent: ia_archiver
    Disallow: /

    muchacho is right
     
    boohlick, Nov 4, 2005 IP
  7. muchacho

    muchacho Active Member

    Messages:
    310
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    58
    #7
    It you want to ban only archiver, robots.txt should be:
    User-agent: *
    Disallow: 
    
    User-agent: ia_archiver
    Disallow: /
    Code (markup):
     
    muchacho, Nov 4, 2005 IP
  8. Nokia999

    Nokia999 Guest

    Messages:
    1,488
    Likes Received:
    74
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Where do it archive sites?
    how can we access it ?
     
    Nokia999, Nov 4, 2005 IP
  9. muchacho

    muchacho Active Member

    Messages:
    310
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    58
    #9
    muchacho, Nov 4, 2005 IP
  10. eduardomaio

    eduardomaio Peon

    Messages:
    450
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Oh, if someone steals your design (if its unique) believe me, it will be really useful!
     
    eduardomaio, Nov 5, 2005 IP
  11. webdesign2005

    webdesign2005 Guest

    Messages:
    26
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Depending on your site size you might just want to block them by using .htaccess. I have heard about ia_archiever going thru sites before finding your robots.txt file. It is very easy and can be done with just a few lines of code added to your file. You can do this by ip address or user agent. You cou8ld do sonething like this:

    Have a nice day.
     
    webdesign2005, Nov 5, 2005 IP
  12. Ron

    Ron Peon

    Messages:
    142
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #12
    i've got a site online since mai 05 (www.wordconstructor.com) and ia_archiver visits it regularly but i'm still not listet in archive.org.
    How long does it take to get in there?
     
    Ron, Nov 7, 2005 IP
  13. webdesign2005

    webdesign2005 Guest

    Messages:
    26
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #13
    From archive.org FAQ page.
     
    webdesign2005, Nov 7, 2005 IP
  14. Nokia999

    Nokia999 Guest

    Messages:
    1,488
    Likes Received:
    74
    Best Answers:
    0
    Trophy Points:
    0
    #14
    What is the benefit of being archived in archive.org?
     
    Nokia999, Nov 8, 2005 IP