Adding your site to Archive.org

Discussion in 'Search Engine Optimization' started by slayer__, Jul 15, 2009.

  1. #1
    First you should check your robots.txt

    if you see:
    User-agent: ia_archiver
    Disallow: /
    User-agent: ia_archiver/1.6
    Disallow: /
    
    Code (markup):
    delete this.

    afterward go
    http://www.alexa.com/help/webmasters/request_bot.html
    write your web sites name and push crawl button.
    indexing generally takes 6 months
     
    slayer__, Jul 15, 2009 IP
  2. Pixelrage

    Pixelrage Peon

    Messages:
    5,083
    Likes Received:
    128
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Why would that Alexa crawler do anything for Archive.org?

    This is a good topic though - there is so little information about how to get archive.org to notice your site. Only my oldest site has been cached by it. My 2 and 3 year old sites have not been spidered by it whatsoever, and it's frustrating...
     
    Pixelrage, Jul 15, 2009 IP
  3. xBHx

    xBHx Banned

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    How does Alexa crawler affect arcive.org?
     
    xBHx, Jul 15, 2009 IP
  4. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Canonical, Jul 15, 2009 IP
  5. madihrb

    madihrb Member

    Messages:
    82
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #5
    Well my site is not yet came in archive.
     
    madihrb, Jul 15, 2009 IP