Internet Archive? (aka waybackmachine)

Discussion in 'All Other Search Engines' started by PYJAMA, Oct 20, 2005.

0
  1. #1
    Can anyone explain why my site has been ignored for all of '05 my The Internet Archive?

    Is it:

    1. My robots.txt (have a look)
    2. The tremendous amount of pages it must index.
    3. The Legality of it all

    thanks for any suggestions or thoughts

    -PYJAMA
     
    PYJAMA, Oct 20, 2005 IP
  2. Smyrl

    Smyrl Tomato Republic Staff

    Messages:
    13,740
    Likes Received:
    1,702
    Best Answers:
    78
    Trophy Points:
    510
    #2
    Have you seen any 2005 pages archived? I haven't.

    Shannon
     
    Smyrl, Oct 20, 2005 IP
  3. Design Agent

    Design Agent Peon

    Messages:
    3,061
    Likes Received:
    154
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Its an archive, try again in 2006 ;)
     
    Design Agent, Oct 20, 2005 IP
    Smyrl likes this.
  4. PYJAMA

    PYJAMA Peon

    Messages:
    79
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Very true, but still curious why the delay....

    -PYJAMA
     
    PYJAMA, Oct 20, 2005 IP
  5. Design Agent

    Design Agent Peon

    Messages:
    3,061
    Likes Received:
    154
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Design Agent, Oct 20, 2005 IP
  6. PYJAMA

    PYJAMA Peon

    Messages:
    79
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Is it:

    1. My robots.txt (have a look)
    2. The tremendous amount of pages it must index.
    3. The Legality of it all
    4. Have you seen any 2005 pages archived? I haven't

    -PYJAMA
     
    PYJAMA, Oct 21, 2005 IP
  7. torunforever

    torunforever Peon

    Messages:
    414
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #7
    http://www.archive.org/about/faqs.php#103

     
    torunforever, Oct 21, 2005 IP
  8. Merkersarl

    Merkersarl Peon

    Messages:
    357
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Despite the time delay message it is a fact that they have been very slow/lax in crawling over the last 18 months.
     
    Merkersarl, Oct 22, 2005 IP
  9. Design Agent

    Design Agent Peon

    Messages:
    3,061
    Likes Received:
    154
    Best Answers:
    0
    Trophy Points:
    0
    #9
    The internet has got alot bigger in the last 18 months..
     
    Design Agent, Oct 22, 2005 IP
  10. Merkersarl

    Merkersarl Peon

    Messages:
    357
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    0
    #10
    True, true, true. Why did that growth take them by surprise?
     
    Merkersarl, Oct 23, 2005 IP