Wayback Machine....using what "spider"

Discussion in 'Search Engine Optimization' started by RH78, Feb 15, 2007.

  1. #1
    Hey guys,

    My boss tried to view our website by using the "Wayback Machine" website, and was unable to because of our extensive robots.txt file. He wants to look at it so does anyone know what "spider" the Wayback Machine uses so I can allow it?


    Thanks!!
     
    RH78, Feb 15, 2007 IP
  2. ghoti

    ghoti Peon

    Messages:
    139
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    ghoti, Feb 15, 2007 IP
  3. RH78

    RH78 Peon

    Messages:
    158
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    awesome...thanks!!!
     
    RH78, Feb 15, 2007 IP