Is twiceler gone mad?

Discussion in 'All Other Search Engines' started by FFMG, Oct 22, 2007.

  1. #1
    So this new spider has been visiting my site for the past few days.

    http://www.cuill.com/twiceler/robot.html

    I don't really care what they do, but they are visiting random pages, (and are served 404 pages).
    Why are they visiting those pages? What are they trying to achieve?

    No other search engine EVER go to those pages, (not google, yahoo, nobody), so that make me think that the link does not exist and they are trying their luck and my site security.

    Does anybody know more about those guys? should I just ban their IP?

    FFMG
     
    FFMG, Oct 22, 2007 IP
  2. Bernard

    Bernard Well-Known Member

    Messages:
    1,608
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    185
    #2
    Twiceler is all over my forums. Hopefully there will be some return in the future on all the bandwidth it uses.
     
    Bernard, Oct 22, 2007 IP
  3. vpguy

    vpguy Guest

    Messages:
    275
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Forgive my ignorance, but what the heck does Cuill do? They claim to be a search company... yet no search functionality exists on their site. So why are they crawling?
     
    vpguy, Oct 22, 2007 IP
  4. firmaterra

    firmaterra Peon

    Messages:
    756
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #4
    they are only expiremental as far as I can tell, so it may be a while before any search functionality exists. My sites have been hit also but I'll leave them spider all they want at the moment and see what happens later.
     
    firmaterra, Oct 22, 2007 IP
  5. FFMG

    FFMG Well-Known Member

    Messages:
    1,091
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    160
    #5
    Like I said I don't mind new spiders, but I wonder why they are hitting so many 'not found' pages.

    Their algo must be broken or something, 'cause I have no idea where they would have picked up some of those links.

    Either that or they are trying something fishy on my site.

    FFMG
     
    FFMG, Oct 22, 2007 IP
  6. deluxdon

    deluxdon Catch Me If You Can...!!!™ Staff

    Messages:
    25,481
    Likes Received:
    1,943
    Best Answers:
    32
    Trophy Points:
    480
    #6
    deluxdon, Oct 22, 2007 IP
  7. FFMG

    FFMG Well-Known Member

    Messages:
    1,091
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    160
    #7
    Thanks, I'll send them an email.
    And if it doesn't stop I'll ban them, (seen that they ignore robot.txt requests).

    FFMG
     
    FFMG, Oct 22, 2007 IP