AskJeeves going nuts?

Discussion in 'All Other Search Engines' started by darqSHADOW, Nov 25, 2004.

0
  1. #1
    Has anyone else noticed that AskJeeves is doing a deep crawl? I've had over 50k hits this month from them, where-as I normally only recieve a few hundred. They've also managed to eat over 10GB of bandwidth in that time.

    DS
     
    darqSHADOW, Nov 25, 2004 IP
  2. darksat

    darksat Guest

    Messages:
    1,239
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #2
    How many pages have they crawled?
     
    darksat, Nov 25, 2004 IP
  3. Thewormman

    Thewormman Peon

    Messages:
    95
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yep I have had 130,000 pages of a new site crawled in last week or two, a constant 5 pages per minute

    Only seen them take 1 page at a time before :eek:

    Go figure??
     
    Thewormman, Nov 25, 2004 IP
  4. ResearchTechs

    ResearchTechs Peon

    Messages:
    71
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I had 30+ sites hit in my first week online, but my site name doesn't even show up on their search? (Check it for ResearchTechs). Any idea what's going on there?
     
    ResearchTechs, Dec 4, 2004 IP
  5. melfan

    melfan Peon

    Messages:
    644
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Same experience on one of my content sites.
     
    melfan, Dec 4, 2004 IP
  6. Thewormman

    Thewormman Peon

    Messages:
    95
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #6
    It is still on my site having had 225000 pages and I can't find more than the index page on their search.
    If it doesn't show soon I think there will be a new addition to my robots txt file, I don't need them to use all my bandwidth. :mad: And give nothing in return.
     
    Thewormman, Dec 4, 2004 IP