Digital Point Forums
iKobo

Go Back   Digital Point Forums > Search Engines > All Other Search Engines
Reload this Page Ask Jeeves hitting thousands of pages on a 12 page site...
Google Analytics
Log In to view
your analytics
Register FAQ/Rules Search Today's Posts Mark Forums Read

Reply
Page 1 of 2 1 2
 
Thread Tools
  #1  
Old Jul 6th 2005, 11:25 am
AfterHim.com's Avatar
AfterHim.com AfterHim.com is offline
of the Nightfall
Recent Blog: Creating a Strong Brand with Twitter
  
Join Date: Dec 2004
Location: There's no place like 127.0.0.1
Posts: 1,880
AfterHim.com will become famous soon enoughAfterHim.com will become famous soon enough
Ask Jeeves hitting thousands of pages on a 12 page site...
My new site has about 12 pages right now, but Ask Jeeves has hit it over 10,000 times so far this month:

AskJeeves 11725+4 48.20 MB 05 Jul 2005 - 16:31

Over 48 megabytes of data transfered...google has hit the site 31 times this month.

Anyone know why?
__________________
FREE 30 Day Niche Marketing Course
Beta preview - only available to DP members, please don't share this link.
Reply With Quote
  #2  
Old Jul 6th 2005, 11:47 am
kalius's Avatar
kalius kalius is offline
Twilight Vanquisher
  
Join Date: Feb 2005
Location: Madison, WI
Posts: 601
kalius will become famous soon enough
I have banned ask from most of my sites/pages because of this, eats bw like hell for 2 visitors a month. I have banned it on robots and only allow a few pages of the site.
__________________
Paid Directories and Text Links Ads || || Creative Link Building

. $3.00 gets you 5 url title combos. You can submit site in more than one category.
Reply With Quote
  #3  
Old Jul 6th 2005, 1:11 pm
ServerUnion's Avatar
ServerUnion ServerUnion is offline
Starcaller
Recent Blog: Who Still Uses the Yellowpages?
  
Join Date: Mar 2005
Location: Madison, Wisconsin
Posts: 3,431
ServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud of
I have a site that got hit almost 400K times, they didn't send me even 1 visitor. strange little man that jeeves...
__________________
$$$ WTB: Health related links and blog posts. $$$
Reply With Quote
  #4  
Old Jul 6th 2005, 2:26 pm
Peter Sellers's Avatar
Peter Sellers Peter Sellers is offline
Champion of the Naaru
  
Join Date: Jul 2005
Location: TheParty
Posts: 116
Peter Sellers is on a distinguished road
Quote:
Originally Posted by ServerUnion
strange little man that jeeves...


ke .. lovely stuff
Reply With Quote
  #5  
Old Jul 6th 2005, 2:29 pm
ServerUnion's Avatar
ServerUnion ServerUnion is offline
Starcaller
Recent Blog: Who Still Uses the Yellowpages?
  
Join Date: Mar 2005
Location: Madison, Wisconsin
Posts: 3,431
ServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud of
reminds me when we would ring people doorbell and run and hide. The least jeeves could do is leave a flaming bag of poo so I knew he stopped by.
__________________
$$$ WTB: Health related links and blog posts. $$$
Reply With Quote
  #6  
Old Jul 6th 2005, 2:32 pm
ferret77's Avatar
ferret77 ferret77 is offline
Heretic
  
Join Date: Apr 2004
Location: A Tropical Island
Posts: 5,276
ferret77 is a jewel in the roughferret77 is a jewel in the roughferret77 is a jewel in the rough
ask jeeves took 4 gigs of bandwidth from one of my sites the other day
Reply With Quote
  #7  
Old Jul 6th 2005, 8:03 pm
AfterHim.com's Avatar
AfterHim.com AfterHim.com is offline
of the Nightfall
Recent Blog: Creating a Strong Brand with Twitter
  
Join Date: Dec 2004
Location: There's no place like 127.0.0.1
Posts: 1,880
AfterHim.com will become famous soon enoughAfterHim.com will become famous soon enough
Does GoogleGuy have a brother? Maybe JeevesGuy who could answer a few questions about the bandwidth theives...
__________________
FREE 30 Day Niche Marketing Course
Beta preview - only available to DP members, please don't share this link.
Reply With Quote
  #8  
Old Jul 7th 2005, 12:50 am
l234244 l234244 is offline
of the Nightfall
Recent Blog: USB speakers
  
Join Date: Jul 2004
Posts: 1,196
l234244 is infamous around these parts
I think they must be building a new index or something because I have seen exactly the same as everyone else.
__________________
Gadgets | Web Directory | |
Reply With Quote
  #9  
Old Jul 7th 2005, 5:51 am
rustybrick's Avatar
rustybrick rustybrick is offline
User ID 3
Recent Blog: Daily Search Forum Recap: November 20, 2009
  
Join Date: Mar 2004
Location: New York
Posts: 363
rustybrick has a spectacular aura aboutrustybrick has a spectacular aura aboutrustybrick has a spectacular aura about
So you know, Ask (Teoma) supports the Crawl-Delay.

Quote:
Q: Can I control the crawler request rate from Teoma spider to my site?

A: Yes. We support the "Crawl-Delay" robots.txt directive. Using this directive you may specify the minimum delay between two successive requests from our spider to your site.
http://sp.ask.com/docs/about/aj/teoma.htm#20
__________________
Barry Schwartz, CEO of RustyBrick - Web Development

Reply With Quote
  #10  
Old Jul 7th 2005, 7:03 am
Scorpion's Avatar
Scorpion Scorpion is offline
Hand of A'dal
Recent Blog: Google drops PageRank from webmaster tools
  
Join Date: Mar 2005
Location: India
Posts: 257
Scorpion is on a distinguished road
Thanks for the link, i am also facing the same problem


Quote:
Originally Posted by rustybrick
So you know, Ask (Teoma) supports the Crawl-Delay.

http://sp.ask.com/docs/about/aj/teoma.htm#20
__________________
Web Directory
Reply With Quote
  #11  
Old Jul 7th 2005, 10:42 am
ServerUnion's Avatar
ServerUnion ServerUnion is offline
Starcaller
Recent Blog: Who Still Uses the Yellowpages?
  
Join Date: Mar 2005
Location: Madison, Wisconsin
Posts: 3,431
ServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud of
so has anyone actually every received hits fron jeeves? Do they have a market chare?
__________________
$$$ WTB: Health related links and blog posts. $$$
Reply With Quote
  #12  
Old Jul 8th 2005, 1:15 pm
swoop's Avatar
swoop swoop is offline
Hand of A'dal
  
Join Date: Jul 2005
Posts: 438
swoop is an unknown quantity at this point
Any way to tell Mr. Jeeves to click a link while he's visiting?

I do get an occasional visitor from him, but not many.
Reply With Quote
  #13  
Old Jul 8th 2005, 6:23 pm
thanol thanol is offline
Peon
  
Join Date: Jul 2005
Posts: 3
thanol is on a distinguished road
Quote:
Originally Posted by ServerUnion
so has anyone actually every received hits fron jeeves? Do they have a market chare?
On one of my sites, Ask accounts for 1% of all search engine referals, so they aren't really that important anymore, imo.
Reply With Quote
  #14  
Old Jul 15th 2005, 8:38 am
av1 av1 is offline
Champion of the Naaru
  
Join Date: Apr 2005
Posts: 168
av1 is an unknown quantity at this point
ok i added robots.txt for teoma, now what?they dont seem to read it too often..
Reply With Quote
  #15  
Old Jul 15th 2005, 11:48 am
ServerUnion's Avatar
ServerUnion ServerUnion is offline
Starcaller
Recent Blog: Who Still Uses the Yellowpages?
  
Join Date: Mar 2005
Location: Madison, Wisconsin
Posts: 3,431
ServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud ofServerUnion has much to be proud of
they will read it daily to save bandwidth
__________________
$$$ WTB: Health related links and blog posts. $$$
Reply With Quote
  #16  
Old Jul 19th 2005, 9:05 am
PinoyIto's Avatar
PinoyIto PinoyIto is offline
Astral Walker
Recent Blog: The easiest way to make money and it?s sure
  
Join Date: Dec 2004
Location: Philippines
Posts: 5,552
PinoyIto has a spectacular aura aboutPinoyIto has a spectacular aura about
all my sites too... get lot of delay visit of this ask jeeves 100k of thousands and really eats lot of bandwidth but never get any traffic from them.
Reply With Quote
  #17  
Old Jul 19th 2005, 9:21 am
Perrow Perrow is offline
of the Nightfall
Recent Blog: Failing early
  
Join Date: Mar 2005
Location: Uppsala, Sweden
Posts: 1,308
Perrow is just really nicePerrow is just really nicePerrow is just really nicePerrow is just really nice
Since may first they've hit my site a total of 115 times with their spider, 0 refferrals.
Reply With Quote
  #18  
Old Jul 23rd 2005, 9:04 pm
David26 David26 is offline
of the Nightfall
  
Join Date: Jul 2005
Posts: 1,017
David26 will become famous soon enough
Yeah I dont really pay attention to my stats since so many bots spider my site, but askjeeves does spider a lot of pages at once.
Reply With Quote
  #19  
Old Jul 23rd 2005, 9:26 pm
Shoemoney's Avatar
Shoemoney Shoemoney is offline
$
  
Join Date: Sep 2004
Location: Nebraska, USA
Posts: 4,470
Shoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond reputeShoemoney has a reputation beyond repute
maybe you should ask jeaves =P
Reply With Quote
  #20  
Old Jul 24th 2005, 5:25 am
Cyclops's Avatar
Cyclops Cyclops is offline
sensei
  
Join Date: Nov 2004
Location: Gold Coast Queensland Australia
Posts: 1,242
Cyclops has a spectacular aura aboutCyclops has a spectacular aura aboutCyclops has a spectacular aura about
Ask Jeeves has hit one of my sites 8 thousand times this month but my other sites ~ 100 times.
Reply With Quote
Reply
Page 1 of 2 1 2

Bookmarks

« Previous Thread | Next Thread »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Design logo, get FREE links on 5 sites with thousands of pages in G or buy $12+/site jeff123 Freebies 0 Jun 27th 2005 9:43 am
Get Thousands Visitors to your site!Very Very Cheap! wdsbg Buy, Sell or Trade 5 May 29th 2005 2:25 am
Lycos is hitting my site hard web-rover All Other Search Engines 3 Apr 19th 2005 2:00 am
MSN is hitting me 8x as hard as G david_sakh Microsoft 7 Feb 19th 2005 11:03 pm
Google losing thousands of pages? Owlcroft Google 9 Oct 26th 2004 11:58 pm


All times are GMT -8. The time now is 3:34 am.

Digital Point Solutions - Library - Top