1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Cool tool that will alert you when and what spider visited your site.

Discussion in 'Products & Tools' started by ryanturner.com, Jan 17, 2005.

  1. #1
    This little php script will alert you when various spiders hit your site. Its great when you just published a new content and want to know the minute an engine picks it up.

    spider alerting

    Just include the script - change your email address and you are off to the races.

    Note: its obviously not intended to be placed site-wide - as the thing is going to email you once for every page the spider hits.

    Its free so spread the love. All comments / hatemail welcome ;)
     
    ryanturner.com, Jan 17, 2005 IP
  2. miko67

    miko67 Well-Known Member

    Messages:
    769
    Likes Received:
    59
    Best Answers:
    0
    Trophy Points:
    120
    #2
    :( Maybe it's overloaded right now... I can't get through
     
    miko67, Jan 17, 2005 IP
  3. mopacfan

    mopacfan Peon

    Messages:
    3,273
    Likes Received:
    164
    Best Answers:
    0
    Trophy Points:
    0
    #3
    too many spiders hitting that site no doubt :)
     
    mopacfan, Jan 17, 2005 IP
  4. LinkBliss

    LinkBliss Peon

    Messages:
    697
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I had someone else's tool like this installed, I wasn't so interested by it.. I need something that will analyze my logs and/or track and generate a log of spider activity.. I want to know when and how deep deep crawls occur and go.. not an individual page.

    Eric
     
    LinkBliss, Jan 17, 2005 IP
  5. exam

    exam Peon

    Messages:
    2,434
    Likes Received:
    120
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I think a good logfile analyzer is more useful, but nothing against your tool ryan, it's good if you want to be notified.
     
    exam, Jan 17, 2005 IP
  6. nevetS

    nevetS Evolving Dragon

    Messages:
    2,544
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    135
    #6
    the page loaded for me, but the download didn't :(
     
    nevetS, Jan 17, 2005 IP
  7. craige

    craige Peon

    Messages:
    90
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You can also use www.crawler-alert.com which does somthing similar.
     
    craige, Jan 27, 2005 IP
  8. ryanturner.com

    ryanturner.com Peon

    Messages:
    57
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    sorry... about the 404 its back... hope it helps someone....

    spider alerting
     
    ryanturner.com, Jan 28, 2005 IP
  9. ryanturner.com

    ryanturner.com Peon

    Messages:
    57
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #9
    craige - checked out www.crawler-alert.com - its VERY similiar only you get the code to customize as you see fit and customize what spiders you are interested in etc.

    >rt
     
    ryanturner.com, Jan 28, 2005 IP
  10. craige

    craige Peon

    Messages:
    90
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Ryan, I looked at your script and it looks like a cool prgram. I justed downloaded it to give it a try.
     
    craige, Jan 28, 2005 IP
  11. piniyini

    piniyini Well-Known Member

    Messages:
    514
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    170
    #11
    Hey nice script ryan

    I modified it to something different, you can check it out at www.toseef.com/crawled.php its very simple really just chuck the data in a db instead of emailing it

    If anyone wants it, just let me know i'll release it on here when I get home

    Thanks
     
    piniyini, Feb 1, 2005 IP