Creating an advance bot trap

Discussion in 'Programming' started by redhits, Nov 30, 2009.

  1. #1
    My problem is that i have a website , that is doing lot's of call in the history for printing stock exchanges data to a user, and lot's of bots are coming to my site.


    I want to create an advance bot trap.
    this means i don't want to block bot by user agents&ips , because those things can easy be changed...
    Also i don't want my user to enter captcha for eachy page results they see.



    Until now, i already made this, in order to confuse bots.

    1. Where i have forms i changed the <input type=text name=NAME, to something like name=seopink1, name=seopink2, insted of url, website, name or e-mail

    2. Where it was possible i added sessions&cookies, and i rechecked if the session is already registered.

    The idea was good.. most bots do not know to load frames, store session , and they only complete of a form , because they match input name=EMAIL,etc ...

    But... i can only use these method on less then 1% of my website.

    What i want is something more advance.
    I want to block robots, (i will make an exception for google/yahoo/msn), for pages like
    site.com/history/romania/XX2
    site.com/history/romania/XX1
    (XXX is an company name)


    Now i can only do this by.
    1. Putting the results in an IFRAME, and most robots only read pure html code, they don't read images , frames

    2. Load some kind of javascript... because robots do not load javascript.... but what kind of javascript i can add?! all my urls are like site.com/history/country/company

    .... and they are url_Rewrited to engine.php


    please give me advices...
     
    redhits, Nov 30, 2009 IP