Im in the process of developing a custom IDX solution for a real estate website. The solution will let users search properties from a mysql database. my MLS is asking me to "Please provide more information on screen scraping, how do you identify it, what is done when someone scrapes, what do you do to prevent it. Please provide a detailed answer" any thoughts on this? I need to be able to allow the SE's to spider my stie! Hopefully I posted this in the right section
The only person around here that I know of who can prevent page scraping is krakjoe. He does not divulge his method, but the thread where this is discussed is here: http://forums.digitalpoint.com/showthread.php?t=194229 Until you learn or buy those secret arts, you best tell your client there is no way to prevent anything posted to the web from being scraped -- which simply means extracting the text data from the page.
With the right amount of knowledge and or money, nothing can't be done. Edit: I was really determined to break it tonight too, except krakjoe removed the page.... Peace,