Search code examples
screen-scrapingdata-protection

Whats a good way to protect a link database from automatic scrapers?


I have a large link database, that I would want to protect against others who would want to copy them. Is there anything I can do other than force people to enter a CAPTCHA before each link?


Solution

  • you can output the links using ROT13, and then use javascript to put them back to normal. this way, the scrapers must support javascript in order to steal your links, which should cut down on the number of eligible scrapers

    bonus points: replace ROT13 with something harder, and obfuscate your 'decode' javascript.