Any solutions to capture data within a website automatically?

Question

I want to write an application to capture data from a website, and the website are using ajax to retrieve data from server.
Is there any solutions that I can get those data conveniently and store into my own database ? As the data in that website is dynamic, historical data will disappear, and I want to keep track them.

Please suggest any solutions, thanks in advance !

Answer 1

Selenium RC can do this with a little bit of work.\

http://seleniumhq.org/