Search code examples
htmlscreen-scrapinghtml-parsing

capturing ajax requests


I want to capture an ajax http request w/ all of its headers/cookies/post params being sent to save it so I can scrape it later.

I can't find a good way of doing this with firefox or chrome. Firebug truncates long post paramters saying "... Firebug request size limit has been reached by Firebug. ... " in the middle of it, which doesn't help me.

Any suggestions?


Solution

  • You can use Fiddler. It captures all port 80 traffic between you and the server for later review. In it you can then look at all the headers, cookies, parameters, etc.. all in Raw or organized forms for each and every request (both normal and ajax calls).

    It has proven to be invaluable to me in debugging my ajax heavy web app.