Search code examples
internet-explorerhttpscreen-scraping

Getting HTTP request from IE

Is there a way to access the http request IE made when the page is already loaded. For instance, I have an application that is opening a browser window. I want to scrape the page, but would like to get the entire http request for that page (not just the URL).

I have downloaded the developer tools, but don't see anything in there for the request.

Thanks.

Solution

  • There's a great utility called "Fiddler" that you can use.

    It is a web debugging proxy, so it'll act as a go-between for all your web requests.

    It's an awesome utility and has helped me many times with things like this.