Search code examples
javaandroidweb-scrapingjsoup

Android Java JSoup Search then retrieve results

I am using JSoup to scrape/parse the data from [url] but I need to be able to also to fill in the Start Date and End Date fields on the webpage.

Any help would be appreciated on this problem,

Thanks

Solution

  • There are two ways to retrieve that data. If you look in your browsers developer tools network tab you can see there is a POST AJAX request done when you enter start+end dates and click search, and that request returns JSON. So you can use HTTP client to make such request and parse JSON with Jackson, GSON or any other JSON parser.

    Or if you really want to enter data in form fields and submit a form - you'd have to use Selenium WebDriver for that. But that's a terrible overkill.