Search code examples
rpauipathuipath-studio

Data scraping: How to read all table content from multiple pages (using next page)?

I am trying to scrape data from web page with (UiPath) Data Scraping wizard. The table is well structured and on first click suggest to read whole table.

I want all the data, so I set MaxNumberOfResults to 0.

ExtractData setup

Next button was properly marked and it does work except last page. The issue is that the procedure break down due to looking for next button, because it exist on the page, but it is not possible to push it, so it expect that there are more pages.

I tested the "Next" button with "Element Exist" and it is all the time True even on last page.

Element exist

Last page buttons look like this last page buttons

Any suggestion or similar experience?

Solution

  • Try using the UiExplorer, some buttons have extra fields that aren't always used in the selector, there could be additional fields that could be used to differentiate between the working Next button and the greyed out Next button.

    Or perhaps you could use the Get Attribute activity, if the Next button has a field such as enabled which could return true or false depending on whether there is another page.