c#seleniumselenium-webdriverpuppeteerpuppeteer-sharp
Dynamic website scraping not picking items in C#
I want to site scrape following web page. However, dynamic website scraping libraries like selenium and puppeteersharp do not pick up items shown on the table of this page (see image).
https://www2.asx.com.au/markets/trade-our-cash-market/todays-announcements
None of the above libs list hrefs under Headline column, although if I try to save a screenshot of this page I can see few table rows.
What is the best way to approach this problem?
why aren't these well established libs not working on this page?
Solution
The content you trying to scrape here is inside iframe.
To access it you have to switch to that iframe.
See here example how to switch to iframe with BeautifulSoup.
Here example with Selenium scraping inside iframe.
And here with puppeteersharp
- Why does an empty preprocessor command still evaluate to something?
- How to implement variable sized array within C struct
- Character array typecasting to integer
- How can I exclude non-numeric keys? CS50 Caesar Pset2
- How to get the sign, mantissa and exponent of a floating point number
- Why do MCU libraries use logic operations instead of bitfield structs?
- What kind of implementation can I use for a static associative array on a vintage system with very limited resources?
- Determine libraries to link against for a windows library function?
- Passing macro values to arm linker that places variable at a specific location
- running a program with wildcards as arguments
- How to perform addition of two vectors of 8-bit integers with a single addition in C/C++
- GNU RISC-V Embedded GCC throws "x ISA extension `xw' must be set with the versions" error
- Counting pulses using a swiss flow meter with an Arduino, how is it done?
- How to create a folder in C (need to run on both Linux and Windows)
- Is there any way to compute the width of an integer type at compile-time?
- How can I initialize all members of an array to the same value?
- Is C notably faster than C++
- How to get the Windows SDK version number a program is compiling with at compile time
- Confused by difference between expression inside if and expression outside if
- Equivalent of atoi for unsigned integers
- k&r: Exercise 1-18. Program takes input but doesnt produce any output?
- Using in C thrd_sleep() to either wait for time or interrupt by signal. Example?
- How can I compute `exp(x)/2` when `x` is large?
- c programming: answer always equates to 0
- Is it possible to access a parameter of a function from another function in C?
- Will this expression evaluate to true or false (1 or 0) in C?
- What Is the Return Value of strcspn() When Str1 Does not Contain Str2?
- Mapping a numeric range onto another
- Signalled and non-signalled state of event
- Why is faster to do a branch than a lookup?