Search code examples
vbaseleniumfindelement

VBA+Selenium+Edge Cannot 'find' element

I've tried all kinds of ele.findElementAs--- and cannot "find" a particular (multiply nested) element on a webpage - even though I can visually see the element (and values) when inspecting the webpage.

I've used VBA+Edge+Selenium before and can locate / "find" other elements on this page, but not the one (or similar ones) I need.

url: www.cmegroup.com item: the Price for the December Corn Futures ("ZCZ2")

JSpath: document.querySelector("#main-content > div > div.component.section.cme-homepage-background-gradient-2.pt-5.reverse > div > div:nth-child(8) > div:nth-child(1) > div.component.react.heat-map.loaded > div > div > div:nth-child(1) > div > a.heat-map-card.heat-map-color_1 > div.product-values > div.rate")

snapshot of webpage code above target:

Code from webpage

2

my code sample:

    Sub FindDecCorn()
  
  Dim Edgdriver As New EdgeDriver
  Edgdriver.Start "edge"
  
  Edgdriver.Get "https://cmegroup.com"
  
  ' *** this one works - finds "main-content" ***
    Dim ch As Selenium.WebElement
    Set ch = Edgdriver.FindElementById("main-content")

    'Set ch = driver.FindElementByLinkText("www.cmegroup.com/etc.clientlibs/cmegroupaem/clientlibs/heat-map.cc2d1dd424fd10c5642e7137587e27a7.css")
    Debug.Print ch.tagname, ch.Attribute("id")
  
  ' *** I've tried all kinds of .FindElement(s)ByXXXX --- all failed ***
  ' *** this one fails to find anything with 'product-code' although there are several ***
    Dim myElements As Selenium.WebElements
      Set myElements = Edgdriver.FindElementsByCss("div[class='product-code']")
     For Each myElement In myElements
        Debug.Print myElement.Attribute("innerHTML")
     Next myElement
  
      
  Edgdriver.Quit
    End Sub
Solution

  • Think I've found your problem, as I commented the elements your looing for are loaded in after the page is loaded. After playing about it looks like they are not loaded until scrolled into view.

    Sub main()
Dim Edge As New EdgeDriver

Edge.Start "edge"
Edge.Get "https://cmegroup.com"

' let the page load
Edge.Wait 500
' scroll the page
'Edge.ExecuteScript "window.scrollTo(0, document.body.scrollHeight/4);"
' scroll to bottom (smoothly no jump)
Edge.ExecuteScript "window.scrollTo({top:document.body.scrollHeight, behavior: 'smooth'});"
' wait a little more...
Edge.Wait 500

Dim List As Selenium.WebElements
Dim Item As WebElement
Dim Index As Long: Index = 1

Set List = Edge.FindElementsByClass("product-code")

If List Is Nothing Then
    Debug.Print "couldnt find product-code"
    Exit Sub
End If

Do
    Set Item = List(Index)
    If Item.Text = "ZCZ2" Then
        Exit Do
    Else
        If Index > List.Count Then
            Exit Do
        Else
            Index = Index + 1
        End If
    End If
Loop

If Item Is Nothing Then
    Debug.Print "found product-code but not ZCZ2"
Else
    ' find the parent element then find the desired child element
    Debug.Print Item.FindElementByXPath("../..").FindElementByClass("rate").Text
End If

Edge.Quit

Set Edge = Nothing

End Sub