Search code examples
pythonseleniumselenium-webdrivershadow-domqueryselector

Can't locate elments within shadow-root (open) using Python Selenium

I'm trying to get the content under Signers, Counter Signers and X509 Signers from https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details

from selenium import webdriver
op = webdriver.ChromeOptions()
op.add_argument('headless')
driver = webdriver.Chrome(executable_path="/Desktop/chromedriver", options=op)
details_url = "https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details"

driver.get(details_url)
element = driver.find_element_by_xpath("/html/body/vt-ui-shell")
print(element.text)

The result doesn't include the parts under Signers, Counter Signers and X509 Signers

result

I also tried to do

driver.find_element_by_xpath("//*[@id="details"]//div/vt-ui-signature-info//vt-ui-expandable/span")

to locate that part, but it ended up giving me

NoSuchElementException: Message: no such element: Unable to locate element
Solution

  • The Signers fields e.g. Microsoft Windows are within nested #shadow-root (open).

    shadowroot

    Solution

    To extract the text Microsoft Windows you have to use shadowRoot.querySelector() and you can use the following Locator Strategy:

    • Code Block:

      driver.get('https://www.virustotal.com/gui/file/03d1316407796b32c03f17f819cca5bede2b0504ecdb7ba3b845c1ed618ae934/details')
print(driver.execute_script("return document.querySelector('file-view').shadowRoot.querySelector('vt-ui-file-details').shadowRoot.querySelector('vt-ui-signature-info').shadowRoot.querySelector('vt-ui-expandable-detail').shadowRoot.querySelector('slot')").text)

    • Console Output:

      Microsoft Windows

    References

    You can find a couple of relevant discussions in: