Search code examples
python-3.xmenudropdown

Trouble selecting from Google Dropdown menu using Selenium (Python)


I am trying to automate a search on Google’s patent website using Python. Here is a link to the website https://patents.google.com/advanced I need to figure out how to select from the dropdown menus. For example, from the Patent Office dropdown menu, I need to select US as the country.

I have tried identifying the dropdown menu using Selenium find_element_ by_xpath. Following suggested solutions on this website, I have attempted to click on the menu using Selenium select_by visible_text. I have not succeeded.

I am new to both Python and html, so any clues will be much appreciated. Here is the Python code I have tried out to find and select US as the country from the Patent Office dropdown.

#Identify the dropdown menu for Patent Office

off_element=driver.find_element_by_xpath("//dropdown-menu[@change-action='RESTRICT_OFFICE_MENU']/iron-dropdown/div[@id='contentWrapper']/div[@id='menu']/div[@class='style-scope dropdown-menu']")


#Declare the dropdown as an instance of the Select class.

    patoff= Select(off_element)
    patoff.selectByVisibleText("US")

Here is the error I get

"UnexpectedTagNameException: Message: Select only works on select elements, not on div"

However, I don't see any select elements in the html code. Is my xpath incorrect? Is the dropdown list not visible? Below I have pasted the html code for the dropdown menu. I wasn't sure how much detail I should provide, so I copied the entire path. The country list is at the very bottom. Thank you!

<dropdown-menu show-label="true" multi="" label="Patent Office" change-action="RESTRICT_OFFICE_MENU" class="style-scope restrict-editor">

    <span class="label style-scope dropdown-menu">
      <span class="style-scope dropdown-menu">Patent Office</span>
      <span id="selected" class="style-scope dropdown-menu" hidden="">
        <span style="margin: 0px 4px 0px 2px" class="style-scope 
         dropdown-menu">·</span>
        <span class="style-scope dropdown-menu"></span>
      </span>
      <iron-icon icon="icons:arrow-drop-down" class="style-scope 
        dropdown-menu x-scope iron-icon-0"><svg viewBox="0 0 24 24" 
        preserveAspectRatio="xMidYMid meet" focusable="false" 
        class="style-scope iron-icon" style="pointer-events: none; 
        display: block; width: 100%; height: 100%;"><g class="style-          
        scope iron-icon"><path d="M7 10l5 5 5-5z" class="style-scope 
        iron-icon"></path></g></svg>    
  </iron-icon><iron-icon icon="icons:arrow-drop-up" class="style-scope 
    dropdown-menu x-scope iron-icon-0" hidden=""><svg viewBox="0 0 24 
    24" preserveAspectRatio="xMidYMid meet" focusable="false" 
    class="style-scope iron-icon" style="pointer-events: none; display: 
    block; width: 100%; height: 100%;"><g class="style-scope iron- 
    icon"><path d="M7 14l5-5 5 5z" class="style-scope iron-icon"> . 
    </path></g></svg>   
  </iron-icon>
    </span>
    <iron-dropdown allow-outside-scroll="" horizontal-align="left" 
     vertical-align="top" class="style-scope dropdown-menu" aria- 
     disabled="false" aria-hidden="true" style="outline: none; display: 
     none;"

    <div id="contentWrapper" class="style-scope iron-dropdown">
      <div class="dropdown-content style-scope dropdown-menu" 
         slot="dropdown-content" id="menu" multi="">
        <div class="style-scope dropdown-menu">

            <div class="item style-scope dropdown-menu">WO</div>

            <div class="item style-scope dropdown-menu">US</div>

            <div class="item style-scope dropdown-menu">EP</div>

            <div class="item style-scope dropdown-menu">JP</div>

            <div class="item style-scope dropdown-menu">KR</div>

            <div class="item style-scope dropdown-menu">CN</div>

            <div class="item style-scope dropdown-menu">AE</div>


Solution

  • The following code works for me, using Chrome driver:

    import time
    
    import urllib.request
    
    import urllib.response
    
    import re
    
    from selenium import webdriver
    
    from selenium.webdriver.common.keys import Keys
    
    from selenium.webdriver.support.ui import WebDriverWait
    
    from selenium.webdriver.support import expected_conditions as EC
    
    from selenium.webdriver.common.by import By
    
    from selenium.webdriver.support.select import Select
    
    from selenium.webdriver.support.ui import Select
    
    from selenium.webdriver.common.action_chains import ActionChains
    
    import webbrowser
    
    import requests, sys
    
    import requests, csv
    
    from lxml import html
    
    import lxml.html
    
    import requests
    
    Chrome = webdriver.Chrome(executable_path='enter_your_driver_file_path_here')
    
    url = "https://patents.google.com/advanced"
    
    Chrome.get(url)
    
    #Find Patent Office Menu.
    patent_menu = Chrome.find_element_by_xpath("//*/span[@class='style-scope dropdown-menu' and text()='Patent Office']") 
    
    #Open the Patent Office menu.
    patent_menu.click() 
    
    #Wait long enough for the patent menu to open, before selecting the country.
    Chrome.implicitly_wait(10) 
    
    #Find the patent country option, which in this case is the 'US'.
    patent_country = Chrome.find_element_by_xpath("//*/div[@id='menu']/div[@class='style-scope dropdown-menu']/div[@class='item style-scope dropdown-menu' and text()='US']")
    
    #Select the patent country option, which in this case is the 'US'.
    patent_country.click()