I am trying to automate a search on Google’s patent website using Python. Here is a link to the website https://patents.google.com/advanced I need to figure out how to select from the dropdown menus. For example, from the Patent Office dropdown menu, I need to select US as the country.
I have tried identifying the dropdown menu using Selenium find_element_ by_xpath. Following suggested solutions on this website, I have attempted to click on the menu using Selenium select_by visible_text. I have not succeeded.
I am new to both Python and html, so any clues will be much appreciated. Here is the Python code I have tried out to find and select US as the country from the Patent Office dropdown.
#Identify the dropdown menu for Patent Office
off_element=driver.find_element_by_xpath("//dropdown-menu[@change-action='RESTRICT_OFFICE_MENU']/iron-dropdown/div[@id='contentWrapper']/div[@id='menu']/div[@class='style-scope dropdown-menu']")
#Declare the dropdown as an instance of the Select class.
patoff= Select(off_element)
patoff.selectByVisibleText("US")
Here is the error I get
"UnexpectedTagNameException: Message: Select only works on select elements, not on div"
However, I don't see any select elements in the html code. Is my xpath incorrect? Is the dropdown list not visible? Below I have pasted the html code for the dropdown menu. I wasn't sure how much detail I should provide, so I copied the entire path. The country list is at the very bottom. Thank you!
<dropdown-menu show-label="true" multi="" label="Patent Office" change-action="RESTRICT_OFFICE_MENU" class="style-scope restrict-editor">
<span class="label style-scope dropdown-menu">
<span class="style-scope dropdown-menu">Patent Office</span>
<span id="selected" class="style-scope dropdown-menu" hidden="">
<span style="margin: 0px 4px 0px 2px" class="style-scope
dropdown-menu">·</span>
<span class="style-scope dropdown-menu"></span>
</span>
<iron-icon icon="icons:arrow-drop-down" class="style-scope
dropdown-menu x-scope iron-icon-0"><svg viewBox="0 0 24 24"
preserveAspectRatio="xMidYMid meet" focusable="false"
class="style-scope iron-icon" style="pointer-events: none;
display: block; width: 100%; height: 100%;"><g class="style-
scope iron-icon"><path d="M7 10l5 5 5-5z" class="style-scope
iron-icon"></path></g></svg>
</iron-icon><iron-icon icon="icons:arrow-drop-up" class="style-scope
dropdown-menu x-scope iron-icon-0" hidden=""><svg viewBox="0 0 24
24" preserveAspectRatio="xMidYMid meet" focusable="false"
class="style-scope iron-icon" style="pointer-events: none; display:
block; width: 100%; height: 100%;"><g class="style-scope iron-
icon"><path d="M7 14l5-5 5 5z" class="style-scope iron-icon"> .
</path></g></svg>
</iron-icon>
</span>
<iron-dropdown allow-outside-scroll="" horizontal-align="left"
vertical-align="top" class="style-scope dropdown-menu" aria-
disabled="false" aria-hidden="true" style="outline: none; display:
none;"
<div id="contentWrapper" class="style-scope iron-dropdown">
<div class="dropdown-content style-scope dropdown-menu"
slot="dropdown-content" id="menu" multi="">
<div class="style-scope dropdown-menu">
<div class="item style-scope dropdown-menu">WO</div>
<div class="item style-scope dropdown-menu">US</div>
<div class="item style-scope dropdown-menu">EP</div>
<div class="item style-scope dropdown-menu">JP</div>
<div class="item style-scope dropdown-menu">KR</div>
<div class="item style-scope dropdown-menu">CN</div>
<div class="item style-scope dropdown-menu">AE</div>
The following code works for me, using Chrome driver:
import time
import urllib.request
import urllib.response
import re
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By
from selenium.webdriver.support.select import Select
from selenium.webdriver.support.ui import Select
from selenium.webdriver.common.action_chains import ActionChains
import webbrowser
import requests, sys
import requests, csv
from lxml import html
import lxml.html
import requests
Chrome = webdriver.Chrome(executable_path='enter_your_driver_file_path_here')
url = "https://patents.google.com/advanced"
Chrome.get(url)
#Find Patent Office Menu.
patent_menu = Chrome.find_element_by_xpath("//*/span[@class='style-scope dropdown-menu' and text()='Patent Office']")
#Open the Patent Office menu.
patent_menu.click()
#Wait long enough for the patent menu to open, before selecting the country.
Chrome.implicitly_wait(10)
#Find the patent country option, which in this case is the 'US'.
patent_country = Chrome.find_element_by_xpath("//*/div[@id='menu']/div[@class='style-scope dropdown-menu']/div[@class='item style-scope dropdown-menu' and text()='US']")
#Select the patent country option, which in this case is the 'US'.
patent_country.click()