python-2.7 web-scraping google-shopping-api

Should I switch from Mechanise to Scrapy or BeautifulSoup?

I'm trying to build a web scraper to scrape Google shopping results. Any ideas where to start? I was using mechanize with python but I've found it has some limitations. Would Scrapy or BeautifulSoup be better?

Solution

Posted on behalf of the OP.

I found this article to be helpful :

http://swizec.com/blog/scraping-with-mechanize-and-beautifulsoup/swizec/5039

I was getting throttling from the Google side.

Get the text of a Tkinter Treeview item using its ID
How to fully understand and implement a recursive factorial function?
How to handle negative inputs in a recursive product function?
python difference between round and int
Matplotlib table falls outside plot area
python pptx align image to center of slide
Python: Package directory does not exist
ModuleNotFoundError: No module named 'cv2'
How to create a new text file using Python
How to pretty format the printing of SQL queries in SQLAlchemy
Problems using MySQL with AWS Lambda in Python
Extract content of <script> with BeautifulSoup
Converting python 3 to 2.7.5 F string to .formated
Write CSV file with double quotes for particular column not working
Multiple versions of Anaconda & Python installation
e pyhow to get python installed path from command line
Get name from python file which called the import
Why is format() throwing ValueError: Unknown format code 'f' for object of type 'str' when I'm not inputting a string?
Python Iterating through a string to look for a Palindrome
Django 1.8 migrate: django_content_type does not exist
'No module named requests' even if I installed requests with pip
Python/sqlite3: is there a way to make database schema figure?
How to create a Sudoku puzzle in Python
range() with x Base (not base 10)
Running powershell script within python script, how to make python print the powershell output while it is running
Can't run python on windows anymore
How to minimize a specific window in Python
Resume code execution from code.interact() in Python
Pandas: nan->None
Is there a way to mock .strip() for unit testing in Python 2.7's unittest module?