Search code examples
google-chromecurlgetgoogle-search

Get request to Google Search

I'm trying to get HTML with search results from Google. With sending GET request for example to:

https://www.google.ru/?q=1111

But if in browser all is ok, when I'm trying to use it with curl or to get source with "View source" in Google, there is only some Javascript code, no search result. Is that some type of protection? What can I do?

Solution

  • You can load it in the browser and then scrape results via Javascript.

    Or you can use Google API, but seems that it requires payment if you will request it more then 100 times per day.