Search code examples
pythonpython-3.xurllib2

How can I use url lib using a json file


I'm trying to get data from a json link, but I'm getting this error: TypeError: can't concat str to bytes

This is my code:

l = "https://www.off---white.com/en/IT/men/products/omch016f18d471431088s"
url = (l+".json"+"?porcoiddio")
req = urllib.request.Request(url, headers)
response = urllib.request.urlopen(req)

size_opts = json.loads(response.decode('utf-8'))['available_sizes']

How can I solve this error?


Solution

  • Your question answer is change your code to:

    size_opts = json.loads(response.read().decode('utf-8'))['available_sizes']
    

    Change at 2018-10-02 22:55 : I view your source code and found Response 503 , the reason why you got 503 is that request did not contain cookies:

    req = urllib.request.Request(url, headers=headers)
    

    you have update your headers.

    headers.update({"Cookie":cookie_value})
    req = urllib.request.Request(url, headers=headers) # !!!! you need a headers include cookies !!!!