Search code examples
pythonwebweb-crawler

F12 Network response garbled characters

This is my first time to climb such data, I do not know why his data does not show up, using python's chardet library does not work. Is there someone who can help me? Thank you!

I tried to crawl through the data, but the data seems to be garbled

enter image description here

Solution

  • This isn't text. Inspecting the response headers of some of those responses shows

    content-type: application/x-protobuf

    That's a binary format that can't be parsed without the message specification. It's used as the message format in gRPC.

    You can check the Protocol Buffer Basics: Python tutorial at the Protobuf site to understand how it works.