Search code examples
pythongoogle-colaboratory

How do I open a .gz file from a website in Goolgle colab?

I need help downloading a .gz file in Google colab. The file is here but I can't download it on my local drive due to the size, it's 8 GB. I have tried to different ways to do it but I'm stuck.

Any help would be greatly appreciated!

file https://mcfp.felk.cvut.cz/publicDatasets/IoT-23-Dataset/iot_23_datasets_small.tar.gz

Solution

  • You can use curl to download and tar to extract it.

    url = 'https://mcfp.felk.cvut.cz/publicDatasets/IoT-23-Dataset/iot_23_datasets_small.tar.gz'
!curl {url} | tar xz

    It should take around 15 minutes. The files will be extracted here

    /content/opt/Malware-Project/BigDataset/IoTScenarios

    See this example notebook