Search code examples
amazon-web-servicesjupyter-notebookstorageamazon-sagemaker

How do you clear the persistent storage for a notebook instance on AWS SageMaker?


So I'm running into the following error on AWS SageMaker when trying to save:

Unexpected error while saving file: untitled.ipynb [Errno 28] No space left on device

If I remove my notebook, create a new identical one and run it, everything works fine. However, I'm suspecting the Jupyter checkpoint takes up too much space if I save the notebook while it's running and therefore I'm running out of space. Sadly, getting more storage is not an option for me, so I'm wondering if there's any command I can use to clear the storage before running my notebook?

More specifically, clearing the persistent storage in the beginning and at the end of the training process.

I have googled like a maniac but there is no suggestion aside from "just increase the amount of storage bro" and that's why I'm asking the question here.

Thanks in advance!


Solution

  • If you don't want your data to be persistent across multiple notebook runs, just store them in /tmp which is not persistent. You have at least 10GB. More details here.