Search code examples
object-detectiondasktfrecorddask-delayed

How to load my train.tfrecord files in saturn cloud for running via Dask?


I am working on Object Detection and I have two record files. Train.tfrecord(1.6GB) and Test.tfrecord(65MB) file. How do I load the training file in Saturn cloud, as I want to speed up the training time using Dask in Saturn Cloud?


Solution

  • As @SultanOrazbayev mentioned, since Saturn runs on AWS, the best way is to put your data in an S3 bucket. Then you can access it using whichever library you prefer. Normally we recommend using s3fs.

    Note: I work at Saturn Cloud.