What is the time limit of an upload stream using upload api of amazon s3? Does it have to be complete in a certain timeframe?
For context I'm using nodejs, here is the function I'm referring to.
I'm assembling an archive and piping it to Passthrough stream and sending via upload api, but assembling the archive might be time consuming (might be an hour or more even).
Would I get timeout exception?
Thank you in advance
There's no timeout, at least it's not a publicly known quota but you need to account for other potential timeouts such as your server's configuration. For example if you're running this from a Lambda you'd have a 15 minute timeout.
I would recommend uploading your archive as a multipart upload where you initiate the upload, send it parts as pieces of your archive become available and then signal that it's complete. S3 will handle concatenating all of the parts into a single object.