Search code examples
amazon-web-servicesamazon-s3aws-sdk-js

AWS S3 files not uploaded properly if total files size exceed 50GB


For my web application I am uploading all the files of a selected directory, if the total files size of that directory is less than 50GB then all the files are uploaded correctly but If goes beyond that then some of the uploaded files size is not matching with the actual files size (less than the actual file size).

I am using AWS JavaScript SDK for this.

Any help/input appreciated. Thanks!


Solution

  • if your single put operation is exceeding the size of 5gb you may observe such inconsistencies.

    what aws says

    The total volume of data and number of objects you can store are unlimited. Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 terabytes. The largest object that can be uploaded in a single PUT is 5 gigabytes.

    for more 5 gb PUToperations consider using multipart upload