Copying lots of files into S3 (and within S3) using s3-bucket-loader

Recently a project I've been working on had the following requirements for a file-set containing roughly a million files varying in individual size from one byte to over a gigabyte; and the file-set size in total being sized between 500gb and one terabyte Store this file-set on Amazon S3 Make this file-set accessible to applications … Continue reading Copying lots of files into S3 (and within S3) using s3-bucket-loader