As stated, I'm trying to download this dataset of zip folders containing images: https://data.broadinstitute.org/bbbc/BBBC006/ and store them in an s3 bucket so I can later unzip them in the bucket, reorganize them, and pull them in smaller chunks into a vm for some computation. Problem is, I don't know how to get the data from https://data.broadinstitute.org/bbbc/BBBC006/BBBC006_v1_images_z_00.zip for example or any of the other ones, to then send it s3 this is my first time using aws or really any cloud platform so please bear with me :]
Asked
Active
Viewed 3,142 times
1 Answers
0
You can't manipulate data in S3, you can only upload to S3, download from S3 and delete from S3, but you can't for example "unzip" in S3. If you want to upload the content of your unzipped archives you will have to unzip them locally on your laptop and then upload to S3.
If you are on Windows you can use a S3 client like S3 Browser to use your S3 storage.
Hope that helps :)
MLu
- 26,247