DevOps Stack Exchange
DevOps Stack Exchange

Questions tagged [s3]

6 questions
4
votes
4 answers

How can I use S3 as a filesystem

I'm not sure if it's something I'm doing wrong, or if the S3 web interface is just trash. There are a ton of basic capabilities that work in pretty much any other file storage product (Windows Explorer, Google Drive, OneDrive etc.), which don't work…
jeremywat
  • 162
  • 1
  • 7
2
votes
1 answer

Best strategy/architecture to deploy dozens websites with PostgreSQL in Kubernetes

I am working on a Kubernetes-based solution to host dozens of PHP websites (with future compatibility for Python/Node) using PostgreSQL as the database. The goal is to provide an environment similar to traditional hosting solutions like Plesk or…
mapedraza
  • 21
  • 1
2
votes
0 answers

What happens if I upload a new version of an object already transitioned to Glacier

I created a bucket with versioning enabled and put 500GB of objects there. I also set a lifecycle policy that transitions the whole bucket to S3 Glacier after 30 days and it was already executed. Let's say I have file1.jpg that was already…
Daniel Ford
  • 21
  • 2
0
votes
0 answers

Liveness probe fails for MinIO pod with tls enabled

I am new to kubernetes and trying to setup MinIO on minikube, i am using bitnami MinIO helm-chart. The problem is that the container starts up fine, initiall I am even able to connect to it and list my buckets, however the logs show continuous…
notbob
  • 1
0
votes
1 answer

s3: reading parquet files with a subset of columns as argument; does this reduce data transfer?

I have set of large tables stored as parquets on s3. In python, I'm using: pd.read_parquet(...,columns=columns) I'm reading the files directly from s3, without any database engine whatsoever for preprocessing in between. My question is, will the…
user19976975
  • 1
  • 2
0
votes
1 answer

Convert an existing s3 bucket policy into a terraform-managed policy?

I have a large bucket policy historically maintained by hand. I'd like to move it into CI/terraform (for the policy maintenance), but I don't want TF to own the bucket itself. Is there any way to have TF "import" the huge existing policy and…
John Humphreys
  • 1,570
  • 7
  • 18