Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [amazon-web-services]

42 questions
7
votes
3 answers

Postgres select on a very large table

We've a very large table with more than 2.2 billion rows at present on Postgres 12.5. The total size of the table (including index) stands at 500 GB. There is one query that we need to do in order to find a set of valid rows from the data set and do…
Rahul Sharma
  • 173
  • 1
  • 1
  • 6
4
votes
1 answer

How to setup continuous DB replication from on-prem MS SQL server to PostgreSQL on AWS RDS without reconfiguring source machine?

I am looking for a way to set up continuous data replication between an on-prem Microsoft SQL Server to AWS RDS PostgreSQL. The source table is updated once every 24 hours. The challenge here is that I don't have any control over the source…
Georgi Koemdzhiev
  • 205
  • 4
  • 8
2
votes
1 answer

Problems getting SQL Server linked server to work in web-based admin utility on Windows Server 2022

I have an ASP classic web application based on an SQL Server database, with an admin component. The database has a linked server with Microsoft.ACE.OLEDB.12.0 provider to allow bulk import of records from an access database. Over the years, I have…
user1207313
  • 21
  • 2
2
votes
4 answers

Migrating MySQL 8.0.20 database to AWS Aurora

I originally posted this question on stack overflow as I did not know this service existed and someone suggested I may get a better answer here. I was trying to use the AWS RDS Proxy service and realized that the only compatible versions with the…
WK123
  • 121
  • 4
2
votes
0 answers

AWS MySQL RDS Replica out of disk space suddenly

We've got a MySQL RDS instance running on AWS, with a replica. From Cloudwatch I can see that there was a sudden drop in free storage space, of the total allocated storage space of 100GB. How can I investigate what is using the storage? And remedies…
crazy8
  • 131
  • 2
  • 9
2
votes
1 answer

Presto SQL: TO_UNIXTIME

I want to convert a readable timestamp to UNIX time in Amazon Athena (Presto). For example: I want to convert 2018-08-24 18:42:16 to 1535136136000. Here is my syntax: TO_UNIXTIME('2018-08-24 06:42:16') new_year_ut My error is: …
noobeerp
  • 123
  • 1
  • 1
  • 4
1
vote
0 answers

AWS MYSQL RDS db instance freezes

Ok I'm facing a real crazy issue, I usually connect through AWS VPN Client Endpoint normally and I can access my database. Today I tried and TablePlus just froze, checked if I'm connected through mysql in the terminal and I'm connected, but when I…
Mohammed Elbaz
1
vote
1 answer

Same query, same data, one server query planner costs 50000, other costs 100

I'm running two Postgres 15 (PostgreSQL 15.7 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-12), 64-bit) RDS instances in AWS, one for my staging environment and one for my production environment. We're running a query…
mtbossa
  • 13
  • 2
1
vote
2 answers

SQL Server Combine Partioned Backups Files to One?

Scenario: Every day you receive a SQL Server 2016 database backup set that is composed of multiple partitioned .bak files of size 1GB each: backup1.bak (1GB) backup2.bak (1GB) backup3.bak (1GB) ... backup20.bak (1GB) This database is consistently…
gbeaven
  • 213
  • 2
  • 3
  • 7
1
vote
1 answer

aurora mysql index creation challenges on large tables

I have a table of yearly data [size 500GB = ~1 billion rows] in aurora mysql 3.02.2. requirement is to migrate this table to another aurora mysql [PROD] using DMS. we initiated the DMS task with data validation enabled and also with indexes & PK in…
JollyRoger
  • 11
  • 1
1
vote
0 answers

Refresh materialized view on Postgresql 11 on RDS

We are currently on Postgres 11.13 on AWS RDS. I am trying to create a materialized view that takes about 6-7 minutes to run. What is the best way to keep this MV mostly up to date? I was thinking of pg_cron but I believe that is only available on…
Asif
  • 111
  • 1
1
vote
0 answers

Unable to connect to postgresql EC2 instance from VPN

I have an EC2 instance of timescaledb running on AWS. For security purposes, my team members and I are using OpenVPN so that we have access to it and the same IP address has been defined in the inbound rules of Security group of the EC2…
reinhardt
  • 111
  • 1
1
vote
1 answer

Limiting user access by subnet to Amazon Aurora PostgreSQL

How do I limit user access by IP? For example, assuming I have two non-superusers (user1 and user2), how can allow general access (only limited by security groups) to the instance/cluster by user1 but only allow access to a particular subnet for…
Miles Elam
  • 121
  • 5
1
vote
1 answer

MySQL 5.7 on AWS will not start, and then keeps trying to restart

A few days ago, I tried to backup my database. It is mySQL community edition 5.7 running on an AWS EC2 instance. This has always worked. The backup command was: mysqldump -h localhost -uroot -pmypwd --opt my_db > "/home/ec2-user/dumps/DB-`date…
tjholmes66
  • 113
  • 5
1
vote
0 answers

How do I stop Amazon Web Service's RDS from locking out connections during backups?

I've been using RDS for years, and this only became an issue a few months ago. I was pulling my hair out trying to find the source of the issue... only to figure out it's suddenly RDS. I've made no configuration changes or anything, but now I can…
sadtaco
  • 11
  • 1
1
2 3