Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [vldb]

For questions about very large databases. (Usually over 1 terabyte)

For questions about very large databases. (Usually over 1 terabyte)

20 questions
12
votes
2 answers

Dividing DBCC CHECKDB over multiple days

I'm working on implementing Paul Randal's method of manually spreading DBCC CHECKDB over several days for very large databases, which basically consists of: Dividing the tables in the database roughly equally between 7 buckets Running a DBCC…
BradC
  • 10,073
  • 9
  • 51
  • 89
10
votes
1 answer

Database design for handling 1 billion rows and counting

We receive real-time GPS data at a rate of around 5000 pr. minute (from 4 TCP servers). Each server uses a single connection to insert the data, and buffers data in between inserts. Every 15 minutes or so, a service fetches this data, and processes…
sondergard
  • 215
  • 2
  • 6
9
votes
1 answer

TDE - Encryption on a large database

I'm in the process of researching TDE implementation on a VLDB and would like to know if anyone has real world experience with enabling encryption on a production server. What kind of problems (if any) can I expect? My testing shows very little…
Brickpack
  • 119
  • 1
  • 6
6
votes
2 answers

Managing a SQL Server database with over one terabyte of data

Recently we have an audit database that went over one terabyte and, since we have storage problems, management is looking for options. My proposal is at the end of each year we take a backup and truncate all the tables which will keep the database…
SQL_NoExpert
  • 1,107
  • 1
  • 21
  • 37
6
votes
1 answer

Partitioning a 4TB table while staying online (SQL Server Standard)

We have a table that is currently ~4TB in size. We wish to introduce partitioning on this table. The table is already clustered on the key we wish to partition on. The options appear to be Use ALTER TABLE SWITCH to switch the data of the table to…
James Crowley
  • 223
  • 2
  • 5
4
votes
1 answer

Shrinking large DB file not working

I have a 5 TB database file (don't ask why) that I am cleaning up. I was already able to free over a TB and I will probably end up at 2.5 TB. All best-practice advice aside, I need to now shrink this file. I am currently running this statement: DBCC…
Sebastian Meine
  • 9,163
  • 1
  • 28
  • 32
3
votes
1 answer

How to design a partitioning strategy for a VLDB OLTP solution (SQL Server 2016, >100TB init. size)

I am currently working to design a MSSQL 2016 based platform to handle a dataset (OLTP based) that will grow above the PetaByte level. It will be used for specific types of analysis that will require trends to be discovered using various methodes…
MvdMunnik
  • 138
  • 10
3
votes
2 answers

Disk size and log file growth during upgrades

I have four SQL Server databases. Per the maximum load requirements, each database file can be between 1 and 2 TB in size. The HDD is a multi-disk DAS with about 9TB of space. During a database upgrade, the transaction log file for a single database…
colbybhearn
  • 133
  • 1
  • 2
  • 9
2
votes
1 answer

How do you generate large OLTP and reporting workloads?

My current skillset lies towards plain vanilla data warehousing, with < 20k users, our setups are rather simple.. I am looking for ways to enhance my technical skills, however, as much theory as I read, I'm struggling to figure out how I can…
user87166
  • 583
  • 1
  • 4
  • 6
2
votes
2 answers

What is the practical use case for a very large (terabyte-scale) heap?

This question is the highest rated question on this website about heaps. It asks about the use case of heaps. However, I believe that very large heaps (e.g. thousands of gigabytes) are a special case that deserves its own question. As the size of…
J. Mini
  • 1,161
  • 8
  • 32
2
votes
0 answers

Restore SQL Server 2016 - buffer memory - OS memory

When restoring SQL Server 2008R2 DWH-DBs I always gave some memory back to the OS to speed it up. Now I got performance problems restoring to SQLServer 2016: Where does the restore buffer come from? SQL Memory Manager I guess? Does the SQL Server…
TKR
  • 21
  • 1
2
votes
1 answer

VLDB - Create SQL DB Snapshot And Run Granular DBCC CHECKDB Commands

I have a 25TB db (SQL2008 Enterprise SP4) that appears to not have had CHECKDB run on it in production. No idea if it was run against a restored backup somewhere at sometime. Right now I don't have space to restore a copy on another server connected…
Todd Kleinhans
  • 23
  • 2
1
vote
2 answers

good strategy for big tables and archiving in sql server 2012

I have a table with roughly ~500,000 rows a day getting added into it. The database supports an OLTP system. The make up of it is a bit like this: create table Stuff (StuffID int identity not null primary key, ValueA decimal(18,4) not null, …
Eric
  • 145
  • 1
  • 1
  • 6
1
vote
1 answer

Integrity checks on large dbs (700GB)

What's the best strategy for integrity checks on large dbs? DBCC CHECKDB (DB Name) would probably take over 24 hours and the largest table, being 532GB, would probably take over 17 hours.
user48020
  • 11
  • 1
1
vote
2 answers

Database restore on new server and upgrade to SQL Server 2012

I have to move a 5 TB SQL Server 2008 database that has mirroring setup to a new server that will have SQL Server 2012 and always on AG setup. I am wondering if detach/attach would be faster or backup/restore. The compressed split backup is about…
TDPSQL_Newbie
  • 123
  • 1
  • 2
  • 12
1
2