Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [scalability]

155 questions
92
votes
5 answers

Why can't RDBM's cluster the way NoSQL does?

One of the big plusses for nosql DBMS is that they can cluster more easily. Supposedly with NoSQL you can create hundreds of cheap machines that store different pieces of data and query it all at once. My question is this, why can't relational…
fregas
  • 1,051
  • 1
  • 9
  • 7
47
votes
1 answer

Scalability limitations of PostgreSQL and MySQL

I've heard that performance of non-sharded relational database such as MySQL or PostgreSQL "breaks" beyond 10 TB. I suspect that limits as such do exist as one would not come up with Netezza, Greenplum, or Vertica, etc, however I would like to ask…
Edmon
  • 759
  • 1
  • 8
  • 13
47
votes
6 answers

Is there any limit to the number of databases you can put on one SQL server?

I'm setting up a SaaS system, where we're planning to give each customer their own database. The system is already set up so that we can easily scale out to additional servers if the load becomes too great; we're hoping to have thousands, or even…
Shaul Behr
  • 2,963
  • 8
  • 34
  • 42
24
votes
4 answers

What does horizontal scaling mean?

In database context, I have come across horizontal scalability as one of the advantages of the NOSQL databases. What does the term mean? CouchDB on Wikipedia NoSQL on Wikipedia How would it compare to vertical scaling?
Lazer
  • 3,361
  • 15
  • 43
  • 53
22
votes
3 answers

PostgreSQL High Availability/Scalability using HAProxy and PGBouncer

I have multiple PostgreSQL servers for a web application. Typically one master and multiple slaves in hot standby mode (asynchronous streaming replication). I use PGBouncer for connection pooling: one instance installed on each PG server (port 6432)…
Nicolas Payart
  • 2,508
  • 5
  • 28
  • 36
20
votes
2 answers

Scaling PostgreSQL TRIGGER(s)

How Postgres triggers mechanism scales ? We have a large PostgreSQL installation and we are trying to implement an event based system using log tables and TRIGGER(s). Basically we would like to create a TRIGGER for each table we want to be…
Ugo Matrangolo
  • 301
  • 1
  • 2
  • 3
20
votes
4 answers

Is it better to separate a big query into multiple smaller queries?

There are situations which require having really big query joining several tables together with sub select statements in them to produce the desired results. My question is, should we consider using multiple smaller queries and bring the logical…
2hamed
  • 323
  • 1
  • 3
  • 7
17
votes
3 answers

Why can't relational databases meet the scales of Big Data?

It is often repeated that the Big Data problem is that relational databases can not scale to process the massive volumes of data that are now being created. But what are these scalability limitations that Big Data solutions like Hadoop are not bound…
Jeremy Beard
  • 281
  • 1
  • 2
  • 6
15
votes
3 answers

Testing stored procedure scalability

I have an email application that will be called upon to deliver to the UI the number of new messages for a given user on each page load. I have a few variations of things I am testing on the DB level but all are abstracted by the stored proc…
kacalapy
  • 2,062
  • 3
  • 27
  • 36
15
votes
3 answers

Should a multi tenant system with SQL Server 2016, Shard or have Tenant isolation via separate database per tenant?

Given the use case: Tenant data should not cross talk, one tenant does not need another tenant's data. Each tenant could potentially have large historical data volume. SQL Server is hosted in AWS EC2 instance. Each tenant is geographically…
D.S.
  • 365
  • 4
  • 10
12
votes
2 answers

Proper storage size estimation technique for PostgreSQL

We are preparing a PostgreSQL database for production usage and we need to estimate the storage size for this database. We are a team of developers with low expertise on database administration, so we are doing research, reading manuals and using…
Bruno Polaco
  • 229
  • 1
  • 2
  • 5
12
votes
3 answers

Database suggestion for a social network/ knowledge base community?

I am looking into various database types and DBMS's for a new project I am wanting to start in the summer. I have built systems in MySQL and postgreSQL , now I am wanting to expand my knowledge and experience in Databases. My project will be a type…
tomaytotomato
  • 185
  • 1
  • 9
12
votes
1 answer

How do you calculate how much hardware resources you need for a database?

We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases? Here is a little bit information about our current database server: MySQL Database InnoDB for all…
Mahdi
  • 185
  • 1
  • 1
  • 8
10
votes
1 answer

What are the practical limitations on a column family in Cassandra?

In Cassandra, it's not recommended to have more than a few thousand column families, let's say 2,000 for the sake of argument. In cases where more than 2,000 types of data need to be persisted, one approach would be to shard multiple unrelated types…
Andrew Swan
  • 201
  • 2
  • 5
9
votes
1 answer

Is Postgres ideal for Many to Many data (M:N) which keeps increasing?

I have a use-case where the data is many to many and needs a wide range of querying functionality. Participants and Events A User/Participant can register for multiple events. And each event can have many participants. It's a many-to-many…
Ayyappa
  • 203
  • 1
  • 7
1
2 3
…
10 11