Questions tagged [autoscaling]

Autoscaling is the capability of a system to dynamically increase capacity to support higher load, and to subsequently decrease costs to reduce costs. Use this tag to describe questions that discus autoscale, plastic-scale or elastic-scale.

Autoscaling is the capability of a system to increase capacity to support increased load, and to decrease capacity to reduce costs subsequently. Use this tag to describe questions that discuss autoscale, plastic-scale or elastic-scale.

There are two types of auto-scaling:

  • Elastic Scale - the capability of a system to dynamically scale out parts of the system that are under a higher load. Engineers configure Autoscaling Rules based upon instrumentation of the system.

  • Plastic Scale - the capability of a system to scale up and down based upon a schedule, generally this scheduled is configured the system owners in response to an expected peak demand at certain times of day, week, month or year.

38 questions
9
votes
1 answer

How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state?

How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state in terraform? Specifically, suppose I provision an aws_autoscaling_group resource with terraform with a desired_capacity of 4 and a scaleup policy on…
8
votes
2 answers

How to run database migrations in an auto-scaled group

We are just about to move from a monolithic architecture to an auto-scaled group and I'm not sure how I should be running my database migrations (Laravel). I am thinking that a script will run when a new box comes online, this will git pull my…
Mick
  • 221
  • 1
  • 4
8
votes
1 answer

How to manage Consul and its quorum in auto-scaling environments?

We have auto-scaling Docker environments in which we use Consul for service discovery. These environments can add or remove one instance every few minutes. Our early Consul testing showed that it was very easy for Consul to loose its quorum. Perhaps…
Alexandre
  • 1,965
  • 15
  • 24
7
votes
1 answer

How can I autoscale instances based on Kafka topic lag?

I have autoscaling groups that I want to dynamically scale up/down based on the amount of lag showing in certain Kafka topics. There's a 1:1 relationship between topic and autoscaling group that needs to be scaled. I'm fairly sure I can't use…
dededecline
  • 183
  • 2
  • 8
6
votes
2 answers

Autoscaling containers using local request counters

Somewhere around I got to know about different approaches which were used to scale our webapp which included Scaling using local request counters. Below that they had written the drawbacks of this approach adding that Each instance would reach the…
radbrawler
  • 257
  • 1
  • 2
  • 5
6
votes
3 answers

Autoscaling on GoCD agents without terminating active builds?

At the moment I have an AutoScaling Group (ASG) of GoCD build agents without any scaling policies. I have created some custom metrics that indicate how many build agents are currently idle and I'd like to scale based off of that. My concern is that…
6
votes
1 answer

Does the "cattle not pets" distinction apply as equally to machine instances as to containers?

There is a great discussion of the Cattle vs Pets distinction from Randy Bias here. Martin Fowler talks about a SnowFlakeServer. In a series of talks, Adrian Cockcroft talks about how they moved toward Cattle Servers for solving a scalability…
hawkeye
  • 1,153
  • 1
  • 9
  • 14
4
votes
1 answer

Kubernetes auto scaling in cloud environment

Anyone knows if there is a solution to provision (non-managed) autoscaling Kubernetes clusters in the cloud? I am looking for a generic solution that will work in any public cloud and in private data centers. After quite a bit of research, the known…
Evgeny Zislis
  • 9,023
  • 5
  • 39
  • 72
4
votes
2 answers

Where to start? Scaling PHP applications on AWS

Currently all of our PHP (Laravel) applications are running on one EC2 instance. To deploy code, we SSH onto the live box and pull from CodeCommit. We now need to scale and deploy properly. I'm not sure where to start. Most examples seem to use…
Mick
  • 221
  • 1
  • 4
4
votes
1 answer

What are best practices for over-committing resources in a staging environment?

Suppose there is a staging environment very strapped for resources as new development, data workloads and other applications grow. Ideally one would like to maintain production parity, even at the resource allocation level per each deployed item in…
3
votes
1 answer

Are distributed distributions like NixOS able to replace docker in terms of autoscaling?

Autoscaling means that the number of instances increases if the load intensifies. Docker is used in for example Kubernetes in order to autoscale. Are distributed distributions like NixOS suitable candidates for autoscaling as well?
030
  • 13,383
  • 17
  • 76
  • 178
3
votes
1 answer

Do GitLab Runner worker nodes need to have network access to GitLab?

GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand. The documentation says that: "GitLab Runner is going to need to talk to your GitLab instance over the network". This is obvious to…
3
votes
1 answer

What is the ec2 cli command to modify the minimum number of nodes in a scaling group?

I've got an ec2 autoscaling group that starts in the morning and finishes in the evening. I'd like to create a 'button' that people can click to warm up the autoscaling group to run jobs in the middle of the night (only on an on-demand basis). My…
hawkeye
  • 1,153
  • 1
  • 9
  • 14
2
votes
1 answer

Autoscaling with Kubernetes daemonset

I have a Kubernetes cluster running on Google Compute Engine. My program uses stateful connections, so I do not want my pods being moved between nodes. Because of this, I am running my workload as daemonsets, and giving each node the amount of…
2
votes
1 answer

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i.e. enabling/disabling certain supervisor…
Dr. Chocolate
  • 605
  • 1
  • 6
  • 9
1
2 3