DevOps Stack Exchange
DevOps Stack Exchange

Questions tagged [metrics]

For questions about numbers that provide information used for measurement, comparison or tracking of processes.

26 questions
27
votes
4 answers

What are some methods to measure the ROI for DevOps?

DevOps is complex, and involves many non-deterministic aspects like culture and process. What are some ways to measure DevOps initiatives for success? How do you prove to a business that the investment they have made is returning (or saving) real…
Dave Swersky
  • 4,068
  • 2
  • 21
  • 33
20
votes
1 answer

How to model Man, Machine, Measures, and Process in a DevOps world?

In The Phoenix Project when on one of the tours of the plant we're told that each workstation is a combination of Person, Machine, Measurement, and Process. This makes a lot of sense, after all we have people, servers, KPIs, and…
Liath
  • 547
  • 3
  • 11
13
votes
3 answers

What Key Performance Indicators (KPIs) are used to measure DevOps?

I am trying to drive good behaviors within a DevOps transformation programme, to support this I am looking at identifying actionable metrics around the operations disciplines: Problem and Incident Management Capacity Management Change and Release…
Richard Slater
  • 11,747
  • 7
  • 43
  • 82
10
votes
2 answers

pre-DevOps deployment metrics challenge

TL;DR, how do you prove devops, specifically deployment automation, improves change failure rates? We're all trying to capture metrics on 'deployment failures' using current (mostly manual) means. Unfortunately, a 'failure' rarely happens, right?…
John O'Keefe
  • 101
  • 3
10
votes
1 answer

What exactly is the cloud term 'a Firehose'?

I found a Firehose definition from Overview of the Loggregator System Cloud Foundry docs. The Firehose is a WebSocket endpoint that streams all the event data coming from a Cloud Foundry deployment. The data stream includes logs, HTTP events…
Sybil
  • 472
  • 4
  • 11
8
votes
2 answers

What is the proper relationship between rollback/rollforward and MTTR metrics?

I'm trying to understand the best way to capture data to start measuring Mean Time To Repair (MTTR) metrics, and I need to wrap my head around how "rollback" impacts MTTR positively or negatively. Scenario 1 Assuming that solid monitoring is in…
Steve Clement
  • 81
  • 1
  • 2
6
votes
1 answer

What are benefits of using third party app metrics tools versus custom build tools?

With tools like Riemann, New Relic, etc., is there any benefit to building custom app metrics tools for monitoring application health?
soundslikeodd
  • 173
  • 2
  • 9
6
votes
2 answers

What are the metrics to consider when doing API performance testing?

I want to establish the benchmark behavior of my API through performance testing. The purpose is to ensure that the product meet or exceed requirements such as: Throughput Response time Stability Resource usage Some of KPIs I'm aware of: Average…
storm
  • 1,759
  • 3
  • 16
  • 34
5
votes
0 answers

Is it possible to create AWS CloudWatch Metric Filters with dimensions?

CloudWatch Metric Filters are the recommended way to create custom metrics from Lambda functions. Sending the metrics directly from the lambda function to the CloudWatch api is the main alternative, but it has several disadvantages including, not…
Andy McCluggage
  • 151
  • 1
  • 3
4
votes
0 answers

Thanos or Cortex - What handles very large scale (say, hundreds of millions of time series) better?

We're looking at a new metrics solution and are attempting to build it in house. So, my question is: What can scale more effectively / with less pain; Thanos or Cortex? I understand the general differences between the two. I'm just looking to…
John Humphreys
  • 1,570
  • 7
  • 18
3
votes
2 answers

How do I measure invisible work?

Full disclosure, I’m not a developer or a DevOps professional so some of the terms I use might not be correct. I’m a product marketer who is trying to learn more about a facet of development work. I’ve read that up to 50% of developers' time is…
J007B
  • 133
  • 4
3
votes
1 answer

Definition of change failure rate and mean time to recovery DORA metrics

There has been a lot of talk in recent years about the Accelerate book and the DORA metrics. As the DORA survey was looking at a wide variety of organisations, teams and cultures all with potentially very different current processes and…
Kieran
  • 83
  • 5
2
votes
1 answer

Which libraries generate observability metrics for applications in the cluster to prometheus?

I recently read "Cloud Native DevOps with Kubernetes" by O'reily and it mentions the RED and USE metrics which are a good starting point for gaining better observability into the system, however I'm having a hard time finding any information online…
avi
  • 1,279
  • 1
  • 13
  • 32
2
votes
2 answers

Identifying a benchmark to compare overall performance of VM virtualization vs hardware

Which performance index is most suitable to find out real performance of your VM limited by sharing and quotas? For example, if you have a physical server with 4 cores and 16 GB RAM, its performance limit might be higher than if you have same on AWS…
Ta Mu
  • 6,792
  • 5
  • 43
  • 83
2
votes
0 answers

Jenkins GitHub Organization Metrics

I am using Jenkins with the GitHub Organization item option. On Jenkins with freestyle projects or others I am able to get build metrics: success, failure, date, node and so forth. On the GitHub Organization item, these metrics do not ever…
user5541158
  • 21
  • 2
1
2