DevOps Stack Exchange
DevOps Stack Exchange

Questions tagged [testing]

Software testing is any activity aimed at evaluating an attribute or capability of a program or system and determining that it meets its required results. Use this tag on questions that talk about the testing of systems or software that would be on-topic for this site.

Before posting a question about Software Quality Assurance and testing, consider if it would be more appropriate on Software Quality Assurance Stack Exchange.

From Wikipedia:

Software testing is an investigation conducted to provide developers and stakeholders with information about the quality of the product or service under test. Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software implementation.

Further Reading

68 questions
51
votes
6 answers

How to test a Terraform Configuration?

If you had a Terraform configuration that had a moderate degree of complexity, how would you write tests around the configuration that could be executed as part of a Continuous Integration / Continuous Delivery pipeline? As an example, you may have…
Richard Slater
  • 11,747
  • 7
  • 43
  • 82
37
votes
6 answers

How to test provisioning and configuration in Ansible setup?

Looking at trying to build some resilience into our Ansible setup which deals with provisioning and configuration. I understand a few methods of testing on the configuration side of things but I'm wondering how best to implement testing on the…
Naphta
  • 627
  • 6
  • 9
26
votes
4 answers

Ansible: Other option available for telnet check of open ports?

I'm new to Ansible. Here's my task ... I have 400+ hosts, and I need to verify if 5 different ports are open from their end to our web server. Individually, I could log in and run: telnet mywebserver.com 443 telnet mywebserver.com 80 telnet…
AWhitaker
  • 371
  • 1
  • 3
  • 5
23
votes
5 answers

How to avoid continuous integration-caused instabilities in test environments?

Assume you're using continuous integration processes which frequently update some target environments, so that every time there are some changes "you" can test your changes right away. That's part of the goals of CI, no? But, also assume that you…
Pierre.Vriens
  • 7,225
  • 14
  • 39
  • 84
17
votes
1 answer

A systematic way to test RESTful APIs with curl?

I have noticed during integration testing that I actually work on recurring use cases with restful APIs (or in general HTTP interfaces) I check here and there with bash+cURL. It starts looking quite messy and gets harder to maintain. Why deliver…
Ta Mu
  • 6,792
  • 5
  • 43
  • 83
14
votes
1 answer

Testing Jenkins jobs and pipelines

Currently, we have a fair number of Jenkins jobs and pipelines for builds, testing, deployments and other automated activities. Every time we change or add a new job, we only test it manually - e. g. going over the "happy path" (when job is done…
alecxe
  • 849
  • 1
  • 16
  • 36
12
votes
4 answers

Infrastructure as code and TDD

Infrastructure as code tells us to use tools that automate your builds. Great. Tools like ansible, chef, puppet, salt stack and others push us towards writing how infrastructure looks like, while resolving the differences. In Salt Stack those bits…
JackLeo
  • 223
  • 1
  • 6
10
votes
3 answers

How to test VM provisioning script without provisioning

Currently I'm on a state that testing costs me money and a lot of time... Background: I'm deploying VMs at softlayer and using a post-deployment script(bash) that will install every software that I need after the VM is ready. The problem is, I can…
Lucas Mattos
  • 201
  • 1
  • 3
8
votes
2 answers

What is "black box" testing?

What is "black box" testing and how it is different from ordinary testing? For example black box tests prior to deploying to production. Note: "black box" testing is a common requirement when applying for devops roles (not necessary a tester thing).
kenorb
  • 8,011
  • 14
  • 43
  • 80
8
votes
3 answers

How to test a cluster of microservices?

I took a look into Server Spec and it says it clearly: Remark: serverspec test suites are meant to be run against a single machine (or docker container). In other words, you should not try to issue a single rspec command that would harvest and…
nicocesar
  • 197
  • 5
8
votes
3 answers

How to implement a frozen test environment?

Here is a partial quote from an answer to the question about "How to avoid continuous integration-caused instabilities in test environments?": This environment usually freezes during the tests. My question: what are sample implementations of a…
Pierre.Vriens
  • 7,225
  • 14
  • 39
  • 84
8
votes
3 answers

How to create staging servers for multiple git branches?

I have to create a new staging process for our development and testing. At any given time, there are only around 4 git branches actively being developed and tested. Within each git branch, there may be database evolution scripts (straight SQL) that…
max1221
  • 81
  • 1
  • 2
8
votes
3 answers

What is the future role of tester?

If the new paradigm is "You build it, you run it" (Werner Voegels, Amazon CTO) which obviously puts much more responsibility - and pressure - on software engineers, what does this change introduce to the task of the test team?
Ta Mu
  • 6,792
  • 5
  • 43
  • 83
7
votes
2 answers

What are the pros and cons of running application testing during vs. after a docker build?

Our dockerfile creates the application environment (e.g. env variables, install libraries with apt-get etc.). It also pulls and copies the python application code from its git repo. However, we are debating whether the application tests (some unit,…
cammil
  • 171
  • 1
6
votes
0 answers

Blackbox testing vs openbox testing applications in a containerized environment

We use containers to deploy our Node.js applications. But currently, the development and a good share of testing is done by the developers on their own host system and thus using different versions of the tools (notably Node.js itself, NPM, and…
Sylvain Leroux
  • 1,660
  • 2
  • 15
  • 27
1
2 3 4 5