DevOps Stack Exchange
DevOps Stack Exchange

Questions tagged [logging]

Systematic recording of events from services and application is a key process within DevOps adoption. Use this tag to describe logging and telemetry questions.

Logging is the activity of recording entries in a register of the operation of an application or service. Logging is a key discipline within a DevOps organization as the creation of detailed and central logs provides an audit trail as well as key information for diagnosing incidents.

Logging Tools

40 questions
29
votes
2 answers

How to have multiple log streams in docker

We have an application that writes three types of logs into three separate files: access logs, generic application logs and system logs. The format (and purpose) of these logs are very different. And we have separate logforwarders that send them…
SztupY
  • 1,597
  • 1
  • 16
  • 18
15
votes
2 answers

What is a good logging practice for distributed tasks?

I have the following setting: Create multiple workers, do a computation and terminate them after the computation is done. So, every-time it’ll be a different instance running the task, so each host will have its own a log file, this will result…
Dawny33
  • 2,816
  • 3
  • 24
  • 62
12
votes
7 answers

How do I log ansible task output to a file?

One of my ansible tasks imports an Oracle database using impdp. This generates a lot of output to the console so I have set no_log: True. However, when this fails I want to see the log! How can I make this particular task log to a file and not to…
opticyclic
  • 489
  • 2
  • 4
  • 12
10
votes
1 answer

What exactly is the cloud term 'a Firehose'?

I found a Firehose definition from Overview of the Loggregator System Cloud Foundry docs. The Firehose is a WebSocket endpoint that streams all the event data coming from a Cloud Foundry deployment. The data stream includes logs, HTTP events…
Sybil
  • 472
  • 4
  • 11
7
votes
2 answers

What strategies can be employed to secure sensitive data in log files?

Working in highly regulated environments data is classified in different ways depending on the sensitivity. In some cases, this is legally enforced and must be treated differently. Examples of a data classification policy are: Highly Restricted…
Richard Slater
  • 11,747
  • 7
  • 43
  • 82
7
votes
1 answer

How do I find out exactly when a Github personal access token was last used?

A few days ago, I got an email from github saying that a personal access token that we used is in an 'outdated format': We noticed that an application, TeamCity(ci.support.example.com), owned by an organization you are an admin of,…
Barton Chittenden
  • 171
  • 3
4
votes
2 answers

How to get memory usage per process with sar, sysstat?

Can I get memory usage per process with Linux? we monitor our servers with sysstat/sar. But besides seeing that memory went off the roof at some point, we can't pinpoint which process was getting bigger and bigger. is there a way with sar (or other…
kokito
  • 161
  • 1
  • 1
  • 3
4
votes
2 answers

How to redirect tomcat logs TO console?

So I have a problem that is the reverse of what everyone else on the internet wants.. I want to take tomcat logs that are being written out to /usr/local/tomcat/logs and have them be output to console instead. (Everyone else is asking the reverse..…
Scott Shorkey
  • 161
  • 2
  • 3
4
votes
3 answers

Ideal methods of handling server logs on AWS

We currently have some ruby applications hosted on EC2 servers on AWS, and every few weeks we see the disk space get completely consumed by the app log as well as the worker logs. What are the best practices regarding log storage for a cloud hosted…
Nyx
  • 143
  • 3
3
votes
1 answer

Should I use filebeat or an app-logging module with lumberjack capabilities to collect my logs

I have a pretty basic elk setup which aggregates logs from around 15 VMs that are running various services. All of them have configured filebeat syslog forwarder with a single input in logstash. I have app servers where I run NodeJS web apps, which…
Ivan Drinchev
  • 133
  • 4
3
votes
1 answer

k9s only shows around 50-100 lines of logs, despite more logs being available

I've started using k9s, a TUI for exploring a kubernetes cluster. When I use it to view logs, it however only shows me around 50-100 lines, instead of all the logs, or at least a decent chunk of them. This makes the log viewer quite useless. How do…
Cornelius Roemer
  • 131
  • 3
3
votes
1 answer

Keeping Docker logs only in memory

There are various log drivers available for Docker but it looks like all of them persist the logs to disk. To reduce disk usage I would like to keep the logs only in memory (and limited to a certain size). I could use log driver none but I believe…
AndreKR
  • 150
  • 3
3
votes
1 answer

Azure Function App logs without Application Insights instance?

I'm a bit confused about my options for Function App logging on Azure. Is Application Insights the only mechanism available to observe the output logged through the function application's context? In other words, can logs be tailed or log files be…
Chris Betti
  • 131
  • 3
3
votes
1 answer

What is the difference between Fluent Bit and Prometheus?

From what I've seen, Prometheus scrapes data and metrics and displays them and Fluent Bit collects logs and metrics and can output them. So, are they doing the same thing, i.e. should I choose one over the other or am I missing something?
Grafana
  • 33
  • 1
  • 3
3
votes
1 answer

Logging & Monitoring on multiple servers

I lead a small project with 2 groups of servers (servers in a single group are clones with the same microservices, like pods in the k8s), a balance loader, and a DB. Docker & k8s aren't used because of small scale of the project (but there are plans…
AivanF.
  • 181
  • 1
  • 8
1
2 3