Guide to DevSecOps

Appearance

Monitoring Docker Container Logs ​

Monitoring Docker container logs is crucial for debugging and maintaining your applications. This section will guide you on how to view logs, tools to use, and how to monitor logs in a Docker Swarm setup.

Viewing Logs ​

You can view logs of a running container using the docker logs command.

Example:

sh
docker logs <container_id>

To follow the logs in real-time, use the -f option:

sh
docker logs -f <container_id>

Tools for Monitoring Logs ​

Several tools can help you monitor Docker container logs more efficiently:

  1. Docker CLI: Basic log viewing and following.
  2. Logspout: A log router for Docker containers.
  3. ELK Stack (Elasticsearch, Logstash, Kibana): A powerful stack for searching, analyzing, and visualizing log data.
  4. Prometheus and Grafana: For metrics collection and visualization.
  5. Fluentd: A data collector for unified logging.

Monitoring Logs in a Swarm Setup ​

In a Docker Swarm setup, monitoring logs can be more complex due to the distributed nature of services. Here are some methods and tools to help:

  1. Docker Service Logs: Use the docker service logs command to view logs for a service.

Example:

sh
docker service logs <service_name>

  1. Centralized Logging: Use a centralized logging solution like the ELK Stack or Fluentd to collect and aggregate logs from all nodes in the swarm.

  2. Monitoring Tools: Use tools like Prometheus and Grafana to monitor the health and performance of your services.

Example: Using ELK Stack in Docker Swarm ​

  1. Elasticsearch: Store and index logs.
  2. Logstash: Collect and process logs.
  3. Kibana: Visualize logs.

Example docker-compose.yml for ELK Stack:

yaml
version: '3.8'

services:
  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:7.10.1
    environment:
      - discovery.type=single-node
    ports:
      - "9200:9200"

  logstash:
    image: docker.elastic.co/logstash/logstash:7.10.1
    ports:
      - "5044:5044"
    volumes:
      - ./logstash.conf:/usr/share/logstash/pipeline/logstash.conf

  kibana:
    image: docker.elastic.co/kibana/kibana:7.10.1
    ports:
      - "5601:5601"
    depends_on:
      - elasticsearch

With this setup, you can collect, process, and visualize logs from your Docker Swarm services.