Posts

Showing posts from March, 2021

Monitor Kubernetes Logs, Metrics, and Metadata with ELK and Beats Part -3

Image
  Installing MetricBeat Agent Metricbeat helps you monitor your servers and the services they host by collecting metrics from the operating system and services. You deploy Metricbeat as a DaemonSet to ensure that there’s a running instance on each node of the cluster. These instances are used to retrieve most metrics from the host, such as system metrics, Docker stats, and metrics from all the services running on top of Kubernetes. Kube-state-metrics kube-state-metrics is a simple service that listens to the Kubernetes API server and generates metrics about the state of the objects. It is not focused on the health of the individual Kubernetes components, but rather on the health of the various objects inside, such as deployments, nodes and pods. Download the yaml file from my git repository. https://github.com/darshanadinushal/rabbitmq-cluster/blob/master/deployment/elk-cluster/kube-state-metrics.yaml Run the following command to execute "kube-state-metrics". oc create -f  ku

Monitor Kubernetes Logs, Metrics, and Metadata with ELK and Beats Part -2

Image
  Installing Filebeat Agent Filebeat is the agent that we are going to use to ship logs to Logstash. The configMap that holds the Filebeat configuration, we specify  output.logstash:hosts: '${LOGSTASH_URL}'  that it needs to ship the log data to Logstash. We’re specifying the Service short URL since both resources live in the same namespace. We are using a DaemonSet for this deployment. A DaemonSet ensures that an instance of the Pod is running each node in the cluster. To deploy Filebeat, we need to create a service account, a cluster role, and a cluster role binding. After install the FileBeat , Logstash ,Elasticsearch and Kibana will show on the Openshift Topology. Monitor OpenShift with Elastic Observability Now that we have Filebeat shipping OpenShift logs to Elasticsearch, we can open up Kibana and start monitoring system health from Elastic Observability. 1. Create Index Patten   Login to kibana using elastic username and password. Then Navigate to the Stack Management u

Provision Red Hat OpenShift Cluster On AWS

Image
OpenShift Red Hat OpenShift Container Platform unites developers and IT operations on a single platform to build, deploy, and manage applications consistently across hybrid cloud and multi-cloud infrastructures. OpenShift Container Platform — platform as a service built around docker containers orchestrated and managed by Kubernetes on a foundation of Red Hat Enterprise Linux. OpenShift helps businesses achieve greater value by delivering modern and traditional applications with shorter development cycles and lower operating costs. For more OpenShift Architecture read my previous blog post. OpenShift On AWS Architecture Openshift Kubernetes Engine comes with different installation on different platforms like AWS, Azure, Google Cloud, Bare-metal and Vmware. In this post I have simplified each and every steps of the process provision OpenShift Container Platform 4.7 on AWS Infrastructure from scratch. In this article we are going to provision Three Master and Three worker node cluster on