Monitor Kubernetes Logs, Metrics, and Metadata with ELK and Beats Part -2

 Installing Filebeat Agent

Filebeat is the agent that we are going to use to ship logs to Logstash.



The configMap that holds the Filebeat configuration, we specify output.logstash:hosts: '${LOGSTASH_URL}' that it needs to ship the log data to Logstash. We’re specifying the Service short URL since both resources live in the same namespace.

We are using a DaemonSet for this deployment. A DaemonSet ensures that an instance of the Pod is running each node in the cluster.
To deploy Filebeat, we need to create a service account, a cluster role, and a cluster role binding.

After install the FileBeat , Logstash ,Elasticsearch and Kibana will show on the Openshift Topology.

Monitor OpenShift with Elastic Observability

Now that we have Filebeat shipping OpenShift logs to Elasticsearch, we can open up Kibana and start monitoring system health from Elastic Observability.

1. Create Index Patten 
Login to kibana using elastic username and password. Then Navigate to the Stack Management under Kibana section select Index Patterns.


If we able to successfully deployed Filebeat and Logstash, it should show index as shown below. Type the Index pattern name same as index and click Next step.

















Select the time field dropdown @timestamp and click the Create index pattern button ,shown as below. 


After Create it will show the lists of every field in the logstash-filebeat* index and the field's associated core type as recorded by Elasticsearch. 

2. Discover Logs
Then Navigate to the Analytics then Discover.







Comments

Post a Comment

Popular posts from this blog

Provision Red Hat OpenShift Cluster On AWS

Image
OpenShift Red Hat OpenShift Container Platform unites developers and IT operations on a single platform to build, deploy, and manage applications consistently across hybrid cloud and multi-cloud infrastructures. OpenShift Container Platform — platform as a service built around docker containers orchestrated and managed by Kubernetes on a foundation of Red Hat Enterprise Linux. OpenShift helps businesses achieve greater value by delivering modern and traditional applications with shorter development cycles and lower operating costs. For more OpenShift Architecture read my previous blog post. OpenShift On AWS Architecture Openshift Kubernetes Engine comes with different installation on different platforms like AWS, Azure, Google Cloud, Bare-metal and Vmware. In this post I have simplified each and every steps of the process provision OpenShift Container Platform 4.7 on AWS Infrastructure from scratch. In this article we are going to provision Three Master and Three worker node cluster on
Read more

Implement an event bus on Kubernetes with RabbitMQ using MassTransit in Microservice Architecture Part - 2

Image
Event-driven microservice architecture, services communicate each-other using event messages. When business events occur, producers publish them with messages.  At the same time, other services consume them through event listeners. The main benefits of event-driven systems are asynchronous behavior and loosely coupled structures. In this article, we are going to talk about a simple publisher/subscriber scenario deployed on Kubernetes cluster. To impalement publisher and subscriber we use Masstransit. In this tutorial, we will use Red Hat® OpenShift® version 4.6  Kubernetes container platform to deploy RabbitMQ cluster , publisher and consumer application.  Prerequisites You should have a basic understanding of RabbitMQ, Docker, Kubernetes, Openshift, ASP.NET Core WebAPI, and .NET Core. Read following articles before start. Openshift Architecture https://darshanadinushal.blogspot.com/2021/02/openshift-with-kubernetes-openshift-v4.html Apache Kafka and RabbitMQ https://darshanadinushal.b
Read more

Openshift with Kubernetes

Image
OpenShift is a layered system designed to expose underlying Docker-formatted container image and Kubernetes concepts as accurately as possible, with a focus on easy composition of applications by a developer . What is OpenShift Red Hat OpenShift Container Platform unites developers and IT operations on a single platform to build, deploy, and manage applications consistently across hybrid cloud and multi-cloud infrastructures. OpenShift Container Platform — platform as a service built around docker containers orchestrated and managed by Kubernetes on a foundation of Red Hat Enterprise Linux. OpenShift helps businesses achieve greater value by delivering modern and traditional applications with shorter development cycles and lower operating costs. What are the features of OpenShift? Multi-Environment support.  One-click deployment.  Responsive web console.  Standardized workflow for developers.  Rest API support.  Support for remote SSH login to the application.  In-built database servic
Read more