Skip to main content

ELK Stack and Beats for a centralized monitoring solution


ELK stack stands for Elastic Search, Logstash and Kibana, together all these three components do the jobs of the centralized monitoring solution of your infrastructure. In short ELK stack is not just monitoring solution it comes with lots of other features like searching the historical data, visualized your monitoring status, quick findings of the root cause of the problem, machine learning, Graph and many more. It has lots of plugins that make it more interesting and useful for today worlds where we have hundreds of microservices and servers running on the cloud and personal data center.





Why ELK Stack?





ELK stack has some unique features, that make it different from any other monitoring tools and software, some of them are given below.





  • Most powerful and unique features of ELK stack is that its lightweight
  • The core of the ELK and very fist is the elastic search which provides the unique functionality of the searching of any error and status.
  • A centralized database of all the servers and all type of monitoring status, like network, server, application, API, process and many more
  • Its provide nice visualization tool with the help of Kibana, but it's not limited to that only you can use the other visualization tool as well like Grafana
  • Using Logstash you can do the filtering and conversion of your traces, data, ERROR, etc
  • There are several lightweight beats which make it more interesting and you need to install the only required beat on the server, Instead of the whole software bundle. Like if you need to monitor the sever health/status then you can only install the Metricbeat.
  • You can send the alert to your email and slack channel.
  • Lots of in builds plugin
  • Lightweight Shipper for application and servers Logs
  • Connectivity directly with your database, Java Beans with the help of Jolokia, application logs monitoring with Filebeat.
  • Power of Machine Learning.
  • Its open source




In short, I just want to show that it's many more powerful what written above, you can do whatever required for your infrastructure and even for your business team.





How to install the ELK stack ?





Steps to setup the ELK stack in your infrastructure

  1. Choose the installation method

    Depending on the connectivity or requirements you can choose the correct option for your installation.
    If you want to install using the repository then you can directly add the ELK stack repository to your server and execute the yum/apt command to install the components.
    If you want to download the RPM or just tar.gz file. There is some difference in the installation method of all these mode and post steps as well, So I recommend to follow the official website for the installation of all the module and components.

  2. However, If you choose to download the ELK Stack then you can download form here.

    First, you need to download/install the ELK stack from the Elastic Search website.ELK stack

  3. Select the Beats as per your requirement.

    Metricbeat for server monitoring, like Load of the server, CPU utilization, Disk IO, Disk space, Memory Utilization, Process status,etc.
    Filebeat if you want to monitor the Logs
    Heartbeat if you want to monitor your process up and down status, like remote HTTP URL, an application running on a specific port, in short, its provide you the functionality to do HTTP request, telnet and ping.
    Packetbeat is for network monitoring.

  4. Configuration of the beats

    Configuration of the beats is also very easy with respect to other tool and you just need to put the IP address of the component in your configuration files. See the below integration architecture how the beats are connected to ELK stack.


Comments

Popular posts from this blog

Flutter Theme Creation, Programmatic Way

Flutter and Dart is an excellent combination for creating the mobile app with material design with nice GUI. Its lots of widget which help the developer for creating the app UI very fast with respect to the other language. You may face some problem in starting due to comm, curly brace and semicolon but after some time you will find the way how to work with these all stuff and it becomes very easy for you. But in this article, we are not going to discuss all these. In this article, we will handle a very interesting topic on how to create a custom theme or multiple themes and let's user decide which theme to use.



Create a flutter project



So let's create a flutter project by selecting the appropriate option from the File menu in android studio or Visual Code. If you are new to Flutter and Dart you can check out our recent post to get started Creating Cross-platform app using flutter.



Once your project is created you will get the default counter app and you try running the app in the…

Flutter How to Start Android Activity from Flutter View

Flutter and Dart is an excellent combination for creating the UI, but for accessing the platform-specific service we need to open platform-specific activity. So lets in this article we will explore how to start an android activity and access the service from Flutter View.

Create a Project for this Android Activity Flutter View Demo Create a Project From File menu select the New Flutter Project Enter the project name Select the AndroidX support and click on next After the above, we step click on Finish We will have the following project structure created. Create the Second Activity in Android
Just go to the android folder and open it in separate windows. We will have the following project structure.









Create the Activity Just right click on the Kotlin folder and create a blank activity from the menu. If you create the activity then you may be required to upgrade the Gradle and do some import. So Just click on update and wait for the project sync completed.
Update the project build config …

Flutter State Management With Provider and ChangeNotifier

Flutter state management with provider library and why it's so important? There are lots of topics in flutter which are very important but out of those state management of your flutter application is the most important and little bit complicated as well. So in this article, I will try to explain how to use the provider package for managing the state of flutter and dart application and how to access the data down the hierarchy of the widget tree without recreating the whole UI.



Basic knowledge of the state management and data flow in the Flutter



Before starting the coding I would like to explain some basics about the Flutter application so that you can understand, why it's important to manage the state of your application in the correct way.



In Flutter, everything is a widget and whenever the state of your application changes the UI is recreated the UI with the new data. Let's list out the topic or problem that we are going to explore about state management.



Challenge of St…