Kubernetes Logging
Ship Kubernetes container logs to your hosted Logstash instance at Logit.io
Filebeat is a lightweight shipper that enables you to send your Kubernetes logs to Logstash and Elasticsearch. Configure Filebeat using the pre-defined examples below to start sending and analysing your Kubernetes logs.
Install Integration
Copy Manifest File
Copy and use the Kubernetes Filebeat manifest below.
If you aren't logged in, you may need to update the environment variables of your-logstash-host / your-logstash-port.
For use with version 7.x Filebeats.
No input available! Your stack is missing the required input for this data source.
Talk to support to add the inputDeploy Pod
Now your deployment manifest is updated, you can deploy it using.
kubectl apply -f filebeat-kubernetes.yamlConfirm Completed Deployment
kubectl --namespace=kube-system get ds/filebeat
kubectl --namespace=kube-system get podsYou should see a pod for each kubernetes node with a name similar to filebeat-abcde listed. The pods should work though from Pending to Running within a couple of minutes as the containers are downloaded and started.
Check Logit.io for your logs
Data should now have been sent to your Stack.
View My DataIf you don't see take a look at How to diagnose no data in Stack below for how to diagnose common issues.
Kubernetes Logging to OpenSearch Overview
Kubernetes was open-sourced in 2014 by Google and has quickly become one of the most popular container management tools on the market as it helps to significantly lower the cost of cloud computing & provides a resilient framework for deploying applications.
A common challenge for effective Kubernetes log aggregation is that during spikes data can easily be lost and not accounted for without a scalable logging solution such as Logit.io. Our platform also provides log tailing for real-time monitoring of your Kubernetes metrics.
Logit.io's container monitoring (opens in a new tab) platform is built to collect, parse, and transform application logs (opens in a new tab) from your Kubernetes clusters within a few steps using the power of the managed Elastic Stack.
Monitor across 1,000s of containers, layers, logs levels, and data types, in one centralised logging platform (opens in a new tab) & save hours on monthly maintenance to support the ELK Stack.
If you need any further help with migrating your Kubernetes log files using Filebeat we're here to help. Feel free to reach out by contacting our support team by visiting our dedicated Help Centre or via live chat & we'll be happy to assist.