Fluent Bit
Ship Fluent Bit events and metrics
Fluent Bit is an open source data collector which can be used to collect event logs from multiple sources. It filters, buffers and transforms the data before forwarding to one or more destinations, including Logstash.
Install Integration
Commandline Example
Example commandline configuration to send CPU metrics from Fluent Bit to logstash
docker run -it fluent/fluent-bit:1.8 /fluent-bit/bin/fluent-bit -i cpu -o tcp://@logstash.host:@logstash.Port -p format=json_lines -p json_date_format=iso8601 -pjson_date_key=@timestamp
Example Output Config
If using a configuration file, then add the following to your Fluent Bit config
[OUTPUT]
Host @logstash.host
Port @logstash.Port
Format json_lines
json_date_format iso8601
json_date_key @timestamp
Check Logit.io for your logs
Data should now have been sent to your Stack.
View My DataIf you don't see take a look at How to diagnose no data in Stack below for how to diagnose common issues.
How to diagnose no data in Stack
If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.
Fluent Bit Logging Overview
Fluent Bit often draws comparisons with Logstash as both log collectors share some similarities especially when it comes to platform compatibility.
Where these tools differ though can be seen clearly across their configuration difficulty & performance (Logstash is notably easier to configure).
Fluent Bit on the other hand is known for requiring minimal system resources for more lightweight method of forwarding your data.
For this configuration guide, we've covered using both Logstash & Fluent Bit together for forwarding your data for further log analysis and processing using ELK (Elasticsearch, Logstash & Kibana).
The Logit.io platform is built to allow you to drive data-driven insights from your logs & brings together Fluent Bit & Logstash for full observability of your logs in a single centralised platform. Our platform offers a complete solution for centralising your log files from multiple applications and servers and provides a Fluent Bit log analyser as standard.
If you need any more help with migrating your Fluent Bit to Logstash the Logit.io team are here to help. Feel free to get in contact with our support team via live chat & we'll be happy to assist.