VPC Flow Logs

VPC Flow Log Setup

Ship logs from VPC to Logstash

Follow the steps below to send your observability data to Logit.io

Logs

Install Integration

Please click on the Install Integration button to configure your stack for this source.

Confirm S3 Bucket

Ensure your logs are being sent to an S3 bucket. The following guide from Amazon will help you achieve this if you are not doing this already, you can choose the best way to achieve this, but cloudwatch or cloudtrail are a great place to start:

VPC Flow Logs Guide (opens in a new tab)

Ensure Adequate Bucket Permissions

The following permissions applied to the AWS IAM Policy being used:

  • s3:ListBucket to check if the S3 bucket exists and list objects in it.
  • s3:GetObject to check object metadata and download objects from S3 buckets.

Below is how your permissions should appear:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "SidID",
      "Effect": "Allow",
      "Action": ["s3:GetObject", "s3:ListBucket"],
      "Resource": ["arn:aws:s3:::your-bucket/*"]
    }
  ]
}

Configure Logstash for Amazon VPC

To start sending logs and metrics from AWS to your Stack you need to configure an AWS Input on your Logit.io Stack.

Go to Dashboard

Logit.io will verify your input before it is applied, we will contact you to confirm when this has been completed.

Check Logit.io for your logs

Data should now have been sent to your Stack.

View My Data

If you don't see take a look at How to diagnose no data in Stack below for how to diagnose common issues.

How to diagnose no data in Stack

If you don't see data appearing in your stack after following this integration, take a look at the troubleshooting guide for steps to diagnose and resolve the problem or contact our support team and we'll be happy to assist.

VPC Flow Logs Overview

Sending data from your Amazon VPC to Logit.io is a streamlined process that enhances your AWS ecosystem's visibility and analytical capabilities. Logit.io's robust integration solutions make it effortless to consolidate logs and metrics, providing invaluable insights into your infrastructure's performance and security. With this integration, you can centralize your data, enabling efficient monitoring and troubleshooting while leveraging Logit.io's powerful analytics tools.

Additionally, for in-depth insights into AWS EKS it is well worth exploring this dedicated integration. These resources will help empower you to optimize your data analytics capabilities and make informed decisions about your AWS environment.

Logit.io's service for AWS logging (opens in a new tab) is renowned for its fully scalable operations, thanks to these integrations.