Google Cloud Load Balancing

Logs

Send Google Cloud platform load balancing logs to Logit.io via Logstash.

Install Integration

Confirm Google Cloud Load Balancing Logs

If you already have logging enabled for your Google Cloud load balancing you can skip to step 2. Instructions on how to configure Google Cloud load balancing can be found here (opens in a new tab).

Google Cloud provides a basic log viewer, in order to get the logs into your Stack we need to configure a Pub/Sub sink, from where Logstash can collect the logs.

Create A Sink

To export the logs choose Create sink as shown below.

You will be then be prompted for:

• Sink details (enter a name)
• Sink destination (choose Cloud Pub/Sub topic creating a new topic if needed)
• Choose logs to include in sink (this will have a filter applied already if you filtered the logs above)

Choose Create sink to continue.

Create Google Pub/Sub

Locate your newly created Pub/Sub topic (opens in a new tab) and choose Create subscription.

Enter a suitable Subscription ID and leave the delivery type as pull.

We don't need to change anything further at this stage, scroll to the bottom and choose CREATE to create the Subscription.

Create Service Account

Now in service accounts (opens in a new tab), choose the project you're working with.

Then select CREATE SERVICE ACCOUNT, this account will be used to retrieve logs from the Pub/Sub and send them to Logit.io.

Name the service account and in step 2 add the role Pub/Sub Subscriber as shown below, then choose DONE.

Now choose Manage keys as shown below.

Then choose ADD KEY > Create new key, choosing the recommended JSON format. This will download the JSON key to your machine ready to use in the next step.

Configuring Logstash

To start pulling logs and metrics from the Google Cloud Platform to your Stack you need to configure a Google Cloud Platform Input on your Logit.io Stack.

Launch Logit.io to view your logs

Data should now have been sent to your Stack.

If you don't see take a look at How to diagnose no data in Stack below for how to diagnose common issues.

Metrics

Configure Telegraf to ship Google Cloud Load Balancing metrics to your Logit.io stack

Install Integration

Set Credentials in GCP

Install Telegraf

This integration allows you to configure a Telegraf agent to send your metrics, in multiple formats, to Logit.io.

Choose the installation method for your operating system:

wget https://dl.influxdata.com/telegraf/releases/telegraf-1.31.2_windows_amd64.zip -UseBasicParsing -OutFile telegraf-1.31.2_windows_amd64.zip 
Expand-Archive .\telegraf-1.31.2_windows_amd64.zip -DestinationPath 'C:\Program Files\InfluxData\telegraf'

Configure the Telegraf input plugin

# Gather timeseries from Google Cloud Platform v3 monitoring API
[[inputs.stackdriver]]
  ## GCP Project
  project = "<your-project-name>"
 
  ## Include timeseries that start with the given metric type.
  metric_type_prefix_include = [
	"@metric_type",
  ]
 
  ## Most metrics are updated no more than once per minute; it is recommended
  ## to override the agent level interval with a value of 1m or greater.
  interval = "1m"

Configure the output plugin

Once you have generated the configuration file, you need to set up the output plug-in to allow Telegraf to transmit your data to Logit.io in Prometheus format. This can be accomplished by incorporating the following code into your configuration file:

[[outputs.http]]
  url = "https://@metricsUsername:@metricsPassword@@metrics_id-vm.logit.io:@vmAgentPort/api/v1/write"
  data_format = "prometheusremotewrite"
 
  [outputs.http.headers]
    Content-Type = "application/x-protobuf"
    Content-Encoding = "snappy"

Start Telegraf

.\telegraf.exe --config telegraf-demo.conf

View your metrics

Data should now have been sent to your Stack.

If you don't see metrics take a look at How to diagnose no data in Stack below for how to diagnose common issues.

How to diagnose no data in Stack

If you don't see data appearing in your stack after following this integration, take a look at the troubleshooting guide for steps to diagnose and resolve the problem or contact our support team and we'll be happy to assist.