HTTP Metrics

Collect and ship HTTP endpoint server metrics to Logstash and Elasticsearch

Metricbeat is a lightweight shipper that helps you monitor your servers by collecting HTTP endpoint server metrics. Configure Metricbeat using the pre-defined examples below to collect and ship abitrary HTTP endpoint server metrics and statistics to Logstash or Elasticsearch.

Install Integration

Please click on the Install Integration button to configure your stack for this source.

Install Metricbeat

To get started first follow the steps below:

Install metricbeat (opens in a new tab)
Root access
Verify the required port is open

Older versions can be found here: metricbeat 7 (opens in a new tab), metricbeat 6 (opens in a new tab), metricbeat 5 (opens in a new tab)

Copy Configuration File

The configuration file below is pre-configured to send data to your Logit.io Stack via Logstash.

Copy the configuration file below and overwrite the contents of metricbeat.yml.

###################### Logit.io Metricbeat Configuration #######################
# =========================== Modules configuration ============================
 
metricbeat.config.modules:
  # Glob pattern for configuration loading
  path: ${path.config}/modules.d/*.yml
 
  # Set to true to enable config reloading
  reload.enabled: false
 
  # Period on which files under path should be checked for changes
  #reload.period: 10s
# ======================= Elasticsearch template setting =======================
setup.template.settings:
  index.number_of_shards: 1
  index.codec: best_compression
  #_source.enabled: false
 
# ================================== Outputs ===================================
# ------------------------------ Logstash Output -------------------------------

⚠️

No input available! Your stack is missing the required input for this data source

Talk to support to add the input

Enable module

There are several built-in metricbeat modules you can use. To enable the http module, run the following:

metricbeat modules list
metricbeat modules enable @module

Configure Module

Each module has its own configuration file where different metricsets can be enabled / disabled. Locate the configuration file for the http module.

/etc/metricbeat/modules.d/@module.yml

By default the following metricsets are disabled. To enable or disable a metric simply comment or uncomment the line out.

- module: http
  #metricsets:
  #  - json
  period: 10s
  hosts: ["localhost:80"]
  namespace: "json_namespace"
  path: "/"
  #body: ""
  #method: "GET"
  #username: "user"
  #password: "secret"
  #request.enabled: false
  #response.enabled: false
  #json.is_array: false
  #dedot.enabled: false
 
- module: http
  #metricsets:
  #  - server
  host: "localhost"
  port: "8080"
  enabled: false
  #paths:
  #  - path: "/foo"
  #    namespace: "foo"
  #    fields: # added to the the response in root. overwrites existing fields
  #      key: "value"

Start Metricbeat

Start or restart Metricbeat (opens in a new tab) to apply the configuration changes.

Check Logit.io for your logs

Data should now have been sent to your Stack.

View My Data

If you don't see take a look at How to diagnose no data in Stack below for how to diagnose common issues.

How to diagnose no data in Stack

If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.

HTTP Metricbeat Module Overview

The Metricbeat Module for HTTP. HTTP is a meticulously designed solution for monitoring services by collecting metrics via HTTP endpoints. Those already acquainted with Metricbeat's broad capabilities in data collection will find its application to HTTP monitoring both intuitive and exceptionally versatile.

HTTP, the foundation of data communication for the World Wide Web, facilitates the transfer of data across web servers and clients. The Metricbeat Module for HTTP leverages this protocol to fetch metrics from specified endpoints, enabling the monitoring of a wide array of services and applications through their HTTP interfaces. This module supports both GET and POST requests, allowing for the retrieval of metrics in various formats such as JSON, XML, or plain text.

This module is invaluable for developers, system administrators, and DevOps professionals who require a flexible solution to monitor the health, performance, and availability of services exposed via HTTP. Our platform extends robust support for the Metricbeat Module for HTTP, offering centralized management of metrics for simplified analysis and active monitoring. This support effectively mitigates the challenges associated with manually collecting and analyzing metrics from various HTTP endpoints.

Should you require assistance with configuring the Metricbeat Module for HTTP or have questions about monitoring your services via HTTP, the Logit.io team is prepared to assist. We encourage you to visit our Help Centre or contact our support team via via live chat & we'll be happy to assist.

Protocols Telegraf