Logstash Output Amazon Es banner
awslabs awslabs

Logstash Output Amazon Es

Data community

Description

Logstash output plugin to sign and export logstash events to Amazon Elasticsearch Service

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Logstash Output Plugin

This plugin is now in maintenance mode. We will supply bug fixes and security patches for v7.2.X, older versions are no longer supported. This change is because the OpenSearch Project created a new Logstash output plugin [logstash-output-opensearch](https://github.com/opensearch-project/logstash-output-opensearch) which ships events from Logstash to OpenSearch 1.x and Elasticsearch 7.x clusters, and also supports SigV4 signing. Having similar functionality plugins can be redundant, so we plan to eventually replace this logstash-output-amazon_es plugin with the logstash-output-opensearch plugin.

To help you migrate to [logstash-output-opensearch](https://github.com/opensearch-project/logstash-output-opensearch) plugin, please find below a brief migration guide.

Migrating to logstash-output-opensearch plugin

This guide provides instructions for existing users of logstash-output-amazon_es plugin to migrate to logstash-output-opensearch plugin.

Configuration Changes

  • The plugin name will change from amazon_es to opensearch.
  • If using HTTPS this must be explicitly configured because opensearch plugin does not default to it like amazon_es does:
    • The protocol must be included in hosts as https (or option ssl added with value true)
    • port must explicitly specified as 443
  • A new parameter auth_type will be added to the Config to support SigV4 signing.
  • The region parameter will move under auth_type.
  • Credential parameters aws_access_key_id and aws_secret_access_key will move under auth_type.
  • The type value for auth_type for SigV4 signing will be set to aws_iam.

For the Logstash configuration provided in [Configuration for Amazon Elasticsearch Service Output Plugin ](#configuration-for-amazon-elasticsearch-service-output-plugin), here's a mapped example configuration for logstash-output-opensearch plugin:

output {
   opensearch {
          hosts => ["https://hostname:port"]