Encrypted Repository Plugin for OpenSearch®

Encrypted Repository for OpenSearch® is a plugin that offers client-side encryption for snapshotting repositories and could be combined with all official supported repository plugins: File Systsem, Google Cloud Storage, Amazon S3 and Microsoft Azure.

• Features
• Compatibility Matrix
• Plugin Configuration
• Repository Settings
• Installation
• Build from Source
• Testing
• Contribute
• Security
• License
• Copyright

Features

• Support for AES 256 bits keys
• AES GCM with AAD encryption support

Compatibility Matrix

OpenSearch	Plugin	Release date
2.14.0	2.14.0.0	Jun 09, 2024
2.13.0	2.13.0.0	Mai 09, 2024
2.12.0	2.12.0.0	Mai 09, 2024
2.11.1	2.11.1.0	Mai 09, 2024
2.9.0	2.9.0.1	Jul 29, 2023

Plugin Configuration

• OpenSearch keystore settings

  • encrypted.<storage_type>.<client_name>.private_key - RSA private key
  • encrypted.<storage_type>.<client_name>.public_key - RSA public key,

  where storage_type is one of azure, fs, gcs and s3 and client the name of the client delegated repository to be used

Repository Settings

• storage_type - delegated repository type, supported values are: azure, fs, gcs and s3
• chunk_size - chunk size as a value and unit, for example: 1MB, 1GB, 1TB. Default value is: 1GB, min value - 500MB, max value - 64GB
• client - the name of a client for Azure, FS, GCS and S3 repository to use
• compress - compress snapshot metadata, default is true

Installation

• Download the latest release from releases
• Extract selected archive into OpenSearch plugins directory
• Generate RSA key pair:

  openssl genrsa -out key.pem 2048 # Private key
  openssl rsa -in key.pem -outform PEM -pubout -out public.pem # Public key

• Create OpenSearch keystore:

  opensearch-keystore create

• Import generated RSA keys into OpenSearch keystore
  • Azure

    opensearch-keystore add-file --force encrypted.azure.default.private_key ~/key.pem
    opensearch-keystore add-file --force encrypted.azure.default.public_key ~/public.pem

  • File System

    opensearch-keystore add-file --force encrypted.fs.default.private_key ~/key.pem
    opensearch-keystore add-file --force encrypted.fs.default.public_key ~/public.pem

  • GCS

    opensearch-keystore add-file --force encrypted.gcs.default.private_key ~/key.pem
    opensearch-keystore add-file --force encrypted.gcs.default.public_key ~/public.pem

  • Amazon S3

    opensearch-keystore add-file --force encrypted.s3.default.private_key ~/key.pem
    opensearch-keystore add-file --force encrypted.s3.default.public_key ~/public.pem

• Start OpenSearch
  • Configure repository using Azure:

    PUT _snapshot/repository_name
      {
        "type": "encrypted",
        "settings": {
          "storage_type": "azure",   
          "client": "secondary",
          "container": "my-azure-container",
          "base_path" : "cluster1"
        }
      }

  • Configure repository using file system:

    PUT _snapshot/repository_name
      {
        "type": "encrypted",
        "settings": {
          "storage_type": "fs",   
          "client": "secondary",
          "location": "/mount/backups/my_fs_backup_location"            
        }
      }

  • Configure repository using GCS:

    PUT _snapshot/repository_name
      {
        "type": "encrypted",
        "settings": {
          "storage_type": "gcs",   
          "client": "secondary",
          "bucket": "name-of-gcs-bucket",
          "compress": true
        }
      }

  • Configure repository using S3:

    PUT _snapshot/repository_name
      {
        "type": "encrypted",
        "settings": {
          "storage_type": "s3",   
          "client": "secondary",
          "bucket": "name-of-bucket",
          "region": "region-of-bucket-same-as-cluster"
        }
      }

Build from Source

The project in this package uses the Gradle build system. Gradle comes with excellent documentation that should be your first stop when trying to figure out how to operate or modify the build. To build the plugin you need at least JDK 11:

./gradlew clean build 

Testing

Complete test suite is run using:

./gradlew clean assemble check

Contribute

See CONTRIBUTING for more information.

Security

See CONTRIBUTING for more information.

License

This code is licensed under the Apache 2.0 License. See LICENSE.txt.

Copyright

Copyright OpenSearch Contributors. See NOTICE for details.