Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add warning around using logstash plugin for new deployments #14058

Merged
merged 11 commits into from
Nov 26, 2024
16 changes: 16 additions & 0 deletions docs/sources/send-data/logstash/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,22 @@ Grafana Loki has a [Logstash](https://www.elastic.co/logstash) output plugin cal
`logstash-output-loki` that enables shipping logs to a Loki
instance or [Grafana Cloud](/products/cloud/).

{{% admonition type="warning" %}}
slim-bean marked this conversation as resolved.
Show resolved Hide resolved
The Logstash plugin is not recommended for new deployments. Even as a mechanism for quickly testing Loki with your existing Beats/Logstash infrastructure we highly discourage the use of this plugin.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved

Our experience over the years has found numerous significant challenges using Logstash and this plugin:

* It's very difficult to configure and get labels correct, conceptually Elasticsearch is a very different database from Loki and users almost always end up sending too many high cardinality labels to Loki which makes getting started with Loki unnecessarily complicated and confusing vs using other clients.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved
* Logstash and the upstream Beats components implement backoff and flow control which we've found hard to observe leading to ingestion delays into Loki which are hard or impossible to address.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved
* We at Grafana Labs have no expertise at configuring Logstash or understanding its configuration language, so we can't help you with it.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved
* It's very hard to troubleshoot and debug, our experience has shown that in nearly every case where it was assumed this would be the fast path to getting logs to Loki that was not the case and it ended up being a significant time sink.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved

Please... strongly consider using any alternative mechanism to sending logs to Loki.

We recommend using [Grafana Alloy](/docs/loki/latest/send-data/alloy/), this is the tool we build and the tool for which we can offer the best experience and most support.
slim-bean marked this conversation as resolved.
Show resolved Hide resolved

{{% /admonition %}}
slim-bean marked this conversation as resolved.
Show resolved Hide resolved

## Installation

### Local
Expand Down
Loading