Skip to content

Commit

Permalink
add warning around using logstash
Browse files Browse the repository at this point in the history
Signed-off-by: Edward Welch <[email protected]>
  • Loading branch information
slim-bean committed Sep 5, 2024
1 parent 4f962ef commit 8e684e2
Showing 1 changed file with 17 additions and 0 deletions.
17 changes: 17 additions & 0 deletions docs/sources/send-data/logstash/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,23 @@ Grafana Loki has a [Logstash](https://www.elastic.co/logstash) output plugin cal
`logstash-output-loki` that enables shipping logs to a Loki
instance or [Grafana Cloud](/products/cloud/).

{{% admonition type="warning" %}}
The Logstash plugin is not recommended for new deployments. Even as a mechanism for quickly testing Loki with your existing Beats/Logstash infrastructure we highly discourage the use of this plugin.

Our experience over the years has found numerous significant challenges using Logstash and this plugin:

* It's very difficult to configure and get labels correct, conceptually Elasticsearch is a very different database from Loki and users almost always end up sending too many high cardinality labels to Loki which makes getting start with Loki unnecessarily complicated and confusing vs using other clients.
* Logstash and the upstream Beats components implement backoff and flow control which we've found hard to observe leading to ingestion delays into Loki which are hard or impossible to address.
* It's difficult to impossible to configure Logstash in a way that sending logs to multiple destinations doesn't create scenarios where problems with one database can cause problems with another.
* We at Grafana Labs have no expertise at configuring Logstash or understanding its configuration language, so we can't help you with it.
* It's very hard to troubleshoot and debug, our experience has shown that in nearly every case where it was assumed this would be the fast path to getting logs to Loki that was not the case and it ended up being a significant time sink.

Please... strongly consider using any alternative mechanism to sending logs to Loki.

We recommend using [Grafana Alloy](/docs/loki/latest/send-data/alloy/), this is the tool we build and the tool for which we can offer the best experience and most support.

{{% /admonition %}}

## Installation

### Local
Expand Down

0 comments on commit 8e684e2

Please sign in to comment.