Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update: kafka connectors pages #409

Merged
merged 3 commits into from
Aug 21, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -3,99 +3,79 @@ title: Available Apache Kafka® Connect connectors
sidebar_label: Available connectors
---

The following connectors can be used in any Aiven for Apache Kafka® services with Apache Kafka Connect enabled.
Discover a variety of connectors available for use with any Aiven for Apache Kafka® service with [Apache Kafka® Connect enabled](/docs/products/kafka/kafka-connect/howto/enable-connect).

## Source connectors

Source connectors enable the integration of data from an existing
technology into an Apache Kafka topic. The following is the list of
available source connectors:

- [Couchbase](https://github.com/couchbase/kafka-connect-couchbase)
- [Official
MongoDB®](https://www.mongodb.com/docs/kafka-connector/current/)
- [Debezium for
MongoDB®](https://debezium.io/docs/connectors/mongodb/)
- [Debezium for MySQL](https://debezium.io/docs/connectors/mysql/)
- [Debezium for PostgreSQL®](/docs/products/kafka/kafka-connect/howto/debezium-source-connector-pg)
- [Debezium for SQL
Server](https://debezium.io/docs/connectors/sqlserver/)
- [Google Cloud
Pub/Sub](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Pub/Sub
Lite](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [JDBC](https://github.com/aiven/jdbc-connector-for-apache-kafka/blob/master/docs/source-connector.md)
- Schema Source
- [Stream Reactor
Cassandra®](https://docs.lenses.io/5.1/connectors/sources/cassandrasourceconnector/)
- [Stream Reactor
MQTT](https://docs.lenses.io/5.1/connectors/sources/mqttsourceconnector/)
- [Couchbase](https://github.com/couchbase/kafka-connect-couchbase)
- [Official MongoDB®](https://www.mongodb.com/docs/kafka-connector/current/)
- [Debezium for MongoDB®](https://debezium.io/docs/connectors/mongodb/)
- [Debezium for MySQL](https://debezium.io/docs/connectors/mysql/)
- [Debezium for PostgreSQL®](/docs/products/kafka/kafka-connect/howto/debezium-source-connector-pg)
- [Debezium for SQL Server](https://debezium.io/docs/connectors/sqlserver/)
- [Google Cloud Pub/Sub](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Pub/Sub Lite](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [JDBC](https://github.com/aiven/jdbc-connector-for-apache-kafka/blob/master/docs/source-connector.md)
- [Stream Reactor Cassandra®](https://docs.lenses.io/5.1/connectors/sources/cassandrasourceconnector/)
- [Stream Reactor MQTT](https://docs.lenses.io/5.1/connectors/sources/mqttsourceconnector/)

## Sink connectors

Sink connectors enable the integration of data from an existing Apache
Kafka topic to a target technology. The following is the list of
available sink connectors:

- [Aiven for Apache Kafka® S3 Sink Connector](/docs/products/kafka/kafka-connect/howto/s3-sink-connector-aiven)
- [Confluent Amazon S3
Sink](/docs/products/kafka/kafka-connect/howto/s3-sink-connector-confluent)
- [Couchbase®](https://github.com/couchbase/kafka-connect-couchbase)
- [OpenSearch®](/docs/products/kafka/kafka-connect/howto/opensearch-sink)
- [Elasticsearch](/docs/products/kafka/kafka-connect/howto/elasticsearch-sink)
- [Google
BigQuery](https://github.com/confluentinc/kafka-connect-bigquery)
- [Google Cloud
Pub/Sub](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Pub/Sub
Lite](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Storage](/docs/products/kafka/kafka-connect/howto/gcs-sink)
- [HTTP](https://github.com/aiven/http-connector-for-apache-kafka)
- [JDBC](https://github.com/aiven/jdbc-connector-for-apache-kafka/blob/master/docs/sink-connector.md)
- [Official
MongoDB®](https://docs.mongodb.com/kafka-connector/current/)
- [Snowflake](https://docs.snowflake.com/en/user-guide/kafka-connector)
- [Splunk](https://github.com/splunk/kafka-connect-splunk)
- [Stream Reactor
Cassandra®](https://docs.lenses.io/5.1/connectors/sinks/cassandrasinkconnector/)
- [Stream Reactor
InfluxDB®](https://docs.lenses.io/5.1/connectors/sinks/influxsinkconnector/)
- [Stream Reactor
MongoDB®](https://docs.lenses.io/5.1/connectors/sinks/mongosinkconnector/)
- [Stream Reactor
MQTT](https://docs.lenses.io/5.1/connectors/sinks/mqttsinkconnector/)
- [Stream Reactor
Redis®*](https://docs.lenses.io/5.1/connectors/sinks/redissinkconnector/)
- [Aiven for Apache Kafka® S3 sink connector](/docs/products/kafka/kafka-connect/howto/s3-sink-connector-aiven)
- [Confluent Amazon S3 sink](/docs/products/kafka/kafka-connect/howto/s3-sink-connector-confluent)
- [Couchbase®](https://github.com/couchbase/kafka-connect-couchbase)
- [OpenSearch®](/docs/products/kafka/kafka-connect/howto/opensearch-sink)
- [Elasticsearch](/docs/products/kafka/kafka-connect/howto/elasticsearch-sink)
- [Google BigQuery](https://github.com/confluentinc/kafka-connect-bigquery)
- [Google Cloud Pub/Sub](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Pub/Sub Lite](https://github.com/googleapis/java-pubsub-group-kafka-connector/)
- [Google Cloud Storage](/docs/products/kafka/kafka-connect/howto/gcs-sink)
- [HTTP](https://github.com/aiven/http-connector-for-apache-kafka)
- [JDBC](https://github.com/aiven/jdbc-connector-for-apache-kafka/blob/master/docs/sink-connector.md)
- [Official MongoDB®](https://docs.mongodb.com/kafka-connector/current/)
- [Snowflake](https://docs.snowflake.com/en/user-guide/kafka-connector)
- [Splunk](https://github.com/splunk/kafka-connect-splunk)
- [Stream Reactor Cassandra®](https://docs.lenses.io/5.1/connectors/sinks/cassandrasinkconnector/)
- [Stream Reactor InfluxDB®](https://docs.lenses.io/5.1/connectors/sinks/influxsinkconnector/)
- [Stream Reactor MongoDB®](https://docs.lenses.io/5.1/connectors/sinks/mongosinkconnector/)
- [Stream Reactor MQTT](https://docs.lenses.io/5.1/connectors/sinks/mqttsinkconnector/)
- [Stream Reactor Redis®*](https://docs.lenses.io/5.1/connectors/sinks/redissinkconnector/)
- [IBM MQ sink connector](/docs/products/kafka/kafka-connect/howto/ibm-mq-sink-connector)

## Preview connectors

![Preview icon next to an OpenSearch® Apache Kafka® Connect connector](/images/content/products/kafka/kafka-connect/preview-kafka-connect-connectors.png)

Some of the available connectors have the tag next to the name.
**Preview connectors do not come under our SLA**, consider this before
using them for production purposes. Bugs should be reported to the code
owner directly.
Some connectors have a preview tag. **Preview connectors are not covered by our SLA**,
so consider this before using them in production environments. Report bugs directly to
the code owner.

## Requesting new connectors

If you know about new and interesting connectors you'd like us to
support, open a support request about it to help us shaping the
future roadmap. You can request adding support of a new connector by
creating a support ticket. We will evaluate the requested connector and
might add support for it.
If there are connectors you'd like us to support, submit a support request. Your
feedback helps shape our roadmap. To request a new connector,
[create a support ticket](/docs/platform/howto/support#create-a-support-ticket).

Aiven evaluation process for new Apache Kafka Connect connectors checks:
Aiven evaluates new Apache Kafka Connect connectors based on:

- license compatibility
- technical implementation
- active repository maintenance
- License compatibility
- Technical implementation
- Active repository maintenance

:::tip
When requesting connectors that are not on the pre-approved list through
a support ticket, specify the target Aiven for Apache Kafka service
you'd like to have it installed to.
When requesting connectors not on the pre-approved list, specify the target Aiven for
Apache Kafka service.
:::


------------------------------------------------------------------------

import ElasticSearch from "@site/static/includes/trademark-elasticsearch.md"
Expand Down

This file was deleted.

10 changes: 2 additions & 8 deletions sidebars.ts
Original file line number Diff line number Diff line change
Expand Up @@ -958,10 +958,7 @@ const sidebars: SidebarsConfig = {
{
type: 'category',
label: 'Source connectors',
link: {
type: 'generated-index',
slug: 'products/kafka/kafka-connect/howto/list-source-connectors',
},

items: [
'products/kafka/kafka-connect/howto/jdbc-source-connector-pg',
'products/kafka/kafka-connect/howto/debezium-source-connector-pg',
Expand All @@ -983,10 +980,7 @@ const sidebars: SidebarsConfig = {
{
type: 'category',
label: 'Sink connectors',
link: {
type: 'doc',
id: 'products/kafka/kafka-connect/howto/list-sink-connectors',
},

items: [
'products/kafka/kafka-connect/howto/jdbc-sink',
'products/kafka/kafka-connect/howto/s3-sink-prereq',
Expand Down
8 changes: 5 additions & 3 deletions static/_redirects
Original file line number Diff line number Diff line change
Expand Up @@ -83,18 +83,23 @@
/products/dragonfly/concept https://aiven.io/docs/products/dragonfly
/products/dragonfly/concepts/overview https://aiven.io/docs/products/dragonfly
/products/dragonfly/howto/migrate-aiven-redis-df-console https://aiven.io/docs/products/dragonfly/howto/migrate-aiven-caching-df-console
/products/flink/concepts https://aiven.io/docs/products/flink/concepts/flink-architecture
/products/flink/concepts/flink-features https://aiven.io/docs/products/flink
/products/flink/concepts/managed-service-features https://aiven.io/docs/products/flink
/products/flink/concepts/managed-service-features.html https://aiven.io/docs/products/flink
/products/flink/howto https://aiven.io/docs/products/flink/howto/create-integration
/products/flink/howto/list-get-started https://aiven.io/docs/products/flink/get-started
/products/flink/howto/real-time-alerting-solution https://aiven.io/docs/products/flink/howto/list-get-started
/products/flink/list-overview https://aiven.io/docs/products/flink
/products/flink/reference https://aiven.io/docs/products/flink/reference/advanced-params
/products/grafana/concepts/grafana-features https://aiven.io/docs/products/grafana
/products/grafana/list-overview https://aiven.io/docs/products/grafana
/products/influxdb https://aiven.io/docs/products/services
/products/influxdb/* https://aiven.io/docs/products/services
/products/kafka/getting-started https://aiven.io/docs/products/kafka/get-started
/products/kafka/index.html https://aiven.io/docs/products/kafka
/products/kafka/kafka-connect/howto/list-sink-connectors https://aiven.io/docs/products/kafka/kafka-connect/howto/enable-connect
/products/kafka/kafka-connect/howto/list-source-connectors https://aiven.io/docs/products/kafka/kafka-connect/howto/enable-connect
/products/kafka/kafka-mirrormaker/howto/setup-mirrormaker-monitoring https://aiven.io/docs/products/kafka/kafka-mirrormaker/howto/setup-replication-flow
/products/kafka/karapace/howto/manage-kafka-rest-proxy-authorization https://aiven.io/docs/products/kafka/karapace/howto/enable-kafka-rest-proxy-authorization
/products/metrics/concepts/metrics-overview https://aiven.io/docs/products/metrics
Expand Down Expand Up @@ -140,6 +145,3 @@
/tools/terraform/reference/troubleshooting/private-access-error https://aiven.io/docs/tools/terraform
/tutorials/anomaly-detection https://aiven.io/developer
/valkey https://aiven.io/docs/products/valkey
/products/flink/concepts https://aiven.io/docs/products/flink/concepts/flink-architecture
/products/flink/howto https://aiven.io/docs/products/flink/howto/create-integration
/products/flink/reference https://aiven.io/docs/products/flink/reference/advanced-params