Skip to content

Releases: databricks/iceberg-kafka-connect

0.5.4

10 Oct 15:51
714901f
Compare
Choose a tag to compare

NOTE: binaries pulled, use 0.5.7 or later

  • Adds support for using the topics.regex property

0.5.3

10 Oct 00:13
d723d3e
Compare
Choose a tag to compare

NOTE: binaries pulled, use 0.5.7 or later

  • Allow auto create tables in conjunction with dynamic routing
  • Allow nested fields for route field and cdc operation field
  • Debezium SMT config to set target metadata field

0.5.2

08 Oct 16:33
0f2eb9f
Compare
Choose a tag to compare

NOTE: binaries pulled, use 0.5.7 or later

  • Adds data type evolution for int -> long and float -> double
  • Adds option to set the partition spec for auto table create
  • Adds key metadata field in the Debezium SMT

0.5.1

06 Oct 19:38
d0adaf9
Compare
Choose a tag to compare

NOTE: binaries pulled, use 0.5.7 or later

Adds an experimental Debezium SMT for use with the sink

0.5.0

05 Oct 03:54
71db253
Compare
Choose a tag to compare

NOTE: binaries pulled, use 0.5.7 or later

The only change from 0.5.0-rc.2 is a build update for Iceberg 1.4.0 release.

REMINDER: There are backwards-incompatible property name changes since 0.5.0-rc.1. See the 0.5.0-rc.2 release notes for details.

0.5.0-rc.2

04 Oct 18:09
03dcf40
Compare
Choose a tag to compare
0.5.0-rc.2 Pre-release
Pre-release

NOTE: binaries pulled, use 0.5.7 or later

  • Updates Iceberg to v1.4.0-rc.2
  • Updates property names to align with the Iceberg project

NOTE: This release has backwards-incompatible property name changes. If upgrading you will need to update your sink config.

iceberg.tables.dynamic.enabled -> iceberg.tables.dynamic-enabled
iceberg.tables.routeField -> iceberg.tables.route-field
iceberg.tables.defaultCommitBranch -> iceberg.tables.default-commit-branch
iceberg.tables.cdcField -> iceberg.tables.cdc-field
iceberg.tables.upsertModeEnabled -> iceberg.tables.upsert-mode-enabled
iceberg.tables.autoCreateEnabled -> iceberg.tables.auto-create-enabled
iceberg.tables.evolveSchemaEnabled -> iceberg.tables.evolve-schema-enabled
iceberg.table.<table name>.idColumns -> - iceberg.table.<table name>.id-columns
iceberg.table.<table name>.routeRegex -> iceberg.table.<table name>.route-regex
iceberg.table.<table name>.commitBranch -> iceberg.table.<table name>.commit-branch
iceberg.control.group.id -> iceberg.control.group-id
iceberg.control.commitIntervalMs -> iceberg.control.commit.interval-ms
iceberg.control.commitTimeoutMs -> iceberg.control.commit.timeout-ms
iceberg.control.commitThreads -> iceberg.control.commit.threads

0.5.0-rc.1

29 Sep 02:39
ef486b1
Compare
Choose a tag to compare
0.5.0-rc.1 Pre-release
Pre-release
  • Adds support for evolving the schema of destination tables to match the record schema
  • Adds support for automatically creating the destination tables based on the record schema
  • Adds support for committing to a branch
  • Improved date and time conversions

0.4.14

20 Sep 04:57
bb82487
Compare
Choose a tag to compare

Adds a configuration option for specifying the columns to use as the row identifier, for upsert and CDC.

0.4.13

16 Sep 00:07
0e18059
Compare
Choose a tag to compare

Includes an Iceberg 1.3.1 build with apache/iceberg#8397 backported.

0.4.12

14 Sep 22:41
809ff6d
Compare
Choose a tag to compare

Adds support for specifying a Hadoop config file directory, with the iceberg.hadoop-conf-dir sink config property.