Skip to content

Releases: memiiso/debezium-server-iceberg

Release latest

30 Nov 10:09
3960613
Compare
Choose a tag to compare
Release latest Pre-release
Pre-release

Release latest

Release 0.7.0.Final

08 Sep 12:53
Compare
Choose a tag to compare
  • Debezium: 2.7.2.Final
  • Apache Iceberg: 1.6.1
  • Quarkus: 3.13.3

Breaking Changes

Equality deletes:

  • Now Equality delete files are containing key fields only and they are written with record projection. Now delete files only includes key files, previously delete files were including full delete record.

Notable changes

  • Various code improvement added. Now code base is more closely aligned with upstream iceberg-kafka-connect
  • Now size of the files generated is defined write.target-file-size-bytes config, previously Long.MAX_VALUE was used
  • Iceberg upgraded from 1.6.0 to 1.6.1
  • Debezium upgraded from 2.7.0.Final to 2.7.2.Final
  • Quarkus upgraded from 3.13.0 to 3.13.3

What's Changed

Full Changelog: 0.6.0.Final...0.7.0.Final

Release 0.6.0.Final

03 Aug 12:47
54a0783
Compare
Choose a tag to compare
  • Debezium: 2.7.0.Final
  • Apache Iceberg: 1.6.0
  • Quarkus: 3.13.0

Notable changes

  • new config added to control casing of iceberg table names. To change tables names uppercase or lowercase folloing configuration properties could be used, see documentation. debezium.sink.iceberg.destination-uppercase-table-names=true or debezium.sink.iceberg.destination-lowercase-table-names=true
  • Quarkus upgraded from 3.12.x to 3.13.x, See Quarkus release notes here

What's Changed

  • Add option to change case of destination/iceberg table names by @ismailsimsek in #389
  • Bump version.quarkus from 3.12.3 to 3.13.0 by @dependabot in #392
  • Bump org.apache.maven.plugins:maven-failsafe-plugin from 3.2.5 to 3.3.1 by @dependabot in #395
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.3.0 to 3.3.1 by @dependabot in #394
  • Bump io.smallrye:jandex-maven-plugin from 3.2.0 to 3.2.1 by @dependabot in #393

Full Changelog: 0.5.0.Final...0.6.0.Final

Release 0.5.0.Final

24 Jul 13:56
623377d
Compare
Choose a tag to compare
  • Debezium: 2.7.0.Final
  • Apache Iceberg: 1.6.0
  • Quarkus: 3.12.3

What's Changed

Full Changelog: 0.5.0.Beta...0.5.0.Final

Release 0.5.0.Beta

28 Jun 14:17
2957e3b
Compare
Choose a tag to compare
  • Debezium: 2.7.0.Final
  • Apache Iceberg: 1.5.2
  • Quarkus: 3.10.0

Breaking Changes

Debezium version upgraded from 2.5.x to 2.7.x:

IcebergSchemaHistory wrong table location corrected:

IcebergSchemaHistory class was using wrong table namespace {catalog-name}.{table-name} now this is corrected to use {table-namespace}.{table-name}
If you were using different catalog-name please follow following steps for migration

  1. stop debezium server
  2. copy the IcebergSchemaHistory table to new location: {table-namespace}.{table-name}
  3. start debezium server

Configuration change:

Configuration option debezium.sink.iceberg.upsert-op-column, defaultValue = __op is removed.

Notable changes

  • Quarkus upgraded from 3.6.x to 3.10.x, See Quarkus release notes here
  • Java release target upgraded from 11 to 17
  • Full support for debezium nested events added. Now its possible to run consumer without event flattening.
  • Debezium event processing improved, unnecessary schema de-serialization is avoided.

What's Changed

Full Changelog: 0.4.0.Final...0.5.0.Beta

Release 0.4.1.Final

29 May 19:15
c9c4ce2
Compare
Choose a tag to compare

This release includes fix to debezium storage classes {IcebergSchemaHistory, IcebergOffsetBackingStore}. Now both classes can be used by icebergevents consumer too.

  • Debezium: 2.7.0.Alpha1
  • Apache Iceberg: 1.5.2
  • Quarkus: 3.10.0

Breaking Changes

IcebergSchemaHistory class was using wrong table name {catalog-name}.{table-name} now this is corrected to {table-namespace}.{table-name}
If you were using different catalog-name previously please follow following steps for migration

  1. stop debezium server
  2. move the table to new location: {table-namespace}.{table-name}
  3. start the debezium server

What's Changed

  • Simplify example config, removed hadoop catalog example by @ismailsimsek in #321
  • Fix reading config values in debezium storage classes by @ismailsimsek in #327
  • Minor improvements to icebergevents consumer, IcebergEventsChangeCons… by @ismailsimsek in #328

Release 0.4.0.Final

02 May 19:59
14b2158
Compare
Choose a tag to compare

Release 0.4.0.Final

What's Changed

Full Changelog: 0.3.0.Final...0.4.0.Final

Release 0.4.0.Beta

03 Mar 21:39
0d5e9ce
Compare
Choose a tag to compare

This release includes dependency upgrades and improvements with dependency versions.

Breaking Changes

Removed iceberg-spark-runtime-* dependency from the release in #114

Debezium version upgraded from 2.2.1 to 2.5.2
For Debezium 2.2 Breaking Changes please see release notes
For Debezium 2.3 Breaking Changes please see release notes
For Debezium 2.4 Breaking Changes please see release notes
For Debezium 2.5 Breaking Changes please see release notes

Iceberg upgraded from 1.3.x to 1.5.0
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.6.9
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

New Contributors

Full Changelog: 0.3.0.Beta...0.4.0.Beta

Release 0.3.0.Final

03 Mar 22:42
0d5e9ce
Compare
Choose a tag to compare

Release 0.3.0.Final

Breaking Changes

Iceberg upgraded from 1.3.1 to 1.4.3
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.5.3
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

New Contributors

Full Changelog: 0.3.0.Beta...0.3.0.Final

Release 0.3.0.Beta

09 Sep 22:18
6fa7a25
Compare
Choose a tag to compare

This release includes major features and changes

Notable changes

  • Support for all nested data types added in #232 #233
  • New iceberg offset and database history classes added in #174 #175

Notable PRs

  • Convert __source_ts_ms and __ts_ms to TimestampType.withZone type in #108
  • Add ofset storage class in #174
  • Add iceberg schema history storage in #175
  • Remove aws-java-sdk-bundle from release in #204
  • Add hive-metastore and Iceberg cloud dependencies to release in #198
  • Add support to map data type in #232 #233

Breaking Changes

  • aws-java-sdk-bundle dependency removed from the release in #204
  • __source_ts_ms and __ts_ms fields are converted to TimestampType.withZone type in #108

Debezium version upgraded from 1.9.5.Final to 2.2.1.Final
For Debezium 1.9 Breaking Changes please see release notes
For Debezium 2.0 Breaking Changes please see release notes
For Debezium 2.1 Breaking Changes please see release notes
For Debezium 2.2 Breaking Changes please see release notes

Iceberg upgraded from 0.14.0 to 1.3.1
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 2.11.3.Final to 3.3.2
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

Read more