Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: convert object value to linked hash map for Iceberg record #48726

Merged
merged 4 commits into from
Nov 27, 2024

Conversation

jdpgrailsdev
Copy link
Contributor

What

  • Properly handle conversion of nested object values for insertion into an Iceberg record

How

  • Convert an Airbyte ObjectValue into a LinkedHashMap instead of an Iceberg GenericRecord for nested objects.

Review guide

  • AirbyteValueToIcebergRecord.kt

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link

vercel bot commented Nov 27, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Nov 27, 2024 5:30pm

@octavia-squidington-iii octavia-squidington-iii added the CDK Connector Development Kit label Nov 27, 2024
@@ -128,22 +139,71 @@ class AirbyteValueToIcebergRecordTest {
val schema =
Schema(
NestedField.required(1, "id", Types.LongType.get()),
NestedField.optional(2, "name", Types.StringType.get())
NestedField.optional(2, "name", Types.StringType.get()),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. Thanks

@jdpgrailsdev jdpgrailsdev merged commit 9b36715 into master Nov 27, 2024
31 checks passed
@jdpgrailsdev jdpgrailsdev deleted the jonathan/iceberg-object-value-mapping branch November 27, 2024 17:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CDK Connector Development Kit
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants