[S3] - Support for Writing Files in Delta Lake Format #46263
lucasnvck
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hey!
I've been using the Airbyte S3 connector for a data ingestion pipeline where I need to write files to S3. Currently, the connector supports several formats, but I noticed that there's no option to write files in Delta Lake format.
It would be great if this feature could support both append and overwrite modes, as well as handling partitioning, which is crucial for performance.
While looking into the issue, I came across this PR, which shows there has been some movement towards this feature, but it seems to have stalled for a while.
Beta Was this translation helpful? Give feedback.
All reactions