Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding docs #33

Merged

Conversation

sungwy
Copy link

@sungwy sungwy commented Jun 12, 2024

helping out where I can

@Fokko Fokko merged commit 5cdb363 into Fokko:fd-add-ability-to-delete-full-data-files Jun 15, 2024
7 checks passed
@Fokko
Copy link
Owner

Fokko commented Jun 15, 2024

Thanks @syun64 appreciate it!

Fokko added a commit that referenced this pull request Jul 10, 2024
* Add option to delete datafiles

This is done through the Iceberg metadata, resulting
in efficient deletes if the data is partitioned correctly

* Pull in main

* WIP

* Change DataScan to accept Metadata and io

For the partial deletes I want to do a scan on in
memory metadata. Changing this API allows this.

* fix name-mapping issue

* WIP

* WIP

* Moar tests

* Oops

* Cleanup

* WIP

* WIP

* Fix summary generation

* Last few bits

* Fix the requirement

* Make ruff happy

* Comments, thanks Kevin!

* Comments

* Append rather than truncate

* Fix merge conflicts

* Make the tests pass

* Add another test

* Conflicts

* Add docs (#33)

* docs

* docs

* Add a partitioned overwrite test

* Fix comment

* Skip empty manifests

---------

Co-authored-by: HonahX <[email protected]>
Co-authored-by: Sung Yun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants