Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1705 lancedb orphan removal via staging deletion inserts #1706

Closed

Conversation

Pipboyguy
Copy link
Collaborator

@Pipboyguy Pipboyguy commented Aug 18, 2024

LanceDB orphan removal job computes id difference between parent and child using in memory arrow data structure. This should rather be done by way of staging and deletion inserts.

Closes #1705

Pipboyguy added 30 commits July 16, 2024 20:56
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
…-efficient-update-strategy-for-chunked-documents
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
@Pipboyguy Pipboyguy self-assigned this Aug 18, 2024
@Pipboyguy Pipboyguy marked this pull request as draft August 18, 2024 21:58
Copy link

netlify bot commented Aug 18, 2024

Deploy Preview for dlt-hub-docs canceled.

Name Link
🔨 Latest commit 8cd6003
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/66cde6e01b1b79000826fa3f

Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
Signed-off-by: Marcel Coetzee <[email protected]>
@rudolfix rudolfix force-pushed the devel branch 2 times, most recently from 2ee3eab to e48f641 Compare September 16, 2024 13:20
@Pipboyguy Pipboyguy closed this Sep 24, 2024
@rudolfix rudolfix deleted the 1705-lancedb-orphan-removal-via-staging-deletion-inserts branch October 21, 2024 14:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

LanceDB Orphan Removal via Staging and Deletion Inserts.
1 participant