Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jodie social media posts #26

Open
MrPowers opened this issue Jan 23, 2023 · 4 comments
Open

Jodie social media posts #26

MrPowers opened this issue Jan 23, 2023 · 4 comments

Comments

@MrPowers
Copy link
Collaborator

MrPowers commented Jan 23, 2023

We want to let developers know about the public interface of this project on social media:

  • Type2Scd.upsert
  • DeltaHelpers.removeDuplicateRecords (remove all occurrences)
  • DeltaHelpers.removeDuplicateRecords (leave one occurrence)
  • DeltaHelpers.latestVersion
  • DeltaHelpers.appendWithoutDuplicates
@brayanjuls
Copy link
Collaborator

@MrPowers - take a look at this post and let me know what you think, https://brayanjules.com/oss/delta-lake/2023/02/26/jodie-append-without-duplicate.html

@MrPowers
Copy link
Collaborator Author

@brayanjuls - blog post looks amazing. I am going to post it on LinkedIn now.

Would be good to add the import statement for DeltaHelpers.

Also, just noticed that the primaryKeysColumns might be better called compositeKey. We should have some way for users to verify that Seq("productId","quantity") is in fact a composite key for this table.

These are just minor nits. The blog post is great.

@MrPowers
Copy link
Collaborator Author

MrPowers commented Mar 4, 2023

@brayanjuls - updated the list by crossing out the post that was made. Will try to get through all of these over the coming weeks.

@brayanjuls
Copy link
Collaborator

crossed the one that I did as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants