Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement synapse destination #832

Closed
rudolfix opened this issue Dec 17, 2023 · 0 comments · Fixed by #900
Closed

implement synapse destination #832

rudolfix opened this issue Dec 17, 2023 · 0 comments · Fixed by #900
Assignees

Comments

@rudolfix
Copy link
Collaborator

Background
We'd like to add destination for Synapse. There's previous work done here:
#740

Our goals are:

  1. support most common use case of loading data into synapse (is it copying PARQUET/JSON/CSV from azure storage into synapse)?
  2. supporting insert-values would be nice (but not necessary AFAIK synapse can insert 1 record per query)
  3. support all write dispositions (append, replace, merge)
  4. reuse as much code from MSSQL destination by subclassing, extracting common base class etc. - whatever necessary
  5. possibly supporting Azure specific authentication modes (again: following the most common use cases)
@rudolfix rudolfix moved this from Todo to Planned in dlt core library Dec 18, 2023
@jorritsandbrink jorritsandbrink moved this from Planned to In Progress in dlt core library Dec 22, 2023
@jorritsandbrink jorritsandbrink linked a pull request Jan 18, 2024 that will close this issue
@sh-rp sh-rp closed this as completed in #900 Feb 6, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in dlt core library Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants