Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

master merge for 0.4.12 release #1418

Merged
merged 45 commits into from
May 28, 2024
Merged

master merge for 0.4.12 release #1418

merged 45 commits into from
May 28, 2024

Conversation

rudolfix
Copy link
Collaborator

Description

master merge for 0.4.12 release

burnash and others added 30 commits May 14, 2024 14:23
RESTClient: add an example for creating a custom POST paginator
* Add rest_api source docs

* Expand rest_api documentation

* Update snippets

* Update string aliases

* Link dlt source

* Reordered code in the example and added a new section

* Mention auto detection

* Reorder the sentence about paginator types and instances

* Elaborate on dependent resources; link the transformer docs

* Link incremental loading

* Update the example to use rest_api_resources

* Rename github_config
…ugh (#1351)

Co-authored-by: AstrakhantsevaAA <[email protected]>
Co-authored-by: Anton Burnashev <[email protected]>
* feat(pipeline): add an ability to auto truncate
staging destination after load

* lint fix

* fix typo

* improve tests

* truncate dataset

* do truncation after all the load is finished

* fix the test, which already expects warnings

* add docs, tests

* lint fix

* lint fix

* fixes

* fix typo

* delete excess comment

* fix the test

* additional conditions for assert

* use qualified name

* lint fix

* lint fix

* fix tests

* fix the test

* fix test

* if staging is not used, don't test it

* test fix for clickhouse

* test fix

* uses with_staging_dataset correctly

---------

Co-authored-by: Marcin Rudolf <[email protected]>
… does not contain the nullable property, like other sql destinations (#1380)
* make path tests windows compatible

---------

Co-authored-by: Jorrit Sandbrink <[email protected]>
* branch naming rules in contributing

* add motivation to branch naming rule

* formatting and typo
* fix snippets

* fix additional mypy errors

* fix another auth type checker error
* Added info about how to reorder the columns

* Updated rest_api.md with configuration examples

* Update docs/website/docs/walkthroughs/adjust-a-schema.md

* Updated ../website/docs/dlt-ecosystem/verified-sources/rest_api.md

* fix naming convention for bigquery custom destination

---------

Co-authored-by: Anton Burnashev <[email protected]>
Co-authored-by: AstrakhantsevaAA <[email protected]>
fix auth methods table
AstrakhantsevaAA and others added 14 commits May 24, 2024 12:38
update maintainers
* Fix AuthConfigBase so its instances always evaluate to True in bool context; change docs to suggest direct inheritance from AuthBase

* Add tests
* bumps duckdb to 0.10.x

* updates dbt support to 1.8
* Support azure service principal credentials

* Add sp credentials to docs

* Test resolved fsspec instance

* Update filesystem config test

* Test connect with service credentials

* configures destination credentials

* fixes toml typo

---------

Co-authored-by: Marcin Rudolf <[email protected]>
* Fix AuthConfigBase so its instances always evaluate to True in bool context; change docs to suggest direct inheritance from AuthBase

* Add tests

* Fix formatting

* uses AuthBase as auth type

---------

Co-authored-by: Anton Burnashev <[email protected]>
* add a page for the openapi generator

* small updates to readme

* small readme updates (alena)

* fixed readme (anton 2nd review)

* fix relative links

* small update
* fix: ensure custom session can be provided to rest client

* fix: move request client retry to correct central req method used in all codepaths

* chore: use adapter mock to replicate production code path more accurately

* chore: rename session warn func and add docstring

* fix: linting err

* creates explicit session in rest client tests

* allows custom sessions in oauth2 jwt of rest client

* adds NotResolved type annotations that excludes type from resolving in configspec

* fixes weaviate test

---------

Co-authored-by: Marcin Rudolf <[email protected]>
* Support partitioning hints for athena iceberg

* Escape partitioning column names

* Update docs

* Move athena skip marker

* marks athena adapter tests essential

---------

Co-authored-by: Marcin Rudolf <[email protected]>
Copy link

netlify bot commented May 27, 2024

Deploy Preview for dlt-hub-docs ready!

Name Link
🔨 Latest commit 6b5952d
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/6654dab624c9240009bfbbf1
😎 Deploy Preview https://deploy-preview-1418--dlt-hub-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@rudolfix rudolfix self-assigned this May 27, 2024
@rudolfix rudolfix added the ci full run the full load tests on pr label May 27, 2024
@rudolfix rudolfix merged commit 252fa92 into master May 28, 2024
57 of 73 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci full run the full load tests on pr
Projects
None yet
Development

Successfully merging this pull request may close these issues.