Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Materialized Views should allow altering definition SELECT without --full-refresh #234

Open
3 tasks done
dataders opened this issue Jun 4, 2024 · 0 comments
Open
3 tasks done
Labels
enhancement New feature or request materialized_views

Comments

@dataders
Copy link
Contributor

dataders commented Jun 4, 2024

Is this your first time submitting a feature request?

  • I have read the expectations for open source contributors
  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing dbt-adapter functionality, rather than a Big Idea better suited to a discussion

Describe the feature

Expected workflow

  1. define a .sql model file with materialized="materialized_view" or materialized="dynamic_table"
  2. run the model so it creates
  3. modify the SQL in the model file
  4. run the model, and the Dynamic Table is ALTERed to have the new SQL without a `--full-refresh

This is how users interact with View and Table materializations, and have come to expect this for MVs & DTs. However no MV or DT implementation supports this today

It is possible to do this, but requires non-trivial engineering work to compare the current compiled model definition against what the Dynamic Table currently has, which is something we do not do today.

dbt-labs/dbt-snowflake#889
dbt-labs/dbt-labs-experimental-features#22

Describe alternatives you've considered

We keep this limitation, but make it clearer to people

Who will this benefit?

Users of MV/DTs who don't want to already loaded data, just the data that is added moving forward.

Are you interested in contributing this feature?

No response

Anything else?

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request materialized_views
Projects
None yet
Development

No branches or pull requests

2 participants