Skip to content

Commit

Permalink
[Coral-dbt] Update README.md (#488)
Browse files Browse the repository at this point in the history
  • Loading branch information
wmoustafa authored Feb 12, 2024
1 parent f200f21 commit 79ff567
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion coral-dbt/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# Using coral-dbt Materialization Modes
This module implements a new materialization mode for dbt called "incremetnal_maintenance". This materialization mode is a drop-in replacement for the "table" materialization mode, but instead of repeatedly replacing tables and computing their data from scratch, it maintains the tables incrementally. This mode leverages Coral to rewrite the input SQL to an incremental version that leverages incremental changes to the input tables, computes the updates to the output tables, and merges them. More details can be found in these [slides](https://www.slideshare.net/walaa_eldin_moustafa/incremental-view-maintenance-with-coral-dbt-and-iceberg).

Note: This project is currently in development and is not intended to be a production ready package. Currently, only Spark adapter is supported.
Note: This project is currently WIP.

## Setup
1. The materialization mode in this package requires a minor modification to the dbt-core source. Clone and setup a local dbt-core source and create/activate a Python virtual environment.
Expand Down

0 comments on commit 79ff567

Please sign in to comment.