Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream 1089/override silver #102

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

Conversation

ShahNewazKhan
Copy link

@ShahNewazKhan ShahNewazKhan commented Dec 6, 2024

  • Adds make directive to deploy overrides
    • Adds silver__streamline_blocks override
      • Move all spine generation and near-realtime block fetching logic to over-ridden model
    • Adds near_mainnet__fact_blocks view as pointer to ephemeral near_models.core.fact_blocks (used in fact_blocks UDTF)
  • Configures materialization to ephemeral / disabled for near_models dbt package models
  • Updates tf_fact_blocks return columns to reflect data types from near_models.core.fact_blocks
  • Adds udf_get_block_data to retrieve data from given a external stage file path
  • Removes deploy core models ( as this has been moved to livequery-base )

@ShahNewazKhan ShahNewazKhan changed the base branch from STREAM-1088/near-live-view-udtfs to main December 7, 2024 01:45
jensenity
jensenity previously approved these changes Dec 10, 2024
* Render dbt cte POC

* jensen fix

* move silver__streamline_blocks to overrides

* add json parsing for raw block data

* remove debug logs

* removed session context based override logic

* added tf_fact_tx & tf_fact_receipts

* added silver tx/flatten_receipts/receipts_final/shards overrides

---------

Co-authored-by: Jensen Yap <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants