Name		Name	Last commit message	Last commit date
parent directory ..
2.1 - DLT Demo Data Prep.py		2.1 - DLT Demo Data Prep.py
2.2 - DLT Pipelines Loans Autoloader.py		2.2 - DLT Pipelines Loans Autoloader.py
2.3 - DLT Demo SQL Analysis.sql		2.3 - DLT Demo SQL Analysis.sql
README.md		README.md
dlt-settings-loans-batch.json		dlt-settings-loans-batch.json
dlt-settings-loans-streaming.json		dlt-settings-loans-streaming.json

README.md

Data Engineering

Follow instructions in SET-UP-ENVIRONMENT.md to create ADLS storage account

Use notebook 2.1 to create CSV files in ADLS storage account.

Go to Jobs > Delta Live Tables > Create Pipeline

Use the settings in file dlt-settings-loans-batch.json to create a batch (triggered) pipeline.

Use the settings in file dlt-settings-loans-streaming.json to create a streaming (continuous) pipeline.

If there are no errors deploy to production using the production button in the top right corner

Run the notebook 2.3 to check that the tables have all been created correctly