From edaa4bb677ee3ab99ad66803748e4725c5cb69ed Mon Sep 17 00:00:00 2001 From: dat-a-man <98139823+dat-a-man@users.noreply.github.com> Date: Fri, 24 May 2024 12:04:46 +0000 Subject: [PATCH] Updated as per comments and resolved merge conflicts --- docs/website/docs/dlt-ecosystem/destinations/filesystem.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/website/docs/dlt-ecosystem/destinations/filesystem.md b/docs/website/docs/dlt-ecosystem/destinations/filesystem.md index 3e2e08013c..9ac8ad20b8 100644 --- a/docs/website/docs/dlt-ecosystem/destinations/filesystem.md +++ b/docs/website/docs/dlt-ecosystem/destinations/filesystem.md @@ -379,6 +379,11 @@ Please note: The filesystem destination configuration supports advanced layout customization and the inclusion of additional placeholders. This can be done through `config.toml` or programmatically when initializing via a factory method. +To set using environment variables: +```sh +export DESTINATION__FILESYSTEM__KWARGS = '{"auto_mkdir": true/false}' +``` + :::tip For handling deeply nested layouts, consider enabling automatic directory creation for the local filesystem destination. This can be done by setting `kwargs = '{"auto_mkdir": true}'` to facilitate the creation of directories automatically. ::: @@ -391,6 +396,8 @@ To configure the layout and placeholders using `config.toml`, use the following layout = "{table_name}/{test_placeholder}/{YYYY}-{MM}-{DD}/{ddd}/{mm}/{load_id}.{file_id}.{ext}" extra_placeholders = { "test_placeholder" = "test_value" } current_datetime="2024-04-14T00:00:00" +# for automatic directory creation in the local filesystem +kwargs = '{"auto_mkdir": true}' ``` :::note