Skip to content

Commit

Permalink
Merge docs from staging into main
Browse files Browse the repository at this point in the history
  • Loading branch information
KRISHNAKUMAR THOTAPALLI committed Oct 23, 2023
2 parents 5757956 + cc93b94 commit f9ace39
Show file tree
Hide file tree
Showing 15 changed files with 594 additions and 163 deletions.
22 changes: 11 additions & 11 deletions docs/Guides/loading-data/working-with-external-tables.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ The metadata virtual columns listed below are available in external tables.
| Metadata column name | Description | Data type |
| :--- | :--- | :--- |
| `source_file_name` | The full path of the row data's source file in Amazon S3, without the bucket. For example, with a source file of `s3://my_bucket/xyz/year=2018/month=01/part-00001.parquet`, the `source_file_name` is `xyz/year=2018/month=01/part-00001.parquet`. | TEXT |
| `source_file_timestamp` | The creation timestamp of the row's source file in S3. | TIMESTAMP |
| `source_file_timestamp` | The UTC creation timestamp in second resolution of the row's source file in S3. | TIMESTAMPTZ |

For examples of metadata virtual column usage, see [Extracting partition values using INSERT](../../sql-reference/commands/data-management/insert.md#extracting-partition-values-using-insert) and [Incrementally loading data with Airflow](incrementally-loading-data.md).

Expand Down Expand Up @@ -65,7 +65,7 @@ CREATE DIMENSION TABLE my_dim_table_with_metadata
c_id INTEGER UNIQUE
c_name TEXT,
source_file_name TEXT,
source_file_timestamp TIMESTAMP,
source_file_timestamp TIMESTAMPTZ,
);
```

Expand All @@ -89,14 +89,14 @@ SELECT * FROM my_dim_table_with_metadata;
```

```bash
+-----------+---------------------+------------------------ +-----------------------+
| c_id | c_name | source_file_name | source_file_timestamp |
+-----------+---------------------+-------------------------+-----------------------+
| 11385 | ClevelandDC8933 | central/cle.parquet | 2021-09-10 10:32:03 |
| 12386 | PortlandXfer9483 | west/pdx.parquet | 2021-09-10 10:32:04 |
| 12387 | PortlandXfer9449 | west/pdx.parquet | 2021-09-10 10:32:04 |
| 12388 | PortlandXfer9462 | west/pdx.parquet | 2021-09-10 10:32:04 |
| 12387 | NashvilleXfer9987 | south/bna.parquet | 2021-09-10 10:33:01 |
| 12499 | ClevelandXfer8998 | central/cle.parquet | 2021-09-10 10:32:03 |
+-----------+---------------------+------------------------ +------------------------+
| c_id | c_name | source_file_name | source_file_timestamp |
+-----------+---------------------+-------------------------+------------------------+
| 11385 | ClevelandDC8933 | central/cle.parquet | 2021-09-10 10:32:03+00 |
| 12386 | PortlandXfer9483 | west/pdx.parquet | 2021-09-10 10:32:04+00 |
| 12387 | PortlandXfer9449 | west/pdx.parquet | 2021-09-10 10:32:04+00 |
| 12388 | PortlandXfer9462 | west/pdx.parquet | 2021-09-10 10:32:04+00 |
| 12387 | NashvilleXfer9987 | south/bna.parquet | 2021-09-10 10:33:01+00 |
| 12499 | ClevelandXfer8998 | central/cle.parquet | 2021-09-10 10:32:03+00 |
[...]
```
79 changes: 0 additions & 79 deletions docs/Guides/query-data/using-explain-to-analyze-query-execution.md

This file was deleted.

15 changes: 15 additions & 0 deletions docs/Reference/release-notes/release-notes-archive.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,18 @@ We provide an archive of release notes for your historical reference.

* Topic ToC
{:toc}

## DB version 3.28
**September 2023**

* [Resolved issues](#resolved-issues)


### Resolved issues
{: .no_toc}

* <!--- FIR-17240 ---> `IN` expressions with scalar arguments now return Postgres-compliant results if there are `NULL`s in the `IN` list.

* <!--- FIR-26293 ---> information_schema.running_queries returns ID of a user that issued the running query, not the current user.

* <!--- FIR-26187 ---> Update error message to explain upper case behavior
28 changes: 23 additions & 5 deletions docs/Reference/release-notes/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,17 +17,35 @@ Firebolt continuously releases updates so that you can benefit from the latest a
{: .note}
Firebolt might roll out releases in phases. New features and changes may not yet be available to all accounts on the release date shown.


## DB version
## DB version 3.29
**October 2023**

* [New features](#new-features)
* [Enhancements, changes, and new integrations](#enhancements-changes-and-new-integrations)
* [Resolved issues](#resolved-issues)


### New features

<!--- FIR-25082 ---> **EXPLAIN ANALYZE now available for detailed query metrics**

You can now use the [EXPLAIN command](../../sql-reference/commands/explain.md) to execute `EXPLAIN (ANALYZE) <select statement>` and get detailed metrics about how much time is spent on each operator in the query plan, and how much data it processes. The query plan shown there is the physical query plan, which you can inspect using `EXPLAIN (PHYSICAL) <select statement>` without executing the query. It shows how query processing is distributed over the nodes of an engine.


### Enhancements, changes and new integrations

### Resolved issues
<!--- FIR-25636 ---> **PERCENTILE_CONT and PERCENTILE_DISC now return PG-compliant results**

[PERCENTILE_CONT](../../sql_reference/functions-reference/window/percentile-cont-window.md) for decimal input now returns DOUBLE instead of DECIMAL

<!--- FIR-24362 ---> **Virtual column 'source_file_timestamp' uses new data-type**

The virtual column `source_file_timstamp` has been migrated from the data type `DateTime/Timestamp` (legacy timestamp type without time zone) to the type `TimestampTz` (new timestamp type with time zone).

Despite the increased resolution, the data is still in second precision as AWS S3 provides them only as unix seconds

You must now use `source_file_timestamp - now()` instead of `date_diff('second', source_file_timestamp, now())`

<!--- FIR-10514 ---> **New function added**

A new function [ARRAY_TO_STRING](../../sql_reference/functions-reference/array/array-to-string.md) has been added as an alias to [ARRAY_JOIN](../../sql_reference/functions-reference/array/array-join.md)


Loading

0 comments on commit f9ace39

Please sign in to comment.