Dataflow Templates 2022-02-28-00_RC00

Release Week of February 28, 2022

New Templates

N/A

Improvements

[Datastream to SQL] Added support for custom connection strings. This can be used to enable SSL for example, though overriding the sslcert/sslrootcert/sslkey parameters (which expect a local file path) is not yet supported.

Bug Fixes

N/A

New Regions

N/A

Contributors

dhercher
zhoufek

Dataflow Templates 2022-02-21-00_RC00

Release Week of February 21, 2022

New Templates

N/A

Improvements

[All Templates] Upgrade beam version to 2.36
[All Dataplex Templates] Refactor common code

Bug Fixes

[Dataplex: BigQuery to GCS] Dataplex Tiering template: Refactor BigQueryTableToGcsTransform date type fix. This should not change the visible behavior of the transform.

New Regions

N/A

Contributors

olegsa
pranavbhandari
zhoufek

Dataflow Templates 2022-02-07-00_RC01

Release Week of February 7, 2022

This the first release with notes published publicly. We're only including the changes unique to the release, but it contains all released changes up to commit 51f613a, which was pushed on February 7, 2022.

For a list of which templates this covers, please see the Cloud documentation on Google provided templates. Those in the repository that are not listed are currently not part of any release or are only accessible through other services (e.g. Dataplex).

New Templates

N/A

Bug Fixes

[Dataplex: BigQuery to GCS] Dataplex Tiering template: fix for the handling of the DATE fields.
[All Datastore] Fix issue that always set datastoreHintNumWorkers to 500 regardless of user-provided value

Contributors

olegsa
pranavbhandari