Skip to content

Latest commit

 

History

History
16 lines (11 loc) · 637 Bytes

README.md

File metadata and controls

16 lines (11 loc) · 637 Bytes
Raw

airflow-composer-plugins

Airflow Composer Plugins

Dataflow Streaming Plugin

This web plugin allows to use Dataflow Templates from Airflow UI.

Image of the plugin UI

Configuration:

You must create the following Variables on the Variables Airflow interface.

  • gcp_project_id : name of the GCP project.
  • gcp_dataproc_region : name of the GCP region where your Dataflow jobs are going to run.

Also, we need to set up a new GCP connection with the right JSON file credentials:

  • gcp_streaming_plugin_df_conn : Airflow connection credentials.