Howie Wang

content/sessions/2024/35-dag-dependency-management-across-lowes.md

@@ -1,8 +1,8 @@
 ---
-title: "DAG Dependency Management across Lowes"
-slug: dag-dependency-management-across-lowes
+title: "Streamlining DAG Creation with YAML in Large Organizations"
+slug: streamlining-dag-creation-yaml
 speakers:
- - Arnab Kundu
+ - Howie Wang
 time_start: 2024-09-10 17:10:00
 time_end: 2024-09-10 17:35:00
 room: California East
@@ -13,4 +13,10 @@ gridarea: "14/2/15/3"
 
 ---
 
-DAG dependency is already a solved use case for the same Airflow instance. But what happens when you have 50+ Airflow instances across teams and the workflow of one or many depends on others? By leveraging sensors and datasets we have created a custom operator that brings in the capability of cross-cluster dependencies. It works with our OnPrem Kubernetes architecture which is responsible for deployment of the custom operators throughout the entire Organization.
+As organizations grow, the task of creating and managing Airflow DAGs efficiently becomes a challenge.
+
+In this talk, we will delve into innovative approaches to streamlining Airflow DAG creation using YAML. By leveraging YAML configuration, we allow users to dynamically generate Airflow DAGs without requiring Python expertise or deep knowledge of Airflow primitives.
+
+We will showcase the significant benefits of this approach, including eliminating duplicate configurations, simplifying DAG management for a large group of workflows, and ultimately enhancing productivity within large organizations.
+
+Join us to learn practical strategies to optimize workflow orchestration, reduce development overhead, and facilitate seamless collaboration across teams.

content/speakers/howie-wang/_index.md

@@ -5,10 +5,10 @@ image: /images/speakers/howie-wang.jpg
 events:
  - 2021
  - 2022
+ - 2024
 twitter: "https://twitter.com/HowieWang15"
 linkedin: "https://www.linkedin.com/in/howiewang/"
 
 ---
 
-Howie Wang is a Software Engineer on the Data Pipelines team. Before joining Apple, Howie worked at WePay, where he helped build infrastructure software, and contributed to open source projects like Airflow, Waltz.
-
+Howie Wang is a Software Engineer on the Data Pipelines team. Before joining Apple, Howie worked at WePay, where he helped build infrastructure software, and contributed to open source projects like Airflow, Waltz, Iceberg.