Spark SQL via dbt-athena

[u-ra-ra-ra]

Hey Community,

AWS athena recently allowed running Spark SQL.
Is there any guidance on supporting this via dbt-athena-commnuity?

My use case:
I am trying to run certain workload via Spark SQL and others via Athena interactive query.

Thanks in advance for any information!

[nicor88]

We don't support directly SparkSQL in the dbt models, but since #248 was released, in 1.7.2 you can should be able to use SparkSQL via python models submissions.

Using SparkSQL natively in dbt-athena, instead of trino sql, it will require a bigger refactor.