[Feature] support delete record when merge engine is partial-update

[AkisAya]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

for now it's not allowed to delete records in a partial-update table. even though a retract with sequence group is ok, but it is not a real delete action. suppose i want to execute a batch sql like delete from xxx_table where id = xx, it will throw an exception. i wonder if this delete feature is able to be complemented or not. if it can be achieved, will it be on the roadmap or if it can not be achieved can anyone explains a little bit why. thank you.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[AkisAya]

it seems i can use insert overwrite my_table select * from my_table where !(my_condition) as a workaournd of delete from my_table where <my_condition>

[JingsongLi]

Now 0.8 Spark SQL supports COW Delete for partial-update.