[flink] fix unstable test: testAsyncCompactionFileDeletedWhenShutdown

[liming30]

Purpose

Linked issue: close #2231

[flink] fix unstable test: testAsyncCompactionFileDeletedWhenShutdown.

In the original implementation, Thread.sleep(2_000) is used to wait for the thread pool to finish, which does not strictly guarantee that the thread pool is finished. I modified it to use ExecutorService#awaitTermination and increased the timeout to 2 minutes.

Tests

No

API and Format

No

Documentation

No

[leaves12138]

+1

[leaves12138]

this also fixed in #2245

[liming30]

this also fixed in #2245

@leaves12138 hi, I saw that #2245 is waiting in the shutdown of AppendOnlyTableCompactionWorkerOperator. If flink sends a cancel signal to the task, this will interrupt the thread. Is it possible to throw an InterruptedException, causing the subsequent logic to fail to execute?

[leaves12138]

this also fixed in #2245

@leaves12138 hi, I saw that #2245 is waiting in the shutdown of AppendOnlyTableCompactionWorkerOperator. If flink sends a cancel signal to the task, this will interrupt the thread. Is it possible to throw an InterruptedException, causing the subsequent logic to fail to execute?

The close method should not receive a Interrupted signal.

[liming30]

@leaves12138 It seems that TaskCanceler will first interrupt the executingThread of the task, and the a TaskInterrupter will interrupt periodically until the task is closed or timeout.

[liming30]

Closed because it has been fixed in #2245.

[Aitozi]

The problem seems still there: https://github.com/Aitozi/incubator-paimon/actions/runs/6792785178/job/18466599312#step:5:410