Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] In cdc database synchronization, data changes to new tables using the combined mode are not monitored, and the job needs to be restarted #3511

Open
1 of 2 tasks
dsanww opened this issue Jun 13, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@dsanww
Copy link

dsanww commented Jun 13, 2024

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

paimon-flink-1.18-0.9-20240610.002222-13
paimon-flink-action-0.9-20240610.002222-13

Compute Engine

flink1.18

Minimal reproduce step

In the cdc database synchronization, the combined mode synchronizes new tables, but does not monitor data changes to the new tables, so the job needs to restart

What doesn't meet your expectations?

I want to dynamically listen to the binlog of new table data without restarting the job

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@dsanww dsanww added the bug Something isn't working label Jun 13, 2024
@xingqing
Copy link

I encountered the same issue. I only saw the schema was synchronized, but the data was not synchronized.

@discivigour
Copy link
Contributor

Hi, you should use flink-sql-connector-mysql-cdc-2.3.0.jar. Other versions of this jar still have compatibility bugs with paimon.

@Pandas886
Copy link
Contributor

Pandas886 commented Aug 14, 2024

Hi, you should use flink-sql-connector-mysql-cdc-2.3.0.jar. Other versions of this jar still have compatibility bugs with paimon.您好,应使用 flink-sql-connector-mysql-cdc-2.3.0.jar。其他版本的此 jar 还存在与 paimon 兼容性问题的 Bug。

Thank you very much, this is feasible.

I also encountered the same issue: paimon-flink-1.18-0.8.2、flink-sql-connector-mysql-cdc-2.4.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants