Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encountered change event for table whose schema isn't known to this connector #32

Open
BuddhiWathsala opened this issue Sep 16, 2019 · 0 comments

Comments

@BuddhiWathsala
Copy link

Description:
When I run to use the CDC extension with a database called parisTMA using the following Siddhi query to just log changes in a table.

@source(
    type='cdc',
    url='jdbc:mysql://localhost:3306/parisTMA',
    username='wso2sp',
    password='wso2',
    table.name='IncidentSample',
    operation='insert',
    @map(
        type='keyvalue'
    )
)
define stream IncidentInputStream(incidentId int, incidentName string);

@sink(type='log', prefix='LOGGER')
define stream SampleLog(incidentId int, incidentName string);

@info(name='listen-notification') 
from IncidentInputStream
select incidentId, incidentName
insert into SampleLog;

And it gives the following error.

database lost. Error while connecting at Source 'cdc' at 'IncidentInputStream'. Will retry in '5 sec'. io.siddhi.core.exception.ConnectionUnavailableException: Connection to the database lost.
	at io.siddhi.extension.io.cdc.source.CDCSource.lambda$connect$1(CDCSource.java:424)
	at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:793)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kafka.connect.errors.ConnectException: Encountered change event for table whose schema isn't known to this connector
	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200)
	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178)
	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:452)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559)
	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793)
	... 1 more
Caused by: org.apache.kafka.connect.errors.ConnectException: Encountered change event for table whose schema isn't known to this connector
	at io.debezium.connector.mysql.BinlogReader.informAboutUnknownTableIfRequired(BinlogReader.java:700)
	at io.debezium.connector.mysql.BinlogReader.handleUpdateTableMetadata(BinlogReader.java:676)
	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:436)
	... 5 more

However when I change my database name to paristma it runs properly.

Suggested Labels:
Bug fix

Affected Product Version:
2.0.3

Steps to reproduce:
Using mentioned databases run the above app in Siddhi tooling or Siddhi runner.

mohanvive pushed a commit to mohanvive/siddhi-io-cdc that referenced this issue Sep 18, 2019
mohanvive pushed a commit to mohanvive/siddhi-io-cdc that referenced this issue Sep 18, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant