Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDC data in inconsistency when tikv has titan on #10421

Closed
fubinzh opened this issue Jan 5, 2024 · 1 comment
Closed

CDC data in inconsistency when tikv has titan on #10421

fubinzh opened this issue Jan 5, 2024 · 1 comment

Comments

@fubinzh
Copy link

fubinzh commented Jan 5, 2024

What did you do?

  1. Deploy tidb cluster with Titan on
 config: |
            [storage]
            reserve-space = "0MB"
            [rocksdb.titan]
            enabled = true
            [rocksdb.defaultcf.titan]
            min-blob-size = '0B'
            [rocksdb.writecf.titan]
            blob-run-mode = 'normal'
            min-blob-size = '0B'
  1. create changefeed
  2. run workload
  3. Send finish in upstream
  4. Wait finishmark in downstream and do data consistency check.

What did you expect to see?

Data should be consistent.

What did you see instead?

Data inconsistency seen.

Versions of the cluster

Upstream TiKV version (execute tikv-server --version):

[root@upstream-tikv-0 /]# /tikv-server -V                                                                             
TiKV                                                                                                                  
Release Version:   7.6.0-alpha                                                                                        
Edition:           Community                                                                                          
Git Commit Hash:   39886146a2e314252c26af473808dea8b9dfb2ad                                                           
Git Commit Branch: heads/refs/tags/v7.6.0-alpha                                                                       
UTC Build Time:    2024-01-04 11:48:02                                                                                
Rust Version:      rustc 1.67.0-nightly (96ddd32c4 2022-11-14)                                                        
Enable Features:   pprof-fp jemalloc mem-profiling portable sse test-engine-kv-rocksdb test-engine-raft-raft-engine cloud-aws cloud-gcp cloud-azure trace-async-tasks openssl-vendored                                                      
Profile:           dist_release                                                                                       

TiCDC version (execute cdc version):

[root@upstream-ticdc-0 /]# /cdc version                            
Release Version: v7.6.0-alpha                                      
Git Commit Hash: d060a7d6e443d0c069bf9b12f0e88837cd250e33          
Git Branch: heads/refs/tags/v7.6.0-alpha                           
UTC Build Time: 2024-01-04 11:38:52                                
Go Version: go version go1.21.5 linux/amd64                        
Failpoint Build: false                                             
@hicqu
Copy link
Contributor

hicqu commented Jan 8, 2024

Duplicate with tikv/tikv#16319.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

No branches or pull requests

4 participants