Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add cassandra support #17

Merged
merged 40 commits into from
Feb 2, 2024
Merged

Add cassandra support #17

merged 40 commits into from
Feb 2, 2024

Conversation

dispensable
Copy link
Contributor

features

  • Support use cassandra as beansdb proxy store backend
  • Support migration from beansdb to cassandra table. User can dual write by prefix and switch read from different storage engine
  • Api for prefix map to cassandra table and switch rw for different store engine(so you can make you migration without restart)
  • Support disable old beansdb backend and use cassandra as backend totally

migration

  1. use api switch prefix to table map and prefix to dual write cassandra/beansdb, read from beansdb
  2. use migration tool migrate legacy data from beansdb to cassandra
  3. if both ok, switch prefix to dual write and read from cassandra
  4. disable beansdb write, keep prefix use cassandra for r/w

cassandra store cfg

  1. prepare cassandra cluster
  2. edit conf/proxy.yaml, you should create cfg table in cassandra table DDL conf/table_dispatcher_cfg.cql
  3. start and ready to go

ZHAO Yijun and others added 30 commits February 2, 2024 14:15
@dispensable
fix vgo build (douban#2)
eac0ab6 
* Update README.md

* fix vgo build

* update go.mod
@dispensable
Init cassandra support on set/get/delete
2a4063e
@dispensable
Fix bugs and implement ?key syntax
200ec2f
@dispensable
Add auth support
cb54dcd
@dispensable
Log key when dual write err at one end
1459d73
@dispensable
Add more metrics
90859d3
@dispensable
Incr connnections
b6af434
@dispensable
Make cstar can used by other project
c7795cb
@dispensable
Cstar can set wth bdbvalue
e2c9218
@dispensable
Add prefix read support
3ac0166
@dispensable
Disable gobeansdb when bdb w/r both disabled
6501c94
@dispensable
Remove unused bin file
0856d7e
@dispensable
Add password_file of cassandra cfg support
115780c
@dispensable
Support switch storage engine by prefix
1649b9e
@dispensable
Add tests and use generic trie
c39abd9
@dispensable
Only return dual write err when bdb r
2dee14a
@dispensable
Add cfg check for prefix dup
e2ba00a
@dispensable
Support reload default storage
b4f34bc
@dispensable
Fix style
6558764
@dispensable
Bump version
68c8d81
@dispensable
Tolerant empty prefix/table switch cfg
cf0954a
@dispensable
Default enable beansdb backend
421b738
@dispensable
Err when mem alloc failed
915c85d
@dispensable
Try to fix mem leak
eefbccf
@dispensable
Bump version
5d7ad43
@dispensable
Fix memory leak
01fdfa3
@dispensable
Add c* stored dispatcher cfg
cf0c6e2 
- support dispatcher cfg stored in  c*
- user can reload cfg by web api
- successtargets access log fields always append proxy host
@dispensable
Fix successtargets overfide error
9b86e8e
@dispensable
Support disable dstore/cstar write completely
5d105c1
@dispensable
Fix empty config crash
eaede16
@dispensable
Copy link
Contributor Author

rebased with master branch, PTAL @LeoQuote

@dispensable dispensable merged commit 929b8fb into douban:master Feb 2, 2024
2 checks passed
dispensable added a commit to dispensable/gobeansproxy that referenced this pull request Feb 2, 2024
@dispensable
Add cassandra support (douban#17)
e1109ba
@dispensable dispensable mentioned this pull request Feb 2, 2024
Merged
dispensable added a commit that referenced this pull request Feb 2, 2024
@dispensable
Support proxy to cassandra (#19)
1bed777 
* Add prometheus metrics to gobeansproxy (#15)

* Add cassandra support (#17)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@LeoQuote LeoQuote Awaiting requested review from LeoQuote

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@dispensable