Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(interactive): Introduce proxy_server into interactive #3778

Draft
wants to merge 76 commits into
base: main
Choose a base branch
from

Conversation

zhanglei1949
Copy link
Collaborator

@zhanglei1949 zhanglei1949 commented May 9, 2024

Originally designed as a standalone graph query system, but in real world scenarios, disaster recovery capabilities is required.

We plan to offering a deployment approach based on master-slave replication, and in order to avoid modifying the core engine, we plan to separate the fault-tolerant features, encapsulating them in a separate server called proxy_server.

The proxy_server is designed to

  • Connect to server interactive workers.
  • Forward the received request to the workers, and gather the responses.
  • Periodically check the healthiness of workers. If a worker are down, proxy will not send request to it anymore. If ALL workers are down, the proxy will return error to client.

It seems that we can not avoid introducing new actor, handler and service definitions.

The usage of proxy_server

./bin/proxy_server -e localhost:10000,localhost:10001

TODO: Currently heartbeat will only return OK, however, we need SNAPSHOT_ID to be returned.

@zhanglei1949 zhanglei1949 force-pushed the impl-proxy branch 4 times, most recently from ed83b42 to a13244e Compare May 23, 2024 12:04
@zhanglei1949 zhanglei1949 force-pushed the impl-proxy branch 2 times, most recently from be59372 to d0ca344 Compare June 3, 2024 08:41
author xiaolei.zl <[email protected]> 1715237940 +0000
committer 霄磊 <[email protected]> 1718701299 +0800

introduce proxy_server

minor

code refactor

refine proxy server

todo: bind to pvc and deploy on internal

try to test on internal

modify dockerfile

able to launch, todo: fix graph creation and loading

minor fix

add log

fix codegen error

minor

introduce proxy_server

minor

code refactor

refine proxy server

todo: bind to pvc and deploy on internal

try to test on internal

modify dockerfile

able to launch, todo: fix graph creation and loading

minor fix

add log

minor

update memory request

add test script

increase memroy request

update docker file for debug

update dns config

add debug tools in dockerfile

use nodePort for secondary

use 7brs

add role binding

install kubectl to get svc ip

minor

debuging host connection

edit

add script

minor

edit
Copy link
Contributor

github-actions bot commented Aug 19, 2024

Please check the preview of the documentation changes at
https://0e028e2e.graphscope-docs-preview.pages.dev

Committed-by: xiaolei.zl from Dev container

Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
@zhanglei1949 zhanglei1949 marked this pull request as draft September 29, 2024 07:50
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container
Committed-by: xiaolei.zl from Dev container

Committed-by: xiaolei.zl from Dev container
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants