Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(interactive): Introduce proxy_server into interactive #3778

Draft
wants to merge 76 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
f3c7afd
parent f1cf69dcec12615a68a9c5351998866c3b9fbe9e
zhanglei1949 May 9, 2024
f3b170e
increase persistence size
zhanglei1949 Jun 13, 2024
49ea34b
add cron_job to backup and update create_graph_and_loading
zhanglei1949 Jun 19, 2024
013ec28
update create_graph.py
zhanglei1949 Jun 19, 2024
6bf4872
fix py
zhanglei1949 Jun 19, 2024
e3730f0
merge
zhanglei1949 Jul 1, 2024
21b99fd
update procedure and create_graph.py
zhanglei1949 Jul 2, 2024
fd6d285
fix create_graph.py
zhanglei1949 Jul 2, 2024
63a7dff
set loading thread num
zhanglei1949 Jul 2, 2024
49c9418
merge parallelism,use_mmap_vector and build_csr_in_mem to loading config
zhanglei1949 Jul 2, 2024
6b5c70c
update doc
zhanglei1949 Jul 2, 2024
1c5b6ce
minor
zhanglei1949 Jul 2, 2024
f86cb69
return json response
zhanglei1949 Jul 2, 2024
d700113
use batch reader for more parallelism
zhanglei1949 Jul 3, 2024
df3ea54
change bulk_loader cmd
zhanglei1949 Jul 2, 2024
9856fe0
minor fix
zhanglei1949 Jul 3, 2024
060b8ee
Merge remote-tracking branch 'github/add-parallelism' into impl-proxy
zhanglei1949 Jul 3, 2024
bcf9682
refine
zhanglei1949 Jul 3, 2024
5392019
fix building
zhanglei1949 Jul 3, 2024
c0fea83
update procedure
zhanglei1949 Jul 19, 2024
276d469
skip stop and start actors
zhanglei1949 Jul 26, 2024
05e3137
use nginx to forwarding
zhanglei1949 Jul 26, 2024
b53eb4e
fix nginx confi
Jul 26, 2024
5667149
let nginx be a load balancer
zhanglei1949 Jul 26, 2024
d7642d2
fix procedure and script
zhanglei1949 Jul 29, 2024
c95d74f
merge
zhanglei1949 Jul 29, 2024
56a7fd1
fix string json parsing
zhanglei1949 Jul 30, 2024
13013b2
fix procedure
zhanglei1949 Jul 31, 2024
9fae628
fix script
zhanglei1949 Jul 31, 2024
20c4d69
add get_ds.py
zhanglei1949 Aug 1, 2024
42c5d36
fixing
zhanglei1949 Aug 5, 2024
cf71982
add switch graph
zhanglei1949 Aug 5, 2024
2edd661
fix create_graph.py
zhanglei1949 Aug 5, 2024
88cb014
separate restarting from graph creation
zhanglei1949 Aug 5, 2024
b99e2d1
delete graph as it switched
zhanglei1949 Aug 5, 2024
0e4efa4
change mode
zhanglei1949 Aug 6, 2024
a094175
do not return error if start oid not found
zhanglei1949 Aug 6, 2024
d62f7ad
fix nginx
Aug 8, 2024
2584684
Merge branch 'impl-proxy' of http://gitlab.alibaba-inc.com/xiaolei.zl…
Aug 8, 2024
1c27662
try use nginx for admin
zhanglei1949 Aug 8, 2024
16fff37
try to fix column.h index out of range
zhanglei1949 Aug 8, 2024
1f21c79
add reporting message
zhanglei1949 Aug 8, 2024
6654d6d
fix py code
zhanglei1949 Aug 8, 2024
ee4e443
use resty
zhanglei1949 Aug 8, 2024
5498ab0
Merge branch 'impl-proxy' of http://gitlab.alibaba-inc.com/xiaolei.zl…
zhanglei1949 Aug 8, 2024
2c93b8d
update openrest conf
zhanglei1949 Aug 8, 2024
e3dbc14
fixing conf
zhanglei1949 Aug 8, 2024
d74126c
merge
Aug 8, 2024
6b417df
fix
zhanglei1949 Aug 8, 2024
7fe24f5
use openresty in admin proxy
Aug 9, 2024
d71a480
check response equals
zhanglei1949 Aug 9, 2024
6c7bb35
fix lua code and try to test pre-relase
Aug 9, 2024
d7c3a49
make report error optional
zhanglei1949 Aug 9, 2024
578816a
refine switch_graph and create_procedure.py
zhanglei1949 Aug 9, 2024
41a7f1e
fix post request
Aug 9, 2024
6f5187c
Merge branch 'impl-proxy' of http://gitlab.alibaba-inc.com/xiaolei.zl…
Aug 9, 2024
869734d
try to catch json parse error and check whether graph is ready before…
zhanglei1949 Aug 12, 2024
4477ea9
add testing script
zhanglei1949 Aug 13, 2024
51051e1
try fixing disk problem
zhanglei1949 Aug 19, 2024
a6c2600
merge
zhanglei1949 Aug 20, 2024
fdbe589
use 16 thread and no using memory
zhanglei1949 Aug 20, 2024
31267c3
check null values
zhanglei1949 Aug 20, 2024
7df776b
Committed-by: xiaolei.zl from Dev container
zhanglei1949 Aug 20, 2024
04392c9
return empty string if null value appears
zhanglei1949 Aug 20, 2024
fa1c12d
fix weight setting
zhanglei1949 Aug 20, 2024
2d8758a
switch to the graph with largest id
zhanglei1949 Aug 21, 2024
ec5ebf6
add ready check
zhanglei1949 Nov 13, 2024
e7fac1d
make heart_beat_handler each on shard
zhanglei1949 Nov 19, 2024
13ce203
use version manager to control the graph switching
zhanglei1949 Nov 20, 2024
5348c46
fix app
zhanglei1949 Nov 21, 2024
7ef2101
fix req hanging
zhanglei1949 Nov 21, 2024
2d071f0
fix bug
zhanglei1949 Nov 21, 2024
272c5b0
add procedure only interface
zhanglei1949 Nov 22, 2024
5804958
fix qidian
zhanglei1949 Nov 26, 2024
3d138e9
fix proc
zhanglei1949 Nov 26, 2024
bc7abf8
fix filtering
zhanglei1949 Nov 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions .github/workflows/interactive.yml
Original file line number Diff line number Diff line change
Expand Up @@ -168,6 +168,20 @@ jobs:
sed -i 's/default_graph: modern_graph/default_graph: ldbc/g' ./engine_config_test.yaml
sed -i 's/temp_workspace/interactive_workspace/g' ./engine_config_test.yaml

- name: Proxy Server test
env:
INTERACTIVE_WORKSPACE: /tmp/interactive_workspace
run: |
cd ${GITHUB_WORKSPACE}/flex/tests/hqps
bash hqps_proxy_server_test.sh ${INTERACTIVE_WORKSPACE} ./engine_config_test.yaml

- name: Proxy Server test
env:
INTERACTIVE_WORKSPACE: /tmp/interactive_workspace
run: |
cd ${GITHUB_WORKSPACE}/flex/tests/hqps
bash hqps_proxy_server_test.sh ${INTERACTIVE_WORKSPACE} ./engine_config_test.yaml

- name: Sample Query test
env:
GS_TEST_DIR: ${{ github.workspace }}/gstest
Expand Down
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -146,6 +146,8 @@ flex/interactive/sdk/python/gs_interactive/configuration.py
flex/interactive/sdk/python/gs_interactive/exceptions.py
flex/interactive/sdk/python/gs_interactive/rest.py
!flex/interactive/sdk/python/gs_interactive/client/generated/__init__.py
!flex/interactive/sdk/python/gs_interactive/models/long_text.py


**/.cache/
*.so
Loading
Loading