Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Low performance when running benchmark code on a different PC than database server #404

Open
moaazassali opened this issue Apr 23, 2024 · 1 comment

Comments

@moaazassali
Copy link

moaazassali commented Apr 23, 2024

If I run the benchmark directly on the same server as the one with the database, the performance is good; I get an ingestion rate of 3.5M/s.

However, since the the benchmark uses a lot of the cpu, I decided to run the benchmark on another PC which connects to the same server with the database. But now, the ingestion rate is 2M/s.

Note that this other PC is more powerful than the server with the database. So, the speed at which it can generate the SQL commands is not an issue, and I would expect that the ingestion rate on the server should stay the same or increase since a lot of CPU usage is freed when the benchmark code is not running on the server directly.

By running htop on the server, I can see that the max network rx speed is around 25MBps, so it seems that the benchmark can't transmit the sql command batches fast enough.

The actual bandwidth between the PC and the server is also not an issue, I tested the speed with iperf and it is around 1Gbit = 125MBps.

This is the configuration I used in both tests:

BENCHMARK_WORK_MODE=testWithDefaultPath
OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0
GROUP_NUMBER=10
DEVICE_NUMBER=1000
SENSOR_NUMBER=3
CLIENT_NUMBER=8
BATCH_SIZE_PER_WRITE=30000
POINT_STEP=200
LOOP=1
@SpriCoder
Copy link
Collaborator

SpriCoder commented May 11, 2024

I think it's better that you can provide more details about other PC and your server which can help me to get your points~
If network is not the bottle, I think we need to take a look of CPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants