New Quarkus version

[franz1981]

Hi @novoj

It is some time I am not running your benchmark with latest quarkus version, let me know if you can give it a shot, so I can verify if I found anything strange

[novoj]

I will give it a shot

[novoj]

Original results based on Quarkus 3.0.4.Final (baseline):

Benchmark                                                      Mode  Cnt      Score      Error  Units
ServersThroughputBenchmark.graphQLApiEchoQuery_QuarkusServer  thrpt    5  21830.819 ± 1492.236  ops/s
ServersLatencyBenchmark.graphQLApiEchoQuery_QuarkusServer      avgt    5    281.107 ±   20.137  us/op

Native Quarkus:

Benchmark                                                      Mode  Cnt      Score     Error  Units
ServersThroughputBenchmark.graphQLApiEchoQuery_QuarkusServer  thrpt    5  15720.155 ± 799.392  ops/s
ServersLatencyBenchmark.graphQLApiEchoQuery_QuarkusServer      avgt    5    392.781 ±  38.727  us/op

New results with version 3.8.1:

Benchmark                                                      Mode  Cnt      Score      Error  Units
ServersThroughputBenchmark.graphQLApiEchoQuery_QuarkusServer  thrpt    5  22147.961 ± 1692.798  ops/s
ServersLatencyBenchmark.graphQLApiEchoQuery_QuarkusServer      avgt    5    281.611 ±   19.583  us/op

Native Quarkus:

Benchmark                                                      Mode  Cnt      Score      Error  Units
ServersThroughputBenchmark.graphQLApiEchoQuery_QuarkusServer  thrpt    5  14901.192 ± 2034.417  ops/s
ServersLatencyBenchmark.graphQLApiEchoQuery_QuarkusServer      avgt    5    412.826 ±   29.148  us/op

I think the difference is negligible.

[novoj]

Tests were run as follows:

java -jar performance_tests/target/benchmarks.jar .*Quarkus.* -wi 1 -i 5 -f 1

[franz1981]

Yep, thanks! I need to check what's going on with the graphQL lib at this point; the fact that native is not half of the performance of JVM mode is sign of reflective operations which are likely better behaving in native mode (which is expected) - but it still means there are lot of hanging fruits there