Skip to content
This repository has been archived by the owner on Jul 31, 2023. It is now read-only.

gRPC Benchmarks

Ramon Nogueira edited this page Feb 21, 2018 · 6 revisions

gRPC Benchmarks

Checkout https://github.com/rakyll/grpc-go/tree/opencensus-benchmarks.

OpenCensus enabled

$ go run benchmark/benchmain/main.go -benchtime=10s -workloads=all \
  -compression=on -maxConcurrentCalls=1 -trace=off \
  -reqSizeBytes=1,1048576 -respSizeBytes=1,1048576 -networkMode=Local \
  -opencensus=true -resultFile=enabled

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1B-Compressor_true:
50_Latency: 208.0740 µs 	90_Latency: 271.1220 µs 	99_Latency: 472.0360 µs 	Avg latency: 223.2570 µs 	Count: 44749 	20275 Bytes/op	367 Allocs/op
Histogram (unit: µs)
Count: 44749  Min: 161.3  Max: 2045.2  Avg: 223.26
------------------------------------------------------------
[    161.263000,     161.264000)      1    0.0%    0.0%
[    161.264000,     161.267980)      0    0.0%    0.0%
[    161.267980,     161.287800)      0    0.0%    0.0%
[    161.287800,     161.386505)      0    0.0%    0.0%
[    161.386505,     161.878054)      0    0.0%    0.0%
[    161.878054,     164.325962)      4    0.0%    0.0%
[    164.325962,     176.516514)    373    0.8%    0.8%
[    176.516514,     237.225319)  35118   78.5%   79.3%  ########
[    237.225319,     539.554456)   8953   20.0%   99.3%  ##
[    539.554456,    2045.150000)    299    0.7%  100.0%
[   2045.150000,            inf)      1    0.0%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1B-Compressor_true:
50_Latency: 418.0410 µs 	90_Latency: 666.1110 µs 	99_Latency: 810.1510 µs 	Avg latency: 442.1240 µs 	Count: 22603 	1303966 Bytes/op	179 Allocs/op
Histogram (unit: µs)
Count: 22603  Min: 171.3  Max: 2496.3  Avg: 442.12
------------------------------------------------------------
[    171.253000,     171.254000)      1    0.0%    0.0%
[    171.254000,     171.258098)      0    0.0%    0.0%
[    171.258098,     171.278987)      0    0.0%    0.0%
[    171.278987,     171.385478)      0    0.0%    0.0%
[    171.385478,     171.928343)      0    0.0%    0.0%
[    171.928343,     174.695747)      0    0.0%    0.0%
[    174.695747,     188.803367)     45    0.2%    0.2%
[    188.803367,     260.720899)   3962   17.5%   17.7%  ##
[    260.720899,     627.340609)  14506   64.2%   81.9%  ######
[    627.340609,    2496.287000)   4088   18.1%  100.0%  ##
[   2496.287000,            inf)      1    0.0%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1048576B-Compressor_true:
50_Latency: 3.1175 ms 	90_Latency: 6.6309 ms 	99_Latency: 106.3650 ms 	Avg latency: 13.1187 ms 	Count: 770 	10558874 Bytes/op	785 Allocs/op
Histogram (unit: ms)
Count: 770  Min:   2.5  Max: 109.2  Avg: 13.12
------------------------------------------------------------
[        2.508021,         2.508022)    1    0.1%    0.1%
[        2.508022,         2.508029)    0    0.0%    0.1%
[        2.508029,         2.508082)    0    0.0%    0.1%
[        2.508082,         2.508495)    0    0.0%    0.1%
[        2.508495,         2.511721)    0    0.0%    0.1%
[        2.511721,         2.536874)    0    0.0%    0.1%
[        2.536874,         2.733042)   18    2.3%    2.5%
[        2.733042,         4.262954)  607   78.8%   81.3%  ########
[        4.262954,        16.194687)   70    9.1%   90.4%  #
[       16.194687,       109.249908)   73    9.5%   99.9%  #
[      109.249908,              inf)    1    0.1%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1048576B-Compressor_true:
50_Latency: 7.6872 ms 	90_Latency: 8.2435 ms 	99_Latency: 9.3503 ms 	Avg latency: 7.7637 ms 	Count: 1288 	9067834 Bytes/op	211 Allocs/op
Histogram (unit: ms)
Count: 1288  Min:   7.0  Max:  11.3  Avg: 7.76
------------------------------------------------------------
[       7.003883,        7.003884)     1    0.1%    0.1%
[       7.003884,        7.003888)     0    0.0%    0.1%
[       7.003888,        7.003913)     0    0.0%    0.1%
[       7.003913,        7.004046)     0    0.0%    0.1%
[       7.004046,        7.004773)     0    0.0%    0.1%
[       7.004773,        7.008746)     0    0.0%    0.1%
[       7.008746,        7.030448)     1    0.1%    0.2%
[       7.030448,        7.148992)    15    1.2%    1.3%
[       7.148992,        7.796531)   807   62.7%   64.0%  ######
[       7.796531,       11.333659)   463   35.9%   99.9%  ####
[      11.333659,             inf)     1    0.1%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1B-Compressor_true:
50_Latency: 3.0579 ms 	90_Latency: 103.6317 ms 	99_Latency: 106.4116 ms 	Avg latency: 13.8204 ms 	Count: 730 10558939 Bytes/op	799 Allocs/op
Histogram (unit: ms)
Count: 730  Min:   2.4  Max: 108.0  Avg: 13.82
------------------------------------------------------------
[        2.371930,         2.371931)    1    0.1%    0.1%
[        2.371931,         2.371938)    0    0.0%    0.1%
[        2.371938,         2.371991)    0    0.0%    0.1%
[        2.371991,         2.372403)    0    0.0%    0.1%
[        2.372403,         2.375613)    0    0.0%    0.1%
[        2.375613,         2.400622)    1    0.1%    0.3%
[        2.400622,         2.595450)   29    4.0%    4.2%
[        2.595450,         4.113211)  559   76.6%   80.8%  ########
[        4.113211,        15.936984)   64    8.8%   89.6%  #
[       15.936984,       108.047411)   75   10.3%   99.9%  #
[      108.047411,              inf)    1    0.1%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1B-Compressor_true:
50_Latency: 7.6509 ms 	90_Latency: 8.1634 ms 	99_Latency: 9.0045 ms 	Avg latency: 7.7025 ms 	Count: 1299 	9067902 Bytes/op	212 Allocs/op
Histogram (unit: ms)
Count: 1299  Min:   7.0  Max:  10.3  Avg: 7.70
------------------------------------------------------------
[       6.953727,        6.953728)     1    0.1%    0.1%
[       6.953728,        6.953732)     0    0.0%    0.1%
[       6.953732,        6.953755)     0    0.0%    0.1%
[       6.953755,        6.953877)     0    0.0%    0.1%
[       6.953877,        6.954524)     0    0.0%    0.1%
[       6.954524,        6.957959)     0    0.0%    0.1%
[       6.957959,        6.976207)     0    0.0%    0.1%
[       6.976207,        7.073154)    15    1.2%    1.2%
[       7.073154,        7.588183)   533   41.0%   42.3%  ####
[       7.588183,       10.324286)   749   57.7%   99.9%  ######
[      10.324286,             inf)     1    0.1%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1048576B-Compressor_true:
50_Latency: 5.4842 ms 	90_Latency: 107.9117 ms 	99_Latency: 109.0442 ms 	Avg latency: 23.5059 ms 	Count: 426 21095795 Bytes/op	1226 Allocs/op
Histogram (unit: ms)
Count: 426  Min:   4.7  Max: 210.1  Avg: 23.51
------------------------------------------------------------
[        4.747499,         4.747500)    1    0.2%    0.2%
[        4.747500,         4.747507)    0    0.0%    0.2%
[        4.747507,         4.747569)    0    0.0%    0.2%
[        4.747569,         4.748089)    0    0.0%    0.2%
[        4.748089,         4.752447)    0    0.0%    0.2%
[        4.752447,         4.789003)    4    0.9%    1.2%
[        4.789003,         5.095598)   52   12.2%   13.4%  #
[        5.095598,         7.667078)  295   69.2%   82.6%  #######
[        7.667078,        29.234600)    0    0.0%   82.6%
[       29.234600,       210.125798)   73   17.1%   99.8%  ##
[      210.125798,              inf)    1    0.2%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1048576B-Compressor_true:
50_Latency: 14.6896 ms 	90_Latency: 16.1699 ms 	99_Latency: 17.8056 ms 	Avg latency: 14.9324 ms 	Count: 670 	16954334 Bytes/op	227 Allocs/op
Histogram (unit: ms)
Count: 670  Min:  13.8  Max:  19.8  Avg: 14.93
------------------------------------------------------------
[      13.770898,       13.770899)    1    0.1%    0.1%
[      13.770899,       13.770904)    0    0.0%    0.1%
[      13.770904,       13.770930)    0    0.0%    0.1%
[      13.770930,       13.771080)    0    0.0%    0.1%
[      13.771080,       13.771931)    0    0.0%    0.1%
[      13.771931,       13.776752)    0    0.0%    0.1%
[      13.776752,       13.804085)    1    0.1%    0.3%
[      13.804085,       13.959028)    9    1.3%    1.6%
[      13.959028,       14.837380)  395   59.0%   60.6%  ######
[      14.837380,       19.816611)  263   39.3%   99.9%  ####
[      19.816611,             inf)    1    0.1%  100.0%

OpenCensus disabled

$ go run benchmark/benchmain/main.go -benchtime=10s -workloads=all \
  -compression=on -maxConcurrentCalls=1 -trace=off \
  -reqSizeBytes=1,1048576 -respSizeBytes=1,1048576 -networkMode=Local \
  -opencensus=false -resultFile=disabled
Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1B-Compressor_true:
50_Latency: 165.4040 µs 	90_Latency: 239.3130 µs 	99_Latency: 375.4510 µs 	Avg latency: 181.3780 µs 	Count: 55050 	14270 Bytes/op	231 Allocs/op
Histogram (unit: µs)
Count: 55050  Min: 111.7  Max: 1349.4  Avg: 181.38
------------------------------------------------------------
[    111.657000,     111.658000)      1    0.0%    0.0%
[    111.658000,     111.661753)      0    0.0%    0.0%
[    111.661753,     111.679590)      0    0.0%    0.0%
[    111.679590,     111.764370)      0    0.0%    0.0%
[    111.764370,     112.167321)      0    0.0%    0.0%
[    112.167321,     114.082516)      7    0.0%    0.0%
[    114.082516,     123.185290)    142    0.3%    0.3%
[    123.185290,     166.450078)  28291   51.4%   51.7%  #####
[    166.450078,     372.084299)  26043   47.3%   99.0%  #####
[    372.084299,    1349.448000)    565    1.0%  100.0%
[   1349.448000,            inf)      1    0.0%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1B-Compressor_true:
50_Latency: 340.0440 µs 	90_Latency: 670.2560 µs 	99_Latency: 951.8220 µs 	Avg latency: 398.4180 µs 	Count: 25079 	1013740 Bytes/op	147 Allocs/op
Histogram (unit: µs)
Count: 25079  Min: 150.9  Max: 5011.5  Avg: 398.42
------------------------------------------------------------
[    150.948000,     150.949000)      1    0.0%    0.0%
[    150.949000,     150.953533)      0    0.0%    0.0%
[    150.953533,     150.978615)      0    0.0%    0.0%
[    150.978615,     151.117393)      0    0.0%    0.0%
[    151.117393,     151.885265)      0    0.0%    0.0%
[    151.885265,     156.133943)      8    0.0%    0.0%
[    156.133943,     179.642147)   1130    4.5%    4.5%
[    179.642147,     309.714499)  10285   41.0%   45.6%  ####
[    309.714499,    1029.412912)  13508   53.9%   99.4%  #####
[   1029.412912,    5011.549000)    146    0.6%  100.0%
[   5011.549000,            inf)      1    0.0%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1048576B-Compressor_true:
50_Latency: 3.0807 ms 	90_Latency: 103.9076 ms 	99_Latency: 106.9699 ms 	Avg latency: 14.0351 ms 	Count: 718 10551693 Bytes/op	659 Allocs/op
Histogram (unit: ms)
Count: 718  Min:   2.3  Max: 111.5  Avg: 14.04
------------------------------------------------------------
[        2.297397,         2.297398)    1    0.1%    0.1%
[        2.297398,         2.297405)    0    0.0%    0.1%
[        2.297405,         2.297458)    0    0.0%    0.1%
[        2.297458,         2.297875)    0    0.0%    0.1%
[        2.297875,         2.301135)    0    0.0%    0.1%
[        2.301135,         2.326621)    0    0.0%    0.1%
[        2.326621,         2.525898)   12    1.7%    1.8%
[        2.525898,         4.084036)  565   78.7%   80.5%  ########
[        4.084036,        16.267031)   64    8.9%   89.4%  #
[       16.267031,       111.525192)   75   10.4%   99.9%  #
[      111.525192,              inf)    1    0.1%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1B-respSize_1048576B-Compressor_true:
50_Latency: 7.5784 ms 	90_Latency: 8.0724 ms 	99_Latency: 8.9285 ms 	Avg latency: 7.6419 ms 	Count: 1309 	9066541 Bytes/op	186 Allocs/op
Histogram (unit: ms)
Count: 1309  Min:   7.0  Max:  10.3  Avg: 7.64
------------------------------------------------------------
[       7.025709,        7.025710)     1    0.1%    0.1%
[       7.025710,        7.025714)     0    0.0%    0.1%
[       7.025714,        7.025737)     0    0.0%    0.1%
[       7.025737,        7.025858)     0    0.0%    0.1%
[       7.025858,        7.026497)     0    0.0%    0.1%
[       7.026497,        7.029886)     1    0.1%    0.2%
[       7.029886,        7.047844)     1    0.1%    0.2%
[       7.047844,        7.142997)    23    1.8%    2.0%
[       7.142997,        7.647195)   765   58.4%   60.4%  ######
[       7.647195,       10.318852)   517   39.5%   99.9%  ####
[      10.318852,             inf)     1    0.1%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1B-Compressor_true:
50_Latency: 2.9226 ms 	90_Latency: 104.1707 ms 	99_Latency: 105.8027 ms 	Avg latency: 14.3494 ms 	Count: 698 10551676 Bytes/op	658 Allocs/op
Histogram (unit: ms)
Count: 698  Min:   2.3  Max: 106.6  Avg: 14.35
------------------------------------------------------------
[        2.264803,         2.264804)    1    0.1%    0.1%
[        2.264804,         2.264811)    0    0.0%    0.1%
[        2.264811,         2.264864)    0    0.0%    0.1%
[        2.264864,         2.265274)    0    0.0%    0.1%
[        2.265274,         2.268465)    0    0.0%    0.1%
[        2.268465,         2.293289)    2    0.3%    0.4%
[        2.293289,         2.486394)   20    2.9%    3.3%
[        2.486394,         3.988565)  584   83.7%   87.0%  ########
[        3.988565,        15.673994)   13    1.9%   88.8%
[       15.673994,       106.575271)   77   11.0%   99.9%  #
[      106.575271,              inf)    1    0.1%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1B-Compressor_true:
50_Latency: 7.7652 ms 	90_Latency: 8.8747 ms 	99_Latency: 10.8562 ms 	Avg latency: 7.9547 ms 	Count: 1258 	9067324 Bytes/op	188 Allocs/op
Histogram (unit: ms)
Count: 1258  Min:   7.0  Max:  12.6  Avg: 7.95
------------------------------------------------------------
[       6.977970,        6.977971)     1    0.1%    0.1%
[       6.977971,        6.977976)     0    0.0%    0.1%
[       6.977976,        6.978002)     0    0.0%    0.1%
[       6.978002,        6.978148)     0    0.0%    0.1%
[       6.978148,        6.978969)     1    0.1%    0.2%
[       6.978969,        6.983589)     0    0.0%    0.2%
[       6.983589,        7.009560)     1    0.1%    0.2%
[       7.009560,        7.155584)    19    1.5%    1.7%
[       7.155584,        7.976598)   819   65.1%   66.9%  #######
[       7.976598,       12.592706)   416   33.1%   99.9%  ###
[      12.592706,             inf)     1    0.1%  100.0%

Unary-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1048576B-Compressor_true:
50_Latency: 5.5364 ms 	90_Latency: 107.8498 ms 	99_Latency: 110.3773 ms 	Avg latency: 23.9946 ms 	Count: 418 21093969 Bytes/op	1109 Allocs/op
Histogram (unit: ms)
Count: 418  Min:   4.6  Max: 212.1  Avg: 23.99
------------------------------------------------------------
[        4.601790,         4.601791)    1    0.2%    0.2%
[        4.601791,         4.601798)    0    0.0%    0.2%
[        4.601798,         4.601861)    0    0.0%    0.2%
[        4.601861,         4.602382)    0    0.0%    0.2%
[        4.602382,         4.606761)    0    0.0%    0.2%
[        4.606761,         4.643533)    2    0.5%    0.7%
[        4.643533,         4.952303)   26    6.2%    6.9%  #
[        4.952303,         7.545002)  306   73.2%   80.1%  #######
[        7.545002,        29.315556)   10    2.4%   82.5%
[       29.315556,       212.120041)   72   17.2%   99.8%  ##
[      212.120041,              inf)    1    0.2%  100.0%

Stream-traceMode_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_1-reqSize_1048576B-respSize_1048576B-Compressor_true:
50_Latency: 14.8092 ms 	90_Latency: 16.5125 ms 	99_Latency: 19.2323 ms 	Avg latency: 15.1231 ms 	Count: 662 	16813718 Bytes/op	204 Allocs/op
Histogram (unit: ms)
Count: 662  Min:  13.7  Max:  21.9  Avg: 15.12
------------------------------------------------------------
[      13.721722,       13.721723)    1    0.2%    0.2%
[      13.721723,       13.721728)    0    0.0%    0.2%
[      13.721728,       13.721756)    0    0.0%    0.2%
[      13.721756,       13.721924)    0    0.0%    0.2%
[      13.721924,       13.722906)    0    0.0%    0.2%
[      13.722906,       13.728667)    0    0.0%    0.2%
[      13.728667,       13.762457)    0    0.0%    0.2%
[      13.762457,       13.960669)   11    1.7%    1.8%
[      13.960669,       15.123341)  443   66.9%   68.7%  #######
[      15.123341,       21.943370)  206   31.1%   99.8%  ###
[      21.943370,             inf)    1    0.2%  100.0%
Clone this wiki locally