Client tracing experiment

[achamayou]

This is a little experiment to see if we could easily build traces that can be checked with https://github.com/ligurio/elle-cli

The answer is, we can:

amchamay@amchamay:~/CCF/build$ ./tests.sh -VV -R client_tracin
...
55: 14:23:27.844 | INFO     | __main__:write:28 - [0|tls=user0] PUT /records/x 2
55: 14:23:27.844 | INFO     | __main__:write:28 - 204 @2.22 
55: 14:23:27.847 | INFO     | __main__:read:50 - [0|tls=user0] GET /records/x
55: 14:23:27.848 | INFO     | __main__:read:50 - 200 @2.22 2
55: 14:23:27.851 | INFO     | __main__:read:50 - [0|tls=user0] GET /records/x
55: 14:23:27.851 | INFO     | __main__:read:50 - 200 @2.22 2
...

amchamay@amchamay:~/elle-cli$ java -jar target/elle-cli-0.1.7-standalone.jar --model rw-register ~/CCF/build/trace.json -c strict-serializable
/home/amchamay/CCF/build/trace.json      true

What could be interesting to do next:

• call across nodes
• support waiting for commit (as opposed to pending)
• try the different consistency models
• do the same thing with piccolo files

[ghost]

client_tracing@78079 aka 20231030.9 vs main ewma over 20 builds from 77459 to 78065

Click to see table

main

build_id	build_number	pi_basic_mt_sgx_cft^	pi_basic_mt_sgx_cft_mem	Commit latency factor	tpcc_virtual_cft^	pi_basic_mt_virtual_cft^	tpcc_sgx_cft^	tpcc_sgx_cft_mem	ls_virtual_cft^	pi_ls_virtual_cft^	pi_basic_virtual_cft^	pi_basic_js_virtual_cft^	ls_jwt_virtual_cft^	pi_ls_jwt_virtual_cft^	ls_sgx_cft^	ls_sgx_cft_mem	ls_js_virtual_cft^	pi_ls_sgx_cft^	pi_ls_sgx_cft_mem	pi_basic_sgx_cft^	pi_basic_sgx_cft_mem	ls_full_js_virtual_cft^	ls_js_jwt_virtual_cft^	pi_basic_js_sgx_cft^	pi_basic_js_sgx_cft_mem	ls_jwt_sgx_cft^	ls_jwt_sgx_cft_mem	pi_ls_jwt_sgx_cft^	pi_ls_jwt_sgx_cft_mem	hist_sgx_cft^	ls_js_sgx_cft^	ls_js_sgx_cft_mem	ls_full_js_sgx_cft^	ls_full_js_sgx_cft_mem	ls_js_jwt_sgx_cft^	ls_js_jwt_sgx_cft_mem	RB put (/s)^	CHAMP put (/s)^	RB get (/s)^	CHAMP get (/s)^
77459	20231020.5	27942.3	2.51822e+07	0.806882	17271.7	83682.7	5609.6	8.59996e+07	45556.9	48282.6	53165.7	4426.2	17066.3	17662.5	14027.3	1.88908e+07	16990.3	14086.4	1.05021e+07	15436.7	1.46964e+07	14844.7	9889.88	1431.9	1.25993e+07	6873.38	1.88908e+07	6974.5	6.30784e+06	42113.3	5805.89	1.67936e+07	5491.04	1.67936e+07	3972.9	1.67936e+07	830635	1.18094e+06	8.16668e+06	3.0923e+07
77461	20231020.6	27968.8	2.30851e+07	0.797578	17246.7	86522.6	5645.01	8.59996e+07	45887.8	48453.6	54176.2	4426.2	17079.1	19435.2	13956.1	1.88908e+07	15003.7	14152	1.05021e+07	15499.4	1.46964e+07	14699.8	9770.09	1437.7	1.25993e+07	7235.96	1.67936e+07	7078.7	6.30784e+06	43030.2	5801.29	1.67936e+07	5742.38	1.67936e+07	3995.17	1.67936e+07	825201	1.1798e+06	8.16489e+06	3.14443e+07
77485	20231020.14	27955.5	2.51822e+07	0.827982	17203.3	67488.2	5614.45	8.59996e+07	45720.2	47505.9	52771.4	4441	17168.5	19652.2	14042.3	1.67936e+07	16950.7	14155.3	1.05021e+07	15587	1.46964e+07	14720	9771.33	1441.5	1.25993e+07	7220.81	1.67936e+07	6925.4	6.30784e+06	46913.9	5824.33	1.67936e+07	5745.31	1.67936e+07	3980.22	1.67936e+07	831368	1.1798e+06	8.12782e+06	3.08955e+07
77532	20231020.31	27967.5	2.51822e+07	0.835073	17092.6	60943.5	5614.22	8.59996e+07	43713.6	47796.6	52609.1	4332.3	17195.4	19336.7	14001.1	1.88908e+07	17022.6	14174.9	1.05021e+07	15520.9	1.46964e+07	14750.8	10188.5	1429.6	1.25993e+07	7252.76	1.67936e+07	7086.5	6.30784e+06	40351.5	5806.4	1.67936e+07	5491.29	1.67936e+07	4001.82	1.67936e+07	833120	1.18235e+06	8.17343e+06	3.12829e+07
77555	20231023.5	28238.2	2.51822e+07	0.816011	17264.2	74767.3	5639.66	8.59996e+07	45924.9	47674	53843.3	4365.2	17152.3	19152.3	14029.3	1.88908e+07	17286.3	14118.1	1.05021e+07	15640.2	1.46964e+07	14910.6	10169.6	1432.7	1.25993e+07	7273.33	1.67936e+07	6953.5	6.30784e+06	43068.6	5781.01	1.67936e+07	5742.5	1.67936e+07	3995.51	1.67936e+07	829052	1.18151e+06	8.148e+06	3.09408e+07
77584	20231023.15	27775.2	2.51822e+07	0.839543	17237.3	63643	5525.06	8.59996e+07	43785.4	47940.2	54114.3	4430	17010.7	19396.4	13936	1.88908e+07	17307.2	13990.4	1.05021e+07	15424.6	1.46964e+07	14810.6	9823.55	1427	1.25993e+07	6853.5	1.88908e+07	6881.2	6.30784e+06	42679.4	5758.93	1.67936e+07	5762.09	1.67936e+07	3983.52	1.67936e+07	825381	1.18095e+06	8.16893e+06	3.13159e+07
77665	20231024.10	28077.5	2.30851e+07	0.782853	17332.4	71956.1	5565	8.59996e+07	43627.5	47460.4	55764.1	4480.7	16984.5	19600.5	13918.6	1.88908e+07	17210.4	14015.8	1.05021e+07	15439.4	1.46964e+07	15032.4	9934.79	1417.5	1.25993e+07	6827.52	1.88908e+07	6933.8	6.30784e+06	42277.7	5759.87	1.67936e+07	5778.73	1.67936e+07	3994.77	1.67936e+07	837727	1.17659e+06	8.1335e+06	3.08424e+07
77722	20231024.29	28002.9	2.51822e+07	0.808583	17482.9	68825.6	5477.83	8.59996e+07	43910	47389.3	55105.8	4422.3	16897.2	19100.4	13980.7	1.88908e+07	17082.1	14011.7	1.05021e+07	15103.3	1.46964e+07	15051.5	9901.25	1409.7	1.25993e+07	6842.46	1.88908e+07	6811.8	6.30784e+06	43837.6	5772.89	1.67936e+07	5489.45	1.67936e+07	4013.18	1.67936e+07	824014	1.17985e+06	8.16421e+06	3.03628e+07
77856	20231025.44	27880.1	2.30851e+07	0.830072	17303.7	84849.8	5666.89	8.59996e+07	45783	47925.3	54083.6	4428.6	17130.6	18998.8	14118.2	1.88908e+07	17531.7	14176.7	1.05021e+07	15508.7	1.46964e+07	14906.9	9965.7	1425.1	1.25993e+07	7259.6	1.67936e+07	6931.4	6.30784e+06	44821	5816.26	1.67936e+07	5714.88	1.67936e+07	3996.87	1.67936e+07	832615	1.17692e+06	8.17447e+06	3.1229e+07
77900	20231025.59	27968.9	2.30851e+07	0.816541	17281.4	81852.5	5546.67	8.59996e+07	45862.6	47692.2	54378.7	4430.3	17128.6	18994.4	13948.6	1.88908e+07	17211.3	14105.4	1.05021e+07	15469.3	1.46964e+07	14724.7	9880.77	1430.1	1.25993e+07	6806.65	1.88908e+07	6880.7	6.30784e+06	42489.7	5770.88	1.67936e+07	5488.27	1.88908e+07	3990.38	1.67936e+07	839143	1.18218e+06	8.15475e+06	3.09642e+07
77909	20231025.62	27790.9	2.30851e+07	0.79592	17614.6	82618.8	5576.25	8.59996e+07	45746.3	48128.1	53844.8	4388	17161.3	19081.4	13953.5	1.88908e+07	17522.5	13887.2	1.05021e+07	15385.2	1.25993e+07	14627.1	10342.4	1410.9	1.25993e+07	6741.99	1.88908e+07	6827.9	6.30784e+06	43740.4	5792.34	1.67936e+07	5446.53	1.67936e+07	3975.81	1.67936e+07	830943	1.17967e+06	8.14732e+06	3.07715e+07
77921	20231026.3	27942.2	2.30851e+07	0.791384	17373	72066.7	5619.54	8.80968e+07	45699.4	48314.8	54188.2	4351.5	17286.9	19246.7	14116.6	1.88908e+07	17012.1	14237.9	1.05021e+07	15679.6	1.25993e+07	14641.1	10204.5	1439.5	1.25993e+07	6842.16	1.67936e+07	7086.5	6.30784e+06	44491.1	5774.21	1.67936e+07	5775.45	1.67936e+07	3999.2	1.67936e+07	835419	1.1779e+06	8.15017e+06	3.23452e+07
77958	20231026.14	27891.3	2.30851e+07	0.772274	17260.9	68096.1	5566.37	8.59996e+07	45673.6	48273.7	54086	4383.2	17108.5	19101.5	14074.9	1.88908e+07	17286.3	14198.3	1.05021e+07	15598.1	1.46964e+07	14984.8	10377.2	1432.2	1.25993e+07	6840.93	1.67936e+07	6965.9	6.30784e+06	43732	5777.94	1.67936e+07	5783.74	1.67936e+07	3984.61	1.67936e+07	834153	1.18014e+06	8.15037e+06	3.08165e+07
77980	20231026.23	27919.7	2.30851e+07	0.799401	17301.4	84229.4	5544.83	8.59996e+07	45630	47959.1	54124.7	4420.8	17150.6	19602.5	13945.1	1.88908e+07	17059.4	14005.8	1.05021e+07	15441	1.25993e+07	14690.5	9850.2	1419.8	1.25993e+07	7232.3	1.67936e+07	6917.8	6.30784e+06	42472.7	5811.09	1.67936e+07	5487	1.67936e+07	4003.14	1.67936e+07	827669	1.18001e+06	8.13674e+06	3.08104e+07
77994	20231026.29	27941.4	2.51822e+07	0.80113	17290	82095.1	5582.56	8.59996e+07	43873.2	47649.7	54065	4441.8	17136.7	19419.7	14017.2	1.88908e+07	17733.8	14167	1.05021e+07	15610.3	1.25993e+07	16838	9840.75	1446	1.25993e+07	6841.03	1.88908e+07	6962.5	6.30784e+06	44959.6	5764.66	1.67936e+07	5729.26	1.67936e+07	4003.36	1.67936e+07	840437	1.18274e+06	8.15494e+06	3.07517e+07
78007	20231026.34	27449.9	2.51822e+07	0.765143	17307	81427	5628.96	8.59996e+07	45407.5	47735	54044.5	4441.4	17288.5	18904.7	14025.1	1.88908e+07	17015.3	14089.7	1.05021e+07	15601.5	1.46964e+07	16872.1	9816.73	1432.4	1.25993e+07	6850.52	1.88908e+07	7096.8	6.30784e+06	43179.9	5773.88	1.67936e+07	5486.07	1.67936e+07	3985.52	1.67936e+07	826445	1.17834e+06	8.14738e+06	3.19605e+07
78033	20231027.4	28127.4	2.51822e+07	0.798824	17273	65638.2	5577.93	8.59996e+07	45862.4	48024.5	53817.4	4439.6	17160.1	19602.8	13972.7	1.88908e+07	17044.2	14096.8	1.05021e+07	15447.2	1.25993e+07	16883.5	9854.32	1432.2	1.25993e+07	7250.65	1.67936e+07	6938.4	6.30784e+06	42046.2	5786.4	1.67936e+07	5743.72	1.67936e+07	4002.74	1.67936e+07	829984	1.18448e+06	8.13813e+06	3.06775e+07
78035	20231027.5	27938.3	2.51822e+07	0.785967	17213.8	83501.4	5573.65	8.59996e+07	45970.2	48037.9	54501.8	4447.9	17062.2	19333.8	14007.5	1.88908e+07	16911.6	14114.5	1.05021e+07	15503.3	1.46964e+07	17015.7	9990.67	1434.7	1.25993e+07	6832.63	1.67936e+07	6983.9	6.30784e+06	47144	5786.59	1.67936e+07	5775.4	1.67936e+07	3982.36	1.67936e+07	831267	1.18066e+06	8.09742e+06	3.06715e+07
78049	20231027.10	28049.5	2.51822e+07	0.781085	17300.2	85552.5	5504.64	8.59996e+07	43575	46933.4	55026	4431	17056.6	19111.7	14023.9	1.88908e+07	17359	14102.3	1.05021e+07	15421.6	1.46964e+07	14869.3	9805.16	1424.4	1.25993e+07	6846.42	1.67936e+07	6826.6	6.30784e+06	41017.4	5791.73	1.67936e+07	5707.49	1.67936e+07	3980.86	1.67936e+07	840517	1.18098e+06	8.16672e+06	3.06803e+07
78065	20231030.3	27850.6	2.30851e+07	0.803529	17287.6	80986.2	5645.18	8.59996e+07	43811.1	46782.1	54407.3	4392.3	17198.2	19724.6	14038.5	1.88908e+07	17634.6	14125	1.05021e+07	15560.2	1.46964e+07	14791.7	10345.8	1434	1.25993e+07	7241.2	1.67936e+07	7023.9	6.30784e+06	38753.2	5804.59	1.67936e+07	5779.74	1.67936e+07	3998.35	1.67936e+07	831589	1.1757e+06	8.07743e+06	3.07175e+07

client_tracing

build_id	build_number	pi_basic_mt_sgx_cft^	pi_basic_mt_sgx_cft_mem	pi_basic_mt_virtual_cft^	Commit latency factor	tpcc_virtual_cft^	ls_virtual_cft^	pi_ls_virtual_cft^	pi_basic_virtual_cft^	tpcc_sgx_cft^	tpcc_sgx_cft_mem	pi_basic_js_virtual_cft^	ls_jwt_virtual_cft^	pi_ls_jwt_virtual_cft^	ls_js_virtual_cft^	ls_full_js_virtual_cft^	ls_sgx_cft^	ls_sgx_cft_mem	ls_js_jwt_virtual_cft^	pi_ls_sgx_cft^	pi_ls_sgx_cft_mem	pi_basic_sgx_cft^	pi_basic_sgx_cft_mem	pi_basic_js_sgx_cft^	pi_basic_js_sgx_cft_mem	hist_sgx_cft^	ls_jwt_sgx_cft^	ls_jwt_sgx_cft_mem	pi_ls_jwt_sgx_cft^	pi_ls_jwt_sgx_cft_mem	ls_js_sgx_cft^	ls_js_sgx_cft_mem	ls_full_js_sgx_cft^	ls_full_js_sgx_cft_mem	ls_js_jwt_sgx_cft^	ls_js_jwt_sgx_cft_mem	RB put (/s)^	CHAMP put (/s)^	RB get (/s)^	CHAMP get (/s)^
77180	20231012.14	28085.7	2.30851e+07	63012.3	0.782463	17443.8	45477	48855.1	55259.8	5570.31	8.59996e+07	4475.6	17262.7	19700.9	17546.7	14977.8	13967.3	1.88908e+07	9854.74	14134.2	1.05021e+07	15503.2	1.46964e+07	1425.3	1.25993e+07	45212.8	6853.59	1.88908e+07	7072.8	6.30784e+06	5769.69	1.67936e+07	5502.7	1.88908e+07	3964.35	1.67936e+07	833112	1.18079e+06	8.15355e+06	3.08876e+07
77192	20231012.18	27776.1	2.30851e+07	71946.8	0.80931	17365.3	45989.3	48475	55810.2	5561.93	8.59996e+07	4473.3	17096.4	19314.7	17057.9	14714.1	13973.5	1.67936e+07	9827.5	14044.5	1.05021e+07	15460.7	1.46964e+07	1422	1.25993e+07	44921.3	6849.54	1.88908e+07	6873.5	6.30784e+06	5801.43	1.67936e+07	5766.07	1.67936e+07	3957.11	1.67936e+07	839602	1.18169e+06	8.14259e+06	3.13947e+07
78079	20231030.9	28036.1	2.51822e+07	79162.5	0.809492	17355.2	43655.4	47491	55225.7	5522.9	8.59996e+07	4406	17005.2	19578.3	16976.5	14653.7	13956.6	1.67936e+07	9789.29	14097.3	1.05021e+07	15453.4	1.46964e+07	1419.2	1.25993e+07	40841.8	6838.71	1.88908e+07	7037.1	6.30784e+06	5796.91	1.67936e+07	5477.6	1.67936e+07	3991.29	1.67936e+07	830213	1.18355e+06	8.17359e+06	3.05996e+07

[achamayou]

It does not look like I will have time to pick this up soon, so parking for now.