Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Action and Variable coverage collection #6092

Merged
merged 1 commit into from
Mar 25, 2024
Merged

Action and Variable coverage collection #6092

merged 1 commit into from
Mar 25, 2024

Conversation

lemmy
Copy link
Contributor

@lemmy lemmy commented Mar 25, 2024

No description provided.

@lemmy lemmy added the tla TLA+ specifications label Mar 25, 2024
@ghost
Copy link

ghost commented Mar 25, 2024

mku-coverage@83114 aka 20240325.21 vs main ewma over 20 builds from 82711 to 83108

Click to see table

main

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem tpcc_virtual_cft^ pi_basic_mt_virtual_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ hist_sgx_cft^ KV ser (/s)^ KV deser (/s)^ KV snap ser (/s)^ KV snap deser (/s)^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean
82711 20240315.19 27473.4 2.30851e+07 0.827234 5579.84 8.59996e+07 13936.8 1.67936e+07 14079 1.05021e+07 15445.4 1.46964e+07 1371.5 1.25993e+07 6864.43 1.88908e+07 6921.8 6.30784e+06 5786.72 1.67936e+07 17226.4 78701.2 5446.19 1.67936e+07 52920 55630.7 62135.6 3995.28 1.67936e+07 4460.1 20750.9 21671.3 17455.4 17410.8 11590.7 46053.1 1.05419e+06 1.13097e+06 7959.78 1401.86 836557 1.17881e+06 8.14735e+06 3.33301e+07 30866 378
82733 20240318.3 27923.1 2.51822e+07 0.793088 5595.36 8.59996e+07 14007.8 1.67936e+07 14120 1.05021e+07 15590.5 1.46964e+07 1375.3 1.25993e+07 6879.03 1.88908e+07 7012.8 6.30784e+06 5760.84 1.67936e+07 17295.9 69387.2 5448.96 1.67936e+07 53432.6 55698.8 61939.2 3971.05 1.67936e+07 4461.6 20831 21767.5 17645.3 17454.5 11747.2 45965.6 988142 1.1655e+06 8411.83 1399.93 811496 1.18487e+06 8.15105e+06 3.07655e+07 31024 381
82737 20240318.4 27855.7 2.30851e+07 0.838162 5614.11 8.59996e+07 13974.8 1.88908e+07 14025.9 1.05021e+07 15532.1 1.25993e+07 1369.4 1.25993e+07 7229.16 1.67936e+07 6882.1 6.30784e+06 5792.09 1.67936e+07 17108.6 66151.2 5445.12 1.67936e+07 52882.5 55297.8 61185.4 3988.23 1.67936e+07 4408.1 20714.4 21251.3 17306 17150.3 11526.5 43448.6 1.01102e+06 1.13417e+06 8227.57 1400.71 826391 1.18204e+06 8.12995e+06 3.08267e+07 32286 383
82757 20240318.11 27866.3 2.30851e+07 0.814693 5551.33 8.59996e+07 13972.9 1.88908e+07 14074.9 1.05021e+07 15512.2 1.25993e+07 1363.3 1.25993e+07 6813.84 1.88908e+07 6923.5 6.30784e+06 5738.68 1.67936e+07 17211.7 90465.6 5453.12 1.67936e+07 52996.5 55448.4 62108.6 3988.85 1.67936e+07 4458.6 20915.4 21481.4 17391 17448.8 11560.6 42784.2 1.06598e+06 1.16428e+06 8761.61 1407.29 833024 1.17982e+06 8.1325e+06 3.18334e+07 30021 357
82779 20240318.19 28083.2 2.30851e+07 0.808391 5527.75 8.59996e+07 13915.1 1.67936e+07 14015.2 1.05021e+07 15265.9 1.25993e+07 1348.1 1.25993e+07 6819.5 1.88908e+07 6934.4 6.30784e+06 5771.53 1.67936e+07 17109.9 83576.3 5438.4 1.67936e+07 52992.4 55188.2 61697.5 3990.96 1.67936e+07 4431.9 21246 21519.7 17562.4 17243.6 11586.9 45272.7 1.02912e+06 1.17744e+06 7807.78 1397.64 837965 1.1708e+06 8.13602e+06 3.07517e+07 32536 373
82788 20240318.22 27842 2.30851e+07 0.791602 5480.12 8.59996e+07 13872.5 1.88908e+07 13833.8 1.05021e+07 15367.6 1.46964e+07 1346.4 1.25993e+07 6866.93 1.88908e+07 7042 6.30784e+06 5767.17 1.67936e+07 17216.4 68458.7 5464.6 1.67936e+07 52899.6 54983.7 61392.7 3976.85 1.67936e+07 4446 20809.4 21099.7 17490.9 17107.9 11706.2 42868.4 1.04167e+06 1.1558e+06 7956.66 1403.54 835007 1.17916e+06 8.14826e+06 3.08369e+07 32882 380
82798 20240318.25 27980.6 2.30851e+07 0.816977 5577.76 8.59996e+07 13942.6 1.88908e+07 14002.4 1.05021e+07 15379.8 1.46964e+07 1370 1.25993e+07 6801.93 1.88908e+07 6928.8 6.30784e+06 5799.78 1.67936e+07 17215.3 97670.4 5480.57 1.67936e+07 53023.5 55469 62158.1 3982.34 1.67936e+07 4443.2 20725 22098 17491.2 17205.9 11605.5 42771 1.05009e+06 1.14116e+06 7963.99 1404.73 827431 1.18304e+06 8.15472e+06 3.07581e+07 32280 384
82808 20240318.28 27678.5 2.51822e+07 0.805582 5626.63 8.59996e+07 13970.8 1.88908e+07 14039 1.05021e+07 15521.4 1.46964e+07 1373.9 1.25993e+07 6868.02 1.88908e+07 6931.4 6.30784e+06 5803.98 1.67936e+07 17152.8 70163.6 5442.74 1.67936e+07 53231.6 55482.5 61663.6 3990.95 1.67936e+07 4405.7 20568.4 21548.5 17531.8 17515.4 11563.2 45393.1 1.04646e+06 1.16809e+06 7919.02 1398.65 832135 1.17718e+06 8.09813e+06 3.14226e+07 31220 382
82814 20240319.1 28079.1 2.30851e+07 0.835128 5601.4 8.59996e+07 13946.2 1.88908e+07 14017.3 1.05021e+07 15577.4 1.46964e+07 1359.8 1.25993e+07 6850.25 1.88908e+07 7140.2 6.30784e+06 5754.81 1.67936e+07 17277.2 70706.4 5447.98 1.67936e+07 52833.5 57165.7 62292 3989.09 1.67936e+07 4430.8 21262.1 21811.2 17511.8 17293.3 11732.8 48561.4 1.03413e+06 1.14025e+06 7801.37 1405.27 830705 1.17741e+06 8.14402e+06 3.1109e+07 32462 369
82835 20240319.8 28062.1 2.51822e+07 0.837813 5510.28 8.59996e+07 13804.3 1.88908e+07 13908.2 1.05021e+07 15320.3 1.46964e+07 1348.4 1.25993e+07 6848.14 1.88908e+07 6889.5 6.30784e+06 5778.13 1.67936e+07 17227.7 69590.2 5474.58 1.67936e+07 53576 56250.9 62196 3957.99 1.67936e+07 4431.4 20786.7 21712.2 17538.6 17544 11613.7 44852.3 1.03907e+06 1.16741e+06 8028.68 1384.91 801178 1.18205e+06 8.1315e+06 3.11322e+07 31218 366
82842 20240320.1 28088.6 2.30851e+07 0.795937 5578.48 8.59996e+07 13967.6 1.88908e+07 13984.1 1.05021e+07 15560.5 1.25993e+07 1370.3 1.05021e+07 6805.41 1.88908e+07 7042.4 6.30784e+06 5775.41 1.67936e+07 17161.1 82750.6 5467.65 1.67936e+07 50737.4 55481.9 61410.4 3879.66 1.67936e+07 4408.2 20721.6 20939.8 17393.6 16990.9 11706.9 47065.1 1.05186e+06 1.16104e+06 8151.56 1404.1 839027 1.17528e+06 8.15056e+06 3.06587e+07 30174 382
82864 20240320.9 27810.6 2.30851e+07 0.821651 5512.38 8.59996e+07 13879.7 1.88908e+07 14042 1.05021e+07 15479.2 1.46964e+07 1359.2 1.25993e+07 6849.78 1.67936e+07 7018.8 6.30784e+06 5765.35 1.67936e+07 17219.5 84734.7 5480.38 1.67936e+07 53302.2 55326.6 62207 3990.49 1.67936e+07 4407.7 17196.8 21736.3 17512.2 17459.7 11693.7 41778.3 1.04701e+06 1.13109e+06 7937.05 1404.32 833112 1.18197e+06 8.15387e+06 3.07457e+07 31738 377
82906 20240321.2 27754.2 2.30851e+07 0.801621 5533.71 8.59996e+07 13799.2 1.88908e+07 13962 1.05021e+07 15288.3 1.46964e+07 1355.5 1.25993e+07 6799.37 1.67936e+07 6906.2 6.30784e+06 5790.33 1.67936e+07 17172.3 87877.2 5465.42 1.67936e+07 52970.8 40672.6 60757.5 3983.52 1.67936e+07 4392.6 20462.7 20745.2 17430.2 17175.9 11543 42157.6 1.05977e+06 1.17412e+06 7531.67 1400.02 836529 1.18229e+06 8.15368e+06 3.25902e+07 29270 386
82925 20240321.7 27420.1 2.30851e+07 0.807056 5646.99 8.59996e+07 13895 1.88908e+07 14012.6 1.05021e+07 15451.8 1.46964e+07 1376.3 1.25993e+07 6896.06 1.88908e+07 7094.7 6.30784e+06 5751.92 1.67936e+07 17368.7 79485.1 5715.65 1.67936e+07 53475.8 56637 62746 3995.22 1.67936e+07 4439.9 21040.8 21736.3 17694.8 17398 11628.1 45300.9 1.05086e+06 1.14718e+06 8069.03 1407.16 831410 1.17717e+06 8.13044e+06 3.0809e+07 32455 379
82996 20240322.3 27423.4 2.30851e+07 0.803997 5569.26 8.59996e+07 13890.2 1.88908e+07 14049.6 1.05021e+07 15467.8 1.46964e+07 1372.1 1.25993e+07 6884.86 1.88908e+07 7030.1 6.30784e+06 5801.3 1.67936e+07 17355.5 79428.1 5456.3 1.67936e+07 53050.4 56308.8 62950.9 3990.73 1.67936e+07 4446 20891.9 21857.9 17952 17419.6 11656.7 43140.2 1.04493e+06 1.11832e+06 8234.47 1400.61 835988 1.17669e+06 8.1458e+06 3.07868e+07 31479 377
83004 20240322.5 27756.3 2.30851e+07 0.808055 5565.83 8.59996e+07 13932.7 1.88908e+07 13952 1.05021e+07 15426.3 1.46964e+07 1361.3 1.25993e+07 6830.62 1.88908e+07 6879.1 6.30784e+06 5801.54 1.67936e+07 17299.9 89907 5464.86 1.67936e+07 52868.8 55992.6 62180.5 3984.08 1.67936e+07 4432.5 20709.2 21069 17629.6 17616.8 11600.9 42890.9 1.0618e+06 1.05664e+06 8153.94 1399.29 835816 1.1854e+06 8.16642e+06 3.10656e+07 30745 366
83028 20240322.11 27692 2.30851e+07 0.786739 5528.39 8.59996e+07 13900.8 1.88908e+07 13977.4 1.05021e+07 15498.5 1.46964e+07 1363.7 1.25993e+07 6797.9 1.88908e+07 6885.5 6.30784e+06 5756.57 1.67936e+07 17295.9 67943.8 5440.95 1.67936e+07 53368.8 56110.7 62452.1 3952.9 1.67936e+07 4426.2 21072 21721.7 17573.9 17149 11633.8 45247.5 1.01989e+06 1.16131e+06 7870.69 1403.37 826657 1.18227e+06 8.17001e+06 3.10609e+07 29497 374
83075 20240325.9 27592.1 2.51822e+07 0.777781 5598.84 8.59996e+07 13848.8 1.88908e+07 13996.7 1.05021e+07 15392.6 1.46964e+07 1356.8 1.25993e+07 6850.45 1.88908e+07 6933.6 6.30784e+06 5771.89 1.67936e+07 17111.8 92049.2 5426.77 1.67936e+07 50328.8 54004.7 59968.3 3782.41 1.67936e+07 4279.8 17295.7 21003.1 17407.6 17504.3 11543.9 44061.4 1.01698e+06 1.14469e+06 7576.94 1399.04 834313 1.18306e+06 8.15381e+06 3.15952e+07 30222 374
83097 20240325.17 27737.4 2.30851e+07 0.811724 5551.44 8.59996e+07 13866 1.88908e+07 13969.6 1.05021e+07 15283.2 1.25993e+07 1359.4 1.05021e+07 6803.62 1.88908e+07 6892.7 6.30784e+06 5791.32 1.67936e+07 17148.4 79563.9 5465.92 1.67936e+07 52877.7 56718.3 62257.9 3972.37 1.67936e+07 4459.3 21024.6 20727.5 17652.1 17131.4 11757.9 40610.5 1.05831e+06 1.1084e+06 7883.06 1398.86 841684 1.17933e+06 8.12434e+06 3.08415e+07 29938 377
83108 20240325.20 27653.5 2.51822e+07 0.816276 5004.39 8.59996e+07 13796.4 1.88908e+07 13646.8 1.05021e+07 14919.6 1.46964e+07 1356.4 1.25993e+07 6715.53 1.88908e+07 6823.7 6.30784e+06 5513.68 1.67936e+07 17273.3 76019.9 5485.08 1.67936e+07 53403.3 57407.9 62082.9 3838.74 1.67936e+07 4470.1 21064.6 21071.3 17750.5 17316.2 11737.3 43047 1.01667e+06 1.17925e+06 7419.23 1385.31 839891 1.18654e+06 8.15416e+06 3.23544e+07 31523 385

mku-coverage

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor pi_basic_mt_virtual_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem tpcc_virtual_cft^ ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem pi_basic_js_virtual_cft^ pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem hist_sgx_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem KV ser (/s)^ KV deser (/s)^ KV snap ser (/s)^ KV snap deser (/s)^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean
83114 20240325.21 27450.9 2.51822e+07 0.807957 80920.6 5607.29 8.59996e+07 17425.7 52887.7 57407.3 61575.7 13922.4 1.88908e+07 4445.4 13968.5 1.05021e+07 15381.8 1.46964e+07 20997.5 21036.2 17406.5 17213.8 11758.8 1371.7 1.25993e+07 6821.02 1.88908e+07 6999.5 6.30784e+06 5767.06 1.67936e+07 40362.6 5482.6 1.67936e+07 3989.99 1.67936e+07 1.01636e+06 1.13999e+06 7702.65 1397.51 819309 1.1819e+06 8.13848e+06 3.09324e+07 28917 377

images

@achamayou achamayou marked this pull request as ready for review March 25, 2024 21:59
@achamayou achamayou requested a review from a team March 25, 2024 21:59
@achamayou achamayou enabled auto-merge (squash) March 25, 2024 22:00
@achamayou achamayou merged commit a078fc9 into main Mar 25, 2024
34 of 40 checks passed
@achamayou achamayou deleted the mku-coverage branch March 25, 2024 22:10
@maxtropets maxtropets mentioned this pull request Jul 17, 2024
6 tasks
@lemmy lemmy restored the mku-coverage branch July 17, 2024 16:58
@lemmy lemmy deleted the mku-coverage branch July 17, 2024 16:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tla TLA+ specifications
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants