Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retain old JWT paths for LTS tests #5711

Merged
merged 2 commits into from
Oct 4, 2023

Conversation

eddyashton
Copy link
Member

Broke this in #5698, noticed while trying to cut a new dev release.

@eddyashton eddyashton requested a review from a team October 4, 2023 16:07
@ghost
Copy link

ghost commented Oct 4, 2023

retain_lts_jwt_path@76910 aka 20231004.39 vs main ewma over 20 builds from 76454 to 76888

Click to see table

main

build_id build_number Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem tpcc_virtual_cft^ pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ pi_basic_mt_virtual_cft^ ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ ls_js_sgx_cft^ ls_js_sgx_cft_mem pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem hist_sgx_cft^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
76454 20230926.16 0.815815 5553.02 8.59996e+07 28221 2.30851e+07 14020.3 1.88908e+07 14156.6 1.05021e+07 15565.7 1.25993e+07 17322.7 1421 1.25993e+07 45821.2 47714.7 53470.9 65869.4 6870.1 1.88908e+07 6932 6.30784e+06 4436.9 17347.5 5804.52 1.67936e+07 19578.3 17671.1 5713.04 1.67936e+07 15008.7 9991.23 4005.46 1.67936e+07 47071.2 792004 1.17574e+06 8.15394e+06 3.15533e+07
76474 20230927.1 0.766724 5608.81 8.59996e+07 27575.6 2.30851e+07 14057 1.88908e+07 14233.1 1.05021e+07 15637.3 1.46964e+07 17281.2 1437 1.25993e+07 45879.6 47971.1 53380.4 69514.1 6861.92 1.67936e+07 6967.8 6.30784e+06 4463 17307.8 5795.6 1.67936e+07 19704 17087.1 5771.67 1.67936e+07 14716.8 9919.16 3999.03 1.67936e+07 45630.4 831956 1.17776e+06 8.15585e+06 3.07203e+07
76488 20230927.7 0.790189 5550.33 8.59996e+07 28284.8 2.30851e+07 13976.3 1.88908e+07 14123.5 1.05021e+07 15542.1 1.25993e+07 17354.7 1436.7 1.25993e+07 45823.4 47430.7 54927.3 63452.7 7237.01 1.67936e+07 6956.7 6.30784e+06 4447.6 17260.7 5812.98 1.67936e+07 19870.8 17176.1 5448.81 1.67936e+07 14914.4 9796.07 3998.52 1.67936e+07 41180.1 831215 1.18125e+06 8.14751e+06 3.09361e+07
76520 20230928.1 0.811302 5528.73 8.59996e+07 27622.7 2.30851e+07 13953 1.88908e+07 13992.5 1.05021e+07 15250 1.46964e+07 17264.1 1419.2 1.25993e+07 45732.8 47735.2 54858.6 65695.6 6863.35 1.88908e+07 6818.3 6.30784e+06 4433.4 17130.3 5785.81 1.67936e+07 19066.5 16924.4 5461.2 1.67936e+07 16923.5 9805.85 3978.65 1.67936e+07 42824 831666 1.18348e+06 8.15342e+06 3.10661e+07
76543 20230928.11 0.803093 5559.9 8.59996e+07 27915.4 2.51822e+07 14011.7 1.88908e+07 13946.2 1.05021e+07 15425.8 1.46964e+07 17380.6 1423.5 1.25993e+07 45620.7 47866.8 54588.7 72582.5 6834.74 1.88908e+07 6929.7 6.30784e+06 4463.5 17525.7 5778.19 1.67936e+07 19217.1 16974.1 5724.81 1.88908e+07 16888.9 9918.21 3988.81 1.67936e+07 43403 836597 1.17951e+06 8.15283e+06 3.14936e+07
76558 20230928.18 0.830452 5604.7 8.59996e+07 27885.8 2.30851e+07 14047.9 1.88908e+07 14110.8 1.05021e+07 15503.8 1.25993e+07 17234 1430.7 1.25993e+07 45454.2 47870 54772.5 88575.4 6843.02 1.67936e+07 6962.7 6.30784e+06 4433.7 17341.5 5769.09 1.67936e+07 19225.2 17098.4 5491.12 1.67936e+07 14922.3 9863.52 3993.7 1.67936e+07 42154.9 831276 1.18056e+06 8.13202e+06 3.02641e+07
76583 20230928.28 0.801501 5537.92 8.59996e+07 27848.7 2.51822e+07 13999.1 1.88908e+07 14007.6 1.05021e+07 15378.9 1.46964e+07 17308 1419.9 1.25993e+07 45863.7 47715.4 54659.8 65434.1 6870.19 1.88908e+07 6977.8 6.30784e+06 4426.7 17042.4 5781.9 1.67936e+07 19021.5 17126.6 5471.22 1.67936e+07 16809.9 9867.79 3964.63 1.67936e+07 44707.7 831168 1.17972e+06 8.14965e+06 3.15285e+07
76590 20230928.31 0.776866 5620.03 8.59996e+07 27807.9 2.51822e+07 14032.4 1.88908e+07 14144 1.05021e+07 15646.5 1.46964e+07 17442.6 1431.9 1.25993e+07 45792.5 48114.9 54905.7 84636.6 6892.39 1.88908e+07 7205.4 6.30784e+06 4462.3 17281.7 5782.23 1.67936e+07 19342.4 17404.5 5744.12 1.67936e+07 14968.6 9799.22 4005.35 1.67936e+07 46452.5 830337 1.17868e+06 8.1539e+06 3.27507e+07
76597 20230928.34 0.810287 5572.97 8.59996e+07 27790.7 2.30851e+07 13976.1 1.88908e+07 14061.9 1.05021e+07 15478.4 1.25993e+07 17299.4 1421.7 1.25993e+07 45785.5 47963.7 54568 65237.8 6790.65 1.88908e+07 6979.9 6.30784e+06 4407.2 17445.4 5802.39 1.67936e+07 19516.4 17451.8 5473.96 1.67936e+07 15049.7 9773.48 3989.84 1.67936e+07 44717.7 830892 1.17553e+06 8.13929e+06 3.15329e+07
76603 20230929.1 0.812755 5509.39 8.59996e+07 27929.8 2.30851e+07 13963.9 1.88908e+07 14003.2 1.05021e+07 15460.2 1.25993e+07 17276.6 1421.9 1.25993e+07 43947.2 40355.5 54828.9 74029.2 6808.22 1.88908e+07 6853.3 6.30784e+06 4361.2 17117.4 5760.56 1.67936e+07 19493.2 16917 5446.9 1.67936e+07 14630.2 9936.59 3984.27 1.67936e+07 45786.1 828785 1.17327e+06 8.14904e+06 3.05535e+07
76674 20230929.32 0.824286 5650.04 8.59996e+07 28135.8 2.51822e+07 14044.4 1.88908e+07 14151.8 1.05021e+07 15668.6 1.46964e+07 17258 1441.1 1.25993e+07 44130.7 47868.2 54216.1 79416.4 6848.37 1.88908e+07 7030.2 6.30784e+06 4439.1 17162.5 5779.43 1.67936e+07 19472.3 17470.5 5785.88 1.67936e+07 14776.5 10176.7 4002.96 1.67936e+07 42393.6 834800 1.17705e+06 8.15572e+06 3.08671e+07
76681 20231002.1 0.778316 5610.63 8.59996e+07 27742.7 2.51822e+07 14016.2 1.67936e+07 14116.8 1.05021e+07 15668.2 1.46964e+07 17317.1 1441.3 1.25993e+07 45761.1 47867.7 54907.1 77661.1 7241.2 1.67936e+07 6972.2 6.30784e+06 4426.1 17211.6 5780.61 1.67936e+07 19449.2 17053.9 5740.75 1.67936e+07 14750.7 9744.29 4007.12 1.67936e+07 43611.5 832338 1.182e+06 8.17173e+06 3.15261e+07
76724 20231002.20 0.836357 5500.05 8.59996e+07 27904.4 2.30851e+07 13942.2 1.88908e+07 14010.7 1.05021e+07 15376 1.46964e+07 17138.9 1426.4 1.25993e+07 45994 47515 54332.6 65839 6865.24 1.88908e+07 6825.1 6.30784e+06 4407.9 17567.5 5791.28 1.67936e+07 19677.7 17216.8 5466.41 1.67936e+07 15003.6 9764.04 3982.56 1.67936e+07 38966.2 827863 1.17557e+06 8.17144e+06 3.07438e+07
76730 20231003.1 0.81692 5607.21 8.59996e+07 28013.8 2.51822e+07 14019 1.88908e+07 14147.9 1.05021e+07 15694.6 1.25993e+07 17191.7 1444.4 1.25993e+07 45513.1 48269.1 54442.6 71051.7 6811.01 1.88908e+07 7029 6.30784e+06 4481.1 17361.9 5811.58 1.67936e+07 19564.9 17099.1 5768.4 1.67936e+07 14813.6 9839.85 3971.63 1.67936e+07 45281.2 833206 1.18303e+06 8.14586e+06 3.06784e+07
76737 20231003.4 0.819855 5602.23 8.59996e+07 27593.5 2.30851e+07 14099.4 1.67936e+07 14185.4 1.05021e+07 15720.3 1.46964e+07 17191.7 1442.7 1.25993e+07 45892.7 48119 54628 64150.5 6888.2 1.88908e+07 6947.2 6.30784e+06 4416 17162 5809.12 1.67936e+07 19516.8 17353 5745.68 1.67936e+07 14663.4 9885.05 3987.27 1.67936e+07 45195.8 833711 1.17516e+06 8.15378e+06 3.0875e+07
76798 20231003.31 0.832841 5507.34 8.59996e+07 27510.7 2.51822e+07 13926.2 1.88908e+07 14064.4 1.05021e+07 15503.8 1.25993e+07 17353.1 1426.1 1.25993e+07 45905.3 48154 53871 81597 6835.05 1.88908e+07 6934.2 6.30784e+06 4439.9 17065.3 5797.3 1.67936e+07 19658.3 17561 5480.27 1.67936e+07 15029.1 10165.7 3989.1 1.67936e+07 43728.3 828433 1.17822e+06 8.15582e+06 3.11739e+07
76817 20231004.1 0.780939 5626.78 8.59996e+07 27941.5 2.51822e+07 13971.1 1.88908e+07 14077.8 1.05021e+07 15496.4 1.46964e+07 17068.1 1437 1.05021e+07 43943.3 47753 54465.2 69954.7 7251.7 1.67936e+07 6941.9 6.30784e+06 4457.9 17248 5773.46 1.67936e+07 19168.1 17214.9 5738.5 1.67936e+07 16923.5 9820.54 3993.81 1.67936e+07 41295.8 841933 1.17864e+06 8.15569e+06 3.07938e+07
76832 20231004.7 0.791761 5615.29 8.59996e+07 27629.2 2.30851e+07 13975.4 1.67936e+07 14056.3 1.05021e+07 15601.7 1.25993e+07 17248.6 1434 1.25993e+07 43721.4 48138.9 46993.4 68893.5 6873.72 1.88908e+07 7089.4 6.30784e+06 4444.2 17038.4 5806.39 1.67936e+07 19713.4 17646.2 5726.45 1.67936e+07 14882.5 9901.95 3976.51 1.67936e+07 42527.8 835979 1.17914e+06 8.15303e+06 3.17647e+07
76869 20231004.22 0.806157 5552.49 8.59996e+07 27762.1 2.51822e+07 14003.1 1.88908e+07 14065.4 1.05021e+07 15372.4 1.46964e+07 17245.9 1427 1.25993e+07 45658.4 48077.4 54561.1 70744.9 6868.91 1.88908e+07 7022 6.30784e+06 4464.3 17322.8 5804.63 1.67936e+07 18923.3 17202.1 5756.12 1.67936e+07 15082.4 9913.2 3991.19 1.67936e+07 45382.2 834342 1.18098e+06 8.14978e+06 3.08076e+07
76888 20231004.30 0.810034 5604.3 8.59996e+07 27780.7 2.30851e+07 13985 1.88908e+07 14115.9 1.05021e+07 15556.5 1.46964e+07 17390.9 1434.9 1.25993e+07 45776.9 48301 51883.1 67387.1 6863.79 1.67936e+07 7032.1 6.30784e+06 4390.1 17189.2 5815.76 1.67936e+07 20048.9 15378.1 5751.88 1.67936e+07 14886.4 10356.8 3969.63 1.67936e+07 42002.2 823286 1.18056e+06 8.1555e+06 3.03318e+07

retain_lts_jwt_path

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem pi_basic_mt_virtual_cft^ tpcc_virtual_cft^ ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_js_virtual_cft^ pi_basic_sgx_cft^ pi_basic_sgx_cft_mem ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem hist_sgx_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
76910 20231004.39 27866.8 2.30851e+07 0.80543 5600.88 8.59996e+07 81756 17390 45689.1 48646.4 53321.5 14054.6 1.88908e+07 14145.9 1.05021e+07 4410.8 15609.5 1.25993e+07 17233 19728.1 17096.5 14653.2 10237.3 1440.1 1.25993e+07 6828.64 1.88908e+07 6985 6.30784e+06 5813.07 1.67936e+07 5491.37 1.67936e+07 43783.3 3998.52 1.67936e+07 836422 1.18433e+06 8.15176e+06 3.15781e+07

images

@achamayou achamayou merged commit cf8b57b into microsoft:main Oct 4, 2023
@eddyashton eddyashton added auto-backport Automatically backport this PR to LTS branch 4.x-todo PRs which should be backported to 4.x labels Oct 25, 2023
ghost pushed a commit that referenced this pull request Oct 25, 2023
@ghost ghost added the backported This PR was successfully backported to LTS branch label Oct 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
4.x-todo PRs which should be backported to 4.x auto-backport Automatically backport this PR to LTS branch backported This PR was successfully backported to LTS branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants