Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discard malformed traffic sent to node-to-node ports #5889

Merged
merged 11 commits into from
Jan 9, 2024

Conversation

eddyashton
Copy link
Member

Response to #5882.

Catch errors from malformed traffic, and close the sending TCP channel.

There may be some missed cases here, as we don't have exhaustive testing or fuzzing.

Also, some of this traffic that looks plausible enough to reach the enclave will still result in [fail] messages which were previously present (eg - "Exception in recv_key_exchange_message"), whereas the newly dropped cases are only logged at [debug]. I've not dropped the verbosity of those existing messages now, though we may want to in future; for parity with the equivalent logging on the RPC ports, where we don't want random internet probing to result in worrying logs on running services.

@eddyashton eddyashton requested a review from a team January 5, 2024 13:36
@achamayou achamayou added auto-backport Automatically backport this PR to LTS branch 4.x-todo PRs which should be backported to 4.x labels Jan 5, 2024
@ghost
Copy link

ghost commented Jan 5, 2024

node_to_node_robustness@80008 aka 20240108.24 vs main ewma over 20 builds from 79750 to 80001

Click to see table

main

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem tlc_3node_fixed_duration_s tlc_3node_fixed_states tlc_atomic_reconfig_duration_s tlc_atomic_reconfig_states tlc_reconfig_duration_s tlc_reconfig_states hist_sgx_cft^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ pi_basic_mt_virtual_cft^ tpcc_virtual_cft^ ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ tlc_sim_traces tlc_sim_levelmean
79750 20231227.1 27885.2 2.51822e+07 0.818602 5599.89 8.59996e+07 14026.9 1.67936e+07 14100 1.05021e+07 15563.2 1.25993e+07 1425.9 1.25993e+07 6848.41 1.67936e+07 6932.3 6.30784e+06 5796.65 1.67936e+07 5448.92 1.67936e+07 3976.43 1.67936e+07 6 86496 430 1.2541e+07 242 6.31473e+06 45579.1 838072 1.18283e+06 8.15446e+06 3.07475e+07 87959.6 17400.9 53080.8 56737.9 61924.4 4624.8 20931.4 18203 20610 17300.9 11921.8 2258 403
79764 20231228.1 28069.2 2.30851e+07 0.785802 5579.3 8.59996e+07 14013.7 1.88908e+07 14133.7 1.05021e+07 15558.2 1.25993e+07 1426 1.25993e+07 6801.15 1.67936e+07 7035 6.30784e+06 5760.56 1.67936e+07 5478.71 1.67936e+07 3992.59 1.67936e+07 6 86496 434 1.2541e+07 235 6.31473e+06 47564.7 832827 1.17369e+06 8.16737e+06 3.1373e+07 100210 17482.4 52691.7 56538.7 62169.5 4606.1 21182.6 22162.1 17804.6 17513 11666.7 2144 403
79781 20231229.2 27896.7 2.51822e+07 0.801636 5589.66 8.59996e+07 14027.6 1.88908e+07 14166.7 1.05021e+07 15567.2 1.46964e+07 1425.2 1.25993e+07 6793.52 1.67936e+07 7078.9 6.30784e+06 5797.56 1.67936e+07 5483.48 1.67936e+07 3993.74 1.67936e+07 6 86496 436 1.2541e+07 240 6.31473e+06 40847.4 834593 1.18035e+06 8.15979e+06 3.07217e+07 70323.6 17379.6 53058 56634.4 62290.7 4544.7 21324.7 22159.2 17388.8 17492.5 11838.8 2181 403
79795 20240101.3 28203.3 2.51822e+07 0.78501 5573.08 8.59996e+07 14058.6 1.88908e+07 14075.3 1.05021e+07 15400.4 1.25993e+07 1433.5 1.25993e+07 6907.22 1.88908e+07 6981.9 6.30784e+06 5797.99 1.67936e+07 5721.54 1.67936e+07 3992.77 1.67936e+07 7 86496 437 1.2541e+07 244 6.31473e+06 45491.3 828138 1.18098e+06 8.16847e+06 3.08021e+07 88523 17464.7 53125.1 57116.7 61313 4568.7 20746.1 22281.6 17744.9 17841.4 11654.5 2254 403
79809 20240102.3 27998 2.51822e+07 0.818907 5582.58 8.59996e+07 14069 1.88908e+07 14207.7 1.05021e+07 15632.9 1.46964e+07 1438 1.25993e+07 7254.86 1.67936e+07 6979.5 6.30784e+06 5809.21 1.67936e+07 5725.47 1.88908e+07 4000.63 1.67936e+07 6 86496 427 1.2541e+07 241 6.31473e+06 39813.8 838128 1.18558e+06 8.15241e+06 3.07577e+07 89517.2 17426.2 52688.3 56487.3 62076.8 4588.5 20938.1 21383.1 17806.2 17373.5 11613.7 2304 403
79821 20240102.7 28223.4 2.30851e+07 0.812237 5591.2 8.59996e+07 14003.1 1.88908e+07 14188.3 1.05021e+07 15498.1 1.46964e+07 1429.2 1.25993e+07 7246.07 1.67936e+07 6934.2 6.30784e+06 5809.09 1.67936e+07 5478.56 1.67936e+07 4007.06 1.67936e+07 7 86496 446 1.2541e+07 237 6.31473e+06 40366 832255 1.17903e+06 8.15355e+06 3.03592e+07 100850 17312.2 53352.6 57235.7 62129.2 4590.4 21078.7 22285.6 20842.2 17429 11612.2 2331 403
79832 20240102.10 27705.2 2.51822e+07 0.780568 5592.62 8.59996e+07 14075.6 1.88908e+07 14247 1.05021e+07 15580.2 1.46964e+07 1429.8 1.25993e+07 6842.56 1.67936e+07 7079.5 6.30784e+06 5781.21 1.67936e+07 5767.74 1.67936e+07 3982.1 1.67936e+07 6 86496 424 1.2541e+07 245 6.31473e+06 42743.5 823735 1.18304e+06 8.15511e+06 3.0778e+07 90345.4 17247.1 52935.7 56910 62683.8 4647.1 20739.3 20193.9 20729.9 17575.8 11690.8 2301 403
79836 20240103.1 28173 2.51822e+07 0.8277 5617.23 8.59996e+07 14088.9 1.88908e+07 14246.2 1.05021e+07 15684.4 1.46964e+07 1430.6 1.25993e+07 7262.76 1.67936e+07 6980.2 6.30784e+06 5814.99 1.67936e+07 5465.89 1.88908e+07 3973.9 1.67936e+07 6 86496 417 1.2541e+07 238 6.31473e+06 43365.4 827987 1.18005e+06 8.16857e+06 3.13533e+07 68113.2 17163.7 52985.4 57238.7 62511.8 4622.6 20776.5 21693.9 20385 17974.8 11889.2 2109 403
79850 20240104.1 28107.5 2.51822e+07 0.774183 5647.78 8.59996e+07 14069.1 1.88908e+07 14203.3 1.05021e+07 15616.9 1.25993e+07 1430.7 1.25993e+07 7263.29 1.67936e+07 7142 6.30784e+06 5808.21 1.67936e+07 5739.03 1.88908e+07 4019.28 1.67936e+07 6 86496 447 1.2541e+07 239 6.31473e+06 45361.8 833007 1.17531e+06 8.1401e+06 3.07056e+07 88847.3 17222.5 53076.9 56886.7 62583 4618.3 20820.4 21956.8 17246.1 17545.1 11727 2277 403
79858 20240104.5 28151.4 2.30851e+07 0.762951 5612.73 8.59996e+07 14105.1 1.88908e+07 14237.6 1.05021e+07 15657.2 1.46964e+07 1437 1.05021e+07 7259.07 1.88908e+07 6983.6 6.30784e+06 5791.47 1.67936e+07 5734.66 1.67936e+07 4001.19 1.67936e+07 6 86496 420 1.2541e+07 238 6.31473e+06 46312.7 832473 1.18246e+06 8.14589e+06 3.0464e+07 72092.6 17237.2 53156.1 56700.3 62251.6 4624.7 20802.9 22305.5 17912 17600.9 12005.6 2357 403
79876 20240104.10 27983.2 2.51822e+07 0.770841 5617.52 8.59996e+07 14034.5 1.67936e+07 14165.8 1.05021e+07 15592.9 1.25993e+07 1427.3 1.25993e+07 7241.98 1.67936e+07 6915.4 6.30784e+06 5771.22 1.67936e+07 5737.28 1.67936e+07 3985.63 1.67936e+07 6 86496 429 1.2541e+07 234 6.31473e+06 40222.9 829045 1.18083e+06 8.15014e+06 3.10298e+07 82253.2 17196.9 53164.5 56410.8 62397 4645.9 20949.8 22178.9 17324.7 17551.5 11659.7 2315 403
79893 20240105.3 28242.6 2.30851e+07 0.770387 5619.63 8.59996e+07 14091.5 1.88908e+07 14247.6 1.05021e+07 15674.3 1.25993e+07 1436.8 1.25993e+07 7241.21 1.67936e+07 7028.1 6.30784e+06 5776.46 1.67936e+07 5739.53 1.67936e+07 4001.54 1.67936e+07 6 86496 438 1.2541e+07 234 6.31473e+06 41192.1 834184 1.18333e+06 8.13454e+06 3.07928e+07 79459.2 17195.7 53109.3 56423.9 61913.6 4637.7 21053.6 21897.2 17479.2 17489.6 11786.3 2312 403
79901 20240105.6 28134.7 2.51822e+07 0.804442 5625.32 8.59996e+07 14099 1.88908e+07 14266.8 1.05021e+07 15657.8 1.46964e+07 1428.6 1.25993e+07 6896.08 1.67936e+07 7033.2 6.30784e+06 5807.41 1.67936e+07 5744.67 1.88908e+07 4003.65 1.67936e+07 6 86496 445 1.2541e+07 240 6.31473e+06 42166 837682 1.17356e+06 8.14881e+06 3.18111e+07 96416.1 17253.5 52754.9 54886.9 61431.1 4615.1 20971.5 21889.5 17410.2 17219.9 11532.7 2258 403
79920 20240105.14 28090.3 2.51822e+07 0.804667 5642.82 8.59996e+07 14097.8 1.88908e+07 14249.7 1.05021e+07 15643 1.46964e+07 1426.1 1.25993e+07 6883.92 1.88908e+07 6976.3 6.30784e+06 5819.57 1.67936e+07 5767.4 1.67936e+07 3983.21 1.67936e+07 6 86496 434 1.2541e+07 235 6.31473e+06 42864.9 816929 1.18007e+06 8.14615e+06 3.06564e+07 72389.5 17195.4 53484.4 56927.5 63034.1 4635.9 20600.9 21708 20208.9 17600.9 11868.5 2325 403
79931 20240105.18 28155.9 2.51822e+07 0.830304 5572.38 8.59996e+07 14067.9 1.67936e+07 14143.9 1.05021e+07 15609.5 1.25993e+07 1433 1.25993e+07 6844.24 1.67936e+07 6937.8 6.30784e+06 5775.62 1.67936e+07 5454.13 1.67936e+07 3990.64 1.67936e+07 6 86496 436 1.2541e+07 236 6.31473e+06 41115.6 835630 1.17185e+06 8.15319e+06 3.14385e+07 78451.8 17203.8 53081 57491.7 63657.6 4644.3 20979.1 21753.3 20837.9 17426.7 11781.2 2224 403
79937 20240105.20 28053.5 2.51822e+07 0.788583 5577.35 8.59996e+07 14052.4 1.88908e+07 14109.9 1.05021e+07 15547.2 1.46964e+07 1435.2 1.25993e+07 7233.07 1.67936e+07 6844.1 6.30784e+06 5802.33 1.67936e+07 5491.67 1.67936e+07 3998.46 1.67936e+07 6 77678 366 1.14441e+07 223 5.86578e+06 47083.7 832419 1.18053e+06 8.15387e+06 3.21896e+07 85420.8 17208.8 56022.5 56925.6 63903.6 4666.7 20742.8 21552.2 20961.9 17614 11908.4 2256 403
79954 20240108.2 28237 2.30851e+07 0.811783 5591.06 8.59996e+07 14064.6 1.88908e+07 14197.4 1.05021e+07 15540.4 1.46964e+07 1431.6 1.25993e+07 7263.29 1.67936e+07 7083.5 6.30784e+06 5819.68 1.67936e+07 5772.06 1.67936e+07 4006.27 1.67936e+07 6 77678 393 1.14441e+07 225 5.86578e+06 41219.2 823934 1.18456e+06 8.13305e+06 3.08225e+07 99047.8 17316.8 53076.6 55248.3 60320.6 4528.2 20993.9 21334.7 17858.4 17621.1 11538.3 2191 403
79961 20240108.5 27925.4 2.51822e+07 0.812651 5643.13 8.59996e+07 14080.8 1.67936e+07 14230.5 1.05021e+07 15627.5 1.25993e+07 1428.6 1.25993e+07 7265.93 1.67936e+07 6978.2 6.30784e+06 5819.84 1.67936e+07 5491.66 1.88908e+07 3978.52 1.67936e+07 5 77678 377 1.14441e+07 219 5.86578e+06 43913.1 834677 1.17721e+06 8.13573e+06 3.1303e+07 85416 17247.2 53409.5 56958 63490.4 4632.7 20797.7 22702.5 20869.2 17815.9 11888.8 2280 403
79989 20240108.17 28271 2.51822e+07 0.812918 5581.25 8.59996e+07 14031.6 1.67936e+07 14136.4 1.05021e+07 15523.6 1.46964e+07 1415.9 1.25993e+07 7249.22 1.67936e+07 6933.6 6.30784e+06 5811.81 1.67936e+07 5488.58 1.67936e+07 3984.32 1.67936e+07 6 77678 392 1.14441e+07 220 5.87421e+06 45321.3 831008 1.18097e+06 8.15374e+06 3.08415e+07 78403.9 17262.7 52887.3 55918.4 62745.3 4610.5 20923.3 22286.1 20921.3 17621.5 11740.7 2380 403
80001 20240108.22 28214.4 2.30851e+07 0.786976 5635.92 8.59996e+07 14107 1.67936e+07 14229 1.05021e+07 15650.3 1.25993e+07 1429.2 1.05021e+07 7261.71 1.67936e+07 7084.9 6.30784e+06 5822.41 1.67936e+07 5738.66 1.67936e+07 3986.1 1.67936e+07 6 77678 147 3.90715e+06 144 3.83177e+06 45877 835642 1.18258e+06 8.17072e+06 3.06881e+07 82485.2 17220.1 52740.1 56590.9 62501.5 4637.4 20710.5 21594.5 20773 17397.2 11679.9 2749 403

node_to_node_robustness

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem tpcc_virtual_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ pi_basic_mt_virtual_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ tlc_3node_fixed_duration_s tlc_3node_fixed_states tlc_atomic_reconfig_duration_s tlc_atomic_reconfig_states tlc_reconfig_duration_s tlc_reconfig_states ls_js_jwt_virtual_cft^ hist_sgx_cft^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean
79917 20240105.12 27904.8 2.51822e+07 0.795989 5600.75 8.59996e+07 14078.9 1.88908e+07 14136.6 1.05021e+07 15695.5 1.25993e+07 1439 1.25993e+07 7235.96 1.67936e+07 7152.5 6.30784e+06 5780.6 1.67936e+07 17247 5727.43 1.67936e+07 52743.7 58673.4 61923.1 88967.3 4005.07 1.67936e+07 4610.5 20853.7 22083.3 17585 17506.4 6 86496 426 1.2541e+07 230 6.31473e+06 11673 40987.8 834880 1.17989e+06 8.12956e+06 3.06037e+07 2382 403
79925 20240105.15 28000.6 2.30851e+07 0.789486 5597 8.59996e+07 14036.8 1.88908e+07 14186.5 1.05021e+07 15584.9 1.46964e+07 1439.8 1.25993e+07 6846.32 1.67936e+07 7138.9 6.30784e+06 5802.2 1.67936e+07 17124.3 5720.55 1.88908e+07 53050.3 56942.4 61825.3 95985.9 4001.42 1.67936e+07 4679.6 20953.8 21506.3 17328.4 17411.2 6 86496 414 1.2541e+07 234 6.31473e+06 11762.1 46787 829608 1.17975e+06 8.10534e+06 3.07291e+07 2278 403
79988 20240108.16 28344.2 2.30851e+07 0.822999 5633.72 8.59996e+07 14056.8 1.88908e+07 14193.6 1.05021e+07 15631.8 1.25993e+07 1427.8 1.25993e+07 6822.49 1.67936e+07 7022 6.30784e+06 5795.46 1.67936e+07 17349.3 5743.53 1.67936e+07 52877.2 57110.2 62750.1 73731.5 4002.95 1.67936e+07 4674.5 20843.8 22304 20940.3 17630.8 6 77678 387 1.14441e+07 219 5.86578e+06 11682.8 43791.6 823803 1.17912e+06 8.15494e+06 3.06738e+07 2259 403
80008 20240108.24 27906 2.51822e+07 0.812311 5675.3 8.59996e+07 14076.5 1.88908e+07 14169.9 1.05021e+07 15664.5 1.25993e+07 1431.1 1.25993e+07 6830.27 1.67936e+07 6924.6 6.30784e+06 5769.46 1.67936e+07 17791.4 5721.79 1.67936e+07 53200.6 57954.9 62974.2 71028.7 4000.06 1.67936e+07 4671.8 20969.8 22304 20916.3 17265 6 77678 150 3.90715e+06 146 3.83177e+06 11751 41991.8 835918 1.18141e+06 8.1542e+06 3.08304e+07 2589 403

images

@achamayou achamayou merged commit e618e51 into microsoft:main Jan 9, 2024
22 checks passed
@ghost
Copy link

ghost commented Jan 9, 2024

💔 All backports failed

Status Branch Result
release/4.x Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

backport --pr 5889

Questions ?

Please refer to the Backport tool documentation and see the Github Action logs for details

achamayou pushed a commit to achamayou/CCF that referenced this pull request Jan 9, 2024
(cherry picked from commit e618e51)

# Conflicts:
#	CHANGELOG.md
@achamayou achamayou added the backported This PR was successfully backported to LTS branch label Jan 9, 2024
achamayou added a commit that referenced this pull request Jan 9, 2024
ghost pushed a commit that referenced this pull request Jan 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
4.x-todo PRs which should be backported to 4.x auto-backport Automatically backport this PR to LTS branch backported This PR was successfully backported to LTS branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants