Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add endpoint to get previous service identity #3880

Merged
merged 38 commits into from
Jun 8, 2022

Conversation

eddyashton
Copy link
Member

@eddyashton eddyashton commented May 23, 2022

Adds a /node/network/previous_identity endpoint. This only works in a node started as Recover, and reads the identity-of-the-previous-service passed to this node on startup. That's simpler than writing it to the KV to be shared to all nodes, and reasoning about the edge cases that introduces (nodes having the wrong value while they're catching up).

EDIT - This is now written to the KV in the recovery-genesis transaction, so can be read by all nodes. Also tested in e2e recovery tests.

Resolves #3879.

@ghost
Copy link

ghost commented May 23, 2022

prev_ident_endpoint@46279 aka 20220608.15 vs main ewma over 20 builds from 46009 to 46221

Click to see table

main

build_id build_number tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_v8_sgx_cft^ ls_v8_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_full_v8_sgx_cft^ ls_full_v8_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem hist_sgx_cft^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
46009 20220527.16 6384.44 8.40213e+07 19299.7 1.69124e+07 5559.13 1.53396e+07 2546.58 1.00967e+07 1649.88 1.63189e+08 2150.01 9.04813e+06 1431.87 9.66042e+07 1975.77 8.78598e+06 21356.5 884125 1.34409e+06 9.30905e+06 3.64413e+07
46021 20220530.3 6281.14 8.45456e+07 19398.7 1.58639e+07 5548.97 1.50774e+07 2549.8 1.00967e+07 1606.58 1.62927e+08 2114.72 9.04813e+06 1415.48 9.81771e+07 1963.82 8.78598e+06 17355.6 897414 1.37017e+06 9.41168e+06 3.65062e+07
46028 20220531.1 6202.02 8.42835e+07 19423.6 1.58639e+07 5622.38 1.56017e+07 2554.12 1.00967e+07 1640.06 1.62927e+08 2123.97 9.04813e+06 1425.91 9.81771e+07 1976.01 8.52384e+06 17638.5 907226 1.37291e+06 9.23758e+06 3.56168e+07
46053 20220531.12 6277.65 8.37592e+07 19305.1 1.66503e+07 5607.49 1.50774e+07 2553.45 1.00967e+07 1619.13 1.63189e+08 2121.98 9.04813e+06 1445.65 9.81771e+07 1977.24 8.78598e+06 18358.9 898718 1.3836e+06 9.29641e+06 3.56794e+07
46061 20220531.15 6212.09 8.42835e+07 19348.5 1.58639e+07 5534.74 1.53396e+07 2557.32 1.00967e+07 1601.94 1.62665e+08 2151.53 9.04813e+06 1433.1 9.76528e+07 1932.45 8.52384e+06 17481.5 903912 1.37422e+06 9.33025e+06 3.5993e+07
46071 20220531.19 6251.84 8.37592e+07 19335.7 1.58639e+07 5589.29 1.53396e+07 2553 1.00967e+07 1611.55 1.63713e+08 2118.64 9.04813e+06 1423.03 9.81771e+07 1927.34 8.52384e+06 19173.5 910459 1.37311e+06 9.22514e+06 3.58036e+07
46080 20220601.2 6105.77 8.32349e+07 19146.6 1.6126e+07 5499.08 1.56017e+07 2584.49 1.00967e+07 1606.6 1.62927e+08 2112.7 9.04813e+06 1412.46 9.79149e+07 1872.19 8.78598e+06 19245.4 898011 1.37913e+06 9.26697e+06 3.58675e+07
46084 20220601.4 6390.33 8.32349e+07 19497.8 1.58639e+07 5623.14 1.53396e+07 2551.71 1.00967e+07 1645.66 1.63975e+08 2114.34 9.31027e+06 1441.88 9.81771e+07 1914.87 8.78598e+06 18681.5 901921 1.3666e+06 9.17555e+06 3.58042e+07
46092 20220602.2 6302.97 8.45456e+07 19323.7 1.66503e+07 5429.06 1.50774e+07 2549.06 1.00967e+07 1618.24 1.6083e+08 2112.71 1.08831e+07 1432.58 9.87014e+07 1926.43 8.78598e+06 19114.8 892882 1.371e+06 9.3945e+06 3.63121e+07
46098 20220603.2 6151.82 8.40213e+07 19510.9 1.66503e+07 5639.79 1.53396e+07 2550.33 1.00967e+07 1648.66 1.63451e+08 2120.96 9.04813e+06 1330.36 9.76528e+07 1892.4 8.78598e+06 18327.5 882296 1.38237e+06 9.22518e+06 3.55556e+07
46109 20220606.3 6150.22 8.37592e+07 18992.9 1.66503e+07 5459.29 1.53396e+07 2516.69 1.00967e+07 1617.18 1.63713e+08 2107.1 9.04813e+06 1421.74 9.84392e+07 1934.65 8.78598e+06 19236.8 899147 1.36206e+06 9.0299e+06 3.65708e+07
46130 20220606.13 6195.01 8.3497e+07 19332.4 1.58639e+07 5528.77 1.53396e+07 2547.37 1.00967e+07 1639.27 1.61092e+08 2117.65 9.04813e+06 1474.03 9.87014e+07 1930.45 8.78598e+06 19137.6 891985 1.36889e+06 9.13059e+06 3.58669e+07
46141 20220606.17 6321.38 8.3497e+07 19137.1 1.58639e+07 5588.34 1.53396e+07 2538.36 1.00967e+07 1635.24 1.63451e+08 2108.33 9.04813e+06 1437.13 9.81771e+07 1962.54 8.78598e+06 17404.1 910418 1.38809e+06 9.2335e+06 3.59298e+07
46150 20220606.20 6169.07 8.45456e+07 19462.5 1.6126e+07 5607.97 1.53396e+07 2494.82 1.32424e+07 1602.06 1.63451e+08 2154.43 1.29803e+07 1425.44 9.79149e+07 1925.96 1.08831e+07 17343.5 909731 1.37173e+06 9.22518e+06 3.54939e+07
46155 20220606.22 6181.84 8.45456e+07 19509.4 1.6126e+07 5470 1.50774e+07 2537.33 1.00967e+07 1610.1 1.62665e+08 2122.78 9.04813e+06 1435.25 9.76528e+07 2013.72 8.78598e+06 17527.2 903830 1.37347e+06 9.25851e+06 3.58042e+07
46167 20220607.2 6370.56 8.32349e+07 19224.6 1.6126e+07 5614.33 1.53396e+07 2493.83 1.00967e+07 1632.62 1.63451e+08 2127.54 9.04813e+06 1437.13 9.81771e+07 2016.21 8.78598e+06 20351.1 900134 1.3755e+06 9.28794e+06 3.58042e+07
46175 20220607.6 6298.77 8.32349e+07 19552.4 1.56017e+07 5599.87 1.56017e+07 2487.18 1.00967e+07 1639.24 1.63451e+08 2122.72 9.04813e+06 1442.42 9.84392e+07 1931.86 9.04813e+06 17674.3 902282 1.37422e+06 9.28798e+06 3.58669e+07
46187 20220607.12 6058.18 8.32349e+07 19682.6 1.6126e+07 5292.73 1.53396e+07 2611.18 1.00967e+07 1636.19 1.6083e+08 2045.57 9.04813e+06 1392.74 9.79149e+07 1956.27 8.78598e+06 17666.4 903237 1.36152e+06 9.22523e+06 3.56794e+07
46197 20220607.15 6307.86 8.42835e+07 19233.5 1.58639e+07 5632.89 1.53396e+07 2546.61 1.00967e+07 1641.41 1.61354e+08 2112.15 9.04813e+06 1435.36 9.81771e+07 1922.15 8.78598e+06 17396.1 876482 1.35485e+06 9.04586e+06 3.5189e+07
46221 20220608.3 6461.37 8.42835e+07 19609.1 1.63882e+07 5641.36 1.53396e+07 2560.87 1.00967e+07 1655.05 1.62665e+08 2117.16 9.31027e+06 1454.25 9.87014e+07 1977.92 8.52384e+06 19859.5 911109 1.36678e+06 9.21688e+06 3.58042e+07

prev_ident_endpoint

build_id build_number tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_v8_sgx_cft^ ls_v8_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_full_v8_sgx_cft^ ls_full_v8_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem hist_sgx_cft^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
45976 20220527.5 6387.63 8.42835e+07 19094.5 1.63882e+07 5570.74 1.53396e+07 2543.2 1.00967e+07 1642.15 1.62927e+08 2112.31 9.04813e+06 1441.79 9.87014e+07 1973.2 8.52384e+06 19501.6 908198 1.36888e+06 9.21684e+06 3.55556e+07
45986 20220527.8 6195.03 8.42835e+07 19819.1 1.6126e+07 5588.47 1.56017e+07 2537.68 1.00967e+07 1639.73 1.6083e+08 2074.18 9.04813e+06 1443.32 9.76528e+07 1974.24 8.78598e+06 18626.9 887804 1.37643e+06 9.27952e+06 3.54939e+07
46139 20220606.16 6294.78 8.40213e+07 19442.6 1.66503e+07 5518.29 1.58639e+07 2592.11 9.83456e+06 1659.22 1.63713e+08 2112.4 9.04813e+06 1420.39 9.84392e+07 1970.59 8.52384e+06 19023.8 913307 1.36451e+06 9.20863e+06 3.59298e+07
46148 20220606.19 6273.7 8.45456e+07 19431.2 1.63882e+07 5590.18 1.53396e+07 2534 1.00967e+07 1634.05 1.63451e+08 2024.14 9.04813e+06 1436.14 9.79149e+07 1921.45 8.52384e+06 19728.4 908200 1.40891e+06 9.42905e+06 3.54939e+07
46279 20220608.15 6318.89 8.45456e+07 19488.7 1.63882e+07 5613.35 1.53396e+07 2538.49 1.00967e+07 1664.33 1.63713e+08 2121.15 9.04813e+06 1445.82 9.79149e+07 1972.12 8.78598e+06 19554.4 911392 1.39632e+06 9.48139e+06 3.57417e+07

images

@eddyashton eddyashton marked this pull request as ready for review May 24, 2022 13:21
@eddyashton eddyashton requested a review from a team May 24, 2022 13:21
@eddyashton eddyashton enabled auto-merge (squash) May 24, 2022 14:10
@eddyashton eddyashton disabled auto-merge May 24, 2022 17:32
@eddyashton eddyashton marked this pull request as draft May 24, 2022 17:33
@eddyashton
Copy link
Member Author

@jumaffre and I noticed some other issues around this, so I'm fixing those as well before merging.

@eddyashton eddyashton marked this pull request as ready for review May 25, 2022 12:44
@eddyashton eddyashton added the 2.x-todo PRs which should be backported to 2.x label May 25, 2022
CHANGELOG.md Outdated Show resolved Hide resolved
@achamayou achamayou enabled auto-merge (squash) June 8, 2022 20:11
@achamayou achamayou merged commit 45b32a3 into microsoft:main Jun 8, 2022
eddyashton added a commit to eddyashton/CCF that referenced this pull request Jun 9, 2022
@shokouedamsr shokouedamsr added the backported This PR was successfully backported to LTS branch label Dec 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.x-todo PRs which should be backported to 2.x backported This PR was successfully backported to LTS branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add an endpoint that returns the previous service identity
4 participants