{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":682206028,"defaultBranch":"main","name":"esc","ownerLogin":"pulumi","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-08-23T17:10:06.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/21992475?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726607921.0","currentOid":""},"activityList":{"items":[{"before":"8f171f807f52afd2ba8291d8a708f7f3ddb5bb8c","after":"c221cafebd9a147557a7f49c8538ff76c5f29cc4","ref":"refs/heads/pgavlin/eval-load-perf","pushedAt":"2024-09-17T21:27:12.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: parallelize environment loading\n\nThese changes add support for loading environments in parallel.\n\nParallelization is breadth-first, then depth-first. For example, given\nthe following environments:\n\n```yaml\nimports: # env a\n  - b\n  - c\n\n--\nimports; # env b\n  - e\n--\nimports: # env c\n  - f\n  - g\n```\n\nEnvironments `b` and `c` would be loaded in parallel, then environment\n`e` would be loaded, then environments `f` and `g` would be loaded in\nparallel. This simplifies the detection of cyclic imports and the\ncollection of diagnostics.\n\nThis improves performance for scenarios that are dominated by\nenvironment load time (e.g. import graphs with high degrees of fanout).\n\nLocal benchmark results:\n\n```\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    559\t  2016141 ns/op\t2212786 B/op\t  18971 allocs/op\nBenchmarkEval-10           \t    591\t  1987670 ns/op\t2212689 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    614\t  1977314 ns/op\t2212625 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    596\t  1970144 ns/op\t2212937 B/op\t  18971 allocs/op\nBenchmarkEval-10           \t    607\t  1989940 ns/op\t2212754 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    628\t  1934108 ns/op\t2212601 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    574\t  1984031 ns/op\t2212765 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    646\t  1944632 ns/op\t2212531 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    631\t  1954274 ns/op\t2212848 B/op\t  18970 allocs/op\nBenchmarkEval-10           \t    614\t  1906139 ns/op\t2212780 B/op\t  18970 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116069278 ns/op\t2212690 B/op\t  18982 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117032264 ns/op\t2213604 B/op\t  18984 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118545838 ns/op\t2214613 B/op\t  18986 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117469657 ns/op\t2212854 B/op\t  18983 allocs/op\nBenchmarkEvalOpen-10       \t      9\t115962963 ns/op\t2212275 B/op\t  18981 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116431745 ns/op\t2212888 B/op\t  18982 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116677569 ns/op\t2212040 B/op\t  18983 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117092157 ns/op\t2211416 B/op\t  18981 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117164181 ns/op\t2213941 B/op\t  18985 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118046199 ns/op\t2215542 B/op\t  18982 allocs/op\nBenchmarkEvalEnvLoad-10    \t     81\t 15394315 ns/op\t2215076 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     84\t 15028452 ns/op\t2214531 B/op\t  18996 allocs/op\nBenchmarkEvalEnvLoad-10    \t     80\t 14744255 ns/op\t2214963 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     90\t 15100905 ns/op\t2214574 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     84\t 15125639 ns/op\t2215519 B/op\t  18998 allocs/op\nBenchmarkEvalEnvLoad-10    \t     84\t 14868314 ns/op\t2214583 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     81\t 14827542 ns/op\t2214839 B/op\t  18995 allocs/op\nBenchmarkEvalEnvLoad-10    \t     88\t 14948501 ns/op\t2214839 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     88\t 15037255 ns/op\t2215109 B/op\t  18997 allocs/op\nBenchmarkEvalEnvLoad-10    \t     84\t 14695667 ns/op\t2215256 B/op\t  18998 allocs/op\nBenchmarkEvalAll-10        \t      8\t127500182 ns/op\t2214674 B/op\t  19009 allocs/op\nBenchmarkEvalAll-10        \t      8\t127734964 ns/op\t2215176 B/op\t  19006 allocs/op\nBenchmarkEvalAll-10        \t      9\t128855694 ns/op\t2215416 B/op\t  19010 allocs/op\nBenchmarkEvalAll-10        \t      8\t128633870 ns/op\t2215320 B/op\t  19009 allocs/op\nBenchmarkEvalAll-10        \t      9\t129122597 ns/op\t2215123 B/op\t  19007 allocs/op\nBenchmarkEvalAll-10        \t      8\t129013708 ns/op\t2213784 B/op\t  19004 allocs/op\nBenchmarkEvalAll-10        \t      9\t127839343 ns/op\t2214552 B/op\t  19007 allocs/op\nBenchmarkEvalAll-10        \t      9\t129212421 ns/op\t2214800 B/op\t  19006 allocs/op\nBenchmarkEvalAll-10        \t      9\t128671162 ns/op\t2215864 B/op\t  19009 allocs/op\nBenchmarkEvalAll-10        \t      9\t127706639 ns/op\t2214455 B/op\t  19006 allocs/op\n```","shortMessageHtmlLink":"eval: parallelize environment loading"}},{"before":"295af2827c5e5fbf6480bc950f8531c1a85d36c5","after":null,"ref":"refs/heads/pgavlin/eval-perf","pushedAt":"2024-09-17T21:18:41.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"}},{"before":"840f7c03efcc6f879f5c5d5ddaf6e6452fbe18e3","after":"a1203bfcd7359ac93b3b4c6b5b9d06780e76e965","ref":"refs/heads/main","pushedAt":"2024-09-17T21:18:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: performance improvements (#392)\n\n* eval: performance improvements\r\n\r\nThese changes improve evaluation performance by memoizing exported\r\nvalues and merged object keys and avoiding copies when building object\r\nschemas.\r\n\r\nThis gives a tremendous improvement in execution time for\r\nevaluation-dominated scenarios, but results in little to no change for\r\nopen- or load-dominated scenarios.\r\n\r\nLocal benchmark results:\r\n\r\ngoos: darwin\r\ngoarch: arm64\r\npkg: github.com/pulumi/esc/eval\r\ncpu: Apple M1 Max\r\nBenchmarkEval-10           \t    453\t  2566938 ns/op\t2204129 B/op\t  18883 allocs/op\r\nBenchmarkEval-10           \t    468\t  2586703 ns/op\t2204146 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    462\t  2588916 ns/op\t2204202 B/op\t  18883 allocs/op\r\nBenchmarkEval-10           \t    464\t  2586365 ns/op\t2204228 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    463\t  2577383 ns/op\t2204362 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    477\t  2537640 ns/op\t2204389 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    468\t  2582930 ns/op\t2204594 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    463\t  2582915 ns/op\t2204246 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    469\t  2608014 ns/op\t2204382 B/op\t  18884 allocs/op\r\nBenchmarkEval-10           \t    465\t  2554270 ns/op\t2204313 B/op\t  18884 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t119163125 ns/op\t2208651 B/op\t  18926 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t118168319 ns/op\t2209928 B/op\t  18928 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t118805454 ns/op\t2208294 B/op\t  18924 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t118506347 ns/op\t2208712 B/op\t  18922 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t118898060 ns/op\t2210256 B/op\t  18926 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t118450250 ns/op\t2208210 B/op\t  18924 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t117723833 ns/op\t2207528 B/op\t  18922 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t117134787 ns/op\t2209227 B/op\t  18925 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t116210269 ns/op\t2208843 B/op\t  18926 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t116987444 ns/op\t2208736 B/op\t  18925 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t298021334 ns/op\t2216058 B/op\t  18951 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t302557979 ns/op\t2213974 B/op\t  18944 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t293050229 ns/op\t2212098 B/op\t  18945 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t304410510 ns/op\t2211322 B/op\t  18946 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t301698562 ns/op\t2212554 B/op\t  18947 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t299588854 ns/op\t2214102 B/op\t  18946 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t295087740 ns/op\t2211650 B/op\t  18944 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t295875531 ns/op\t2212638 B/op\t  18950 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t294871781 ns/op\t2212038 B/op\t  18945 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t294592875 ns/op\t2211682 B/op\t  18945 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t405058722 ns/op\t2215330 B/op\t  18976 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t407002764 ns/op\t2215688 B/op\t  18978 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t409757153 ns/op\t2214973 B/op\t  18976 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t404553611 ns/op\t2215261 B/op\t  18977 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t402620945 ns/op\t2216994 B/op\t  18980 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t405302139 ns/op\t2213112 B/op\t  18973 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t404533556 ns/op\t2215848 B/op\t  18978 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t403431236 ns/op\t2215896 B/op\t  18979 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t402586597 ns/op\t2217245 B/op\t  18983 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t404775236 ns/op\t2217122 B/op\t  18980 allocs/op\r\n\r\n* CL","shortMessageHtmlLink":"eval: performance improvements (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2531827562\" data-permission-text=\"Title is private\" data-url=\"https://github.com/pulumi/esc/issues/392\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/pulumi/esc/pull/392/hovercard\" href=\"https://github.com/pulumi/esc/pull/392\">#392</a>)"}},{"before":"0766b9f397de3b0007eb6c2bb34a9d7423f52eba","after":"295af2827c5e5fbf6480bc950f8531c1a85d36c5","ref":"refs/heads/pgavlin/eval-perf","pushedAt":"2024-09-17T21:15:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"CL","shortMessageHtmlLink":"CL"}},{"before":"2af6c5321c24e423a3fbc16abb42a226a541ee7f","after":"0766b9f397de3b0007eb6c2bb34a9d7423f52eba","ref":"refs/heads/pgavlin/eval-perf","pushedAt":"2024-09-17T19:17:22.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: performance improvements\n\nThese changes improve evaluation performance by memoizing exported\nvalues and merged object keys and avoiding copies when building object\nschemas.\n\nThis gives a tremendous improvement in execution time for\nevaluation-dominated scenarios, but results in little to no change for\nopen- or load-dominated scenarios.\n\nLocal benchmark results:\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    453\t  2566938 ns/op\t2204129 B/op\t  18883 allocs/op\nBenchmarkEval-10           \t    468\t  2586703 ns/op\t2204146 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    462\t  2588916 ns/op\t2204202 B/op\t  18883 allocs/op\nBenchmarkEval-10           \t    464\t  2586365 ns/op\t2204228 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    463\t  2577383 ns/op\t2204362 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    477\t  2537640 ns/op\t2204389 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    468\t  2582930 ns/op\t2204594 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    463\t  2582915 ns/op\t2204246 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    469\t  2608014 ns/op\t2204382 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    465\t  2554270 ns/op\t2204313 B/op\t  18884 allocs/op\nBenchmarkEvalOpen-10       \t      9\t119163125 ns/op\t2208651 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118168319 ns/op\t2209928 B/op\t  18928 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118805454 ns/op\t2208294 B/op\t  18924 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118506347 ns/op\t2208712 B/op\t  18922 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118898060 ns/op\t2210256 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118450250 ns/op\t2208210 B/op\t  18924 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117723833 ns/op\t2207528 B/op\t  18922 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117134787 ns/op\t2209227 B/op\t  18925 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116210269 ns/op\t2208843 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116987444 ns/op\t2208736 B/op\t  18925 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t298021334 ns/op\t2216058 B/op\t  18951 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t302557979 ns/op\t2213974 B/op\t  18944 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t293050229 ns/op\t2212098 B/op\t  18945 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304410510 ns/op\t2211322 B/op\t  18946 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301698562 ns/op\t2212554 B/op\t  18947 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t299588854 ns/op\t2214102 B/op\t  18946 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t295087740 ns/op\t2211650 B/op\t  18944 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t295875531 ns/op\t2212638 B/op\t  18950 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t294871781 ns/op\t2212038 B/op\t  18945 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t294592875 ns/op\t2211682 B/op\t  18945 allocs/op\nBenchmarkEvalAll-10        \t      3\t405058722 ns/op\t2215330 B/op\t  18976 allocs/op\nBenchmarkEvalAll-10        \t      3\t407002764 ns/op\t2215688 B/op\t  18978 allocs/op\nBenchmarkEvalAll-10        \t      3\t409757153 ns/op\t2214973 B/op\t  18976 allocs/op\nBenchmarkEvalAll-10        \t      3\t404553611 ns/op\t2215261 B/op\t  18977 allocs/op\nBenchmarkEvalAll-10        \t      3\t402620945 ns/op\t2216994 B/op\t  18980 allocs/op\nBenchmarkEvalAll-10        \t      3\t405302139 ns/op\t2213112 B/op\t  18973 allocs/op\nBenchmarkEvalAll-10        \t      3\t404533556 ns/op\t2215848 B/op\t  18978 allocs/op\nBenchmarkEvalAll-10        \t      3\t403431236 ns/op\t2215896 B/op\t  18979 allocs/op\nBenchmarkEvalAll-10        \t      3\t402586597 ns/op\t2217245 B/op\t  18983 allocs/op\nBenchmarkEvalAll-10        \t      3\t404775236 ns/op\t2217122 B/op\t  18980 allocs/op","shortMessageHtmlLink":"eval: performance improvements"}},{"before":null,"after":"8f171f807f52afd2ba8291d8a708f7f3ddb5bb8c","ref":"refs/heads/pgavlin/eval-load-perf","pushedAt":"2024-09-17T18:33:10.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: parallelize environment loading\n\nThese changes add support for loading environments in parallel.\n\nParallelization is breadth-first, then depth-first. For example, given\nthe following environments:\n\n```yaml\nimports: # env a\n  - b\n  - c\n\n--\nimports; # env b\n  - e\n--\nimports: # env c\n  - f\n  - g\n```\n\nEnvironments `b` and `c` would be loaded in parallel, then environment\n`e` would be loaded, then environments `f` and `g` would be loaded in\nparallel. This simplifies the detection of cyclic imports and the\ncollection of diagnostics.\n\nThis improves performance for scenarios that are dominated by\nenvironment load time (e.g. import graphs with high degrees of fanout).\n\nLocal benchmark results:\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    162\t  6249736 ns/op\t4636941 B/op\t  23697 allocs/op\nBenchmarkEval-10           \t    192\t  6229592 ns/op\t4637483 B/op\t  23697 allocs/op\nBenchmarkEval-10           \t    192\t  6213844 ns/op\t4638117 B/op\t  23699 allocs/op\nBenchmarkEval-10           \t    192\t  6215693 ns/op\t4637189 B/op\t  23696 allocs/op\nBenchmarkEval-10           \t    192\t  6286186 ns/op\t4637032 B/op\t  23696 allocs/op\nBenchmarkEval-10           \t    192\t  6250083 ns/op\t4637796 B/op\t  23698 allocs/op\nBenchmarkEval-10           \t    194\t  6201700 ns/op\t4637262 B/op\t  23697 allocs/op\nBenchmarkEval-10           \t    192\t  6256509 ns/op\t4637151 B/op\t  23697 allocs/op\nBenchmarkEval-10           \t    193\t  6220107 ns/op\t4638638 B/op\t  23699 allocs/op\nBenchmarkEval-10           \t    192\t  6196454 ns/op\t4636411 B/op\t  23696 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124156394 ns/op\t4632673 B/op\t  23703 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123760278 ns/op\t4636146 B/op\t  23713 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123941329 ns/op\t4640512 B/op\t  23718 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122636315 ns/op\t4637026 B/op\t  23710 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123189880 ns/op\t4636938 B/op\t  23702 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122790926 ns/op\t4635157 B/op\t  23710 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123945481 ns/op\t4637705 B/op\t  23711 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123235093 ns/op\t4640275 B/op\t  23710 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122647329 ns/op\t4639136 B/op\t  23708 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123545866 ns/op\t4638529 B/op\t  23715 allocs/op\nBenchmarkEvalEnvLoad-10    \t     60\t 17289035 ns/op\t4639187 B/op\t  23721 allocs/op\nBenchmarkEvalEnvLoad-10    \t     72\t 17035170 ns/op\t4638442 B/op\t  23721 allocs/op\nBenchmarkEvalEnvLoad-10    \t     72\t 17176440 ns/op\t4639614 B/op\t  23722 allocs/op\nBenchmarkEvalEnvLoad-10    \t     72\t 17151064 ns/op\t4639322 B/op\t  23722 allocs/op\nBenchmarkEvalEnvLoad-10    \t     70\t 17086652 ns/op\t4638750 B/op\t  23719 allocs/op\nBenchmarkEvalEnvLoad-10    \t     70\t 16979492 ns/op\t4638801 B/op\t  23721 allocs/op\nBenchmarkEvalEnvLoad-10    \t     70\t 17061474 ns/op\t4638384 B/op\t  23720 allocs/op\nBenchmarkEvalEnvLoad-10    \t     70\t 17121283 ns/op\t4640587 B/op\t  23723 allocs/op\nBenchmarkEvalEnvLoad-10    \t     69\t 17093001 ns/op\t4639506 B/op\t  23722 allocs/op\nBenchmarkEvalEnvLoad-10    \t     70\t 17046285 ns/op\t4639028 B/op\t  23720 allocs/op\nBenchmarkEvalAll-10        \t      8\t135173646 ns/op\t4635106 B/op\t  23730 allocs/op\nBenchmarkEvalAll-10        \t      8\t133903672 ns/op\t4638396 B/op\t  23735 allocs/op\nBenchmarkEvalAll-10        \t      8\t133961172 ns/op\t4640463 B/op\t  23735 allocs/op\nBenchmarkEvalAll-10        \t      8\t134953359 ns/op\t4639089 B/op\t  23724 allocs/op\nBenchmarkEvalAll-10        \t      8\t134443724 ns/op\t4639118 B/op\t  23739 allocs/op\nBenchmarkEvalAll-10        \t      8\t134042062 ns/op\t4638356 B/op\t  23733 allocs/op\nBenchmarkEvalAll-10        \t      8\t135336984 ns/op\t4642280 B/op\t  23739 allocs/op\nBenchmarkEvalAll-10        \t      8\t135161682 ns/op\t4638414 B/op\t  23730 allocs/op\nBenchmarkEvalAll-10        \t      8\t133572880 ns/op\t4639524 B/op\t  23727 allocs/op\nBenchmarkEvalAll-10        \t      8\t137661594 ns/op\t4642510 B/op\t  23736 allocs/op","shortMessageHtmlLink":"eval: parallelize environment loading"}},{"before":null,"after":"2af6c5321c24e423a3fbc16abb42a226a541ee7f","ref":"refs/heads/pgavlin/eval-perf","pushedAt":"2024-09-17T18:30:31.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: performance improvements\n\nThese changes improve evaluation performance by memoizing exported\nvalues and merged object keys and avoiding copies when building object\nschemas.\n\nThis gives a tremendous improvement in execution time for\nevaluation-dominated scenarios, but results in little to no change for\nopen- or load-dominated scenarios.\n\nLocal benchmark results:\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    453\t  2566938 ns/op\t2204129 B/op\t  18883 allocs/op\nBenchmarkEval-10           \t    468\t  2586703 ns/op\t2204146 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    462\t  2588916 ns/op\t2204202 B/op\t  18883 allocs/op\nBenchmarkEval-10           \t    464\t  2586365 ns/op\t2204228 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    463\t  2577383 ns/op\t2204362 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    477\t  2537640 ns/op\t2204389 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    468\t  2582930 ns/op\t2204594 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    463\t  2582915 ns/op\t2204246 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    469\t  2608014 ns/op\t2204382 B/op\t  18884 allocs/op\nBenchmarkEval-10           \t    465\t  2554270 ns/op\t2204313 B/op\t  18884 allocs/op\nBenchmarkEvalOpen-10       \t      9\t119163125 ns/op\t2208651 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118168319 ns/op\t2209928 B/op\t  18928 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118805454 ns/op\t2208294 B/op\t  18924 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118506347 ns/op\t2208712 B/op\t  18922 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118898060 ns/op\t2210256 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t118450250 ns/op\t2208210 B/op\t  18924 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117723833 ns/op\t2207528 B/op\t  18922 allocs/op\nBenchmarkEvalOpen-10       \t      9\t117134787 ns/op\t2209227 B/op\t  18925 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116210269 ns/op\t2208843 B/op\t  18926 allocs/op\nBenchmarkEvalOpen-10       \t      9\t116987444 ns/op\t2208736 B/op\t  18925 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t298021334 ns/op\t2216058 B/op\t  18951 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t302557979 ns/op\t2213974 B/op\t  18944 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t293050229 ns/op\t2212098 B/op\t  18945 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304410510 ns/op\t2211322 B/op\t  18946 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301698562 ns/op\t2212554 B/op\t  18947 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t299588854 ns/op\t2214102 B/op\t  18946 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t295087740 ns/op\t2211650 B/op\t  18944 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t295875531 ns/op\t2212638 B/op\t  18950 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t294871781 ns/op\t2212038 B/op\t  18945 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t294592875 ns/op\t2211682 B/op\t  18945 allocs/op\nBenchmarkEvalAll-10        \t      3\t405058722 ns/op\t2215330 B/op\t  18976 allocs/op\nBenchmarkEvalAll-10        \t      3\t407002764 ns/op\t2215688 B/op\t  18978 allocs/op\nBenchmarkEvalAll-10        \t      3\t409757153 ns/op\t2214973 B/op\t  18976 allocs/op\nBenchmarkEvalAll-10        \t      3\t404553611 ns/op\t2215261 B/op\t  18977 allocs/op\nBenchmarkEvalAll-10        \t      3\t402620945 ns/op\t2216994 B/op\t  18980 allocs/op\nBenchmarkEvalAll-10        \t      3\t405302139 ns/op\t2213112 B/op\t  18973 allocs/op\nBenchmarkEvalAll-10        \t      3\t404533556 ns/op\t2215848 B/op\t  18978 allocs/op\nBenchmarkEvalAll-10        \t      3\t403431236 ns/op\t2215896 B/op\t  18979 allocs/op\nBenchmarkEvalAll-10        \t      3\t402586597 ns/op\t2217245 B/op\t  18983 allocs/op\nBenchmarkEvalAll-10        \t      3\t404775236 ns/op\t2217122 B/op\t  18980 allocs/op","shortMessageHtmlLink":"eval: performance improvements"}},{"before":null,"after":"ba8c647b4ba498c074ccffa5b5f3aea06cd4859c","ref":"refs/heads/readme-updates","pushedAt":"2024-09-13T20:08:08.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"desteves","name":"diana esteves","path":"/desteves","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2991841?s=80&v=4"},"commit":{"message":"re-org messaging","shortMessageHtmlLink":"re-org messaging"}},{"before":"2528c9ba71d1d4fe8e1810d9e183026d3136d89a","after":null,"ref":"refs/heads/pgavlin/eval-bench","pushedAt":"2024-09-12T17:34:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"}},{"before":"71d131b8077c654b360d09b3d9d77b4f6114f9eb","after":"840f7c03efcc6f879f5c5d5ddaf6e6452fbe18e3","ref":"refs/heads/main","pushedAt":"2024-09-12T17:34:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: add benchmarks (#387)\n\nThese changes add four benchmarks for the evaluator: one for the\r\nevalutator itself, one focused on `fn::open`, one focused on\r\nenvironment loading, and one for the entire stack. Each\r\nbenchmark uses the same set of environments with different\r\nparameters for the time taken by an `fn::open` call or an\r\nenvironment load.\r\n\r\nLocal results are below.\r\n\r\n```\r\ngoos: darwin\r\ngoarch: arm64\r\npkg: github.com/pulumi/esc/eval\r\ncpu: Apple M1 Max\r\nBenchmarkEval-10           \t    196\t  6029274 ns/op\t4626576 B/op\t  23578 allocs/op\r\nBenchmarkEval-10           \t    195\t  6051825 ns/op\t4625788 B/op\t  23576 allocs/op\r\nBenchmarkEval-10           \t    195\t  6041508 ns/op\t4625803 B/op\t  23576 allocs/op\r\nBenchmarkEval-10           \t    195\t  6070728 ns/op\t4625819 B/op\t  23577 allocs/op\r\nBenchmarkEval-10           \t    194\t  6065964 ns/op\t4625696 B/op\t  23577 allocs/op\r\nBenchmarkEval-10           \t    196\t  6075660 ns/op\t4626653 B/op\t  23578 allocs/op\r\nBenchmarkEval-10           \t    195\t  6161176 ns/op\t4626057 B/op\t  23578 allocs/op\r\nBenchmarkEval-10           \t    194\t  6123274 ns/op\t4625977 B/op\t  23577 allocs/op\r\nBenchmarkEval-10           \t    194\t  6098131 ns/op\t4626670 B/op\t  23578 allocs/op\r\nBenchmarkEval-10           \t    196\t  6064363 ns/op\t4626654 B/op\t  23579 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t124478532 ns/op\t4629023 B/op\t  23614 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t124931037 ns/op\t4630025 B/op\t  23609 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t123642606 ns/op\t4634537 B/op\t  23618 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t124292352 ns/op\t4631007 B/op\t  23611 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t122027546 ns/op\t4633108 B/op\t  23617 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t123727792 ns/op\t4630472 B/op\t  23613 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t121888051 ns/op\t4630566 B/op\t  23617 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t123239685 ns/op\t4630572 B/op\t  23619 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t124360343 ns/op\t4631780 B/op\t  23616 allocs/op\r\nBenchmarkEvalOpen-10       \t      9\t122856963 ns/op\t4631718 B/op\t  23613 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t305906031 ns/op\t4634742 B/op\t  23643 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t304883292 ns/op\t4636056 B/op\t  23644 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t309884938 ns/op\t4637584 B/op\t  23643 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t301879375 ns/op\t4634852 B/op\t  23632 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t301303094 ns/op\t4632002 B/op\t  23639 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t303479062 ns/op\t4638610 B/op\t  23647 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t303368458 ns/op\t4634654 B/op\t  23635 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t304764969 ns/op\t4637982 B/op\t  23655 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t308650562 ns/op\t4636046 B/op\t  23640 allocs/op\r\nBenchmarkEvalEnvLoad-10    \t      4\t305385281 ns/op\t4629074 B/op\t  23628 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t421889528 ns/op\t4647314 B/op\t  23686 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t412783556 ns/op\t4639096 B/op\t  23683 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t418679208 ns/op\t4642520 B/op\t  23682 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t413973958 ns/op\t4632093 B/op\t  23650 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t415022083 ns/op\t4645818 B/op\t  23679 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t421364694 ns/op\t4633874 B/op\t  23662 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t413825070 ns/op\t4634840 B/op\t  23661 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t424170639 ns/op\t4630058 B/op\t  23666 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t421530069 ns/op\t4638128 B/op\t  23684 allocs/op\r\nBenchmarkEvalAll-10        \t      3\t416247500 ns/op\t4638744 B/op\t  23670 allocs/op\r\n```","shortMessageHtmlLink":"eval: add benchmarks (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2520882958\" data-permission-text=\"Title is private\" data-url=\"https://github.com/pulumi/esc/issues/387\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/pulumi/esc/pull/387/hovercard\" href=\"https://github.com/pulumi/esc/pull/387\">#387</a>)"}},{"before":"533d666a85dd6dab5f5ee7eb200be32918e66ad1","after":"2528c9ba71d1d4fe8e1810d9e183026d3136d89a","ref":"refs/heads/pgavlin/eval-bench","pushedAt":"2024-09-12T17:31:33.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: add benchmarks\n\nThese changes add four benchmarks for the evaluator: one for the\nevalutator itself, one focused on `fn::open`, one focused on\nenvironment loading, and one for the entire stack. Each\nbenchmark uses the same set of environments with different\nparameters for the time taken by an `fn::open` call or an\nenvironment load.\n\nLocal results are below.\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    196\t  6029274 ns/op\t4626576 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6051825 ns/op\t4625788 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6041508 ns/op\t4625803 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6070728 ns/op\t4625819 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6065964 ns/op\t4625696 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    196\t  6075660 ns/op\t4626653 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6161176 ns/op\t4626057 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    194\t  6123274 ns/op\t4625977 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6098131 ns/op\t4626670 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    196\t  6064363 ns/op\t4626654 B/op\t  23579 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124478532 ns/op\t4629023 B/op\t  23614 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124931037 ns/op\t4630025 B/op\t  23609 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123642606 ns/op\t4634537 B/op\t  23618 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124292352 ns/op\t4631007 B/op\t  23611 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122027546 ns/op\t4633108 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123727792 ns/op\t4630472 B/op\t  23613 allocs/op\nBenchmarkEvalOpen-10       \t      9\t121888051 ns/op\t4630566 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123239685 ns/op\t4630572 B/op\t  23619 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124360343 ns/op\t4631780 B/op\t  23616 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122856963 ns/op\t4631718 B/op\t  23613 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305906031 ns/op\t4634742 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304883292 ns/op\t4636056 B/op\t  23644 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t309884938 ns/op\t4637584 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301879375 ns/op\t4634852 B/op\t  23632 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301303094 ns/op\t4632002 B/op\t  23639 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303479062 ns/op\t4638610 B/op\t  23647 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303368458 ns/op\t4634654 B/op\t  23635 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304764969 ns/op\t4637982 B/op\t  23655 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t308650562 ns/op\t4636046 B/op\t  23640 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305385281 ns/op\t4629074 B/op\t  23628 allocs/op\nBenchmarkEvalAll-10        \t      3\t421889528 ns/op\t4647314 B/op\t  23686 allocs/op\nBenchmarkEvalAll-10        \t      3\t412783556 ns/op\t4639096 B/op\t  23683 allocs/op\nBenchmarkEvalAll-10        \t      3\t418679208 ns/op\t4642520 B/op\t  23682 allocs/op\nBenchmarkEvalAll-10        \t      3\t413973958 ns/op\t4632093 B/op\t  23650 allocs/op\nBenchmarkEvalAll-10        \t      3\t415022083 ns/op\t4645818 B/op\t  23679 allocs/op\nBenchmarkEvalAll-10        \t      3\t421364694 ns/op\t4633874 B/op\t  23662 allocs/op\nBenchmarkEvalAll-10        \t      3\t413825070 ns/op\t4634840 B/op\t  23661 allocs/op\nBenchmarkEvalAll-10        \t      3\t424170639 ns/op\t4630058 B/op\t  23666 allocs/op\nBenchmarkEvalAll-10        \t      3\t421530069 ns/op\t4638128 B/op\t  23684 allocs/op\nBenchmarkEvalAll-10        \t      3\t416247500 ns/op\t4638744 B/op\t  23670 allocs/op","shortMessageHtmlLink":"eval: add benchmarks"}},{"before":"a85f0f98fcb8d482b01b9d10ec62f037dc1ec0b3","after":null,"ref":"refs/heads/syeh/v0.10.0","pushedAt":"2024-09-12T13:49:01.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"}},{"before":"328d3204100fafe4a6fa5c2293dcd5ff86a6950a","after":"71d131b8077c654b360d09b3d9d77b4f6114f9eb","ref":"refs/heads/main","pushedAt":"2024-09-12T13:48:59.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"chore: freeze 0.10.0","shortMessageHtmlLink":"chore: freeze 0.10.0"}},{"before":"fad5e464af0f7ab3ac4e2632ce8cbcd145ef3fce","after":"a85f0f98fcb8d482b01b9d10ec62f037dc1ec0b3","ref":"refs/heads/syeh/v0.10.0","pushedAt":"2024-09-12T13:44:02.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"chore: freeze 0.10.0","shortMessageHtmlLink":"chore: freeze 0.10.0"}},{"before":"e1e8d853e97b1fba5900bdb13d0e4e4f1ae30691","after":"67da63b66c7ce92840a34a72692687da12ba21c0","ref":"refs/heads/chore/v0.10.0","pushedAt":"2024-09-12T13:37:28.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"chore: CHANGELOG for v0.10.0","shortMessageHtmlLink":"chore: CHANGELOG for v0.10.0"}},{"before":"39bbf44d61c00440154009ffbe6b7e8ce0f85664","after":"533d666a85dd6dab5f5ee7eb200be32918e66ad1","ref":"refs/heads/pgavlin/eval-bench","pushedAt":"2024-09-11T23:38:09.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: add benchmarks\n\nThese changes add four benchmarks for the evaluator: one for the\nevalutator itself, one focused on `fn::open`, one focused on\nenvironment loading, and one for the entire stack. Each\nbenchmark uses the same set of environments with different\nparameters for the time taken by an `fn::open` call or an\nenvironment load.\n\nLocal results are below.\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    196\t  6029274 ns/op\t4626576 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6051825 ns/op\t4625788 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6041508 ns/op\t4625803 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6070728 ns/op\t4625819 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6065964 ns/op\t4625696 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    196\t  6075660 ns/op\t4626653 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6161176 ns/op\t4626057 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    194\t  6123274 ns/op\t4625977 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6098131 ns/op\t4626670 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    196\t  6064363 ns/op\t4626654 B/op\t  23579 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124478532 ns/op\t4629023 B/op\t  23614 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124931037 ns/op\t4630025 B/op\t  23609 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123642606 ns/op\t4634537 B/op\t  23618 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124292352 ns/op\t4631007 B/op\t  23611 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122027546 ns/op\t4633108 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123727792 ns/op\t4630472 B/op\t  23613 allocs/op\nBenchmarkEvalOpen-10       \t      9\t121888051 ns/op\t4630566 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123239685 ns/op\t4630572 B/op\t  23619 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124360343 ns/op\t4631780 B/op\t  23616 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122856963 ns/op\t4631718 B/op\t  23613 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305906031 ns/op\t4634742 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304883292 ns/op\t4636056 B/op\t  23644 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t309884938 ns/op\t4637584 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301879375 ns/op\t4634852 B/op\t  23632 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301303094 ns/op\t4632002 B/op\t  23639 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303479062 ns/op\t4638610 B/op\t  23647 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303368458 ns/op\t4634654 B/op\t  23635 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304764969 ns/op\t4637982 B/op\t  23655 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t308650562 ns/op\t4636046 B/op\t  23640 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305385281 ns/op\t4629074 B/op\t  23628 allocs/op\nBenchmarkEvalAll-10        \t      3\t421889528 ns/op\t4647314 B/op\t  23686 allocs/op\nBenchmarkEvalAll-10        \t      3\t412783556 ns/op\t4639096 B/op\t  23683 allocs/op\nBenchmarkEvalAll-10        \t      3\t418679208 ns/op\t4642520 B/op\t  23682 allocs/op\nBenchmarkEvalAll-10        \t      3\t413973958 ns/op\t4632093 B/op\t  23650 allocs/op\nBenchmarkEvalAll-10        \t      3\t415022083 ns/op\t4645818 B/op\t  23679 allocs/op\nBenchmarkEvalAll-10        \t      3\t421364694 ns/op\t4633874 B/op\t  23662 allocs/op\nBenchmarkEvalAll-10        \t      3\t413825070 ns/op\t4634840 B/op\t  23661 allocs/op\nBenchmarkEvalAll-10        \t      3\t424170639 ns/op\t4630058 B/op\t  23666 allocs/op\nBenchmarkEvalAll-10        \t      3\t421530069 ns/op\t4638128 B/op\t  23684 allocs/op\nBenchmarkEvalAll-10        \t      3\t416247500 ns/op\t4638744 B/op\t  23670 allocs/op","shortMessageHtmlLink":"eval: add benchmarks"}},{"before":null,"after":"39bbf44d61c00440154009ffbe6b7e8ce0f85664","ref":"refs/heads/pgavlin/eval-bench","pushedAt":"2024-09-11T22:14:33.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pgavlin","name":"Pat Gavlin","path":"/pgavlin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1224093?s=80&v=4"},"commit":{"message":"eval: add benchmarks\n\nThese changes add four benchmarks for the evaluator: one for the\nevalutator itself, one focused on `fn::open`, one focused on\nenvironment loading, and one for the entire stack. Each\nbenchmark uses the same set of environments with different\nparameters for the time taken by an `fn::open` call or an\nenvironment load.\n\nLocal results are below.\n\ngoos: darwin\ngoarch: arm64\npkg: github.com/pulumi/esc/eval\ncpu: Apple M1 Max\nBenchmarkEval-10           \t    196\t  6029274 ns/op\t4626576 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6051825 ns/op\t4625788 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6041508 ns/op\t4625803 B/op\t  23576 allocs/op\nBenchmarkEval-10           \t    195\t  6070728 ns/op\t4625819 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6065964 ns/op\t4625696 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    196\t  6075660 ns/op\t4626653 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    195\t  6161176 ns/op\t4626057 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    194\t  6123274 ns/op\t4625977 B/op\t  23577 allocs/op\nBenchmarkEval-10           \t    194\t  6098131 ns/op\t4626670 B/op\t  23578 allocs/op\nBenchmarkEval-10           \t    196\t  6064363 ns/op\t4626654 B/op\t  23579 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124478532 ns/op\t4629023 B/op\t  23614 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124931037 ns/op\t4630025 B/op\t  23609 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123642606 ns/op\t4634537 B/op\t  23618 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124292352 ns/op\t4631007 B/op\t  23611 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122027546 ns/op\t4633108 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123727792 ns/op\t4630472 B/op\t  23613 allocs/op\nBenchmarkEvalOpen-10       \t      9\t121888051 ns/op\t4630566 B/op\t  23617 allocs/op\nBenchmarkEvalOpen-10       \t      9\t123239685 ns/op\t4630572 B/op\t  23619 allocs/op\nBenchmarkEvalOpen-10       \t      9\t124360343 ns/op\t4631780 B/op\t  23616 allocs/op\nBenchmarkEvalOpen-10       \t      9\t122856963 ns/op\t4631718 B/op\t  23613 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305906031 ns/op\t4634742 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304883292 ns/op\t4636056 B/op\t  23644 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t309884938 ns/op\t4637584 B/op\t  23643 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301879375 ns/op\t4634852 B/op\t  23632 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t301303094 ns/op\t4632002 B/op\t  23639 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303479062 ns/op\t4638610 B/op\t  23647 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t303368458 ns/op\t4634654 B/op\t  23635 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t304764969 ns/op\t4637982 B/op\t  23655 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t308650562 ns/op\t4636046 B/op\t  23640 allocs/op\nBenchmarkEvalEnvLoad-10    \t      4\t305385281 ns/op\t4629074 B/op\t  23628 allocs/op\nBenchmarkEvalAll-10        \t      3\t421889528 ns/op\t4647314 B/op\t  23686 allocs/op\nBenchmarkEvalAll-10        \t      3\t412783556 ns/op\t4639096 B/op\t  23683 allocs/op\nBenchmarkEvalAll-10        \t      3\t418679208 ns/op\t4642520 B/op\t  23682 allocs/op\nBenchmarkEvalAll-10        \t      3\t413973958 ns/op\t4632093 B/op\t  23650 allocs/op\nBenchmarkEvalAll-10        \t      3\t415022083 ns/op\t4645818 B/op\t  23679 allocs/op\nBenchmarkEvalAll-10        \t      3\t421364694 ns/op\t4633874 B/op\t  23662 allocs/op\nBenchmarkEvalAll-10        \t      3\t413825070 ns/op\t4634840 B/op\t  23661 allocs/op\nBenchmarkEvalAll-10        \t      3\t424170639 ns/op\t4630058 B/op\t  23666 allocs/op\nBenchmarkEvalAll-10        \t      3\t421530069 ns/op\t4638128 B/op\t  23684 allocs/op\nBenchmarkEvalAll-10        \t      3\t416247500 ns/op\t4638744 B/op\t  23670 allocs/op","shortMessageHtmlLink":"eval: add benchmarks"}},{"before":null,"after":"b4aaf9f97f9ea2b1288294d7f8072207a20eb0c1","ref":"refs/heads/syeh/add-projects-execcontext","pushedAt":"2024-09-11T18:32:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"wip","shortMessageHtmlLink":"wip"}},{"before":null,"after":"e1e8d853e97b1fba5900bdb13d0e4e4f1ae30691","ref":"refs/heads/chore/v0.10.0","pushedAt":"2024-09-11T17:18:37.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"chore: CHANGELOG for v0.10.0","shortMessageHtmlLink":"chore: CHANGELOG for v0.10.0"}},{"before":null,"after":"fad5e464af0f7ab3ac4e2632ce8cbcd145ef3fce","ref":"refs/heads/syeh/v0.10.0","pushedAt":"2024-09-11T15:04:15.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"chore: freeze 0.10.0","shortMessageHtmlLink":"chore: freeze 0.10.0"}},{"before":"a178d67e814d8a27b98a2c96fb6324edbfad5b1c","after":null,"ref":"refs/heads/feature/projects","pushedAt":"2024-09-10T22:16:58.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"}},{"before":"9f740bb977ea50405c32036ca7d7e51b5f4b332f","after":"328d3204100fafe4a6fa5c2293dcd5ff86a6950a","ref":"refs/heads/main","pushedAt":"2024-09-10T22:16:56.000Z","pushType":"pr_merge","commitsCount":6,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"[env] add project filter to ls command (#382)\n\n* [env] add project filter to ls command\r\n\r\n* update changelog with PR #\r\n\r\n* resolve merge issues\r\n\r\n* s/stacks/environments/","shortMessageHtmlLink":"[env] add project filter to ls command (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517172747\" data-permission-text=\"Title is private\" data-url=\"https://github.com/pulumi/esc/issues/382\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/pulumi/esc/pull/382/hovercard\" href=\"https://github.com/pulumi/esc/pull/382\">#382</a>)"}},{"before":"2dbf04924de9975b1104c670eb3497869b62f700","after":"a178d67e814d8a27b98a2c96fb6324edbfad5b1c","ref":"refs/heads/feature/projects","pushedAt":"2024-09-10T21:20:57.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"[env] add project filter to ls command (#382)\n\n* [env] add project filter to ls command\r\n\r\n* update changelog with PR #\r\n\r\n* resolve merge issues\r\n\r\n* s/stacks/environments/","shortMessageHtmlLink":"[env] add project filter to ls command (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517172747\" data-permission-text=\"Title is private\" data-url=\"https://github.com/pulumi/esc/issues/382\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/pulumi/esc/pull/382/hovercard\" href=\"https://github.com/pulumi/esc/pull/382\">#382</a>)"}},{"before":"e692f41a8af81acc126b5c781945912229d731a6","after":null,"ref":"refs/heads/projects/lsfilter","pushedAt":"2024-09-10T20:14:58.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"}},{"before":"5471bad7b8c6962818b1181d525c1c7c521bd740","after":"2dbf04924de9975b1104c670eb3497869b62f700","ref":"refs/heads/feature/projects","pushedAt":"2024-09-10T20:14:57.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"[env] add project filter to ls command (#382)\n\n* [env] add project filter to ls command\r\n\r\n* update changelog with PR #\r\n\r\n* resolve merge issues\r\n\r\n* s/stacks/environments/","shortMessageHtmlLink":"[env] add project filter to ls command (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517172747\" data-permission-text=\"Title is private\" data-url=\"https://github.com/pulumi/esc/issues/382\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/pulumi/esc/pull/382/hovercard\" href=\"https://github.com/pulumi/esc/pull/382\">#382</a>)"}},{"before":"39dae9e5ea3adca9fa7e93a96a1988ec2cee0799","after":"e692f41a8af81acc126b5c781945912229d731a6","ref":"refs/heads/projects/lsfilter","pushedAt":"2024-09-10T19:13:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"s/stacks/environments/","shortMessageHtmlLink":"s/stacks/environments/"}},{"before":"ec3b363a0511601bd2a848f5183a74bb3227d0e1","after":"39dae9e5ea3adca9fa7e93a96a1988ec2cee0799","ref":"refs/heads/projects/lsfilter","pushedAt":"2024-09-10T17:59:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"resolve merge issues","shortMessageHtmlLink":"resolve merge issues"}},{"before":"3a6d82139a5da1a1d42483939b9a7f7cb8113e33","after":"ec3b363a0511601bd2a848f5183a74bb3227d0e1","ref":"refs/heads/projects/lsfilter","pushedAt":"2024-09-10T17:53:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"update changelog with PR #","shortMessageHtmlLink":"update changelog with PR #"}},{"before":null,"after":"3a6d82139a5da1a1d42483939b9a7f7cb8113e33","ref":"refs/heads/projects/lsfilter","pushedAt":"2024-09-10T17:52:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dschaller","name":"Derek","path":"/dschaller","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1004789?s=80&v=4"},"commit":{"message":"[env] add project filter to ls command","shortMessageHtmlLink":"[env] add project filter to ls command"}},{"before":"101642515329fe8819d5f1c35c298437a31f9d7b","after":"5471bad7b8c6962818b1181d525c1c7c521bd740","ref":"refs/heads/feature/projects","pushedAt":"2024-09-10T14:32:21.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"seanyeh","name":"Sean Yeh","path":"/seanyeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/109418?s=80&v=4"},"commit":{"message":"fixup - changelog changes","shortMessageHtmlLink":"fixup - changelog changes"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xN1QyMToyNzoxMi4wMDAwMDBazwAAAAS5AS3T","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xN1QyMToyNzoxMi4wMDAwMDBazwAAAAS5AS3T","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xMFQxNDozMjoyMS4wMDAwMDBazwAAAASyK86j"}},"title":"Activity · pulumi/esc"}