Skip to content

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 31, 2025

Stack from ghstack (oldest at bottom):

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 31, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3286

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 3 Pending, 2 Unrelated Failures

As of commit 1ff8f81 with merge base 7d6c5e3 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 2e1839f
Pull-Request: #3286
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 31, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}23$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 83.7826μs 82.8125μs 12.0755 KOps/s 11.7482 KOps/s $\color{#35bf28}+2.79\%$
test_tensor_to_bytestream_speed[torch.save] 0.1415ms 0.1407ms 7.1066 KOps/s 6.7142 KOps/s $\textbf{\color{#35bf28}+5.84\%}$
test_tensor_to_bytestream_speed[untyped_storage] 0.1180s 0.1175s 8.5139 Ops/s 8.3260 Ops/s $\color{#35bf28}+2.26\%$
test_tensor_to_bytestream_speed[numpy] 2.6056μs 2.5995μs 384.6902 KOps/s 374.6730 KOps/s $\color{#35bf28}+2.67\%$
test_tensor_to_bytestream_speed[safetensors] 40.1862μs 40.0034μs 24.9979 KOps/s 25.0709 KOps/s $\color{#d91a1a}-0.29\%$
test_simple 0.5503s 0.5493s 1.8205 Ops/s 1.7407 Ops/s $\color{#35bf28}+4.58\%$
test_transformed 1.1240s 1.1227s 0.8907 Ops/s 0.8681 Ops/s $\color{#35bf28}+2.60\%$
test_serial 1.7234s 1.6875s 0.5926 Ops/s 0.5850 Ops/s $\color{#35bf28}+1.29\%$
test_parallel 1.2004s 1.1082s 0.9024 Ops/s 0.8980 Ops/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-True-True-True-True] 0.3637ms 45.1874μs 22.1301 KOps/s 21.8321 KOps/s $\color{#35bf28}+1.36\%$
test_step_mdp_speed[True-True-True-True-False] 48.9410μs 25.6906μs 38.9248 KOps/s 38.8595 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[True-True-True-False-True] 73.6420μs 25.7460μs 38.8409 KOps/s 39.0163 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-True-True-False-False] 45.4610μs 14.4097μs 69.3977 KOps/s 71.5645 KOps/s $\color{#d91a1a}-3.03\%$
test_step_mdp_speed[True-True-False-True-True] 81.5120μs 48.5261μs 20.6075 KOps/s 20.2677 KOps/s $\color{#35bf28}+1.68\%$
test_step_mdp_speed[True-True-False-True-False] 58.2410μs 28.3222μs 35.3080 KOps/s 35.0833 KOps/s $\color{#35bf28}+0.64\%$
test_step_mdp_speed[True-True-False-False-True] 63.4510μs 28.3031μs 35.3318 KOps/s 34.5014 KOps/s $\color{#35bf28}+2.41\%$
test_step_mdp_speed[True-True-False-False-False] 39.7910μs 17.0824μs 58.5399 KOps/s 59.1449 KOps/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[True-False-True-True-True] 82.1820μs 52.0717μs 19.2043 KOps/s 19.2137 KOps/s $\color{#d91a1a}-0.05\%$
test_step_mdp_speed[True-False-True-True-False] 57.2320μs 31.6499μs 31.5957 KOps/s 31.2128 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-False-True-False-True] 57.9710μs 28.5004μs 35.0873 KOps/s 34.8902 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[True-False-True-False-False] 49.1310μs 17.0634μs 58.6051 KOps/s 58.7461 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[True-False-False-True-True] 0.1226ms 54.9363μs 18.2029 KOps/s 18.1167 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-False-False-True-False] 71.6720μs 34.1910μs 29.2475 KOps/s 28.7970 KOps/s $\color{#35bf28}+1.56\%$
test_step_mdp_speed[True-False-False-False-True] 65.2320μs 31.3622μs 31.8855 KOps/s 31.4182 KOps/s $\color{#35bf28}+1.49\%$
test_step_mdp_speed[True-False-False-False-False] 45.7710μs 19.9590μs 50.1026 KOps/s 50.5559 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[False-True-True-True-True] 82.8820μs 52.2225μs 19.1488 KOps/s 19.3500 KOps/s $\color{#d91a1a}-1.04\%$
test_step_mdp_speed[False-True-True-True-False] 0.1013ms 31.2233μs 32.0273 KOps/s 31.4548 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[False-True-True-False-True] 2.3865ms 33.0294μs 30.2761 KOps/s 30.2511 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-True-True-False-False] 54.3710μs 19.0875μs 52.3904 KOps/s 53.4403 KOps/s $\color{#d91a1a}-1.96\%$
test_step_mdp_speed[False-True-False-True-True] 84.4120μs 54.9236μs 18.2071 KOps/s 18.1394 KOps/s $\color{#35bf28}+0.37\%$
test_step_mdp_speed[False-True-False-True-False] 63.3510μs 34.0144μs 29.3993 KOps/s 28.9978 KOps/s $\color{#35bf28}+1.38\%$
test_step_mdp_speed[False-True-False-False-True] 65.6220μs 35.2791μs 28.3454 KOps/s 27.8541 KOps/s $\color{#35bf28}+1.76\%$
test_step_mdp_speed[False-True-False-False-False] 46.3310μs 21.3095μs 46.9274 KOps/s 46.3430 KOps/s $\color{#35bf28}+1.26\%$
test_step_mdp_speed[False-False-True-True-True] 86.6720μs 56.1128μs 17.8212 KOps/s 17.4543 KOps/s $\color{#35bf28}+2.10\%$
test_step_mdp_speed[False-False-True-True-False] 63.4820μs 36.5941μs 27.3268 KOps/s 27.0093 KOps/s $\color{#35bf28}+1.18\%$
test_step_mdp_speed[False-False-True-False-True] 61.0110μs 35.1800μs 28.4253 KOps/s 28.1959 KOps/s $\color{#35bf28}+0.81\%$
test_step_mdp_speed[False-False-True-False-False] 49.5210μs 21.5797μs 46.3399 KOps/s 46.1895 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-False-False-True-True] 84.5120μs 58.2337μs 17.1722 KOps/s 16.8069 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-False-False-True-False] 0.1153ms 39.4477μs 25.3500 KOps/s 24.9822 KOps/s $\color{#35bf28}+1.47\%$
test_step_mdp_speed[False-False-False-False-True] 78.6210μs 37.9296μs 26.3646 KOps/s 27.1137 KOps/s $\color{#d91a1a}-2.76\%$
test_step_mdp_speed[False-False-False-False-False] 54.6720μs 24.1224μs 41.4553 KOps/s 41.3049 KOps/s $\color{#35bf28}+0.36\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8688s 0.7722s 1.2950 Ops/s 1.2850 Ops/s $\color{#35bf28}+0.78\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7391s 0.6391s 1.5648 Ops/s 1.5544 Ops/s $\color{#35bf28}+0.67\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7758s 1.6966s 0.5894 Ops/s 0.5917 Ops/s $\color{#d91a1a}-0.38\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5494s 1.4696s 0.6805 Ops/s 0.6762 Ops/s $\color{#35bf28}+0.63\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0199s 1.9358s 0.5166 Ops/s 0.5148 Ops/s $\color{#35bf28}+0.36\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7974s 1.7137s 0.5835 Ops/s 0.5786 Ops/s $\color{#35bf28}+0.85\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.8105s 4.6468s 0.2152 Ops/s 0.2147 Ops/s $\color{#35bf28}+0.22\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.6481s 4.4911s 0.2227 Ops/s 0.2240 Ops/s $\color{#d91a1a}-0.58\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0438s 1.9713s 0.5073 Ops/s 0.5088 Ops/s $\color{#d91a1a}-0.30\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7634s 1.6808s 0.5950 Ops/s 0.5891 Ops/s $\color{#35bf28}+0.99\%$
test_values[generalized_advantage_estimate-True-True] 9.7778ms 9.6066ms 104.0947 Ops/s 104.0951 Ops/s $-0.00\%$
test_values[vec_generalized_advantage_estimate-True-True] 20.1154ms 17.9912ms 55.5829 Ops/s 56.1563 Ops/s $\color{#d91a1a}-1.02\%$
test_values[td0_return_estimate-False-False] 0.1895ms 0.1306ms 7.6554 KOps/s 4.5494 KOps/s $\textbf{\color{#35bf28}+68.27\%}$
test_values[td1_return_estimate-False-False] 27.4843ms 26.7065ms 37.4441 Ops/s 38.8468 Ops/s $\color{#d91a1a}-3.61\%$
test_values[vec_td1_return_estimate-False-False] 18.6241ms 17.9869ms 55.5960 Ops/s 55.8754 Ops/s $\color{#d91a1a}-0.50\%$
test_values[td_lambda_return_estimate-True-False] 41.6163ms 40.1758ms 24.8906 Ops/s 26.0041 Ops/s $\color{#d91a1a}-4.28\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.6070ms 17.9555ms 55.6933 Ops/s 55.8938 Ops/s $\color{#d91a1a}-0.36\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.9574ms 8.4569ms 118.2462 Ops/s 118.9024 Ops/s $\color{#d91a1a}-0.55\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9119ms 1.4835ms 674.0724 Ops/s 667.4629 Ops/s $\color{#35bf28}+0.99\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4472ms 0.3992ms 2.5049 KOps/s 2.4821 KOps/s $\color{#35bf28}+0.92\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.1134ms 30.4687ms 32.8206 Ops/s 29.0769 Ops/s $\textbf{\color{#35bf28}+12.88\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.9298ms 1.7296ms 578.1698 Ops/s 577.5014 Ops/s $\color{#35bf28}+0.12\%$
test_dqn_speed[False-None] 1.5144ms 1.3915ms 718.6234 Ops/s 724.4866 Ops/s $\color{#d91a1a}-0.81\%$
test_dqn_speed[False-backward] 1.9547ms 1.8972ms 527.0818 Ops/s 530.3343 Ops/s $\color{#d91a1a}-0.61\%$
test_dqn_speed[True-None] 0.5866ms 0.5190ms 1.9269 KOps/s 1.8237 KOps/s $\textbf{\color{#35bf28}+5.65\%}$
test_dqn_speed[True-backward] 1.0148ms 0.9785ms 1.0220 KOps/s 923.0373 Ops/s $\textbf{\color{#35bf28}+10.72\%}$
test_dqn_speed[reduce-overhead-None] 0.6494ms 0.5212ms 1.9188 KOps/s 1.8614 KOps/s $\color{#35bf28}+3.08\%$
test_dqn_speed[reduce-overhead-backward] 0.9920ms 0.9582ms 1.0436 KOps/s 939.6946 Ops/s $\textbf{\color{#35bf28}+11.06\%}$
test_ddpg_speed[False-None] 3.1286ms 2.8632ms 349.2566 Ops/s 333.4970 Ops/s $\color{#35bf28}+4.73\%$
test_ddpg_speed[False-backward] 4.1646ms 4.0387ms 247.6034 Ops/s 245.5530 Ops/s $\color{#35bf28}+0.84\%$
test_ddpg_speed[True-None] 1.7796ms 1.3642ms 733.0126 Ops/s 696.8947 Ops/s $\textbf{\color{#35bf28}+5.18\%}$
test_ddpg_speed[True-backward] 2.3851ms 2.3442ms 426.5791 Ops/s 376.8008 Ops/s $\textbf{\color{#35bf28}+13.21\%}$
test_ddpg_speed[reduce-overhead-None] 1.4504ms 1.3647ms 732.7551 Ops/s 695.5099 Ops/s $\textbf{\color{#35bf28}+5.36\%}$
test_ddpg_speed[reduce-overhead-backward] 2.3808ms 2.3263ms 429.8602 Ops/s 348.5110 Ops/s $\textbf{\color{#35bf28}+23.34\%}$
test_sac_speed[False-None] 8.5717ms 7.9271ms 126.1497 Ops/s 122.7853 Ops/s $\color{#35bf28}+2.74\%$
test_sac_speed[False-backward] 11.7438ms 11.1520ms 89.6702 Ops/s 89.4778 Ops/s $\color{#35bf28}+0.22\%$
test_sac_speed[True-None] 2.4443ms 2.1197ms 471.7662 Ops/s 465.6366 Ops/s $\color{#35bf28}+1.32\%$
test_sac_speed[True-backward] 4.1703ms 4.0400ms 247.5260 Ops/s 204.5631 Ops/s $\textbf{\color{#35bf28}+21.00\%}$
test_sac_speed[reduce-overhead-None] 2.6319ms 2.1215ms 471.3565 Ops/s 466.7564 Ops/s $\color{#35bf28}+0.99\%$
test_sac_speed[reduce-overhead-backward] 4.1198ms 3.9960ms 250.2502 Ops/s 222.5487 Ops/s $\textbf{\color{#35bf28}+12.45\%}$
test_redq_speed[False-None] 15.2388ms 10.5006ms 95.2327 Ops/s 95.6277 Ops/s $\color{#d91a1a}-0.41\%$
test_redq_speed[False-backward] 18.5601ms 17.6306ms 56.7194 Ops/s 55.8988 Ops/s $\color{#35bf28}+1.47\%$
test_redq_speed[True-None] 4.9661ms 4.3845ms 228.0739 Ops/s 230.5866 Ops/s $\color{#d91a1a}-1.09\%$
test_redq_speed[True-backward] 10.1022ms 9.8471ms 101.5525 Ops/s 105.2599 Ops/s $\color{#d91a1a}-3.52\%$
test_redq_speed[reduce-overhead-None] 5.3698ms 4.4724ms 223.5923 Ops/s 218.0911 Ops/s $\color{#35bf28}+2.52\%$
test_redq_speed[reduce-overhead-backward] 10.3047ms 10.0582ms 99.4210 Ops/s 102.4313 Ops/s $\color{#d91a1a}-2.94\%$
test_redq_deprec_speed[False-None] 11.4838ms 11.0078ms 90.8450 Ops/s 87.8706 Ops/s $\color{#35bf28}+3.38\%$
test_redq_deprec_speed[False-backward] 16.2082ms 15.7856ms 63.3491 Ops/s 61.6823 Ops/s $\color{#35bf28}+2.70\%$
test_redq_deprec_speed[True-None] 4.2425ms 3.7068ms 269.7756 Ops/s 272.5708 Ops/s $\color{#d91a1a}-1.03\%$
test_redq_deprec_speed[True-backward] 7.8352ms 7.6471ms 130.7682 Ops/s 127.1196 Ops/s $\color{#35bf28}+2.87\%$
test_redq_deprec_speed[reduce-overhead-None] 3.8774ms 3.6775ms 271.9239 Ops/s 276.3065 Ops/s $\color{#d91a1a}-1.59\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.8627ms 7.6852ms 130.1195 Ops/s 122.5022 Ops/s $\textbf{\color{#35bf28}+6.22\%}$
test_td3_speed[False-None] 8.2101ms 7.9927ms 125.1139 Ops/s 124.7749 Ops/s $\color{#35bf28}+0.27\%$
test_td3_speed[False-backward] 11.2175ms 10.7700ms 92.8505 Ops/s 92.2103 Ops/s $\color{#35bf28}+0.69\%$
test_td3_speed[True-None] 1.8569ms 1.8141ms 551.2509 Ops/s 546.4177 Ops/s $\color{#35bf28}+0.88\%$
test_td3_speed[True-backward] 3.7082ms 3.6197ms 276.2654 Ops/s 267.0064 Ops/s $\color{#35bf28}+3.47\%$
test_td3_speed[reduce-overhead-None] 1.8523ms 1.7704ms 564.8455 Ops/s 553.6933 Ops/s $\color{#35bf28}+2.01\%$
test_td3_speed[reduce-overhead-backward] 3.7767ms 3.6388ms 274.8171 Ops/s 232.7432 Ops/s $\textbf{\color{#35bf28}+18.08\%}$
test_cql_speed[False-None] 29.4822ms 26.1386ms 38.2576 Ops/s 38.3830 Ops/s $\color{#d91a1a}-0.33\%$
test_cql_speed[False-backward] 39.4917ms 35.1653ms 28.4371 Ops/s 28.2708 Ops/s $\color{#35bf28}+0.59\%$
test_cql_speed[True-None] 12.8762ms 12.4383ms 80.3968 Ops/s 80.8892 Ops/s $\color{#d91a1a}-0.61\%$
test_cql_speed[True-backward] 19.2556ms 18.4176ms 54.2959 Ops/s 55.2265 Ops/s $\color{#d91a1a}-1.69\%$
test_cql_speed[reduce-overhead-None] 15.2046ms 12.4809ms 80.1222 Ops/s 82.2719 Ops/s $\color{#d91a1a}-2.61\%$
test_cql_speed[reduce-overhead-backward] 18.7067ms 18.2946ms 54.6609 Ops/s 56.0161 Ops/s $\color{#d91a1a}-2.42\%$
test_a2c_speed[False-None] 5.6427ms 5.3975ms 185.2697 Ops/s 182.5794 Ops/s $\color{#35bf28}+1.47\%$
test_a2c_speed[False-backward] 11.9864ms 11.7074ms 85.4158 Ops/s 85.5804 Ops/s $\color{#d91a1a}-0.19\%$
test_a2c_speed[True-None] 4.0659ms 3.7261ms 268.3773 Ops/s 261.0307 Ops/s $\color{#35bf28}+2.81\%$
test_a2c_speed[True-backward] 8.7937ms 8.5829ms 116.5113 Ops/s 114.3762 Ops/s $\color{#35bf28}+1.87\%$
test_a2c_speed[reduce-overhead-None] 3.9853ms 3.6798ms 271.7547 Ops/s 272.4176 Ops/s $\color{#d91a1a}-0.24\%$
test_a2c_speed[reduce-overhead-backward] 8.8971ms 8.7031ms 114.9014 Ops/s 115.3439 Ops/s $\color{#d91a1a}-0.38\%$
test_ppo_speed[False-None] 6.0803ms 5.8717ms 170.3079 Ops/s 167.9770 Ops/s $\color{#35bf28}+1.39\%$
test_ppo_speed[False-backward] 12.5060ms 12.2094ms 81.9040 Ops/s 80.6340 Ops/s $\color{#35bf28}+1.58\%$
test_ppo_speed[True-None] 4.1073ms 3.6067ms 277.2651 Ops/s 276.3330 Ops/s $\color{#35bf28}+0.34\%$
test_ppo_speed[True-backward] 8.7357ms 8.3666ms 119.5227 Ops/s 119.3363 Ops/s $\color{#35bf28}+0.16\%$
test_ppo_speed[reduce-overhead-None] 4.0944ms 3.5673ms 280.3247 Ops/s 276.6241 Ops/s $\color{#35bf28}+1.34\%$
test_ppo_speed[reduce-overhead-backward] 8.8482ms 8.6506ms 115.5990 Ops/s 115.5498 Ops/s $\color{#35bf28}+0.04\%$
test_reinforce_speed[False-None] 4.9197ms 4.5386ms 220.3332 Ops/s 219.3383 Ops/s $\color{#35bf28}+0.45\%$
test_reinforce_speed[False-backward] 8.0563ms 7.3541ms 135.9781 Ops/s 134.7680 Ops/s $\color{#35bf28}+0.90\%$
test_reinforce_speed[True-None] 2.9913ms 2.8611ms 349.5203 Ops/s 349.1716 Ops/s $\color{#35bf28}+0.10\%$
test_reinforce_speed[True-backward] 7.9943ms 7.7561ms 128.9308 Ops/s 119.9767 Ops/s $\textbf{\color{#35bf28}+7.46\%}$
test_reinforce_speed[reduce-overhead-None] 3.3020ms 2.8522ms 350.6031 Ops/s 347.3807 Ops/s $\color{#35bf28}+0.93\%$
test_reinforce_speed[reduce-overhead-backward] 8.3272ms 7.8256ms 127.7851 Ops/s 121.8512 Ops/s $\color{#35bf28}+4.87\%$
test_iql_speed[False-None] 24.4817ms 20.1398ms 49.6530 Ops/s 49.8889 Ops/s $\color{#d91a1a}-0.47\%$
test_iql_speed[False-backward] 34.1445ms 30.5839ms 32.6970 Ops/s 33.4678 Ops/s $\color{#d91a1a}-2.30\%$
test_iql_speed[True-None] 8.8120ms 8.4377ms 118.5163 Ops/s 116.5322 Ops/s $\color{#35bf28}+1.70\%$
test_iql_speed[True-backward] 17.1331ms 16.6946ms 59.8995 Ops/s 58.6130 Ops/s $\color{#35bf28}+2.19\%$
test_iql_speed[reduce-overhead-None] 8.7999ms 8.5330ms 117.1923 Ops/s 116.6705 Ops/s $\color{#35bf28}+0.45\%$
test_iql_speed[reduce-overhead-backward] 17.5731ms 17.1431ms 58.3325 Ops/s 56.1366 Ops/s $\color{#35bf28}+3.91\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.4858ms 6.3332ms 157.8975 Ops/s 160.6149 Ops/s $\color{#d91a1a}-1.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5687ms 0.3299ms 3.0316 KOps/s 3.0369 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5731ms 0.3068ms 3.2595 KOps/s 3.1780 KOps/s $\color{#35bf28}+2.56\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.2308ms 5.9870ms 167.0295 Ops/s 168.1966 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9343ms 0.3426ms 2.9190 KOps/s 2.9667 KOps/s $\color{#d91a1a}-1.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4956ms 0.2927ms 3.4160 KOps/s 3.1509 KOps/s $\textbf{\color{#35bf28}+8.41\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5503ms 1.3431ms 744.5474 Ops/s 756.1967 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6372ms 1.2657ms 790.0957 Ops/s 813.5605 Ops/s $\color{#d91a1a}-2.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.5877ms 6.1728ms 162.0016 Ops/s 163.5478 Ops/s $\color{#d91a1a}-0.95\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8449s 1.0308ms 970.1329 Ops/s 2.1127 KOps/s $\textbf{\color{#d91a1a}-54.08\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6420ms 0.4222ms 2.3686 KOps/s 2.1835 KOps/s $\textbf{\color{#35bf28}+8.48\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.1915ms 5.9777ms 167.2884 Ops/s 164.7776 Ops/s $\color{#35bf28}+1.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9791ms 0.3198ms 3.1269 KOps/s 2.9835 KOps/s $\color{#35bf28}+4.81\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6185ms 0.3145ms 3.1793 KOps/s 2.9800 KOps/s $\textbf{\color{#35bf28}+6.69\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.2168ms 5.9673ms 167.5797 Ops/s 169.2622 Ops/s $\color{#d91a1a}-0.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7571ms 0.3420ms 2.9241 KOps/s 2.5968 KOps/s $\textbf{\color{#35bf28}+12.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6741ms 0.3380ms 2.9583 KOps/s 2.7417 KOps/s $\textbf{\color{#35bf28}+7.90\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.3047ms 6.1019ms 163.8825 Ops/s 164.2468 Ops/s $\color{#d91a1a}-0.22\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.4240ms 0.5098ms 1.9614 KOps/s 2.0088 KOps/s $\color{#d91a1a}-2.36\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7489ms 0.4991ms 2.0035 KOps/s 2.0903 KOps/s $\color{#d91a1a}-4.15\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.4766ms 5.1081ms 195.7673 Ops/s 50.3934 Ops/s $\textbf{\color{#35bf28}+288.48\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 4.0364ms 2.0178ms 495.5821 Ops/s 527.8049 Ops/s $\textbf{\color{#d91a1a}-6.11\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.9335ms 0.9166ms 1.0910 KOps/s 831.8965 Ops/s $\textbf{\color{#35bf28}+31.14\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.6296s 17.6219ms 56.7475 Ops/s 192.2312 Ops/s $\textbf{\color{#d91a1a}-70.48\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 9.5570ms 1.8965ms 527.2920 Ops/s 577.7390 Ops/s $\textbf{\color{#d91a1a}-8.73\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.6563ms 0.9216ms 1.0851 KOps/s 1.1343 KOps/s $\color{#d91a1a}-4.34\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 8.1859ms 5.3264ms 187.7433 Ops/s 183.7662 Ops/s $\color{#35bf28}+2.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 4.0321ms 1.8869ms 529.9716 Ops/s 508.0434 Ops/s $\color{#35bf28}+4.32\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 3.3063ms 1.0700ms 934.5715 Ops/s 783.3889 Ops/s $\textbf{\color{#35bf28}+19.30\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 37.3685ms 34.7962ms 28.7388 Ops/s 28.7211 Ops/s $\color{#35bf28}+0.06\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.5221ms 17.6906ms 56.5271 Ops/s 55.3493 Ops/s $\color{#35bf28}+2.13\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 39.8912ms 35.9901ms 27.7854 Ops/s 28.0526 Ops/s $\color{#d91a1a}-0.95\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 20.3629ms 18.3393ms 54.5278 Ops/s 55.5085 Ops/s $\color{#d91a1a}-1.77\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 40.4403ms 38.8589ms 25.7342 Ops/s 26.3375 Ops/s $\color{#d91a1a}-2.29\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.6749ms 20.3048ms 49.2494 Ops/s 51.6200 Ops/s $\color{#d91a1a}-4.59\%$

@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Dec 31, 2025
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 7c92a6d
Pull-Request: #3286
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: d5fae60
Pull-Request: #3286
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Jan 1, 2026
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: 34cd3ab
Pull-Request: #3286

amend

ghstack-source-id: 34cd3ab
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: b6179e0
Pull-Request: #3286

amend

ghstack-source-id: b6179e0
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 8379fda
Pull-Request: #3286

amend

ghstack-source-id: 8379fda
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 535577c
Pull-Request: #3286

amend

ghstack-source-id: 535577c
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: fc83efd
Pull-Request: #3286

amend

ghstack-source-id: fc83efd
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 5eaa840
Pull-Request: #3286

amend

ghstack-source-id: 5eaa840
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 962c34a
Pull-Request: #3286

amend

ghstack-source-id: 962c34a
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 25150bf
Pull-Request: #3286

amend

ghstack-source-id: 25150bf
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: b46a1fc
Pull-Request: #3286

amend

ghstack-source-id: b46a1fc
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 5e3eb25
Pull-Request: #3286

amend

ghstack-source-id: 5e3eb25
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: b8e2fb6
Pull-Request: #3286

amend

ghstack-source-id: b8e2fb6
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 9e0548b
Pull-Request: #3286

amend

ghstack-source-id: 9e0548b
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 0b6c546
Pull-Request: #3286

amend

ghstack-source-id: 0b6c546
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 29dcfb5
Pull-Request: #3286

amend

ghstack-source-id: 29dcfb5
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 17, 2026
ghstack-source-id: 061eec5
Pull-Request: #3286

amend

ghstack-source-id: 061eec5
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 18, 2026
ghstack-source-id: 12520e5
Pull-Request: #3286

amend

ghstack-source-id: 12520e5
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 19, 2026
ghstack-source-id: a7c93d0
Pull-Request: #3286

amend

ghstack-source-id: a7c93d0
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 19, 2026
ghstack-source-id: bec6ee6
Pull-Request: #3286

amend

ghstack-source-id: bec6ee6
Pull-Request: #3287
@vmoens vmoens added the Environments Adds or modifies an environment wrapper label Jan 19, 2026
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 19, 2026
ghstack-source-id: 26d8659
Pull-Request: #3286

amend

ghstack-source-id: 26d8659
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 19, 2026
ghstack-source-id: 6cd28e1
Pull-Request: #3286

amend

ghstack-source-id: 6cd28e1
Pull-Request: #3287
vmoens added a commit that referenced this pull request Jan 19, 2026
ghstack-source-id: 6cd28e1
Pull-Request: #3286

amend

ghstack-source-id: 6cd28e1
Pull-Request: #3287
@vmoens vmoens merged commit 1ff8f81 into gh/vmoens/172/base Jan 19, 2026
97 of 109 checks passed
@vmoens vmoens deleted the gh/vmoens/172/head branch January 19, 2026 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants