Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Installation instructions in API ref #1871

Merged
merged 2 commits into from
Feb 5, 2024
Merged

[Doc] Installation instructions in API ref #1871

merged 2 commits into from
Feb 5, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Feb 5, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Feb 5, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1871

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (25 Unrelated Failures)

As of commit 9461d76 with merge base 5f82601 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 5, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 5, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1415s 67.8201ms 14.7449 Ops/s 16.0003 Ops/s $\textbf{\color{#d91a1a}-7.85\%}$
test_sync 40.9163ms 33.8143ms 29.5733 Ops/s 29.2221 Ops/s $\color{#35bf28}+1.20\%$
test_async 0.1474s 33.7580ms 29.6226 Ops/s 30.5146 Ops/s $\color{#d91a1a}-2.92\%$
test_simple 0.4994s 0.4348s 2.3000 Ops/s 2.2716 Ops/s $\color{#35bf28}+1.25\%$
test_transformed 0.6490s 0.5924s 1.6880 Ops/s 1.6528 Ops/s $\color{#35bf28}+2.13\%$
test_serial 1.4038s 1.3417s 0.7453 Ops/s 0.7234 Ops/s $\color{#35bf28}+3.04\%$
test_parallel 1.2720s 1.2183s 0.8208 Ops/s 0.8239 Ops/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[True-True-True-True-True] 0.1520ms 21.6915μs 46.1011 KOps/s 45.9979 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[True-True-True-True-False] 52.5480μs 13.2329μs 75.5690 KOps/s 76.0069 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[True-True-True-False-True] 42.4190μs 12.5573μs 79.6347 KOps/s 78.9842 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-True-True-False-False] 41.6470μs 7.6079μs 131.4421 KOps/s 131.3263 KOps/s $\color{#35bf28}+0.09\%$
test_step_mdp_speed[True-True-False-True-True] 67.9270μs 23.3531μs 42.8209 KOps/s 43.2431 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[True-True-False-True-False] 53.6000μs 14.4166μs 69.3646 KOps/s 69.8909 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[True-True-False-False-True] 67.7960μs 13.9962μs 71.4480 KOps/s 72.0160 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-True-False-False-False] 50.3740μs 8.8812μs 112.5970 KOps/s 111.3811 KOps/s $\color{#35bf28}+1.09\%$
test_step_mdp_speed[True-False-True-True-True] 75.8410μs 24.4879μs 40.8364 KOps/s 41.2101 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[True-False-True-True-False] 40.5050μs 15.9024μs 62.8837 KOps/s 63.0592 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[True-False-True-False-True] 63.9890μs 13.9483μs 71.6933 KOps/s 72.0707 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[True-False-True-False-False] 38.0810μs 9.0348μs 110.6829 KOps/s 112.2674 KOps/s $\color{#d91a1a}-1.41\%$
test_step_mdp_speed[True-False-False-True-True] 77.2030μs 25.6567μs 38.9762 KOps/s 38.6599 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-False-False-True-False] 42.4890μs 17.0477μs 58.6591 KOps/s 58.4078 KOps/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-False-False-False-True] 65.7220μs 15.1675μs 65.9306 KOps/s 65.9485 KOps/s $\color{#d91a1a}-0.03\%$
test_step_mdp_speed[True-False-False-False-False] 48.2900μs 10.1440μs 98.5806 KOps/s 98.6423 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[False-True-True-True-True] 79.7090μs 24.3780μs 41.0205 KOps/s 40.8670 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-True-True-True-False] 59.1400μs 15.8036μs 63.2769 KOps/s 62.5542 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-True-True-False-True] 43.8910μs 16.2050μs 61.7094 KOps/s 61.8465 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-True-True-False-False] 44.8340μs 10.1704μs 98.3245 KOps/s 97.6020 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-True-False-True-True] 62.3960μs 25.7160μs 38.8863 KOps/s 38.7883 KOps/s $\color{#35bf28}+0.25\%$
test_step_mdp_speed[False-True-False-True-False] 62.3050μs 17.0643μs 58.6019 KOps/s 58.8230 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[False-True-False-False-True] 62.6070μs 17.3970μs 57.4811 KOps/s 57.3337 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-True-False-False-False] 49.8630μs 11.4342μs 87.4567 KOps/s 87.8152 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-False-True-True-True] 0.1425ms 27.6679μs 36.1429 KOps/s 36.9500 KOps/s $\color{#d91a1a}-2.18\%$
test_step_mdp_speed[False-False-True-True-False] 44.6830μs 18.4741μs 54.1299 KOps/s 55.0202 KOps/s $\color{#d91a1a}-1.62\%$
test_step_mdp_speed[False-False-True-False-True] 67.9360μs 17.2058μs 58.1199 KOps/s 56.9815 KOps/s $\color{#35bf28}+2.00\%$
test_step_mdp_speed[False-False-True-False-False] 35.9780μs 11.4574μs 87.2801 KOps/s 88.1124 KOps/s $\color{#d91a1a}-0.94\%$
test_step_mdp_speed[False-False-False-True-True] 76.8720μs 28.1179μs 35.5646 KOps/s 35.7639 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-False-False-True-False] 64.9200μs 19.4264μs 51.4763 KOps/s 51.5380 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[False-False-False-False-True] 42.3990μs 18.2831μs 54.6955 KOps/s 53.8418 KOps/s $\color{#35bf28}+1.59\%$
test_step_mdp_speed[False-False-False-False-False] 57.6870μs 12.4903μs 80.0622 KOps/s 80.0495 KOps/s $\color{#35bf28}+0.02\%$
test_values[generalized_advantage_estimate-True-True] 10.5219ms 9.4512ms 105.8067 Ops/s 106.1994 Ops/s $\color{#d91a1a}-0.37\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.7662ms 35.1373ms 28.4598 Ops/s 28.3509 Ops/s $\color{#35bf28}+0.38\%$
test_values[td0_return_estimate-False-False] 0.2239ms 0.1791ms 5.5828 KOps/s 6.0291 KOps/s $\textbf{\color{#d91a1a}-7.40\%}$
test_values[td1_return_estimate-False-False] 23.6388ms 23.2785ms 42.9582 Ops/s 42.3281 Ops/s $\color{#35bf28}+1.49\%$
test_values[vec_td1_return_estimate-False-False] 37.5871ms 35.3033ms 28.3259 Ops/s 28.1842 Ops/s $\color{#35bf28}+0.50\%$
test_values[td_lambda_return_estimate-True-False] 35.9844ms 34.0265ms 29.3889 Ops/s 29.4301 Ops/s $\color{#d91a1a}-0.14\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.4097ms 35.6512ms 28.0495 Ops/s 28.1861 Ops/s $\color{#d91a1a}-0.48\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.2595ms 8.1089ms 123.3207 Ops/s 121.4085 Ops/s $\color{#35bf28}+1.57\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.8212ms 1.8691ms 535.0226 Ops/s 521.8563 Ops/s $\color{#35bf28}+2.52\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5499ms 0.3568ms 2.8029 KOps/s 2.8635 KOps/s $\color{#d91a1a}-2.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.8172ms 46.1722ms 21.6580 Ops/s 21.3044 Ops/s $\color{#35bf28}+1.66\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.1496ms 3.0297ms 330.0630 Ops/s 331.5284 Ops/s $\color{#d91a1a}-0.44\%$
test_dqn_speed 12.0447ms 6.1055ms 163.7879 Ops/s 155.2441 Ops/s $\textbf{\color{#35bf28}+5.50\%}$
test_ddpg_speed 86.1144ms 12.3118ms 81.2227 Ops/s 84.5172 Ops/s $\color{#d91a1a}-3.90\%$
test_sac_speed 25.5519ms 23.5035ms 42.5469 Ops/s 41.7324 Ops/s $\color{#35bf28}+1.95\%$
test_redq_speed 15.5076ms 14.3096ms 69.8834 Ops/s 70.6577 Ops/s $\color{#d91a1a}-1.10\%$
test_redq_deprec_speed 23.4790ms 22.2309ms 44.9823 Ops/s 45.3623 Ops/s $\color{#d91a1a}-0.84\%$
test_td3_speed 26.5368ms 16.5753ms 60.3309 Ops/s 58.9256 Ops/s $\color{#35bf28}+2.38\%$
test_cql_speed 74.7388ms 73.3983ms 13.6243 Ops/s 13.4063 Ops/s $\color{#35bf28}+1.63\%$
test_a2c_speed 25.7263ms 21.8921ms 45.6786 Ops/s 45.3006 Ops/s $\color{#35bf28}+0.83\%$
test_ppo_speed 23.0602ms 22.0559ms 45.3394 Ops/s 44.5765 Ops/s $\color{#35bf28}+1.71\%$
test_reinforce_speed 23.2210ms 21.1148ms 47.3601 Ops/s 46.1350 Ops/s $\color{#35bf28}+2.66\%$
test_iql_speed 56.5512ms 55.5492ms 18.0020 Ops/s 17.6055 Ops/s $\color{#35bf28}+2.25\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.4020ms 2.9594ms 337.9088 Ops/s 364.7219 Ops/s $\textbf{\color{#d91a1a}-7.35\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8008ms 0.5208ms 1.9200 KOps/s 1.9481 KOps/s $\color{#d91a1a}-1.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7823ms 0.4864ms 2.0561 KOps/s 2.0468 KOps/s $\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1968ms 2.8595ms 349.7058 Ops/s 362.4037 Ops/s $\color{#d91a1a}-3.50\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6569ms 0.5034ms 1.9864 KOps/s 1.9523 KOps/s $\color{#35bf28}+1.75\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7976ms 0.4849ms 2.0623 KOps/s 2.0642 KOps/s $\color{#d91a1a}-0.09\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.8380ms 2.6290ms 380.3779 Ops/s 387.5583 Ops/s $\color{#d91a1a}-1.85\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9273ms 0.6241ms 1.6024 KOps/s 1.5913 KOps/s $\color{#35bf28}+0.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0704ms 0.5970ms 1.6751 KOps/s 1.6584 KOps/s $\color{#35bf28}+1.00\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0359ms 2.8310ms 353.2292 Ops/s 356.2735 Ops/s $\color{#d91a1a}-0.85\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6710ms 0.5157ms 1.9392 KOps/s 1.9568 KOps/s $\color{#d91a1a}-0.90\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8571ms 0.4888ms 2.0459 KOps/s 2.0278 KOps/s $\color{#35bf28}+0.89\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2190ms 2.9399ms 340.1476 Ops/s 348.9407 Ops/s $\color{#d91a1a}-2.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8737ms 0.5137ms 1.9465 KOps/s 1.9687 KOps/s $\color{#d91a1a}-1.13\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6206ms 0.4895ms 2.0430 KOps/s 1.9457 KOps/s $\textbf{\color{#35bf28}+5.00\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0441ms 2.6762ms 373.6679 Ops/s 387.1129 Ops/s $\color{#d91a1a}-3.47\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9850ms 0.6373ms 1.5690 KOps/s 1.5749 KOps/s $\color{#d91a1a}-0.37\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7212ms 0.6124ms 1.6329 KOps/s 1.6452 KOps/s $\color{#d91a1a}-0.75\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1068s 8.3001ms 120.4800 Ops/s 95.6802 Ops/s $\textbf{\color{#35bf28}+25.92\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.0319ms 13.4827ms 74.1689 Ops/s 73.6640 Ops/s $\color{#35bf28}+0.69\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.6705ms 2.6408ms 378.6783 Ops/s 389.4778 Ops/s $\color{#d91a1a}-2.77\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1114s 10.4669ms 95.5392 Ops/s 101.0571 Ops/s $\textbf{\color{#d91a1a}-5.46\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.2898ms 13.7193ms 72.8898 Ops/s 73.9874 Ops/s $\color{#d91a1a}-1.48\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.0544ms 2.6227ms 381.2826 Ops/s 389.7639 Ops/s $\color{#d91a1a}-2.18\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1165s 8.9006ms 112.3516 Ops/s 115.0294 Ops/s $\color{#d91a1a}-2.33\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.9307ms 14.0454ms 71.1977 Ops/s 72.0380 Ops/s $\color{#d91a1a}-1.17\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.4715ms 2.7641ms 361.7783 Ops/s 364.2343 Ops/s $\color{#d91a1a}-0.67\%$

@vmoens vmoens added the documentation Improvements or additions to documentation label Feb 5, 2024
@vmoens vmoens merged commit 80fc87f into main Feb 5, 2024
12 of 23 checks passed
@vmoens vmoens deleted the pip-in-doc branch February 5, 2024 16:25
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 5, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}0$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1245s 0.1236s 8.0893 Ops/s 8.3758 Ops/s $\color{#d91a1a}-3.42\%$
test_sync 0.1355s 0.1350s 7.4082 Ops/s 7.5996 Ops/s $\color{#d91a1a}-2.52\%$
test_async 0.3311s 0.1308s 7.6444 Ops/s 7.6563 Ops/s $\color{#d91a1a}-0.16\%$
test_single_pixels 0.1441s 0.1432s 6.9826 Ops/s 7.0256 Ops/s $\color{#d91a1a}-0.61\%$
test_sync_pixels 0.1034s 0.1017s 9.8374 Ops/s 10.0816 Ops/s $\color{#d91a1a}-2.42\%$
test_async_pixels 0.2619s 96.1550ms 10.3999 Ops/s 10.4981 Ops/s $\color{#d91a1a}-0.94\%$
test_simple 0.9315s 0.8639s 1.1575 Ops/s 1.1655 Ops/s $\color{#d91a1a}-0.68\%$
test_transformed 1.1739s 1.1123s 0.8991 Ops/s 0.9018 Ops/s $\color{#d91a1a}-0.30\%$
test_serial 2.4908s 2.4397s 0.4099 Ops/s 0.4204 Ops/s $\color{#d91a1a}-2.50\%$
test_parallel 3.3611s 3.1942s 0.3131 Ops/s 0.3125 Ops/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-True-True-True-True] 94.0320μs 32.7296μs 30.5534 KOps/s 30.6616 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-True-True-True-False] 42.9400μs 20.1761μs 49.5635 KOps/s 51.6778 KOps/s $\color{#d91a1a}-4.09\%$
test_step_mdp_speed[True-True-True-False-True] 0.1446ms 18.8278μs 53.1130 KOps/s 53.9236 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[True-True-True-False-False] 30.6410μs 11.2731μs 88.7064 KOps/s 89.1491 KOps/s $\color{#d91a1a}-0.50\%$
test_step_mdp_speed[True-True-False-True-True] 66.2410μs 35.7573μs 27.9663 KOps/s 29.3608 KOps/s $\color{#d91a1a}-4.75\%$
test_step_mdp_speed[True-True-False-True-False] 63.7010μs 22.1403μs 45.1665 KOps/s 47.0826 KOps/s $\color{#d91a1a}-4.07\%$
test_step_mdp_speed[True-True-False-False-True] 79.5910μs 20.8416μs 47.9809 KOps/s 48.8352 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-True-False-False-False] 30.7410μs 13.4169μs 74.5329 KOps/s 77.5082 KOps/s $\color{#d91a1a}-3.84\%$
test_step_mdp_speed[True-False-True-True-True] 62.9800μs 37.0957μs 26.9573 KOps/s 28.0654 KOps/s $\color{#d91a1a}-3.95\%$
test_step_mdp_speed[True-False-True-True-False] 98.8610μs 23.8955μs 41.8489 KOps/s 42.2230 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-True-False-True] 34.9300μs 20.5436μs 48.6770 KOps/s 48.3878 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[True-False-True-False-False] 27.3800μs 13.4434μs 74.3860 KOps/s 77.6772 KOps/s $\color{#d91a1a}-4.24\%$
test_step_mdp_speed[True-False-False-True-True] 0.1159ms 39.4357μs 25.3577 KOps/s 26.8758 KOps/s $\textbf{\color{#d91a1a}-5.65\%}$
test_step_mdp_speed[True-False-False-True-False] 64.9610μs 26.0344μs 38.4107 KOps/s 39.7203 KOps/s $\color{#d91a1a}-3.30\%$
test_step_mdp_speed[True-False-False-False-True] 39.5910μs 22.6891μs 44.0740 KOps/s 44.2692 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[True-False-False-False-False] 74.6010μs 14.9298μs 66.9804 KOps/s 67.6710 KOps/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[False-True-True-True-True] 58.1110μs 37.5353μs 26.6416 KOps/s 27.9747 KOps/s $\color{#d91a1a}-4.77\%$
test_step_mdp_speed[False-True-True-True-False] 44.3110μs 24.2096μs 41.3059 KOps/s 43.0938 KOps/s $\color{#d91a1a}-4.15\%$
test_step_mdp_speed[False-True-True-False-True] 0.1368ms 25.2421μs 39.6163 KOps/s 41.3531 KOps/s $\color{#d91a1a}-4.20\%$
test_step_mdp_speed[False-True-True-False-False] 37.2000μs 15.4162μs 64.8669 KOps/s 68.0503 KOps/s $\color{#d91a1a}-4.68\%$
test_step_mdp_speed[False-True-False-True-True] 0.1191ms 40.0508μs 24.9683 KOps/s 26.1914 KOps/s $\color{#d91a1a}-4.67\%$
test_step_mdp_speed[False-True-False-True-False] 40.5110μs 26.3885μs 37.8953 KOps/s 39.9983 KOps/s $\textbf{\color{#d91a1a}-5.26\%}$
test_step_mdp_speed[False-True-False-False-True] 0.1485ms 26.9070μs 37.1651 KOps/s 38.2944 KOps/s $\color{#d91a1a}-2.95\%$
test_step_mdp_speed[False-True-False-False-False] 34.1810μs 16.9604μs 58.9607 KOps/s 60.0533 KOps/s $\color{#d91a1a}-1.82\%$
test_step_mdp_speed[False-False-True-True-True] 0.2108ms 41.6018μs 24.0374 KOps/s 25.1991 KOps/s $\color{#d91a1a}-4.61\%$
test_step_mdp_speed[False-False-True-True-False] 0.1507ms 28.1296μs 35.5497 KOps/s 37.7295 KOps/s $\textbf{\color{#d91a1a}-5.78\%}$
test_step_mdp_speed[False-False-True-False-True] 0.1879ms 26.9230μs 37.1429 KOps/s 38.6757 KOps/s $\color{#d91a1a}-3.96\%$
test_step_mdp_speed[False-False-True-False-False] 0.2148ms 16.8409μs 59.3792 KOps/s 60.3333 KOps/s $\color{#d91a1a}-1.58\%$
test_step_mdp_speed[False-False-False-True-True] 0.2380ms 42.8748μs 23.3237 KOps/s 24.7980 KOps/s $\textbf{\color{#d91a1a}-5.95\%}$
test_step_mdp_speed[False-False-False-True-False] 0.2085ms 29.5944μs 33.7902 KOps/s 34.8853 KOps/s $\color{#d91a1a}-3.14\%$
test_step_mdp_speed[False-False-False-False-True] 0.2214ms 28.8258μs 34.6911 KOps/s 36.5752 KOps/s $\textbf{\color{#d91a1a}-5.15\%}$
test_step_mdp_speed[False-False-False-False-False] 0.2132ms 18.5488μs 53.9119 KOps/s 54.8143 KOps/s $\color{#d91a1a}-1.65\%$
test_values[generalized_advantage_estimate-True-True] 25.0849ms 24.3359ms 41.0915 Ops/s 42.1386 Ops/s $\color{#d91a1a}-2.48\%$
test_values[vec_generalized_advantage_estimate-True-True] 82.9879ms 3.2145ms 311.0925 Ops/s 309.8672 Ops/s $\color{#35bf28}+0.40\%$
test_values[td0_return_estimate-False-False] 90.5810μs 58.2943μs 17.1543 KOps/s 16.8241 KOps/s $\color{#35bf28}+1.96\%$
test_values[td1_return_estimate-False-False] 52.2723ms 51.6826ms 19.3489 Ops/s 19.6881 Ops/s $\color{#d91a1a}-1.72\%$
test_values[vec_td1_return_estimate-False-False] 1.9110ms 1.7515ms 570.9377 Ops/s 575.1855 Ops/s $\color{#d91a1a}-0.74\%$
test_values[td_lambda_return_estimate-True-False] 82.6319ms 81.9658ms 12.2002 Ops/s 12.3812 Ops/s $\color{#d91a1a}-1.46\%$
test_values[vec_td_lambda_return_estimate-True-False] 4.0765ms 1.7888ms 559.0271 Ops/s 561.6351 Ops/s $\color{#d91a1a}-0.46\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.3465ms 22.8572ms 43.7500 Ops/s 44.3415 Ops/s $\color{#d91a1a}-1.33\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8789ms 0.6894ms 1.4505 KOps/s 1.4671 KOps/s $\color{#d91a1a}-1.14\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7881ms 0.6416ms 1.5586 KOps/s 1.5742 KOps/s $\color{#d91a1a}-1.00\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.7528ms 1.4480ms 690.6114 Ops/s 695.2659 Ops/s $\color{#d91a1a}-0.67\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9306ms 0.6606ms 1.5137 KOps/s 1.5307 KOps/s $\color{#d91a1a}-1.11\%$
test_dqn_speed 7.7119ms 7.2970ms 137.0431 Ops/s 135.1579 Ops/s $\color{#35bf28}+1.39\%$
test_ddpg_speed 15.7155ms 14.2895ms 69.9816 Ops/s 70.7820 Ops/s $\color{#d91a1a}-1.13\%$
test_sac_speed 28.6864ms 27.9766ms 35.7442 Ops/s 35.6713 Ops/s $\color{#35bf28}+0.20\%$
test_redq_speed 13.0218ms 11.6288ms 85.9934 Ops/s 85.6499 Ops/s $\color{#35bf28}+0.40\%$
test_redq_deprec_speed 23.5193ms 22.4562ms 44.5311 Ops/s 44.9155 Ops/s $\color{#d91a1a}-0.86\%$
test_td3_speed 28.7218ms 18.7683ms 53.2813 Ops/s 53.1853 Ops/s $\color{#35bf28}+0.18\%$
test_cql_speed 74.4618ms 73.9364ms 13.5251 Ops/s 13.4484 Ops/s $\color{#35bf28}+0.57\%$
test_a2c_speed 25.6498ms 24.5445ms 40.7424 Ops/s 40.6349 Ops/s $\color{#35bf28}+0.26\%$
test_ppo_speed 25.9405ms 24.8029ms 40.3179 Ops/s 40.4094 Ops/s $\color{#d91a1a}-0.23\%$
test_reinforce_speed 24.7077ms 23.6717ms 42.2445 Ops/s 42.2801 Ops/s $\color{#d91a1a}-0.08\%$
test_iql_speed 50.8238ms 49.7352ms 20.1065 Ops/s 19.9518 Ops/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.9145ms 3.6373ms 274.9299 Ops/s 274.2056 Ops/s $\color{#35bf28}+0.26\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7998ms 0.5534ms 1.8069 KOps/s 1.7989 KOps/s $\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7088ms 0.5267ms 1.8987 KOps/s 1.8912 KOps/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.0315ms 3.6582ms 273.3553 Ops/s 272.3550 Ops/s $\color{#35bf28}+0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7666ms 0.5490ms 1.8215 KOps/s 1.8126 KOps/s $\color{#35bf28}+0.49\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6956ms 0.5240ms 1.9083 KOps/s 1.9133 KOps/s $\color{#d91a1a}-0.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.6313ms 3.3147ms 301.6879 Ops/s 301.3060 Ops/s $\color{#35bf28}+0.13\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9558ms 0.6801ms 1.4704 KOps/s 1.4702 KOps/s $\color{#35bf28}+0.01\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8700ms 0.6520ms 1.5337 KOps/s 1.5156 KOps/s $\color{#35bf28}+1.19\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.9781ms 3.6261ms 275.7770 Ops/s 273.4201 Ops/s $\color{#35bf28}+0.86\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7382ms 0.5545ms 1.8035 KOps/s 1.7957 KOps/s $\color{#35bf28}+0.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7736ms 0.5286ms 1.8919 KOps/s 1.8923 KOps/s $\color{#d91a1a}-0.02\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.0530ms 3.6855ms 271.3353 Ops/s 271.8069 Ops/s $\color{#d91a1a}-0.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7775ms 0.5480ms 1.8249 KOps/s 1.8151 KOps/s $\color{#35bf28}+0.54\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7202ms 0.5244ms 1.9070 KOps/s 1.8999 KOps/s $\color{#35bf28}+0.37\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5878ms 3.3102ms 302.0982 Ops/s 300.4443 Ops/s $\color{#35bf28}+0.55\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9759ms 0.6787ms 1.4735 KOps/s 1.4592 KOps/s $\color{#35bf28}+0.98\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8212ms 0.6523ms 1.5331 KOps/s 1.5160 KOps/s $\color{#35bf28}+1.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1231s 10.1549ms 98.4750 Ops/s 98.1445 Ops/s $\color{#35bf28}+0.34\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.4725ms 16.1574ms 61.8912 Ops/s 61.0269 Ops/s $\color{#35bf28}+1.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.7164ms 3.0972ms 322.8715 Ops/s 330.4636 Ops/s $\color{#d91a1a}-2.30\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1211s 12.3559ms 80.9332 Ops/s 98.1206 Ops/s $\textbf{\color{#d91a1a}-17.52\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.4682ms 16.2650ms 61.4818 Ops/s 61.1038 Ops/s $\color{#35bf28}+0.62\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.8664ms 3.0982ms 322.7666 Ops/s 327.2088 Ops/s $\color{#d91a1a}-1.36\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1209s 10.2984ms 97.1023 Ops/s 96.7963 Ops/s $\color{#35bf28}+0.32\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.5856ms 16.3951ms 60.9938 Ops/s 60.6055 Ops/s $\color{#35bf28}+0.64\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 8.5943ms 3.3262ms 300.6471 Ops/s 306.0448 Ops/s $\color{#d91a1a}-1.76\%$

vmoens added a commit that referenced this pull request Feb 6, 2024
@vmoens
[Doc] Installation instructions in API ref (#1871)
12c8a49
@vmoens vmoens mentioned this pull request Feb 28, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot