Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BugFix] Fix colab in tutos #2113

Merged
merged 3 commits into from
Apr 25, 2024
Merged

[BugFix] Fix colab in tutos #2113

merged 3 commits into from
Apr 25, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 25, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 25, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2113

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 2 Unrelated Failures

As of commit b4a6ada with merge base fd280ed (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 25, 2024
@vmoens vmoens added bug Something isn't working documentation Improvements or additions to documentation ciflow/docs tests full docs CI labels Apr 25, 2024
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 25, 2024

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 25, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 56.0819ms 54.8020ms 18.2475 Ops/s 18.8737 Ops/s $\color{#d91a1a}-3.32\%$
test_sync 36.0835ms 29.6264ms 33.7537 Ops/s 34.2178 Ops/s $\color{#d91a1a}-1.36\%$
test_async 56.6706ms 26.5205ms 37.7067 Ops/s 37.9417 Ops/s $\color{#d91a1a}-0.62\%$
test_simple 0.3404s 0.3387s 2.9524 Ops/s 2.9689 Ops/s $\color{#d91a1a}-0.56\%$
test_transformed 0.4886s 0.4872s 2.0526 Ops/s 2.0073 Ops/s $\color{#35bf28}+2.26\%$
test_serial 1.2743s 1.2271s 0.8149 Ops/s 0.8159 Ops/s $\color{#d91a1a}-0.11\%$
test_parallel 1.0548s 1.0132s 0.9870 Ops/s 0.9979 Ops/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-True-True-True-True] 0.3185ms 21.7843μs 45.9046 KOps/s 46.0963 KOps/s $\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-True-True-True-False] 80.9010μs 13.3538μs 74.8848 KOps/s 76.0377 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[True-True-True-False-True] 39.2540μs 12.6622μs 78.9753 KOps/s 78.8640 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-True-True-False-False] 67.4560μs 7.7340μs 129.2989 KOps/s 129.7820 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[True-True-False-True-True] 50.5640μs 22.9174μs 43.6349 KOps/s 43.8067 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-True-False-True-False] 66.5560μs 14.5397μs 68.7774 KOps/s 69.0946 KOps/s $\color{#d91a1a}-0.46\%$
test_step_mdp_speed[True-True-False-False-True] 77.4140μs 13.8916μs 71.9859 KOps/s 71.9498 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-False-False-False] 33.2510μs 9.0300μs 110.7423 KOps/s 111.9999 KOps/s $\color{#d91a1a}-1.12\%$
test_step_mdp_speed[True-False-True-True-True] 58.3590μs 24.1642μs 41.3836 KOps/s 41.4224 KOps/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[True-False-True-True-False] 40.5760μs 15.9222μs 62.8052 KOps/s 63.6329 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[True-False-True-False-True] 42.6100μs 13.9513μs 71.6780 KOps/s 72.2109 KOps/s $\color{#d91a1a}-0.74\%$
test_step_mdp_speed[True-False-True-False-False] 31.8800μs 9.0623μs 110.3474 KOps/s 110.8896 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-False-False-True-True] 58.8300μs 25.5243μs 39.1783 KOps/s 39.4553 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-False-False-True-False] 41.9790μs 17.1737μs 58.2286 KOps/s 58.8491 KOps/s $\color{#d91a1a}-1.05\%$
test_step_mdp_speed[True-False-False-False-True] 64.6490μs 15.0903μs 66.2679 KOps/s 66.3631 KOps/s $\color{#d91a1a}-0.14\%$
test_step_mdp_speed[True-False-False-False-False] 52.0080μs 10.1755μs 98.2755 KOps/s 98.8329 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-True-True-True] 72.5850μs 24.1240μs 41.4526 KOps/s 41.2700 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-True-True-False] 49.1710μs 15.8960μs 62.9089 KOps/s 63.2572 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[False-True-True-False-True] 46.8780μs 15.9248μs 62.7951 KOps/s 62.1207 KOps/s $\color{#35bf28}+1.09\%$
test_step_mdp_speed[False-True-True-False-False] 36.2880μs 10.3229μs 96.8717 KOps/s 98.2337 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[False-True-False-True-True] 41.3370μs 25.9488μs 38.5374 KOps/s 38.5768 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-True-False-True-False] 53.4180μs 17.1371μs 58.3529 KOps/s 58.8591 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-True-False-False-True] 53.0490μs 17.2810μs 57.8669 KOps/s 57.9524 KOps/s $\color{#d91a1a}-0.15\%$
test_step_mdp_speed[False-True-False-False-False] 40.3950μs 11.5668μs 86.4541 KOps/s 87.9343 KOps/s $\color{#d91a1a}-1.68\%$
test_step_mdp_speed[False-False-True-True-True] 87.1630μs 26.6497μs 37.5238 KOps/s 37.6421 KOps/s $\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-False-True-True-False] 47.7190μs 18.6328μs 53.6688 KOps/s 54.5710 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[False-False-True-False-True] 59.8310μs 17.3611μs 57.6000 KOps/s 58.0494 KOps/s $\color{#d91a1a}-0.77\%$
test_step_mdp_speed[False-False-True-False-False] 42.3390μs 11.4565μs 87.2866 KOps/s 89.1614 KOps/s $\color{#d91a1a}-2.10\%$
test_step_mdp_speed[False-False-False-True-True] 91.4510μs 27.5612μs 36.2828 KOps/s 36.4687 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-False-True-False] 87.1330μs 19.8719μs 50.3224 KOps/s 52.4507 KOps/s $\color{#d91a1a}-4.06\%$
test_step_mdp_speed[False-False-False-False-True] 46.2870μs 18.0184μs 55.4988 KOps/s 54.7262 KOps/s $\color{#35bf28}+1.41\%$
test_step_mdp_speed[False-False-False-False-False] 67.2450μs 12.5619μs 79.6059 KOps/s 81.5502 KOps/s $\color{#d91a1a}-2.38\%$
test_values[generalized_advantage_estimate-True-True] 11.7210ms 9.6990ms 103.1030 Ops/s 106.5389 Ops/s $\color{#d91a1a}-3.23\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.8591ms 35.1571ms 28.4437 Ops/s 28.4419 Ops/s $+0.01\%$
test_values[td0_return_estimate-False-False] 0.2282ms 0.1773ms 5.6395 KOps/s 5.9477 KOps/s $\textbf{\color{#d91a1a}-5.18\%}$
test_values[td1_return_estimate-False-False] 25.3225ms 24.2641ms 41.2131 Ops/s 42.2138 Ops/s $\color{#d91a1a}-2.37\%$
test_values[vec_td1_return_estimate-False-False] 36.5047ms 35.3550ms 28.2846 Ops/s 28.3656 Ops/s $\color{#d91a1a}-0.29\%$
test_values[td_lambda_return_estimate-True-False] 37.4470ms 34.9321ms 28.6270 Ops/s 29.3210 Ops/s $\color{#d91a1a}-2.37\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.7437ms 35.3036ms 28.3258 Ops/s 28.3869 Ops/s $\color{#d91a1a}-0.22\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.5638ms 8.5829ms 116.5112 Ops/s 123.5309 Ops/s $\textbf{\color{#d91a1a}-5.68\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.5681ms 1.9906ms 502.3522 Ops/s 504.1998 Ops/s $\color{#d91a1a}-0.37\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4803ms 0.3585ms 2.7892 KOps/s 2.8876 KOps/s $\color{#d91a1a}-3.41\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 44.3665ms 43.0451ms 23.2315 Ops/s 21.7485 Ops/s $\textbf{\color{#35bf28}+6.82\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7669ms 3.0627ms 326.5102 Ops/s 328.0555 Ops/s $\color{#d91a1a}-0.47\%$
test_dqn_speed 1.5705ms 1.3833ms 722.8930 Ops/s 738.7805 Ops/s $\color{#d91a1a}-2.15\%$
test_ddpg_speed 3.1816ms 2.9175ms 342.7561 Ops/s 348.7309 Ops/s $\color{#d91a1a}-1.71\%$
test_sac_speed 10.4806ms 8.8815ms 112.5936 Ops/s 116.8119 Ops/s $\color{#d91a1a}-3.61\%$
test_redq_speed 15.2897ms 13.5105ms 74.0165 Ops/s 75.4295 Ops/s $\color{#d91a1a}-1.87\%$
test_redq_deprec_speed 14.9301ms 13.9691ms 71.5867 Ops/s 72.5610 Ops/s $\color{#d91a1a}-1.34\%$
test_td3_speed 9.3449ms 8.6524ms 115.5752 Ops/s 117.9927 Ops/s $\color{#d91a1a}-2.05\%$
test_cql_speed 39.8051ms 37.2384ms 26.8540 Ops/s 26.6066 Ops/s $\color{#35bf28}+0.93\%$
test_a2c_speed 8.3730ms 7.6981ms 129.9025 Ops/s 130.5768 Ops/s $\color{#d91a1a}-0.52\%$
test_ppo_speed 8.8904ms 7.8889ms 126.7607 Ops/s 125.1786 Ops/s $\color{#35bf28}+1.26\%$
test_reinforce_speed 7.7077ms 6.7791ms 147.5114 Ops/s 146.2095 Ops/s $\color{#35bf28}+0.89\%$
test_iql_speed 34.6455ms 33.1580ms 30.1586 Ops/s 30.0590 Ops/s $\color{#35bf28}+0.33\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.4138ms 2.2539ms 443.6803 Ops/s 422.1214 Ops/s $\textbf{\color{#35bf28}+5.11\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8436ms 0.5126ms 1.9507 KOps/s 1.9323 KOps/s $\color{#35bf28}+0.95\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.4084ms 0.4809ms 2.0794 KOps/s 2.0304 KOps/s $\color{#35bf28}+2.41\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.4255ms 2.2798ms 438.6363 Ops/s 435.3859 Ops/s $\color{#35bf28}+0.75\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9227ms 0.4987ms 2.0053 KOps/s 2.0139 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7603ms 0.4798ms 2.0842 KOps/s 2.1018 KOps/s $\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0319ms 1.2703ms 787.2148 Ops/s 812.2137 Ops/s $\color{#d91a1a}-3.08\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6993ms 1.1983ms 834.5494 Ops/s 857.7788 Ops/s $\color{#d91a1a}-2.71\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.3782ms 2.3718ms 421.6169 Ops/s 429.4993 Ops/s $\color{#d91a1a}-1.84\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9094ms 0.6199ms 1.6131 KOps/s 1.6231 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7393ms 0.6001ms 1.6665 KOps/s 1.6422 KOps/s $\color{#35bf28}+1.48\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.4413ms 2.1915ms 456.3132 Ops/s 454.3817 Ops/s $\color{#35bf28}+0.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8126ms 0.5073ms 1.9714 KOps/s 2.0055 KOps/s $\color{#d91a1a}-1.70\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.7611ms 0.4819ms 2.0750 KOps/s 2.1083 KOps/s $\color{#d91a1a}-1.58\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3461ms 2.2340ms 447.6273 Ops/s 444.9103 Ops/s $\color{#35bf28}+0.61\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0356ms 0.4939ms 2.0246 KOps/s 2.0352 KOps/s $\color{#d91a1a}-0.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9373ms 0.4850ms 2.0618 KOps/s 2.0986 KOps/s $\color{#d91a1a}-1.75\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.6599ms 2.4453ms 408.9537 Ops/s 426.8378 Ops/s $\color{#d91a1a}-4.19\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7773ms 0.6203ms 1.6121 KOps/s 1.6314 KOps/s $\color{#d91a1a}-1.18\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.6981ms 0.6046ms 1.6540 KOps/s 1.6774 KOps/s $\color{#d91a1a}-1.39\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1049s 7.7134ms 129.6438 Ops/s 125.8317 Ops/s $\color{#35bf28}+3.03\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.6565ms 12.7055ms 78.7059 Ops/s 82.7243 Ops/s $\color{#d91a1a}-4.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.5494ms 1.0626ms 941.0703 Ops/s 927.0434 Ops/s $\color{#35bf28}+1.51\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1056s 5.7201ms 174.8210 Ops/s 171.0899 Ops/s $\color{#35bf28}+2.18\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1168s 14.5023ms 68.9547 Ops/s 82.7573 Ops/s $\textbf{\color{#d91a1a}-16.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7555ms 1.0849ms 921.7024 Ops/s 927.5442 Ops/s $\color{#d91a1a}-0.63\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1029s 6.0929ms 164.1249 Ops/s 166.2105 Ops/s $\color{#d91a1a}-1.25\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.6156ms 12.7242ms 78.5903 Ops/s 81.0906 Ops/s $\color{#d91a1a}-3.08\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.1655ms 1.3927ms 718.0291 Ops/s 694.6297 Ops/s $\color{#35bf28}+3.37\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 25, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}9$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1011s 0.1009s 9.9084 Ops/s 10.1079 Ops/s $\color{#d91a1a}-1.97\%$
test_sync 86.7239ms 86.4051ms 11.5734 Ops/s 11.3111 Ops/s $\color{#35bf28}+2.32\%$
test_async 0.1619s 70.5348ms 14.1774 Ops/s 11.9449 Ops/s $\textbf{\color{#35bf28}+18.69\%}$
test_single_pixels 0.1115s 0.1115s 8.9712 Ops/s 9.1499 Ops/s $\color{#d91a1a}-1.95\%$
test_sync_pixels 0.1241s 69.5065ms 14.3872 Ops/s 14.1622 Ops/s $\color{#35bf28}+1.59\%$
test_async_pixels 0.1204s 61.5505ms 16.2468 Ops/s 16.1086 Ops/s $\color{#35bf28}+0.86\%$
test_simple 0.6862s 0.6833s 1.4634 Ops/s 1.4782 Ops/s $\color{#d91a1a}-1.00\%$
test_transformed 0.9163s 0.9133s 1.0949 Ops/s 1.1230 Ops/s $\color{#d91a1a}-2.50\%$
test_serial 2.1623s 2.1041s 0.4753 Ops/s 0.4869 Ops/s $\color{#d91a1a}-2.39\%$
test_parallel 1.8334s 1.7639s 0.5669 Ops/s 0.5733 Ops/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[True-True-True-True-True] 82.7010μs 34.3301μs 29.1289 KOps/s 29.5525 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[True-True-True-True-False] 46.4710μs 20.5328μs 48.7026 KOps/s 50.2929 KOps/s $\color{#d91a1a}-3.16\%$
test_step_mdp_speed[True-True-True-False-True] 36.0900μs 19.3713μs 51.6228 KOps/s 53.2501 KOps/s $\color{#d91a1a}-3.06\%$
test_step_mdp_speed[True-True-True-False-False] 31.7910μs 11.5800μs 86.3555 KOps/s 87.5229 KOps/s $\color{#d91a1a}-1.33\%$
test_step_mdp_speed[True-True-False-True-True] 62.1610μs 35.3863μs 28.2595 KOps/s 28.0678 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-True-False-True-False] 78.6310μs 21.9716μs 45.5132 KOps/s 46.0352 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-False-False-True] 60.5410μs 21.0296μs 47.5521 KOps/s 48.7525 KOps/s $\color{#d91a1a}-2.46\%$
test_step_mdp_speed[True-True-False-False-False] 32.1210μs 13.5409μs 73.8505 KOps/s 75.4360 KOps/s $\color{#d91a1a}-2.10\%$
test_step_mdp_speed[True-False-True-True-True] 58.5400μs 37.1993μs 26.8822 KOps/s 27.1476 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[True-False-True-True-False] 46.2310μs 23.9338μs 41.7820 KOps/s 42.2722 KOps/s $\color{#d91a1a}-1.16\%$
test_step_mdp_speed[True-False-True-False-True] 42.3910μs 20.7963μs 48.0855 KOps/s 48.4676 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-False-True-False-False] 33.9210μs 13.3426μs 74.9477 KOps/s 75.1570 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[True-False-False-True-True] 67.6610μs 39.0959μs 25.5781 KOps/s 25.9804 KOps/s $\color{#d91a1a}-1.55\%$
test_step_mdp_speed[True-False-False-True-False] 49.0600μs 26.2766μs 38.0566 KOps/s 39.4055 KOps/s $\color{#d91a1a}-3.42\%$
test_step_mdp_speed[True-False-False-False-True] 43.3310μs 22.6598μs 44.1311 KOps/s 44.7147 KOps/s $\color{#d91a1a}-1.31\%$
test_step_mdp_speed[True-False-False-False-False] 34.8710μs 15.1418μs 66.0426 KOps/s 66.3346 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[False-True-True-True-True] 59.3810μs 37.4560μs 26.6980 KOps/s 26.7557 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-True-True-True-False] 49.1910μs 24.1243μs 41.4520 KOps/s 42.4983 KOps/s $\color{#d91a1a}-2.46\%$
test_step_mdp_speed[False-True-True-False-True] 44.5910μs 24.9669μs 40.0530 KOps/s 41.1169 KOps/s $\color{#d91a1a}-2.59\%$
test_step_mdp_speed[False-True-True-False-False] 37.9810μs 15.3872μs 64.9892 KOps/s 65.3692 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[False-True-False-True-True] 64.4710μs 39.8764μs 25.0775 KOps/s 25.3600 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-False-True-False] 59.8700μs 26.3544μs 37.9443 KOps/s 38.6989 KOps/s $\color{#d91a1a}-1.95\%$
test_step_mdp_speed[False-True-False-False-True] 48.8500μs 26.9788μs 37.0661 KOps/s 37.4837 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-False-False-False] 77.0510μs 16.9418μs 59.0256 KOps/s 59.0020 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[False-False-True-True-True] 67.6810μs 41.3254μs 24.1982 KOps/s 24.3655 KOps/s $\color{#d91a1a}-0.69\%$
test_step_mdp_speed[False-False-True-True-False] 51.1800μs 28.1766μs 35.4905 KOps/s 36.1378 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-False-True-False-True] 49.9210μs 26.8287μs 37.2735 KOps/s 37.5242 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[False-False-True-False-False] 34.9800μs 17.2256μs 58.0531 KOps/s 59.1530 KOps/s $\color{#d91a1a}-1.86\%$
test_step_mdp_speed[False-False-False-True-True] 66.0000μs 42.3637μs 23.6051 KOps/s 23.7096 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[False-False-False-True-False] 57.6010μs 29.6941μs 33.6767 KOps/s 33.9727 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[False-False-False-False-True] 54.4910μs 28.8082μs 34.7123 KOps/s 35.8035 KOps/s $\color{#d91a1a}-3.05\%$
test_step_mdp_speed[False-False-False-False-False] 41.5000μs 19.1721μs 52.1592 KOps/s 53.1251 KOps/s $\color{#d91a1a}-1.82\%$
test_values[generalized_advantage_estimate-True-True] 25.9006ms 24.2858ms 41.1763 Ops/s 43.1137 Ops/s $\color{#d91a1a}-4.49\%$
test_values[vec_generalized_advantage_estimate-True-True] 81.1941ms 3.1855ms 313.9181 Ops/s 299.4686 Ops/s $\color{#35bf28}+4.83\%$
test_values[td0_return_estimate-False-False] 87.6510μs 62.7176μs 15.9445 KOps/s 16.3793 KOps/s $\color{#d91a1a}-2.65\%$
test_values[td1_return_estimate-False-False] 55.1202ms 53.6174ms 18.6507 Ops/s 20.1303 Ops/s $\textbf{\color{#d91a1a}-7.35\%}$
test_values[vec_td1_return_estimate-False-False] 2.0295ms 1.7547ms 569.8895 Ops/s 574.6899 Ops/s $\color{#d91a1a}-0.84\%$
test_values[td_lambda_return_estimate-True-False] 87.4779ms 84.4522ms 11.8410 Ops/s 12.6111 Ops/s $\textbf{\color{#d91a1a}-6.11\%}$
test_values[vec_td_lambda_return_estimate-True-False] 2.1129ms 1.7539ms 570.1573 Ops/s 574.8611 Ops/s $\color{#d91a1a}-0.82\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.7643ms 24.3007ms 41.1511 Ops/s 44.7231 Ops/s $\textbf{\color{#d91a1a}-7.99\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8760ms 0.7182ms 1.3924 KOps/s 1.4747 KOps/s $\textbf{\color{#d91a1a}-5.58\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6949ms 0.6421ms 1.5575 KOps/s 1.5870 KOps/s $\color{#d91a1a}-1.86\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4694ms 1.4446ms 692.2459 Ops/s 697.0298 Ops/s $\color{#d91a1a}-0.69\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9337ms 0.6636ms 1.5069 KOps/s 1.5353 KOps/s $\color{#d91a1a}-1.85\%$
test_dqn_speed 1.5532ms 1.4222ms 703.1391 Ops/s 704.6178 Ops/s $\color{#d91a1a}-0.21\%$
test_ddpg_speed 3.0923ms 2.9267ms 341.6780 Ops/s 349.7712 Ops/s $\color{#d91a1a}-2.31\%$
test_sac_speed 8.7474ms 8.3467ms 119.8082 Ops/s 120.1806 Ops/s $\color{#d91a1a}-0.31\%$
test_redq_speed 10.9525ms 10.0982ms 99.0272 Ops/s 99.0760 Ops/s $\color{#d91a1a}-0.05\%$
test_redq_deprec_speed 11.8698ms 11.3940ms 87.7657 Ops/s 91.0537 Ops/s $\color{#d91a1a}-3.61\%$
test_td3_speed 17.4218ms 8.3776ms 119.3661 Ops/s 123.1592 Ops/s $\color{#d91a1a}-3.08\%$
test_cql_speed 27.3163ms 25.8154ms 38.7366 Ops/s 39.2525 Ops/s $\color{#d91a1a}-1.31\%$
test_a2c_speed 6.5203ms 5.6775ms 176.1335 Ops/s 181.7654 Ops/s $\color{#d91a1a}-3.10\%$
test_ppo_speed 6.1967ms 5.9727ms 167.4298 Ops/s 172.0228 Ops/s $\color{#d91a1a}-2.67\%$
test_reinforce_speed 4.8091ms 4.6455ms 215.2601 Ops/s 222.1123 Ops/s $\color{#d91a1a}-3.08\%$
test_iql_speed 20.6401ms 19.7834ms 50.5474 Ops/s 51.4077 Ops/s $\color{#d91a1a}-1.67\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.8930ms 2.7954ms 357.7324 Ops/s 359.7910 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1018s 0.6058ms 1.6508 KOps/s 1.8821 KOps/s $\textbf{\color{#d91a1a}-12.29\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6928ms 0.5124ms 1.9517 KOps/s 1.9567 KOps/s $\color{#d91a1a}-0.25\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9844ms 2.8267ms 353.7643 Ops/s 358.3356 Ops/s $\color{#d91a1a}-1.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6666ms 0.5251ms 1.9045 KOps/s 1.9099 KOps/s $\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.1257ms 0.5086ms 1.9661 KOps/s 1.9897 KOps/s $\color{#d91a1a}-1.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4881ms 1.4019ms 713.2942 Ops/s 602.7638 Ops/s $\textbf{\color{#35bf28}+18.34\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5329ms 1.3357ms 748.6871 Ops/s 730.2836 Ops/s $\color{#35bf28}+2.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0502ms 2.9285ms 341.4701 Ops/s 342.1307 Ops/s $\color{#d91a1a}-0.19\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.2870ms 0.6513ms 1.5354 KOps/s 1.5292 KOps/s $\color{#35bf28}+0.40\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7708ms 0.6328ms 1.5803 KOps/s 1.5742 KOps/s $\color{#35bf28}+0.39\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.8569ms 2.7798ms 359.7366 Ops/s 364.0597 Ops/s $\color{#d91a1a}-1.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6485ms 0.5338ms 1.8734 KOps/s 1.8845 KOps/s $\color{#d91a1a}-0.59\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6512ms 0.5138ms 1.9465 KOps/s 1.9371 KOps/s $\color{#35bf28}+0.48\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9836ms 2.8305ms 353.2930 Ops/s 355.8862 Ops/s $\color{#d91a1a}-0.73\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6201ms 0.5264ms 1.8996 KOps/s 1.9139 KOps/s $\color{#d91a1a}-0.75\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7062ms 0.5055ms 1.9783 KOps/s 1.9817 KOps/s $\color{#d91a1a}-0.17\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0581ms 2.9628ms 337.5235 Ops/s 345.1453 Ops/s $\color{#d91a1a}-2.21\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5519ms 0.6612ms 1.5123 KOps/s 1.5387 KOps/s $\color{#d91a1a}-1.71\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7624ms 0.6334ms 1.5787 KOps/s 1.5787 KOps/s $-0.00\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1286s 9.6349ms 103.7894 Ops/s 133.5901 Ops/s $\textbf{\color{#d91a1a}-22.31\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 21.0828ms 14.8930ms 67.1455 Ops/s 68.6509 Ops/s $\color{#d91a1a}-2.19\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.2748ms 1.3248ms 754.8550 Ops/s 908.2252 Ops/s $\textbf{\color{#d91a1a}-16.89\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1153s 7.0888ms 141.0675 Ops/s 141.7761 Ops/s $\color{#d91a1a}-0.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.3244ms 14.8989ms 67.1193 Ops/s 68.4338 Ops/s $\color{#d91a1a}-1.92\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.8276ms 1.3137ms 761.1910 Ops/s 901.4381 Ops/s $\textbf{\color{#d91a1a}-15.56\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1182s 7.5053ms 133.2390 Ops/s 101.8566 Ops/s $\textbf{\color{#35bf28}+30.81\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.4216ms 14.9656ms 66.8198 Ops/s 67.0549 Ops/s $\color{#d91a1a}-0.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7021ms 1.5070ms 663.5580 Ops/s 701.3678 Ops/s $\textbf{\color{#d91a1a}-5.39\%}$

@vmoens vmoens merged commit 160a946 into main Apr 25, 2024
47 of 51 checks passed
@vmoens vmoens deleted the fix-colab branch April 25, 2024 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
bug Something isn't working ciflow/docs tests full docs CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot