Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] RoboHive integration #1119

Merged
merged 66 commits into from
Sep 6, 2023
Merged

[Feature] RoboHive integration #1119

merged 66 commits into from
Sep 6, 2023

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented May 3, 2023 •
edited
Loading

No description provided.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 3, 2023
@vmoens vmoens added the enhancement New feature or request label May 9, 2023
@github-actions
Copy link

github-actions bot commented Jun 30, 2023 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}12$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1818s 0.1800s 5.5540 Ops/s 6.1903 Ops/s $\textbf{\color{#d91a1a}-10.28\%}$
test_sync 0.1891s 0.1031s 9.7009 Ops/s 10.8636 Ops/s $\textbf{\color{#d91a1a}-10.70\%}$
test_async 0.2638s 93.5491ms 10.6896 Ops/s 10.7939 Ops/s $\color{#d91a1a}-0.97\%$
test_simple 1.0053s 0.9352s 1.0693 Ops/s 1.3545 Ops/s $\textbf{\color{#d91a1a}-21.06\%}$
test_transformed 2.1458s 2.0826s 0.4802 Ops/s 0.5338 Ops/s $\textbf{\color{#d91a1a}-10.05\%}$
test_serial 2.6934s 2.6217s 0.3814 Ops/s 0.4993 Ops/s $\textbf{\color{#d91a1a}-23.61\%}$
test_parallel 2.1465s 2.1332s 0.4688 Ops/s 0.5621 Ops/s $\textbf{\color{#d91a1a}-16.60\%}$
test_step_mdp_speed[True-True-True-True-True] 0.2122ms 52.1172μs 19.1875 KOps/s 19.8149 KOps/s $\color{#d91a1a}-3.17\%$
test_step_mdp_speed[True-True-True-True-False] 58.4050μs 29.1543μs 34.3003 KOps/s 35.4268 KOps/s $\color{#d91a1a}-3.18\%$
test_step_mdp_speed[True-True-True-False-True] 74.3060μs 36.0112μs 27.7692 KOps/s 28.3236 KOps/s $\color{#d91a1a}-1.96\%$
test_step_mdp_speed[True-True-True-False-False] 56.0050μs 19.7887μs 50.5338 KOps/s 51.8442 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[True-True-False-True-True] 0.1546ms 52.8132μs 18.9347 KOps/s 19.3567 KOps/s $\color{#d91a1a}-2.18\%$
test_step_mdp_speed[True-True-False-True-False] 81.3080μs 31.1223μs 32.1313 KOps/s 33.3808 KOps/s $\color{#d91a1a}-3.74\%$
test_step_mdp_speed[True-True-False-False-True] 0.1051ms 37.8152μs 26.4444 KOps/s 26.7706 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[True-True-False-False-False] 75.3060μs 22.2529μs 44.9379 KOps/s 45.8629 KOps/s $\color{#d91a1a}-2.02\%$
test_step_mdp_speed[True-False-True-True-True] 99.1090μs 55.4321μs 18.0401 KOps/s 18.6114 KOps/s $\color{#d91a1a}-3.07\%$
test_step_mdp_speed[True-False-True-True-False] 0.1038ms 33.5620μs 29.7956 KOps/s 30.4684 KOps/s $\color{#d91a1a}-2.21\%$
test_step_mdp_speed[True-False-True-False-True] 68.2060μs 37.6952μs 26.5286 KOps/s 26.9327 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[True-False-True-False-False] 50.2040μs 22.2317μs 44.9809 KOps/s 45.5474 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-False-False-True-True] 0.1019ms 56.8707μs 17.5837 KOps/s 18.0902 KOps/s $\color{#d91a1a}-2.80\%$
test_step_mdp_speed[True-False-False-True-False] 0.1001ms 35.4485μs 28.2099 KOps/s 29.0833 KOps/s $\color{#d91a1a}-3.00\%$
test_step_mdp_speed[True-False-False-False-True] 82.1070μs 40.1976μs 24.8771 KOps/s 25.6832 KOps/s $\color{#d91a1a}-3.14\%$
test_step_mdp_speed[True-False-False-False-False] 56.9050μs 24.3122μs 41.1316 KOps/s 42.4991 KOps/s $\color{#d91a1a}-3.22\%$
test_step_mdp_speed[False-True-True-True-True] 3.7073ms 57.0008μs 17.5436 KOps/s 18.5470 KOps/s $\textbf{\color{#d91a1a}-5.41\%}$
test_step_mdp_speed[False-True-True-True-False] 80.4070μs 33.7170μs 29.6587 KOps/s 30.7683 KOps/s $\color{#d91a1a}-3.61\%$
test_step_mdp_speed[False-True-True-False-True] 0.1008ms 43.2318μs 23.1311 KOps/s 24.0079 KOps/s $\color{#d91a1a}-3.65\%$
test_step_mdp_speed[False-True-True-False-False] 3.2421ms 25.0146μs 39.9766 KOps/s 41.3035 KOps/s $\color{#d91a1a}-3.21\%$
test_step_mdp_speed[False-True-False-True-True] 1.6565ms 57.8074μs 17.2988 KOps/s 17.8819 KOps/s $\color{#d91a1a}-3.26\%$
test_step_mdp_speed[False-True-False-True-False] 80.3070μs 35.1320μs 28.4641 KOps/s 29.1162 KOps/s $\color{#d91a1a}-2.24\%$
test_step_mdp_speed[False-True-False-False-True] 0.1600ms 44.9625μs 22.2407 KOps/s 22.9305 KOps/s $\color{#d91a1a}-3.01\%$
test_step_mdp_speed[False-True-False-False-False] 65.5050μs 26.8768μs 37.2068 KOps/s 38.0186 KOps/s $\color{#d91a1a}-2.14\%$
test_step_mdp_speed[False-False-True-True-True] 0.1042ms 59.3676μs 16.8442 KOps/s 16.9716 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[False-False-True-True-False] 70.9050μs 38.0562μs 26.2769 KOps/s 26.8212 KOps/s $\color{#d91a1a}-2.03\%$
test_step_mdp_speed[False-False-True-False-True] 82.7060μs 44.1691μs 22.6403 KOps/s 22.5868 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[False-False-True-False-False] 94.2080μs 26.9351μs 37.1263 KOps/s 38.1644 KOps/s $\color{#d91a1a}-2.72\%$
test_step_mdp_speed[False-False-False-True-True] 0.1012ms 60.9897μs 16.3962 KOps/s 16.4125 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-False-False-True-False] 79.6080μs 40.5125μs 24.6837 KOps/s 25.9419 KOps/s $\color{#d91a1a}-4.85\%$
test_step_mdp_speed[False-False-False-False-True] 86.7070μs 46.8084μs 21.3637 KOps/s 22.2149 KOps/s $\color{#d91a1a}-3.83\%$
test_step_mdp_speed[False-False-False-False-False] 96.9090μs 28.9490μs 34.5435 KOps/s 35.7918 KOps/s $\color{#d91a1a}-3.49\%$
test_values[generalized_advantage_estimate-True-True] 15.6052ms 14.7563ms 67.7678 Ops/s 59.1187 Ops/s $\textbf{\color{#35bf28}+14.63\%}$
test_values[vec_generalized_advantage_estimate-True-True] 55.3842ms 48.0206ms 20.8244 Ops/s 20.6540 Ops/s $\color{#35bf28}+0.82\%$
test_values[td0_return_estimate-False-False] 0.3778ms 0.2212ms 4.5202 KOps/s 4.2876 KOps/s $\textbf{\color{#35bf28}+5.43\%}$
test_values[td1_return_estimate-False-False] 15.0642ms 14.1775ms 70.5345 Ops/s 69.7364 Ops/s $\color{#35bf28}+1.14\%$
test_values[vec_td1_return_estimate-False-False] 56.6900ms 48.0743ms 20.8011 Ops/s 20.8879 Ops/s $\color{#d91a1a}-0.42\%$
test_values[td_lambda_return_estimate-True-False] 38.2674ms 34.0287ms 29.3869 Ops/s 28.6541 Ops/s $\color{#35bf28}+2.56\%$
test_values[vec_td_lambda_return_estimate-True-False] 54.1983ms 48.3895ms 20.6657 Ops/s 21.1132 Ops/s $\color{#d91a1a}-2.12\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 13.1531ms 12.7551ms 78.4003 Ops/s 76.9456 Ops/s $\color{#35bf28}+1.89\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 10.4973ms 4.0728ms 245.5312 Ops/s 248.0580 Ops/s $\color{#d91a1a}-1.02\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 1.3434ms 0.5584ms 1.7908 KOps/s 1.7914 KOps/s $\color{#d91a1a}-0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 72.2484ms 66.9653ms 14.9331 Ops/s 15.3040 Ops/s $\color{#d91a1a}-2.42\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 11.7151ms 3.4376ms 290.9000 Ops/s 300.0214 Ops/s $\color{#d91a1a}-3.04\%$
test_dqn_speed 6.2057ms 2.1754ms 459.6809 Ops/s 461.4401 Ops/s $\color{#d91a1a}-0.38\%$
test_ddpg_speed 9.4112ms 3.2716ms 305.6608 Ops/s 306.7111 Ops/s $\color{#d91a1a}-0.34\%$
test_sac_speed 15.8663ms 9.6453ms 103.6770 Ops/s 105.5457 Ops/s $\color{#d91a1a}-1.77\%$
test_redq_speed 31.2382ms 18.6448ms 53.6344 Ops/s 54.6752 Ops/s $\color{#d91a1a}-1.90\%$
test_redq_deprec_speed 25.1389ms 14.9914ms 66.7051 Ops/s 67.2336 Ops/s $\color{#d91a1a}-0.79\%$
test_td3_speed 12.7675ms 11.5147ms 86.8456 Ops/s 86.5604 Ops/s $\color{#35bf28}+0.33\%$
test_cql_speed 42.2979ms 32.4240ms 30.8413 Ops/s 33.0560 Ops/s $\textbf{\color{#d91a1a}-6.70\%}$
test_a2c_speed 14.7174ms 6.2390ms 160.2827 Ops/s 160.1535 Ops/s $\color{#35bf28}+0.08\%$
test_ppo_speed 21.0850ms 6.8165ms 146.7021 Ops/s 141.5561 Ops/s $\color{#35bf28}+3.64\%$
test_reinforce_speed 11.6215ms 4.8286ms 207.1004 Ops/s 205.7199 Ops/s $\color{#35bf28}+0.67\%$
test_iql_speed 32.0351ms 25.3563ms 39.4379 Ops/s 39.2422 Ops/s $\color{#35bf28}+0.50\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.6852ms 2.9970ms 333.6652 Ops/s 331.3098 Ops/s $\color{#35bf28}+0.71\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 5.7937ms 3.1076ms 321.7938 Ops/s 313.5749 Ops/s $\color{#35bf28}+2.62\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 5.6721ms 3.2018ms 312.3251 Ops/s 313.3831 Ops/s $\color{#d91a1a}-0.34\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.2349ms 3.0029ms 333.0107 Ops/s 335.3585 Ops/s $\color{#d91a1a}-0.70\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 4.7225ms 3.1790ms 314.5664 Ops/s 310.7595 Ops/s $\color{#35bf28}+1.23\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 5.1964ms 3.1725ms 315.2052 Ops/s 313.1521 Ops/s $\color{#35bf28}+0.66\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.3765ms 3.0184ms 331.3040 Ops/s 329.9081 Ops/s $\color{#35bf28}+0.42\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1538s 3.7296ms 268.1266 Ops/s 308.3326 Ops/s $\textbf{\color{#d91a1a}-13.04\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.6000ms 3.1456ms 317.9022 Ops/s 310.8089 Ops/s $\color{#35bf28}+2.28\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 0.2459s 3.7235ms 268.5669 Ops/s 331.6744 Ops/s $\textbf{\color{#d91a1a}-19.03\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 5.7844ms 3.1932ms 313.1650 Ops/s 306.7801 Ops/s $\color{#35bf28}+2.08\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 5.8717ms 3.1241ms 320.0871 Ops/s 315.0968 Ops/s $\color{#35bf28}+1.58\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.7381ms 3.0186ms 331.2837 Ops/s 332.0263 Ops/s $\color{#d91a1a}-0.22\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 4.5978ms 3.1347ms 319.0054 Ops/s 310.4353 Ops/s $\color{#35bf28}+2.76\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.7670ms 3.1428ms 318.1862 Ops/s 304.7637 Ops/s $\color{#35bf28}+4.40\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.2899ms 2.9748ms 336.1534 Ops/s 323.2958 Ops/s $\color{#35bf28}+3.98\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 5.4298ms 3.1869ms 313.7819 Ops/s 302.8317 Ops/s $\color{#35bf28}+3.62\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 5.4647ms 3.2025ms 312.2556 Ops/s 310.4561 Ops/s $\color{#35bf28}+0.58\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.2615s 34.4022ms 29.0679 Ops/s 30.6864 Ops/s $\textbf{\color{#d91a1a}-5.27\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1547s 26.6745ms 37.4890 Ops/s 31.0366 Ops/s $\textbf{\color{#35bf28}+20.79\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.1529s 31.5631ms 31.6826 Ops/s 34.2823 Ops/s $\textbf{\color{#d91a1a}-7.58\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1547s 31.6788ms 31.5669 Ops/s 31.3986 Ops/s $\color{#35bf28}+0.54\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1506s 29.0695ms 34.4003 Ops/s 34.2381 Ops/s $\color{#35bf28}+0.47\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.1491s 31.3714ms 31.8762 Ops/s 30.9165 Ops/s $\color{#35bf28}+3.10\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1520s 29.0061ms 34.4755 Ops/s 34.2659 Ops/s $\color{#35bf28}+0.61\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1522s 31.7682ms 31.4781 Ops/s 31.3865 Ops/s $\color{#35bf28}+0.29\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.1507s 29.0501ms 34.4233 Ops/s 33.5685 Ops/s $\color{#35bf28}+2.55\%$

@github-actions
Copy link

github-actions bot commented Jun 30, 2023 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}13$. Worsened: $\large\color{#d91a1a}22$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.2605s 0.2535s 3.9447 Ops/s 3.9862 Ops/s $\color{#d91a1a}-1.04\%$
test_sync 0.1458s 0.1355s 7.3817 Ops/s 6.6516 Ops/s $\textbf{\color{#35bf28}+10.98\%}$
test_async 0.2004s 0.1330s 7.5205 Ops/s 7.2598 Ops/s $\color{#35bf28}+3.59\%$
test_simple 1.1582s 1.0570s 0.9461 Ops/s 0.9653 Ops/s $\color{#d91a1a}-2.00\%$
test_transformed 2.5739s 2.5035s 0.3994 Ops/s 0.3963 Ops/s $\color{#35bf28}+0.78\%$
test_serial 3.2579s 3.1799s 0.3145 Ops/s 0.3080 Ops/s $\color{#35bf28}+2.10\%$
test_parallel 2.5636s 2.4552s 0.4073 Ops/s 0.4115 Ops/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[True-True-True-True-True] 1.1081ms 57.4878μs 17.3950 KOps/s 15.9623 KOps/s $\textbf{\color{#35bf28}+8.98\%}$
test_step_mdp_speed[True-True-True-True-False] 2.8471ms 35.2259μs 28.3882 KOps/s 30.8232 KOps/s $\textbf{\color{#d91a1a}-7.90\%}$
test_step_mdp_speed[True-True-True-False-True] 1.9863ms 45.1467μs 22.1500 KOps/s 22.0437 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-True-True-False-False] 2.8637ms 26.2784μs 38.0541 KOps/s 40.4637 KOps/s $\textbf{\color{#d91a1a}-5.96\%}$
test_step_mdp_speed[True-True-False-True-True] 3.3889ms 63.0251μs 15.8667 KOps/s 15.5217 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[True-True-False-True-False] 1.2878ms 32.8234μs 30.4661 KOps/s 28.9755 KOps/s $\textbf{\color{#35bf28}+5.14\%}$
test_step_mdp_speed[True-True-False-False-True] 3.8103ms 43.4086μs 23.0369 KOps/s 22.8771 KOps/s $\color{#35bf28}+0.70\%$
test_step_mdp_speed[True-True-False-False-False] 2.8866ms 24.8371μs 40.2624 KOps/s 41.7142 KOps/s $\color{#d91a1a}-3.48\%$
test_step_mdp_speed[True-False-True-True-True] 2.7716ms 63.3961μs 15.7738 KOps/s 16.1865 KOps/s $\color{#d91a1a}-2.55\%$
test_step_mdp_speed[True-False-True-True-False] 2.9774ms 38.0057μs 26.3119 KOps/s 28.5418 KOps/s $\textbf{\color{#d91a1a}-7.81\%}$
test_step_mdp_speed[True-False-True-False-True] 2.7914ms 45.7580μs 21.8541 KOps/s 22.4456 KOps/s $\color{#d91a1a}-2.64\%$
test_step_mdp_speed[True-False-True-False-False] 5.1078ms 24.8524μs 40.2376 KOps/s 38.4950 KOps/s $\color{#35bf28}+4.53\%$
test_step_mdp_speed[True-False-False-True-True] 9.5203ms 67.7191μs 14.7669 KOps/s 14.1699 KOps/s $\color{#35bf28}+4.21\%$
test_step_mdp_speed[True-False-False-True-False] 3.5956ms 38.9934μs 25.6453 KOps/s 26.2192 KOps/s $\color{#d91a1a}-2.19\%$
test_step_mdp_speed[True-False-False-False-True] 2.9270ms 47.8275μs 20.9085 KOps/s 20.3107 KOps/s $\color{#35bf28}+2.94\%$
test_step_mdp_speed[True-False-False-False-False] 4.7259ms 27.4715μs 36.4014 KOps/s 36.5642 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[False-True-True-True-True] 1.4559ms 64.9817μs 15.3889 KOps/s 14.2341 KOps/s $\textbf{\color{#35bf28}+8.11\%}$
test_step_mdp_speed[False-True-True-True-False] 1.1619ms 36.7999μs 27.1740 KOps/s 28.7803 KOps/s $\textbf{\color{#d91a1a}-5.58\%}$
test_step_mdp_speed[False-True-True-False-True] 2.8413ms 51.3655μs 19.4683 KOps/s 19.3585 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-True-True-False-False] 1.4430ms 28.3050μs 35.3295 KOps/s 37.4365 KOps/s $\textbf{\color{#d91a1a}-5.63\%}$
test_step_mdp_speed[False-True-False-True-True] 1.8097ms 65.5496μs 15.2556 KOps/s 15.1651 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-True-False-True-False] 1.5670ms 37.2215μs 26.8662 KOps/s 26.4971 KOps/s $\color{#35bf28}+1.39\%$
test_step_mdp_speed[False-True-False-False-True] 1.2891ms 52.0779μs 19.2020 KOps/s 19.5666 KOps/s $\color{#d91a1a}-1.86\%$
test_step_mdp_speed[False-True-False-False-False] 1.5405ms 29.9627μs 33.3749 KOps/s 32.5546 KOps/s $\color{#35bf28}+2.52\%$
test_step_mdp_speed[False-False-True-True-True] 1.5430ms 67.2851μs 14.8621 KOps/s 15.7208 KOps/s $\textbf{\color{#d91a1a}-5.46\%}$
test_step_mdp_speed[False-False-True-True-False] 2.7822ms 40.4428μs 24.7263 KOps/s 24.5226 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[False-False-True-False-True] 1.2543ms 59.9463μs 16.6816 KOps/s 20.5922 KOps/s $\textbf{\color{#d91a1a}-18.99\%}$
test_step_mdp_speed[False-False-True-False-False] 1.7213ms 29.5979μs 33.7861 KOps/s 34.3004 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[False-False-False-True-True] 1.6169ms 75.5415μs 13.2378 KOps/s 14.6677 KOps/s $\textbf{\color{#d91a1a}-9.75\%}$
test_step_mdp_speed[False-False-False-True-False] 5.3764ms 41.6065μs 24.0347 KOps/s 25.1760 KOps/s $\color{#d91a1a}-4.53\%$
test_step_mdp_speed[False-False-False-False-True] 2.5504ms 54.5564μs 18.3296 KOps/s 18.5774 KOps/s $\color{#d91a1a}-1.33\%$
test_step_mdp_speed[False-False-False-False-False] 5.0698ms 32.2768μs 30.9820 KOps/s 33.3631 KOps/s $\textbf{\color{#d91a1a}-7.14\%}$
test_values[generalized_advantage_estimate-True-True] 33.4450ms 22.1229ms 45.2020 Ops/s 44.7761 Ops/s $\color{#35bf28}+0.95\%$
test_values[vec_generalized_advantage_estimate-True-True] 93.7961ms 79.5725ms 12.5671 Ops/s 12.6970 Ops/s $\color{#d91a1a}-1.02\%$
test_values[td0_return_estimate-False-False] 3.3072ms 0.5090ms 1.9648 KOps/s 2.2076 KOps/s $\textbf{\color{#d91a1a}-11.00\%}$
test_values[td1_return_estimate-False-False] 25.9429ms 21.6221ms 46.2489 Ops/s 45.4233 Ops/s $\color{#35bf28}+1.82\%$
test_values[vec_td1_return_estimate-False-False] 87.0624ms 75.4450ms 13.2547 Ops/s 12.3937 Ops/s $\textbf{\color{#35bf28}+6.95\%}$
test_values[td_lambda_return_estimate-True-False] 73.5938ms 60.8157ms 16.4431 Ops/s 16.5688 Ops/s $\color{#d91a1a}-0.76\%$
test_values[vec_td_lambda_return_estimate-True-False] 95.4545ms 76.8698ms 13.0090 Ops/s 12.9112 Ops/s $\color{#35bf28}+0.76\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 21.4222ms 17.1264ms 58.3893 Ops/s 57.9943 Ops/s $\color{#35bf28}+0.68\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 10.4613ms 5.3175ms 188.0586 Ops/s 189.0938 Ops/s $\color{#d91a1a}-0.55\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 4.3400ms 0.8107ms 1.2335 KOps/s 1.2506 KOps/s $\color{#d91a1a}-1.37\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 84.6701ms 77.4459ms 12.9122 Ops/s 12.0869 Ops/s $\textbf{\color{#35bf28}+6.83\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 12.5397ms 6.6811ms 149.6754 Ops/s 138.4786 Ops/s $\textbf{\color{#35bf28}+8.09\%}$
test_dqn_speed 18.3563ms 2.8142ms 355.3411 Ops/s 360.1038 Ops/s $\color{#d91a1a}-1.32\%$
test_ddpg_speed 9.6116ms 5.1539ms 194.0266 Ops/s 193.0375 Ops/s $\color{#35bf28}+0.51\%$
test_sac_speed 24.3796ms 16.2915ms 61.3818 Ops/s 66.4543 Ops/s $\textbf{\color{#d91a1a}-7.63\%}$
test_redq_speed 0.1605s 32.5570ms 30.7153 Ops/s 36.1303 Ops/s $\textbf{\color{#d91a1a}-14.99\%}$
test_redq_deprec_speed 33.6159ms 25.2776ms 39.5607 Ops/s 42.6103 Ops/s $\textbf{\color{#d91a1a}-7.16\%}$
test_td3_speed 27.2090ms 20.5213ms 48.7299 Ops/s 49.6017 Ops/s $\color{#d91a1a}-1.76\%$
test_cql_speed 64.2974ms 58.1393ms 17.2001 Ops/s 14.7888 Ops/s $\textbf{\color{#35bf28}+16.30\%}$
test_a2c_speed 21.5128ms 13.2197ms 75.6446 Ops/s 74.9262 Ops/s $\color{#35bf28}+0.96\%$
test_ppo_speed 22.8261ms 13.8109ms 72.4064 Ops/s 76.0759 Ops/s $\color{#d91a1a}-4.82\%$
test_reinforce_speed 17.7172ms 11.0399ms 90.5802 Ops/s 89.5530 Ops/s $\color{#35bf28}+1.15\%$
test_iql_speed 64.0805ms 52.6446ms 18.9953 Ops/s 19.2012 Ops/s $\color{#d91a1a}-1.07\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 14.9272ms 4.9566ms 201.7498 Ops/s 202.2994 Ops/s $\color{#d91a1a}-0.27\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 9.6977ms 5.1755ms 193.2193 Ops/s 197.0260 Ops/s $\color{#d91a1a}-1.93\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.8486ms 5.1254ms 195.1065 Ops/s 200.4060 Ops/s $\color{#d91a1a}-2.64\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 10.0724ms 4.9315ms 202.7779 Ops/s 200.8435 Ops/s $\color{#35bf28}+0.96\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 16.1211ms 5.3920ms 185.4587 Ops/s 191.4653 Ops/s $\color{#d91a1a}-3.14\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 10.3983ms 5.2132ms 191.8212 Ops/s 163.3607 Ops/s $\textbf{\color{#35bf28}+17.42\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.1790ms 4.8695ms 205.3617 Ops/s 194.8953 Ops/s $\textbf{\color{#35bf28}+5.37\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.2353s 6.2180ms 160.8238 Ops/s 192.3455 Ops/s $\textbf{\color{#d91a1a}-16.39\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 13.1411ms 5.2448ms 190.6636 Ops/s 193.7988 Ops/s $\color{#d91a1a}-1.62\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.1997ms 5.1282ms 194.9994 Ops/s 171.1272 Ops/s $\textbf{\color{#35bf28}+13.95\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 10.3379ms 5.3082ms 188.3885 Ops/s 194.6858 Ops/s $\color{#d91a1a}-3.23\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 10.1245ms 5.1831ms 192.9340 Ops/s 162.5780 Ops/s $\textbf{\color{#35bf28}+18.67\%}$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 9.8418ms 5.2128ms 191.8354 Ops/s 200.7288 Ops/s $\color{#d91a1a}-4.43\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 12.0389ms 5.3463ms 187.0448 Ops/s 185.4941 Ops/s $\color{#35bf28}+0.84\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 10.4461ms 5.3794ms 185.8958 Ops/s 193.1686 Ops/s $\color{#d91a1a}-3.76\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 0.4274s 7.3231ms 136.5544 Ops/s 172.1167 Ops/s $\textbf{\color{#d91a1a}-20.66\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 9.2150ms 5.1733ms 193.3015 Ops/s 190.7267 Ops/s $\color{#35bf28}+1.35\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 10.5978ms 5.1559ms 193.9540 Ops/s 163.8803 Ops/s $\textbf{\color{#35bf28}+18.35\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.3977s 53.9871ms 18.5229 Ops/s 21.4576 Ops/s $\textbf{\color{#d91a1a}-13.68\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.2389s 46.9342ms 21.3064 Ops/s 20.7959 Ops/s $\color{#35bf28}+2.45\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.2328s 46.2280ms 21.6319 Ops/s 22.5586 Ops/s $\color{#d91a1a}-4.11\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.2506s 50.6036ms 19.7614 Ops/s 22.5108 Ops/s $\textbf{\color{#d91a1a}-12.21\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.2306s 47.3468ms 21.1208 Ops/s 22.4473 Ops/s $\textbf{\color{#d91a1a}-5.91\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.2366s 51.2704ms 19.5044 Ops/s 20.8135 Ops/s $\textbf{\color{#d91a1a}-6.29\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.2375s 48.1852ms 20.7533 Ops/s 21.9642 Ops/s $\textbf{\color{#d91a1a}-5.51\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.2743s 49.2641ms 20.2988 Ops/s 22.4574 Ops/s $\textbf{\color{#d91a1a}-9.61\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.2323s 46.8397ms 21.3494 Ops/s 23.1080 Ops/s $\textbf{\color{#d91a1a}-7.61\%}$

@vmoens
Copy link
Contributor Author

vmoens commented Sep 6, 2023

@vikashplus this is ready to be merged! Will be part of 0.2.0 release :D

@vikashplus
Copy link

Super cool! Glad the tests are passing. There is something related to habitat not passing but I guess its unrelated.

LGTM

@vmoens vmoens merged commit 0ed2208 into main Sep 6, 2023
@vmoens vmoens deleted the rlhive branch September 6, 2023 15:40
vmoens added a commit to hyerra/rl that referenced this pull request Oct 10, 2023
@vmoens
[Feature] RoboHive integration (pytorch#1119)
d5ddd3d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@vikashplus vikashplus vikashplus approved these changes

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@vmoens @vikashplus @facebook-github-bot