[BugFix] Use rsync in doc workflow

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1741

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (6 Unrelated Failures)

As of commit f4a4aa2 with merge base 4a6cc52 ():

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• Build M1 Wheels / pytorch/rl / wheel-py3_8-cpu (gh)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
• Olddeps Tests on Linux / unittests (3.8, 11.6) / linux-job (gh)
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Unit-tests on Windows CPU / unittests / windows-job (gh)
• Unit-tests on Windows GPU / unittests / windows-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	64.4592ms	63.3594ms	15.7830 Ops/s	15.2349 Ops/s	$\color{#35bf28}+3.60\%$
test_sync	40.1139ms	34.5769ms	28.9210 Ops/s	29.0350 Ops/s	$\color{#d91a1a}-0.39\%$
test_async	77.3987ms	33.7069ms	29.6675 Ops/s	30.4360 Ops/s	$\color{#d91a1a}-2.52\%$
test_simple	0.5027s	0.4437s	2.2538 Ops/s	2.3184 Ops/s	$\color{#d91a1a}-2.79\%$
test_transformed	0.6814s	0.6169s	1.6211 Ops/s	1.6781 Ops/s	$\color{#d91a1a}-3.40\%$
test_serial	1.4265s	1.3637s	0.7333 Ops/s	0.7567 Ops/s	$\color{#d91a1a}-3.09\%$
test_parallel	1.3465s	1.2874s	0.7768 Ops/s	0.7789 Ops/s	$\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-True-True-True-True]	0.1053ms	22.8771μs	43.7118 KOps/s	43.9480 KOps/s	$\color{#d91a1a}-0.54\%$
test_step_mdp_speed[True-True-True-True-False]	46.1760μs	14.0082μs	71.3866 KOps/s	73.2171 KOps/s	$\color{#d91a1a}-2.50\%$
test_step_mdp_speed[True-True-True-False-True]	62.8680μs	13.8685μs	72.1056 KOps/s	71.9899 KOps/s	$\color{#35bf28}+0.16\%$
test_step_mdp_speed[True-True-True-False-False]	30.8480μs	8.4052μs	118.9734 KOps/s	122.9392 KOps/s	$\color{#d91a1a}-3.23\%$
test_step_mdp_speed[True-True-False-True-True]	62.9880μs	24.2939μs	41.1625 KOps/s	41.0625 KOps/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-True-False-True-False]	68.7280μs	15.2035μs	65.7743 KOps/s	66.2006 KOps/s	$\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-True-False-False-True]	51.2760μs	15.2671μs	65.5001 KOps/s	65.5093 KOps/s	$\color{#d91a1a}-0.01\%$
test_step_mdp_speed[True-True-False-False-False]	31.2490μs	9.6996μs	103.0975 KOps/s	103.0391 KOps/s	$\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-False-True-True-True]	58.3390μs	26.0475μs	38.3914 KOps/s	39.0877 KOps/s	$\color{#d91a1a}-1.78\%$
test_step_mdp_speed[True-False-True-True-False]	66.9850μs	16.6009μs	60.2378 KOps/s	60.9235 KOps/s	$\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-False-True-False-True]	41.3880μs	15.2227μs	65.6916 KOps/s	66.1962 KOps/s	$\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-False-True-False-False]	35.3160μs	9.6174μs	103.9787 KOps/s	105.9366 KOps/s	$\color{#d91a1a}-1.85\%$
test_step_mdp_speed[True-False-False-True-True]	73.4270μs	27.1213μs	36.8714 KOps/s	36.8645 KOps/s	$\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-False-False-True-False]	58.0790μs	17.9398μs	55.7419 KOps/s	57.0778 KOps/s	$\color{#d91a1a}-2.34\%$
test_step_mdp_speed[True-False-False-False-True]	40.4460μs	16.3904μs	61.0114 KOps/s	59.7109 KOps/s	$\color{#35bf28}+2.18\%$
test_step_mdp_speed[True-False-False-False-False]	43.7820μs	10.9974μs	90.9306 KOps/s	94.1941 KOps/s	$\color{#d91a1a}-3.46\%$
test_step_mdp_speed[False-True-True-True-True]	52.3680μs	25.7837μs	38.7842 KOps/s	38.7404 KOps/s	$\color{#35bf28}+0.11\%$
test_step_mdp_speed[False-True-True-True-False]	59.9460μs	16.5189μs	60.5367 KOps/s	61.3835 KOps/s	$\color{#d91a1a}-1.38\%$
test_step_mdp_speed[False-True-True-False-True]	47.3690μs	17.7131μs	56.4553 KOps/s	56.5890 KOps/s	$\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-True-False-False]	46.9240μs	10.8601μs	92.0800 KOps/s	92.5039 KOps/s	$\color{#d91a1a}-0.46\%$
test_step_mdp_speed[False-True-False-True-True]	60.0330μs	27.0508μs	36.9674 KOps/s	37.1889 KOps/s	$\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-True-False-True-False]	47.4790μs	17.7427μs	56.3613 KOps/s	57.3849 KOps/s	$\color{#d91a1a}-1.78\%$
test_step_mdp_speed[False-True-False-False-True]	62.9280μs	18.8571μs	53.0305 KOps/s	52.9574 KOps/s	$\color{#35bf28}+0.14\%$
test_step_mdp_speed[False-True-False-False-False]	59.6010μs	12.2346μs	81.7354 KOps/s	83.8925 KOps/s	$\color{#d91a1a}-2.57\%$
test_step_mdp_speed[False-False-True-True-True]	81.4430μs	28.2942μs	35.3429 KOps/s	35.3700 KOps/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-False-True-True-False]	71.9450μs	19.3458μs	51.6909 KOps/s	53.2677 KOps/s	$\color{#d91a1a}-2.96\%$
test_step_mdp_speed[False-False-True-False-True]	57.5380μs	18.9705μs	52.7134 KOps/s	53.4022 KOps/s	$\color{#d91a1a}-1.29\%$
test_step_mdp_speed[False-False-True-False-False]	38.4320μs	12.2943μs	81.3387 KOps/s	83.9501 KOps/s	$\color{#d91a1a}-3.11\%$
test_step_mdp_speed[False-False-False-True-True]	81.4860μs	29.3487μs	34.0731 KOps/s	34.2440 KOps/s	$\color{#d91a1a}-0.50\%$
test_step_mdp_speed[False-False-False-True-False]	53.8110μs	20.3639μs	49.1066 KOps/s	50.5224 KOps/s	$\color{#d91a1a}-2.80\%$
test_step_mdp_speed[False-False-False-False-True]	52.4690μs	20.1353μs	49.6641 KOps/s	50.9688 KOps/s	$\color{#d91a1a}-2.56\%$
test_step_mdp_speed[False-False-False-False-False]	36.3480μs	13.3967μs	74.6455 KOps/s	78.0217 KOps/s	$\color{#d91a1a}-4.33\%$
test_values[generalized_advantage_estimate-True-True]	12.8058ms	12.2423ms	81.6841 Ops/s	84.0250 Ops/s	$\color{#d91a1a}-2.79\%$
test_values[vec_generalized_advantage_estimate-True-True]	38.3155ms	29.0380ms	34.4376 Ops/s	35.2204 Ops/s	$\color{#d91a1a}-2.22\%$
test_values[td0_return_estimate-False-False]	0.9425ms	0.2030ms	4.9268 KOps/s	5.7061 KOps/s	$\textbf{\color{#d91a1a}-13.66\%}$
test_values[td1_return_estimate-False-False]	26.1680ms	25.8237ms	38.7242 Ops/s	39.4287 Ops/s	$\color{#d91a1a}-1.79\%$
test_values[vec_td1_return_estimate-False-False]	36.4978ms	28.3273ms	35.3016 Ops/s	35.1931 Ops/s	$\color{#35bf28}+0.31\%$
test_values[td_lambda_return_estimate-True-False]	38.1323ms	36.2311ms	27.6006 Ops/s	28.0595 Ops/s	$\color{#d91a1a}-1.64\%$
test_values[vec_td_lambda_return_estimate-True-False]	37.2281ms	28.5327ms	35.0475 Ops/s	34.8029 Ops/s	$\color{#35bf28}+0.70\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.2672ms	8.0985ms	123.4791 Ops/s	125.9045 Ops/s	$\color{#d91a1a}-1.93\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.9134ms	1.7456ms	572.8718 Ops/s	464.5421 Ops/s	$\textbf{\color{#35bf28}+23.32\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	8.7883ms	0.4389ms	2.2785 KOps/s	2.1357 KOps/s	$\textbf{\color{#35bf28}+6.69\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	46.4245ms	40.0769ms	24.9520 Ops/s	24.4728 Ops/s	$\color{#35bf28}+1.96\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	2.8100ms	2.6318ms	379.9689 Ops/s	378.1002 Ops/s	$\color{#35bf28}+0.49\%$
test_dqn_speed	8.8174ms	1.6528ms	605.0379 Ops/s	615.5250 Ops/s	$\color{#d91a1a}-1.70\%$
test_ddpg_speed	11.5326ms	3.6235ms	275.9726 Ops/s	278.4113 Ops/s	$\color{#d91a1a}-0.88\%$
test_sac_speed	18.5463ms	10.2758ms	97.3156 Ops/s	98.6378 Ops/s	$\color{#d91a1a}-1.34\%$
test_redq_speed	27.3912ms	19.5640ms	51.1143 Ops/s	51.7695 Ops/s	$\color{#d91a1a}-1.27\%$
test_redq_deprec_speed	24.9017ms	15.8687ms	63.0173 Ops/s	66.1543 Ops/s	$\color{#d91a1a}-4.74\%$
test_td3_speed	18.6131ms	10.6519ms	93.8799 Ops/s	94.4542 Ops/s	$\color{#d91a1a}-0.61\%$
test_cql_speed	49.0569ms	39.8993ms	25.0631 Ops/s	24.7934 Ops/s	$\color{#35bf28}+1.09\%$
test_a2c_speed	10.5544ms	8.5694ms	116.6940 Ops/s	115.4787 Ops/s	$\color{#35bf28}+1.05\%$
test_ppo_speed	18.1381ms	9.6959ms	103.1364 Ops/s	110.4669 Ops/s	$\textbf{\color{#d91a1a}-6.64\%}$
test_reinforce_speed	16.0327ms	8.1820ms	122.2192 Ops/s	129.9115 Ops/s	$\textbf{\color{#d91a1a}-5.92\%}$
test_iql_speed	44.3228ms	35.6404ms	28.0580 Ops/s	28.1714 Ops/s	$\color{#d91a1a}-0.40\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.6621ms	1.9431ms	514.6447 Ops/s	516.5597 Ops/s	$\color{#d91a1a}-0.37\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.6470ms	2.0855ms	479.5045 Ops/s	479.0091 Ops/s	$\color{#35bf28}+0.10\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.0738ms	2.0889ms	478.7204 Ops/s	498.7567 Ops/s	$\color{#d91a1a}-4.02\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.8260ms	1.8929ms	528.2826 Ops/s	530.6632 Ops/s	$\color{#d91a1a}-0.45\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.9529ms	2.0527ms	487.1608 Ops/s	505.5296 Ops/s	$\color{#d91a1a}-3.63\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	2.9912ms	2.0732ms	482.3559 Ops/s	509.6914 Ops/s	$\textbf{\color{#d91a1a}-5.36\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.5730ms	1.8939ms	528.0035 Ops/s	530.8489 Ops/s	$\color{#d91a1a}-0.54\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	2.9728ms	2.0380ms	490.6857 Ops/s	497.4070 Ops/s	$\color{#d91a1a}-1.35\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.0871ms	2.0995ms	476.3072 Ops/s	495.8124 Ops/s	$\color{#d91a1a}-3.93\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.0752ms	1.8911ms	528.7887 Ops/s	520.3315 Ops/s	$\color{#35bf28}+1.63\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	2.9409ms	2.0525ms	487.2004 Ops/s	469.9606 Ops/s	$\color{#35bf28}+3.67\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.1108ms	2.0404ms	490.1000 Ops/s	502.6426 Ops/s	$\color{#d91a1a}-2.50\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.9580ms	1.9152ms	522.1451 Ops/s	526.1045 Ops/s	$\color{#d91a1a}-0.75\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	3.4310ms	2.0655ms	484.1442 Ops/s	490.6188 Ops/s	$\color{#d91a1a}-1.32\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.1335ms	2.0580ms	485.9029 Ops/s	459.4591 Ops/s	$\textbf{\color{#35bf28}+5.76\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1068ms	1.9594ms	510.3656 Ops/s	503.6622 Ops/s	$\color{#35bf28}+1.33\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.5376ms	2.0697ms	483.1677 Ops/s	495.6419 Ops/s	$\color{#d91a1a}-2.52\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.2184ms	2.0666ms	483.8918 Ops/s	488.3622 Ops/s	$\color{#d91a1a}-0.92\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1715s	17.8227ms	56.1084 Ops/s	58.3430 Ops/s	$\color{#d91a1a}-3.83\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1064s	16.1515ms	61.9137 Ops/s	63.5956 Ops/s	$\color{#d91a1a}-2.64\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1084s	16.2584ms	61.5067 Ops/s	61.4543 Ops/s	$\color{#35bf28}+0.09\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1133s	16.4837ms	60.6661 Ops/s	61.5025 Ops/s	$\color{#d91a1a}-1.36\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1282s	16.7429ms	59.7268 Ops/s	55.2077 Ops/s	$\textbf{\color{#35bf28}+8.19\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1128s	16.4241ms	60.8860 Ops/s	61.7746 Ops/s	$\color{#d91a1a}-1.44\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1112s	16.3003ms	61.3487 Ops/s	62.3669 Ops/s	$\color{#d91a1a}-1.63\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1096s	16.2053ms	61.7080 Ops/s	60.8124 Ops/s	$\color{#35bf28}+1.47\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1137s	16.1704ms	61.8412 Ops/s	59.4977 Ops/s	$\color{#35bf28}+3.94\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1212s	0.1208s	8.2791 Ops/s	8.2486 Ops/s	$\color{#35bf28}+0.37\%$
test_sync	0.1057s	0.1029s	9.7207 Ops/s	9.7640 Ops/s	$\color{#d91a1a}-0.44\%$
test_async	0.2746s	0.1007s	9.9274 Ops/s	10.1306 Ops/s	$\color{#d91a1a}-2.01\%$
test_single_pixels	0.1326s	0.1321s	7.5720 Ops/s	6.9237 Ops/s	$\textbf{\color{#35bf28}+9.36\%}$
test_sync_pixels	95.2059ms	94.2724ms	10.6076 Ops/s	10.6055 Ops/s	$\color{#35bf28}+0.02\%$
test_async_pixels	0.2461s	90.8475ms	11.0075 Ops/s	10.9448 Ops/s	$\color{#35bf28}+0.57\%$
test_simple	0.9471s	0.8784s	1.1384 Ops/s	1.1350 Ops/s	$\color{#35bf28}+0.30\%$
test_transformed	1.1895s	1.1277s	0.8868 Ops/s	0.8860 Ops/s	$\color{#35bf28}+0.08\%$
test_serial	2.5116s	2.4608s	0.4064 Ops/s	0.4054 Ops/s	$\color{#35bf28}+0.24\%$
test_parallel	2.5536s	2.4755s	0.4040 Ops/s	0.4024 Ops/s	$\color{#35bf28}+0.40\%$
test_step_mdp_speed[True-True-True-True-True]	0.1036ms	35.2177μs	28.3948 KOps/s	28.8095 KOps/s	$\color{#d91a1a}-1.44\%$
test_step_mdp_speed[True-True-True-True-False]	48.0710μs	20.7364μs	48.2244 KOps/s	48.9540 KOps/s	$\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-True-True-False-True]	41.4810μs	20.6218μs	48.4923 KOps/s	49.3306 KOps/s	$\color{#d91a1a}-1.70\%$
test_step_mdp_speed[True-True-True-False-False]	40.2610μs	12.0573μs	82.9373 KOps/s	83.2946 KOps/s	$\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-True-False-True-True]	65.0020μs	36.8664μs	27.1250 KOps/s	27.7273 KOps/s	$\color{#d91a1a}-2.17\%$
test_step_mdp_speed[True-True-False-True-False]	42.3210μs	22.3098μs	44.8233 KOps/s	45.1776 KOps/s	$\color{#d91a1a}-0.78\%$
test_step_mdp_speed[True-True-False-False-True]	39.9000μs	22.9212μs	43.6277 KOps/s	45.6843 KOps/s	$\color{#d91a1a}-4.50\%$
test_step_mdp_speed[True-True-False-False-False]	28.8900μs	14.1332μs	70.7554 KOps/s	72.5359 KOps/s	$\color{#d91a1a}-2.45\%$
test_step_mdp_speed[True-False-True-True-True]	60.5820μs	38.9301μs	25.6871 KOps/s	25.9334 KOps/s	$\color{#d91a1a}-0.95\%$
test_step_mdp_speed[True-False-True-True-False]	49.1010μs	24.5598μs	40.7170 KOps/s	41.4025 KOps/s	$\color{#d91a1a}-1.66\%$
test_step_mdp_speed[True-False-True-False-True]	41.2610μs	22.3813μs	44.6801 KOps/s	45.0673 KOps/s	$\color{#d91a1a}-0.86\%$
test_step_mdp_speed[True-False-True-False-False]	30.6200μs	14.0839μs	71.0029 KOps/s	72.8518 KOps/s	$\color{#d91a1a}-2.54\%$
test_step_mdp_speed[True-False-False-True-True]	71.7610μs	41.0029μs	24.3885 KOps/s	25.2505 KOps/s	$\color{#d91a1a}-3.41\%$
test_step_mdp_speed[True-False-False-True-False]	48.2310μs	26.2874μs	38.0410 KOps/s	38.2241 KOps/s	$\color{#d91a1a}-0.48\%$
test_step_mdp_speed[True-False-False-False-True]	39.6610μs	24.2044μs	41.3148 KOps/s	42.4491 KOps/s	$\color{#d91a1a}-2.67\%$
test_step_mdp_speed[True-False-False-False-False]	41.1900μs	16.1749μs	61.8244 KOps/s	64.0273 KOps/s	$\color{#d91a1a}-3.44\%$
test_step_mdp_speed[False-True-True-True-True]	59.3310μs	39.1500μs	25.5428 KOps/s	26.5199 KOps/s	$\color{#d91a1a}-3.68\%$
test_step_mdp_speed[False-True-True-True-False]	42.0910μs	24.6506μs	40.5670 KOps/s	41.5088 KOps/s	$\color{#d91a1a}-2.27\%$
test_step_mdp_speed[False-True-True-False-True]	52.2710μs	27.4661μs	36.4085 KOps/s	38.2505 KOps/s	$\color{#d91a1a}-4.82\%$
test_step_mdp_speed[False-True-True-False-False]	33.1610μs	15.9676μs	62.6267 KOps/s	64.1415 KOps/s	$\color{#d91a1a}-2.36\%$
test_step_mdp_speed[False-True-False-True-True]	65.8810μs	41.0538μs	24.3583 KOps/s	24.8824 KOps/s	$\color{#d91a1a}-2.11\%$
test_step_mdp_speed[False-True-False-True-False]	54.5310μs	26.5059μs	37.7275 KOps/s	38.5850 KOps/s	$\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-True-False-False-True]	73.5820μs	28.8281μs	34.6883 KOps/s	36.3481 KOps/s	$\color{#d91a1a}-4.57\%$
test_step_mdp_speed[False-True-False-False-False]	40.9010μs	17.6258μs	56.7350 KOps/s	56.7326 KOps/s	$+0.00\%$
test_step_mdp_speed[False-False-True-True-True]	85.8320μs	42.4725μs	23.5446 KOps/s	24.0452 KOps/s	$\color{#d91a1a}-2.08\%$
test_step_mdp_speed[False-False-True-True-False]	46.6910μs	28.1880μs	35.4760 KOps/s	35.3825 KOps/s	$\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-False-True-False-True]	64.0320μs	28.9335μs	34.5620 KOps/s	35.9027 KOps/s	$\color{#d91a1a}-3.73\%$
test_step_mdp_speed[False-False-True-False-False]	33.9110μs	17.7367μs	56.3804 KOps/s	56.5845 KOps/s	$\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-False-False-True-True]	83.7220μs	43.9702μs	22.7427 KOps/s	23.2296 KOps/s	$\color{#d91a1a}-2.10\%$
test_step_mdp_speed[False-False-False-True-False]	47.3010μs	30.1039μs	33.2182 KOps/s	34.1303 KOps/s	$\color{#d91a1a}-2.67\%$
test_step_mdp_speed[False-False-False-False-True]	59.3910μs	30.6536μs	32.6226 KOps/s	34.5763 KOps/s	$\textbf{\color{#d91a1a}-5.65\%}$
test_step_mdp_speed[False-False-False-False-False]	41.9210μs	19.3236μs	51.7503 KOps/s	52.8300 KOps/s	$\color{#d91a1a}-2.04\%$
test_values[generalized_advantage_estimate-True-True]	25.6918ms	25.2591ms	39.5896 Ops/s	40.7390 Ops/s	$\color{#d91a1a}-2.82\%$
test_values[vec_generalized_advantage_estimate-True-True]	83.7492ms	3.2561ms	307.1185 Ops/s	299.6089 Ops/s	$\color{#35bf28}+2.51\%$
test_values[td0_return_estimate-False-False]	0.1017ms	64.5909μs	15.4821 KOps/s	14.8537 KOps/s	$\color{#35bf28}+4.23\%$
test_values[td1_return_estimate-False-False]	56.2270ms	55.1244ms	18.1408 Ops/s	18.7581 Ops/s	$\color{#d91a1a}-3.29\%$
test_values[vec_td1_return_estimate-False-False]	2.0252ms	1.7716ms	564.4642 Ops/s	561.5045 Ops/s	$\color{#35bf28}+0.53\%$
test_values[td_lambda_return_estimate-True-False]	89.9631ms	88.2298ms	11.3340 Ops/s	11.6841 Ops/s	$\color{#d91a1a}-3.00\%$
test_values[vec_td_lambda_return_estimate-True-False]	2.0681ms	1.7736ms	563.8119 Ops/s	563.5063 Ops/s	$\color{#35bf28}+0.05\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	24.3980ms	23.7564ms	42.0939 Ops/s	41.2899 Ops/s	$\color{#35bf28}+1.95\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8753ms	0.7124ms	1.4036 KOps/s	1.4036 KOps/s	$-0.00\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7343ms	0.6856ms	1.4586 KOps/s	1.4470 KOps/s	$\color{#35bf28}+0.80\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5327ms	1.4679ms	681.2670 Ops/s	681.1701 Ops/s	$\color{#35bf28}+0.01\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9811ms	0.6903ms	1.4487 KOps/s	1.4528 KOps/s	$\color{#d91a1a}-0.28\%$
test_dqn_speed	8.4912ms	1.4585ms	685.6461 Ops/s	690.0768 Ops/s	$\color{#d91a1a}-0.64\%$
test_ddpg_speed	4.6251ms	3.2283ms	309.7653 Ops/s	303.8488 Ops/s	$\color{#35bf28}+1.95\%$
test_sac_speed	10.1490ms	9.0448ms	110.5610 Ops/s	107.2203 Ops/s	$\color{#35bf28}+3.12\%$
test_redq_speed	16.8252ms	16.4861ms	60.6570 Ops/s	60.2770 Ops/s	$\color{#35bf28}+0.63\%$
test_redq_deprec_speed	0.1013s	13.7603ms	72.6729 Ops/s	78.1215 Ops/s	$\textbf{\color{#d91a1a}-6.97\%}$
test_td3_speed	19.3379ms	9.3509ms	106.9411 Ops/s	106.0525 Ops/s	$\color{#35bf28}+0.84\%$
test_cql_speed	32.1057ms	30.8066ms	32.4606 Ops/s	31.7064 Ops/s	$\color{#35bf28}+2.38\%$
test_a2c_speed	8.3696ms	7.0585ms	141.6724 Ops/s	141.9427 Ops/s	$\color{#d91a1a}-0.19\%$
test_ppo_speed	8.6846ms	7.3699ms	135.6869 Ops/s	135.8742 Ops/s	$\color{#d91a1a}-0.14\%$
test_reinforce_speed	7.5376ms	6.0834ms	164.3824 Ops/s	164.8043 Ops/s	$\color{#d91a1a}-0.26\%$
test_iql_speed	28.4280ms	26.4866ms	37.7549 Ops/s	37.6613 Ops/s	$\color{#35bf28}+0.25\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.0519ms	2.4587ms	406.7225 Ops/s	405.1190 Ops/s	$\color{#35bf28}+0.40\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.7855ms	2.6607ms	375.8447 Ops/s	338.5316 Ops/s	$\textbf{\color{#35bf28}+11.02\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.7461ms	2.6384ms	379.0162 Ops/s	376.6850 Ops/s	$\color{#35bf28}+0.62\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.1378ms	2.4701ms	404.8459 Ops/s	405.9925 Ops/s	$\color{#d91a1a}-0.28\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	3.6144ms	2.6413ms	378.6079 Ops/s	335.3227 Ops/s	$\textbf{\color{#35bf28}+12.91\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.7752ms	2.6585ms	376.1572 Ops/s	377.7545 Ops/s	$\color{#d91a1a}-0.42\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.6975ms	2.4584ms	406.7620 Ops/s	405.1069 Ops/s	$\color{#35bf28}+0.41\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.7804ms	2.6357ms	379.4008 Ops/s	377.2775 Ops/s	$\color{#35bf28}+0.56\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.5947ms	2.6186ms	381.8830 Ops/s	378.5765 Ops/s	$\color{#35bf28}+0.87\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.6621ms	2.4502ms	408.1325 Ops/s	404.2436 Ops/s	$\color{#35bf28}+0.96\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	4.2095ms	2.6425ms	378.4362 Ops/s	376.2025 Ops/s	$\color{#35bf28}+0.59\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.1308ms	2.6465ms	377.8526 Ops/s	378.9987 Ops/s	$\color{#d91a1a}-0.30\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.0869ms	2.4606ms	406.4006 Ops/s	404.7027 Ops/s	$\color{#35bf28}+0.42\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.2760ms	2.6382ms	379.0409 Ops/s	377.0275 Ops/s	$\color{#35bf28}+0.53\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.2213ms	2.6538ms	376.8241 Ops/s	377.3496 Ops/s	$\color{#d91a1a}-0.14\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1414ms	2.4758ms	403.9035 Ops/s	406.4326 Ops/s	$\color{#d91a1a}-0.62\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.4321ms	2.6374ms	379.1543 Ops/s	374.3200 Ops/s	$\color{#35bf28}+1.29\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.1561ms	2.6581ms	376.2078 Ops/s	375.3409 Ops/s	$\color{#35bf28}+0.23\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2139s	19.6755ms	50.8245 Ops/s	51.0276 Ops/s	$\color{#d91a1a}-0.40\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1274s	15.4015ms	64.9287 Ops/s	55.7657 Ops/s	$\textbf{\color{#35bf28}+16.43\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1273s	17.7105ms	56.4638 Ops/s	64.0877 Ops/s	$\textbf{\color{#d91a1a}-11.90\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1293s	17.5877ms	56.8578 Ops/s	55.8215 Ops/s	$\color{#35bf28}+1.86\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1270s	17.6207ms	56.7516 Ops/s	56.0421 Ops/s	$\color{#35bf28}+1.27\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1281s	17.8771ms	55.9375 Ops/s	56.3340 Ops/s	$\color{#d91a1a}-0.70\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1278s	17.8858ms	55.9103 Ops/s	55.6735 Ops/s	$\color{#35bf28}+0.43\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1275s	17.7592ms	56.3089 Ops/s	55.7680 Ops/s	$\color{#35bf28}+0.97\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1284s	17.6009ms	56.8153 Ops/s	55.8000 Ops/s	$\color{#35bf28}+1.82\%$