[CI] FIx nightly builds on osx

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1726

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (4 Unrelated Failures)

As of commit 9cfe051 with merge base d545364 ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Unit-tests on Linux CPU / tests (3.10) / linux-job (gh)
• Unit-tests on Linux CPU / tests (3.8) / linux-job (gh)
• Unit-tests on Windows CPU / unittests / windows-job (gh)

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	66.6048ms	65.3815ms	15.2949 Ops/s	14.4309 Ops/s	$\textbf{\color{#35bf28}+5.99\%}$
test_sync	46.7321ms	36.1238ms	27.6826 Ops/s	27.4168 Ops/s	$\color{#35bf28}+0.97\%$
test_async	62.4500ms	32.8873ms	30.4068 Ops/s	28.4599 Ops/s	$\textbf{\color{#35bf28}+6.84\%}$
test_simple	0.5288s	0.4609s	2.1695 Ops/s	2.2239 Ops/s	$\color{#d91a1a}-2.44\%$
test_transformed	0.6967s	0.6341s	1.5772 Ops/s	1.6077 Ops/s	$\color{#d91a1a}-1.90\%$
test_serial	1.4691s	1.4055s	0.7115 Ops/s	0.7233 Ops/s	$\color{#d91a1a}-1.64\%$
test_parallel	1.4328s	1.3679s	0.7311 Ops/s	0.7466 Ops/s	$\color{#d91a1a}-2.08\%$
test_step_mdp_speed[True-True-True-True-True]	0.2000ms	23.1936μs	43.1154 KOps/s	43.4633 KOps/s	$\color{#d91a1a}-0.80\%$
test_step_mdp_speed[True-True-True-True-False]	61.6490μs	14.2997μs	69.9315 KOps/s	70.3353 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-True-False-True]	72.4450μs	14.3025μs	69.9178 KOps/s	70.5649 KOps/s	$\color{#d91a1a}-0.92\%$
test_step_mdp_speed[True-True-True-False-False]	60.3330μs	8.6978μs	114.9710 KOps/s	117.2618 KOps/s	$\color{#d91a1a}-1.95\%$
test_step_mdp_speed[True-True-False-True-True]	55.1840μs	25.0408μs	39.9349 KOps/s	41.1890 KOps/s	$\color{#d91a1a}-3.04\%$
test_step_mdp_speed[True-True-False-True-False]	53.1900μs	15.8849μs	62.9529 KOps/s	65.0951 KOps/s	$\color{#d91a1a}-3.29\%$
test_step_mdp_speed[True-True-False-False-True]	62.0260μs	15.8398μs	63.1322 KOps/s	65.3559 KOps/s	$\color{#d91a1a}-3.40\%$
test_step_mdp_speed[True-True-False-False-False]	50.2350μs	10.1309μs	98.7082 KOps/s	99.9469 KOps/s	$\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-False-True-True-True]	59.2310μs	26.6199μs	37.5659 KOps/s	38.5106 KOps/s	$\color{#d91a1a}-2.45\%$
test_step_mdp_speed[True-False-True-True-False]	61.6550μs	17.2553μs	57.9532 KOps/s	58.4092 KOps/s	$\color{#d91a1a}-0.78\%$
test_step_mdp_speed[True-False-True-False-True]	49.6230μs	15.7396μs	63.5341 KOps/s	65.3230 KOps/s	$\color{#d91a1a}-2.74\%$
test_step_mdp_speed[True-False-True-False-False]	48.2410μs	10.0102μs	99.8983 KOps/s	100.7992 KOps/s	$\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-False-True-True]	64.3510μs	27.7064μs	36.0927 KOps/s	36.8658 KOps/s	$\color{#d91a1a}-2.10\%$
test_step_mdp_speed[True-False-False-True-False]	64.7810μs	18.5434μs	53.9275 KOps/s	54.7791 KOps/s	$\color{#d91a1a}-1.55\%$
test_step_mdp_speed[True-False-False-False-True]	75.3820μs	17.1755μs	58.2224 KOps/s	59.4432 KOps/s	$\color{#d91a1a}-2.05\%$
test_step_mdp_speed[True-False-False-False-False]	49.0720μs	11.3075μs	88.4370 KOps/s	89.2922 KOps/s	$\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-True-True-True-True]	67.4760μs	26.4305μs	37.8351 KOps/s	38.4769 KOps/s	$\color{#d91a1a}-1.67\%$
test_step_mdp_speed[False-True-True-True-False]	51.5070μs	17.2832μs	57.8597 KOps/s	58.9474 KOps/s	$\color{#d91a1a}-1.85\%$
test_step_mdp_speed[False-True-True-False-True]	59.5980μs	17.9498μs	55.7110 KOps/s	55.4260 KOps/s	$\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-True-True-False-False]	35.0760μs	11.3247μs	88.3023 KOps/s	89.4960 KOps/s	$\color{#d91a1a}-1.33\%$
test_step_mdp_speed[False-True-False-True-True]	70.1710μs	27.6106μs	36.2180 KOps/s	36.7511 KOps/s	$\color{#d91a1a}-1.45\%$
test_step_mdp_speed[False-True-False-True-False]	97.2420μs	18.4133μs	54.3087 KOps/s	55.1380 KOps/s	$\color{#d91a1a}-1.50\%$
test_step_mdp_speed[False-True-False-False-True]	53.0100μs	18.9662μs	52.7252 KOps/s	53.3162 KOps/s	$\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-False-False-False]	85.4500μs	12.7014μs	78.7315 KOps/s	78.9875 KOps/s	$\color{#d91a1a}-0.32\%$
test_step_mdp_speed[False-False-True-True-True]	77.5960μs	28.8707μs	34.6372 KOps/s	35.0837 KOps/s	$\color{#d91a1a}-1.27\%$
test_step_mdp_speed[False-False-True-True-False]	53.3900μs	20.0988μs	49.7543 KOps/s	50.7242 KOps/s	$\color{#d91a1a}-1.91\%$
test_step_mdp_speed[False-False-True-False-True]	53.6110μs	19.3565μs	51.6623 KOps/s	52.6032 KOps/s	$\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-False-True-False-False]	50.6050μs	12.7771μs	78.2649 KOps/s	80.7256 KOps/s	$\color{#d91a1a}-3.05\%$
test_step_mdp_speed[False-False-False-True-True]	86.9740μs	30.5206μs	32.7648 KOps/s	33.5646 KOps/s	$\color{#d91a1a}-2.38\%$
test_step_mdp_speed[False-False-False-True-False]	64.3510μs	21.1433μs	47.2962 KOps/s	48.2256 KOps/s	$\color{#d91a1a}-1.93\%$
test_step_mdp_speed[False-False-False-False-True]	61.2250μs	20.5417μs	48.6815 KOps/s	49.6952 KOps/s	$\color{#d91a1a}-2.04\%$
test_step_mdp_speed[False-False-False-False-False]	65.8530μs	13.7492μs	72.7314 KOps/s	74.4395 KOps/s	$\color{#d91a1a}-2.29\%$
test_values[generalized_advantage_estimate-True-True]	13.9079ms	12.4622ms	80.2429 Ops/s	80.6843 Ops/s	$\color{#d91a1a}-0.55\%$
test_values[vec_generalized_advantage_estimate-True-True]	37.8994ms	27.4956ms	36.3695 Ops/s	36.9580 Ops/s	$\color{#d91a1a}-1.59\%$
test_values[td0_return_estimate-False-False]	0.2802ms	0.2091ms	4.7817 KOps/s	4.4013 KOps/s	$\textbf{\color{#35bf28}+8.64\%}$
test_values[td1_return_estimate-False-False]	26.9416ms	26.4601ms	37.7927 Ops/s	38.2934 Ops/s	$\color{#d91a1a}-1.31\%$
test_values[vec_td1_return_estimate-False-False]	35.7897ms	27.3772ms	36.5267 Ops/s	36.7279 Ops/s	$\color{#d91a1a}-0.55\%$
test_values[td_lambda_return_estimate-True-False]	40.5638ms	36.7778ms	27.1903 Ops/s	27.3835 Ops/s	$\color{#d91a1a}-0.71\%$
test_values[vec_td_lambda_return_estimate-True-False]	0.1209s	29.3141ms	34.1133 Ops/s	37.3584 Ops/s	$\textbf{\color{#d91a1a}-8.69\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.7831ms	8.3257ms	120.1099 Ops/s	123.4371 Ops/s	$\color{#d91a1a}-2.70\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.3600ms	2.0182ms	495.5007 Ops/s	495.3375 Ops/s	$\color{#35bf28}+0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	8.8252ms	0.4516ms	2.2143 KOps/s	2.2280 KOps/s	$\color{#d91a1a}-0.62\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	48.3760ms	40.7791ms	24.5224 Ops/s	24.6958 Ops/s	$\color{#d91a1a}-0.70\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	12.0435ms	2.5902ms	386.0733 Ops/s	385.8032 Ops/s	$\color{#35bf28}+0.07\%$
test_dqn_speed	10.8022ms	1.7182ms	582.0177 Ops/s	574.1299 Ops/s	$\color{#35bf28}+1.37\%$
test_ddpg_speed	85.5830ms	4.3322ms	230.8319 Ops/s	253.9874 Ops/s	$\textbf{\color{#d91a1a}-9.12\%}$
test_sac_speed	21.3045ms	11.5276ms	86.7483 Ops/s	89.1080 Ops/s	$\color{#d91a1a}-2.65\%$
test_redq_speed	31.8499ms	21.2623ms	47.0315 Ops/s	47.1029 Ops/s	$\color{#d91a1a}-0.15\%$
test_redq_deprec_speed	26.5073ms	17.7113ms	56.4612 Ops/s	55.8650 Ops/s	$\color{#35bf28}+1.07\%$
test_td3_speed	22.4409ms	11.9862ms	83.4296 Ops/s	83.7531 Ops/s	$\color{#d91a1a}-0.39\%$
test_cql_speed	75.7411ms	44.5245ms	22.4595 Ops/s	23.2818 Ops/s	$\color{#d91a1a}-3.53\%$
test_a2c_speed	27.8646ms	9.7846ms	102.2015 Ops/s	101.8728 Ops/s	$\color{#35bf28}+0.32\%$
test_ppo_speed	19.7538ms	10.3612ms	96.5137 Ops/s	97.9230 Ops/s	$\color{#d91a1a}-1.44\%$
test_reinforce_speed	20.2890ms	8.0232ms	124.6384 Ops/s	117.5261 Ops/s	$\textbf{\color{#35bf28}+6.05\%}$
test_iql_speed	45.3517ms	36.6641ms	27.2746 Ops/s	26.4515 Ops/s	$\color{#35bf28}+3.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.9423ms	2.1852ms	457.6248 Ops/s	438.7088 Ops/s	$\color{#35bf28}+4.31\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	4.6590ms	2.3434ms	426.7284 Ops/s	420.3686 Ops/s	$\color{#35bf28}+1.51\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.1679ms	2.3812ms	419.9541 Ops/s	421.3912 Ops/s	$\color{#d91a1a}-0.34\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.5104ms	2.2524ms	443.9707 Ops/s	446.6969 Ops/s	$\color{#d91a1a}-0.61\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.2266ms	2.1724ms	460.3305 Ops/s	419.7842 Ops/s	$\textbf{\color{#35bf28}+9.66\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	5.6217ms	2.5116ms	398.1544 Ops/s	424.2196 Ops/s	$\textbf{\color{#d91a1a}-6.14\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.2883ms	2.2472ms	444.9917 Ops/s	442.5593 Ops/s	$\color{#35bf28}+0.55\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1338s	2.6688ms	374.6972 Ops/s	426.6742 Ops/s	$\textbf{\color{#d91a1a}-12.18\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.7009ms	2.3880ms	418.7525 Ops/s	420.9921 Ops/s	$\color{#d91a1a}-0.53\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.9637ms	2.2214ms	450.1686 Ops/s	446.2862 Ops/s	$\color{#35bf28}+0.87\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1556s	2.6884ms	371.9748 Ops/s	417.2372 Ops/s	$\textbf{\color{#d91a1a}-10.85\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.5781ms	2.3910ms	418.2266 Ops/s	418.3280 Ops/s	$\color{#d91a1a}-0.02\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.2991ms	2.2253ms	449.3804 Ops/s	432.9906 Ops/s	$\color{#35bf28}+3.79\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	6.7506ms	2.3999ms	416.6826 Ops/s	423.6462 Ops/s	$\color{#d91a1a}-1.64\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.5779ms	2.3421ms	426.9741 Ops/s	401.8433 Ops/s	$\textbf{\color{#35bf28}+6.25\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.7713ms	2.3637ms	423.0634 Ops/s	435.6309 Ops/s	$\color{#d91a1a}-2.88\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	4.1981ms	2.3813ms	419.9418 Ops/s	419.5242 Ops/s	$\color{#35bf28}+0.10\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.6862ms	2.3348ms	428.3029 Ops/s	424.0559 Ops/s	$\color{#35bf28}+1.00\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2226s	20.5254ms	48.7201 Ops/s	48.8233 Ops/s	$\color{#d91a1a}-0.21\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1489s	19.2371ms	51.9829 Ops/s	52.5742 Ops/s	$\color{#d91a1a}-1.12\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1458s	18.5368ms	53.9467 Ops/s	53.2019 Ops/s	$\color{#35bf28}+1.40\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1431s	19.0559ms	52.4771 Ops/s	53.4130 Ops/s	$\color{#d91a1a}-1.75\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1434s	18.6175ms	53.7130 Ops/s	52.0022 Ops/s	$\color{#35bf28}+3.29\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1431s	18.6989ms	53.4791 Ops/s	46.4390 Ops/s	$\textbf{\color{#35bf28}+15.16\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1359s	16.1261ms	62.0112 Ops/s	53.1707 Ops/s	$\textbf{\color{#35bf28}+16.63\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1456s	19.0385ms	52.5251 Ops/s	52.8323 Ops/s	$\color{#d91a1a}-0.58\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1406s	18.6799ms	53.5336 Ops/s	52.8621 Ops/s	$\color{#35bf28}+1.27\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}6$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1231s	0.1225s	8.1647 Ops/s	7.9154 Ops/s	$\color{#35bf28}+3.15\%$
test_sync	0.1055s	0.1029s	9.7185 Ops/s	9.5841 Ops/s	$\color{#35bf28}+1.40\%$
test_async	0.2719s	99.5413ms	10.0461 Ops/s	9.7476 Ops/s	$\color{#35bf28}+3.06\%$
test_single_pixels	0.1456s	0.1451s	6.8927 Ops/s	7.5623 Ops/s	$\textbf{\color{#d91a1a}-8.85\%}$
test_sync_pixels	98.0322ms	95.1790ms	10.5065 Ops/s	10.3498 Ops/s	$\color{#35bf28}+1.51\%$
test_async_pixels	0.2485s	91.3964ms	10.9414 Ops/s	10.8950 Ops/s	$\color{#35bf28}+0.43\%$
test_simple	0.9572s	0.8833s	1.1321 Ops/s	1.1242 Ops/s	$\color{#35bf28}+0.70\%$
test_transformed	1.2015s	1.1334s	0.8823 Ops/s	0.8768 Ops/s	$\color{#35bf28}+0.64\%$
test_serial	2.5411s	2.4738s	0.4042 Ops/s	0.4012 Ops/s	$\color{#35bf28}+0.75\%$
test_parallel	2.5495s	2.4806s	0.4031 Ops/s	0.4039 Ops/s	$\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-True-True-True-True]	99.5320μs	34.4262μs	29.0476 KOps/s	28.9413 KOps/s	$\color{#35bf28}+0.37\%$
test_step_mdp_speed[True-True-True-True-False]	44.5100μs	20.1627μs	49.5966 KOps/s	48.1108 KOps/s	$\color{#35bf28}+3.09\%$
test_step_mdp_speed[True-True-True-False-True]	44.2920μs	19.8691μs	50.3293 KOps/s	48.4711 KOps/s	$\color{#35bf28}+3.83\%$
test_step_mdp_speed[True-True-True-False-False]	31.8400μs	11.9789μs	83.4804 KOps/s	82.5876 KOps/s	$\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-False-True-True]	66.3720μs	35.2652μs	28.3566 KOps/s	26.9384 KOps/s	$\textbf{\color{#35bf28}+5.26\%}$
test_step_mdp_speed[True-True-False-True-False]	45.7110μs	22.0058μs	45.4425 KOps/s	44.9017 KOps/s	$\color{#35bf28}+1.20\%$
test_step_mdp_speed[True-True-False-False-True]	87.4100μs	22.2785μs	44.8863 KOps/s	44.2997 KOps/s	$\color{#35bf28}+1.32\%$
test_step_mdp_speed[True-True-False-False-False]	48.6510μs	13.6906μs	73.0427 KOps/s	72.0877 KOps/s	$\color{#35bf28}+1.32\%$
test_step_mdp_speed[True-False-True-True-True]	0.2345ms	37.4219μs	26.7223 KOps/s	25.6901 KOps/s	$\color{#35bf28}+4.02\%$
test_step_mdp_speed[True-False-True-True-False]	57.1500μs	24.1954μs	41.3302 KOps/s	41.2442 KOps/s	$\color{#35bf28}+0.21\%$
test_step_mdp_speed[True-False-True-False-True]	51.4500μs	21.4218μs	46.6813 KOps/s	44.4170 KOps/s	$\textbf{\color{#35bf28}+5.10\%}$
test_step_mdp_speed[True-False-True-False-False]	31.7800μs	13.7510μs	72.7222 KOps/s	71.8761 KOps/s	$\color{#35bf28}+1.18\%$
test_step_mdp_speed[True-False-False-True-True]	0.1009ms	39.2149μs	25.5005 KOps/s	25.0093 KOps/s	$\color{#35bf28}+1.96\%$
test_step_mdp_speed[True-False-False-True-False]	52.2900μs	25.5787μs	39.0950 KOps/s	38.3196 KOps/s	$\color{#35bf28}+2.02\%$
test_step_mdp_speed[True-False-False-False-True]	46.5010μs	23.3215μs	42.8789 KOps/s	42.1883 KOps/s	$\color{#35bf28}+1.64\%$
test_step_mdp_speed[True-False-False-False-False]	82.4110μs	15.6875μs	63.7449 KOps/s	63.7628 KOps/s	$\color{#d91a1a}-0.03\%$
test_step_mdp_speed[False-True-True-True-True]	70.1310μs	37.8185μs	26.4421 KOps/s	25.8426 KOps/s	$\color{#35bf28}+2.32\%$
test_step_mdp_speed[False-True-True-True-False]	51.8210μs	24.4343μs	40.9261 KOps/s	41.0528 KOps/s	$\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-True-True-False-True]	53.0810μs	26.4802μs	37.7641 KOps/s	36.8583 KOps/s	$\color{#35bf28}+2.46\%$
test_step_mdp_speed[False-True-True-False-False]	36.5810μs	15.9050μs	62.8734 KOps/s	63.4891 KOps/s	$\color{#d91a1a}-0.97\%$
test_step_mdp_speed[False-True-False-True-True]	84.4420μs	39.9915μs	25.0053 KOps/s	24.2909 KOps/s	$\color{#35bf28}+2.94\%$
test_step_mdp_speed[False-True-False-True-False]	54.2500μs	26.2422μs	38.1065 KOps/s	37.9692 KOps/s	$\color{#35bf28}+0.36\%$
test_step_mdp_speed[False-True-False-False-True]	70.9910μs	28.8184μs	34.7000 KOps/s	35.5789 KOps/s	$\color{#d91a1a}-2.47\%$
test_step_mdp_speed[False-True-False-False-False]	56.1500μs	17.5760μs	56.8957 KOps/s	56.5822 KOps/s	$\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-False-True-True-True]	0.1142ms	42.0192μs	23.7986 KOps/s	23.6746 KOps/s	$\color{#35bf28}+0.52\%$
test_step_mdp_speed[False-False-True-True-False]	63.1110μs	27.9430μs	35.7872 KOps/s	35.5023 KOps/s	$\color{#35bf28}+0.80\%$
test_step_mdp_speed[False-False-True-False-True]	47.3010μs	28.0004μs	35.7137 KOps/s	35.5803 KOps/s	$\color{#35bf28}+0.37\%$
test_step_mdp_speed[False-False-True-False-False]	80.1610μs	17.5860μs	56.8634 KOps/s	56.5959 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-False-False-True-True]	0.2333ms	43.1758μs	23.1611 KOps/s	22.9839 KOps/s	$\color{#35bf28}+0.77\%$
test_step_mdp_speed[False-False-False-True-False]	0.2215ms	29.5530μs	33.8375 KOps/s	33.3204 KOps/s	$\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-False-False-False-True]	0.2318ms	29.4709μs	33.9318 KOps/s	33.6481 KOps/s	$\color{#35bf28}+0.84\%$
test_step_mdp_speed[False-False-False-False-False]	42.0200μs	19.4037μs	51.5365 KOps/s	51.3409 KOps/s	$\color{#35bf28}+0.38\%$
test_values[generalized_advantage_estimate-True-True]	28.6943ms	27.2274ms	36.7277 Ops/s	37.4295 Ops/s	$\color{#d91a1a}-1.88\%$
test_values[vec_generalized_advantage_estimate-True-True]	87.2002ms	3.3103ms	302.0911 Ops/s	288.7402 Ops/s	$\color{#35bf28}+4.62\%$
test_values[td0_return_estimate-False-False]	0.1055ms	64.9631μs	15.3934 KOps/s	15.0594 KOps/s	$\color{#35bf28}+2.22\%$
test_values[td1_return_estimate-False-False]	61.2546ms	58.7248ms	17.0286 Ops/s	17.5878 Ops/s	$\color{#d91a1a}-3.18\%$
test_values[vec_td1_return_estimate-False-False]	2.1576ms	1.7462ms	572.6881 Ops/s	573.1884 Ops/s	$\color{#d91a1a}-0.09\%$
test_values[td_lambda_return_estimate-True-False]	97.5204ms	93.2435ms	10.7246 Ops/s	11.0415 Ops/s	$\color{#d91a1a}-2.87\%$
test_values[vec_td_lambda_return_estimate-True-False]	2.0527ms	1.7307ms	577.8162 Ops/s	574.8065 Ops/s	$\color{#35bf28}+0.52\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	25.2429ms	24.8482ms	40.2444 Ops/s	39.5885 Ops/s	$\color{#35bf28}+1.66\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9101ms	0.7364ms	1.3580 KOps/s	1.3609 KOps/s	$\color{#d91a1a}-0.22\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7733ms	0.6872ms	1.4551 KOps/s	1.4423 KOps/s	$\color{#35bf28}+0.89\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5340ms	1.4810ms	675.2019 Ops/s	674.3612 Ops/s	$\color{#35bf28}+0.12\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	1.0340ms	0.7145ms	1.3996 KOps/s	1.4014 KOps/s	$\color{#d91a1a}-0.12\%$
test_dqn_speed	8.3001ms	1.5118ms	661.4496 Ops/s	666.4825 Ops/s	$\color{#d91a1a}-0.76\%$
test_ddpg_speed	4.8403ms	3.4173ms	292.6258 Ops/s	299.1103 Ops/s	$\color{#d91a1a}-2.17\%$
test_sac_speed	10.6857ms	9.4946ms	105.3227 Ops/s	106.5736 Ops/s	$\color{#d91a1a}-1.17\%$
test_redq_speed	17.4053ms	17.0179ms	58.7617 Ops/s	59.1880 Ops/s	$\color{#d91a1a}-0.72\%$
test_redq_deprec_speed	14.8868ms	13.5336ms	73.8904 Ops/s	75.7921 Ops/s	$\color{#d91a1a}-2.51\%$
test_td3_speed	19.8028ms	9.7347ms	102.7253 Ops/s	104.0624 Ops/s	$\color{#d91a1a}-1.28\%$
test_cql_speed	34.7137ms	33.4211ms	29.9212 Ops/s	31.4617 Ops/s	$\color{#d91a1a}-4.90\%$
test_a2c_speed	0.1261s	8.4983ms	117.6707 Ops/s	137.7254 Ops/s	$\textbf{\color{#d91a1a}-14.56\%}$
test_ppo_speed	9.1106ms	7.8896ms	126.7489 Ops/s	131.8752 Ops/s	$\color{#d91a1a}-3.89\%$
test_reinforce_speed	8.0626ms	6.5383ms	152.9449 Ops/s	159.7973 Ops/s	$\color{#d91a1a}-4.29\%$
test_iql_speed	29.5184ms	28.1724ms	35.4958 Ops/s	36.2802 Ops/s	$\color{#d91a1a}-2.16\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.8542ms	2.5563ms	391.1972 Ops/s	395.1309 Ops/s	$\color{#d91a1a}-1.00\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	4.1028ms	2.7178ms	367.9499 Ops/s	327.1329 Ops/s	$\textbf{\color{#35bf28}+12.48\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.8477ms	2.7136ms	368.5106 Ops/s	369.7667 Ops/s	$\color{#d91a1a}-0.34\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.9721ms	2.5422ms	393.3609 Ops/s	396.9021 Ops/s	$\color{#d91a1a}-0.89\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.4768ms	2.7285ms	366.4969 Ops/s	369.9291 Ops/s	$\color{#d91a1a}-0.93\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.9953ms	2.7365ms	365.4358 Ops/s	369.4747 Ops/s	$\color{#d91a1a}-1.09\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	0.2068s	3.0997ms	322.6137 Ops/s	393.8507 Ops/s	$\textbf{\color{#d91a1a}-18.09\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.7444ms	2.7308ms	366.1996 Ops/s	370.1299 Ops/s	$\color{#d91a1a}-1.06\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.3959ms	2.7369ms	365.3746 Ops/s	370.0773 Ops/s	$\color{#d91a1a}-1.27\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	0.2096s	3.0712ms	325.6016 Ops/s	390.8812 Ops/s	$\textbf{\color{#d91a1a}-16.70\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.6764ms	2.7222ms	367.3461 Ops/s	368.3657 Ops/s	$\color{#d91a1a}-0.28\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.6812ms	2.7329ms	365.9113 Ops/s	369.5173 Ops/s	$\color{#d91a1a}-0.98\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.1237ms	2.5268ms	395.7571 Ops/s	391.2374 Ops/s	$\color{#35bf28}+1.16\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.1120ms	2.7358ms	365.5290 Ops/s	366.6333 Ops/s	$\color{#d91a1a}-0.30\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.6825ms	2.7296ms	366.3474 Ops/s	368.7943 Ops/s	$\color{#d91a1a}-0.66\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1710ms	2.5564ms	391.1782 Ops/s	392.9390 Ops/s	$\color{#d91a1a}-0.45\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.7567ms	2.7268ms	366.7255 Ops/s	369.1848 Ops/s	$\color{#d91a1a}-0.67\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.2033ms	2.7255ms	366.8993 Ops/s	367.5153 Ops/s	$\color{#d91a1a}-0.17\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2517s	18.4369ms	54.2390 Ops/s	49.3005 Ops/s	$\textbf{\color{#35bf28}+10.02\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1349s	18.2676ms	54.7418 Ops/s	54.0791 Ops/s	$\color{#35bf28}+1.23\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1367s	18.4008ms	54.3456 Ops/s	54.4277 Ops/s	$\color{#d91a1a}-0.15\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1344s	18.2979ms	54.6512 Ops/s	53.9100 Ops/s	$\color{#35bf28}+1.37\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1355s	18.2775ms	54.7121 Ops/s	62.2516 Ops/s	$\textbf{\color{#d91a1a}-12.11\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1399s	15.9851ms	62.5581 Ops/s	54.0527 Ops/s	$\textbf{\color{#35bf28}+15.74\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1385s	18.4004ms	54.3465 Ops/s	54.4464 Ops/s	$\color{#d91a1a}-0.18\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1354s	15.8175ms	63.2210 Ops/s	54.6652 Ops/s	$\textbf{\color{#35bf28}+15.65\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1393s	18.5377ms	53.9440 Ops/s	53.2625 Ops/s	$\color{#35bf28}+1.28\%$