Skip to content

Commit d05be1c

Browse files
committedMay 22, 2024·
cosmetic changes
1 parent c6445f7 commit d05be1c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed
 

‎README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -148,7 +148,7 @@ While `timestep_pad_mask` indicates which observations should be attended to on
148148
Octo was pretrained with an action chunking size of 4, meaning it predicts the next 4 actions at once. You can choose to execute all these actions before sampling new ones, or only execute the first action before sampling new ones (also known as receding horizon control). You can also do something more advanced like [temporal ensembling](octo/utils/gym_wrappers.py).
149149

150150
## Updates for Version 1.5
151-
- Language task tokens are now repeated at every timestep in the context window.
151+
- Improved cross-attention between visual and language tokens by repeating language tokens at every timestep in the context window.
152152
- Augmented the language instructions in the data with rephrasings from GPT-3.5.
153153
- Bug fixes:
154154
- Turned off dropout in the diffusion head due to incompatibility with layer norm.

0 commit comments

Comments
 (0)
Please sign in to comment.