Skip to content

Releases: octo-models/octo

v1.5

24 May 00:28
@mees mees
v1.5
5eaa5c6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.5 Latest
Latest

What's Changed

  • Improved cross-attention between visual and language tokens by repeating language tokens at every timestep in the context window.
  • Augmented the language instructions in the data with rephrasings from GPT-3.5.
  • Bug fixes:
    • Turned off dropout in the diffusion head due to incompatibility with layer norm.
    • Fixed an off-by-one error with the attention mask.
    • Fixed an issue where different image augmentations did not get fresh random seeds.
Assets 2
Loading

v0.1.0

18 Dec 16:56
@kvablack kvablack
v0.1.0
37951e4
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.1.0

Creating this to document the initial release version of Octo (12/14/23).

Assets 2
Loading