Skip to content

Haiku 0.0.4
Compare
Choose a tag to compare
@tomhennigan tomhennigan released this 12 Apr 13:12
v0.0.4
005187c

Changelog:

  • (Important Fix) Fixed strides in basic block (300e6a4).
  • Added map, partition_n and traverse to data_structures.
  • Added "build your own Haiku" to the docs.
  • Added summarise utility to Haiku.
  • Added visualisation section to docs.
  • Added precision arg to Linear, Conv and ConvTranspose.
  • Added RMSNorm.
  • Added module_name and name to GetterContext.
  • Added hk.eval_shape.
  • Improved performance of non cross-replica BN variance.
  • Haiku branch functions are only traced once (mirroring JAX).
  • Attention logits are rescaled before the softmax now.
  • ModuleMetaclass now inherits from Protocol.
  • Removed "dot access" to FlatMapping.
  • Removed query_size from MultiHeadAttention constructor.

Any many other small fixes and improvements.

Assets 2
Loading