Code

feat: batch hash tree root#378

Code

Draft

matthewkeil wants to merge 118 commits intomasterChainSafe/ssz:masterfrom te/batch_hash_tree_rootChainSafe/ssz:te/batch_hash_tree_rootCopy head branch name to clipboard

+1,821-342

Commits

Commits on Jul 16, 2024

• feat: initial implementation of batch hash

  twoeths

  committed
  2380430

  Copy full SHA for 2380430

• feat: track HashComputation in setNodesAtDepth()

  twoeths

  committed
  48854ed

  Copy full SHA for 48854ed

• fix: findDiffDepthi to support more than 31 bytes

  twoeths

  committed
  6820252

  Copy full SHA for 6820252

• fix: test setNodesAtDepth get computation for > 32 bits

  twoeths

  committed
  c370e3e

  Copy full SHA for c370e3e

• feat: implement getHashComputations and executeHashComputations

  twoeths

  committed
  b65b06a

  Copy full SHA for b65b06a

• fix: setNodesAtDepth() with HashComputationGroup

  twoeths

  committed
  086daf9

  Copy full SHA for 086daf9

• feat: implement ViewDU.hashTreeRoot() using batch hash

  twoeths

  committed
  b82e718

  Copy full SHA for b82e718

• fix: precompute hash for zero nodes

  twoeths

  committed
  75a4422

  Copy full SHA for 75a4422

• chore: add eth2 BeaconState test

  twoeths

  committed
  008cf3d

  Copy full SHA for 008cf3d

• fix: merge issue

  twoeths

  committed
  6133535

  Copy full SHA for 6133535

• feat: generalize Hasher interface

  twoeths

  committed
  e60101a

  Copy full SHA for e60101a

• chore: add batchHash() benchmark

  twoeths

  committed
  b1a7765

  Copy full SHA for b1a7765

• fix: getHashComputations() unit tests and perf test batchHash()

  twoeths

  committed
  e14e24a

  Copy full SHA for e14e24a

• feat: hasher.executeHashComputations()

  twoeths

  committed
  87094b0

  Copy full SHA for 87094b0

• fix: executeHashComputations() util to call hasher implementation

  twoeths

  committed
  525bb1f

  Copy full SHA for 525bb1f

• chore: add getHashComputations() benchmark

  twoeths

  committed
  cef8fa7

  Copy full SHA for cef8fa7

• fix: improve for loop in as-sha256 executeHashComputations

  twoeths

  committed
  88fd6e8

  Copy full SHA for 88fd6e8

• chore: rename variables

  twoeths

  committed
  2d5fe10

  Copy full SHA for 2d5fe10

• fix: improve executeHashComputations() by reducing one if

  twoeths

  committed
  1689afb

  Copy full SHA for 1689afb

• feat: add hashtree hasher

  

  matthewkeil

  authored and

  twoeths

  committed
  a49d32b

  Copy full SHA for a49d32b

• feat: use hashtreeHasher

  

  matthewkeil

  authored and

  twoeths

  committed
  92d33f0

  Copy full SHA for 92d33f0

• fix: rough out of hashtreeHasher

  

  matthewkeil

  authored and

  twoeths

  committed
  4d40df3

  Copy full SHA for 4d40df3

• feat: add name to hasher for type detection in tests

  

  matthewkeil

  authored and

  twoeths

  committed
  f56a6c5

  Copy full SHA for f56a6c5

• feat: fix bug in hashtree and add batch hashing

  

  matthewkeil

  authored and

  twoeths

  committed
  b9f9426

  Copy full SHA for b9f9426

• test: add expectHex util

  

  matthewkeil

  authored and

  twoeths

  committed
  cc57d3d

  Copy full SHA for cc57d3d

• test: add unit tests for hashers

  

  matthewkeil

  authored and

  twoeths

  committed
  94b2d09

  Copy full SHA for 94b2d09

• feat: add null-loader to simpleserialze webpack config

  

  matthewkeil

  authored and

  twoeths

  committed
  29bdd2a

  Copy full SHA for 29bdd2a

• feat: add get hashComputations to BranchNode

  

  matthewkeil

  authored and

  twoeths

  committed
  578f706

  Copy full SHA for 578f706

• test: add buildComparisonTrees to test utils

  

  matthewkeil

  authored and

  twoeths

  committed
  39cb5e4

  Copy full SHA for 39cb5e4

• fix: broken perf test

  

  matthewkeil

  authored and

  twoeths

  committed
  3b8050e

  Copy full SHA for 3b8050e

• test: add perf comparison for hashers

  

  matthewkeil

  authored and

  twoeths

  committed
  3ebb4c2

  Copy full SHA for 3ebb4c2

• fix: benchmark command in persistent-merkle-tree

  

  matthewkeil

  authored and

  twoeths

  committed
  bef3d5b

  Copy full SHA for bef3d5b

• feat: improve hashtree performance a bit

  

  matthewkeil

  authored and

  twoeths

  committed
  d4293f0

  Copy full SHA for d4293f0

• test: add batchHash perf comparison

  

  matthewkeil

  authored and

  twoeths

  committed
  483f85b

  Copy full SHA for 483f85b

• chore: add partially modified tree benchmark

  twoeths

  committed
  6fff41f

  Copy full SHA for 6fff41f

• feat: optimize ContainerNodeStruct.valueToTree()

  twoeths

  committed
  5ba002c

  Copy full SHA for 5ba002c

• fix: add batchHash vs hashTreeRoot benchmark

  twoeths

  committed
  a3a17a0

  Copy full SHA for a3a17a0

• feat: benchmark hash step of each batch hash method

  twoeths

  committed
  a969608

  Copy full SHA for a969608

• feat: compute HashComputations when creating validator tree

  twoeths

  committed
  396cebe

  Copy full SHA for 396cebe

• fix: use hashtree for ssz benchmark

  twoeths

  committed
  ec89ce9

  Copy full SHA for ec89ce9

• fix: hasher executeHashComputations() benchmark

  twoeths

  committed
  07e4d3c

  Copy full SHA for 07e4d3c

• fix: allocate memory once for hashtree

  twoeths

  committed
  31cec22

  Copy full SHA for 31cec22

• fix: improve hashtree.batchHashObjects()

  twoeths

  committed
  fbf59ea

  Copy full SHA for fbf59ea

• fix: stablize hasher.test.ts benchmark

  twoeths

  committed
  c22f368

  Copy full SHA for c22f368

• feat: use Uint32Array

  twoeths

  committed
  46ddb4c

  Copy full SHA for 46ddb4c

• fix: remove binding devDependency

  

  matthewkeil

  authored and

  twoeths

  committed
  a4d8677

  Copy full SHA for a4d8677

• chore: update yarn.lock

  

  matthewkeil

  authored and

  twoeths

  committed
  1a1271e

  Copy full SHA for 1a1271e

• fix: release backed tree after use in BranchNodeStruct

  twoeths

  committed
  5cc208b

  Copy full SHA for 5cc208b

• feat: sync ValidatorNodeStructType from lodestar

  twoeths

  committed
  c2f4dc0

  Copy full SHA for c2f4dc0

• feat: implement ValidatorViewDU class

  twoeths

  committed
  b518321

  Copy full SHA for b518321

• feat: implement ListCompositeTreeViewDU

  twoeths

  committed
  f991f52

  Copy full SHA for f991f52

• feat: implement and use hashtree.digestNLevelUnsafe()

  twoeths

  committed
  0c8ac39

  Copy full SHA for 0c8ac39

• chore: export more classes

  twoeths

  committed
  724c057

  Copy full SHA for 724c057

• fix: spec tests

  twoeths

  committed
  7b20306

  Copy full SHA for 7b20306

• feat: ContainerNodeStruct does not support batch hash

  twoeths

  committed
  ac3a930

  Copy full SHA for ac3a930

• fix: allocate memory once for ListValidatorTreeViewDU

  twoeths

  committed
  34d822f

  Copy full SHA for 34d822f

• fix: implement ValidatorTreeViewDU.commit()

  twoeths

  committed
  0f06a77

  Copy full SHA for 0f06a77

• fix: revert valueToTree()

  twoeths

  committed
  f1a37d1

  Copy full SHA for f1a37d1

• fix: composite type setters in validator ViewDU

  twoeths

  committed
  dc3f9f2

  Copy full SHA for dc3f9f2

• chore: remove unused code in Validator ViewDU

  twoeths

  committed
  58caa51

  Copy full SHA for 58caa51

• fix: no need to create new validator node in commitToHashObject()

  twoeths

  committed
  ef6101f

  Copy full SHA for ef6101f

• fix: remove getHashComputations() in ListValidator ViewDU

  twoeths

  committed
  829b644

  Copy full SHA for 829b644

• fix: avoid memory allocation in hashtree

  twoeths

  committed
  6485e14

  Copy full SHA for 6485e14

• feat: support digestNLevelUnsafe using as-sha256

  twoeths

  committed
  e181ded

  Copy full SHA for e181ded

• fix: use hashtree in setHasher.mjs for test

  twoeths

  committed
  158601a

  Copy full SHA for 158601a

• feat: do not allocate temp HashObjects

  twoeths

  committed
  4037ffe

  Copy full SHA for 4037ffe

• chore: benchmark validator hashTreeRoot time

  twoeths

  committed
  b41b28e

  Copy full SHA for b41b28e

• fix: lint

  twoeths

  committed
  b68f729

  Copy full SHA for b68f729

• feat: implement merkleizeInto() for as-sha256 and hashtree

  twoeths

  committed
  80d3de2

  Copy full SHA for 80d3de2

• fix: deduplicate merkleizeInto() implementations

  twoeths

  committed
  f1b5483

  Copy full SHA for f1b5483

• fix: handle empty data in merkleizeInto()

  twoeths

  committed
  743b7cf

  Copy full SHA for 743b7cf

• feat: type.hashTreeRootInto() using hasher merkleizeInto()

  twoeths

  committed
  0e06479

  Copy full SHA for 0e06479

• chore: benchmark BeaconBlock hashTreeRoot()

  twoeths

  committed
  6c8e27f

  Copy full SHA for 6c8e27f

• fix: correct cached root

  twoeths

  committed
  49846bf

  Copy full SHA for 49846bf

• fix: improve digestNLevel to hash to input data

  twoeths

  committed
  1001833

  Copy full SHA for 1001833

• feat: support offset in byteArrayIntoHashObject

  twoeths

  committed
  59a1221

  Copy full SHA for 59a1221

• feat: ssz v0.17.0

  twoeths

  committed
  e591866

  Copy full SHA for e591866

• fix: only overwrite ListValidatorViewDU

  twoeths

  committed
  9779b0a

  Copy full SHA for 9779b0a

• fix: publish ContainerNodeStructTreeViewDU

  twoeths

  committed
  30976f1

  Copy full SHA for 30976f1

• fix: preallocate HashComputationsGroup

  twoeths

  committed
  c939ee7

  Copy full SHA for c939ee7

• chore: benchmark merkleize() vs merkleizeInto()

  twoeths

  committed
  805b350

  Copy full SHA for 805b350

• fix: do not rebind nodes if child ViewDU is not changed (#380)

  twoeths

  committed
  fc0531d

  Copy full SHA for fc0531d

• fix: optimize commit() for Container and ArrayComposite ViewDUs (#381)

  twoeths

  committed
  33e2416

  Copy full SHA for 33e2416

• feat: support optional output arrays for getAll() apis (#383)

  twoeths

  committed
  4873a66

  Copy full SHA for 4873a66

Commits on Jul 19, 2024

• fix: merge master

  twoeths

  committed
  dcda46f

  Copy full SHA for dcda46f

• fix: merge issue

  twoeths

  committed
  7e0aa16

  Copy full SHA for 7e0aa16

Commits on Jul 23, 2024

• feat: minimal memory allocation on ViewDU hashTreeRoot (#388)

  twoeths

  authored
  b6f18fb

  Copy full SHA for b6f18fb

Commits on Jul 31, 2024

• feat: ReuseListIterator for getAll() api (#390)

  twoeths

  authored
  04f8a16

  Copy full SHA for 04f8a16

Commits on Aug 7, 2024

• Merge branch 'master' into te/batch_hash_tree_root

  twoeths

  committed
  2b07892

  Copy full SHA for 2b07892

• chore: fix lint

  twoeths

  committed
  23557d7

  Copy full SHA for 23557d7

• feat: new batchHashTreeRoot() method for ViewDU

  twoeths

  committed
  aa7ebfb

  Copy full SHA for aa7ebfb

Commits on Aug 9, 2024

• feat: implement ViewDU.batchHashTreeRoot()

  twoeths

  committed
  a6191d4

  Copy full SHA for a6191d4

• chore: add benchmark

  twoeths

  committed
  6aaa7bd

  Copy full SHA for 6aaa7bd

• feat: implement ViewDU.batchHashTreeRoot, merge PR #392

  twoeths

  committed
  c616b55

  Copy full SHA for c616b55

• chore: remove describe.only

  twoeths

  committed
  0ee377b

  Copy full SHA for 0ee377b

• Merge remote-tracking branch 'origin/te/viewdu_batch_hash_tree_root' into te/batch_hash_tree_root

  twoeths

  committed
  4af75e6

  Copy full SHA for 4af75e6

Commits on Aug 16, 2024

• fix: do not change hashTreeRoot() (#393)

  Show description for 04ed553
  twoeths

  authored
  04ed553

  Copy full SHA for 04ed553

Commits on Aug 22, 2024

• fix: handle unmodified validators (#397)

  Show description for ad686e6
  twoeths

  authored
  ad686e6

  Copy full SHA for ad686e6

Commits on Aug 26, 2024

• fix: separate batch hash and commit logic in listValidator ViewDU

  twoeths

  committed
  0b3ba85

  Copy full SHA for 0b3ba85

• fix: do not throw error if commit ViewDU without tracking changes

  twoeths

  committed
  ed1b08a

  Copy full SHA for ed1b08a

Commits on Sep 11, 2024

• feat: implement forEach() and forEachValue() for ArrayCompositeType

  twoeths

  committed
  1b69676

  Copy full SHA for 1b69676

Commits on Sep 13, 2024

• feat: ListUintNum64Type create ViewDU from existing tree (#402)

  Show description for 91c735c
  twoeths

  authored
  91c735c

  Copy full SHA for 91c735c

• chore: merge master

  twoeths

  committed
  fd4112a

  Copy full SHA for fd4112a

Commits on Oct 11, 2024

• chore: merge master

  twoeths

  committed
  7b1b3ad

  Copy full SHA for 7b1b3ad

• fix: implement getChunkBytes() for StableContainer & Profile

  twoeths

  committed
  806c4de

  Copy full SHA for 806c4de

• fix: lint

  twoeths

  committed
  1da53b3

  Copy full SHA for 1da53b3

• feat: use allocUnsafe() for hashTreeRoot()

  twoeths

  committed
  024538d

  Copy full SHA for 024538d

Commits on Oct 14, 2024

• chore: revert unnecessary change to master

  twoeths

  committed
  95cc29e

  Copy full SHA for 95cc29e

• chore: remove ListIterator

  twoeths

  committed
  9315119

  Copy full SHA for 9315119

• fix: dedup executeHashComputations - hashtree perf test

  twoeths

  committed
  f17019e

  Copy full SHA for f17019e

• fix: no memory allocation in StableContainer Profile hashTreeRootInto()

  twoeths

  committed
  79152c4

  Copy full SHA for 79152c4

Commits on Oct 15, 2024

• chore: revert unnecessary change

  twoeths

  committed
  d03c720

  Copy full SHA for d03c720

• fix: cache same root instance from CompositeType.hashTreeRoot()

  twoeths

  committed
  c7e03b8

  Copy full SHA for c7e03b8

Commits on Oct 18, 2024

• feat: hashtree as default hasher

  twoeths

  committed
  e0e3173

  Copy full SHA for e0e3173

Commits on Oct 31, 2024

• Revert "feat: hashtree as default hasher"

  Show description for 4f7a0a4
  twoeths

  committed
  4f7a0a4

  Copy full SHA for 4f7a0a4

• refactor: chunkBytesBuffer to blocksBuffer to reflect SHA256 blocks

  twoeths

  committed
  3249906

  Copy full SHA for 3249906

• refactor: merkleizeInto to merkleizeBlocksBytes

  twoeths

  committed
  025a069

  Copy full SHA for 025a069

Commits on Nov 6, 2024

• feat: merkleize block array (#420)

  Show description for fbbf918
  twoeths

  authored
  fbbf918

  Copy full SHA for fbbf918