jsipfs add fails on inputs larger than 1GiB when rabin is specified

[ribasushi]

Reproducible as:

~$ for onemegs in 1022 1023 1024 1025 ; do echo -n "$(( $onemegs * 1048576 )) bytes: "; dd if=/dev/zero bs=1048576 count=$onemegs 2>/dev/null | jsipfs add -n -q --chunker=rabin ; done
1071644672 bytes: QmQtWcWN3DKaRnPDYU7nsPEbrSH63Py7LFQfFJ7bKaWHNi
1072693248 bytes: QmNex7npXYN4CFR4ysL6VsBLvAt9CQjAiSpvTnGMiQhZ9k
1073741824 bytes: unreachable
1074790400 bytes: unreachable

~$ jsipfs --version
0.40.0

[ribasushi]

@alanshaw actually... rabin outright does not converge with goipfs for a number of inputs. I say let's put this bug on ice for now, I will use go-ipfs as the "source of truth", and circle back to this once things are better validated.

In other words - we need to fix this one way or the other, but it seems there's more to fix than just a crash :(

[ribasushi]

rabin outright does not converge with goipfs for a number of inputs

That turned out to be #50

The original bug ( crash on > ~1GiB files ) seems to have been fixed by @hugomrdias' changes 🎉
I will close this ticket once the full convergence test finishes ( ~3 hours )

[ribasushi]

This particular issue seems solved for good on 0.42.2-rc.4. Finding others sadly, but will make separate tickets for them shortly.