v0.11.0-rc9.1 - Stability patch for arabica-9

This release contains stability changes backported from main. This RC is compatible with arabica-9 ONLY and not compatible with arabica-10 and mocha-4.

v0.11.0-rc14 - Cache Fixes

This RC contains experimental fixes, use with caution.

What's Changed

BREAKING

• deps!: bump nmt, breaking JSON RPC return types including nmt Proofs by @distractedm1nd in #2728

FEATURES

• feat(share/eds): Rework accessor cache by @walldiss in #2612
• feat(share/store/cache): Split accessor cache into recent and blockstore by @walldiss in #2656
• feat(share/eds/cache): Add accessor cache refs counter by @walldiss in #2723
• feat(share/eds/store): expose eds store params by @walldiss in #2724

OTHER

• fix(shrexeds): close stream by @Wondertan in #2705
• Stale issue github workflow by @ramin in #2667
• refactor(swamp): use RPC client instead of service pointers by @distractedm1nd in #2699
• refactoring(full/availability): removing TeeGetter, storing via SharesAvailable by @distractedm1nd in #2726
• Goreleaser by @MSevey in #2661
• docs: Add share p2p documentation by @derrandz in #2008

DEPS

• chore: bump docker ci to v0.2.3 by @Bidon15 in #2696
• chore(deps): Bump actions/checkout from 3 to 4 by @dependabot in #2690
• chore(deps): Bump golang.org/x/crypto from 0.12.0 to 0.13.0 by @dependabot in #2688
• chore(deps): Bump github.com/ipfs/go-block-format from 0.1.2 to 0.2.0 by @dependabot in #2682
• chore(deps): Bump github.com/libp2p/go-libp2p-routing-helpers from 0.7.2 to 0.7.3 by @dependabot in #2687
• chore(deps): Bump go.opentelemetry.io/contrib/instrumentation/runtime from 0.42.0 to 0.43.0 by @dependabot in #2685
• chore(deps): Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.16.0 to 1.17.0 by @dependabot in #2683
• chore(deps): Bump actions/checkout from 3 to 4 by @dependabot in #2718
• chore(deps): Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 0.40.0 to 0.41.0 by @dependabot in #2713
• chore(deps): Bump github.com/hashicorp/golang-lru/v2 from 2.0.5 to 2.0.6 by @dependabot in #2711
• chore(deps): Bump mathieudutour/github-tag-action from 6.0 to 6.1 by @dependabot in #2721
• chore(deps): Bump goreleaser/goreleaser-action from 4 to 5 by @dependabot in #2719
• chore(deps): Bump celestiaorg/.github from 0.2.2 to 0.2.3 by @dependabot in #2720
• chore(deps): Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.17.0 to 1.18.0 by @dependabot in #2714
• chore(dependabot): add otel group to dependabot by @walldiss in #2722
• chore(deps): Bump go.uber.org/zap from 1.25.0 to 1.26.0 by @dependabot in #2731
• chore(deps): Bump go.opentelemetry.io/contrib/instrumentation/runtime from 0.43.0 to 0.44.0 by @dependabot in #2732

Full Changelog: v0.11.0-rc13...v0.11.0-rc14

v0.11.0-rc13 - arabica-10 syncing fix

Contains a fix for header sync on arabica-10.

What's Changed

• feat(headertest): Validate exact error types in header tests by @Manav-Aggarwal in #2644
• chore: bump celestia-app to v1.0.0-rc14 by @evan-forbes in #2662
• chore: bump libp2p by @Wondertan in #2676
• fix(modshare): start peer manager after Syncer by @Wondertan in #2677
• feat(cmd/blob): add fee and gasLimit flags by @vgonkivs in #2669
• chore(nodebuilder/p2p): BlockTime from 15 sec --> 10 sec by @renaynay in #2692
• refactor(nodebuilder/header): get rid of InitStore by @renaynay in #2678
• chore: fix unknown in ghcr registry by @Bidon15 in #2693

New Contributors

• @Manav-Aggarwal made their first contribution in #2644

Full Changelog: v0.11.0-rc12...v0.11.0-rc13

v0.11.0-rc12 - `mocha-4` upgrade

What's Changed

BREAKING

• improvement!(blob/service): add options to submit by @vgonkivs in #2630

FEATURES

• feat(nodebuilder/header): Bootstrap from previously seen peers by @renaynay in #2507
• feat(modp2p): listen on WebTransport by default by @Wondertan in #2660

OTHER

• fix(share/eds): skip concurrent writes on edsstore Put by @walldiss in #2613
• chore(lint/sort-imports): fix absolute path for sort-imports by @walldiss in #2640
• chore: cleanup usage of share.Root(DAH) by @Wondertan in #2481
• chore!: bump mocha chain with new bootstrappers and genesis hash by @Bidon15 in #2668

Full Changelog: v0.11.0-rc11...v0.11.0-rc12

v0.11.0-rc11 - `arabica-10` syncing fix

What's Changed

BREAKING

• refactor(share)!: have NamespacedShares fields use snake_case in JSON by @distractedm1nd in #2633
• chore!: bump celestia-app to v1.0.0-rc13 by @evan-forbes in #2646

FEATURES

• feat(share/eds) add dagstore shards status metric by @walldiss in #2642
• feat: local docker telemetry infra by @distractedm1nd in #2296
• feat(eds/store): remove corrupted blocks from store by @distractedm1nd in #2625

MISCELLANEOUS

• chore(deps): bump golanci-lint workflow by @distractedm1nd in #2641
• chore(deps): bump golangci/golangci-lint-action from 3.6.0 to 3.7.0 by @dependabot in #2586
• chore(deps): bump alpine from 3.18.2 to 3.18.3 by @dependabot in #2564
• chore(deps): bump cosmossdk.io/math from 1.1.1 to 1.1.2 by @dependabot in #2594
• tests(swamp): befp testing by @vgonkivs in #2584
• chore(deps): bump github.com/ipfs/go-ipld-cbor from 0.0.6 to 0.1.0 by @dependabot in #2622
• chore(deps): bump github.com/ipfs/go-ipld-format from 0.5.0 to 0.6.0 by @dependabot in #2621
• chore(deps): bump github.com/ipfs/go-block-format from 0.1.2 to 0.2.0 by @dependabot in #2623
• fix(blob): typo, sumitter -> submitter by @ramin in #2648
• chore(nodebuilder/tests): Clean up integration tests in p2p_test by @renaynay in #2166
• refactor(blob): removing jsonProof by @distractedm1nd in #2652
• chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 0.39.0 to 0.40.0 by @dependabot in #2635
• chore(deps): migrate to boxo by @Wondertan in #2595
• chore(deps): bump github.com/ipfs/go-ipfs-ds-help from 1.1.0 to 1.1.1 by @dependabot in #2624
• chore(go.mod): bump go-header by @renaynay in #2657

New Contributors

• @ramin made their first contribution in #2648

Full Changelog: v0.11.0-rc10...v0.11.0-rc11

v0.11.0-rc10 - `arabica-10`

This RC contains an upgrade to arabica-10 which incorporates several storage-related fixes and optimisations as well as an upgrade to the shrex-nd protocol such that it can now support getting blobs larger than 1mb.

This RC is not compatible with arabica-9.

Please note: this RC is breaking against past RCs of the same version

What's Changed

BREAKING

• misc(metrics)!: split global attributes into two by @walldiss in #2546
• chore!: update celestia-app to v1.0.0-rc12 by @evan-forbes in #2581
• chore(nodebuilder/p2p)!: Bump arabica-10 by @jrmanes in #2639

FEATURES

• metrics(runtime): add runtime metrics by @walldiss in #2570
• feat(eds/store): add eds blockstore cache metrics by @walldiss in #2567
• feat(nodebuilder/state): Provide stubbed state module if a core endpoint not provided by @renaynay in #2577
• feat(blob): improve gas estimation and track min gas price by @cmwaters in #2511
• feat(cmd/node): add logs cmd to dynamically change the log level by @vgonkivs in #2601
• feat(edssser): introduce EDS Store Stresser and cel-shed utility by @Wondertan in #2482

BUG FIXES

• fix(blob): ensure that the share sequence is not empty by @vgonkivs in #2547
• fix(rpc): fix commands handling by @vgonkivs in #2515
• fix(cmd): fix formatting during submit by @vgonkivs in #2551
• fix(share/eds): don't use in-memory buffer for mount after shard recover by @walldiss in #2554
• fix(header): Only bridge node should panic on data root mismatch in e… by @renaynay in #2558
• fix(share/eds): dagstore shard restore reflection workaround by @walldiss in #2559
• fix(nodebuilder): set default log level for bitswap-client by @walldiss in #2576
• fix: TestShareAvailable_DisconnectedFullNodes by @distractedm1nd in #2560
• fix(share/discovery): discovery should try to connect to empty hosts peers by @walldiss in #2575
• fix(share/ipld): Remove proofs from leaked ctx by @walldiss in #2574
• fix(share/eds): scale up inverted_index badger levels by @walldiss in #2591
• fix(cmd/blob): fix response by @vgonkivs in #2600
• fix(eds/blockstore): Puts on EDSStore Blockstore by @distractedm1nd in #2532
• fix: fixing panic on GetShare with out of bounds indexes by @distractedm1nd in #2605

MISCELLANEOUS

• chore(deps): bump ipfs networking deps by @walldiss in #2478
• chore: bump to rsmt2d v0.11.0 by @rootulp in #2580
• chore: bump deps + go1.21 by @Wondertan in #2589
• deps: bump dagstore by @walldiss in #2598
• nodebuilder/core: Set default ports for RPC and GRPC by @renaynay in #2596
• feat(share/p2p/discovery): Warning for discovery loop if haven't found wanted peers in 5 minutes by @nodersteam in #2573
• chore(deps): bump dagstore by @walldiss in #2602
• refactor: address namespace follow-ups from celestia-app v1.0.0-rc12 bump by @rootulp in #2597
• chore: bump go-header and go-fraud by @Wondertan in #2619

New Contributors

• @nodersteam made their first contribution in #2573

Full Changelog: v0.11.0-rc9...v0.11.0-rc10

v0.11.0-rc8-arabica-improvements - Bridge + Full node sync stability

STORAGE-BREAKING RC -- ONLY COMPATIBLE WITH ARABICA-9

This is a cherry-picked RC containing storage-breaking fixes and improvements that will help full and bridge nodes sync more reliably. Node runners wishing to upgrade should clear their datastores using the instructions here.

Note that this release does not contain all commits from main and only contains necessary storage fixes and improvements as well as other necessary bug fixes and dependency bumps to help stabilise full and bridge nodes.

v0.11.0-rc9 - Storage fixes + shrex-nd ugprade

This RC is breaking in two ways:

1. it contains several storage optimisations and breaks such that those wishing to upgrade will have to re-sync from scratch (please read the Note below)
2. it contains an upgrade to the shrex-nd protocol

All storage optimisations and breaks as well as shrex-nd upgrades can be checked out here: #2545

Note: This RC is not yet compatible with either arabica or mocha.

What's Changed

BREAKING

• !feat(share/p2p/shrex-nd): rework shrex-nd to serve data in multiple messages by @walldiss in #2444
• release!: Breaking release V0.11.0 rc9 by @walldiss in #2545

OTHER

• fix(nodebuilder): fix nil pointer exception and simplify synchronization by @Wondertan in #2466
• docs: clarify usage of len(merkleRowRoots) by @rootulp in #2431
• chore(share/p2p/discovery): demote disc peers log to debug by @renaynay in #2473
• chore(deps): bump otel, go-header, and go-fraud by @walldiss in #2472
• chore: move versioning outside the main package by @vgonkivs in #2468
• refactor(share/availability): don't log error canceled operation by @walldiss in #2475
• feat(nodebuilder): Invoke traces from fx by @vgonkivs in #2477
• fix: remove root from traces by @vgonkivs in #2483
• feat(share/byzantine): handle additional cases in befp validation by @vgonkivs in #2383
• chore(deps): bump celestiaorg/.github from 0.2.0 to 0.2.2 by @dependabot in #2484
• fix(nodebuilder/tests/swamp): Bump timeout by @renaynay in #2504
• dep: update nmt version by @vgonkivs in #2509
• feat: new metrics - deployment dashboard by @jrmanes in #2464
• test(share/utils): fix no deadline test for ctxWithSplitTimeout by @walldiss in #2502
• fix(share/availability): update availability ErrNotAvailable handling logic by @walldiss in #2445
• chore(deps): bump cosmossdk.io/errors from 1.0.0-beta.7 to 1.0.0 by @dependabot in #2486
• fix: check for namespace version 0 by @rootulp in #2514
• chore(deps): bump github.com/spf13/cobra from 1.6.1 to 1.7.0 by @dependabot in #2487
• test(share/p2p): fix namespace add operations in tests by @walldiss in #2422
• fix(share/eds): remove Has() and Sync() badger calls in inverted index by @walldiss in #2518
• fix(share/eds): turn off eds store dagstore gc by default by @walldiss in #2529
• feat(share/shrex/nd): add swamp test for shrex nd by @walldiss in #2227
• feat(share/eds): introduce List method for the Store by @Wondertan in #2494
• fix(share/eds): print error for stuck register shard by @walldiss in #2516
• chore(deps): bump celestia-app to rc10 by @cmwaters in #2508
• chore: bump app v1.0.0 rc11 by @evan-forbes in #2527
• fix(share/p2p): fix race in shrexeds test by @walldiss in #2534
• feat(share/store): add eds store metrics by @walldiss in #2536
• chore: bump libp2p by @Wondertan in #2533
• feat(cmd): use rpc client instead of http.Request by @vgonkivs in #2521
• feat(eds/store): cache proofs after first eds recompute on sampling by @walldiss in #2429

New Contributors

• @cmwaters made their first contribution in #2508

Full Changelog: v0.11.0-rc8...v0.11.0-rc9

v0.11.0-rc8 - Fix Mocha

What's Changed

• share/befp: add benchmarks for fraud proof creation and validation by @vgonkivs in #2400
• deps: bump go-header by @Wondertan in #2436
• chore: bump celestia-app to v1.0.0-rc8 by @evan-forbes in #2434
• deps: bump go-header by @Wondertan in #2438
• feat: use context in the common pipeline by @jrmanes in #2447
• fix(header): temporary disable skipping verification by @Wondertan in #2456
• share/befp: rework collecting and verifying the BEFP by @vgonkivs in #2408
• chore: bump celestia app v1.0.0-rc9 by @evan-forbes in #2458
• fix(lint): fix importing by @vgonkivs in #2467
• cmd: rpc.go fix error parsing height message by @tuxcanfly in #2469

New Contributors

• @tuxcanfly made their first contribution in #2469

Full Changelog: v0.11.0-rc7...v0.11.0-rc8

v0.11.0-rc7 - Upgrade mocha

What's Changed

• feat: update Go base alpine - add branch in makefile by @jrmanes in #2414
• doc(share/p2p/shrexnd): Improve accuracy of RequestND description by @musalbas in #2418
• chore(deps): bump alpine from 3.18.0 to 3.18.2 by @dependabot in #2380
• chore(nodebuilder/p2p)! Upgrade to mocha-3 by @sysrex in #2432

New Contributors

• @musalbas made their first contribution in #2418

Full Changelog: v0.11.0-rc6...v0.11.0-rc7