v0.18.2 - Shwap Arabica

This is a protocol-breaking release featuring Shwap(CIP-19), which targets the Arabica network that brings massive optimizations to disk usage(14x) and data access latencies. The new protocol is not backwards compatible with the currently deployed protocol and software.

Both protocols will run side-by-side for a month-long transition period, from September 25 to October 23(which may end earlier) for Arabica. During this period, node operators should migrate to the new version. At the end of the period, posted historical and recent data will no longer be available on the old protocol.

Migration Notes

Migration requires resyncing the node from scratch, as it now contains a new storage format.

Migration Steps over the old node:

• Remove old data:
  • In home directory(default .celestia-<type>-arabica-4) => rm -rf inverted_index index data transients blocks
  • Keep keys directory to preserve peer and chain identity keys in place
• Config updates
  • If defaults were in use, remove the old config and re-init in the next step
  • If you want to preserve the old config - move BlockstoreCacheSize entry from [Share.EDSStoreParams] section to just [Share]
    and remove GCInterval, RoutingTableRefreshPeriod
• Re-init node for the Arabica p2p network
  • celestia init --p2p.network arabica
• Start the node and monitor syncing
  • celestia start --p2p.network arabica

If the old node has to be kept running - initiate and start the new version in a different directory:

• celestia init --p2p.network arabica --node.store <new_path>
• celestia start --p2p.network arabica --node.store <new_path>

Changelog

The full changelog will be provided on the official mainnet release

v0.17.0-mocha

This release contains an API-breaking change to the DA API via #3750

What's changed

• fix: remove godebug asynctimerchan=1 by @cristaloleg in #3790
• feat(cel-shed/p2p): bootstrapper probe tool by @smuu in #3780
• test(nodebuilder): disable TestArchivalBlobSync by @cristaloleg in #3635
• feat(nodebuilder/da)!: implement go-da v0.6.1 changesby @tzdybal in #3750

v0.17.0-arabica

This release contains an API-breaking change to the DA API via #3750

What's changed

• fix: remove godebug asynctimerchan=1 by @cristaloleg in #3790
• feat(cel-shed/p2p): bootstrapper probe tool by @smuu in #3780
• test(nodebuilder): disable TestArchivalBlobSync by @cristaloleg in #3635
• feat(nodebuilder/da)!: implement go-da v0.6.1 changesby @tzdybal in #3750

Full Changelog: v0.16.2-mocha...v0.17.0-arabica

v0.16.2-mocha

What's Changed

• chore(deps): upgrade to app v2.2.0-arabica by @rootulp in #3772
• fix(header): soft failure is only for not enough voting power by @cristaloleg in #3769
• fix(core/listener): wait listener to shutdown before exit by @walldiss in #3775
• chore(deps): upgrade to v2.2.0-mocha by @rootulp in #3786

Full Changelog: v0.16.1-mocha...v0.16.2-mocha

v0.18.1-arabica

This is a protocol-breaking release featuring Shwap(CIP-19), which targets the Arabica network that brings massive optimizations to disk usage and data access latencies. The new protocol is not backward compatible with the currently deployed protocol and software.

Both protocols will run side-by-side for a month-long transition period, from September 25 to October 23 for Arabica. During this period, node operators should migrate to the new version. At the end of the period, posted historical and recent data will no longer be available on the old protocol.

Migration Notes

Migration requires resyncing the node from scratch, as it now contains a new storage format.

Migration Steps over the old node:

• Remove old data:
  • In home directory(default .celestia-<type>-arabica-11) => rm -rf inverted_index index data transients blocks
  • Keep keys directory to preserve peer and chain identity keys in place
• Config update
  • In case defaults were in use, remove the old config
• Re-init node for the Arabica p2p network
  • celestia init --p2p.network arabica
• Start the node and monitor syncing
  • celestia start --p2p.network arabica

If the old node has to be kept running - initiate and start the new version in a different directory:

• celestia init --p2p.network arabica --node.store <new_path>
• celestia start --p2p.network arabica --node.store <new_path>

Changelog

The full changelog will be provided on the official mainnet release

v0.16.2-arabica

What's Changed

• chore(deps): upgrade to app v2.2.0-arabica by @rootulp in #3772
• fix(header): soft failure is only for not enough voting power by @cristaloleg in #3769
• fix(core/listener): wait listener to shutdown before exit by @walldiss in #3775

Full Changelog: v0.16.1-arabica...v0.16.2-arabica

v0.16.1-mocha

This release includes new bootstrappers for the mainnet, performance enhancements, and several bug fixes.

CELESTIA_HOME env var changed its behavior. Previously, it worked like XDG_HOME in the form of $CELESTIA_HOME/.celestia--. This change makes $CELESTIA_HOME the actual path to which node data goes.

NOTE: It is no longer required to set GODEBUG="asynctimerchan=1" manually, It will be set automatically.

What's Changed

• chore(swamp): skip fraud test until a better day by @Wondertan in #3712
• chore(go.mod): use toolchain version in go.mod by @walldiss in #3714
• fix(logs): bitswap logger names broke in latest version bump, updated by @renaynay in #3713
• chore(p2p/shrexsub) increase timeout for flaky shrexsub test by @walldiss in #3672
• chore(ci): run unit-tests in parallel with lint by @walldiss in #3700
• feat(modrpc): list pubsub topics RPC by @Wondertan in #3744
• fix(blob/service): return error from GetProof if it appears by @vgonkivs in #3742
• chore: use sync/atomic types by @cristaloleg in #3723
• Add bootsrapper for mainnet by Qubelabs by @qubelabsio in #3760
• Add bootstrapper mainnet P-OPS by @rooiie in #3749
• Chore(fix): set asynctimerchan=1 on build by @walldiss in #3761
• fix(ci): Run pruning integration test separately in ci by @walldiss in #3752
• log(das): clarify that square width is for EDS by @renaynay in #3725
• fix(nodebuilder/host): Ensure libp2p metrics are collected to prometheus by @walldiss in #3753
• fix(nodebuilder/p2p/metrics): enforce init order for bitswap metrics by @walldiss in #3763
• fix(node): fixup CELESTIA_HOME by @Wondertan in #3759
• feat: add network-specific tags to ci container workflow by @smuu in #3765
• chore(ci): add workflow dispath to docker ci to manually trigger by @MSevey in #3766

Full Changelog: v0.16.0...v0.16.1-mocha

v0.16.1-arabica

This release includes new bootstrappers for the mainnet, performance enhancements, and several bug fixes.

CELESTIA_HOME env var changed its behavior. Previously, it worked like XDG_HOME in the form of $CELESTIA_HOME/.celestia--. https://github.com/celestiaorg/celestia-node/pull/3759makes $CELESTIA_HOME the actual path to which node data goes.

NOTE: It is no longer required to set GODEBUG="asynctimerchan=1" manually, It will be set automatically.

What's Changed

• chore(swamp): skip fraud test until a better day by @Wondertan in #3712
• chore(go.mod): use toolchain version in go.mod by @walldiss in #3714
• fix(logs): bitswap logger names broke in latest version bump, updated by @renaynay in #3713
• chore(p2p/shrexsub) increase timeout for flaky shrexsub test by @walldiss in #3672
• chore(ci): run unit-tests in parallel with lint by @walldiss in #3700
• feat(modrpc): list pubsub topics RPC by @Wondertan in #3744
• fix(blob/service): return error from GetProof if it appears by @vgonkivs in #3742
• chore: use sync/atomic types by @cristaloleg in #3723
• Add bootsrapper for mainnet by Qubelabs by @qubelabsio in #3760
• Add bootstrapper mainnet P-OPS by @rooiie in #3749
• Chore(fix): set asynctimerchan=1 on build by @walldiss in #3761
• fix(ci): Run pruning integration test separately in ci by @walldiss in #3752
• log(das): clarify that square width is for EDS by @renaynay in #3725
• fix(nodebuilder/host): Ensure libp2p metrics are collected to prometheus by @walldiss in #3753
• fix(nodebuilder/p2p/metrics): enforce init order for bitswap metrics by @walldiss in #3763
• fix(node): fixup CELESTIA_HOME by @Wondertan in #3759
• feat: add network-specific tags to ci container workflow by @smuu in #3765
• chore(ci): add workflow dispath to docker ci to manually trigger by @MSevey in #3766

Full Changelog: v0.16.0...v0.16.1-arabica

v0.16.1-rc1

Changelog

• 2a9acb4 fix(node): fixup CELESTIA_HOME (#3759)

v0.16.0

NOTE: There is a bug in go1.23 that may cause networking and timeout issues(golang/go#69312). If you experience syncing/sampling instability, try running your node with GODEBUG="asynctimerchan=1"

What’s Changed:

• Celestia-App v2 (Lemongrass) Upgrade:

  • The latest release integrates the Celestia-App v2 (Lemongrass) upgrade, which introduces key improvements such as Interchain Accounts and Packet Forward Middleware. This update is backward-compatible with existing node configurations, ensuring a smooth transition. However, there are minor API breaking changes for SubmitPayForBlob API to note:
    • Error Handling: The way errors are constructed within the SubmitPayForBlob function has been slightly modified. Despite this change, the errors returned will continue to contain the same information as before, ensuring that all necessary details are still available in the error.
    • API Response Changes: The return type for SubmitPayForBlob remains unchanged, but most fields in the response will now be omitted. Only the Code, TxHash, and Height fields will be populated, with all other fields set to empty values.

• Community-Run Bootstrappers for Mocha Test Network:

  • We’ve added new community-operated bootstrappers to the Mocha Testnet, contributed by pops.one and qubelabs. These bootstrappers will enhance the network's decentralization and resilience.

• Performance Improvements for Full and Bridge Nodes:

  • This release includes significant performance optimizations for Full and Bridge nodes, particularly in CPU and disk IOPS consumption. These improvements aim to reduce resource usage, providing a more efficient and stable node operation experience.

Changelog

Breaking

• chore!: bump celestia-app to v2.1.2 by @ninabarbakadze in #3674

Celestia-App v2 (Lemongrass) Upgrade

• chore(deps): upgrade to celestia-app v2.0.0 by @rootulp in #3453

Mocha bootstrapers update

• feat(chore): Add the Pops.one bootstrapper to the Mocha test network by @rooiie in #3706
• Add Qubelabs Bootstrapper for Mocha by @qubelabsio in #3708
• feat: mocha update DNS of BN bootstrapper by @smuu in #3659
• feat: mocha bootstrapper now with dnsaddr by @smuu in #3704

Performance improvements

• fix(share): return fixed data size in blockstore by @cristaloleg in #3634

Fixes

• fix(p2p): couple bitswap client and server by @walldiss in #3641
• fix(nodebuilder/state): overwrite state flags only if they were passed explicitly by @vgonkivs in #3663
• fix(store/cache): force close Accessor if not closed within timeout by @walldiss in #3642

Other

• chore: improve Make help command by @rootulp in #3640
• refactor(header): Validate should check that the raw header's app version is not greater than latest app version by @renaynay in #3589
• chore(deps): Bump golangci/golangci-lint-action from 6.0.1 to 6.1.0 by @dependabot in #3622
• misc(ci): detect breaking change to any .proto files or config fields in nodebuilder/**/config.go and add kind:break! by @ramin in #3568
• config(issues): extend bug report template to request DASer state for stuck nodes by @ramin in #3564
• chore(deps): Bump alpine from 3.20.1 to 3.20.2 by @dependabot in #3602
• ci(CODEOWNERS): remove @ramin by @ramin in #3660
• ci: fix goreleaser check deprecation warning by @rootulp in #3667
• deps(go.mod): bump boxo + libp2p by @renaynay in #3671
• chore(deps): Bump google.golang.org/grpc from 1.64.0 to 1.65.0 by @dependabot in #3565
• chore(deps): Bump github.com/rollkit/go-da from 0.4.0 to 0.5.0 by @dependabot in #3269
• chore(deps): Bump github.com/gofrs/flock from 0.8.1 to 0.12.1 by @dependabot in #3588
• chore(deps): Bump github.com/filecoin-project/go-jsonrpc from 0.4.0 to 0.6.0 by @dependabot in #3623
• chore(deps): Bump github.com/libp2p/go-libp2p-routing-helpers from 0.7.3 to 0.7.4 by @dependabot in #3541
• chore(ci): add lint imports ci action by @walldiss in #3677
• chore(lint): bump golang-ci lint to 1.60 by @walldiss in #3678
• chore: bump bump go to 1.23 by @walldiss in #3676
• fix(share/discovery): fix TestDiscovery test by @walldiss in #3699
• chore(deps): bump go-libp2p-kad-dht to v0.26.1 by @walldiss in #3698
• refactor(share/bitswap): remove feature flag for bitswap fix by @walldiss in #3703
• feat(metrics): send bitswap metric to prometheus by @walldiss in #3701

New Contributors

• @ninabarbakadze made their first contribution in #3674
• @rooiie made their first contribution in #3706
• @qubelabsio made their first contribution in #3708

Full Changelog: v0.15.0...v0.16.0