v1.13.2

[jennijuju]

Lotus v1.13.2 is a highly recommended feature release with remarkable retrieval improvements, new features like worker management, schedule enhancements and so on.

Highlights

• 🚀🚀🚀Improve retrieval deal experience
  • Testing result with MinerX.3 shows the retrieval deal success rate has increased dramatically with faster transfer
    speed, you can join or follow along furthur performance testings here. We recommend application developers to integrate with the new
    retrieval APIs to provide a better client experience.
  • 🌟🌟🌟 Reduce retrieval Time-To-First-Byte over 100x (#7693)
    • This change makes most free, small retrievals sub-second
  • 🌟🌟🌟 Partial retrieval ux improvements (#7610)
    • New retrieval commands for clients:
      • lotus client ls: retrieve and list desired object links
      • lotus client cat: retrieve and print the data from the network
    • 🌟🌟 The monolith ClientRetrieve method was broken into:
      • ClientRetrieve which retrieves data into the local repo (or into an IPFS node if ipfs integration is enabled)
      • ClientRetrieveWait which will wait for the retrieval to complete
      • ClientExport which will export data from the local node
      • Note: this change only applies to v1 API. v0 API remains unchanged.
    • 🌟 Support for full ipld selectors was added (for example making it possible to only retrieve list of directories in a deal, without fetching any file data)
      • To learn more, see here
• 🚀🚀 Sealing scheduler enhancements (#7703,#7269, #7714)
  • Workers are now aware of cgroup memory limits
  • Multiple tasks which use a GPU can be scheduled on a single worker
  • Workers can override default resource table through env vars
    • Default value list: https://gist.github.com/magik6k/c0e1c7cd73c1241a9acabc30bf469a43
• 🚀🚀 Sector storage groups (#7453)
  • Storage groups allow for better control of data flow between workers, for example, it makes it possible to define that data from PC1 on a given worker has to have it's PC2 step executed on the same worker
  • To set it up, follow the instructions under the Sector Storage Group section here

New Features

• Add RLE dump code (#7691)
• Shed: Add a util to list miner faults (#7605)
• lotus-shed msg: Decode submessages/msig proposals (#7639)
• CLI: Add a lotus multisig cancel command (#7645)
• shed: simple wallet balancer util (#7414)
  • balancing token balance between multiple accounts

Improvements

• Add verbose mode to lotus-miner pieces list-cids (#7699)
• retrieval: Only output matching nodes, MatchPath dagspec (#7706)
• Cleanup partial retrieval codepaths ( zero functional changes ) (#7688)
• storage: Use 1M buffers for Tar transfers (#7681)
• Chore/dm level tests plus merkle proof cars (#7673)
• Shed: Add a util to create miners more easily (#7595)
• add timeout flag to wait-api command (#7592)
• add log for restart windows post scheduler (#7613)
• remove jaeger envvars (#7631)
• remove api and jaeger env from docker file (#7624)
• Wdpost worker: Reduce challenge confidence to 1 epoch (#7572)
• add additional methods to lotus gateway (#7644)
• Add caches to lotus-stats and splitcode (#7329)
• remote store: Remove debug printf (#7664)
• docsgen-cli: Handle commands with no description correctly (#7659)

Bug Fixes

• fix docker logic error (#7709)
• add missing NodeType tag (#7559)
• checkCommit should return SectorCommitFailed (#7555)
• ffiwrapper: Validate PC2 by calling C1 with random seeds (#7710)

Dependency Updates

• Update go-graphsync v0.10.6 (#7708)
• update go-libp2p-pubsub to v0.5.6 (#7581)
• Update go-state-types (#7591)
• disable mplex stream muxer (#7689)
• Bump ws from 5.2.2 to 5.2.3 in /lotuspond/front (#7660)
• Bump color-string from 1.5.3 to 1.6.0 in /lotuspond/front (#7658)
• Bump postcss from 7.0.17 to 7.0.39 in /lotuspond/front (#7657)
• Bump path-parse from 1.0.6 to 1.0.7 in /lotuspond/front (#7656)
• Bump tmpl from 1.0.4 to 1.0.5 in /lotuspond/front (#7655)
• Bump url-parse from 1.4.7 to 1.5.3 in /lotuspond/front (#7654)
• github.com/filecoin-project/go-state-types (v0.1.1-0.20210915140513-d354ccf10379 -> v0.1.1):

Others

• Update archive script (#7690)

Contributors

Contributor	Commits	Lines ±	Files Changed
@magik6k	89	+5200/-1818	232
Travis Person	5	+1473/-953	38
@arajasek	6	+550/-38	19
@clinta	4	+393/-123	26
@ribasushi	3	+334/-68	7
@jennijuju	13	+197/-120	67
@Kubuxu	10	+153/-30	10
@coryschwartz	6	+18/-26	6
Marten Seemann	2	+6/-34	5
@vyzo	1	+3/-3	2
@hannahhoward	1	+3/-3	2
@ZenGround0	2	+2/-2	2
@yaohcn	2	+2/-2	2
@jennijuju	1	+1/-1	1
@hunjixin	1	+1/-0	1

---

This discussion was created from the release v1.13.2.