Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

--bindP1P2 not working correctly? #4609

Closed
8 of 20 tasks
Fatman13 opened this issue Dec 13, 2021 · 3 comments
Closed
8 of 20 tasks

--bindP1P2 not working correctly? #4609

Fatman13 opened this issue Dec 13, 2021 · 3 comments
Assignees
@diwufeiwen
Labels
V-venus-sealer venus-sealer component
Milestone
sprint 29

Comments

@Fatman13
Copy link
Contributor

Checklist

  • This is not a security-related bug/issue. If it is, please follow please follow the security policy.
  • This is not a question or a support request. If you have any lotus related questions, please ask in the venus forum.
  • This is not a new feature request. If it is, please file a feature request instead.
  • This is not an enhancement request. If it is, please file a improvement suggestion instead.
  • I have searched on the issue tracker and the venus forum, and there is no existing related issue or discussion.
  • I am running the latest release, or the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
  • I did not make any code changes to venus.

Venus component

  • venus daemon - chain sync
  • venus auth - authentication
  • venus gateway - chain service gateway
  • venus miner - mining and block production
  • venus sealer/worker - sealing
  • venus sealer - proving(WindowPoSt)
  • venus market - storage deal
  • venus market - retrieval deal
  • venus market - data transfer
  • venus light-weight client
  • venus JSON-RPC API
  • venus messager - message management (mpool)
  • Other

Venus Version

latest incubation

Describe the Bug

https://filecoinproject.slack.com/archives/CEHHJNJS3/p1638960020056400

I have analyzed the last 20 sectors of PC1/PC2 and only 3 of them were assigned to PC2 worker with --bindP1P2 the others sectors went to other PC2 workers.
So it works rather poorly in my opinion.
It doesnt depends on which sealing directory was used. (there is 5 sealing dirs)
Below you can find the logs for example sector 9836

I saw that v1.13.2-rc2 of lotus has already merged "Sectors storage groups" filecoin-project/lotus#7453
So I think it will be only waste of time to fix --bindP1P2

Logging Information

BOX1 - PC1 logs


2021-12-10T17:40:05.181+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:0; a:7): {{0 0} /ssd3/unsealed/s-t01127678-9836 /ssd3/sealed/s-t01127678-9836 /ssd3/cache/s-t01127678-9836}
2021-12-10T17:40:05.181+0100    INFO    ffiwrapper      ffiwrapper/sealer_cgo.go:513    pre commit1 paths: {{0 0} /ssd3/unsealed/s-t01127678-9836 /ssd3/sealed/s-t01127678-9836 /ssd3/cache/s-t01127678-9836}
2021-12-10T17:41:22.070 INFO filecoin_proofs::api::seal > seal_pre_commit_phase1:start: SectorId(9836)
2021-12-10T20:56:37.164 INFO filecoin_proofs::api::seal > seal_pre_commit_phase1:finish: SectorId(9836)
2021-12-10T20:56:37.167+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnSealPreCommit1] complete for sector 9836

BOX1 - PC2 logs

2021-12-10T20:56:37.221+0100    INFO    advmgr  sector-storage/worker_local.go:504      find acquire sector paths: {{0 0}  /ssd1/sealed/s-t01127678-9836 }
2021-12-10T20:56:37.241+0100    INFO    advmgr  sector-storage/worker_local.go:504      find acquire sector paths: {{0 0}  /ssd1/sealed/s-t01127678-9836 }
2021-12-10T21:02:56.645+0100    INFO    stores  stores/http_handler.go:89       SERVE GET /remote/sealed/s-t01127678-9836
2021-12-10T21:03:32.495+0100    DEBUG   stores  stores/http_handler.go:162      served sector file/dir, sectorID={Miner:1127678 Number:9836}, fileType=sealed, path=/ssd3/sealed/s-t01127678-9836
2021-12-10T21:03:32.504+0100    INFO    stores  stores/http_handler.go:166      SERVE DELETE /remote/sealed/s-t01127678-9836
2021-12-10T21:03:32.505+0100    INFO    stores  stores/local.go:619     remove /ssd3/sealed/s-t01127678-9836
2021-12-10T21:03:35.078+0100    INFO    stores  stores/http_handler.go:89       SERVE GET /remote/cache/s-t01127678-9836
2021-12-10T21:19:26.400+0100    DEBUG   stores  stores/http_handler.go:162      served sector file/dir, sectorID={Miner:1127678 Number:9836}, fileType=cache, path=/ssd3/cache/s-t01127678-9836
2021-12-10T21:19:26.404+0100    INFO    stores  stores/http_handler.go:166      SERVE DELETE /remote/cache/s-t01127678-9836
2021-12-10T21:19:26.405+0100    INFO    stores  stores/local.go:619     remove /ssd3/cache/s-t01127678-9836
2021-12-10T23:11:20.100+0100    INFO    stores  stores/http_handler.go:89       SERVE GET /remote/unsealed/s-t01127678-9836
2021-12-10T23:12:10.230+0100    DEBUG   stores  stores/http_handler.go:162      served sector file/dir, sectorID={Miner:1127678 Number:9836}, fileType=unsealed, path=/ssd3/unsealed/s-t01127678-9836
2021-12-10T23:12:10.239+0100    INFO    stores  stores/http_handler.go:166      SERVE DELETE /remote/unsealed/s-t01127678-9836
2021-12-10T23:12:10.239+0100    INFO    stores  stores/local.go:619     remove /ssd3/unsealed/s-t01127678-9836

BOX2 - PC2 logs

2021-12-10T21:02:56.641+0100    INFO    stores  stores/remote.go:228    Fetch http://192.168.88.52:34535/remote/sealed/s-t01127678-9836 -> /md0/sealed/fetching/s-t01127678-9836
2021-12-10T21:03:32.499+0100    DEBUG   stores  stores/util_unix.go:30  move sector data        {"from": "/md0/sealed/fetching/s-t01127678-9836", "to": "/md0/sealed/s-t01127678-9836"}
2021-12-10T21:03:32.501+0100    INFO    stores  stores/remote.go:364    Delete http://192.168.88.52:34535/remote/sealed/s-t01127678-9836
2021-12-10T21:03:35.075+0100    INFO    stores  stores/remote.go:228    Fetch http://192.168.88.52:34535/remote/cache/s-t01127678-9836 -> /md0/cache/fetching/s-t01127678-9836
2021-12-10T21:19:26.399+0100    DEBUG   stores  stores/util_unix.go:30  move sector data        {"from": "/md0/cache/fetching/s-t01127678-9836", "to": "/md0/cache/s-t01127678-9836"}
2021-12-10T21:19:26.400+0100    INFO    stores  stores/remote.go:364    Delete http://192.168.88.52:34535/remote/cache/s-t01127678-9836
2021-12-10T21:19:42.255+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:6; a:0): {{0 0}  /md0/sealed/s-t01127678-9836 /md0/cache/s-t01127678-9836}
2021-12-10T21:19:42.259+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnFetch] complete for sector 9836
2021-12-10T21:19:42.263+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:6; a:0): {{0 0}  /md0/sealed/s-t01127678-9836 /md0/cache/s-t01127678-9836}
2021-12-10T21:37:29.058 INFO storage_proofs_core::data > dropping data /md0/sealed/s-t01127678-9836
2021-12-10T21:37:29.980+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnSealPreCommit2] complete for sector 9836
2021-12-10T22:57:08.466+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:6; a:0): {{0 0}  /md0/sealed/s-t01127678-9836 /md0/cache/s-t01127678-9836}
2021-12-10T22:57:08.467+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnFetch] complete for sector 9836
2021-12-10T22:57:08.468+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:6; a:0): {{0 0}  /md0/sealed/s-t01127678-9836 /md0/cache/s-t01127678-9836}
2021-12-10T22:57:08.469 INFO filecoin_proofs::api::seal > seal_commit_phase1:start: SectorId(9836)
2021-12-10T22:57:11.424 INFO filecoin_proofs::api::seal > seal_commit_phase1:finish: SectorId(9836)
2021-12-10T22:57:12.706+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnSealCommit1] complete for sector 9836
2021-12-10T23:11:20.098+0100    INFO    stores  stores/remote.go:228    Fetch http://192.168.88.52:34535/remote/unsealed/s-t01127678-9836 -> /md0/unsealed/fetching/s-t01127678-9836
2021-12-10T23:12:10.235+0100    DEBUG   stores  stores/util_unix.go:30  move sector data        {"from": "/md0/unsealed/fetching/s-t01127678-9836", "to": "/md0/unsealed/s-t01127678-9836"}
2021-12-10T23:12:10.237+0100    INFO    stores  stores/remote.go:364    Delete http://192.168.88.52:34535/remote/unsealed/s-t01127678-9836
2021-12-10T23:12:12.469+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:7; a:0): {{0 0} /md0/unsealed/s-t01127678-9836 /md0/sealed/s-t01127678-9836 /md0/cache/s-t01127678-9836}
2021-12-10T23:12:12.473+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnFetch] complete for sector 9836
2021-12-10T23:12:12.474+0100    DEBUG   advmgr  sector-storage/worker_local.go:147      acquired sector {{1127678 9836} 8} (e:4; a:0): {{0 0}   /md0/cache/s-t01127678-9836}
2021-12-10T23:12:13.228+0100    INFO    stores  stores/local.go:619     remove /md0/unsealed/s-t01127678-9836
2021-12-10T23:12:16.822+0100    INFO    advmgr  sector-storage/worker_local.go:238      task [ReturnFinalizeSector] complete for sector 9836
2021-12-10T23:12:17.063+0100    INFO    stores  stores/http_handler.go:89       SERVE GET /remote/sealed/s-t01127678-9836
2021-12-10T23:13:16.626+0100    DEBUG   stores  stores/http_handler.go:162      served sector file/dir, sectorID={Miner:1127678 Number:9836}, fileType=sealed, path=/md0/sealed/s-t01127678-9836
2021-12-10T23:13:17.288+0100    INFO    stores  stores/http_handler.go:166      SERVE DELETE /remote/sealed/s-t01127678-9836
2021-12-10T23:13:17.289+0100    INFO    stores  stores/local.go:619     remove /md0/sealed/s-t01127678-9836
2021-12-10T23:13:19.550+0100    INFO    stores  stores/http_handler.go:89       SERVE GET /remote/cache/s-t01127678-9836
2021-12-10T23:13:19.692+0100    DEBUG   stores  stores/http_handler.go:162      served sector file/dir, sectorID={Miner:1127678 Number:9836}, fileType=cache, path=/md0/cache/s-t01127678-9836
2021-12-10T23:13:19.735+0100    INFO    stores  stores/http_handler.go:166      SERVE DELETE /remote/cache/s-t01127678-9836
2021-12-10T23:13:19.736+0100    INFO    stores  stores/local.go:619     remove /md0/cache/s-t01127678-9836



### Repo Steps

_No response_
@Fatman13 Fatman13 added the V-venus-sealer venus-sealer component label Dec 13, 2021
@diwufeiwen
Copy link
Contributor

filecoin-project/venus-sealer#155

@Fatman13 Fatman13 mentioned this issue Dec 17, 2021
Merged
@Fatman13
Copy link
Contributor Author

Fatman13 commented Dec 20, 2021 •
edited
Loading

adopting same approach by lotus filecoin-project/lotus-docs#32

@Fatman13
Copy link
Contributor Author

Fatman13 commented Dec 20, 2021 •
edited
Loading

discussion thread filecoin-project/lotus#7238

@Fatman13 Fatman13 added this to the sprint 29 milestone Dec 20, 2021
@Fatman13 Fatman13 mentioned this issue Mar 22, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@diwufeiwen diwufeiwen

Labels
V-venus-sealer venus-sealer component
Projects
None yet
Milestone
sprint 29
Development

No branches or pull requests
2 participants
@Fatman13 @diwufeiwen