Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Solo-deployed CNode throws error: data/config/.archive/genesis-network.json: Device or resource busy #1027

Closed
alex-kuzmin-hg opened this issue Dec 29, 2024 · 4 comments · Fixed by #1074
Closed

Solo-deployed CNode throws error: data/config/.archive/genesis-network.json: Device or resource busy #1027

alex-kuzmin-hg opened this issue Dec 29, 2024 · 4 comments · Fixed by #1074
Assignees
@jeromy-cannon
Labels
Bug A error that causes the feature to behave differently than what was expected based on design docs P0 An issue impacting production environments or impacting multiple releases or multiple individuals. released

Comments

@alex-kuzmin-hg
Copy link
Contributor

Describe the bug

Solo-deployed CNode throws error:
hgcaa.log:2024-12-28 20:41:21.547 WARN 388 DiskStartupNetworks - Failed to archive [genesis-network.json]
hgcaa.log:java.nio.file.FileSystemException: data/config/genesis-network.json -> data/config/.archive/genesis-network.json: Device or resource busy

Describe the expected behavior

hgcaa.log:2024-12-28 20:41:21.547 WARN 388 DiskStartupNetworks - Failed to archive [genesis-network.json]
hgcaa.log:java.nio.file.FileSystemException: data/config/genesis-network.json -> data/config/.archive/genesis-network.json: Device or resource busy
hgcaa.log- at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:100) ~[?:?]
hgcaa.log- at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]
hgcaa.log- at java.base/sun.nio.fs.UnixFileSystem.move(UnixFileSystem.java:934) ~[?:?]
hgcaa.log- at java.base/sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:309) ~[?:?]
hgcaa.log- at java.base/java.nio.file.Files.move(Files.java:1430) ~[?:?]

To Reproduce

use latest main branch of Solo.
deploy normally with the "task", e.g. hedera-services branch: 17171-override-weight-mgmt
CN will throw the error above

Additional Context

No response
@alex-kuzmin-hg alex-kuzmin-hg added Bug A error that causes the feature to behave differently than what was expected based on design docs Pending Triage New issue that needs to be triaged by the team labels Dec 29, 2024
@alex-kuzmin-hg alex-kuzmin-hg self-assigned this Dec 29, 2024
@alex-kuzmin-hg
Copy link
Contributor Author

I'm investigating for more details...

@alex-kuzmin-hg
Copy link
Contributor Author

Root cause:
the CN code tries to File.move() mounted resource:
/dev/md0 on /opt/hgcapp/services-hedera/HapiApp2.0/data/config/genesis-network.json type ext4 (ro,relatime,stripe=256)

https://github.com/hashgraph/hedera-services/blob/346ac6489173bf282245ad9768998a06[…]src/main/java/com/hedera/node/app/info/DiskStartupNetworks.java

@jeromy-cannon jeromy-cannon added P0 An issue impacting production environments or impacting multiple releases or multiple individuals. and removed Pending Triage New issue that needs to be triaged by the team labels Dec 30, 2024
@alex-kuzmin-hg
Copy link
Contributor Author

Introduced in https://github.com/hashgraph/hedera-services/pull/16594/files

@jeromy-cannon jeromy-cannon self-assigned this Dec 31, 2024
@jeromy-cannon jeromy-cannon mentioned this issue Dec 31, 2024
Merged
@swirlds-automation
Copy link
Contributor

🎉 This issue has been resolved in version 0.32.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jeromy-cannon jeromy-cannon

Labels
Bug A error that causes the feature to behave differently than what was expected based on design docs P0 An issue impacting production environments or impacting multiple releases or multiple individuals. released
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: fixed genesis-network.json file lock issue hashgraph/solo
3 participants
@jeromy-cannon @swirlds-automation @alex-kuzmin-hg