Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Block blocked at height #5202215 #3089

Closed
vae520283995 opened this issue May 24, 2021 · 8 comments
Closed

Block blocked at height #5202215 #3089

vae520283995 opened this issue May 24, 2021 · 8 comments

Comments

@vae520283995
Copy link 

Version: 0.9.0-b5519e768-x86_64-linux-gnu

   0: <unknown>
   1: <unknown>
   2: <unknown>
   3: <unknown>
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: <unknown>
  16: <unknown>
  17: <unknown>
  18: <unknown>
  19: <unknown>
  20: <unknown>
  21: <unknown>
  22: <unknown>
  23: <unknown>
  24: <unknown>
  25: <unknown>
  26: <unknown>
  27: <unknown>
  28: <unknown>
  29: <unknown>
  30: <unknown>
  31: <unknown>
  32: <unknown>
  33: <unknown>
  34: <unknown>
  35: <unknown>
  36: <unknown>
  37: <unknown>
  38: <unknown>
  39: <unknown>
  40: <unknown>
  41: <unknown>
  42: <unknown>
  43: <unknown>
  44: <unknown>
  45: <unknown>
  46: <unknown>
  47: <unknown>
  48: start_thread
  49: clone


Thread 'tokio-runtime-worker' panicked at 'Failed to allocate memory: "Allocator ran out of space"', /usr/local/cargo/git/checkouts/substrate-7e08433d4c370a21/dc9acd2/primitives/io/src/lib.rs:1057

This is a bug. Please report it at:

	https://github.com/paritytech/polkadot/issues/new

2021-05-24 14:15:02  Evicting failed runtime instance: RuntimePanicked("Failed to allocate memory: \"Allocator ran out of space\"")    
2021-05-24 14:15:02  Block prepare storage changes error:
RuntimeApiError(Application(Execution(RuntimePanicked("Failed to allocate memory: \"Allocator ran out of space\""))))    
2021-05-24 14:15:02  💔 Error importing block 0xd79f21595fb10471ab2b0d9427dffa8de4001c351a53f408995cf2dda309e43a: Err(Other(ClientImport("Import failed: Error at calling runtime api: Execution failed: RuntimePanicked(\"Failed to allocate memory: \\\"Allocator ran out of space\\\"\")")))    
2021-05-24 14:15:02  💔 Error importing block 0x5921b7b1b5269c96e91421f5b55d37c70db36d99fa3a207ce50429b3a20d7939: Err(UnknownParent)    
2021-05-24 14:15:02  💔 Error importing block 0xb96bfa95b07ed82bcb2628447df98f355162991ecb4513aa1c81f767dd712b23: Err(UnknownParent)    
2021-05-24 14:15:07  💤 Idle (42 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 74.3kiB/s ⬆ 0.9kiB/s    
2021-05-24 14:15:12  💤 Idle (42 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 12.8kiB/s ⬆ 5.0kiB/s    
2021-05-24 14:15:17  💤 Idle (42 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 16.9kiB/s ⬆ 0.3kiB/s    
2021-05-24 14:15:22  💤 Idle (42 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 8.1kiB/s ⬆ 3.1kiB/s
@vae520283995
Copy link
Author

vae520283995 commented May 24, 2021 •
edited
Loading

Update to v0.9.2 did not solve

2021-05-24 14:23:20  Parity Polkadot    
2021-05-24 14:23:20  ✌️  version 0.9.2-f36bb8201-x86_64-linux-gnu    
2021-05-24 14:23:20  ❤️  by Parity Technologies <admin@parity.io>, 2017-2021    
2021-05-24 14:23:20  📋 Chain specification: Polkadot    
2021-05-24 14:23:20  🏷 Node name: wild-coal-6990    
2021-05-24 14:23:20  👤 Role: FULL    
2021-05-24 14:23:20  💾 Database: RocksDb at /data/chains/polkadot/db    
2021-05-24 14:23:20  ⛓  Native runtime: polkadot-9020 (parity-polkadot-0.tx7.au0)    
2021-05-24 14:23:21  🏷 Local node identity is: 12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:21  📦 Highest known block at #5202215    
2021-05-24 14:23:21  〽️ Prometheus server started at 127.0.0.1:9615    
2021-05-24 14:23:21  Listening for new connections on 0.0.0.0:9944.    
2021-05-24 14:23:22  🔍 Discovered new external address for our node: /ip4/54.169.105.235/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:22  🔍 Discovered new external address for our node: /ip4/172.17.0.2/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:23  🔍 Discovered new external address for our node: /ip4/172.18.0.3/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:23  🔍 Discovered new external address for our node: /ip4/127.0.0.1/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:23  Accepted a new tcp connection from 172.17.0.1:34530.    
2021-05-24 14:23:24  🔍 Discovered new external address for our node: /ip4/192.168.101.192/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:26  💤 Idle (11 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 187.5kiB/s ⬆ 24.7kiB/s    
2021-05-24 14:23:27  🔍 Discovered new external address for our node: /ip4/10.2.112.37/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:30  🔍 Discovered new external address for our node: /ip4/172.18.0.2/tcp/30333/ws/p2p/12D3KooWDkkFKMiMpgQ5Wa3CKKhRGn1ZMXTFp4mQZZX8kG8wLZwW    
2021-05-24 14:23:31  💤 Idle (14 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 81.5kiB/s ⬆ 44.9kiB/s    
2021-05-24 14:23:36  💤 Idle (16 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 64.5kiB/s ⬆ 91.5kiB/s    
2021-05-24 14:23:41  💤 Idle (16 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 129.2kiB/s ⬆ 112.7kiB/s    
2021-05-24 14:23:46  💤 Idle (18 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 105.7kiB/s ⬆ 108.5kiB/s    
2021-05-24 14:23:51  💤 Idle (18 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 13.3kiB/s ⬆ 80.6kiB/s

Thread 'tokio-runtime-worker' panicked at 'Failed to allocate memory: "Allocator ran out of space"', /usr/local/cargo/git/checkouts/substrate-7e08433d4c370a21/1d7f6e1/primitives/io/src/lib.rs:1068

This is a bug. Please report it at:

	https://github.com/paritytech/polkadot/issues/new

2021-05-24 15:24:55  Block prepare storage changes error:
RuntimeApiError(Application(Execution(Other("Wasm execution trapped: Failed to allocate memory: \"Allocator ran out of space\"\nwasm backtrace:\n    0: 0x1601 - <unknown>!sp_io::allocator::extern_host_function_impls::malloc::h3ba50d5b2de26c25\n    1: 0xcf604 - <unknown>!core::ops::function::impls::<impl core::ops::function::FnMut<A> for &mut F>::call_mut::he3692847e41b46cc\n    2: 0xcf1c2 - <unknown>!sp_npos_elections::setup_inputs::hd89ca1e0feeaabd9\n    3: 0x90707 - <unknown>!sp_npos_elections::phragmen::seq_phragmen::hd129027c03c0249a\n    4: 0xa1161 - <unknown>!pallet_staking::Module<T>::new_era::hf7fe25e8949425a7\n    5: 0x9930e - <unknown>!<(TupleElement0,TupleElement1) as frame_support::traits::OnInitialize<BlockNumber>>::on_initialize::h398bc3af78c339e8\n    6: 0x1576c3 - <unknown>!frame_executive::Executive<System,Block,Context,UnsignedValidator,AllPallets,COnRuntimeUpgrade>::initialize_block::h975d2a527ce51f82\n    7: 0x15082b - <unknown>!Core_execute_block\nnote: run with `WASMTIME_BACKTRACE_DETAILS=1` environment variable to display more information\n"))))    
2021-05-24 15:24:55  💔 Error importing block 0xd79f21595fb10471ab2b0d9427dffa8de4001c351a53f408995cf2dda309e43a: Err(Other(ClientImport("Import failed: Error at calling runtime api: Execution failed: Other(\"Wasm execution trapped: Failed to allocate memory: \\\"Allocator ran out of space\\\"\\nwasm backtrace:\\n    0: 0x1601 - <unknown>!sp_io::allocator::extern_host_function_impls::malloc::h3ba50d5b2de26c25\\n    1: 0xcf604 - <unknown>!core::ops::function::impls::<impl core::ops::function::FnMut<A> for &mut F>::call_mut::he3692847e41b46cc\\n    2: 0xcf1c2 - <unknown>!sp_npos_elections::setup_inputs::hd89ca1e0feeaabd9\\n    3: 0x90707 - <unknown>!sp_npos_elections::phragmen::seq_phragmen::hd129027c03c0249a\\n    4: 0xa1161 - <unknown>!pallet_staking::Module<T>::new_era::hf7fe25e8949425a7\\n    5: 0x9930e - <unknown>!<(TupleElement0,TupleElement1) as frame_support::traits::OnInitialize<BlockNumber>>::on_initialize::h398bc3af78c339e8\\n    6: 0x1576c3 - <unknown>!frame_executive::Executive<System,Block,Context,UnsignedValidator,AllPallets,COnRuntimeUpgrade>::initialize_block::h975d2a527ce51f82\\n    7: 0x15082b - <unknown>!Core_execute_block\\nnote: run with `WASMTIME_BACKTRACE_DETAILS=1` environment variable to display more information\\n\")")))    
2021-05-24 15:24:55  💔 Error importing block 0x4e2825636313cb034d0673571065869921a1aed0d088fe781134bce12a2c44df: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0x40a62de11bffe2af4a0ee6368554e133b9ffde3ef44b5e755b091fbf3185f776: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0xa1c3ac904935bfbae42d6402df189392efda3d89c59737741bd92d30f09f63d4: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0xf120666f47cc30b6403d0154df21b58e9093977afbe9fe9e180feea74f70a5b8: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0x1eabcf8103e4e51e85c489478b71731aaec43b6865019b758133cea3619f1e0f: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0xb6bbc5c0c59c389baac6f54ee76cb772f46540c85aae595f8ccb61f946f49da9: Err(UnknownParent)    
2021-05-24 15:24:55  💔 Error importing block 0xf82964451b7b24831f963866b5368d5ac032a0006517338328f7e446d9b0bc61: Err(UnknownParent)    
2021-05-24 15:24:58  💤 Idle (31 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 133.8kiB/s ⬆ 42.9kiB/s    
2021-05-24 15:25:03  💤 Idle (32 peers), best: #5202215 (0xa1ef…ee60), finalized #5202213 (0x23a2…d92d), ⬇ 24.3kiB/s ⬆ 1.8kiB/s

@vae520283995
Copy link
Author

@bkchr @arkpar

@vae520283995
Copy link
Author

Downgrade to the v0.8.30 can temporarily solve this issue

@alecalve
Copy link

We have 3 0.9.2 nodes stuck at the same height

@vae520283995
Copy link
Author

We have 3 0.9.2 nodes stuck at the same height

Downgrade to the v0.8.30

@AlexZhenWang
Copy link

AlexZhenWang commented May 24, 2021 •
edited
Loading

Thanks! Downgrade to the v0.8.30 solved the block sync issue on my end

@Neurone
Copy link
Contributor

Neurone commented May 24, 2021

Same issue #3090

@AlexZhenWang
Copy link

Just in case there is someone who hasn't know, we need to add --execution=native for the validator node when downgrading to 0.8.30

@DylanVerstraete DylanVerstraete mentioned this issue Sep 21, 2022
Closed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@Neurone @alecalve @AlexZhenWang @vae520283995