New blocks aren't fetched and RPC goes down on periodic snapshot

[jleeh]

• Parity Ethereum version: 2.2.10
• Operating system: Linux
• Installation: Docker
• Fully synchronized: yes
• Network: ropsten
• Restarted: no

This is a constant whenever a periodic snapshot is starting to be created, and has happened around 10+ times on different physical instances. The parity instances will be active and working fine for around 12 hours until a snapshot is starting to be created.

This logging output for the snapshot never finishes and during this, the RPC is down. The parity node will continue to slowly sync over time, but often gets stuck on the same block for many hours.

Logging output:

2019-02-20 16:17:42 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:17:43 UTC Syncing #5055575 0x39d5…f742 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1228 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:17:48 UTC Syncing #5055576 0x8f41…10fd 0.20 blk/s 0.6 tx/s 0.0 Mgas/s 0+ 1228 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:17:52 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:17:53 UTC Syncing #5055576 0x8f41…10fd 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1228 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:17:58 UTC Syncing #5055576 0x8f41…10fd 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1228 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:05 UTC Syncing #5055577 0xf2fa…cfbd 0.17 blk/s 0.5 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:06 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:10 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:15 UTC Syncing #5055578 0x7684…5a88 0.17 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:16 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:21 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:24 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:25 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:30 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:33 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:36 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:41 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:43 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:45 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:50 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:18:53 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:18:55 UTC Syncing #5055578 0x7684…5a88 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:02 UTC Syncing #5055579 0x7d91…adae 0.21 blk/s 1.8 tx/s 0.9 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:03 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:08 UTC Syncing #5055579 0x7d91…adae 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:11 UTC Syncing #5055579 0x7d91…adae 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:13 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:15 UTC Syncing #5055579 0x7d91…adae 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:20 UTC Syncing #5055579 0x7d91…adae 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:23 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:25 UTC Syncing #5055580 0xc99f…c4a4 0.19 blk/s 1.1 tx/s 0.1 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:30 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:33 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:35 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:42 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:43 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:46 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:51 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:19:53 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:19:59 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:02 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:03 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:07 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:14 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:14 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:18 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:23 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:24 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:27 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:34 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:34 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:39 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:43 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:44 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:49 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:52 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:20:54 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:20:57 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:04 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:07 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:10 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:13 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:14 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:17 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:23 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:24 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:28 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:34 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:35 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:38 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:44 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:45 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:49 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:53 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:21:55 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:21:59 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:05 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:22:05 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:11 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:14 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:15 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:22:19 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 11 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:25 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:25 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:22:29 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:35 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:22:35 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:41 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:44 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:45 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:22:50 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:54 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:22:56 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:23:00 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 12 conn, 0 req/s, 15164421 µs
2019-02-20 16:23:05 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:23:05 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes
2019-02-20 16:23:11 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 10 conn, 0 req/s, 15164421 µs
2019-02-20 16:23:15 UTC Syncing #5055580 0xc99f…c4a4 0.00 blk/s 0.0 tx/s 0.0 Mgas/s 0+ 1216 Qed #5056805 0/80 peers 279 MiB chain 69 MiB db 30 MiB queue 391 KiB sync RPC: 9 conn, 0 req/s, 15164421 µs
2019-02-20 16:23:16 UTC Snapshot: 214304 accounts 5000 blocks 56268231 bytes

[jam10o-new]

This is unfortunately known behaviour, ie, snapshotting is an extremely resource intensive process and can grind the rest of your node to a halt - especially networking, which includes rpc (notice the loss of peers)

I would recommend running with no_periodic_snapshots if you experience this, in the longer term we will hopefully have a better snapshot format to allow for snapshots with more reasonable resource usage.

[jleeh]

I don't think this should be known behaviour as this process has been fine for me on Ropsten until I upgraded to 2.2.10 for the security fix. It also works fine on kovan/main with similar spec'd boxes.

I've disabled snapshots in the meantime, but I'd really like not to as I use my nodes as reserved peers for others syncing.

[soc1c]

which version did you upgrade from?

[jleeh]

2.2.9. Although, I run a templating job daily against the stable docker version, so the boxes that were created would of pulled down the db from 2.2.10.

If it helps, I can explain the process in a bit more detail.

[c0deright]

You're most certainly affected by #10361 which would explain why you didn't have problems with 2.2.9

[jleeh]

Seems to be related @c0deright and thanks, as I'm seeing the same issue with disk on our 2.2.10 boxes.

This makes sense to be related, as the disk we provision for our Ropsten boxes is a fraction of the perf of our main boxes. The only outlier is that I don't see the same issue on Kovan which has the same box specs as Ropsten.

[adria0]

Closing issue due to its stale state.