Skip to content
This repository has been archived by the owner on Aug 2, 2021. It is now read-only.

Data race in swarm/network/stream #1197

Closed
frncmx opened this issue Feb 6, 2019 · 2 comments · Fixed by ethereum/go-ethereum#19049
Closed

Data race in swarm/network/stream #1197

frncmx opened this issue Feb 6, 2019 · 2 comments · Fixed by ethereum/go-ethereum#19049
Assignees
@acud
Labels
bug

Comments

@frncmx
Copy link
Contributor

frncmx commented Feb 6, 2019 •
edited by acud
Loading

How to reproduce?

go test -v -race github.com/ethereum/go-ethereum/swarm/network/stream

Failing: TestFileRetrieval (note: just run alone the test does not fail)

Stack trace

=== RUN   TestStreamerRetrieveRequest
--- PASS: TestStreamerRetrieveRequest (0.03s)
=== RUN   TestStreamerUpstreamRetrieveRequestMsgExchangeWithoutStore
--- PASS: TestStreamerUpstreamRetrieveRequestMsgExchangeWithoutStore (2.03s)
=== RUN   TestStreamerUpstreamRetrieveRequestMsgExchange
--- PASS: TestStreamerUpstreamRetrieveRequestMsgExchange (0.04s)
=== RUN   TestRequestFromPeers
--- PASS: TestRequestFromPeers (0.00s)
=== RUN   TestRequestFromPeersWithLightNode
--- PASS: TestRequestFromPeersWithLightNode (0.00s)
=== RUN   TestStreamerDownstreamChunkDeliveryMsgExchange
--- PASS: TestStreamerDownstreamChunkDeliveryMsgExchange (0.03s)
=== RUN   TestDeliveryFromNodes
--- PASS: TestDeliveryFromNodes (76.24s)
=== RUN   TestIntervalsLive
--- PASS: TestIntervalsLive (4.13s)
=== RUN   TestIntervalsHistory
--- PASS: TestIntervalsHistory (3.91s)
=== RUN   TestIntervalsLiveAndHistory
--- PASS: TestIntervalsLiveAndHistory (4.09s)
=== RUN   TestLigthnodeRetrieveRequestWithRetrieve
--- PASS: TestLigthnodeRetrieveRequestWithRetrieve (1.07s)
=== RUN   TestLigthnodeRetrieveRequestWithoutRetrieve
--- PASS: TestLigthnodeRetrieveRequestWithoutRetrieve (0.15s)
=== RUN   TestLigthnodeRequestSubscriptionWithSync
--- PASS: TestLigthnodeRequestSubscriptionWithSync (0.05s)
=== RUN   TestLigthnodeRequestSubscriptionWithoutSync
--- PASS: TestLigthnodeRequestSubscriptionWithoutSync (0.05s)
=== RUN   TestFileRetrieval
==================
WARNING: DATA RACE
Write at 0x00c006f9c490 by goroutine 3256:
  runtime.closechan()
      /usr/lib/go/src/runtime/chan.go:327 +0x0
  github.com/ethereum/go-ethereum/swarm/storage.(*LDBStore).Close()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:1040 +0xcc
  github.com/ethereum/go-ethereum/swarm/storage.(*LocalStore).Close()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:194 +0x50
  github.com/ethereum/go-ethereum/swarm/storage.(*NetStore).Close()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/netstore.go:130 +0x79
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:139 +0x53
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:120 +0x54
  github.com/ethereum/go-ethereum/swarm/network/simulation.(*Simulation).Close.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:191 +0x84

Previous read at 0x00c006f9c490 by goroutine 3037:
  runtime.chansend()
      /usr/lib/go/src/runtime/chan.go:140 +0x0
  github.com/ethereum/go-ethereum/swarm/storage.(*LDBStore).Put()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:811 +0x864
  github.com/ethereum/go-ethereum/swarm/storage.(*LocalStore).Put()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:131 +0x3b7
  github.com/ethereum/go-ethereum/swarm/storage.(*NetStore).Put()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/netstore.go:78 +0xc1
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Delivery).handleChunkDeliveryMsg.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/delivery.go:222 +0x1e1

Goroutine 3256 (running) created at:
  github.com/ethereum/go-ethereum/swarm/network/simulation.(*Simulation).Close()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:187 +0x2fe
  github.com/ethereum/go-ethereum/swarm/network/stream.runFileRetrievalTest()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:212 +0x4b0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:657 +0x1ed
  fmt.Fscanf()
      /usr/lib/go/src/fmt/scan.go:143 +0xe9
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).recoverJournal()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:476 +0xe3
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.openDB()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:125 +0x9dc
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:197 +0x1ed
  fmt.Sscanf()
      /usr/lib/go/src/fmt/scan.go:114 +0xd0
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.fsParseName()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:643 +0x144
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).List()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/storage/file_storage.go:458 +0x279
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:113 +0xbb
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.(*session).recover()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/session.go:121 +0x17b7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.Open()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:183 +0xd7
  github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb.OpenFile()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/vendor/github.com/syndtr/goleveldb/leveldb/db.go:219 +0xa5
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBDatabase()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/database.go:37 +0xc3
  github.com/ethereum/go-ethereum/swarm/storage.NewLDBStore()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/ldbstore.go:152 +0x37c
  github.com/ethereum/go-ethereum/swarm/storage.NewTestLocalStoreForAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/storage/localstore.go:74 +0x9a
  github.com/ethereum/go-ethereum/swarm/network/stream.createTestLocalStorageForID()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:308 +0x258
  github.com/ethereum/go-ethereum/swarm/network/stream.netStoreAndDeliveryWithAddr()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:115 +0x119
  github.com/ethereum/go-ethereum/swarm/network/stream.newNetStoreAndDelivery()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/common_test.go:76 +0xa6
  github.com/ethereum/go-ethereum/swarm/network/stream.glob..func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:107 +0x60
  github.com/ethereum/go-ethereum/swarm/network/simulation.New.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/simulation.go:89 +0xa7
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start.func1.1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:247 +0x25b
  github.com/ethereum/go-ethereum/node.(*Node).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/node/node.go:190 +0x751
  github.com/ethereum/go-ethereum/p2p/simulations/adapters.(*SimNode).Start()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/adapters/inproc.go:271 +0x193
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).startWithSnapshots()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:182 +0x2fc
  github.com/ethereum/go-ethereum/p2p/simulations.(*Network).Load()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/simulations/network.go:789 +0x753
  github.com/ethereum/go-ethereum/swarm/network/simulation.(*Simulation).UploadSnapshot()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/simulation/node.go:236 +0x3d0
  github.com/ethereum/go-ethereum/swarm/network/stream.runFileRetrievalTest()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:149 +0x2f2
  github.com/ethereum/go-ethereum/swarm/network/stream.TestFileRetrieval()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/snapshot_retrieval_test.go:59 +0x128
  testing.tRunner()
      /usr/lib/go/src/testing/testing.go:827 +0x162

Goroutine 3037 (running) created at:
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Delivery).handleChunkDeliveryMsg()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/delivery.go:220 +0x120
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Peer).HandleMsg()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/stream.go:595 +0x869
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Peer).HandleMsg-fm()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/stream.go:447 +0x6d
  github.com/ethereum/go-ethereum/p2p/protocols.(*Peer).handleIncoming()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/protocols/protocol.go:374 +0xa8a
  github.com/ethereum/go-ethereum/p2p/protocols.(*Peer).Run()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/protocols/protocol.go:232 +0x46
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Registry).Run()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/stream.go:447 +0x21a
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Registry).runProtocol()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/stream.go:568 +0x236
  github.com/ethereum/go-ethereum/swarm/network/stream.(*Registry).runProtocol-fm()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/swarm/network/stream/stream.go:864 +0x63
  github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols.func1()
      /home/frncmx/code/src/github.com/ethereum/go-ethereum/p2p/peer.go:361 +0x8d
==================
--- FAIL: TestFileRetrieval (62.45s)
    snapshot_retrieval_test.go:61: context deadline exceeded
    testing.go:771: race detected during execution of test
=== RUN   TestRetrieval
FAIL	github.com/ethereum/go-ethereum/swarm/network/stream	240.794s
@frncmx frncmx added the bug label Feb 6, 2019
@frncmx frncmx mentioned this issue Feb 6, 2019
Closed
16 tasks
@frncmx frncmx changed the title Data race in swarm/network/stream caused by LDBStore Data race in swarm/network/stream Feb 6, 2019
@frncmx
Copy link
Contributor Author

frncmx commented Feb 6, 2019

It seems the root cause might be an incorrect shutdown procedure on when the context deadline exceeded.

@holisticode holisticode mentioned this issue Feb 6, 2019
Closed
@holisticode
Copy link
Contributor

holisticode commented Feb 6, 2019 •
edited
Loading

One possible reason is the following;

127 // Close chunk store 
128 func (n *NetStore) Close() {
129   close(n.closeC)
130   n.store.Close()
131   // TODO: loop through fetchers to cancel them  <--- THIS COULD BE THE REASON?
132 }

This Close() function is called from the cleanup() function when the simulation terminates.

Now if there are running fetchers (this is the TestRetrieval, which tries to retrieve files/chunks, thus fetchers are spawned), they may at some point call

286     sourceID, quit, err = f.protoRequestFunc(ctx, req)

or

300     sourceID, quit, err = f.protoRequestFunc(ctx, req)

(swarm/network/fetcher.go).

protoRequestFunc is actually Delivery.RequestFromPeers, from which messages are sent (RetrieveRequestMsg),

But actually, the race is reported to be in handleChunkDeliveryMsg()#L222, which could be writing into the store. So not the same place. Still, it may be related.

So another, and simpler explanation, could be that it is handling a ChunkDeliverMsg while the node is shutting down. Even if all files have been retrieved, it may still be handling chunks it already has because it issued a request and some other node is sending it:

222     err := d.chunkStore.Put(ctx, storage.NewChunk(req.Addr, req.SData))

(which is a line reported in the race stack trace)

@acud acud self-assigned this Feb 12, 2019
This was referenced Feb 12, 2019
Closed
Merged
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@acud acud

Labels
bug
Projects
None yet
Milestone
No milestone
3 participants
@holisticode @frncmx @acud