Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

swarm/storage/localstore: new localstore package #19015

Merged
merged 81 commits into from
Feb 7, 2019
Merged

swarm/storage/localstore: new localstore package #19015

merged 81 commits into from
Feb 7, 2019

Commits on Nov 29, 2018

  1. swarm/storage/localstore: most basic database

    @janos
    janos committed Nov 29, 2018
    Configuration menu
    Copy the full SHA
    d8acb12 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2018

  1. swarm/storage/localstore: fix typos and comments

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    9ec535a View commit details
    Browse the repository at this point in the history

  2. swarm/shed: add uint64 field Dec and DecInBatch methods

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    37205de View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: decrement size counter on ModeRemoval update

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    b1ded5a View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localstore: unexport modeAccess and modeRemoval

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    572f3cb View commit details
    Browse the repository at this point in the history

  5. swarm/storage/localstore: add WithRetrievalCompositeIndex

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    cbb510b View commit details
    Browse the repository at this point in the history

  6. swarm/storage/localstore: add TestModeSyncing

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    c7beb22 View commit details
    Browse the repository at this point in the history

  7. swarm/storage/localstore: fix test name

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    391faa7 View commit details
    Browse the repository at this point in the history

  8. swarm/storage/localstore: add TestModeUpload

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    58f3f86 View commit details
    Browse the repository at this point in the history

  9. swarm/storage/localstore: add TestModeRequest

    @janos
    janos committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    2d928bf View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2018

  1. swarm/storage/localstore: add TestModeSynced

    @janos
    janos committed Dec 4, 2018
    Configuration menu
    Copy the full SHA
    4d58a6f View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add TestModeAccess

    @janos
    janos committed Dec 4, 2018
    Configuration menu
    Copy the full SHA
    af1b137 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: add TestModeRemoval

    @janos
    janos committed Dec 4, 2018
    Configuration menu
    Copy the full SHA
    96409ff View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2018

  1. swarm/storage/localstore: add mock store option for chunk data

    @janos
    janos committed Dec 5, 2018
    Configuration menu
    Copy the full SHA
    b782bfe View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add TestDB_pullIndex

    @janos
    janos committed Dec 5, 2018
    Configuration menu
    Copy the full SHA
    35376d8 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2018

  1. swarm/storage/localstore: add TestDB_gcIndex

    @janos
    janos committed Dec 6, 2018
    Configuration menu
    Copy the full SHA
    e6a7196 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: change how batches are written

    @janos
    janos committed Dec 6, 2018
    Configuration menu
    Copy the full SHA
    58c7f11 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: add updateOnAccess function

    @janos
    janos committed Dec 6, 2018
    Configuration menu
    Copy the full SHA
    6e8b2ad View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localhost: add DB.gcSize

    @janos
    janos committed Dec 6, 2018
    Configuration menu
    Copy the full SHA
    7b8510e View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2018

  1. swarm/storage/localstore: update comments

    @janos
    janos committed Dec 7, 2018
    Configuration menu
    Copy the full SHA
    cf3ec30 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add BenchmarkNew

    @janos
    janos committed Dec 7, 2018
    Configuration menu
    Copy the full SHA
    d58e1ee View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: add retrieval tests benchmarks

    @janos
    janos committed Dec 7, 2018
    Configuration menu
    Copy the full SHA
    f2299f4 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2018

  1. swarm/storage/localstore: accessors redesign

    @janos
    janos committed Dec 13, 2018
    Configuration menu
    Copy the full SHA
    e6bdda7 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add semaphore for updateGC goroutine

    @janos
    janos committed Dec 13, 2018
    Configuration menu
    Copy the full SHA
    b6f5b7a View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: implement basic garbage collection

    @janos
    janos committed Dec 13, 2018
    Configuration menu
    Copy the full SHA
    5732c38 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2018

  1. swarm/storage/localstore: optimize collectGarbage

    @janos
    janos committed Dec 14, 2018
    Configuration menu
    Copy the full SHA
    ac9d153 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add more garbage collection tests cases

    @janos
    janos committed Dec 14, 2018
    Configuration menu
    Copy the full SHA
    e6e29f5 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2018

  1. swarm/shed, swarm/storage/localstore: rename IndexItem to Item

    @janos
    janos committed Dec 17, 2018
    Configuration menu
    Copy the full SHA
    750268d View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2018

  1. swarm/shed: add Index.CountFrom

    @janos
    janos committed Dec 18, 2018
    Configuration menu
    Copy the full SHA
    a486a09 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: persist gcSize

    @janos
    janos committed Dec 18, 2018
    Configuration menu
    Copy the full SHA
    e17fec2 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: remove composite retrieval index

    @janos
    janos committed Dec 18, 2018
    Configuration menu
    Copy the full SHA
    5605323 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2018

  1. swarm/shed: IterateWithPrefix and IterateWithPrefixFrom Index functions

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    5ebbcb5 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: writeGCSize function with leveldb batch

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    80c269b View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: unexport modeSetRemove

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    bca85ef View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localstore: update writeGCSizeWorker comment

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    cee4004 View commit details
    Browse the repository at this point in the history

  5. swarm/storage/localstore: add triggerGarbageCollection function

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    b5a0fd2 View commit details
    Browse the repository at this point in the history

  6. swarm/storage/localstore: call writeGCSize on DB Close

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    4fca004 View commit details
    Browse the repository at this point in the history

  7. swarm/storage/localstore: additional comment in writeGCSizeWorker

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    5ad0c8d View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into localstore

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    cb8078e View commit details
    Browse the repository at this point in the history

  9. swarm/storage/localstore: add MetricsPrefix option

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    c9f5130 View commit details
    Browse the repository at this point in the history

  10. swarm/storage/localstore: fix a typo

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    da9bab4 View commit details
    Browse the repository at this point in the history

  11. swamr/shed: only one Index Iterate function

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    d54d7ae View commit details
    Browse the repository at this point in the history

  12. swarm/storage/localstore: use shed Iterate function

    @janos
    janos committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    67473be View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2018

  1. swarm/shed: pass a new byte slice copy to index decode functions

    @janos
    janos committed Dec 20, 2018
    Configuration menu
    Copy the full SHA
    2299147 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: implement feed subscriptions

    @janos
    janos committed Dec 20, 2018
    Configuration menu
    Copy the full SHA
    5488a2b View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2018

  1. swarm/storage/localstore: add more subscriptions tests

    @janos
    janos committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    38bdf7f View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localsore: add parallel upload test

    @janos
    janos committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    a74eae2 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: use storage.MaxPO in subscription tests

    @janos
    janos committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    534009f View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localstore: subscription of addresses instead chunks

    @janos
    janos committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    5edd22d View commit details
    Browse the repository at this point in the history

  5. swarm/storage/localstore: lock item address in collectGarbage iterator

    @janos
    janos committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    95726d7 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2018

  1. swarm/storage/localstore: fix TestSubscribePull to include MaxPO

    @janos
    janos committed Dec 22, 2018
    Configuration menu
    Copy the full SHA
    c5dcae3 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2019

  1. swarm/storage/localstore: improve subscriptions

    @janos
    janos committed Jan 7, 2019
    Configuration menu
    Copy the full SHA
    f3380ea View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: add TestDB_SubscribePull_sinceAndUntil test

    @janos
    janos committed Jan 7, 2019
    Configuration menu
    Copy the full SHA
    1d2d470 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: adjust pull sync tests

    @janos
    janos committed Jan 7, 2019
    Configuration menu
    Copy the full SHA
    c26c979 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into localstore

    @janos
    janos committed Jan 7, 2019
    Configuration menu
    Copy the full SHA
    c188281 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2019

  1. swarm/storage/localstore: remove writeGCSizeDelay and use literal

    @janos
    janos committed Jan 8, 2019
    Configuration menu
    Copy the full SHA
    c5e4c61 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: adjust subscriptions tests delays and comments

    @janos
    janos committed Jan 8, 2019
    Configuration menu
    Copy the full SHA
    015d977 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2019

  1. swarm/storage/localstore: add godoc package overview

    @janos
    janos committed Jan 10, 2019
    Configuration menu
    Copy the full SHA
    abbb4a6 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: fix a typo

    @janos
    janos committed Jan 10, 2019
    Configuration menu
    Copy the full SHA
    fb0a822 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: update package overview

    @janos
    janos committed Jan 10, 2019
    Configuration menu
    Copy the full SHA
    c423060 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2019

  1. swarm/storage/localstore: remove repeated index change

    @janos
    janos committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    c5a6456 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: rename ChunkInfo to ChunkDescriptor

    @janos
    janos committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    33726a4 View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: add comment in collectGarbageWorker

    @janos
    janos committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    25a068a View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localstore: replace atomics with mutexes for gcSize and… 

    … tests
    @janos
    janos committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    ca1e24f View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2019

  1. Merge branch 'master' into localstore

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    c62fee3 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: protect addrs map in pull subs tests

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    5ddc75f View commit details
    Browse the repository at this point in the history

  3. swarm/storage/localstore: protect slices in push subs test

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    87bbd61 View commit details
    Browse the repository at this point in the history

  4. swarm/storage/localstore: protect chunks in TestModePutUpload_parallel

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    6ad67d7 View commit details
    Browse the repository at this point in the history

  5. swarm/storage/localstore: fix a race in TestDB_updateGCSem defers

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    a550388 View commit details
    Browse the repository at this point in the history

  6. swarm/storage/localstore: remove parallel flag from tests

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    1dae999 View commit details
    Browse the repository at this point in the history

  7. swarm/storage/localstore: fix a race in testDB_collectGarbageWorker

    @janos
    janos committed Jan 14, 2019
    Configuration menu
    Copy the full SHA
    eda338a View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2019

  1. swarm/storage/localstore: remove unused code

    @janos
    janos committed Jan 22, 2019
    Configuration menu
    Copy the full SHA
    ad5b329 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2019

  1. swarm/storage/localstore: add more context to pull sub log messages

    @janos
    janos committed Jan 25, 2019
    Configuration menu
    Copy the full SHA
    8d15e82 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: merge branch 'master' into localstore

    @janos
    janos committed Jan 25, 2019
    Configuration menu
    Copy the full SHA
    3948044 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2019

  1. swarm/storage/localstore: BenchmarkPutUpload and global lock option

    @janos
    janos committed Jan 26, 2019
    Configuration menu
    Copy the full SHA
    6c8208a View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2019

  1. swarm/storage/localstore: pre-generate chunks in BenchmarkPutUpload

    @janos
    janos committed Jan 28, 2019
    Configuration menu
    Copy the full SHA
    6accc6b View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: correct useGlobalLock in collectGarbage

    @janos
    janos committed Jan 28, 2019
    Configuration menu
    Copy the full SHA
    85cd349 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2019

  1. swarm/storage/localstore: fix typos and update comments

    @janos
    janos committed Jan 29, 2019
    Configuration menu
    Copy the full SHA
    7fa1ba9 View commit details
    Browse the repository at this point in the history

  2. swarm/storage/localstore: update writeGCSize comment

    @janos
    janos committed Jan 29, 2019
    Configuration menu
    Copy the full SHA
    ebecd05 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2019

  1. swarm/storage/localstore: remove global lock option

    @janos
    janos committed Feb 4, 2019
    Configuration menu
    Copy the full SHA
    f056e86 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2019

  1. swarm/storage/localstore: add description for gc size counting

    @janos
    janos committed Feb 5, 2019
    Configuration menu
    Copy the full SHA
    40432d9 View commit details
    Browse the repository at this point in the history