Skip to content

ikirker/ShellStore

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is a dumb sort-of-object-store. I blame @glennklockwood.

It uses split gzipped files spread and replicated across a list of nodes, with keyed passwordless scp/ssh for distribution and reading. It's written in bash (though I haven't checked for bashisms, it might be portable to dash/ksh/sh) and a fairly vanilla blend of command-line tools.

Still missing:

  • more careful replication, where we actually have multiple replicas on single hosts (or else make sure we don't try to make more replicas than we have hosts: at the moment they just get overwritten on the same host)
  • maybe more careful object ID generation
  • nodelist syncing
  • ability to run in different dirs on different nodes
  • any sort of checking that what you get out is what you put in
  • bash CGI access
  • something to check the number of replicas available and re-replicate if necessary
  • something to check replicas haven't diverged through corruption (+ quorum assertion)
  • a remote version of the store command
  • CI testing
  • probably a bunch of other things, I don't know

About

A sort-of-object-store written in bash & command-line-tools

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages