Skip to content

hriteshg/lhotse-storage

 
 

Repository files navigation

File storage support for Lhotse

Build Status Latest release

This is a supporting repository for Lhotse, a starter kit for writing event sourced web applications following domain driven design principles.

Purpose

This library implements two file stores: one is referred to as permanent, the other as the ephemeral store. The permanent file store is for storing critical files that, such as user uploads, cannot be recovered. The ephemeral store is for non-critical files that can be regenerated by the system either dynamically or via an event replay.

Our file store implementation automatically deduplicates files. Storing a file whose contents matches a previous file will return a (new) file identifier mapping to the original. The most recently stored file will then be silently removed.

File stores need backing service such as a blob store or filesystem. This starter kit supports Mongo GridFS and AWS S3 at time of writing.

Configuring Mongo GridFS

Set the application property:

application.filestore.backend=mongoGridFs

Configuring AWS S3

Set the following application properties:

application.filestore.backend=awsS3
application.filestore.awsS3.buckets.permanent=sample-bucket-permanent
application.filestore.awsS3.buckets.ephemeral=sample-bucket-ephemeral

We rely on DefaultAWSCredentialsProviderChain and DefaultAwsRegionProviderChain for fetching AWS credentials and the AWS region.

License

License

License: EverestEngineering

Talk to us hi@everest.engineering.

About

Filestore abstractions for Lhotse

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 100.0%