Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PLAT-538] Enable redis persistence #176

Merged
merged 1 commit into from
Jan 24, 2023
Merged

[PLAT-538] Enable redis persistence #176

merged 1 commit into from
Jan 24, 2023

Conversation

raymondjacobson
Copy link
Member

@raymondjacobson raymondjacobson commented Jan 6, 2023

Description

Snapshot every 60 seconds so long as there has been 1 write.
This should be performant and far better than our custom persistence (especially on discovery) which persists every redis write for some keys to a file
https://redis.io/docs/management/persistence/

Adds restart: always to redis because rdb backups will let us recoup redis state if it crashes.

@linear
Copy link

linear bot commented Jan 6, 2023

@jowlee
Copy link
Contributor

jowlee commented Jan 6, 2023

Just something to note: "...if the dataset is big, and may result in Redis stopping serving clients for some milliseconds or even for one second if the dataset is very big and the CPU performance is not great. "

@raymondjacobson
Copy link
Member Author

Just something to note: "...if the dataset is big, and may result in Redis stopping serving clients for some milliseconds or even for one second if the dataset is very big and the CPU performance is not great. "

our dataset is 400mb and also it says that it may pause for milliseconds or maybe a second at worst. I think ok! the write only append ahead is another option but I think not warranted

@raymondjacobson raymondjacobson changed the base branch from main to comms January 24, 2023 19:33
@raymondjacobson raymondjacobson merged commit a5ed496 into comms Jan 24, 2023
@raymondjacobson raymondjacobson deleted the rj-plat-538 branch January 24, 2023 19:33
stereosteve added a commit that referenced this pull request Jan 24, 2023
* Add comms container

* proper comms docker repo

* wip-comms for now

* [PLAT-538] Enable redis persistence

* volume for NATS

* Add chain health check

* add block production to chain health check

* Configure NATS_STORE_DIR

* Add redis restart

* separate nats container

* add comms containers to creator node docker compose

* comms depends on nats

* [PLAT-538] Enable redis persistence (#176)

Comment copy change

* Launch chain on prod (#184)

* add chain to upgrade

* remove sync logs

* add no recreate

Co-authored-by: Raymond Jacobson <ray@audius.co>
Co-authored-by: Isaac Solo <isaac@audius.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants