Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Temporary hold on ops image id updates once in production #103

Closed
DJAndries opened this issue May 25, 2023 · 4 comments
Closed

Temporary hold on ops image id updates once in production #103

DJAndries opened this issue May 25, 2023 · 4 comments
Assignees

Comments

@DJAndries
Copy link
Collaborator

DJAndries commented May 25, 2023

Once we're in production with P3A, we should probably put a hold on production image updates (image ids specified in the ops repo) for both the nitro-shim & star-randsrv unless absolutely critical, until brave/nitriding-daemon#10 is resolved.

@NullHypothesis
Copy link
Contributor

That's a good idea. Alternatively (or in addition), we could configure flux to hold off on auto-updating the pods when it sees a new nitro-shim image in ECR. Then again, the nitro-shim doesn't change a lot anyway and if I understand correctly, changes to star-randsrv aren't going to get auto-deployed because star-randsrv's image is an argument to nitro-shim's startup script.

@rillian
Copy link
Contributor

rillian commented May 29, 2023

changes to star-randsrv aren't going to get auto-deployed

That was my understanding too. Both the run book and the code in the star-randsrv-ops repo specify an explicit image version, not just the latest build.

If we do deploy automatically to production, we should limit it to tagged releases or similar. Limiting merges to the default branch for for normal work is tedious.

@DJAndries
Copy link
Collaborator Author

DJAndries commented May 29, 2023

Then again, the nitro-shim doesn't change a lot anyway and if I understand correctly, changes to star-randsrv aren't going to get auto-deployed because star-randsrv's image is an argument to nitro-shim's startup script.

That was my understanding too. Both the run book and the code in the star-randsrv-ops repo specify an explicit image version, not just the latest build

Right, just noticed this. will update title & description to refer to "image updates" instead, so we don't lose the key material for the current epoch in production

@DJAndries DJAndries changed the title Temporary hold on main branch merges once in production Temporary hold on deployment image updates once in production May 29, 2023
@DJAndries DJAndries changed the title Temporary hold on deployment image updates once in production Temporary hold on ops image id updates once in production May 29, 2023
@NullHypothesis NullHypothesis removed their assignment Jul 18, 2023
@rillian
Copy link
Contributor

rillian commented Jan 22, 2024

We haven't resolved the underlying cause, but we also haven't been able to run this in an enclave for a while, so I think we can expire this prohibition for now. Still an issue to be aware of with future deployments once aws/aws-nitro-enclaves-cli#550 is addressed.

@rillian rillian closed this as completed Jan 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants