Skip to content
This repository has been archived by the owner on Sep 21, 2020. It is now read-only.

Hack to stop dataloader related errors #180

Merged

Conversation

stepanstipl
Copy link
Contributor

@stepanstipl stepanstipl commented Oct 12, 2018

This is an ugly hack to stop TF/Helm data loader errors that freezes data loader version.

It should be removed in scope of #163, once the "new" dataloader is ready to be used.

After potentially failing once (if the dataloader is at older version), no more errors should appear, as TF will not try to update it even if versions.yaml change.

@amatas
Copy link
Contributor

amatas commented Oct 12, 2018

LGTM

@mrtyler
Copy link
Contributor

mrtyler commented Oct 16, 2018

LGTM :(

Although this is a temporary hack, I think it could confusion for our users in the short-term (cc @javihernandez @klown @cindyli).

Anyone else we should notify? Email to architecture@?

@natarajaya
Copy link
Contributor

LGTM

@stepanstipl
Copy link
Contributor Author

@mrtyler thanks, it will not change the behavior on already existing clusters - as the dataloader will not run anyway in a current state, so the only difference will be on newly created clusters.

@stepanstipl stepanstipl merged commit c243c01 into gpii-ops:master Oct 16, 2018
@javihernandez
Copy link
Contributor

Anyone else we should notify? Email to architecture@?

Hey @mrtyler, thanks for the heads up, I think it's fine as long as @cindyli and @klown (and probably @sgithens, since I know he's been using gpii-infra) are aware of it.
In any case, just to confirm, if I need to re-deploy the dataloader for whatever reason, I need to update this file with the correct sha in addition to the change in the versions.yml file, right? Also, given that this is a temporary solution, I assume that you'll let us know again when this is not required anymore?

@stepanstipl
Copy link
Contributor Author

@javihernandez currently, if you would need to redeploy new data loader, it's correct you would have to update the sha at the same place this PR freezes it (gcp/modules/gpii-dataloader/main.tf) but also the dataloader as of now will only actually run once when creating a new cluster (or delete the dataloader batchJob from the existing cluster first).

Otherwise this is temporary only till we get to resolve GPII/universal#626 and related #163 PRs

@stepanstipl stepanstipl deleted the hack-stop-dataloader-errors branch March 21, 2019 14:53
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants