Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: run notebooks in data service #375

Merged

Conversation

olevski
Copy link
Member

@olevski olevski commented Aug 27, 2024

This includes major edits to the notebooks code to work with the data service.

/deploy renku=feat-jupyter-free-sessions amalthea-sessions=feat-add-cloud-storage renku-notebooks=feat-jupyter-free-sessions renku-gateway=feat-add-renku-refresh-token-for-data-service renku-ui=andrea/custom-launcher-jupyter-free extra-values=amalthea-sessions.deployCrd=false #notest

@olevski olevski requested a review from a team as a code owner August 27, 2024 18:49
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from dcc7d03 to 545b3c6 Compare August 27, 2024 19:14
@olevski olevski marked this pull request as draft August 27, 2024 19:14
@olevski olevski force-pushed the feat-expand-environments-specification branch 4 times, most recently from 8872560 to 4eb2c24 Compare August 27, 2024 21:32
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 545b3c6 to 15cc4e9 Compare August 27, 2024 21:41
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 15cc4e9 to 3a28e4e Compare August 27, 2024 23:39
@olevski olevski force-pushed the feat-expand-environments-specification branch from 4eb2c24 to d76ef5e Compare August 28, 2024 11:30
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 3a28e4e to f4455bc Compare August 28, 2024 11:55
@RenkuBot
Copy link
Contributor

You can access the deployment of this PR at https://renku-ci-ds-375.dev.renku.ch

@olevski olevski force-pushed the feat-expand-environments-specification branch from d76ef5e to 03223a7 Compare August 28, 2024 11:58
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from f4455bc to 43b61be Compare August 28, 2024 12:04
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 43b61be to e221f61 Compare August 28, 2024 12:14
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from e221f61 to bb8625d Compare August 28, 2024 12:26
@olevski olevski force-pushed the feat-expand-environments-specification branch from 03223a7 to 09ca8b3 Compare August 28, 2024 12:38
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from bb8625d to 6c4468d Compare August 28, 2024 12:48
@Panaetius Panaetius force-pushed the feat-expand-environments-specification branch from 09ca8b3 to 4eb2c24 Compare August 30, 2024 08:21
@olevski olevski force-pushed the feat-expand-environments-specification branch from 4eb2c24 to 09ca8b3 Compare August 30, 2024 08:31
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from ecb9c88 to 9941e20 Compare September 20, 2024 15:40
@olevski olevski marked this pull request as ready for review September 20, 2024 15:41
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 9941e20 to 9e88bad Compare September 20, 2024 16:15
@olevski olevski force-pushed the feat-run-notebook-service-simplify-history branch from 9e88bad to 1a44f2e Compare September 23, 2024 08:41
Copy link
Collaborator

@sgaist sgaist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's taking a good shape !

Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>
Copy link
Collaborator

@sgaist sgaist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@olevski olevski merged commit 34252c3 into release-amaltheas-migration Sep 23, 2024
15 checks passed
@olevski olevski deleted the feat-run-notebook-service-simplify-history branch September 23, 2024 11:52
@RenkuBot
Copy link
Contributor

Tearing down the temporary RenkuLab deplyoment for this PR.

olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>
olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts
olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: update and expand apispec for environments

chore: filter environments by owner type

squashme: address comments

feat!: expand environment specification

This is a breaking change in the API.

chore: add tests and minor fixes

chore: test the global environments migration

chore: fix tests

chore: minor improvements to db session handling

squashme: minor fix

squashme: fixups for conflict resolutuion after merge

squashme: fix failing tests

chore: address comments

feat: add command and args to environments

squashme: notebooks changes

This includes major edits to the notebooks code to work with the data
service.

chore: resolve changes from conflict resolution

chore: do not use the complicated notebooks gitlab header

The gitlab credentials header from the notebooks is really complicated.
We used it here just to get the access token expiry. I modified the
gateway to now pass in an extra header value to indicate the gitlab
token expiry.

squashme: handle per secret adoption in amalthea

squashme: fix parsing of PosixPath in orm

squashme: display the right status and state

squashme: address comments from review pt1

refactor: make APIUser a frozen dataclass

As there is no reason that these object shall be modified within
the services, it simplifies its handling.

squashme: address comments from review pt2

squashme: fixups from rebasing

squashme: use PurePosixPath for workdir and mount

squashme: add saved cloud storage model
olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: update and expand apispec for environments

chore: filter environments by owner type

squashme: address comments

feat!: expand environment specification

This is a breaking change in the API.

chore: add tests and minor fixes

chore: test the global environments migration

chore: fix tests

chore: minor improvements to db session handling

squashme: minor fix

squashme: fixups for conflict resolutuion after merge

squashme: fix failing tests

chore: address comments

feat: add command and args to environments

squashme: notebooks changes

This includes major edits to the notebooks code to work with the data
service.

chore: resolve changes from conflict resolution

chore: do not use the complicated notebooks gitlab header

The gitlab credentials header from the notebooks is really complicated.
We used it here just to get the access token expiry. I modified the
gateway to now pass in an extra header value to indicate the gitlab
token expiry.

squashme: handle per secret adoption in amalthea

squashme: fix parsing of PosixPath in orm

squashme: display the right status and state

squashme: address comments from review pt1

refactor: make APIUser a frozen dataclass

As there is no reason that these object shall be modified within
the services, it simplifies its handling.

squashme: address comments from review pt2

squashme: fixups from rebasing

squashme: use PurePosixPath for workdir and mount

squashme: add saved cloud storage model
olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: run notebooks in data service (#375)

Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: update and expand apispec for environments

chore: filter environments by owner type

squashme: address comments

feat!: expand environment specification

This is a breaking change in the API.

chore: add tests and minor fixes

chore: test the global environments migration

chore: fix tests

chore: minor improvements to db session handling

squashme: minor fix

squashme: fixups for conflict resolutuion after merge

squashme: fix failing tests

chore: address comments

feat: add command and args to environments

squashme: notebooks changes

This includes major edits to the notebooks code to work with the data
service.

chore: resolve changes from conflict resolution

chore: do not use the complicated notebooks gitlab header

The gitlab credentials header from the notebooks is really complicated.
We used it here just to get the access token expiry. I modified the
gateway to now pass in an extra header value to indicate the gitlab
token expiry.

squashme: handle per secret adoption in amalthea

squashme: fix parsing of PosixPath in orm

squashme: display the right status and state

squashme: address comments from review pt1

refactor: make APIUser a frozen dataclass

As there is no reason that these object shall be modified within
the services, it simplifies its handling.

squashme: address comments from review pt2

squashme: fixups from rebasing

squashme: use PurePosixPath for workdir and mount

squashme: add saved cloud storage model
olevski added a commit that referenced this pull request Sep 23, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: run notebooks in data service (#375)

Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: run notebooks in data service (#375)

Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts

feat: update and expand apispec for environments

chore: filter environments by owner type

squashme: address comments

feat!: expand environment specification

This is a breaking change in the API.

chore: add tests and minor fixes

chore: test the global environments migration

chore: fix tests

chore: minor improvements to db session handling

squashme: minor fix

squashme: fixups for conflict resolutuion after merge

squashme: fix failing tests

chore: address comments

feat: add command and args to environments

squashme: notebooks changes

This includes major edits to the notebooks code to work with the data
service.

chore: resolve changes from conflict resolution

chore: do not use the complicated notebooks gitlab header

The gitlab credentials header from the notebooks is really complicated.
We used it here just to get the access token expiry. I modified the
gateway to now pass in an extra header value to indicate the gitlab
token expiry.

squashme: handle per secret adoption in amalthea

squashme: fix parsing of PosixPath in orm

squashme: display the right status and state

squashme: address comments from review pt1

refactor: make APIUser a frozen dataclass

As there is no reason that these object shall be modified within
the services, it simplifies its handling.

squashme: address comments from review pt2

squashme: fixups from rebasing

squashme: use PurePosixPath for workdir and mount

squashme: add saved cloud storage model
olevski added a commit that referenced this pull request Sep 25, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts
olevski added a commit that referenced this pull request Sep 27, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts
olevski added a commit that referenced this pull request Oct 2, 2024
Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch>

squashme: resolve package version conflicts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants