Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat/ray jobs #2274

Merged
merged 20 commits into from
Jul 9, 2024
Merged

Feat/ray jobs #2274

merged 20 commits into from
Jul 9, 2024

Conversation

jieguangzhou
Copy link
Collaborator

Description

Related Issues

Checklist

  • Is this code covered by new or existing unit tests or integration tests?
  • Did you run make unit_testing and make integration-testing successfully?
  • Do new classes, functions, methods and parameters all have docstrings?
  • Were existing docstrings updated, if necessary?
  • Was external documentation updated, if necessary?

Additional Notes or Comments

@kartik4949 kartik4949 force-pushed the feat/ray_jobs branch 2 times, most recently from 2fd4fe7 to 03a7091 Compare July 9, 2024 13:03
kartik4949 and others added 19 commits July 9, 2024 23:53
@kartik4949
Add pluggable compute backend config
a3596c2
@kartik4949
Update changelog
d47a697
@kartik4949
Create a scheduler for submitting jobs in ray.
3dbcca0
@kartik4949
Add basic services structure
9029fc2
@kartik4949
Remove future and job id
9796758
@kartik4949
Anchor compute_kwargs for individual actors
d17e28b
@kartik4949
Remove ray backend and fix some minor bugs
9790167
@jieguangzhou @kartik4949
Fix ray configuration and missing component.unpack.
a916c0f
@kartik4949
Make scheduler configurable
a6cca8e 
(cherry picked from commit f9581a0)
@jieguangzhou @kartik4949
Fix other issues in the Ray PR.
2f2c41f
@kartik4949
Migrate services from superduperdb to private
00b699d 
(cherry picked from commit 1b80a39)
@kartik4949
Shift integration tests
6fad900 
(cherry picked from commit 3ff5635)
@kartik4949
Remove cdc dependencies from datalayer
5425431 
(cherry picked from commit e745e9b)
@kartik4949
Add back integration test
dfc0e21
@kartik4949
Remove services init dependencies from docker compose
d7cc2f0
@kartik4949
Simplify taskworkflow with queues
8c3f454
@kartik4949
Add Event cls for db events
b35ddae
@kartik4949
Update compute queue to support message broker
a8ec862
@kartik4949
Added general components in the queue
4d2e11f
@kartik4949 kartik4949 force-pushed the feat/ray_jobs branch 6 times, most recently from dec77c4 to 081cfa5 Compare July 9, 2024 19:21
@blythed blythed merged commit 51ea046 into main Jul 9, 2024
3 checks passed
@blythed blythed deleted the feat/ray_jobs branch July 9, 2024 21:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@jieguangzhou @blythed @kartik4949