Code

Feat/ray jobs#2274

Code

Merged

blythed merged 20 commits intomainsuperduper-io/superduper:mainfrom feat/ray_jobssuperduper-io/superduper:feat/ray_jobsCopy head branch name to clipboardJul 9, 2024

+480-3,945

Commits

Commits on Jul 9, 2024

• Add pluggable compute backend config

  kartik4949

  committed
  a3596c2

• Update changelog

  kartik4949

  committed
  d47a697

• Create a scheduler for submitting jobs in ray.

  kartik4949

  committed
  3dbcca0

• Add basic services structure

  kartik4949

  committed
  9029fc2

• Remove future and job id

  kartik4949

  committed
  9796758

• Anchor compute_kwargs for individual actors

  kartik4949

  committed
  d17e28b

• Remove ray backend and fix some minor bugs

  kartik4949

  committed
  9790167

• Fix ray configuration and missing component.unpack.

  

  jieguangzhou

  authored and

  kartik4949

  committed
  a916c0f

• Make scheduler configurable

  Show description for a6cca8e
  kartik4949

  committed
  a6cca8e

• Fix other issues in the Ray PR.

  

  jieguangzhou

  authored and

  kartik4949

  committed
  2f2c41f

• Migrate services from superduperdb to private

  Show description for 00b699d
  kartik4949

  committed
  00b699d

• Shift integration tests

  Show description for 6fad900
  kartik4949

  committed
  6fad900

• Remove cdc dependencies from datalayer

  Show description for 5425431
  kartik4949

  committed
  5425431

• Add back integration test

  kartik4949

  committed
  dfc0e21

• Remove services init dependencies from docker compose

  kartik4949

  committed
  d7cc2f0

• Simplify taskworkflow with queues

  kartik4949

  committed
  8c3f454

• Add Event cls for db events

  kartik4949

  committed
  b35ddae

• Update compute queue to support message broker

  kartik4949

  committed
  a8ec862

• Added general components in the queue

  kartik4949

  committed
  4d2e11f

• Fix query dependencies property

  kartik4949

  committed
  4949f21