Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Redundant feature materialization and premature incremental materialization timestamp updates #3789

Merged
merged 10 commits into from
Oct 25, 2023
Merged

fix: Redundant feature materialization and premature incremental materialization timestamp updates #3789

merged 10 commits into from
Oct 25, 2023

Commits on Oct 23, 2023

  1. SAASMLOPS-767 wait for jobs to complete 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    948c7fb View commit details
    Browse the repository at this point in the history

  2. SAASMLOPS-805 Stopgap change to fix duplicate materialization of data 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    0ec030f View commit details
    Browse the repository at this point in the history

  3. SAASMLOPS-805 save BYTEWAX_REPLICAS=1 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    71c02f0 View commit details
    Browse the repository at this point in the history

  4. SAASMLOPS-809 fix bytewax workers so they only process a single file (#6 

    )

* SAASMLOPS-809 fix bytewax workers so they only process a single file

* SAASMLOPS-809 fix newlines

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    2313c1d View commit details
    Browse the repository at this point in the history

  5. SAASMLOPS-833 add configurable job timeout (#7) 

    * SAASMLOPS-833 add configurable job timeout

* SAASMLOPS-833 fix whitespace

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    5f97ed0 View commit details
    Browse the repository at this point in the history

  6. develop Run large materializations in batches of pods 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    65c039a View commit details
    Browse the repository at this point in the history

  7. master Set job_batch_size at least equal to max_parallelism 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    cbda2bf View commit details
    Browse the repository at this point in the history

  8. master clarity max_parallelism description 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    c35b0c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. master resolve bug that causes materialization to continue after job … 

    …error

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    5a8018d View commit details
    Browse the repository at this point in the history

  2. master resolve bug causing pod logs to not be printed 

    Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
    @james-crabtree-sp
    james-crabtree-sp committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    938b903 View commit details
    Browse the repository at this point in the history