Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dag processor manager queue split (fixes SLAs) #27317

Closed
wants to merge 1 commit into from
Closed

Dag processor manager queue split (fixes SLAs) #27317

wants to merge 1 commit into from

Commits on Oct 27, 2022

  1. Dag processor manager queue overhaul

    - Existing single queue split into std and priority queues
    - Additional tracking of processing of files read from disk
    - Additional config property added
        - Updated config.yml template to match
    - Fixes SLA issues from #20683, prior to this SLA callbacks could stop
      the queue from ever emptying, and thus prevent the dags being
      refreshed from disk
    - Also prevents a similar, theoretically-possible-but-not-observed-by-me
      issue where lots of dag callbacks could have the same effect
    argibbs committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    5a7099c View commit details
    Browse the repository at this point in the history