Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vine, wq: set a maximum number of task to run per category #3759

Merged
merged 4 commits into from
Apr 17, 2024

Conversation

btovar
Copy link
Member

@btovar btovar commented Apr 5, 2024

Proposed changes

Please describe your changes (e.g., what problems they attempt to solve, what results are expected, etc.) Additional motivation and context are welcome.
Please also mention relevant issues and pull requests as appropriate.

Post-change actions

Put an 'x' in the boxes that describe post-change actions that you have done.
The more 'x' ticked, the faster your changes are accepted by maintainers.

  • make test Run local tests prior to pushing.
  • make format Format source code to comply with lint policies. Note that some lint errors can only be resolved manually (e.g., Python)
  • make lint Run lint on source code prior to pushing.
  • Manual Update Did you update the manual to reflect your changes, if appropriate? This action should be done after your changes are approved but not merged.
  • Type Labels Select github labels for the type of this change: bug, enhancement, etc.
  • Product Labels Select github labels for the product affected: TaskVine, Makeflow, etc.
  • PR RTM Mark your PR as ready to merge.

Additional comments

This section is dedicated to changes that are ambitious or complex and require substantial discussions. Feel free to start the ball rolling.

Copy link
Member

@dthain dthain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The API for doing it by category makes sense to me. I do have some concern about inc/dec complex stats throughout the code, as opposed to counting it in one place. But it looks ok as given.

@dthain
Copy link
Member

dthain commented Apr 8, 2024

It may also be helpful to understand from the end user why they want to limit tasks by category. There may be some underlying resource conflict, and it might be easier to measure the conflict more directly...

@dthain
Copy link
Member

dthain commented Apr 17, 2024

Do we still have an active use case for this one?

@btovar btovar merged commit a933943 into cooperative-computing-lab:master Apr 17, 2024
7 checks passed
@btovar btovar deleted the limit_per_cat branch April 17, 2024 20:40
btovar added a commit that referenced this pull request Apr 17, 2024
* wq: move category task counts to change_task_state

* wq: adds q.specify_category_max_concurrent("category", max)

* vine: move category task counts to change_task_state

* vine: adds m.specify_category_max_concurrent("category", max)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants