Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add deferrable mode to EcsRunTaskOperator #31636

Closed
1 of 2 tasks
tim-x-y-z opened this issue May 31, 2023 · 4 comments · Fixed by #31881
Closed
1 of 2 tasks

Add deferrable mode to EcsRunTaskOperator #31636

tim-x-y-z opened this issue May 31, 2023 · 4 comments · Fixed by #31881
Assignees
Labels

Comments

@tim-x-y-z
Copy link

tim-x-y-z commented May 31, 2023

Description

I would greatly appreciate it if the EcsRunTaskOperator could incorporate the deferrable mode. Currently, this operator significantly affects the performance of my workers, and running multiple instances simultaneously proves to be inefficient. I have noticed that the KubernetesPodOperator already supports this functionality, so having a similar feature available for ECS would be a valuable addition.

Note: This feature request relates to the amazon provider.

Use case/motivation

Reduce resource utilisation of my worker when running multiple ecs run task operator in paralllel.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@tim-x-y-z tim-x-y-z added kind:feature Feature Requests needs-triage label for new issues that we didn't triage yet labels May 31, 2023
@boring-cyborg
Copy link

boring-cyborg bot commented May 31, 2023

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

@hussein-awala
Copy link
Member

Great progress is being made to add the deferrable mode for the AWS provider operators and sensors. If you are interested in becoming an Airflow contributor, you can open a pull request (PR) to contribute and add this feature.

Here are a few examples:

@hussein-awala hussein-awala added provider:amazon-aws AWS/Amazon - related issues area:providers good first issue and removed needs-triage label for new issues that we didn't triage yet labels May 31, 2023
@ferruzzi
Copy link
Contributor

ferruzzi commented Jun 5, 2023

@syedahsn @vandonr-amz I know you two have been working on a bunch, is this one on your "near future" list?

@vandonr-amz
Copy link
Contributor

Hey, yes, thanks for pinging me about it. It's on the backlog, I should have a PR for this this week or the next !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants