Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a deferrable mode to BatchCreateComputeEnvironmentOperator #32036

Merged
merged 9 commits into from
Jun 27, 2023

Conversation

vandonr-amz
Copy link
Contributor

@vandonr-amz vandonr-amz commented Jun 20, 2023

This operator didn't have a wait_for_completion mode, but there is still some completion to wait for.
I'm adding a deferrable mode to it via a new custom waiter.

I'm reusing the max_retries parameter that was passed to the hook for no good reason, and deprecating along the way the other retry param that had no effect.

cc @syedahsn

airflow/providers/amazon/aws/operators/batch.py Outdated Show resolved Hide resolved
airflow/providers/amazon/aws/operators/batch.py Outdated Show resolved Hide resolved
airflow/providers/amazon/aws/operators/batch.py Outdated Show resolved Hide resolved
Copy link
Contributor

@phanikumv phanikumv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add documentation for the availability of deferrable param for this operator

@vandonr-amz
Copy link
Contributor Author

can you add documentation for the availability of deferrable param for this operator

do you mean in the batch.rst file ?

If so, the problem is that this relies on examples from the system tests, and system tests don't support deferrables just yet (we need #31826 for that)

@potiuk potiuk merged commit 1fb2831 into apache:main Jun 27, 2023
42 checks passed
@vandonr-amz vandonr-amz deleted the vandonr/batch branch June 27, 2023 23:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers provider:amazon-aws AWS/Amazon - related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants