Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove useless logging line #25347

Merged
merged 3 commits into from
Jul 27, 2022

Conversation

Jorricks
Copy link
Contributor

@Jorricks Jorricks commented Jul 27, 2022

Currently more than 50% of our scheduler logs are in the form of Failed to get task ... Marking it as removed.
There are two of these logging lines in this file, one already has this if else statement, the other one was missing it.
This should considerably bring down logging messages for airflow instances where the tasks change a lot while using the same dag.

@Jorricks
Copy link
Contributor Author

Jorricks commented Jul 27, 2022

@eladkal is this still on time for Airflow 2.4.0?
It would be awesome to include this in a 2.3.x release as well.
This will significantly reduce the pressure on our logging systems :)

@Jorricks
Copy link
Contributor Author

That was quick, even for you @potiuk :p

@potiuk
Copy link
Member

potiuk commented Jul 27, 2022

For 2.4.0 for sure - we have not yet cut the branch for 2.4. I will mark it for 2.3.4 in case we have it, but it's not very likely I think ( we will go straight to 2.4.0 with all bugfixes most likely - but it's up to @jedcunningham and @ephraimbuddy to decided.).

@potiuk potiuk added this to the Airflow 2.3.4 milestone Jul 27, 2022
airflow/models/dagrun.py Outdated Show resolved Hide resolved
Jorricks and others added 2 commits July 27, 2022 21:26
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
@jedcunningham jedcunningham merged commit 5efe6f3 into apache:main Jul 27, 2022
@ephraimbuddy ephraimbuddy added type:improvement Changelog: Improvements type:bug-fix Changelog: Bug Fixes and removed type:improvement Changelog: Improvements labels Aug 15, 2022
ephraimbuddy pushed a commit that referenced this pull request Aug 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants