Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make extra link work in UI #25500

Merged
merged 1 commit into from
Aug 5, 2022
Merged

Conversation

uranusjr
Copy link
Member

@uranusjr uranusjr commented Aug 3, 2022

Close #25360. Two parts in this:

  1. The existing extra links mechanism relies on the operator being unmapped, so we do that for most operators to keep working.
  2. The UI needs to be updated to ask for those links at the right time -- namely, it must only make requests against unmapped tasks, not the mapped ones.

@boring-cyborg boring-cyborg bot added area:core-operators Operators, Sensors and hooks within Core Airflow area:providers area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues labels Aug 3, 2022
Comment on lines -404 to +418
return render_template_as_native(template, context)
return render_template_to_string(template, context)
return render_template_as_native(template, cast(MutableMapping[str, Any], context))
return render_template_to_string(template, cast(MutableMapping[str, Any], context))
Copy link
Member Author

@uranusjr uranusjr Aug 3, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unrelated, but Mypy is complaining. context here is implemented as a MutableMapping (although we supply a type stub to say it’s not to prevent users from getting a wrong idea), so this is fine.

@uranusjr uranusjr force-pushed the extra-links-js-req branch 3 times, most recently from bbf31ef to 72d55bd Compare August 3, 2022 07:33
@uranusjr uranusjr requested a review from mik-laj as a code owner August 3, 2022 07:33
This has two parts: First, the existing extra links mechanism relies on
the operator being unmapped, so we do that for most operators to keep
working. Second, the UI needs to be slightly updated to ask for those
links at the right time -- namely, it must only make requests against
unmapped tasks, not the mapped ones.
@ashb
Copy link
Member

ashb commented Aug 3, 2022

The UI needs to be updated to ask for those links at the right time -- namely, it must only make requests against unmapped tasks, not the mapped ones.

Hmmm. Ideally It would be nice if each individual mapped task could have it's own mapped links too. For example if your mapped task submits jobs to EMR/Databricks etc then being able to have mapped links to the remote logs/job is desirable.

@uranusjr
Copy link
Member Author

uranusjr commented Aug 3, 2022

Hmmm. Ideally It would be nice if each individual mapped task could have it's own mapped links too. For example if your mapped task submits jobs to EMR/Databricks etc then being able to have mapped links to the remote logs/job is desirable.

Yes, this is what this PR intends to do. What we’re currently doing is completely the other way around: we display the links against the entire mapped task (and that doesn’t work well for most things), but not for individual (mapped) task instances. This PR removes the former, and adds the links for the latter.

Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fantastic ! Thnks @uranusjr for looking at that :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:core-operators Operators, Sensors and hooks within Core Airflow area:providers area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Extra Links do not works with mapped operators
5 participants