Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Manager] Support schedule instance callback to submit Flink batch job #10459

Closed
2 tasks done
Tracked by #9779
aloyszhang opened this issue Jun 19, 2024 · 0 comments
Closed
2 tasks done
Tracked by #9779
Assignees
Milestone

Comments

@aloyszhang
Copy link
Contributor

aloyszhang commented Jun 19, 2024

Description

The whole procedure for offline jobs is
image

An InLong group of the offline type is created and approved, and then, the scheduling engine client will register schedule info to the scheduling engine(support built-in quartz engine and third-party engines).

The scheduling engines will generate instances periodically, every instance means the offline sync should execute once.

By now, we have already supported the management of schedule info like configuration/register, etc.

The only remaining part is the scheduling instance's callback to submit a Flink batch job to Flink service.
This part is marked with yellow color in the draw above.

We should implement this part to complete the processing of offline sync jobs.

Use case

Support schedule instance callback to submit Flink batch job

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant