Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INLONG-10459][Manager] Support schedule instance callback to submit Flink batch job #10510

Merged
merged 6 commits into from
Jun 26, 2024

Conversation

aloyszhang
Copy link
Contributor

@aloyszhang aloyszhang commented Jun 25, 2024

Fixes #10459

Motivation

Support submitting Flink batch job when the scheduling instance callback.

Details see descriptions in #10459

Modifications

  1. make sure StartupSortListener only take effect in real time sync workflow
  2. add OfflineOperator interface and FlinkOfflineOperator to handle the submitting of flink batch job
  3. add interface to InLongGroupController to receive the callback of schedule instance
  4. improve update logic for schedule info
  5. other tiny improvements in NoopScheduleClient and application.properties

Verifying this change

(Please pick either of the following options)

  • This change is a trivial rework/code cleanup without any test coverage.

Documentation

  • Does this pull request introduce a new feature? (no)

@aloyszhang aloyszhang self-assigned this Jun 25, 2024
@aloyszhang aloyszhang requested review from vernedeng and fuweng11 and removed request for vernedeng June 25, 2024 11:20
@aloyszhang aloyszhang merged commit 8819bfc into apache:dev-offline-sync Jun 26, 2024
8 checks passed
@aloyszhang aloyszhang deleted the schedule-instance branch July 5, 2024 02:31
aloyszhang added a commit to aloyszhang/inlong that referenced this pull request Jul 9, 2024
…Flink batch job (apache#10510)

* [INLONG-10459][Manager] Support schedule instance callback to submit Flink batch job
aloyszhang added a commit that referenced this pull request Jul 9, 2024
…Flink batch job (#10510)

* [INLONG-10459][Manager] Support schedule instance callback to submit Flink batch job
aloyszhang added a commit to aloyszhang/inlong that referenced this pull request Jul 9, 2024
…Flink batch job (apache#10510)

* [INLONG-10459][Manager] Support schedule instance callback to submit Flink batch job
aloyszhang added a commit that referenced this pull request Jul 9, 2024
…Flink batch job (#10510)

* [INLONG-10459][Manager] Support schedule instance callback to submit Flink batch job
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants