Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Sort] The audit operator in mysql connector cannot be serialized and the job cannot submit to jobmanager #10297

Closed
2 tasks done
EMsnap opened this issue May 29, 2024 · 0 comments · Fixed by #10301
Closed
2 tasks done
Assignees
Labels
type/bug Something is wrong
Milestone

Comments

@EMsnap
Copy link
Contributor

EMsnap commented May 29, 2024

What happened

The audit operator cannot be serialized

Right now the audit operator is initialized on ScanTableSource.getScanRuntimeProvider which is run on flink client. which means all objects in DAG should be serialized.
企业微信截图_75fd6116-86c1-485a-b0ea-542630fa5372

image

So the job cannot be submitted,the error log as follows:

企业微信截图_8a9e0f30-6673-4e9c-8650-40f92468ff65

also the mysql mysql jdbc connector should be added to the connector fat jar

image

What you expected to happen

job can submit to flink cluster

How to reproduce

submit flink mysql source to flink cluster

Environment

flink 1.15

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@EMsnap EMsnap added the type/bug Something is wrong label May 29, 2024
@EMsnap EMsnap self-assigned this May 29, 2024
@dockerzhang dockerzhang added this to the 1.13.0 milestone May 29, 2024
@dockerzhang dockerzhang changed the title [Bug] The audit operator in mysql connector cannot be serialized and the job cannot submit to jobmanager [Bug][Sort] The audit operator in mysql connector cannot be serialized and the job cannot submit to jobmanager May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something is wrong
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants