-
Notifications
You must be signed in to change notification settings - Fork 224
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
优化TIS Flink实时增量通道启动速度 #366
Labels
enhancement
New feature or request
Milestone
Comments
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Oct 5, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Oct 6, 2024
baisui1981
added a commit
that referenced
this issue
Oct 6, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Oct 7, 2024
baisui1981
added a commit
that referenced
this issue
Oct 7, 2024
|
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Oct 7, 2024
baisui1981
added a commit
that referenced
this issue
Oct 7, 2024
baisui1981
added a commit
to qlangtech/plugins
that referenced
this issue
Oct 9, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
现象
有同学反馈TIS增量启动速度比较慢,一百张表的增量执行管道需要将近20分钟。
以下是启动执行日志链接:https://github.com/qlangtech/plugins-commercial/issues/1
问题分析:
根据典型的日志:
下面那条通过表名获取对应的列元组信息,需要耗费5秒 时间,这个算比较耗费时间的,主要原因是:创建jdbc Connection对象费时,且没有使用dbcp的connection pool来缓存,所以当需要同步的表比较多时的确会比较耗时。
优化思路:
在整个启动过程中,引入Connection缓存机制,将对应构建jdbcURL->Connection的 映射关系作为缓存。启动过程只需要构对Connection实例进行一次初始化工作,将会大大缩减启动初始化时间。
The text was updated successfully, but these errors were encountered: