Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lightning's compress reader's efficiency is bad #43128

Closed
lichunzhu opened this issue Apr 18, 2023 · 0 comments · Fixed by #43129
Closed

Lightning's compress reader's efficiency is bad #43128

lichunzhu opened this issue Apr 18, 2023 · 0 comments · Fixed by #43129
Labels
affects-7.0 component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.

Comments

@lichunzhu
Copy link
Contributor

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Use Lightning to import some gzip compressed csv data.

2. What did you expect to see? (Required)

Lightning can import data very fast.

3. What did you see instead (Required)

Lightning's speed of importing data is very slow.

4. What is your TiDB version? (Required)

v6.5.1
@lichunzhu lichunzhu added type/bug The issue is confirmed as a bug. component/lightning This issue is related to Lightning of TiDB. labels Apr 18, 2023
@lichunzhu lichunzhu mentioned this issue Apr 18, 2023
Merged
3 tasks
ti-chi-bot pushed a commit that referenced this issue Apr 18, 2023
@lichunzhu
storage: replace standard gzip with klauspost/compress to increase ef…
fa54151 
…fiency (#43129)

close #43128
@ti-chi-bot ti-chi-bot mentioned this issue Apr 19, 2023
Merged
3 tasks
ti-chi-bot added a commit that referenced this issue Apr 19, 2023
@ti-chi-bot
storage: replace standard gzip with klauspost/compress to increase ef…
a8d1f0a 
…fiency (#43129) (#43186)

close #43128
@ti-chi-bot ti-chi-bot mentioned this issue Apr 19, 2023
Merged
3 tasks
ti-chi-bot added a commit that referenced this issue Apr 19, 2023
@ti-chi-bot
storage: replace standard gzip with klauspost/compress to increase ef…
29116c0 
…fiency (#43129) (#43186) (#43203)

close #43128
@niubell niubell added the type/enhancement The issue or PR belongs to an enhancement. label Apr 27, 2023
@lichunzhu lichunzhu removed the type/bug The issue is confirmed as a bug. label Apr 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
affects-7.0 component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

storage: replace standard gzip with klauspost/compress to improve efficiency lichunzhu/tidb
2 participants
@niubell @lichunzhu