Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

zstd: Improve best compression #360

Merged
merged 2 commits into from
Apr 22, 2021
Merged

zstd: Improve best compression #360

merged 2 commits into from
Apr 22, 2021

Commits on Apr 22, 2021

  1. zstd: Improve best compression 

    See if we can find a better match by checking where the current best ends.
Use that offset to see if we can find a better full match.

Before/after. Ignore speed, may not be comparable:

```
gob-stream  zskp    4   1911399616  171537212   32113   56.76
gob-stream	zskp	4	1911399616	167273881	29337	62.13

enwik9  zskp    4   1000000000  276609671   44029   21.66
enwik9	zskp	4	1000000000	275241169	36430	26.18

github-june-2days-2019.json zskp    4   6273951764  512796117   97791   61.18
github-june-2days-2019.json	zskp	4	6273951764	503314661	93811	63.78

nyc-taxi-data-10M.csv   zskp    4   3325605752  495986829   89368   35.49
nyc-taxi-data-10M.csv	zskp	4	3325605752	490907191	65939	48.10
```
    @klauspost
    klauspost committed Apr 22, 2021
    Configuration menu
    Copy the full SHA
    063720d View commit details
    Browse the repository at this point in the history

  2. Update docs.

    @klauspost
    klauspost committed Apr 22, 2021
    Configuration menu
    Copy the full SHA
    f7789aa View commit details
    Browse the repository at this point in the history