Skip to content

Latest commit

 

History

History
104 lines (87 loc) · 7.05 KB

README.md

File metadata and controls

104 lines (87 loc) · 7.05 KB
Raw

pithy

pithy is licensed under the terms of the BSD license.
Copyright © 2011, John Engelhart.

Notes

pithys roots can be traced back to Googles snappy compression library, but has diverged quite a bit.

pithy can not read or write the snappy compression format, and vice versa.

TODO

Write the README.md :).

Benchmarks

  • Benchmarks were performed on an iPhone 4 (not S) and compiled with clang version 3.0 using -Os.
  • Compression and decompression speed numbers are in megabytes per second.
  • The files used are from the snappy distributions test suite.
  • zlib 1 and zlib 6 correspond to the zlib tunable compression effort, with 1 being fastest, and 6 being the default.
  • pithy 0 and pithy 2 correspond to the pithy tunable compression effort.

Size

Name Uncompressed pithy 0 pithy 2 snappy lzf lzo zlib 1 zlib 6
alice29.txt 152089 93270 87767 90965 82985 83568 65148 54416
asyoulik.txt 125179 83039 78170 80207 72081 73849 56809 48909
baddata1.snappy 27512 27521 27521 26675 26228 26491 23151 22953
baddata2.snappy 27483 27495 27495 26724 26272 26531 23214 23035
baddata3.snappy 28384 28346 28346 27476 27105 27388 23927 23730
cp.html 24603 12398 11990 11838 11869 11677 9046 7973
fields.c 11150 4960 4790 4728 4667 4680 3665 3134
geo.protodata 118588 19984 19524 27459 27748 20170 18845 15143
grammar.lsp 3721 1859 1839 1800 1768 1783 1344 1234
house.jpg 126958 126846 126843 126803 130003 127169 126488 126525
html 102400 21725 21077 24140 22534 21059 17049 13711
html_x_4 409600 21753 21105 96472 89962 82730 67470 53379
kennedy.xls 1029744 427736 425992 425735 402525 359590 242311 204004
kppkn.gtb 184320 73768 68287 70535 75486 72623 49877 38763
lcet10.txt 426754 247515 230250 243710 225007 223028 174142 144916
mapreduce-osdi-1.pdf 94330 79281 79331 77477 79684 77241 76414 74940
plrabn12.txt 481861 340325 317582 329339 290030 297444 228901 195273
ptt5 513216 87776 83676 93455 80756 86277 65571 56477
sum 38240 19018 18728 19837 20274 17609 14130 13002
urls.10K 702087 343976 316942 357267 350981 312748 253275 222625
xargs.1 4227 2603 2545 2509 2441 2451 1864 1748

Compression Speed in MB/s

Name pithy 0 pithy 2 snappy lzf lzo zlib 1 zlib 6
alice29.txt 34.31 30.48 26.92 18.46 27.91 5.01 1.36
asyoulik.txt 32.67 29.09 25.63 17.52 25.91 4.60 1.24
baddata1.snappy 332.22 236.41 37.59 12.61 13.20 3.33 2.79
baddata2.snappy 287.97 213.15 40.39 12.58 13.12 3.45 2.87
baddata3.snappy 287.98 213.21 34.57 12.57 13.03 3.38 2.82
cp.html 44.02 37.66 29.81 22.54 29.00 6.32 3.36
fields.c 43.06 35.57 26.45 25.68 39.53 6.03 3.56
geo.protodata 90.33 82.31 63.04 37.91 60.77 12.47 5.42
grammar.lsp 35.15 33.17 23.19 24.99 36.98 3.73 2.93
house.jpg 712.25 450.11 209.48 11.53 10.41 2.67 2.46
html 77.14 69.61 58.09 41.57 57.68 11.02 4.65
html_x_4 171.03 131.75 56.00 37.63 51.18 11.18 4.36
kennedy.xls 45.41 37.88 36.68 34.34 40.08 7.97 1.76
kppkn.gtb 47.66 42.32 37.38 31.08 40.32 6.80 1.23
lcet10.txt 33.98 29.69 27.15 17.84 23.87 4.92 1.37
mapreduce-osdi-1.pdf 165.96 147.48 90.87 14.25 13.31 3.47 2.91
plrabn12.txt 29.28 24.61 22.84 15.80 20.64 4.14 1.03
ptt5 80.67 70.76 68.08 41.08 49.54 11.46 3.53
sum 44.91 38.59 30.31 22.71 32.02 5.93 1.97
urls.10K 39.15 31.68 31.11 20.44 23.31 5.71 2.47
xargs.1 33.60 25.68 19.67 20.26 30.31 3.77 2.99

Decompression Speed in MB/s

Name pithy 0 pithy 2 snappy lzf lzo zlib 1 zlib 6
alice29.txt 115.76 114.84 48.92 69.53 68.74 28.71 33.94
asyoulik.txt 112.63 110.95 47.17 66.92 65.92 27.99 31.66
baddata1.snappy 1544.53 1642.51 228.20 114.57 143.39 20.58 21.42
baddata2.snappy 1093.85 1049.47 251.99 115.96 144.84 20.60 20.77
baddata3.snappy 1355.65 1355.65 213.21 114.71 143.99 20.19 21.67
cp.html 172.58 172.58 76.19 74.72 100.70 30.83 32.77
fields.c 154.19 156.49 67.73 81.80 100.34 33.76 37.18
geo.protodata 340.65 343.80 135.29 150.60 156.64 54.24 58.54
grammar.lsp 154.64 154.24 72.43 78.96 104.45 22.32 23.19
house.jpg 1985.66 897.23 1017.70 230.62 229.32 27.60 36.28
html 279.83 280.60 115.30 130.03 136.39 50.97 55.11
html_x_4 832.94 847.38 108.72 122.60 129.39 46.41 50.31
kennedy.xls 147.34 147.61 52.08 56.72 95.54 32.96 36.43
kppkn.gtb 132.47 115.95 56.02 85.62 84.27 34.07 41.23
lcet10.txt 109.02 107.61 45.58 60.34 61.26 27.58 30.86
mapreduce-osdi-1.pdf 478.53 463.82 257.78 182.13 185.10 29.29 30.33
plrabn12.txt 94.13 90.73 37.60 55.46 52.74 23.68 26.55
ptt5 241.46 182.63 116.23 131.32 133.36 49.16 52.61
sum 162.12 147.64 67.91 74.89 98.04 29.18 33.77
urls.10K 156.08 153.04 68.10 62.93 77.84 29.52 31.03
xargs.1 149.63 144.20 63.98 72.03 93.80 22.03 23.30