Very interesting results of my HTML compression tests
GZ, LZMA and ZSTD with custom dictionary compression codecs were tested
The aim was to find the best storage method for the special use case
We see the huge ZSTD compression superiority over the competitors, much more than LZMA has over GZ. The important definition is - using the custom dictionary. Meanwhile, the LZMA is not so impressive in this case. Probably because of the short data chunks. Thus, it is exactly what the ZSTD custom dictionaries were thought for
The test HTML data array is private and can't be shared, sorry
| html | gz | lzma | zstd dict | gz | lzma | zstd dict | lzma/gz | zstd/gz | zstd/lzma |
|---|---|---|---|---|---|---|---|---|---|
| 224892 | 27642 | 22608 | 16010 | 8.14 | 9.95 | 14.05 | 1.22 | 1.73 | 1.41 |
| 325494 | 38068 | 29968 | 23587 | 8.55 | 10.86 | 13.80 | 1.27 | 1.61 | 1.27 |
| 234658 | 28912 | 23536 | 16918 | 8.12 | 9.97 | 13.87 | 1.23 | 1.71 | 1.39 |
| 131838 | 19560 | 16456 | 9361 | 6.74 | 8.01 | 14.08 | 1.19 | 2.09 | 1.76 |
| 111991 | 17242 | 14716 | 7994 | 6.50 | 7.61 | 14.01 | 1.17 | 2.16 | 1.84 |
| 114844 | 18278 | 15592 | 8743 | 6.28 | 7.37 | 13.14 | 1.17 | 2.09 | 1.78 |
| 210660 | 25286 | 20852 | 14032 | 8.33 | 10.10 | 15.01 | 1.21 | 1.80 | 1.49 |
| 122262 | 18497 | 15652 | 8771 | 6.61 | 7.81 | 13.94 | 1.18 | 2.11 | 1.78 |
| 146676 | 20567 | 17268 | 10209 | 7.13 | 8.49 | 14.37 | 1.19 | 2.01 | 1.69 |
| 335602 | 37512 | 29380 | 22532 | 8.95 | 11.42 | 14.89 | 1.28 | 1.66 | 1.30 |
| 345848 | 38140 | 29780 | 23447 | 9.07 | 11.61 | 14.75 | 1.28 | 1.63 | 1.27 |
| 132987 | 19167 | 16136 | 9817 | 6.94 | 8.24 | 13.55 | 1.19 | 1.95 | 1.64 |
| 136297 | 19881 | 16692 | 10180 | 6.86 | 8.17 | 13.39 | 1.19 | 1.95 | 1.64 |
| 186631 | 24681 | 20440 | 13822 | 7.56 | 9.13 | 13.50 | 1.21 | 1.79 | 1.48 |
| 159849 | 21848 | 18240 | 11705 | 7.32 | 8.76 | 13.66 | 1.20 | 1.87 | 1.56 |
| 228437 | 28792 | 23328 | 16881 | 7.93 | 9.79 | 13.53 | 1.23 | 1.71 | 1.38 |
| 138191 | 19790 | 16636 | 10222 | 6.98 | 8.31 | 13.52 | 1.19 | 1.94 | 1.63 |
| 195771 | 25474 | 20848 | 14358 | 7.69 | 9.39 | 13.63 | 1.22 | 1.77 | 1.45 |
| 137628 | 19646 | 16596 | 10011 | 7.01 | 8.29 | 13.75 | 1.18 | 1.96 | 1.66 |
| 140959 | 19867 | 16744 | 10225 | 7.10 | 8.42 | 13.79 | 1.19 | 1.94 | 1.64 |
| -------- | ------- | ------- | ------- | ------ | ------ | ------- | ------ | ------ | ------ |
| Mean | 7.49 | 9.09 | 13.91 | 1.21 | 1.87 | 1.55 |