OpenZL
OpenZL
OpenZL delivers high compression ratios while preserving high speed, a level of performance that is out of reach for generic compressors. OpenZL 在保持高速的同时提供了极高的压缩比,这种性能水平是通用压缩工具所无法企及的。
OpenZL takes a description of your data and builds from it a specialized compressor optimized for your specific format. OpenZL 通过获取您数据的描述信息,为您特定的数据格式构建一个经过优化的专用压缩器。
OpenZL consists of a core library and tools to generate specialized compressors — all compatible with a single universal decompressor. OpenZL 由一个核心库和用于生成专用压缩器的工具组成,所有这些工具都兼容同一个通用解压器。
It is designed for engineers that deal with large quantities of specialized datasets (like AI workloads for example) and require high speed for their processing pipelines. 它专为处理大量专用数据集(例如 AI 工作负载)且对处理流水线有高速要求的工程师而设计。
Here are some examples: SAO, part of the Silesia Compression Corpus: 以下是一些示例:SAO(Silesia 压缩语料库的一部分):
| SAO | zstd -3 | xz -9 | OpenZL | |
|---|---|---|---|---|
| Ratio | - | x1.31 | x1.64 | x2.06 |
| Compression Speed | - | 115 MB/s | 3.1 MB/s | 203 MB/s |
| Decompression Speed | - | 890 MB/s | 30 MB/s | 822 MB/s |
The result: much stronger ratios than generic compressors, at the speeds required by datacenter workloads. 结果是:在满足数据中心工作负载所需速度的同时,实现了远超通用压缩工具的压缩比。
Want to try it yourself? Get started in minutes with the Quick start guide. 想亲自尝试一下吗?通过“快速入门指南”,几分钟内即可上手。