facebookDeveloper tools

zstd

Zstandard is a high-performance lossless compression algorithm that provides real-time compression speeds with zlib-level or better compression ratios.

  • Backend
  • DevOps
  • Productivity
  • Library/framework
  • CLI
  • Windows
  • macOS
  • Linux
  • Runs locally
  • Docker supported
zstd screenshot
Popularity
27.6k Stars
GitHub stars
Recent activity
8/23/2026
Updated in the last 30 days
License
NOASSERTION
Review the terms yourself

Why it matters

We look beyond stars: what problem it solves, whether it creates real utility, and what makes its approach worth noticing.

Last 90 days

Problem

Addresses the trade-off between compression ratio and processing speed in real-time scenarios, specifically solving efficiency bottlenecks when handling small data blocks.

Practical value

Offers highly configurable compression levels and dictionary training, making it widely applicable for system-level data transmission and storage.

Innovation / differentiation

Introduces Finite State Entropy (FSE) coding and dictionary-based compression, significantly improving small-file compression while maintaining high-speed decompression.

Leverage potential

As a foundational library, its standardized format and extensive language bindings make it a standard component for data compression in modern software architectures.

Why now

The project has matured into an industry-standard compression algorithm, widely adopted across operating systems, databases, and network protocols.

Community activity

In the last 90 days there were 16 new issues and 48 pull requests; the bounded issue/PR samples include 12 issue authors and 29 PR contributors, with at least 0 releases.

Maintainer responsiveness

The 16-issue window sample had a 19% close rate, and the 47-pull-request sample had a 13% merge rate. Maintainer-response observations covered 100% of that issue sample, with a 0% response rate and median first response of not enough data.

29 contributors in PR sampleAt least 0 releasesIssue response rate 0% · sample 16 (100% coverage)PR merge rate 13% · 47 sampled in window

Key highlights

  • Provides a lossless compression algorithm with configurable speed and ratio trade-offs
  • Supports training custom dictionaries on sample data to optimize small data compression
  • Includes a command-line utility for generating and decoding multiple compression formats

Quick start

How it is installed, how hard it is, and where to start.

Where it runs

Runs locally

Difficulty

Medium — some setup needed

Docker supportedRuns locally
  1. 01Run the 'make' command in the root directory to compile the zstd CLI and libzstd library.
  2. 02Use the 'zstd --train' command followed by your training set files to create a compression dictionary.
  3. 03Load the generated dictionary file using the '-D' flag during compression or decompression.

Best for

  • Developers who want to try it on their machine
  • People who prefer Docker deploys

More about it

Zstandard (zstd) is a lossless data compression algorithm designed for real-time performance. By utilizing Huff0 and FSE entropy coding, it achieves superior processing speeds while maintaining or exceeding zlib-level compression ratios.

The project provides a reference C library and a versatile command-line utility that handles formats including .zst, .gz, .xz, and .lz4. For small data scenarios, it features a training mode that generates custom dictionaries to maximize compression efficiency.

Sources

Each field shows its status and source — expand to review.

15 · Expand
  • capability tags

    Verified

    productivity

    Source: admin_cms · cms editor · 8/22/2026

  • editor note

    Verified

    {"en":"Zstandard offers an excellent balance between compression speed and ratio, making it ideal for real-time data processing. Its built-in dictionary training significantly improves compression efficiency for small files.","zh":"Zstandard 提供了极佳的压缩速度与比率平衡,特别适合需要实时处理大量数据的场景。其内置的字典训练功能可提高小文件(如 JSON 记录)的压缩效率。"}

    Source: admin_cms · cms editor · 8/22/2026

  • how to use

    Verified

    {"steps":[{"en":"Run the 'make' command in the root directory to compile the zstd CLI and libzstd library.","zh":"在项目根目录运行 make 命令以编译 zstd 命令行工具及 libzstd 库。"},{"en":"Use the 'zstd --train' command followed by your training set files to create a compression dictionary.","zh":"使用 zstd --train 命令并指定训练集文件来创建压缩字典。"},{"en":"Load the generated dictionary file using the '-D' flag during compression or decompression.","zh":"在压缩或解压时通过 -D 参数加载生成的字典文件。"}],"installAt":"local","difficulty":"medium"}

    Source: admin_cms · cms editor · 8/22/2026

  • intro

    Verified

    {"en":"Zstandard (zstd) is a lossless data compression algorithm designed for real-time performance. By utilizing Huff0 and FSE entropy coding, it achieves superior processing speeds while maintaining or exceeding zlib-level compression ratios.\n\nThe project provides a reference C library and a versatile command-line utility that handles formats including .zst, .gz, .xz, and .lz4. For small data scenarios, it features a training mode that generates custom dictionaries to maximize compression efficiency.","zh":"Zstandard (zstd) 是一种提供实时压缩性能的无损数据压缩算法。它通过 Huff0 和 FSE 熵编码技术,在保持与 zlib 相当或更优压缩比的前提下,大幅提升了处理速度。\n\n该项目不仅包含核心 C 语言库,还提供了一个功能完备的命令行工具,支持 `.zst`、`.gz`、`.xz` 和 `.lz4` 等多种格式。对于小数据场景,用户可以通过训练模式生成专用字典,从而提高压缩效果。"}

    Source: admin_cms · cms editor · 8/22/2026

  • Latest release

    Verified

    v1.5.7

    Source: GitHub API · latest_release=v1.5.7 · 8/25/2026

  • License

    Verified

    NOASSERTION

    Source: GitHub API · license.spdx_id=NOASSERTION · 8/25/2026

  • needs api key

    Verified

    No

    Source: admin_cms · cms editor · 8/22/2026

  • One-liner

    Verified

    {"en":"Zstandard is a high-performance lossless compression algorithm that provides real-time compression speeds with zlib-level or better compression ratios.","zh":"Zstandard 是一款高性能无损压缩算法,在提供 zlib 级别压缩比的同时,具备极高的实时压缩与解压速度。"}

    Source: admin_cms · cms editor · 8/22/2026

  • Platforms

    Verified

    windows, macos, linux

    Source: admin_cms · cms editor · 8/22/2026

  • Category hint

    Inferred from materials

    security

    Source: Project README · hint=security · 8/16/2026

  • product forms

    Verified

    library_framework, cli

    Source: admin_cms · cms editor · 8/22/2026

  • role tags

    Verified

    backend, devops

    Source: admin_cms · cms editor · 8/22/2026

  • supports docker

    Verified

    Yes

    Source: Repository file · dockerfile=true; compose=false · 8/25/2026

  • supports local

    Verified

    Yes

    Source: admin_cms · cms editor · 8/22/2026

  • supports self host

    Verified

    No

    Source: admin_cms · cms editor · 8/22/2026

Other verified projects matched by category, capabilities, and intended roles.