Skip to content

Would you like adding zstd compressor with CGO? #2168

@GrigoryEvko

Description

@GrigoryEvko

I've been upgrading libzstd go wrapper some time ago for usage in my production stargz-snapshotter environment, it's super fast, +-5% with original zstd, sometimes faster when additional buffer helps. https://github.com/GrigoryEvko/gozstd
I implemented all internal apis and so on, and basically this is a 95% complete wrapper of zstd lib, but unfortunately with CGO requirement. It's 70-120% faster than klauspost/compress zstd implementation. With lazy loading it should do wonders with containers.

I originally intended to implement it in stargz-snapshotter and PR, but got busy with other things.

Would it make sense for you? I'm quite obsessed with zstd and zstdchunked in particular, but I'm not sure it's okay for you to add CGO libs, I thought of it as an optional feature and detected at runtime.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions