Skip to content

Versioning / build issues vendoring quack (cutlass/cutedsl pin) for sonic-moe #718

Description

@sayakpaul

Context: sonic-moe now hard-requires quack (previously optional alongside its own GEMM backends), so we must vendor it — but that surfaces versioning/build problems.

Problem:

  • Current blocker is on the kernel-builder side: latest quack needs a newer cutlass than what's available.
  • quack → cutedsl → cutlass; the version is pinned in cute, and nixpkgs keeps resolving an older one (~4.5.0).
  • Naive bump is risky since cute/cutedsl frequently change internal APIs.
  • Open question: does the build sandbox need cutedsl/cutlass at build time? (cf. how Helion is handled in Add Helion as a supported Python dependency #706)

Ask: make a newer cutlass/cutedsl available to the builder without breaking existing kernels, decide a pin/bump strategy, and wire up build-time deps if needed (analogous to the python-depends mechanism from #706).

Cc: @IlyasMoutawwakil

Related to #715

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions