Skip to content

chore(gallery): add TwIL Pro Q5 and Q6 variants - #12589

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
gallery/cron-20261009-run2
Open

localai-org-maint-bot wants to merge 1 commit into
masterfrom
gallery/cron-20261009-run2

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add the publisher's Q5_K_M and Q6_K GGUF builds of TwIL-LM3-Pro as variants of the existing Q4 entry. These fill the size gap between Q4 and Q8 (2.61 GB and 3.01 GB). Preserve the existing llama.cpp configuration, embedded reasoning template, and noncommercial license notice. Document automatic and explicit variant installation.

Notes for Reviewers

Both download URLs use revision 4214aaa4020cd51ac418dc6c7243c076665a811d, matching the existing Q4/Q8 entries. SHA256 values and byte sizes were cross-checked against HF LFS metadata and independent x-linked-etag / x-linked-size HTTP headers.

Validation:

  • YAML parsed successfully: 2,085 unique entries, valid variant references, and no nested or multiply claimed variants.
  • All 2,082 unrelated entries remain unchanged; the Q4 entry only gains two variant references. Both new entries preserve Q8 runtime settings.
  • git diff --check passes.
  • go test ./core/gallery is blocked before execution: generated pkg/grpc/proto is absent. This environment also lacks make/protoc. No inference or full weight download was performed.

Signed commits

  • Yes, I signed my commits. Human DCO sign-off is required; the commit includes Assisted-by attribution.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Fill the gap between the existing Q4 and Q8 builds with the
publisher's Q5_K_M and Q6_K GGUF files. Preserve the runtime settings
and license notice, and document explicit variant installation.

Assisted-by: Codex:gpt-6

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant