Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions docs/content/features/model-gallery.md
Original file line number Diff line number Diff line change
Expand Up @@ -187,6 +187,25 @@ To select Q8 explicitly, run `local-ai models install cyber-tiel-coder-35b-a3b-q
Both configurations use the embedded chat template and default to 32,768 context tokens.
The [model card](https://huggingface.co/peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP) describes its abliterated Ornith-1.5 base and MIT license.

## Qwen3.8-27B Pi

The `qwen3.8-27b-pi` entry offers Q4_K_M, Q5_K_M, Q6_K, Q8_0, and
Q4_K_M with MTP builds for llama.cpp. This fine-tune targets coding and
tool use in the Pi agent harness. Each build includes the BF16 vision
projector and uses the embedded chat template.

To select one of the intermediate quantizations explicitly:

```bash
local-ai models install qwen3.8-27b-pi --variant qwen3.8-27b-pi-q5
local-ai models install qwen3.8-27b-pi --variant qwen3.8-27b-pi-q6
```

The Q5 and Q6 builds use a 32,768-token context and do not enable MTP.
Downloads are pinned to a revision and checked with SHA256. See the
[publisher's model card](https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF)
for model details.

## Qwen3.8-27B Agention Precision

The gallery includes Agention Precision IQ4_XS and Q4_K_M GGUF builds of
Expand Down
96 changes: 96 additions & 0 deletions gallery/index.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -67747,6 +67747,8 @@
sha256: 82b7adb44411dbb298b1c689567804e5ed0790d80f308ed8b5b6b8ac0527d2ac
- name: qwen3.8-27b-pi
variants:
- model: qwen3.8-27b-pi-q5
- model: qwen3.8-27b-pi-q6
- model: qwen3.8-27b-pi-q8
- model: qwen3.8-27b-pi-q4-mtp
url: github:mudler/LocalAI/gallery/virtual.yaml@master
Expand Down Expand Up @@ -67795,6 +67797,100 @@
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q5
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/bytkim/Qwen3.8-27B-pi
- https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF
description: |
Qwen3.8-27B-pi is a 27B fine-tune for coding and tool use in the Pi agent harness.
This Q5_K_M GGUF build uses llama.cpp, the embedded chat template, and the BF16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- reasoning
- vision
- multimodal
last_checked: "2026-10-09"
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
options:
- use_jinja:true
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q5_K_M.gguf
temperature: 1.0
top_p: 0.95
top_k: 20
min_p: 0.0
files:
- filename: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q5_K_M.gguf
sha256: c6a9a66cd17a3627948fd1cf4730835423379aee926b33c0cfa94963b1968fd1
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/Qwen3.8-27B-pi-Q5_K_M.gguf
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q6
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
- https://huggingface.co/bytkim/Qwen3.8-27B-pi
- https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF
description: |
Qwen3.8-27B-pi is a 27B fine-tune for coding and tool use in the Pi agent harness.
This Q6_K GGUF build uses llama.cpp, the embedded chat template, and the BF16 vision projector.
license: apache-2.0
tags:
- llm
- gguf
- cpu
- gpu
- coding
- reasoning
- vision
- multimodal
last_checked: "2026-10-09"
overrides:
backend: llama-cpp
context_size: 32768
function:
automatic_tool_parsing_fallback: true
grammar:
disable: true
known_usecases:
- chat
- vision
mmproj: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
options:
- use_jinja:true
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q6_K.gguf
temperature: 1.0
top_p: 0.95
top_k: 20
min_p: 0.0
files:
- filename: llama-cpp/models/qwen3.8-27b-pi/Qwen3.8-27B-pi-Q6_K.gguf
sha256: 8a7e614810ad9da748903753c07b5beba2f99b355170fe36832eb0acee5183f3
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/Qwen3.8-27B-pi-Q6_K.gguf
- filename: llama-cpp/models/qwen3.8-27b-pi/mmproj-Qwen3.8-27B-pi-BF16.gguf
sha256: 6086d2fb198687fbd5961f9b4e5847979dfd3ac73420aada6ce72d4fc9d80f2a
uri: https://huggingface.co/bytkim/Qwen3.8-27B-pi-GGUF/resolve/97caacb971d9246520fa8db5282a06bd36b103df/mmproj-Qwen3.8-27B-pi-BF16.gguf
- name: qwen3.8-27b-pi-q8
url: github:mudler/LocalAI/gallery/virtual.yaml@master
urls:
Expand Down
Loading