Skip to content

chore: ⬆️ Update ggml-org/llama.cpp to 23b0202a189c44a54625aadcb37a946dd1d6278d - #12601

Open
localai-org-maint-bot wants to merge 2 commits into
mudler:masterfrom
ci-forks:bump/LLAMA_VERSION
Open

localai-org-maint-bot wants to merge 2 commits into
mudler:masterfrom
ci-forks:bump/LLAMA_VERSION

Conversation

@localai-org-maint-bot

@localai-org-maint-bot localai-org-maint-bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Collaborator

@localai-org-maint-bot localai-org-maint-bot changed the title chore: ⬆️ Update ggml-org/llama.cpp to 79e2e74eb11022c1ba2e438df7f0ca2d4c10f8b6 chore: ⬆️ Update ggml-org/llama.cpp to 23b0202a189c44a54625aadcb37a946dd1d6278d Oct 10, 2026
mudler and others added 2 commits October 11, 2026 03:03
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Newer llama.cpp parsers return template state outside the request JSON.
Pass that state to both inference tasks and response readers so grammar,
tool calls, and reasoning remain available in both chat paths.

Detect the parser API during preparation to preserve older fork builds.

Assisted-by: Codex:gpt-6

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants