Skip to content

Feature: Auto-detect template capabilities (supports_disable_thinking, supports_reasoning_only, etc.) #19

@ochafik

Description

@ochafik

Feature Request

Minja should auto-detect and expose template capabilities that currently need to be manually specified in test harnesses.

New Capabilities to Detect

Thinking Mode Control

  • supports_disable_thinking - Can the template respect enable_thinking=false?
    • DeepSeek V3.1: Always emits thinking blocks (doesn't support disabling)
    • Command R7B, GLM-4.6, SmolLM3-3B: Respect enable_thinking

Reasoning Format Variations

  • supports_reasoning_only - Can the template emit reasoning without any content or tool calls?
  • supports_reasoning_with_content - Can the template mix content text with reasoning in the same message?
    • Apertus: Cannot mix text content with reasoning blocks

Tool Call Behavior

  • tool_required_allows_content - When tool_choice=required, can content appear before tool calls?
  • tools_emit_content_with_calls - Can content appear alongside tool calls in the same message?
  • reasoning_requires_tools - Does reasoning only appear when tools are also present?
    • Command R7B: reasoning_requires_tools = true - reasoning only appears with tool calls
    • DeepSeek R1/V3.1, GLM-4.6: reasoning_requires_tools = false - reasoning can appear independently

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions