Skip to content

Add Sqeakd direct-ANE research harness - #1

Merged
ebowwa merged 2 commits into
mainfrom
agent/sqeakd-inference-harness
Jul 28, 2026
Merged

Add Sqeakd direct-ANE research harness#1
ebowwa merged 2 commits into
mainfrom
agent/sqeakd-inference-harness

Conversation

@ebowwa

@ebowwa ebowwa commented Jul 28, 2026

Copy link
Copy Markdown
Owner

What changed

Why

Core ML reports the fixed Sqeakd FP16 graph as ANE-compatible but schedules it
on GPU or CPU. This branch establishes a macOS-only private-API research path
for translating and benchmarking Sqeakd kernels directly on ANE.

Validation

  • make test_mil_custom
  • ./test_mil_custom on M1/macOS 26.5.2
  • attention, linear, transformer block, and backward matmul CPU-reference checks pass
  • make sqeakd-inspect MODEL=/path/SqeakdCTC_fixed105_fp16.mlpackage
  • graph inventory reports 1,877 operations and the expected fixed tensor contract

Scope

This is research code using private APIs. It is intentionally isolated from
the iOS, TestFlight, App Store, and production Sqeakd runtimes.

@ebowwa
ebowwa marked this pull request as ready for review July 28, 2026 22:34
@ebowwa
ebowwa merged commit 26d5218 into main Jul 28, 2026
@ebowwa
ebowwa deleted the agent/sqeakd-inference-harness branch July 28, 2026 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants