v0.5 improvements to MoE perf (Deepseek V3) #1478

Open

Labels

opened

Tracking v0.5 items for MoE performance, example model is deepseek v3.

Sub-issues

Metadata

Assignees

No one assigned

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests