Add Kimi K3 standalone B300 perf workload - #61
Draft
khluu wants to merge 2 commits into
Draft
Conversation
Co-authored-by: Codex <noreply@openai.com> Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com> Signed-off-by: khluu <khluu000@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR was authored with assistance from Codex.
Summary
kimi_k3_b300workload for the standalone 8×B300 runner.docker#v5.2.0profile from stacked PR Add GLM-5.2 standalone B300 vLLM benchmark #50 instead of duplicating that infrastructure.vllm bench servecell with 256 prompts.VLLM_IMAGEat trigger time.This does not duplicate PR #57: that PR adds an MI355X aiperf workload, while this change targets the standalone B300 queue and the existing vLLM bench ingestion path.
Trigger
Validation
python3 .buildkite/test_generate_pipeline.py— 11/11 passedb300-8,docker#v5.2.0, and the exact release-image overridebash -non the runner shell scriptsgit diff --checkThe Docker-plugin path itself previously passed on this runner in perf-eval #393. Live Kimi validation is currently blocked by a host issue: #411 shows host
nvidia-smitiming out and a minimal GPU container failing withnvidia-container-cli: ... driver rpc error: timed out. After the B300 host is repaired, this PR still needs an end-to-end run against the image above, including confirmation that PR #50's FlashInfer cubin overlay matches the v0.27.1 image.