Skip to content

[None][test] Waive 5 failed cases for main in QA CI - #17807

Merged
xinhe-nv merged 4 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260817-065552
Aug 17, 2026
Merged

[None][test] Waive 5 failed cases for main in QA CI#17807
xinhe-nv merged 4 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260817-065552

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Aug 17, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6621358, 6621362

Waive entries added

full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekR1LongBenchV2::test_nvfp4_4gpus SKIP (https://nvbugs/6621358)
full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekR1LongBenchV2::test_fp8_8gpus SKIP (https://nvbugs/6621358)
full:B200/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-deepseek_r1_v2_fp4_stress] SKIP (https://nvbugs/6621358)
full:H100/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-qwen3_5_4b_fp8_stress] SKIP (https://nvbugs/6621362)
full:H100/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_eagle_triton_stress] SKIP (https://nvbugs/6621362)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • Added five SKIP entries in tests/integration/test_lists/waives.txt.
  • The entries waive three B200 cases for bug 6621358 and two H100 cases for bug 6621362.
  • The entries cover two DeepSeek R1 LongBench V2 accuracy tests and three disaggregated stress tests.
  • The changes are limited to the waiver list.
  • No public API or code changes are included.
  • The waiver format and scope are consistent with the stated objective.

QA Engineer Review

  • Modified tests/integration/test_lists/waives.txt.
  • Added five waiver entries:
    • Two B200 DeepSeek R1 LongBench V2 accuracy tests.
    • Three disaggregated stress tests for DeepSeek R1 V2, GPT-OSS 120B, and Qwen3.5 4B.
  • No test-db/ or qa/ files were modified.
  • CBTS coverage data is unavailable.
  • Verdict: needs follow-up.

Bug(s): 6621358, 6621362
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@xinhe-nv
xinhe-nv enabled auto-merge (squash) August 17, 2026 06:56
@xinhe-nv
xinhe-nv self-requested a review August 17, 2026 06:56
@coderabbitai

coderabbitai Bot commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: d47e902b-39cf-4482-935d-be0c90869a89

📥 Commits

Reviewing files that changed from the base of the PR and between c8ee4c2 and 0f94dc8.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt
🚧 Files skipped from review as they are similar to previous changes (1)
  • tests/integration/test_lists/waives.txt

Included review availability: Your plan includes up to 12 reviews per rolling hour; 10 remain after this review.


Walkthrough

The change adds five skipped integration-test entries for DeepSeek R1 accuracy tests and disaggregated stress tests covering DeepSeek R1 V2, GPT-OSS 120B, and Qwen3.5 4B.

Changes

Integration test waivers

Layer / File(s) Summary
Platform-specific test skips
tests/integration/test_lists/waives.txt
Adds two DeepSeek R1 LongBench V2 accuracy-test skips and three disaggregated stress-test skips. The entries reference nvbugs/6621358 and nvbugs/6621362.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: ⚪ Minimal · up to 0f94d

This change only waives five specified QA CI cases on main; no actionable merge-blocking risk remains beyond normal review and checks.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title follows the repository format and clearly states that five failed QA CI cases are waived on main.
Description check ✅ Passed The description explains the purpose, target branch, bug references, and all five waived test entries with clear skip reasons.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv

Copy link
Copy Markdown
Collaborator

/bot skip --comment "only waive tests"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #66687 [ skip ] triggered by Bot. Commit: c8ee4c2 Link to invocation

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #66687 [ skip ] completed with state SUCCESS. Commit: c8ee4c2
Release Check Pipeline #4835 failed

Link to invocation

@xinhe-nv

Copy link
Copy Markdown
Collaborator

/bot skip --comment "only waive tests"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #66704 [ skip ] triggered by Bot. Commit: cda9655 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #66704 [ skip ] completed with state SUCCESS. Commit: cda9655
Skipping testing for commit cda9655

Link to invocation

@xinhe-nv
xinhe-nv merged commit e8965de into NVIDIA:main Aug 17, 2026
7 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260817-065552 branch August 17, 2026 09:12
xinhe-nv pushed a commit to xinhe-nv/TensorRT-LLM that referenced this pull request Aug 17, 2026
Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
Signed-off-by: Xin He (SW-GPU) <200704525+xinhe-nv@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants