[high] uipath-agents: skill does not call out that Optimize has no CLI coverage

[mercer]

Summary

uipath-agents skill does not call out that Optimize has no CLI coverage. Agents using the skill burn turns probing for Optimize instead of stopping early with a clear no-CLI-coverage answer. Impact classification: degraded.

Severity reason

missing-command auto-elevation per references/contracts/severity.md

Customer impact

Agents using the skill burn turns probing for Optimize instead of stopping early with a clear no-CLI-coverage answer.

Reproduction

Missing-surface proof:

uip agent eval optimize --help
# Expected from skill: pre-emptive no-CLI-coverage warning
# Actual: agent searches help surfaces during scenario

CLI version: 1.0.0 @ 50917605

Verbatim output

No verbatim output block was recorded; enrich the parent gap before filing.

Expected behavior

(see Reproduction block — CLI to return actionable error with remediation)

Actual behavior

(see Verbatim evidence above)

Proposed fix location

• Bug location: skill docs (skills/uipath-agents/SKILL.md and references) [skills repo]
• Gap attribution: not evaluated in this scenario; see the parent gap evidence for the proven boundary.
• SDK method: not fully evaluated in this run
• Swagger path: not evaluated; agent and Studio Web surfaces are not in the harvested swagger set for this gap

Layer attribution

• Gap attribution: not evaluated in this scenario; see the parent gap evidence for the proven boundary.
• Bug location: skill docs (skills/uipath-agents/SKILL.md and references) [skills repo]
• SDK method: not fully evaluated in this run
• Swagger path: not evaluated; agent and Studio Web surfaces are not in the harvested swagger set for this gap

Layer table from gap

Layer	Status	Detail
CLI tool	proven boundary	The scenario evidence demonstrates a CLI-visible issue.
SDK/API	not primary from current evidence	Check during implementation only if the CLI fix requires it.
Skill	not primary	Skill changes can document or work around the behavior, but the fix target is the CLI.

Architecture convention

skills §2 - Skills teach the supported CLI path requires skills to tell agents when no CLI path exists.

Target architecture convention: use UiPath/cli main as the source of truth: https://github.com/UiPath/cli/blob/main/docs/reference/cli-contracts.md and https://github.com/UiPath/cli/blob/main/docs/development/architecture.md.

Evidence links

Evidence Card

• Gap: uipath-agents skill does not call out that Optimize has no CLI coverage
• Severity / impact: high / degraded
• Expected behavior: Avoid wasting turns searching for an Optimize command that the CLI does not expose.
• Failing command: uip agent eval optimize --help
• Scenario / mode: agent-eval-optimization / skills
• Source verdict: evidence://scenario_results_coverage_20260426_045336/agent-eval-optimization/skills/VERDICT.json
• Archive digest: 1da19584e267337dc85e56343afaf8b3c161e25921a31f1e2511b0ed9e4e119d
• Last observed: 2026-04-26
• Source verdict URL: https://github.com/UiPath/cli-scenarios/blob/43224e35593aa15e8a68e6502985f14aa5c09b45/runs/scenario_results_coverage_20260426_045336/agent-eval-optimization/raw/skills/VERDICT.json
• Observed result: Agent project "ScenarioTest_OptimizeBot" created with a system prompt for ticket triage classification
• Observed evidence: agent-eval-optimization/raw/skills/agent-output.json
• Transcript: evidence://scenario_results_coverage_20260426_045336/agent-eval-optimization/skills/bash-transcript.md
• Transcript URL: https://github.com/UiPath/cli-scenarios/blob/43224e35593aa15e8a68e6502985f14aa5c09b45/runs/scenario_results_coverage_20260426_045336/agent-eval-optimization/raw/skills/bash-transcript.md
• Agent output: evidence://scenario_results_coverage_20260426_045336/agent-eval-optimization/skills/agent-output.json
• Agent output URL: https://github.com/UiPath/cli-scenarios/blob/43224e35593aa15e8a68e6502985f14aa5c09b45/runs/scenario_results_coverage_20260426_045336/agent-eval-optimization/raw/skills/agent-output.json
• Issue: not filed
• PR: none
• Eval: evals/skills/uipath-agents/optimize-no-cli-coverage-callout.yaml

UserVoice reproduction relationship

• Classification: verification-blocker
• Summary: The run could not complete the exact UserVoice reproduction because a CLI/skill coverage gap blocked the workflow before the original symptom could be verified.

Environment/setup distinction

• No environment-not-seeded stop was part of the filed evidence.

Source feedback

• none recorded

Cross-references

• Parent gap in cli-scenarios: gaps/skills/uipath-agents/missing-command/optimize-no-cli-coverage-callout.md
• Sibling gaps:
• gaps/cli/common/ux/help-all-lazy-tools-incomplete.md
• Related issues:
• none recorded
• Related PRs:
• none recorded

Metadata

• Filed via: make fire-tickets-from-plan --priority P2
• Source repo: https://github.com/UiPath/cli-scenarios