-
Notifications
You must be signed in to change notification settings - Fork 34
Show extra info for Skipped (include XFailed) cases #2372
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
0306396 to
1ea2e30
Compare
85644f0 to
6895359
Compare
11ea0c5 to
dca47fb
Compare
Signed-off-by: Albin Sun <[email protected]>
dca47fb to
a972aa9
Compare
lanfon72
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In general LGTM
| reason.format(cluster_version=cluster_ver, versions=versions) | ||
| reason.format( | ||
| cluster_version=cluster_ver, | ||
| condition=cond_str.get(cond, str(cond)), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We didn’t restrict the condition parameter to only any or all; instead, we allowed any callable function. As a result, it may fail if a user provides other callable functions.
To prevent this, we can simply use callable.__name__ to retrieve the condition name, which also eliminates the need to maintain a mapping table.
| delete_image(api_client, exported_image_id, wait_timeout) | ||
|
|
||
| @pytest.mark.skip_version_if( | ||
| ">= v1.7.0", "< v1.9.0", reason="https://github.com/harvester/harvester/issues/9515") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
#9515 has been rescheduled to v1.9.0.
I would suggest to add regression in reason and not limit the before version, then when then issue be fixed, we can use the keyword to search and update the skip restriction.
And it would be helpful that add the test case path when filing the regression issue. (cc @asc5543)
Which issue(s) this PR fixes:
Issue #2373
What this PR does / why we need it:
pytest.mark.skip_version_*marks to the more explicitpytest.mark.skip_version_if.skip_version_if()if the milestone is decided. For those still inPlanning, may usexfail(expected fail) temporarily.Special notes for your reviewer:
For known issue to leverage this enhancement, skip
reasonshould contain URL.Additional documentation or context
Verification (

harvester-install-and-test#9)