Skip to content

Record a failing @test_logs as a failure instead of erroring - #64

Merged
JamesWrigley merged 3 commits into
JuliaTesting:masterfrom
JohnCobbler:fix/50-record-logtestfailure
Sep 11, 2026
Merged

JamesWrigley merged 3 commits into
JuliaTesting:masterfrom
JohnCobbler:fix/50-record-logtestfailure

Conversation

@JohnCobbler

Copy link
Copy Markdown
Contributor

A failing @test_logs produces a Test.LogTestFailure, which is not a
Fail/Error/Broken, so ReTestSet had no record method for it and the
failure threw a MethodError instead of being reported.

Convert LogTestFailure to Fail in record, matching
Test.DefaultTestSet, so it is counted and printed like any other failure.

Adds a unit test on record/anyfailed/get_test_counts, and an integration
module whose failing @test_logs causes retest to throw TestSetException
(not MethodError).

Fixes #50

JohnCobbler and others added 2 commits September 11, 2026 23:08
A failing @test_logs produces a Test.LogTestFailure, which is not a
Fail/Error/Broken, so ReTestSet has no record method for it and the failure
throws a MethodError instead of being reported. Convert it to a Fail in
record, as Test.DefaultTestSet does, so it is counted and printed like any
other failure.
@JamesWrigley
JamesWrigley force-pushed the fix/50-record-logtestfailure branch 2 times, most recently from d776f0c to 1000d3e Compare September 11, 2026 21:10
@JamesWrigley
JamesWrigley force-pushed the fix/50-record-logtestfailure branch from 1000d3e to 75046bd Compare September 11, 2026 21:11
@JamesWrigley

JamesWrigley commented Sep 11, 2026 •

Copy link
Copy Markdown
Member

Thanks, and sorry for taking so long to get to this. I took the liberty of cleaning up the code a little and fixing some unrelated failures.

@JamesWrigley
JamesWrigley merged commit 58fb97e into JuliaTesting:master Sep 11, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

failing @test_logs hits method error for record

2 participants