intrinsic-test: run by default #159011
Conversation
|
|
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
|
You'll have to rebless bootstrap tests, IIRC it was just |
|
@Kobzol locally running |
This comment has been minimized.
This comment has been minimized.
| /// and a Rust Cargo workspace. Then runs `cargo test` on that workspace | ||
| /// which compiles both versions and compares their outputs on random inputs. | ||
| #[derive(Debug, Clone, PartialEq, Eq, Hash)] | ||
| pub struct IntrinsicTest { |
There was a problem hiding this comment.
Let's add a comment here that explains the required dependencies on the various OSes. For now, we should say that on x64, it requires a recent GCC (>15?), and the SDE emulator to run.
| cmd.arg("--skip").arg(skip); | ||
| } | ||
| cmd.arg("--sample-percentage").arg("10"); | ||
| cmd.arg("--sample-percentage").arg("100"); |
There was a problem hiding this comment.
Let's do this in a separate PR, it seems that the tests are a lot slower with this sample rate.
There was a problem hiding this comment.
Ok, makes sense . Thank you!
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
| run.path("library/stdarch/crates/intrinsic-test") | ||
| } | ||
|
|
||
| fn is_default_step(_builder: &Builder<'_>) -> bool { |
There was a problem hiding this comment.
Please also move test::IntrinsicTest to the very end in get_step_descriptions.
|
This PR modifies If appropriate, please update |
b0d38e6 to
86af606
Compare
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
86af606 to
17eccd1
Compare
This comment has been minimized.
This comment has been minimized.
17eccd1 to
ad29218
Compare
This comment has been minimized.
This comment has been minimized.
| pub change_id: Option<ChangeId>, | ||
| pub bypass_bootstrap_lock: bool, | ||
| pub ccache: Option<String>, | ||
| pub sde: Option<PathBuf>, |
There was a problem hiding this comment.
Please also add a Info level entry to change_tracker.rs, notifying users of this new config option, introduced in #159011. Thanks!
| .config | ||
| .paths | ||
| .iter() | ||
| .any(|p| p.to_string_lossy().contains("intrinsic-test")); |
There was a problem hiding this comment.
I think that we can do an exact match, because should_run will be changed to the intrinsic-test alias anyway.
I would also prefer if the build SDE presence and the explicit path checking was moved to make_run, since we already check the targets there.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
|
Warning If you are changing how CI LLVM is built or linked, make sure to bump cc @jieyouxu |
|
@Kobzol I'm a bit confused here different CI jobs (x86_64 , aarch64) seem to want different edits to the same snapshot, so blessing for one breaks the other. Could you help point me the right way? Thanks! |
This comment has been minimized.
This comment has been minimized.
|
Ah, this is annoying, the test machinery on non-x64/aarch64 Linux skips the test altogether, so it changes the diff. And we cannot just easily pin a specific target in tests, because then some of the steps will fail. Ok, sorry, I will have to revert one of my previous advices. Let's move the check for x64/aarch64 from fn run(self, builder: &Builder<'_>) {
let host = self.host;
if !host.contains("aarch64-unknown-linux") && !host.contains("x86_64-unknown-linux") {
builder.info(&format!("Skipping intrinsic-test, as it is not available for {host}"));
return;
}You can run the tests locally using |
|
Hmm ok, got it . Thank you! |
77b5bf8 to
235647f
Compare
|
This PR was rebased onto a different main commit. Here's a range-diff highlighting what actually changed. Rebasing is a normal part of keeping PRs up to date, so no action is needed—this note is just to help reviewers. |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
@Kobzol Applied the change and |
|
The target check still seems to be in |
This comment has been minimized.
This comment has been minimized.
|
Ah, I see what is the issue now. The test step is not represented in the blessed output at all. We are looking at the build step of the |
|
OK, Thank you! |
|
@bors squash msg="Run intrinsic-test bootstrap step by default" |
This comment has been minimized.
This comment has been minimized.
Co-authored-by: Jakub Beránek <berykubik@gmail.com>
|
🔨 15 commits were squashed into c19d4a0. |
13ce81d to
c19d4a0
Compare
|
Let's try again :) @bors r+ |
This comment has been minimized.
This comment has been minimized.
What is this?This is an experimental post-merge analysis report that shows differences in test outcomes between the merged PR and its parent PR.Comparing 390279b (parent) -> 165cce8 (this PR) Test differencesShow 4 test diffs4 doctest diffs were found. These are ignored, as they are noisy. Test dashboardRun cargo run --manifest-path src/ci/citool/Cargo.toml -- \
test-dashboard 165cce8d820b229af8f6a8226cf0b910b57600ff --output-dir test-dashboardAnd then open Job duration changes
How to interpret the job duration changes?Job durations can vary a lot, based on the actual runner instance |
|
Finished benchmarking commit (165cce8): comparison URL. Overall result: no relevant changes - no action needed@rustbot label: -perf-regression Instruction countThis perf run didn't have relevant results for this metric. Max RSS (memory usage)Results (primary 5.1%, secondary 2.8%)A less reliable metric. May be of interest, but not used to determine the overall result above.
CyclesResults (secondary 3.9%)A less reliable metric. May be of interest, but not used to determine the overall result above.
Binary sizeThis perf run didn't have relevant results for this metric. Bootstrap: 486.724s -> 485.902s (-0.17%) |
View all comments
This PR makes
intrinsic-testrun by default inx testand raise sample-percentage to100.r? @Kobzol