Skip to content

Conversation

@nirs
Copy link
Member

@nirs nirs commented Nov 25, 2024

Split CI to multiple workflow so we can run qemu and lima integration tests
without conflicts on all platforms.

  • build: build on multiple version of macOS
  • lima: lima integration tests
  • qemu: lima integration tests
  • release: already exist

Try to run integration tests on all platforms to see what works now. We
probably want to minimize the number of platform since the macOS runners
are very flaky.

The lima workflow is flaky. Sometimes all 3 platforms succeed, but
usually one gets stuck and cancelled after many minutes.

Notes:

  • Workflow names unified to Title case. This is more consistent with
    github UI and standard workflow names.

Workarounds:

  • on macos-15-large brew is not updated and get lima 0.23.2. Fixed by
    running brew update.

@nirs nirs force-pushed the simpler-ci branch 3 times, most recently from e3afd13 to 235ebb5 Compare November 25, 2024 22:44
nirs added 2 commits November 26, 2024 00:53
Adding or removing a version should be one line change now.

Signed-off-by: Nir Soffer <[email protected]>
@nirs nirs marked this pull request as ready for review November 25, 2024 23:09
@nirs nirs changed the title WIP: Simplify CI Simplify CI Nov 25, 2024
@nirs nirs force-pushed the simpler-ci branch 2 times, most recently from 08224ba to 6b187d3 Compare November 25, 2024 23:43
@nirs nirs marked this pull request as draft November 25, 2024 23:43
@nirs
Copy link
Member Author

nirs commented Nov 25, 2024

Moving to draft to test standard qemu

@nirs nirs force-pushed the simpler-ci branch 4 times, most recently from aa8cd34 to 011767b Compare November 26, 2024 00:20
with:
fetch-depth: 1
- name: Build
run: make
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make test.repro should be tested

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I copied it from #63. You want to replace with make with make test.repro?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The release workflow run make test.repro why test it here again? If we want to test this on all architectures we can add more platforms to the release matrix.

# Apache License 2.0

name: Release
name: release
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For consistency with other names.

@nirs nirs force-pushed the simpler-ci branch 2 times, most recently from cd30669 to 4a88de7 Compare November 26, 2024 00:25
platform:
- macos-13-large
- macos-14-large
- macos-15-large
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

QEMU test is quite lightweight and should be executable on ARM Mac with QEMU TCG mode

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, you can just merge qemu.yaml to build.yaml

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can switch to arm, but I don't want to mix integration tests with trivial build. This test is likely to break in the future and will requires workaround, lets keep it separate.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated to run with arm64 machines, kept as separate workflow for easier future maintainance.

@nirs nirs force-pushed the simpler-ci branch 2 times, most recently from 6e151b7 to 56628c7 Compare November 26, 2024 00:48
@nirs nirs marked this pull request as ready for review November 26, 2024 00:56
@nirs nirs force-pushed the simpler-ci branch 2 times, most recently from 43cdc25 to 0aa2fa7 Compare November 26, 2024 01:20
- build: build on multiple version of macOS
- lima: lima integration tests
- qemu: lima integration tests
- release: already exist

Try to run integration tests on all platforms to see what works now.  We
probably want to minimize the number of platform since the macOS runners
are very flaky.

The lima workflow is flaky. Sometimes all 3 platforms succeed, but
usually one gets stuck and cancelled after many minutes.

Notes:
- Workflow names unified to Title case. This is more consistent with
  github UI and standard workflow names.

Workarounds:
- on macos-15-large brew is not updated and get lima 0.23.2. Fixed by
  running brew update.

Signed-off-by: Nir Soffer <[email protected]>
It works now on macos-{13,14,15} in both standard and large runners.
This job is very quick so we run it on the standard runners.

Signed-off-by: Nir Soffer <[email protected]>
@nirs nirs added this to the v1.2.0 milestone Nov 26, 2024
Copy link
Member

@AkihiroSuda AkihiroSuda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

@AkihiroSuda AkihiroSuda merged commit 117bee8 into lima-vm:master Nov 26, 2024
11 checks passed
@nirs nirs deleted the simpler-ci branch January 19, 2025 17:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants