Roland Clobus <
rclobus@rclobus.nl> writes:
Hello Debian-cd Team and Phil,
Now that the busy period for releasing Debian 12.1 is over and some of
the live images have been verified by openQA (via me), would it make
sense to think about automating the tests for the officially released
Debian images, and the weekly builds as well?
My thoughts/ramblings:
* As soon as an image has been generated, and it has been made
accessible via an URL, openQA will be invoked and starts to download and test the image (i.e. the generator will trigger openQA instead of openQA polling)
** Phil will be able to generate API keys for openQA
In fact I think anyone can do that (having logged in, using salsa) but
of course I'm very happy to do it.
** I've already implemented a similar setup on Jenkins [1] for the live images [6]
** Phil has already implemented a similar setup for the netinst images, using polling [2]
I beleive this implements openqa-cli triggering as part of image creation:
https://salsa.debian.org/images-team/setup/-/merge_requests/4
but it needs testing (hence the WIP).
* By testing on virtualised hardware, at least many of the manual,
tediously repeating tests can be verified to work correctly, which could make the tests on real hardware faster, because less needs to be tested
* Automated tests would automatically see e.g. kernel mismatches in the installer [3]
** However, for the live images (based on testing and unstable) I've implemented an automatic kernel selection, which saves additional maintenance [4]
* The automated tests will show issues earlier, but that would require regular monitoring/dashboarding
** I've tried to tags the issues that I've reported [5]
* For the medium to long term, would it make sense to shift these test
from debian.net machines to debian.org machines?
** The workload on osuosl3-amd64.d.n is already rather high
It would be good to have more workers.
I'm assuming that one way of doing that would be to spin up cloud
instances, but my tentative attempts to work out how that's done have
not yet bourn fruit (one issue is that the worker needs to be able to
run kvm, which given that one's cloud instance is already a VM needs
nested VMs, which seems problematic)
I recently had a machine at Equinix for testing arm64 workers, which
worked really well, but which I relised after starting it up was going
to be rather expensive (their arm64 offer being Ampere Altra Q80-30's
which have 80 cores, and cost $2.50 an hour).
We've since tried a VM on altra.d.n, which allowed me to learn that its
CPU (Neoverse-N1) is not quite new enough to do nested VMs (it looks
like a Neoverse-N2 based thing ought to work, judging from comments in
the related kernel patches)
Running the workers on altra itself seems like it ought to be an option,
but my kids are currently off school keeping me busy, so I've not been
pushing that yet.
So, if anyone has ideas for getting nested-VM-capable cloud stuff
working (or just more amd64 hosting) or getting arm64 resources that
would do the trick (or e.g. riscv machines I could play on), I'm very interested, becuase the current workers are only just keeping up, so
adding more jobs at present is going to be frustrating.
Cheers, Phil.
--
Philip Hands --
https://hands.com/~phil
--=-=-Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEE3/FBWs4yJ/zyBwfW0EujoAEl1cAFAmTCBCIACgkQ0EujoAEl 1cBWARAAgHWsJX2Asfgd106R3vtjEnEbhsNymbGqNHvSQ44cYkH19eviH8E9Jtcd 0vrif6WTZxawEXTuEQh/yGy3pQibtoU7gNXevJcOIhiVCloCKN7DKm3o5TV95zz+ bFC1YaS0JdOFPh2pqyNsAH6hsGKT9F7W50+LYTHCVJp2/OVpDxjjELeYYhwDD2dl QmYABmPBcAQDff51MZ3RURPXkS0H6sNkGxwpOl1jFwD06viG+maESsktiI9udWBv 9/xbZcfRsfiH2PNndBZo0d5Vkga+et/B/Fw6nx70HleR3XU2jFIUChu3YVUQ2czs S+HTelEmzW0S28WhDCsDH7M2Puqh+PNzjPCF/Zmp61Wc5ccnxmYkB9YQkZBn9jGP ghYJgpojGO+PdNEba0ss6w6r0k1vA/mViyNmnmBS5CXLKhgEC8I95c6aBieNWPjw fPnUr480CU2NGvjinpnW2GO65aWiMCkBqmvdVhvv7MVHXc1jw70KXqZBGfVM+HFU 8+Tw/IaZYTgu20MmWG5d05OIkTiUj8/aUOP2x+jn2yK5RZT6rqXsYUWyv/4iWjVI Tbh3BDZpbW2O/bLnwnWvgP3muicy9BlzvRjGmVDK/B6mfSg3iZ4TyA5WlC3fRxEz 4ByPVXskuzWuTYe+cqigIChq2ccgPZjYVpTP5Fc5mny/6izmt/4=isyW
-----END PGP SIGNATURE-----
--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gatewa