• Moving firmware packages from non-free to non-free-firmware

    From Cyril Brulebois@21:1/5 to All on Tue Jan 17 21:50:01 2023
    Hi folks,

    First off: sorry I haven't been able to work on this sooner. For some
    context, you can check the notes for the meeting I had with Steve
    after the GR result was published:
    https://lists.debian.org/debian-boot/2022/10/msg00044.html

    This mail is about moving packages from non-free to non-free-firmware,
    which will make it possible to install firmware packages (and configure
    apt to keep them up-to-date) from non-free-firmware without enabling
    non-free as a whole.

    For this first round, I've checked on amd64/unstable which packages
    ship files under /lib/firmware, then excluded some of them, and worked
    on the rest. (I'll need to check other archs for possible arch-specific firmware packages, but I must confess our current thinking is making
    the random joe/jane user experience on x86 systems as easy as possible,
    then care about less obvious targets later.)

    So far I've excluded:
    - libfishcamp1 and libsbig4 since those are library packages that
    also happen to ship some hexdumps; I don't think they would qualify
    for non-free-firmware (maybe if the hexdumps would be split out in
    their own packages, but I'm not sure that's worth it).
    - firmware-nvidia-gsp, firmware-nvidia-tesla-gsp, and
    nvidia-tesla-470-kernel-support, from nvidia-graphics-drivers*
    source packages; it's been a while since my X days, but I don't
    think firmware packages would be useful on their own, one would
    need to install/build X drivers from non-free as well?

    (but maintainers are in copy anyway, just in case I missed something.)

    The remaining source packages:
    - amd64-microcode
    - atmel-firmware
    - bluez-firmware
    - dahdi-firmware
    - firmware-ast
    - firmware-nonfree
    - firmware-sof
    - intel-microcode
    - rtl8723bt-firmware
    - zd1211-firmware

    I've filed merge requests on Salsa for 8 of them, and bug reports for
    the remaining 2 (hosted on an external cgit for one, no VCS for the
    other).

    I'd be happy for maintainers to tell me whether the merge requests are sufficient, or whether they'd like bug reports filed as well. I'm happy
    to take care of uploading and pushing commits/tags to the repository if
    that helps getting packages quicker (in which case, just make sure to
    grant “kibi” push access).

    I also plan on getting in touch with ftpmaster to get the whole lot
    reviewed in a timely manner, and overrides adjusted.

    Please let us know if you have any questions.

    Thanks for your help!


    Merge requests:
    - amd64-microcode:
    https://salsa.debian.org/hmh/amd64-microcode/-/merge_requests/3
    - atmel-firmware:
    https://salsa.debian.org/rfinnie/atmel-firmware-pkg-debian/-/merge_requests/1
    - bluez-firmware:
    https://salsa.debian.org/bluetooth-team/bluez-firmware/-/merge_requests/3
    - dahdi-firmware:
    https://salsa.debian.org/pkg-voip-team/dahdi-firmware/-/merge_requests/2
    - firmware-nonfree:
    https://salsa.debian.org/kernel-team/firmware-nonfree/-/merge_requests/48
    - firmware-sof:
    https://salsa.debian.org/mpearson/firmware-sof/-/merge_requests/6
    - intel-microcode:
    https://salsa.debian.org/hmh/intel-microcode/-/merge_requests/2
    - zd1211-firmware:
    https://salsa.debian.org/debian/zd1211-firmware/-/merge_requests/1

    Bug reports:
    - firmware-ast:
    https://bugs.debian.org/1029110
    - rtl8723bt-firmware
    https://bugs.debian.org/1029111


    Cheers,
    --
    Cyril Brulebois (kibi@debian.org) <https://debamax.com/>
    D-I release manager -- Release team member -- Freelance Consultant

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPHCb8ACgkQ/5FK8MKz VSBbbA//ZuxLfVt15l8rNxflTw4V61+W2f+0unHGY7VclXml2ujwmOetOc4TZdV+ X/SvPJETQ2HknlD95hy7o/VOUvPk0xQLWXHKvoD6exooDLYZ3G7MushFs83TYkgc Yhw/KBQCnFnbK9EudDNAUYjrzLY8AvnQmlSTaVEC9UNWzxOENhQGc60RrcW/X687 gj5pxIQ7JHbT6oje1j0Zv3tT+EmnqWogOUulx8lJWjSft3BA0OkooliK2Kc+kW4W 5orOp9o6XuPOozh08CJc/kldY51EmvbZzK63j4nqi7YqvOievbQg6lvosNtKQlF6 vkcOiPQyDShkog58M3qAsclo/uOkRw6V4rLkhvd/XnuAmDOmT9LmvZz1XuaRAOUn 6CrZR08tWWuFJTpK3MfvRSFMekvu7tFkX8E+ZGI4vnqc8r8RXeLvrSrJWW4qL/Tk rFfjaAs4tZ/fwXG3+iDWIKjTdxOhFzNX+sON9w3Pq6tCuOCh/85TY1XqV5XR+91E hThcsgZGh/Hxt8QO1uoGPbH2AEddi5Hg5kvGIQ9dPmYoX5zPnfH4QOE6Uu/w2US/ kCzLMw8PcIl+9y9XcSt8WR4QBHEefyD1SCw+zG2/KiSU19J+7p9X1N19RdpMEVd0 LrCMioesFVqHV2jrd0EgI9PfJs8tFvpDBKTBZLeRwOFPajY7zM4=
    =Y6Wk
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    *
  • From Ryan Finnie@21:1/5 to Cyril Brulebois on Wed Jan 18 02:50:01 2023
    To: debian-boot@lists.debian.org

    This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------2wYvUG9KshB1vkvJti4v4PqO
    Content-Type: text/plain; charset=UTF-8
    Content-Transfer-Encoding: quoted-printable

    On 1/17/23 12:49 PM, Cyril Brulebois wrote:
    - atmel-firmware:
    https://salsa.debian.org/rfinnie/atmel-firmware-pkg-debian/-/merge_requests/1

    This has been merged, thank you. However, I have a few bootstrap
    problems getting this uploaded, namely it's REJECTED:

    ACL dm: NEW uploads are not allowed

    binary:atmel-firmware is NEW.
    binary:atmel-firmware is NEW.
    source:atmel-firmware is NEW.

    This is likely because I am a DM and not a full DD, even though I have
    full rights to the atmel-firmware package[0].

    I'd upload it to mentors.debian.net, but that site only accepts
    source-only uploads, while paradoxically ftp-master does not accept
    source-only non-free uploads.

    So, I've thrown it in my personal stuff directory :) https://www.finnie.org/stuff/atmel-firmware/

    If someone could review and sponsor this upload, I'd appreciate it.

    [0] https://ftp-master.debian.org/dm.txt

    --------------2wYvUG9KshB1vkvJti4v4PqO--

    -----BEGIN PGP SIGNATURE-----

    wsF5BAABCAAjFiEEQuLI3owXOrEC9SxufmCjpoaujZgFAmPHTMEFAwAAAAAACgkQfmCjpoaujZgS ghAAjbgYu32BWAT+ASc0rtMfkio/fVbIXosCiNJtu5iNssvlgL6+VoNQl89N3emYxcW7XuW53HBW kzOHRwXXfyHrlxH9cNYLyr8iOh1ycEWG5tN7+t0paKPUOEMn7GOuGnkIMiQBOzLT02MnDnJbKB0A MHABndjQUZNC8b9cATYXkIdnJZfrg24nRLChz17CKHbyw0z9FkNGWh6uKw1DWtHTbBUAo+felAyw DOiQE6ZT0Oe1dI5R1/MNqG6GIy8aQ8XiRN5u2EIDrb+5rSfGkX5hgpMIGeUExVWe7iHbVgqIWeXE e5aosFiIPvYXg25U7VBFsP+SAk9QBBcR9mwWoqjxOHVoiDth3cqAvARqw65w3CeEyPTAZGew6cMm r7YP5k/un09Q8tz4KwkHd1ANN58yI3w0bFqO1rBWkV4oJxEyhjJ3LwK3fNVNF+R71a7vdUZfqFIr DnhAf0lxDJNesvvG6FKTdUAZsdl/4Z6bV+WPBnroyjVe33zrPhdw/M5IkU5NQ5MB1LiSm1KogTOD 3pj2JUawZwanBabEnofhAfJQO0ebvTdiBSwHpM4bw2G7QZGav9hOMa+0n9AQxXq+atgEWfSGUJHs ajO+0G5CyIw/ey19N7plur9KctrZoCPJsLL6txkT/Xv9mc8pP2WWdmBv5ZTOfEZhFnNTnZPXhxql TB8=
    =lkH+
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Daniel Baumann@21:1/5 to Cyril Brulebois on Wed Jan 18 06:50:02 2023
    Hi Cyril

    On 1/17/23 21:49, Cyril Brulebois wrote:
    - firmware-ast:
    https://bugs.debian.org/1029110

    thanks, applied and uploaded.

    Regards,
    Daniel

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andreas Beckmann@21:1/5 to Cyril Brulebois on Wed Jan 18 10:30:01 2023
    On 17/01/2023 21.49, Cyril Brulebois wrote:
    - firmware-nvidia-gsp, firmware-nvidia-tesla-gsp, and
    nvidia-tesla-470-kernel-support, from nvidia-graphics-drivers*
    source packages; it's been a while since my X days, but I don't
    think firmware packages would be useful on their own, one would
    need to install/build X drivers from non-free as well?

    Even with the open source nvidia kernel module (src:nvidia-open-gpu-kernel-modules in contrib) the gsp firmware is
    (currently) only useful with nvidia driver components from non-free, so
    there is no point in moving the firmware to non-free-firmware.
    In case nouveau is going to use the gsp firmware at some point (as Luca mentioned), it will probably have different version constraints than the proprietary driver and will likely require separate packages (which
    could be in non-free-firmware).


    Andreas

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Cyril Brulebois@21:1/5 to All on Wed Jan 18 13:30:01 2023
    Hi Ryan,

    Ryan Finnie <ryan@finnie.org> (2023-01-17):
    This is likely because I am a DM and not a full DD, even though I have
    full rights to the atmel-firmware package[0].

    Ah, right!

    I'd upload it to mentors.debian.net, but that site only accepts
    source-only uploads, while paradoxically ftp-master does not accept source-only non-free uploads.

    So, I've thrown it in my personal stuff directory :) https://www.finnie.org/stuff/atmel-firmware/

    Built & uploaded:

    Uploading to ftp-master (via ftp to ftp.upload.debian.org):
    Uploading atmel-firmware_1.3-7.dsc: done.
    Uploading atmel-firmware_1.3-7.debian.tar.xz: done.
    Uploading atmel-firmware_1.3-7_all.deb: done.
    Uploading atmel-firmware_1.3-7_amd64.buildinfo: done.
    Uploading atmel-firmware_1.3-7_amd64.changes: done.
    Successfully uploaded packages.

    Thanks for the swift answer!


    Cheers,
    --
    Cyril Brulebois (kibi@debian.org) <https://debamax.com/>
    D-I release manager -- Release team member -- Freelance Consultant

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPH49YACgkQ/5FK8MKz VSDWDw//V+h5lBIRwaiM0mmaW5BsQ5bECK+xTnu77Oj/ckfMkFTMzEB49zmFEwH+ j47FPbBcZxAbwwWLEgLotVl2Unu3dDseo9DFT2R/Olcx0qXQ2FS9bisv35UBczpf YBKk6jLIWIRmmGO7a8YJ5lNVVAbDpFnB08jq0zzEja3u/RPherKKHZ+Pugewyfo7 h2IS8iaToncAyjHcGTotKN+yMN5ae0i4VdDccRKJTihUD4KqVvbra+5FIahTKWs/ QvhLOk35Hfb1DsC2a5B5hHKhjoNies/93JZ4DLHs0a0bEM5fZR+C8b9TkbdtlS7b fQAOTvvS4LppgNq3+LH3mwsEC+KC+9H2Qug3DTJQK9ShB/bOPXEbvU4oNEOJfXtB k0cGLvcExhnB9COH1s4dFUmFGXMNFbZevS1AIZozoM+6j65Dn3mcHpwcQM3XazI6 3u3Gpc6CUyOdBG3Hzc6ZbfBG8LKcD5ybPnquB2bMNV2mSlmEAcyGYNobMaZa7j+C UjYfk1SUo2fCjNTKUd3I0LmPAzuOhIJkJ0bUuQCax6qDnLUqknfUQ2Fs0Fa7hNJa wwc0gnLkQLxRbPZn2KBwLCrmeRe6oVNt5eB9KhipI0WLBavTh/jbPR54FCjT30GJ nP70DJnVGmTVNMaBL/T0XCLv3Amxb1AElLt/RttupMMPB00eWMI=
    =CLDQ
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    *
  • From Cyril Brulebois@21:1/5 to All on Sat Jan 28 06:10:01 2023
    Hi,

    Here's an update regarding firmware packages vs. non-free-firmware. I'm extending the list of recipients a little; feel free to let me know if
    you spot packages/teams that I would have missed!

    Cyril Brulebois <kibi@debian.org> (2023-01-17):
    For this first round, I've checked on amd64/unstable which packages
    ship files under /lib/firmware, then excluded some of them, and worked
    on the rest. (I'll need to check other archs for possible arch-specific firmware packages, but I must confess our current thinking is making
    the random joe/jane user experience on x86 systems as easy as possible,
    then care about less obvious targets later.)

    Different approach: downloading all non-free/binary-<ARCH>/Packages,
    grepping for “firmware” or “microcode” in the package name, without filtering on package contents.

    - nvidia-tesla-470-kernel-support disappears, as it doesn't match the
    package name pattern I selected, even if it ships /lib/firmware/;
    - ixp4xx-microcode shows up, armel-only;
    - midisport-firmware shows up, as it matches the package name pattern,
    and didn't before because /usr/share/usb/maudio/ is where firmware
    files are shipped.

    To dot my i's and cross my t's, I iterated on non-free/Contents-<ARCH>,
    looked for lib/firmware, and I found no other packages.

    With some packages having moved to non-free-firmware migrating to testing, users or developers have started noticing packages seemingly disappearing
    from the archive. Thinking about the documentation aspect, I suppose it
    would make sense to have *all* firmware packages move to non-free-firmware which would be the place to find non-free firmware, regardless of the
    list of packages that we determined to be interesting for the installer
    (my initial mail).

    Efforts to do that aren't much bigger than what's going on already:
    - for debian-installer and debian-cd, that should only mean maintaining
    a little list of packages that we want to allow/block on installation
    images;
    - ixp4xx-microcode could probably be removed entirely (#1029814);
    - midisport-firmware now has a trivial MR:
    https://salsa.debian.org/multimedia-team/midisport-firmware/-/merge_requests/1

    So far I've excluded:
    - libfishcamp1 and libsbig4 since those are library packages that
    also happen to ship some hexdumps; I don't think they would qualify
    for non-free-firmware (maybe if the hexdumps would be split out in
    their own packages, but I'm not sure that's worth it).

    As long as library and firmware are shipped together, keeping packages
    in non-free is probably best.

    - firmware-nvidia-gsp, firmware-nvidia-tesla-gsp, and
    nvidia-tesla-470-kernel-support, from nvidia-graphics-drivers*
    source packages; it's been a while since my X days, but I don't
    think firmware packages would be useful on their own, one would
    need to install/build X drivers from non-free as well?

    Regardless of the discussion below my initial mail, those packages can
    move to non-free-firmware just like all the others.

    Current state for the initial list of packages:
    - amd64-microcode
    - intel-microcode (and iucode-tool)

    No changes. Those are not a blocker for the next d-i release though. See #1029804 for a discussion about whether to install them automatically once
    we have them there.

    - atmel-firmware
    - firmware-ast
    - firmware-sof
    - rtl8723bt-firmware

    Moved to non-free-firmware, and migrated to testing.

    Thank you, maintainers!

    - bluez-firmware
    - dahdi-firmware
    - firmware-nonfree

    I've uploaded those a few hours ago, currently in NEW. firmware-nonfree
    is a blocker for the next d-i release.

    - zd1211-firmware

    This one looks like a weird state, I've added some comments in the MR:
    https://salsa.debian.org/debian/zd1211-firmware/-/merge_requests/1

    I don't plan on uploading it without learning more about it; I won't
    consider it a blocker for the next d-i release.


    Cheers,
    --
    Cyril Brulebois (kibi@debian.org) <https://debamax.com/>
    D-I release manager -- Release team member -- Freelance Consultant

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPUrGEACgkQ/5FK8MKz VSCdlQ/7BJSOUZegFRhsPAn32onUSq2tjYX6kioJSH1vW8BfFoT9F5RXe0nDdBsw njZZazC71rvF4vhdcJdRezhDLXTqi4Gsk6PN6ukCSrsgxledrdNuljCpYziFQZyn GHJ2FGKydfAU52WR7lq7WCt3/RrPlSv+JT2j0pe1wT8GZYuqdG9n5zd4zWgWcpIN Zyyid5pH2KhJVEOicjRqa8lVcfS9xIHPmVV8ePu5rOu2vsvXDPEqktXnyuR0GbeE 93jzP9LfvTZx8UVCJe7AtXnDs6jgEJ9gXOxioH86PuubQ+qFmVLfpRXQ8zxjDgPQ Q3XRpnyptf+Zrfkf3BzhhB17+pkNQF3Ga4p3W01cI6FFBi9O8OJZB23sKV/a2adQ IOzhbgPjzkcD8ea9ymEabGv717YkopP4OQxu81S6KRXLgLptQ8EsTBNu7pEi1zpP tP65fQMywtlgWrJF7tQuR9ONX923R7DjEtwbtTqJW9sQAdl5q5DIjLoRo6/62zsd dG9Y6T+vOTBR6y8ekGMRHqDkIYgru9hEcQi23uBlSWpjDHP2dxOEwn2TDD9aGixv /W1Ia80h1pplInB7rgJpUFq+Aa+LI1NCm+UXI40L/7HREwG/vGh+sJ/m5wNdqQY2 6flTN9yzJOt7FrvpTZkz1A7xU32zHrXVSTjjGDcTyxejnsgIlg8=
    =R7Pl
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    *