• RFH: Packaging Intel's userspace tools for Data Streaming Accelerator

    From Gunnar Wolf@21:1/5 to All on Fri Oct 21 20:00:01 2022
    Hi all,

    I was recently approached by Intel engineers Miguel and Jair (Cc:ed on
    this mail). They asked for my help in getting Debian Bookworm and
    higher to support the Data Streaming Accelerator, and we have
    exchanged a couple of messages about this. I'm reproducing next part
    of our conversation.

    The purpose of this mail is to help find interested people in Debian
    that can help review and sponsor uploads of the userspace tools; the kernel-side modules have been enabled as of bug #1021337 (thanks for
    the quick reply!)

    It is quite probable Miguel and Jair can be the package maintainers,
    and I'd be more than happy to welcome them in Debian, but they will
    surely need some guidance to get the package (for which the work is
    already started¹) in a state that can be uploaded to Debian. I've been
    meaning to start helping them, but am quite time-strained and have
    been unable to do so, so... anybody interested in getting this
    technology supported in our distribution will be a good candidate to
    help!

    ¹ The proposed debian/control file can be found at
    https://github.com/intel/idxd-config/blob/stable/debian/control

    I asked them for a description of Intel DSA. They say that:

    The driver enables the Data Streaming Accelerator or DSA
    capability for the 4th generation of the Intel Scalable Xeon
    processor family, with code name Sapphire Rapids, and for future
    Intel processors.

    As stated in the DSA specification (which can be found at

    https://software.intel.com/en-us/download/intel-data-streaming-accelerator-preliminary-architecture-specification

    ):

    Intel DSA is a high-performance data copy and transformation
    accelerator that will be integrated in future Intel® processors,
    targeted for optimizing streaming data movement and transformation
    operations common with applications for high-performance storage,
    networking, persistent memory, and various data processing
    applications.

    Intel DSA replaces Intel® QuickData Technology, which is a part of
    Intel® I/O Acceleration Technology.

    I was also pointed at this very clear blog post in Intel Open Source's
    space:

    https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator

    The userspace software is already available in Fedora / CentOS / RHEL
    under the name "accel-config" and "libaccel-config". They propose the
    following description:

    Utility for configuring the DSA subsystem

    Intel Accelerator Utilities (accel-config) provides a user
    interface to the Intel Data Streaming Accelerator (DSA). DSA is a
    high-performance data copy and transformation accelerator
    integrated into Intel Xeon processors. . This package contains a
    utility for configuring the DSA (Data Stream Accelerator)
    subsystem in the Linux kernel.

    The first processor family to support the capability is Intel's fourth generation of Scalable Xeon server processors, code-named Sapphire
    Rapids. Currently some SPR products are planned to be launched on 2022
    calendar week 42 and 2022 calendar week 45. High volume SPR processors
    have a planned launch window on 2023 calendar week 6 to 9 (Feb. 6,
    2023 to March 3, 2023).

    The document at https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator
    is a good introduction to the accelerator feature.

    From it, we can extract additional details about the accel-config
    tool's architecture and features:

    accel-config is a utility that allows system administrators to
    configure groups, work queues and engines. The utility parses the
    topology and capabilities exposed via sysfs and provides a command
    line interface to configure resources. Some of the capabilities of the accel-config are listed below:

    Display the device hierarchy.
    Configure attributes and provide access for kernel or applications.
    Use API library (libaccel) that applications can link to to perform operations through a standard ‘C’ library.
    Control devices to stop, start interfaces.
    Create VFIO mediated devices to expose virtual Intel® DSA instances
    to Guest OSes.

    So... Is anybody among debian-devel readers interested in helping
    Debian support this hardware feature? Extra points for people that
    _have_ the suitable hardware! (I don't)

    Greetings,

    -----BEGIN PGP SIGNATURE-----

    iHUEABYIAB0WIQRNFAUGU6QC1zaHBJ0kBMlUbhRTYAUCY1LbSgAKCRAkBMlUbhRT YKVNAP0SATuqR22840erqjgH9EXVKCg31DcJQFV8jLV/9n41kgD+NuQU16EWvT9p V2AUH3oJ9VpKpwCoStx2NtJJ1YjIagc=
    =Yspk
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From nick black@21:1/5 to All on Fri Oct 21 22:40:01 2022
    Gunnar Wolf left as an exercise for the reader:
    So... Is anybody among debian-devel readers interested in helping
    Debian support this hardware feature? Extra points for people that
    _have_ the suitable hardware! (I don't)

    my current professional plans include evaluating DSA and
    integrating it into my product if it proves itself, and this
    kind of thing is directly up my alley besides. i'm one of the
    newest DDs, but i'd be very happy to work with Jair and Miguel.

    --
    nick black -=- https://www.nick-black.com
    to make an apple pie from scratch,
    you need first invent a universe.

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEmi//dHmU4oe+xCLxX0NADCHL+swFAmNTAtwACgkQX0NADCHL +szXFhAAmCZaNC2M7k1crIViTCTXO5eAhADnAOnYvYhOL8VLGO14afdSVSe2CxyW eEvG0vJG/SsTzOVDSx6EH9npLnNckxMDCvSBsSaKxs3HTUvvEE9yLcaqi/AaGnQa EXWwrDc1YNrSr9ipY77yHDSrfJgpJo0v7mbqWqhq4hoP14Dm0VcFa/jmIXNgjWA9 3h7k1PdFTOhB7IppYNkVvMbIuIFHNpxrcEoDs/E6PD0jJEA03KgvwARRy+apgEG/ UuaJYO4vwlPBbi4hZ9pP5ON7pJY2p4IDsiUU3mXZK/r4z9N3DaxIU4S6jJROn5oj tFe6qFQZoy0rwrPdrRz108+gEZEDNv+J9VL1bNdK+Pz4iwXen+oIMaVq4xh80TXi WZXCoqzDjBDI4cC5MyPnmPyhKJsorxowzoD/LzyB3GBy6NxOkB4lkGwBKkWknQfx Pvahd+4wLsi30F+c+FWk8IJEk3P1v8nsMIfO3SmcP7eaYC7SoSCEHeNy4V7y+qIq /AlVyfw5xv8biu2ypplJ+oqJm2h3lLffu27rFeSU6t2HQgvKGsXnRAix6SkFsYHE ozdj6OZuVFaW27nQ2hDe93cO85G0cxXnReoasUbSw0azhzACq8ojGtNbKg63fuvJ MXjKtktYqq8Ndb6BQSrthUR67hjSoaWZy281IA3OXzH+57iRQ2c=
    =dkIG
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet G
  • From Paul Wise@21:1/5 to Gunnar Wolf on Sat Oct 22 04:30:01 2022
    On Fri, 2022-10-21 at 12:48 -0500, Gunnar Wolf wrote:

    The purpose of this mail is to help find interested people in Debian
    that can help review and sponsor uploads of the userspace tools; the kernel-side modules have been enabled as of bug #1021337 (thanks for
    the quick reply!)

    PS: once the userspace tools reach Debian, please add them here:

    https://wiki.debian.org/DebianKernel/UserspaceTools

    It is quite probable Miguel and Jair can be the package maintainers,
    and I'd be more than happy to welcome them in Debian, but they will
    surely need some guidance to get the package (for which the work is
    already started¹) in a state that can be uploaded to Debian.

    I think it is excellent that Intel employees are considering getting
    involved in Debian. Our usual docs for new maintainers are here:

    https://mentors.debian.net/intro-maintainers/

    The basic procedure is to make a new package, polish it up with
    lintian, piuparts, autopkgtest and other automated checking tools,
    upload it to the mentors site and file a request for sponsor (RFS).

    https://mentors.debian.net/sponsors/rfs-howto/

    The Debian glossary may help with any unfamiliar jargon:

    https://wiki.debian.org/Glossary

    In case Intel are interested in supporting Debian more generally we
    have some info on our website, inc about partnerships and sponsorship.

    https://www.debian.org/intro/help#organizations https://www.debconf.org/sponsors/
    https://www.debian.org/partners/

    --
    bye,
    pabs

    https://wiki.debian.org/PaulWise

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEYQsotVz8/kXqG1Y7MRa6Xp/6aaMFAmNTVCAACgkQMRa6Xp/6 aaOvgA/8CzpQNM4kgJVy9TPG/cWegBPpkRA6e8G9qlJb8l7NP3W4sqsNB0BrK8B1 xT4a9QYWQfLSkumEnTEAl4ihzPrHSoefmQSzimU2XPy6+P8JEnbo2G1ZIkpIj7fj 4XMPkP5iJ2q5L8i/31wgJYc59I1XW/goC5yAeS/RfU9xnKESUjtrXJbkFxuGAFlz MAiHqhGEEMjkoGrGtFF1z4m7Ib5L6A069hpQle4SdUHs2+TANvKeM3R0mUFSgcVP 6qNbY5VqYa2R/On20cEUBPKeA6Ddu9JIUGAl0/gC+miEtx4p9wpwrp3F3k5DGk9m G6S5l0LyMcnvzKobslOhmhOz52dSK7oUqG+D2mfxnx7oNKG01Xum2UNV1tyzx4nL rNkzfv3k53zAcSlmeQ6I0FOS+RgClAT0hrOk7U24BZsXshsrj9AyYXXU/hltUsRs t6Z7BpnuLUHFkDSEiNp/Igc3fByAiQ1WJcxDMjG5RuQCzeASso3ZEkb0q9yt+ZgV H4wD1uflhqlOZ/MSJc8Xpass7QG5I/+EU6tFMBl75EW4jDWRkhFQlVtmyL4XuTNc aRlgYcOgRzJ6GxQhJr8I146ElHZJq7myWEEk4kl/Qbiu86+dSnP++49DOGjHj4VG FMySZF97XHnpj43YGPD20df9ZJK15aGv5lgkWmPAoAatYO5FSvs=
    =l99h
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)