• Re: DEP-11 metadata for non-free-firmware?

    From Cyril Brulebois@21:1/5 to All on Mon Jan 23 17:50:01 2023
    Hi again,

    Cyril Brulebois <[email protected]> (2023-01-19):
    Sorry for the noise. I missed there were several rsync calls on the
    dak side, and at least dak needs patching…

    https://salsa.debian.org/ftp-team/dak/-/merge_requests/267

    This was merged and works fine for sid, but for some reason, we're
    missing files for bookworm. Configuration changes from earlier this
    month look good though (/srv/appstream.debian.org):

    - Add the non-free-firmware archive component
    - Retire buster & stretch, add non-free-firmware processing for dev suites

    (in passing, workspace/asgen-config.json lacks armel for sid)

    Looking at the logs, the machinery is indeed looking at bookworm/nff,
    except it doesn't find anything new/interesting there, e.g.:

    2023-01-23 14:21:22 - INFO: Skipping bookworm/non-free-firmware [amd64], no interesting new packages since last update.

    Shouldn't we have placeholders (with just metadata) anyway? Like we have currently for sid/nff, e.g. for amd64[1]:

    ---
    File: DEP-11
    Version: '0.14'
    Origin: debian-sid-non-free-firmware
    MediaBaseUrl: https://appstream.debian.org/media/sid
    Time: 20230108T192336

    1. https://deb.debian.org/debian/dists/unstable/non-free-firmware/dep11/Components-amd64.yml.gz


    In case anyone wonders, [2] looks weird, that's a bug in dak that should
    be fixed, that's triggered by trying to work on non-existing things…

    2. https://deb.debian.org/debian/dists/bookworm/non-free-firmware/dep11/


    Cheers,
    --
    Cyril Brulebois ([email protected]) <https://debamax.com/>
    D-I release manager -- Release team member -- Freelance Consultant

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPOuLgACgkQ/5FK8MKz VSAUDhAAsM3N5xgbOpizrguD6Aqwq9E+O+YFwpgRFEA7vAAljv/XKSQIvmTTq0a7 HwRXN8GXWri4Q/VYn2JotnD60Hoh8ICB4NbbxkzeGV/MGsAYBOMJtVYlIHoziVI7 /LYmf/xGK9caPgtMKtQYVaaraC+LxPtUTnhMuTpd0e6rY2HieRwfc394ZyS3BrLC lFxUdQ5VWMShSkwvUd07MRhhm9VNGEk9lnNBujdGfmCA3kLk+MsNM7fSmQqvmNVy wfALRFvaCg8td4xNvcAdb05WymGYiwT+AXTPj5v8wQvIQ3WSsmpEwzojy8c0iGsL lxSeqNrEvajpLl8Qm5iXezQS6kAkQyafXMv1J8j738SqREmZyCzxbTaOYEAHp1oH XHf4dysACRPYRkncuflpw2zbnwMI8cdwZZEgWGBwFQ0WqBt9v2cvGLjA8R93TToI 8UFu08MCbL1rEeHZA/F9w1rzulpq8nDV+0Mi1COF9OQUKUXPJEBB4PlUIeQaefFW 8GMozT5ftgB1ASAsf94X30zfJjjC8riA70Chwn7+IbOhthMhmimaIiI3gAVuuO1a 3ppN9QYrS99ifq7oDpfyximmgeJMk+piEXEmom6xZYQoI8UjfEbMkxzhkonTKwAO uwQh8PstGQHfZcTI/kpcqP+AGeEV3WRH6Qu6O0cTt5dt6nyPD+I=
    =lfej
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    *
  • From Matthias Klumpp@21:1/5 to All on Mon Jan 30 00:30:01 2023
    Hi!

    Sorry for the delayed reply, I had some health things to deal with last week.

    Am Mo., 23. Jan. 2023 um 17:41 Uhr schrieb Cyril Brulebois <[email protected]>:

    Hi again,

    Cyril Brulebois <[email protected]> (2023-01-19):
    Sorry for the noise. I missed there were several rsync calls on the
    dak side, and at least dak needs patching…

    https://salsa.debian.org/ftp-team/dak/-/merge_requests/267

    This was merged and works fine for sid, but for some reason, we're
    missing files for bookworm. Configuration changes from earlier this
    month look good though (/srv/appstream.debian.org):

    - Add the non-free-firmware archive component
    - Retire buster & stretch, add non-free-firmware processing for dev suites

    (in passing, workspace/asgen-config.json lacks armel for sid)

    Looking at the logs, the machinery is indeed looking at bookworm/nff,
    except it doesn't find anything new/interesting there, e.g.:

    2023-01-23 14:21:22 - INFO: Skipping bookworm/non-free-firmware [amd64], no interesting new packages since last update.

    Shouldn't we have placeholders (with just metadata) anyway? Like we have currently for sid/nff, e.g. for amd64[1]:
    [...]

    So, long story short: A DEP-11 metadata file is only created if the
    archive component that it's built for actually has metadata (any file
    in /usr/share/metainfo or /usr/share/applications). If there is no
    metadata, no file is created, not even an empty one.
    The reason why "sid" has one is because I forced the creation of an
    empty file, since having nothing there completely broke tracker.d.o
    and we needed a quick fix (and I also thought it was a permanent one).
    Looks like I misjudged that and also other parts of our infrastructure
    rely on the files' existence.

    So, Ideally other tools should be fixed to not break if the file isn't
    there, or only break if the file *was* there and vanished (because
    that shouldn't happen), or I could make a change on the generator to
    always generate a file, even if no input data is present, depending on
    what seems like the better way to go.

    Cheers,
    Matthias

    --
    I welcome VSRE emails. See http://vsre.info/

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Cyril Brulebois@21:1/5 to All on Mon Jan 30 01:00:01 2023
    Hi Matthias!

    Hope everything is getting better on your side!

    Matthias Klumpp <[email protected]> (2023-01-30):
    So, Ideally other tools should be fixed to not break if the file isn't
    there, or only break if the file *was* there and vanished (because
    that shouldn't happen), or I could make a change on the generator to
    always generate a file, even if no input data is present, depending on
    what seems like the better way to go.

    Yeah, dak needed a little fix, and with the move of a bunch of firmware packages from non-free to non-free-firmware, we've seen files getting
    refreshed appropriately, and with the first packages reaching bookworm,
    we've seen metadata pop up there as well.

    Everything looks good now for debian-installer/debian-cd as far as I can
    see (we need a fix migration to testing before being 100% certain); sorry
    for that bunch of mails!


    Cheers,
    --
    Cyril Brulebois ([email protected]) <https://debamax.com/>
    D-I release manager -- Release team member -- Freelance Consultant

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPXBvYACgkQ/5FK8MKz VSBgUQ/8Dt6NGV1O7bDRzxN91U1eTCQrdkWrv2s2B2wG+X87ozL9fElOgqwxiBTg tIwU7LDWVXxtWR+u/Ioovc5Ie4vUM5uRlaLN9RaWO3KbdR8zWl6vEumGEwx1PAq2 l/0BOnvbqghgDIR22pwNitGa5BsmntwcVdW5jRqSEkZ+lcV6mpRUAhSv2hftmDtj LssczPdrwXQXvz/knYRv2KSibah9d5fj6vrvf+hiNu4V3RqhWjU65f7659hHDqeB Bn8vX7WW1f1mSfsFzq3BWtPPlxvyxUN/0Mlwx1CGHZllUpSND73USHHqLRQZoGMQ dHB62R57YpgawMf4ifB95uObXhdCfJYWeJFD324/lPGJtRYQgTTc20ZEhYL+XQM3 LStxWHIwSeIcJ++fWuJA3+t9wT+5YkfcH2R/c1R3+/C8ekMtUH+v66Y7EXL7epyV vuVKionrWHCeBzKA6NWwZQYPgNrYYDulo91rMJ/zdaosBbGLOxuuEfDKunhXS8zN UZ0arlauMVdf5rlKkoOkoV/CkgVeh8mCEzhXyWGn4dMkH4JO8bExooAkF/eaRqp+ xEZuzgI4H08vQnkNom/MB9wzmudA/0csURiB7kQ57iCR/CEGflyb1t/ERh99JQ23 5Z3xG3IHUtKF3xy6e+ueHHvfGc4JRjede5sKWau8ArKVVWZJ99U=
    =aGjQ
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    *