• UDD mirror not up to date

    From Andreas Tille@21:1/5 to All on Thu Aug 19 09:20:01 2021
    Hi,

    I'm just checking some R packages and realised that UDD mirror
    seems not to be up to date

    The mirror has:

    $ psql --port=5432 --host=udd-mirror.debian.net --username=udd-mirror udd
    udd=> select source, version, release from sources where source = 'r-cran-xslt' ;
    source | version | release
    -------------+---------+----------
    r-cran-xslt | 1.3-1 | buster
    r-cran-xslt | 1.4.2-1 | bullseye
    r-cran-xslt | 1.4.2-1 | sid
    (3 Zeilen)


    original UDD has:

    udd=> select source, version, release from sources where source = 'r-cran-xslt' ;
    source | version | release
    -------------+---------+----------
    r-cran-xslt | 1.3-1 | buster
    r-cran-xslt | 1.4.2-1 | bullseye
    r-cran-xslt | 1.4.3-1 | bookworm
    r-cran-xslt | 1.4.3-1 | sid
    (4 Zeilen)


    Is there some issue with syncronizing the mirror?

    Kind regards

    Andreas.


    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Sebastiaan Couwenberg@21:1/5 to Andreas Tille on Thu Aug 19 09:40:01 2021
    On 8/19/21 9:13 AM, Andreas Tille wrote:
    Is there some issue with syncronizing the mirror?

    DSA disabled the UDD cronjob due to disk space usage, see:

    https://lists.debian.org/debian-qa/2021/08/msg00000.html

    See also: #992461

    Kind Regards,

    Bas

    --
    GPG Key ID: 4096R/6750F10AE88D4AF1
    Fingerprint: 8182 DE41 7056 408D 6146 50D1 6750 F10A E88D 4AF1

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Mattia Rizzolo@21:1/5 to Sebastiaan Couwenberg on Thu Aug 19 11:30:02 2021
    On Thu, Aug 19, 2021 at 09:23:51AM +0200, Sebastiaan Couwenberg wrote:
    On 8/19/21 9:13 AM, Andreas Tille wrote:
    Is there some issue with syncronizing the mirror?

    DSA disabled the UDD cronjob due to disk space usage, see:

    https://lists.debian.org/debian-qa/2021/08/msg00000.html

    See also: #992461


    I just re-enabled the cronjobs handling the dumps, so that at least
    udd-mirror will keep updated.

    I doubt the pg_dump calls were those things causing troubles last week.

    --
    regards,
    Mattia Rizzolo

    GPG Key: 66AE 2B4A FCCF 3F52 DA18 4D18 4B04 3FCD B944 4540 .''`.
    More about me: https://mapreri.org : :' : Launchpad user: https://launchpad.net/~mapreri `. `'`
    Debian QA page: https://qa.debian.org/developer.php?login=mattia `-

    -----BEGIN PGP SIGNATURE-----

    iQIzBAEBCgAdFiEEi3hoeGwz5cZMTQpICBa54Yx2K60FAmEeJG4ACgkQCBa54Yx2 K612ohAAnsihVEvqH0BiUrG0caWhSGTGNW2O9g4QrZOQlZU3kn+At/CleXY1C77+ cNUX7NOpDYeCRxmmKBWHa2A2swkLf/aWEi78HACQPZu3e3MZSYmRzVB7Vca9N1xb kP8DqlMZeKucR56ffXvLLrHKo89geO3/Cu7QeN3g/4ouDx9xXqw7vPG9p0EqA4Lt GolwZPtrUtd+6Oixrych/JDIpBZl+GW7xOhGbnwagnIJ/oiTYViQnb2WNzp9j4La TEoWYygTFBE7tlG4tUeeMNkwOFa8x7E75UM+BFUMZHYkB/WCt9CKh9cIf00d6GQN TuyXe/OTOs+mydF+rmGdIJXSOWVCHVIFZfRZo2OJTPWGRKQ3Y+vLKTHsvvQqtvV/ 9ROw9J4qoOSOrg8UNFoKOuDBoKcnMead4AYfaGgve5OmaXc0PQBdYU1UdpqcxHck 9ZoAQFVLGA+4criKmMZ1LoerE9hPD5w/GacFPhPlRMRcDNXWQVfCC3+joFjEV/ns 2rs+WFeO6YO3lSmJ/ORbkkpd1Ab0NbnvLFiJXn0YX27A8hXeiJC
  • From Andreas Tille@21:1/5 to Mattia Rizzolo on Thu Aug 19 15:10:01 2021
    On Thu, Aug 19, 2021 at 11:29:20AM +0200, Mattia Rizzolo wrote:

    I just re-enabled the cronjobs handling the dumps, so that at least udd-mirror will keep updated.

    Thanks a lot. That's very convenient since we relay on UDD to organise
    the packages that need updates.

    Kind regards

    Andreas.

    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andreas Tille@21:1/5 to Andreas Tille on Fri Aug 20 14:10:01 2021
    Hi again,

    On Thu, Aug 19, 2021 at 03:04:22PM +0200, Andreas Tille wrote:
    On Thu, Aug 19, 2021 at 11:29:20AM +0200, Mattia Rizzolo wrote:

    I just re-enabled the cronjobs handling the dumps, so that at least udd-mirror will keep updated.

    Thanks a lot. That's very convenient since we relay on UDD to organise
    the packages that need updates.

    Seems that upload_history in UDD itself is not updated:

    udd=# select source, version, date from upload_history where source = 'r-cran-stringi' order by version;
    source | version | date ----------------+---------+------------------------
    r-cran-stringi | 0.5-5-1 | 2015-11-12 11:00:22+01
    r-cran-stringi | 1.0-1-1 | 2015-11-12 11:21:49+01
    r-cran-stringi | 1.1.2-1 | 2016-11-04 16:08:36+01
    r-cran-stringi | 1.1.5-1 | 2017-10-12 22:51:57+02
    r-cran-stringi | 1.1.6-1 | 2018-02-23 10:04:47+01
    r-cran-stringi | 1.1.7-1 | 2018-03-16 09:53:23+01
    r-cran-stringi | 1.2.2-1 | 2018-05-03 09:58:35+02
    r-cran-stringi | 1.2.3-1 | 2018-06-16 22:36:59+02
    r-cran-stringi | 1.2.4-1 | 2018-07-26 16:55:31+02
    r-cran-stringi | 1.2.4-2 | 2018-11-15 16:05:27+01
    r-cran-stringi | 1.4.3-1 | 2019-07-09 09:19:10+02
    r-cran-stringi | 1.4.5-1 | 2020-01-13 21:40:36+01
    r-cran-stringi | 1.4.6-1 | 2020-02-22 09:36:51+01
    r-cran-stringi | 1.5.3-1 | 2020-09-22 12:03:34+02
    (14 Zeilen)


    $ rmadison r-cran-stringi
    r-cran-stringi | 1.1.2-1 | oldoldstable | source, amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.2.4-2~bpo9+1 | stretch-backports | source, amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.2.4-2~bpo9+1 | stretch-backports-debug | source r-cran-stringi | 1.2.4-2 | oldstable | source, amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.5.3-1 | stable | source, amd64, arm64, armel, armhf, i386, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.5.3-1 | testing | source, amd64, arm64, armel, armhf, i386, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.7.3-1 | unstable | source, amd64, arm64, armel, armhf, i386, mips64el, mipsel, ppc64el, s390x
    r-cran-stringi | 1.7.3-1 | unstable-debug | source


    I admit I would be really urgent to get this updated quickly. I need
    those data for my talk at DebConf. :-(

    Kind regards

    Andreas.

    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Mattia Rizzolo@21:1/5 to Andreas Tille on Sat Aug 21 12:30:01 2021
    On Fri, Aug 20, 2021 at 02:05:45PM +0200, Andreas Tille wrote:
    On Thu, Aug 19, 2021 at 03:04:22PM +0200, Andreas Tille wrote:
    On Thu, Aug 19, 2021 at 11:29:20AM +0200, Mattia Rizzolo wrote:

    I just re-enabled the cronjobs handling the dumps, so that at least udd-mirror will keep updated.

    Thanks a lot. That's very convenient since we relay on UDD to organise
    the packages that need updates.

    Seems that upload_history in UDD itself is not updated:

    Yes, that's included in the importers that are stopped for now.

    I'm running the "upload-history" importer manually right now, so you
    should see somethng appear soon, just for you :)

    --
    regards,
    Mattia Rizzolo

    GPG Key: 66AE 2B4A FCCF 3F52 DA18 4D18 4B04 3FCD B944 4540 .''`.
    More about me: https://mapreri.org : :' : Launchpad user: https://launchpad.net/~mapreri `. `'`
    Debian QA page: https://qa.debian.org/developer.php?login=mattia `-

    -----BEGIN PGP SIGNATURE-----

    iQIzBAEBCgAdFiEEi3hoeGwz5cZMTQpICBa54Yx2K60FAmEg1QEACgkQCBa54Yx2 K62Z0xAAi9o70aamAlvyyuAk6jj4fthYZrmWPHpPJ7QiumfVwyk/P89ctAw/CPvy 7iXg4YcSd0/nn2+xycHjhettOG5Qw2OdscEoGXOsopOgBAluWJI5r76v9Rm0q9Qy HieznGB2Ffhq8ESkMVzFjgoB8EqIHc9sz9C9CzXE2u1WDnfIuvnHVyC0YTR1TvEu O9Ohn+bTmoIO9funSiA5SFn3Go+kTcK9QqdrxCRLuOc4ZaR2tUXhgfC+3zush5Eg c4N69cbs7FEJ+CqZ8n4KBH6jqfiS684UnSckp7RwOM7t3XtdbIcvjZsJw7HTHXlx L7NGZRVvUXJbwrpkh+Iqhd0vnbfy4QycMJfXLb/DBeZ5Xk+zBCs9+WmrB0Y1y5u/ 1qd5pOzAWi2l+2Ufz4Pvk7FOl06VobY5yBzhKkaAssTQVAggIVTd3ZP6gFjiYMXe ahyZ/5ktjm+yjx26LaT5EijX/TLfniys4TQqhVvNhRdx6dq/CP4TIwPhKmQ0Ui+5 VWWv6FpSCLa4Og3GpiWIB3s8br/X8QeGGs1s6OywA5pXz4U/4Vw
  • From Andreas Tille@21:1/5 to Mattia Rizzolo on Sat Aug 21 20:20:02 2021
    On Sat, Aug 21, 2021 at 12:27:15PM +0200, Mattia Rizzolo wrote:

    Yes, that's included in the importers that are stopped for now.

    I'm running the "upload-history" importer manually right now, so you
    should see somethng appear soon, just for you :)

    That's a really great service. The rationaly why I'm so keen on these
    data is that I want to proof that each new release has the effect of a
    bug bump in the number of uploads - the "freeze depression" has ended
    now.

    Thanks a lot for your support

    Andreas.

    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andreas Tille@21:1/5 to Mattia Rizzolo on Sun Aug 22 07:00:01 2021
    Hi again,

    On Sat, Aug 21, 2021 at 12:27:15PM +0200, Mattia Rizzolo wrote:
    Thanks a lot. That's very convenient since we relay on UDD to organise the packages that need updates.

    Seems that upload_history in UDD itself is not updated:

    Yes, that's included in the importers that are stopped for now.

    I'm running the "upload-history" importer manually right now, so you
    should see somethng appear soon, just for you :)

    I have no idea how much time the importer takes but I havn't seen any
    change so far.

    Kind regards and thanks again for your effort

    Andreas.

    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Mattia Rizzolo@21:1/5 to Andreas Tille on Sun Aug 22 09:50:01 2021
    On Sun, Aug 22, 2021 at 06:52:38AM +0200, Andreas Tille wrote:
    Hi again,

    On Sat, Aug 21, 2021 at 12:27:15PM +0200, Mattia Rizzolo wrote:
    Thanks a lot. That's very convenient since we relay on UDD to organise the packages that need updates.

    Seems that upload_history in UDD itself is not updated:

    Yes, that's included in the importers that are stopped for now.

    I'm running the "upload-history" importer manually right now, so you
    should see somethng appear soon, just for you :)

    I have no idea how much time the importer takes but I havn't seen any
    change so far.

    It takes 2-3 minutes. but when I mailed last time I had already run it
    once, indeed this is the last record right now:

    udd=> select source, version, date, distribution from upload_history order by date desc limit 1;
    source | version | date | distribution ---------+---------+------------------------+--------------
    tellico | 3.4.1-2 | 2021-08-21 10:03:46+00 | unstable
    (1 row)


    IOW, it looks "good" to me. I'm running it again now. however of
    course it'll only pick the uploads until I run the command. Clearly
    somebody needs to take out the time to look at what happened and re-cron
    it all.

    --
    regards,
    Mattia Rizzolo

    GPG Key: 66AE 2B4A FCCF 3F52 DA18 4D18 4B04 3FCD B944 4540 .''`.
    More about me: https://mapreri.org : :' : Launchpad user: https://launchpad.net/~mapreri `. `'`
    Debian QA page: https://qa.debian.org/developer.php?login=mattia `-

    -----BEGIN PGP SIGNATURE-----

    iQIzBAEBCgAdFiEEi3hoeGwz5cZMTQpICBa54Yx2K60FAmEh/9oACgkQCBa54Yx2 K606WA/9Fp1FE30dQZyL6RXxcCd3iGQGGG5RqE3fMz/0FfFhySYNT1wpQlr6M7NX E1yvV1GoNl0wN2kNIuUtPCLaSyUiWGUYl6UAHQJIMU8sK7VLBspcDKowG3/JPDdC Fvp2A8SX6lKfI5Vhp7u5VHP3iSGznqqxaHB59oSldptH7uKWWlBIYw1eZXAtsBYi wFgfab4Xqyph/POtTaiN6glpI9wJ06/mdQe003X+COMODR5n1SKEh1J5ZUytm11o gfVOpbMhF9CWaCN+Q5lwImDd6QkT4ssx2Id5XzLH8zhRvfObd1EL4GTqJJ9TSYz9 DUrFBkiDA2dkqoivz44jf83qhOpgPtGdi8OfeM2jt5teCu9d6o1ZULWYU087Y7Va Ka23Mj+h5LkGsIZrRlzmDVnPYsX7D9gF4RgfnfN6ReONnWlQochRnTPlXrZJMOQ9 vSw2H2ftoes/C0d1Q20VYTXRleuZqV+a0A6OA/RovDY81YE6C0ics6WQYMnIBBwM 0RybLCM22LQfRh1ECRrjaSNGDA9eC3H+vlWSen7Fjtd0q7vM55U
  • From Andreas Tille@21:1/5 to Mattia Rizzolo on Sun Aug 22 11:20:02 2021
    On Sun, Aug 22, 2021 at 09:42:21AM +0200, Mattia Rizzolo wrote:

    It takes 2-3 minutes. but when I mailed last time I had already run it
    once, indeed this is the last record right now:

    udd=> select source, version, date, distribution from upload_history order by date desc limit 1;
    source | version | date | distribution ---------+---------+------------------------+--------------
    tellico | 3.4.1-2 | 2021-08-21 10:03:46+00 | unstable
    (1 row)

    OK, r-cran-stringi is now at the right version as well. Thanks a lot.

    IOW, it looks "good" to me. I'm running it again now. however of
    course it'll only pick the uploads until I run the command. Clearly
    somebody needs to take out the time to look at what happened and re-cron
    it all.

    re-croning would be helpful, thought.

    Thanks a lot for your help

    Andreas.

    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Eriberto Mota@21:1/5 to All on Sun Aug 22 22:50:02 2021
    Hi guys,

    Today I noticed an issue in my report[1] at the end of the first
    section (called "Sources in Debian Sid including orphan, by upload
    dates"). Some packages don't have an upload date. This is very common
    for packages uploaded a few hours ago. However, I can see some
    packages not updated for a very long time, such as edb and pal.

    [1] https://people.debian.org/~eriberto/udd/help_a_package.html

    These packages don't have an upload date in bapase but it is not true
    for upload_history. See below:

    $ LANG=C psql -P pager=off service=udd -c $'SELECT bapase.source as
    "Source Name", bapase.upload_date as "Upload bapase",
    upload_history.date as "Upload upload_history" FROM bapase JOIN
    upload_history ON bapase.source=upload_history.source WHERE
    bapase.source IN (\'pal\',\'edb\');'
    Source Name | Upload bapase | Upload upload_history -------------+---------------+------------------------
    edb | | 1999-05-26 03:19:50+00
    edb | | 1999-07-30 18:53:01+00
    edb | | 1999-08-16 18:52:33+00
    edb | | 1999-09-20 18:56:18+00
    edb | | 2000-02-16 10:54:55+00
    edb | | 2002-02-07 20:00:07+00
    edb | | 2002-04-03 04:17:13+00
    edb | | 2004-03-23 09:47:05+00
    edb | | 2006-11-02 23:32:56+00
    edb | | 2006-11-18 12:17:08+00
    edb | | 2006-11-19 22:03:05+00
    edb | | 2007-09-14 21:32:04+00
    edb | | 2009-08-30 06:32:08+00
    edb | | 2009-12-20 12:50:53+00
    pal | | 2004-03-31 21:14:16+00
    pal | | 2004-05-01 15:32:28+00
    pal | | 2004-05-08 18:17:03+00
    pal | | 2004-06-09 20:32:11+00
    pal | | 2005-11-14 17:47:08+00
    pal | | 2008-06-02 10:17:04+00
    pal | | 2008-06-03 06:47:06+00
    pal | | 2008-06-19 16:47:04+00
    pal | | 2008-07-05 19:32:24+00
    pal | | 2008-07-22 17:50:19+00
    pal | | 2008-08-03 18:03:08+00
    pal | | 2008-09-07 21:04:28+00
    pal | | 2008-09-29 11:02:03+00
    pal | | 2009-05-17 16:32:07+00
    pal | | 2009-09-24 07:32:17+00
    pal | | 2010-12-01 20:48:12+00
    pal | | 2011-08-27 21:48:09+00
    pal | | 2011-12-13 23:33:45+00
    (32 rows)

    As I said, no dates in bapase. However, there is another problem here:
    the last date for edb in upload_history is 2009-12-20 but 2013-07-03
    in tracker.debian.org. The same for pal: 2011-12-13 in upload_history
    and 2014-04-26 in tracker.

    Regards,

    Eriberto

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Mattia Rizzolo@21:1/5 to Eriberto Mota on Sun Aug 22 23:20:02 2021
    On Sun, Aug 22, 2021 at 05:43:19PM -0300, Eriberto Mota wrote:
    Hi guys,

    Today I noticed an issue

    You reported true things, but I doubt this is in any way related to the
    current issue.

    Are you saying these inconsistencies appeared just now? I'd suspect
    those things have been broken for a decade already.

    $ LANG=C psql -P pager=off service=udd -c $'SELECT bapase.source as
    "Source Name", bapase.upload_date as "Upload bapase",
    upload_history.date as "Upload upload_history" FROM bapase JOIN

    Incidentally, I know nothing of bapase.

    As I said, no dates in bapase. However, there is another problem here:
    the last date for edb in upload_history is 2009-12-20 but 2013-07-03
    in tracker.debian.org. The same for pal: 2011-12-13 in upload_history
    and 2014-04-26 in tracker.

    For these kind of bugs, remember that the upload_history is feeded via
    the debian-devel-changes mails, parsed one by one. the implementation
    of it has changed a couple of times over the many years (though it has
    been the same for at least the last 7). So it's realistic to think that
    a few uploads might be missing here and there.
    Another "common" cause for missing uploads, though it's not the case for src:pal nor src:edb, is that udd caught a few packages that were
    reuploaded with the same version after dak forgot them, whereas udd
    failed in the upload_history sql constraint.

    All this said, I haven't looked at why those two uploads specifically
    might be missing.

    --
    regards,
    Mattia Rizzolo

    GPG Key: 66AE 2B4A FCCF 3F52 DA18 4D18 4B04 3FCD B944 4540 .''`.
    More about me: https://mapreri.org : :' : Launchpad user: https://launchpad.net/~mapreri `. `'`
    Debian QA page: https://qa.debian.org/developer.php?login=mattia `-

    -----BEGIN PGP SIGNATURE-----

    iQIzBAEBCgAdFiEEi3hoeGwz5cZMTQpICBa54Yx2K60FAmEivnkACgkQCBa54Yx2 K612Iw/+Lu6pFU/NilU47vV3GwW+b9v5c7kNxfdSOkIsCbgirWvRzuSU1OhbBWk9 d+/1Y3EcDGOhkVpIk2rX0vkW6DL0OlOyNar9k1FUMr1ojJUueZQsre/DvJS6WUpF 7nnpFyPhxTu6r5UvKmhwSmnDjAR4REvtW95HNdsLyQhSS0twjid9naoEOYiYgvCd X31ko9G8iZGguCBXo+qmltL2wr1zanfYsDzSCaylaGG+t4h/9I+XHQx3H1++o5zY GS5dOL/gmSOymEaxpXKsdEFbObukNrc1I3P0cyxFM1sOrAOKWAjMH0n9sUzjB2s9 d3XhnbSLPP/CN3gWQ3pA+NpHVvFjG8VGbj8nhGeuX8PT9C7U7WiYZDk1Qhul/dMn bS8+YqJCRW1Dogc5vdwnuYMxq6BSAXKC2yHp3+l9X3a7hizcZdVBUcmJ1JvqRGt7 BhvY4E4xvrotU1xvpFXRtTTv9IkejxgUOlEX09J3iVicDxPFZq64WoS8EGRyOokP 8L21xVCa4CBC6iwwpL+qVsgYBNHQFcNLgzMd+rTAT7dRvL4BzxM
  • From Lucas Nussbaum@21:1/5 to Mattia Rizzolo on Mon Aug 23 21:00:03 2021
    Hi,

    On 22/08/21 at 23:15 +0200, Mattia Rizzolo wrote:
    On Sun, Aug 22, 2021 at 05:43:19PM -0300, Eriberto Mota wrote:
    Hi guys,

    Today I noticed an issue

    You reported true things, but I doubt this is in any way related to the current issue.

    Are you saying these inconsistencies appeared just now? I'd suspect
    those things have been broken for a decade already.

    $ LANG=C psql -P pager=off service=udd -c $'SELECT bapase.source as
    "Source Name", bapase.upload_date as "Upload bapase",
    upload_history.date as "Upload upload_history" FROM bapase JOIN

    Incidentally, I know nothing of bapase.

    bapase is just a view (see '\d+ bapase' in psql)

    As I said, no dates in bapase. However, there is another problem here:
    the last date for edb in upload_history is 2009-12-20 but 2013-07-03
    in tracker.debian.org. The same for pal: 2011-12-13 in upload_history
    and 2014-04-26 in tracker.

    For these kind of bugs, remember that the upload_history is feeded via
    the debian-devel-changes mails, parsed one by one. the implementation
    of it has changed a couple of times over the many years (though it has
    been the same for at least the last 7). So it's realistic to think that
    a few uploads might be missing here and there.

    Indeed, the upload_history implementation is fragile (or more correctly:
    its data source is fragile). There are a few uploads whose emails to debian-devel-changes could not be parsed for some reason.

    You can get the list of packages currently in unstable with no
    corresponding upload in upload_history:

    udd=> select s.source, s.version from sources s left join upload_history uh using (source, version) where s.release='sid' and uh.version is null order by source asc;
    source | version ------------------------------+-----------------------------
    binutils-z80 | 4
    dvhtool | 1.0.1-5
    edb | 1.31-3
    kerneltop | 0.91-2
    libmime-explode-perl | 0.39-3
    libnet-jabber-loudmouth-perl | 0.07-3
    libparse-exuberantctags-perl | 1.02-1
    libsgml-parser-opensp-perl | 0.994-3
    libshairport | 1.2.1~git20120510.cbed0c1-3
    libsocket-linux-perl | 0.01-2
    libtext-levenshteinxs-perl | 0.03-4
    libxml-grddl-perl | 0.004-2
    pal | 0.4.3-8.1
    scheme2c | 2012.10.14-1
    vowpal-wabbit | 7.3-1.1
    (15 rows)

    Lucas

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEE/t7ByzN7z1CfQ8IkORS1MvTfvpkFAmEj7JAACgkQORS1MvTf vpn4zQ//aXW+UwsKs15FA2sy8ZAvIlE5jjuRAS2GExAylTaNmiVg6edZeEiDPwyO iuu7x21qLpsWHn9Rw8MyzW+UmvZ+dlbNo3O2RiMRLV0rKCciQfPqWMKfrr2eUZh7 Ld94ldrEFgP8NgPaPEXzvOGKUkt7swNmV+RISBFmXTkH5c2Qlah/BVKGIeXFbZIi ITSS8TVQhtYkANYv/RVgF6jula1vyqd8roJu5yU/OsZfXfoZKXdhCC85Dl1iP4Uc 9/HwR5ogEeRW5At93id/uFyQouOxm77kcoQ44DP2jfMa5tbSOiwpFlaC8lcqoehA B8A8tHgvBZbmco+L5JNC+igAgGKdzlrAJh+jqVrcasiQa4FclVw3pXxbYqxv0V8e 3AtOwkuLX2Yddik6bBCQa7x37rbTohMh0n2DhzuNqQGnVUgtXW/F9f7NJJmRSeuz W9I9Ilpsb3uREAQuiRIZ44JT2FLEyaWNzDMHD4WXMd50YuBOZjElJGavbP/hHBNe cnP/AgTqTpsN61++H+T83lbN7X5gbz3SP4Y8huiweqW6tfkRIXeGszrVAOEDWECh 0Ky/YKzBiDffT0MyUdlpsnO0MKX2PgwKhcjkCsRX7q7Ja7COf4m4mqHF26YUWk+b g1zB4ZKqLhK7HNzUiJ+corRAUWjRJEix0djziFcwmngJHNjcs4Y=
    =+qrT
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Eriberto@21:1/5 to All on Tue Aug 24 00:40:01 2021
    Em seg., 23 de ago. de 2021 às 15:53, Lucas Nussbaum
    <lucas@debian.org> escreveu:

    Indeed, the upload_history implementation is fragile (or more correctly:
    its data source is fragile). There are a few uploads whose emails to debian-devel-changes could not be parsed for some reason.

    You can get the list of packages currently in unstable with no
    corresponding upload in upload_history:

    udd=> select s.source, s.version from sources s left join upload_history uh using (source, version) where s.release='sid' and uh.version is null order by source asc;
    source | version ------------------------------+-----------------------------
    binutils-z80 | 4
    dvhtool | 1.0.1-5
    edb | 1.31-3
    kerneltop | 0.91-2
    libmime-explode-perl | 0.39-3
    libnet-jabber-loudmouth-perl | 0.07-3
    libparse-exuberantctags-perl | 1.02-1
    libsgml-parser-opensp-perl | 0.994-3
    libshairport | 1.2.1~git20120510.cbed0c1-3
    libsocket-linux-perl | 0.01-2
    libtext-levenshteinxs-perl | 0.03-4
    libxml-grddl-perl | 0.004-2
    pal | 0.4.3-8.1
    scheme2c | 2012.10.14-1
    vowpal-wabbit | 7.3-1.1
    (15 rows)

    Lucas

    Is possible/viable to insert the dates manually? I think it can fix
    this inconsistency.

    Cheers,

    Eriberto

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Lucas Nussbaum@21:1/5 to Eriberto on Tue Aug 24 09:30:01 2021
    On 23/08/21 at 19:29 -0300, Eriberto wrote:
    Em seg., 23 de ago. de 2021 às 15:53, Lucas Nussbaum
    <lucas@debian.org> escreveu:

    Indeed, the upload_history implementation is fragile (or more correctly: its data source is fragile). There are a few uploads whose emails to debian-devel-changes could not be parsed for some reason.

    You can get the list of packages currently in unstable with no corresponding upload in upload_history:

    udd=> select s.source, s.version from sources s left join upload_history uh using (source, version) where s.release='sid' and uh.version is null order by source asc;
    source | version ------------------------------+-----------------------------
    binutils-z80 | 4
    dvhtool | 1.0.1-5
    edb | 1.31-3
    kerneltop | 0.91-2
    libmime-explode-perl | 0.39-3
    libnet-jabber-loudmouth-perl | 0.07-3
    libparse-exuberantctags-perl | 1.02-1
    libsgml-parser-opensp-perl | 0.994-3
    libshairport | 1.2.1~git20120510.cbed0c1-3
    libsocket-linux-perl | 0.01-2
    libtext-levenshteinxs-perl | 0.03-4
    libxml-grddl-perl | 0.004-2
    pal | 0.4.3-8.1
    scheme2c | 2012.10.14-1
    vowpal-wabbit | 7.3-1.1
    (15 rows)

    Lucas

    Is possible/viable to insert the dates manually? I think it can fix
    this inconsistency.

    If the emails are available, it would be better to fix the code so that
    they can be imported, and then re-import from scratch (or just re-import
    the months with problems)

    Note that it's not a problem with missing dates: it's a problem with
    missing records in upload_history.

    Lucas

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)