• Refresh thread (Was: Started porting UDD to Python3 (Was: [UDD] Is ther

    From Andreas Tille@21:1/5 to All on Sun Jan 16 16:30:02 2022
    Hi,

    as far as I can see we can not upgrade the machine running UDD
    to current stable since it is not ported to Python3 yet. I wonder
    whether the authors involved into this project want to grab their
    code and port it to Python3 (inside the python3 branch of the
    repository).

    Kind regards

    Andreas.

    Am Mon, May 18, 2020 at 09:57:33PM +0200 schrieb Andreas Tille:
    On Mon, May 18, 2020 at 08:35:33PM +0200, Stéphane Blondon wrote:

    Can you send me the file 'gatherer.${I_dont_know_the_command}' which
    raises the UnicodeDecodeError exception? I will try to write a working patch.

    I simply added a debug line:

    udd(python3) $ git diff
    diff --git a/udd/ddtp_gatherer.py b/udd/ddtp_gatherer.py
    index bbf041b..d32b85f 100644
    --- a/udd/ddtp_gatherer.py
    +++ b/udd/ddtp_gatherer.py
    @@ -239,6 +239,7 @@ class ddtp_gatherer(gatherer):
    self.log.exception("Error reading %s%s", dir, filename)

    def _open_file(path):
    + print(path)
    with open(path, 'rb') as f:
    raw_content = f.read()
    encoding = chardet.detect(raw_content)["encoding"]


    which leads to


    udd(python3) $ ./update-and-run.sh ddtp /srv/mirrors/debian/dists/squeeze-proposed-updates/main/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/squeeze-proposed-updates/non-free/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/squeeze-proposed-updates/contrib/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/stretch-proposed-updates/main/i18n/Translation-en.bz2
    Traceback (most recent call last):
    File "/srv/udd.debian.org/udd//udd.py", line 88, in <module>
    exec("gatherer.%s()" % command)
    File "<string>", line 1, in <module>
    File "/srv/udd.debian.org/udd/udd/ddtp_gatherer.py", line 127, in run
    h.update(f.read())
    File "/usr/lib/python3.8/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc5 in position 11: invalid continuation byte


    While you can download the files from any Debian mirror I've attached
    /srv/mirrors/debian/dists/stretch-proposed-updates/main/i18n/Translation-en.bz2
    to this mail. My guess is that translations from stretch will not be
    touched any more and thus we need to cope somehow with the existing
    encoding.

    Thanks a lot for your help

    Andreas.

    --
    http://fam-tille.de



    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andreas Tille@21:1/5 to All on Mon Jan 24 17:20:02 2022
    Hi again,

    I've added this as an issue to "Grow your ideas for Debian Project":

    https://salsa.debian.org/debian/grow-your-ideas/-/issues/13

    Kind regards

    Andreas.

    Am Sun, Jan 16, 2022 at 04:28:29PM +0100 schrieb Andreas Tille:
    Hi,

    as far as I can see we can not upgrade the machine running UDD
    to current stable since it is not ported to Python3 yet. I wonder
    whether the authors involved into this project want to grab their
    code and port it to Python3 (inside the python3 branch of the
    repository).

    Kind regards

    Andreas.

    Am Mon, May 18, 2020 at 09:57:33PM +0200 schrieb Andreas Tille:
    On Mon, May 18, 2020 at 08:35:33PM +0200, Stéphane Blondon wrote:

    Can you send me the file 'gatherer.${I_dont_know_the_command}' which raises the UnicodeDecodeError exception? I will try to write a working patch.

    I simply added a debug line:

    udd(python3) $ git diff
    diff --git a/udd/ddtp_gatherer.py b/udd/ddtp_gatherer.py
    index bbf041b..d32b85f 100644
    --- a/udd/ddtp_gatherer.py
    +++ b/udd/ddtp_gatherer.py
    @@ -239,6 +239,7 @@ class ddtp_gatherer(gatherer):
    self.log.exception("Error reading %s%s", dir, filename)

    def _open_file(path):
    + print(path)
    with open(path, 'rb') as f:
    raw_content = f.read()
    encoding = chardet.detect(raw_content)["encoding"]


    which leads to


    udd(python3) $ ./update-and-run.sh ddtp /srv/mirrors/debian/dists/squeeze-proposed-updates/main/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/squeeze-proposed-updates/non-free/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/squeeze-proposed-updates/contrib/i18n/Translation-en.bz2
    /srv/mirrors/debian/dists/stretch-proposed-updates/main/i18n/Translation-en.bz2
    Traceback (most recent call last):
    File "/srv/udd.debian.org/udd//udd.py", line 88, in <module>
    exec("gatherer.%s()" % command)
    File "<string>", line 1, in <module>
    File "/srv/udd.debian.org/udd/udd/ddtp_gatherer.py", line 127, in run
    h.update(f.read())
    File "/usr/lib/python3.8/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc5 in position 11: invalid continuation byte


    While you can download the files from any Debian mirror I've attached
    /srv/mirrors/debian/dists/stretch-proposed-updates/main/i18n/Translation-en.bz2
    to this mail. My guess is that translations from stretch will not be touched any more and thus we need to cope somehow with the existing encoding.

    Thanks a lot for your help

    Andreas.

    --
    http://fam-tille.de



    --
    http://fam-tille.de



    --
    http://fam-tille.de

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)