• betterbird: reading crossposts once?

    From candycanearter07@21:1/5 to All on Sun Oct 8 03:06:52 2023
    XPost: news.software.nntp

    Hi,
    For cross-posts, is there any way to automatically mark the message read
    in the other groups its posted to once I read it?
    --
    user <candycane> is generated from /dev/urandom

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Adam H. Kerman@21:1/5 to no@thanks.net on Sun Oct 8 08:31:08 2023
    XPost: news.software.nntp

    candycanearter07 <no@thanks.net> wrote:

    For cross-posts, is there any way to automatically mark the message read
    in the other groups its posted to once I read it?

    Look at the Xref: header. It has the server's article number in each
    newsgroup in the crosspost. This will allow your newsreader to update
    its list of read articles in each newsgroup in the crosspost.

    Check your newsreader's settings. Otherwise you'll have to ask in the betterbird developer's support forum.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From The Doctor@21:1/5 to no@thanks.net on Sun Oct 8 11:25:31 2023
    XPost: news.software.nntp

    In article <uftnus$2voq4$1@dont-email.me>,
    candycanearter07 <no@thanks.net> wrote:
    Hi,
    For cross-posts, is there any way to automatically mark the message read
    in the other groups its posted to once I read it?

    Yes AFAIK. Which newsware are you using?

    --
    user <candycane> is generated from /dev/urandom


    --
    Member - Liberal International This is doctor@nk.ca Ici doctor@nk.ca
    Yahweh, King & country!Never Satan President Republic!Beware AntiChrist rising! Look at Psalms 14 and 53 on Atheism https://www.empire.kred/ROOTNK?t=94a1f39b An oil stain on the carpet is not removed by picking up the litter. -unknown Beware https://mindspring.com

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From candycanearter07@21:1/5 to The Doctor on Sun Oct 8 06:30:58 2023
    XPost: news.software.nntp

    On 10/8/23 06:25, The Doctor wrote:
    Yes AFAIK. Which newsware are you using?

    Stated in Subject, Betterbird.
    --
    user <candycane> is generated from /dev/urandom

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Adam H. Kerman@21:1/5 to no@thanks.net on Sun Oct 8 18:10:46 2023
    XPost: news.software.nntp

    candycanearter07 <no@thanks.net> wrote:
    On 10/8/23 03:31, Adam H. Kerman wrote:

    Check your newsreader's settings. Otherwise you'll have to ask in the >>betterbird developer's support forum.

    I looked, couldn't find anything in settings.

    https://groups.google.com/g/mozilla.support.thunderbird/c/S5tSRiGR0w8
    Seems that the solution proposed is "use filters and check cross posting >manually" which kinda sucks. It almost makes me want to switch to Claws,
    but that one is broken too (doesn't display newsgroup list in subscribe
    menu)

    Betterbird is being actively developed, doing bug fixes that Mozilla has ignored for decades, sometimes.

    What happens if you start with a fresh profile rather than importing
    your Thunderbird profile?

    betterbird.eu

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From candycanearter07@21:1/5 to Adam H. Kerman on Sun Oct 8 14:19:41 2023
    XPost: news.software.nntp

    On 10/8/23 13:10, Adam H. Kerman wrote:
    What happens if you start with a fresh profile rather than importing
    your Thunderbird profile?

    betterbird.eu

    I'll try to remember later today.
    --
    user <candycane> is generated from /dev/urandom

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From VanguardLH@21:1/5 to no@thanks.net on Sat Oct 14 05:32:45 2023
    XPost: news.software.nntp

    candycanearter07 <no@thanks.net> wrote:

    For cross-posts, is there any way to automatically mark the message read
    in the other groups its posted to once I read it?

    Note that article numbers are independently assigned at each NNTP
    server. There is no synchronization of article numbers across NNTP
    servers. Hence there is no cross-posting across servers. If you are
    seeing the same article in multiple newsgroups, but the newsgroups are subscribed on different servers, it was a multi-post, not a cross-post.

    To tracking cross-posting means having to track article numbers. When cross-posted, only a single copy of a post is sent to the server, and
    the server adds pointers to the same article based on the Newsgroups
    header. More efficient to have multiple pointers to the same article.

    Alas, the client won't have the indexing to know about pointers to
    multiple newsgroups for the same article. The client only has the
    Message-ID to track across its local store of messages, so it is
    possible to connect cross-posts across multiple newsgroups. That would
    require the "mark as read" action to scan all the subscribed newsgroups
    to find the same MID value. How many newsgroups to which a message was cross-posted wouldn't be an impact on performance, but the number of
    subscribed newsgroups would impact performance in how many newsgroups
    the client would have to search. You can delete a message in one
    newsgroup, but it remains in another newsgroup. The client isn't
    creating pointers to articles across newsgroups as does the server.

    Rather than search across many subscribed newsgroups, the client could
    use the Xref header, if present, to determine in which newsgroups a
    message got cross-posted. That would shorten the time for "mark as
    read" to find the other copies of the message. Clicking on a button,
    and having to wait for the action to complete, is counter ease-of-use.

    https://www.rfc-editor.org/rfc/rfc1036
    Section 2.2.13

    https://bugzilla.mozilla.org/show_bug.cgi?id=43278

    A problem noted there is that the client may not yet have populated the
    other newsgroups into which a message got cross-posted. The "mark as
    read" action would be stalled by however long it takes for the client to retrieve all messages (well, those that cover the cross-posted article)
    in the Xref newsgroups before they could also get marked as read. You'd
    punch the "read as mark" button while in one newsgroup, but have to wait
    for its commit to complete until all other Xref newsgroups got polled,
    and newsgroups aren't polled in the same order as Xref. It's almost as
    if "read as mark" would have to act as a post-retrieve-all-subscribed- newsgroups action; i.e., you couldn't mark any message as read until all subscribed newsgroups got retrieved. The same for when marking as
    unread.

    From this 22-year old bug, implementing the read state across multiple newsgroups for cross-posted messages doesn't seem that easy a task.
    Your request isn't new. About a year ago, this ticket changed from
    minor (problem worth reporting & fixing, but do not interfere with
    normal work or use) to S4 (Important, but not that much. May get fixed someday).

    https://wiki.documentfoundation.org/QA/Bugzilla/Fields/Severity https://wiki.documentfoundation.org/QA/Bugzilla/Fields/Priority

    Per this ticket, doesn't look like any dev is still interested in
    implementing the feature. Interest died out. Since Betterbird is a
    fork of Thunderbird, and since the feature request faded in Thunderbird,
    my guess is nothing for it showed up in Betterbird.

    One suggestion in the ticket was to order the folders (newsgroup) as to
    how you visit them, and use rules in following folders that were
    dependent those on you already visiting the prior folders. You visit
    the top folder, mark as read, then visit the 2nd folder, and a rule
    checks the prior folder for read state, and so on. However, this
    requires you always visit the folders in top-down order, and never
    bounce around the folders. See bugzillaroid's post 114 of 5 years ago.
    I do bounce around the folders since I only want to visit those
    newsgroups that show new/unread messages. No point for me to visit
    newsgroups with no new messages (that survived filtering).

    Does Tbird poll all newsgroups, and retrieve all new message in every
    one (shown as a folder in the tree pane)? Or does it poll a newsgroup
    only when the folder (newsgroup) is selected in the tree?

    There is a German forum for Betterbird at:

    https://www.thunderbird-mail.de/forum/board/91-betterbird/

    They would probably know better the capabilities of that Tbird fork,
    like if that project added read-state by MessageID (or article number
    via Xref) across newsgroups. Get ready with Google Translate.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Russ Allbery@21:1/5 to VanguardLH on Sat Oct 14 09:25:58 2023
    XPost: news.software.nntp

    VanguardLH <V@nguard.LH> writes:

    Rather than search across many subscribed newsgroups, the client could
    use the Xref header, if present, to determine in which newsgroups a
    message got cross-posted.

    Indeed, this is what essentially every client does and what they should
    do.

    That would shorten the time for "mark as read" to find the other copies
    of the message.

    It makes it essentially instantaneous, since it means the reader doesn't
    have to find other copies at all. It already knows exactly which article numbers to mark as read.

    A problem noted there is that the client may not yet have populated the
    other newsgroups into which a message got cross-posted. The "mark as
    read" action would be stalled by however long it takes for the client to retrieve all messages (well, those that cover the cross-posted article)
    in the Xref newsgroups before they could also get marked as read.

    The client shouldn't have to retrieve articles to mark them as read. The standard representation on the client that goes all the way back to the
    very early days of Usenet is called a "newsrc". It holds a list of groups (often both the unsubscribed and the subscribed groups so that read
    articles are tracked properly if someone later subscribes to the group)
    and a list of read articles by number in each group. In text form, it
    looks something like this:

    rec.arts.sf.misc! 1-14774,14786,14789
    rec.arts.sf.reviews! 1-2534
    rec.arts.sf.written: 1-876513
    news.answers! 1-199359,213516,215735
    news.announce.newusers! 1-4399
    news.newusers.questions! 1-645661
    news.groups.questions! 1-32676
    news.software.readers! 1-95504,137265,137274,140059,140091,140117
    alt.test! 1-1441498

    ":" indicates a subscribed newsgroup and "!" indicates an unsubscribed newsgroup. This is a widely-used standard format that can be read by
    multiple newsreaders so that you can switch between, say, trn and tin
    freely and keep the same read article information.

    Marking an article as read in the crossposted groups is as simple as
    reading the group and article number pairs from the Xref header of the
    article that was just read and adding the corresponding numbers to the
    list of read articles in each group, coalescing ranges where needed. It doesn't require any server operations and is extremely fast with any sort
    of reasonable data structure on the client.

    Usually the client couples this with a LIST ACTIVE command at each
    startup, which very efficiently returns the full list of groups on the
    server and the high and low water marks for each one. This allows the
    client to discover new groups and to coalesce article ranges once articles
    have expired and the low water mark moves forward.

    --
    Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

    Please post questions rather than mailing me directly.
    <https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Russ Allbery@21:1/5 to VanguardLH on Sat Oct 14 11:51:42 2023
    XPost: news.software.nntp

    VanguardLH <V@nguard.LH> writes:

    Except that only tells you (the client) in which newsgroups an article
    was cross-posted. You would still need the Message-ID value to find the matching article in each of those newsgroups. Searching takes time.

    If a news reader needs the message ID to mark an article as read, it's
    doing something fairly odd.

    --
    Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

    Please post questions rather than mailing me directly.
    <https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Frank Slootweg@21:1/5 to VanguardLH on Sun Oct 15 12:34:46 2023
    XPost: news.software.nntp

    VanguardLH <V@nguard.lh> wrote:
    Ray Banana <rayban@raybanana.net> wrote:

    * VanguardLH wrote:
    Russ Allbery <eagle@eyrie.org> wrote:
    The client shouldn't have to retrieve articles to mark them as read. The >>> standard representation on the client that goes all the way back to the >>> very early days of Usenet is called a "newsrc". It holds a list of groups
    (often both the unsubscribed and the subscribed groups so that read
    articles are tracked properly if someone later subscribes to the group) >>> and a list of read articles by number in each group. In text form, it >>> looks something like this:

    rec.arts.sf.misc! 1-14774,14786,14789

    Does Thunderbird currently store the article numbers of messages in its
    MSF database files?

    Not in the MSF files, but in the *.rc files.

    I don't recall Tbird uses .rc files

    From my news.eternal-september.org.rc file: --------------------------------------------
    eternal-september.config: 1-958
    eternal-september.grouprequests: 1-690
    eternal-september.info: 1-64
    eternal-september.moderated: 1-27,29
    eternal-september.newusers: 1-1366
    eternal-september.nocems: 1-27
    eternal-september.talk: 1-1515
    eternal-september.test: 1-10382,10397,10502,10503,10544,10546-10548 eternal-september.where.are.all.the.newsgroups: 1-2
    control.checkgroups: 1-1649
    control.newgroup: 1-875
    control.rmgroup: 1-865
    alt.de.test: 1-6609
    uk.d-i-y: 1-1261447
    eternal-september.support: 1-15165,15204-15209,15434,15438,15448-15450

    This is what Russ was talking about and I can confirm that marking
    a crossposted article as read in one group (or simply opening it)
    also marks the article as read in all groups it was crossposted to.
    It has been like that for more than 15 years, IIRC.

    If all that were doable in other e-mail clients, seems inane that Tbird hasn't accomplied the same feat for a 22-year old bug ticket. Comes
    back to me thinking Tbird was first designed to be an e-mail client, and newsgroups got tacked on.

    What Ray is saying, is that Thunderbird *does* already mark
    crossposted articles as read. I.e. Thunderbird does use a 'newsrc' style
    file, as does any other newreader on the planet. The file just isn't
    named '[.]newsrc', but <server_name>.rc. So while there may be some old
    bug report, it's doubtful that Thunderbird is generally not marking
    crossposted articles as read.

    So basically the questions are: 1) under which circumstances does
    Thunderbird - allegedly - not do what it should do or/and 2) does - as
    the OP (candycanearter07) implies - Betterbird do something different
    than Thunderbird?

    Like you (and Ray), I don't use Thunderbird as my regular newsreader,
    so it would be nice if some people who *do* use Thunderbird on a regular
    basis, can confirm if this alleged 'bug' - Thunderbird does (sometimes)
    not mark crossposted articles as read - exists at all or that it's just
    and urban legend, FUD, etc..

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Russ Allbery@21:1/5 to VanguardLH on Sun Oct 15 19:22:22 2023
    XPost: news.software.nntp

    VanguardLH <V@nguard.LH> writes:

    From RFC 2980, section 2.1.7, the 'list overview.fmt' shows the overview headers that get sent by the server. Both ES, and my server
    (individual.net) show "Xref:full". Do any NNTP servers not add this
    overview header to a retrieved article? The same RFC says "Many
    newsreaders work better if Xref: is one of the optional fields." I
    never thought of it as an optional header.

    Although it's technically optional, I'm fairly doubtful that any widely
    used news server doesn't provide Xref headers and Xref in overview.

    https://www.rfc-editor.org/rfc/rfc5536.html#page-24 describes the syntax
    of the Xref header, but that section 3.2.14 is under section 3.2 which
    is titled "Optional Header Fields". Maybe the Xref header has become ubiqitous in Usenet, but it is an optional header. What happens when a client that relies on Xref (and .rc files) hits an endpoint server that doesn't add Xref when the client retrieves an article?

    I think a fairly obvious thing to do would be to fall back on not updating
    the read message indicator in crossposted groups if there's no Xref
    header.

    Maybe that's why the Tbird devs didn't want to rely on an optional
    header.

    If indeed Thunderbird doesn't mark crossposted messages as read in all
    groups (it sounds from the recent messages like it doesn't, but I don't
    use it so I don't know), another possibility is that this was an
    intentional design choice. Thunderbird is primarily a mail reader, and in
    the mail world, it's normal *not* to mark messages cross-posted to
    multiple mailing lists as read in other mailing lists to which they're
    sent. This is for somewhat obvious technical reasons (usually you receive separate copies of the message for each list, and mail has no Xref
    header), but it's also something mail users are used to.

    It's possible that the original Thunderbird developers decided keeping the typical mail behavior made more sense given their expected user base, or
    at least was a good argument to not bother to implement crosspost
    tracking.

    --
    Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

    Please post questions rather than mailing me directly.
    <https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Olivier Miakinen@21:1/5 to All on Mon Oct 16 08:44:56 2023
    XPost: news.software.nntp

    Bonjour Julien,

    Le 15/10/2023 21:43, Julien ÉLIE a écrit :

    As a user of Thunderbird, and reading both news.software.readers and news.software.nntp, I confirm that when I read (and mark as so) an
    article in this thread either in news.software.readers or
    news.software.nntp first, it still shows up unread in the other newsgroup.

    Thank you for the info about the latest version.

    I'm using the latest version of Thunderbird (115.3.2), and this bug was present in previous versions too.

    This bug was already present in Netscape Communicator a.k.a. Netscape 4, then in all flavors of Mozilla, and still in SeaMonkey.

    About Thunderbird which is the only one I never used for newsgroups, because
    it is still present now I suppose that it has always been present since the split between various Mozilla products.

    --
    Olivier Miakinen

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From VanguardLH@21:1/5 to Ray Banana on Mon Oct 16 07:56:45 2023
    Ray Banana <rayban@raybanana.net> wrote:

    Thus spake Frank Slootweg <this@ddress.is.invalid>


    The reason for my question is obvious: Thunderbird should use article
    numbers to mark articles are read in both groups, but (as you are of
    course all too aware of), article numbers are server specific, so
    marking crossposted articles are read across multiple servers is
    (nearly) impossible.

    Obviously, I was referring to a setup where all groups are read from the
    same server.
    It would have never occurred to me that somebody would expect this to
    work across multiple servers ;-)

    I don't know any newsreader that is able to do that.

    If implemented across servers, the MID would have to get used since
    that's the same for a message no matter were peered. Article numbers
    would be unusable for tracking read-state across servers.

    Since Thunderbird switch to SQLite long ago, and record structures would
    be modified to add a field for MID, doesn't seem that much an onus to
    code for the same MID across the SQLite databases for all folders.
    However, that probably would incur a delay between when the Read button
    was pressed until the message changed formatting (bold to unbolded).

    By using MID, seem plausible the read-state could be reflected for the
    same message across newsgroups polled from different servers. Not an
    elegant solution, but a possible one. Yet interest seems to have faded
    with the Tbird dev folks.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From candycanearter07@21:1/5 to Ray Banana on Mon Oct 16 07:57:17 2023
    On 10/16/23 07:27, Ray Banana wrote:
    Obviously, I was referring to a setup where all groups are read from the
    same server.
    It would have never occurred to me that somebody would expect this to
    work across multiple servers ;-)

    Why would you? The point of USENET is shared posts across all servers,
    right?
    --
    user <candycane> is generated from /dev/urandom

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From VanguardLH@21:1/5 to no@thanks.net on Mon Oct 16 08:16:13 2023
    candycanearter07 <no@thanks.net> wrote:

    Ray Banana wrote:

    Obviously, I was referring to a setup where all groups are read from
    the same server. It would have never occurred to me that somebody
    would expect this to work across multiple servers ;-)

    Why would you? The point of USENET is shared posts across all servers,
    right?

    You're thinking about peering whether articles are cross-posted, or not.
    Each server generates its own article numbers. They peer posts. They
    don't sync their Overview and Articles databases.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From J.B. Nicholson@21:1/5 to VanguardLH on Mon Oct 16 23:20:39 2023
    VanguardLH <V@nguard.LH> wrote:
    Since Thunderbird switch to SQLite long ago, and record structures
    would be modified to add a field for MID, doesn't seem that much an
    onus to code for the same MID across the SQLite databases for all
    folders. However, that probably would incur a delay between when
    the Read button was pressed until the message changed formatting
    (bold to unbolded).

    Why not do that job in a background task/thread?

    By using MID, seem plausible the read-state could be reflected for
    the same message across newsgroups polled from different servers.
    Not an elegant solution, but a possible one. Yet interest seems to
    have faded with the Tbird dev folks.

    Why would that be inelegant? It seems to me that using the only
    approach one could use to implement a nice feature ought to qualify as
    elegant. I'd appreciate marking the same articles as read (and
    updating all dependencies including unread article counts, newsrcs,
    and saved searches) across one's news servers so I don't have to waste
    time re-marking stuff read multiple times.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From VanguardLH@21:1/5 to J.B. Nicholson on Mon Oct 16 22:10:28 2023
    "J.B. Nicholson" <jbn@forestfield.org> wrote:

    VanguardLH <V@nguard.LH> wrote:

    Since Thunderbird switch to SQLite long ago, and record structures
    would be modified to add a field for MID, doesn't seem that much an
    onus to code for the same MID across the SQLite databases for all
    folders. However, that probably would incur a delay between when
    the Read button was pressed until the message changed formatting
    (bold to unbolded).

    Why not do that job in a background task/thread?

    "Mark as read" doesn't happen until the user views a message. No way to
    know beforehand which articles a user will view.

    By using MID, seem plausible the read-state could be reflected for
    the same message across newsgroups polled from different servers.
    Not an elegant solution, but a possible one. Yet interest seems to
    have faded with the Tbird dev folks.

    Why would that be inelegant? It seems to me that using the only
    approach one could use to implement a nice feature ought to qualify as elegant.

    The performance impact when "mark as read" to then issue a query on all
    other folder databases (newsgroups) would cause a momentary hang in the
    program along with flickering of the folders due to changing the New or
    Pending count shown in the tree pane.

    There isn't one local message store in Thunderbird. It keeps an SQLite database for each folder (newsgroup). The moment you read an article,
    or otherwise marked it as read, that read-state would have to sync
    across as many SQLite databases as there are folders in the tree (to
    however many newsgroups to which you subscribed).

    Another method would be to not sync the SQLite databases when a user
    read an article or marked it as read. Instead update the SQLite
    database for a folder when the user clicked on a folder. However, that
    means all the other SQLite database must be queried to see if the same
    article in the other folders were marked as read.

    Or, when an article is read that has the Xref header with more than one
    article number, update a global SQLite database to track the
    cross-posted articles. Rather than a text .rc file, an SQLite database
    gets used to record all the cross-postings since SQL searches are faster
    than parsing a text file. When a folder is selected (opened), each
    article retrieved would be checked if it were cross-posted. However,
    that only identifies cross-posted articles, not if they have been read,
    so you'd still have to do multiple folder SQLite queries to bring the
    read state into a message for the selected folder.

    Xref just identifies which article numbers are cross-posted, not their
    read state.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Frank Slootweg@21:1/5 to J.B. Nicholson on Tue Oct 17 15:29:48 2023
    J.B. Nicholson <jbn@forestfield.org> wrote:
    [...]

    I'd appreciate marking the same articles as read (and
    updating all dependencies including unread article counts, newsrcs,
    and saved searches) across one's news servers so I don't have to waste
    time re-marking stuff read multiple times.

    As I mentioned in another response, Hamster can aggregrate articles
    from several news servers and solves this problem. I see that you're
    using slrn on Linux, so you can not (easily) use Hamster (which is a
    Windows program). But you might want to look if Leafnode can do the same
    on Linux.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From issdr@21:1/5 to Frank Slootweg on Tue Oct 17 17:58:19 2023
    Frank Slootweg wrote:

    As I mentioned in another response, Hamster can aggregrate articles
    from several news servers and solves this problem. I see that you're
    using slrn on Linux, so you can not (easily) use Hamster (which is a
    Windows program). But you might want to look if Leafnode can do the same
    on Linux.

    better leafnode2. yes, it does.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Frank Slootweg@21:1/5 to Russ Allbery on Thu Oct 19 13:14:49 2023
    XPost: news.software.nntp

    Russ Allbery <eagle@eyrie.org> wrote:
    Frank Slootweg <this@ddress.is.invalid> writes:

    Neither do I, but it's just SMOP (Small Matter Of Programming). All you have to do is to remember all the hundred of thousands / millions of message-ids of the postings you've ever 'read'. How hard can *that* be!? :-)

    Well, we know exactly how hard this is, because you're describing a news server's history database. News servers also have to remember every
    message they've seen, and they have to do that by message ID. News
    servers limit this to articles within a certain date range and reject all articles older than that date range, but servers that never expire essentially keep that data forever.

    There are a bunch of techniques for maintaining that database. It mostly uses dedicated data structures optimized for this specific problem, not a SQLite database, although I'd be interested to see someone try with modern SQLite or another SQL database and see if it can be optimized enough,
    since those tools have a lot more general optimizations and way more
    active developers.

    This is certainly *doable*, since it's done all the time, and a modern
    server is often smaller (in disk, memory, and CPU) than a typical laptop,
    let alone desktop. On my news server, it currently takes up about 660MiB
    of disk space, which is smaller than a lot of video games. :) But that's literally every message the server has on disk, and I can assure you that
    I have not read the VAST majority of them, so most history databases for a personal newsreader would be substantially smaller.

    Hi Russ,

    Just to be sure/clear: I was both joking (hence "SMOP", "How hard can
    *that* be!?" and the smiley) and serious in my responses to those who apparently took my comments seriously.

    And indeed, it's not that hard to do, because it's exactly what a newsserver's history database does. That's why I later talked about
    Hamster (which I use) and Leafnode(2).

    My response was somewhat in jest, because it was a response to Ray's likeminded post:

    It would have never occurred to me that somebody would expect this to
    work across multiple servers ;-)

    So neither Ray, nor I took the original 'problem' seriously. But
    humour and Usenet often don't go well together.

    Hope this clarifies things.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From VanguardLH@21:1/5 to J.B. Nicholson on Tue Oct 24 06:00:26 2023
    XPost: news.software.nntp

    "J.B. Nicholson" <jbn@forestfield.org> wrote:

    VanguardLH <V@nguard.LH> wrote:
    https://www.dbtalks.com/tutorials/learn-sqlite/what-are-the-limitations-of-sqlite

    I read this URL and immediately didn't understand why dbtalks.com is a reasonable place to look up information about or refer others to
    SQLite's limitations.

    A SQLite database can have maximum 2147483646 pages. Hence the maximum
    number of tables in a schema cannot reach more than 2147483646. The
    maximum number of rows in a table is 264. The maximum number of columns
    is 32767 in a table.

    Notice only 264 rows per table.

    I noticed that you seem to have taken that seriously. Something should
    have immediately caught your eye and made you think 'that is not
    reasonable' particularly for a production-ready relational DB as
    widely used as SQLite.

    Okay, how about this from SQLite:

    https://www.sqlite.org/limits.html

    2000 columns (fields per record) maximum. Recommended: 100.

    There are possible maximums, and there are feasible maximums based on performance. SQLite is not good for huge or even large databases, and
    even SQLite says that.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)