I wonder how many peers are carrying and preserving fulltext historical and curent Usenet feeds.

Will anyone give a ballpark number?

Which peers have articles remotest in antiquity?

Even guesstimates might be useful.

--
3883@sugar.bug | sybershock.com | sci.crypt

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 28/03/2024 20:11, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext historical and curent Usenet feeds.

Will anyone give a ballpark number?

Which peers have articles remotest in antiquity?

Even guesstimates might be useful.

Actually I have my full server back to 2000. Actually i'm working to add
other back from archive.org.


Sincerely

--
Ivo Gandolfo

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 3/28/24 14:11, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext historical
and curent Usenet feeds.

Considering that all of the news servers that I've looked at have a
/default/ configuration to expire articles, you're actually asking for a special configuration.

After Google killed Dejanews, (years ago) I would wonder if some of the
big binary friendly news service providers might happen to have a VERY
long text newsgroup archive simply based on size compared to binaries.

Beyond that, I'd start inquiring if anyone like the Library of Congress
has an archive. But I'd be somewhat surprised if they did. Or if they
did, I suspect that getting access to it in any capacity would be onerous.



--
Grant. . . .

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

According to Grant Taylor <gtaylor@tnetconsulting.net>:

After Google killed Dejanews, (years ago) I would wonder if some of the
big binary friendly news service providers might happen to have a VERY
long text newsgroup archive simply based on size compared to binaries.

My impression is that the commercial providers like Giganews stopped
expiring stuff a long time ago so their archives go way back.


--
Regards,
John Levine, johnl@taugh.com, Primary Perpetrator of "The Internet for Dummies",
Please consider the environment before reading this e-mail. https://jl.ly

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

Kyonshi <gmkeros@gmail.com> wrote at 23:03 this Sunday (GMT):

On 3/28/2024 8:11 PM, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext historical and curent Usenet feeds.

Will anyone give a ballpark number?

Which peers have articles remotest in antiquity?

Even guesstimates might be useful.

The question is how much of that really is useful, considering the flood
of spam the last few decades.

There was still plenty of legitimate conversation, and
filtering/skipping the spam should be easier in retrospect. You could
also apply the existing spam reports for a portion of it.
--
user <candycane> is generated from /dev/urandom

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 28.03.24 20:11, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext historical and curent Usenet feeds.

Will anyone give a ballpark number?

Which peers have articles remotest in antiquity?

Even guesstimates might be useful.

i've imported and deduped all available usenet backups/mbox files from archive.org (several TB compressed) without any filtering and accepted
every group that showed up which results in 471k groups so far at the Full-Node.

'news.software.nntp' for example dates back to 1987.

it should be readable via NNTP

Part-Node (111k groups)
file: http://104.244.74.85/usenet/active/part.active.txt
host: 104.244.74.85:11119
user: freefree
pass: freefree


Full-Node (471k groups)
file: http://104.244.74.85/usenet/active/full.active.txt
host: 104.244.74.85:11120
user: freefree
pass: freefree

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On Sun, 12 May 2024 13:41:45 +0200
"Billy G. (go-while)" <no-reply@no.spam> wrote:

On 28.03.24 20:11, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext
historical and curent Usenet feeds.

Will anyone give a ballpark number?

Which peers have articles remotest in antiquity?

Even guesstimates might be useful.

i've imported and deduped all available usenet backups/mbox files
from archive.org (several TB compressed) without any filtering and
accepted every group that showed up which results in 471k groups so
far at the Full-Node.

'news.software.nntp' for example dates back to 1987.

it should be readable via NNTP

Part-Node (111k groups)
file: http://104.244.74.85/usenet/active/part.active.txt
host: 104.244.74.85:11119
user: freefree
pass: freefree

Full-Node (471k groups)
file: http://104.244.74.85/usenet/active/full.active.txt
host: 104.244.74.85:11120
user: freefree
pass: freefree

Unable to contact either server .....

torsocks telnet 104.244.74.85 11119
[proxychains] config file found: /etc/onion.proxychains.conf
[proxychains] preloading /usr/lib/x86_64-linux-gnu/libproxychains.so.4
Trying 104.244.74.85...
telnet: Unable to connect to remote host: Connection refused

torsocks wget http://104.244.74.85/usenet/active/full.active.txt
[proxychains] config file found: /etc/onion.proxychains.conf
[proxychains] preloading /usr/lib/x86_64-linux-gnu/libproxychains.so.4 --2024-09-27
12:40:55-- http://104.244.74.85/usenet/active/full.active.txt Connecting to 104.244.74.85:80... failed: Connection refused.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On Fri, 27 Sep 2024 17:43:08 -0000, Tor User <onion@example.invalid> wrote:

On Sun, 12 May 2024 13:41:45 +0200
"Billy G. (go-while)" <no-reply@no.spam> wrote:

On 28.03.24 20:11, SugarBug wrote:

I wonder how many peers are carrying and preserving fulltext
historical and curent Usenet feeds.
Will anyone give a ballpark number?
Which peers have articles remotest in antiquity?
Even guesstimates might be useful.

i've imported and deduped all available usenet backups/mbox files
from archive.org (several TB compressed) without any filtering and
accepted every group that showed up which results in 471k groups so
far at the Full-Node.
'news.software.nntp' for example dates back to 1987.
it should be readable via NNTP
Part-Node (111k groups)
file: http://104.244.74.85/usenet/active/part.active.txt
host: 104.244.74.85:11119
user: freefree
pass: freefree

Full-Node (471k groups)
file: http://104.244.74.85/usenet/active/full.active.txt
host: 104.244.74.85:11120
user: freefree
pass: freefree

Unable to contact either server .....
torsocks telnet 104.244.74.85 11119
[proxychains] config file found: /etc/onion.proxychains.conf
[proxychains] preloading /usr/lib/x86_64-linux-gnu/libproxychains.so.4
Trying 104.244.74.85...
telnet: Unable to connect to remote host: Connection refused

torsocks wget http://104.244.74.85/usenet/active/full.active.txt >[proxychains] config file found: /etc/onion.proxychains.conf
[proxychains] preloading /usr/lib/x86_64-linux-gnu/libproxychains.so.4 >--2024-09-27
12:40:55-- http://104.244.74.85/usenet/active/full.active.txt Connecting to 104.244.74.85:80... failed: Connection refused.

they were working for a few days (maybe weeks?) after this . . .

Date: Thu, 6 Jun 2024 01:39:33 +0200
Subject: Re: github.com/go-while/nntp-overview
Newsgroups: news.software.nntp
References: <6SGrM.427956$hTH1.411991@fx14.ams4>
From: "Billy G. (go-while)" <no-reply@no.spam>
Organization: github.com/go-while
Message-ID: <6660e7cf$0$31818$882e4bbb@reader.netnews.com>

On 13.07.23 02:12, go-while wrote:

Hello World!
just want to create a topic for my repo. maybe anyone finds it useful.
https://github.com/go-while/nntp-overview
it is running great so far and connected to a usenet server i'm writing.
Author
go-while

Update:
It's running! got 1.5 billion articles in this overview code
mariadb with rocksDB engine is powering the hashdb now
I'v put all sha256 hashs of message-ids with size in rocksdb
4k tables 000-fff, cutting first 3 chars of hash
only 75gigs of hashs in this database :D
maybe a little more. zfs compression earned 13%
Billy G. (go-while)

[end quoted excerpt]

but the results had very distinctive gaps, as in incomplete;
akaik, blueworld is the most complete free nntp server with
about 21+ years retention with many older archived articles
in quite a few newsgroups that i have tested over the years;

see also utzoo-wiseman archive http://annex.retroarchive.org/utzoo, https://archive.org/details/usenethistorical with many hierarchies;

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)