First, I'd like to pick and choose which groups I want to get, for a
test, and then grab whole hierarchies such as soc.*
Second, I know there's a few programs that'll do this, I believe INN
comes with one and there's suck, I think. What would be the best one
to use?
Finally, I absolutely positively do not want to propagate these new
(but really old) articles to my peers. Last thing I want is every news
admin calling for my head on a block. What would be the best/proper way
to ensure these articles don't get sent out once they're injected?
Finally finally...anything else I haven't thought of that I should
consider before doing this? (apart from the obvious amount of bandwidth
and disk space) etc?
INN comes with pullnews:
https://www.eyrie.org/~eagle/software/inn/docs/pullnews.html
I've not compared how fast pullnews and suck perform each other. I
believe both of them will do the job for you.
Good question.
I assume your news server is already receiving and transferring news
with peers.
Maybe other people will have a better suggestion. I would just use something like "pullnews -F pulled" to add "pulled" in the Path
header field of articles you're pulling. And for every outgoing feed parametered in your newsfeeds file, add "pulled" in the exclusion
pattern:
news.server.com/pulled:*:Tm:innfeed!
I assume you've read the beginning of:
https://www.eyrie.org/~eagle/faqs/inn.html#S6.4
notably saying to disable Perl and Python filter hooks, and
parametring INN not to reject articles older than 10 days (which is
the default). Also make sure to correctly configure expire.ctl not to
expire the articles :-)
... and choose well your overview and storage methods :-)
If you're using INN 2.6.x, maybe tradindexed (overview) and CNFS
(storage) would be the best. Make sure to create the right amount of
CNFS buffers so that they do not wrap and erase old articles. You
can add new ones whenever you want.
*:A:never:never:never
I do believe that should keep articles for a long time.
... and choose well your overview and storage methods :-)
If you're using INN 2.6.x, maybe tradindexed (overview) and CNFS
(storage) would be the best. Make sure to create the right amount of
CNFS buffers so that they do not wrap and erase old articles. You
can add new ones whenever you want.
I am using 2.6.x. Just regular disk storage, will be easier for me to
throw more disk space at it, if I need it.
When speaking of CNFS for storage, I meant regular disk storage with
"method cnfs" in storage.conf instead of "method tradspool" (the
default). There's 1 file per article with tradspool whereas CNFS uses
large buffer files containing lots of articles (even millions if the
buffer is large enough).
If you never expire articles, tradspool will consume more and more
inodes.
Is it possible to convert from tradspool to cnfs or do I need to start
from scratch? I guess this might be in the faq so I'll look there
anyway.
I'm concerned about allocating enough space for all the articles I'm
about to drag down v over allocating and wasting space that won't be
used.
Sysop: | Keyop |
---|---|
Location: | Huddersfield, West Yorkshire, UK |
Users: | 307 |
Nodes: | 16 (2 / 14) |
Uptime: | 79:43:19 |
Calls: | 6,915 |
Files: | 12,382 |
Messages: | 5,433,003 |