• Throughput of the Big 8 hierarchies

    From Tanguy Ortolo@21:1/5 to All on Thu Sep 14 08:14:01 2017
    Hello,

    I am configuring my newly installed new server, and I am considering distributing the Big 8 hierarchies. To help with that decision, would
    anyone have some figures about the data throughput of these hierarchies?
    By that, I mean something like how many me{ga|bi}bytes of data are
    received each day on comp.*, humanities.*, misc.*, news.*, rec.*, sci.*,
    soc.* and talk.*.

    I also need to determine how much storage space that will take depending
    on the retention time I will set, but this is simply a matter of making
    one multiplication. Okay, that does not take cancellations into
    account. :-)

    Cheers,

    --
    Tanguy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Richard Kettlewell@21:1/5 to Tanguy Ortolo on Thu Sep 14 09:20:37 2017
    Tanguy Ortolo <tanguy@ortolo.eu> writes:
    I am configuring my newly installed new server, and I am considering distributing the Big 8 hierarchies. To help with that decision, would
    anyone have some figures about the data throughput of these hierarchies?
    By that, I mean something like how many me{ga|bi}bytes of data are
    received each day on comp.*, humanities.*, misc.*, news.*, rec.*, sci.*, soc.* and talk.*.

    I’ve been tracking this information since 2010.

    http://www.greenend.org.uk/rjk/spoolstats/

    --
    https://www.greenend.org.uk/rjk/

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Kevin Bowling@21:1/5 to Tanguy Ortolo on Thu Sep 14 02:13:25 2017
    On 09/14/17 01:14, Tanguy Ortolo wrote:
    Hello,

    I am configuring my newly installed new server, and I am considering distributing the Big 8 hierarchies. To help with that decision, would
    anyone have some figures about the data throughput of these hierarchies?
    By that, I mean something like how many me{ga|bi}bytes of data are
    received each day on comp.*, humanities.*, misc.*, news.*, rec.*, sci.*, soc.* and talk.*.

    I also need to determine how much storage space that will take depending
    on the retention time I will set, but this is simply a matter of making
    one multiplication. Okay, that does not take cancellations into
    account. :-)

    Cheers,



    I use FreeBSD with ZFS, which does very efficient transparent
    compression, and I run inn with tradspool and tradindex on that with no
    limit on retention. A full text feed (with alt and others) is maybe
    10GB a year. Stats are on http://csiph.com/.

    Regards,
    Kevin

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Tanguy Ortolo@21:1/5 to All on Thu Sep 14 09:16:06 2017
    Richard Kettlewell, 2017-09-14 10:20+0200:
    I’ve been tracking this information since 2010.

    http://www.greenend.org.uk/rjk/spoolstats/

    Wonderful, thank you! Well, I will have no problem distributing the Big
    8 with 90 days of retentions I think.

    --
    Tanguy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Aioe@21:1/5 to All on Thu Sep 14 15:10:29 2017
    Il Thu, 14 Sep 2017 08:14:01 +0000, Tanguy Ortolo ha scritto:

    I mean something like how many me{ga|bi}bytes of data are received each
    day on comp.*, humanities.*, misc.*, news.*, rec.*, sci.*,
    soc.* and talk.*.

    a few stats are at https://news.aioe.org/index.php?id=articles-per-
    hierarchy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Aioe@21:1/5 to All on Thu Sep 14 15:11:02 2017
    Il Thu, 14 Sep 2017 15:10:29 +0000, Aioe ha scritto:

    a few stats are at https://news.aioe.org/index.php?id=articles-per-
    hierarchy

    https://news.aioe.org/index.php?id=articles-per-hierarchy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Tanguy Ortolo@21:1/5 to All on Thu Sep 14 15:34:06 2017
    Aioe, 2017-09-14 17:10+0200:
    a few stats are at https://news.aioe.org/index.php?id=articles-per-
    hierarchy

    Thank you! I have already started distributing the Big 8, that now
    confirms this is working. :-)

    --
    Tanguy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)