• Running a windows 7 firmwre updater on RaspiOS

    From bob prohaska@3:770/3 to All on Sat Dec 12 02:03:52 2020
    I'd like to try running a firmware updater for a USB hard drive enclosure. Supposedly TRIM can be enabled via the updater, but it requires Windows 7.
    The host is an 8GB Pi4 running 32bit RaspiOS. The updater is at https://www.sabrent.com/download/ec-uasp-update/
    It isn't entirely clear the updater is needed, but running it seems prudent.

    I've tried WINE, but it reports BAD FORMAT, I gather the result of the
    updater being written for i386 architechture.

    Is there any other way to proceed? I don't own any modern i386 hardware,
    nor a Win7 license and don't realy want to buy either. I do have an old
    Xeon box, but it probably doesn't have enough RAM to install Windows 7.

    The WINE version installed using apt reports
    wine --version
    wine-4.0 (Raspbian 4.0-2)

    Might a later version of WINE help, if it can be found and made to run on
    the Pi4?

    Thanks for reading!

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Computer Nerd Kev@3:770/3 to bob prohaska on Sat Dec 12 06:35:58 2020
    bob prohaska <bp@www.zefox.net> wrote:
    I'd like to try running a firmware updater for a USB hard drive enclosure. Supposedly TRIM can be enabled via the updater, but it requires Windows 7. The host is an 8GB Pi4 running 32bit RaspiOS. The updater is at https://www.sabrent.com/download/ec-uasp-update/
    It isn't entirely clear the updater is needed, but running it seems prudent.

    I've tried WINE, but it reports BAD FORMAT, I gather the result of the updater being written for i386 architechture.

    Is there any other way to proceed? I don't own any modern i386 hardware,
    nor a Win7 license and don't realy want to buy either. I do have an old
    Xeon box, but it probably doesn't have enough RAM to install Windows 7.

    The WINE version installed using apt reports
    wine --version
    wine-4.0 (Raspbian 4.0-2)

    Might a later version of WINE help, if it can be found and made to run on
    the Pi4?

    No because WINE isn't a CPU emulator - it's a compatibility layer
    that translates Windows API calls. If your program is compiled for
    x86, you'll need something that can execute x86 instructions.

    https://wiki.winehq.org/ARM

    QEMU has some support for passing physical USB devices over to
    software running in emulation: https://qemu.readthedocs.io/en/latest/system/usb.html

    Links for setting up x86 WINE on a Pi using QEMU are aplenty: https://wiki.winehq.org/Emulation (see bottom for what you presumably
    had in mind originally) https://sourceforge.net/projects/pi-qemu-wine/ https://www.novaspirit.com/2019/04/15/run-x86-arm/

    --
    __ __
    #_ < |\| |< _#

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From David Taylor@3:770/3 to Computer Nerd Kev on Sat Dec 12 09:17:04 2020
    On 12/12/2020 06:35, Computer Nerd Kev wrote:
    No because WINE isn't a CPU emulator - it's a compatibility layer
    that translates Windows API calls. If your program is compiled for
    x86, you'll need something that can execute x86 instructions.

    https://wiki.winehq.org/ARM

    QEMU has some support for passing physical USB devices over to
    software running in emulation: https://qemu.readthedocs.io/en/latest/system/usb.html

    Links for setting up x86 WINE on a Pi using QEMU are aplenty: https://wiki.winehq.org/Emulation (see bottom for what you presumably
    had in mind originally) https://sourceforge.net/projects/pi-qemu-wine/ https://www.novaspirit.com/2019/04/15/run-x86-arm/

    ... and Windows may include an ARM-based Intel-64-bit emulator in a
    future release:


    https://www.theverge.com/2020/12/10/22168542/x64-emulation-windows-on-arm-surfa ce-pro-x

    Some way to go having it running on the RPi, of course.

    --
    Cheers,
    David
    Web: http://www.satsignal.eu

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Theo@3:770/3 to Computer Nerd Kev on Sat Dec 12 10:45:19 2020
    Computer Nerd Kev <not@telling.you.invalid> wrote:
    No because WINE isn't a CPU emulator - it's a compatibility layer
    that translates Windows API calls. If your program is compiled for
    x86, you'll need something that can execute x86 instructions.

    https://wiki.winehq.org/ARM

    QEMU has some support for passing physical USB devices over to
    software running in emulation: https://qemu.readthedocs.io/en/latest/system/usb.html

    If the drive is USB I'd be looking at Qemu's USB passthrough at a minimum: I doubt WINE would support such access. However, given the risk of bricking
    the drive if the firmware upgrade goes wrong, I would much prefer to do this
    on a real Windows box. Much less chance of something breaking halfway
    through.

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Theo on Sat Dec 12 17:29:03 2020
    Theo <theom+news@chiark.greenend.org.uk> wrote:

    If the drive is USB I'd be looking at Qemu's USB passthrough at a minimum: I doubt WINE would support such access. However, given the risk of bricking the drive if the firmware upgrade goes wrong, I would much prefer to do this on a real Windows box. Much less chance of something breaking halfway through.

    Yes, the drive is USB. I agree completely that using a native Windows box is best, but I don't have one.

    Apt search reports a bunch of qemu-related packages, one of which is called qemu-system-arm/stable 1:3.1+dfsg-8+deb10u8 armhf
    QEMU full system emulation binaries (arm)

    Would that be the package to try? It's unclear to me if -arm refers to
    the host architecture or the emulated architechture....

    Thanks for posting!

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Tauno Voipio@3:770/3 to bob prohaska on Sat Dec 12 21:29:06 2020
    On 12.12.20 19.29, bob prohaska wrote:
    Theo <theom+news@chiark.greenend.org.uk> wrote:

    If the drive is USB I'd be looking at Qemu's USB passthrough at a minimum: >> doubt WINE would support such access. However, given the risk of bricking >> the drive if the firmware upgrade goes wrong, I would much prefer to do this
    on a real Windows box. Much less chance of something breaking halfway
    through.

    Yes, the drive is USB. I agree completely that using a native Windows box is best, but I don't have one.

    Apt search reports a bunch of qemu-related packages, one of which is called qemu-system-arm/stable 1:3.1+dfsg-8+deb10u8 armhf
    QEMU full system emulation binaries (arm)

    Would that be the package to try? It's unclear to me if -arm refers to
    the host architecture or the emulated architechture....

    Thanks for posting!

    bob prohaska


    If you do mind the risk of bricking the drive, please buy, beg or
    borrow a genuine Windows 7 box for the upgrade.

    These hardware guys' Windows programs are particularly fussy
    about really running on Windows (and the version suggested).

    --

    -TV

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Computer Nerd Kev@3:770/3 to bob prohaska on Sat Dec 12 21:41:02 2020
    bob prohaska <bp@www.zefox.net> wrote:
    Theo <theom+news@chiark.greenend.org.uk> wrote:

    If the drive is USB I'd be looking at Qemu's USB passthrough at a minimum: >> doubt WINE would support such access. However, given the risk of bricking >> the drive if the firmware upgrade goes wrong, I would much prefer to do this
    on a real Windows box. Much less chance of something breaking halfway
    through.

    Yes, the drive is USB. I agree completely that using a native Windows box is best, but I don't have one.

    Apt search reports a bunch of qemu-related packages, one of which is called qemu-system-arm/stable 1:3.1+dfsg-8+deb10u8 armhf
    QEMU full system emulation binaries (arm)

    Would that be the package to try? It's unclear to me if -arm refers to
    the host architecture or the emulated architechture....

    Unless you've put other architectures in your /etc/apt/sources.list
    (or associated files), then you should only be seeing packages for
    ARM host architecture. That one presumably applies to running ARM
    emulation on ARM, "armhf" at the end indicates that it's an ARM
    package.

    But I'd agree with others here that the odds of this all working are
    very much against you. WINE and QEMU are both extra layers that have
    pretty dodgy support for what you're doing. WINE's hardware USB
    support isn't clearly documented, but might be mainly geared at
    things like game controllers which are HID devices. HIDs work more
    simply than other USB devices like your HDD.

    If you set up a real Windows installation in QEMU, that gives you
    a bit more likelihood of success, but I still wouldn't bet on it.

    --
    __ __
    #_ < |\| |< _#

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Deloptes@3:770/3 to bob prohaska on Sun Dec 13 00:08:38 2020
    bob prohaska wrote:

    Would that be the package to try? It's unclear to me if -arm refers to
    the host architecture or the emulated architechture....

    it is the emulated architecture

    you would need the -x86 package on the rpi. Consider that then you have to install windows7 in the qemu. I have no idea how good it is supported. But
    if the drive is so important, given the risk that you can brick it and the
    time and work you will invest, wouldn't be it better to buy a used laptop
    with windows7 on it?

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Computer Nerd Kev on Sun Dec 13 01:07:01 2020
    Computer Nerd Kev <not@telling.you.invalid> wrote:

    But I'd agree with others here that the odds of this all working are
    very much against you. WINE and QEMU are both extra layers that have
    pretty dodgy support for what you're doing. WINE's hardware USB
    support isn't clearly documented, but might be mainly geared at
    things like game controllers which are HID devices. HIDs work more
    simply than other USB devices like your HDD.

    If you set up a real Windows installation in QEMU, that gives you
    a bit more likelihood of success, but I still wouldn't bet on it.


    My understanding of what's easy to do is clearly naive.

    Thanks for bringing me down to earth 8-(

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Computer Nerd Kev@3:770/3 to Deloptes on Sun Dec 13 01:36:17 2020
    Deloptes <deloptes@gmail.com> wrote:
    wouldn't be it better to buy a used laptop with windows7 on it?

    In the past when WINE hasn't worked but I really needed to run
    Windows software on a current Windows release (the Australian
    government's tax return submission software - thankfully now
    implemented as a website), I used an "internet computer" at the
    local library. Since moving, I found that the local community centre
    offers a similar local service, though I haven't had to try that yet.

    --
    __ __
    #_ < |\| |< _#

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Deloptes@3:770/3 to Computer Nerd Kev on Sun Dec 13 12:06:58 2020
    Computer Nerd Kev wrote:

    In the past when WINE hasn't worked but I really needed to run
    Windows software on a current Windows release (the Australian
    government's tax return submission software - thankfully now
    implemented as a website), I used an "internet computer" at the
    local library. Since moving, I found that the local community centre
    offers a similar local service, though I haven't had to try that yet.

    I doubt it is helpful in the case, because on such computers you can not execute code as administrator, which is mostly the case if you have to do a firmware upgrade.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Deloptes on Sun Dec 13 16:38:29 2020
    Deloptes <deloptes@gmail.com> wrote:
    bob prohaska wrote:

    Would that be the package to try? It's unclear to me if -arm refers to
    the host architecture or the emulated architechture....

    it is the emulated architecture

    you would need the -x86 package on the rpi. Consider that then you have to install windows7 in the qemu. I have no idea how good it is supported. But
    if the drive is so important, given the risk that you can brick it and the time and work you will invest, wouldn't be it better to buy a used laptop with windows7 on it?

    It seems more cost-effective to keep searching for a USB-SATA enclosure or adapter that correctly supports the Pi4's implementation of UASP. Even a
    rather expensive adapter will be cheaper than a second-hand laptop if a candidate can be identified.

    It's a bit surprising that nobody has collected a list of suitable adapters. Perhaps one is out there, but I've not found it in considerable looking.

    Then again, it may all be a wild goose chase. The drive and adapter I'm
    using now, a Sabrent EC-UASP, works in a subjectively acceptable way. The sticking points are a report that the firmware upgrade is needed to support TRIM and a poor performance report from the Pi's SD card speed test utility:

    Raspberry Pi Diagnostics - version 0.5
    Sun Dec 13 07:48:49 2020

    Test : SD Card Speed Test
    Run 1
    prepare-file;0;0;92174;180
    seq-write;0;0;100979;197
    rand-4k-write;0;0;1200;300
    rand-4k-read;254;63;0;0
    Sequential write speed 100979 KB/sec (target 10000) - PASS
    Random write speed 300 IOPS (target 500) - FAIL
    Random read speed 63 IOPS (target 1500) - FAIL
    Run 2
    prepare-file;0;0;79245;154
    seq-write;0;0;83912;163
    rand-4k-write;0;0;1274;318
    rand-4k-read;271;67;0;0
    Sequential write speed 83912 KB/sec (target 10000) - PASS
    Random write speed 318 IOPS (target 500) - FAIL
    Random read speed 67 IOPS (target 1500) - FAIL
    Run 3
    prepare-file;0;0;59959;117
    seq-write;0;0;58671;114
    rand-4k-write;0;0;677;169
    rand-4k-read;366;91;0;0
    Sequential write speed 58671 KB/sec (target 10000) - PASS
    Random write speed 169 IOPS (target 500) - FAIL
    Random read speed 91 IOPS (target 1500) - FAIL
    Test FAIL

    This is with a 5400 RPM mechanical hard disk, so rotational latency
    precludes excellent random performance. Still, the subjective "feel"
    of the machine is reasonably good; it's fast enough to use as a
    chromium browser workstation.

    It's unclear if the adapter supports trim as-is. One report on Amazon's
    review pages says the update is required. An examination of the system
    per the instructions at

    https://www.jeffgeerling.com/blog/2020/enabling-trim-on-external-ssd-on-raspber ry-pi
    suggests the adapter and hard drive both support TRIM:

    Maximum unmap LBA count: 65535
    Maximum unmap block descriptor count: 8
    Unmap command supported (LBPU): 1

    In addition, the disk reports:
    Data Set Management TRIM supported (limit 8 blocks)
    suggesting it's an SMR drive.

    I attribute the acceptable performance to the drive being new,
    with 1 TB capacity. Once it starts re-writing old sectors it'll
    likely slow much more.

    Thanks for reading this far!

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to bob prohaska on Sun Dec 13 19:13:33 2020
    On Sun, 13 Dec 2020 16:38:29 +0000, bob prohaska wrote:

    I attribute the acceptable performance to the drive being new,
    with 1 TB capacity. Once it starts re-writing old sectors it'll likely
    slow much more.

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large scale
    data storage with minimal updating, i.e. not something I'd use for the
    (main? only?) storage volume for a Linux or Windows system and definitely
    not for a journalled fling system.


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Deloptes@3:770/3 to Martin Gregorie on Sun Dec 13 21:04:21 2020
    Martin Gregorie wrote:

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large scale data storage with minimal updating, i.e. not something I'd use for the
    (main? only?) storage volume for a Linux or Windows system and definitely
    not for a journalled fling system.

    SMR means "keep hands off!" from what I know useful only in OEM equipment.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Martin Gregorie on Sun Dec 13 21:09:15 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Sun, 13 Dec 2020 16:38:29 +0000, bob prohaska wrote:

    I attribute the acceptable performance to the drive being new,
    with 1 TB capacity. Once it starts re-writing old sectors it'll likely
    slow much more.

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large scale data storage with minimal updating, i.e. not something I'd use for the
    (main? only?) storage volume for a Linux or Windows system and definitely
    not for a journalled fling system.

    Practically, SMR is not readily avoidable. It's denser and therefore cheaper than conventional perpendicular recording and has found its way, unbidden, to
    a wide range of sizes, speeds and brands. The drawback is that, like flash, data is written in relatively large blocks. Writes to an entirely unused
    block proceed without a delay. Changes to an already-written block require
    it be copied, edited and re-written in much the same fashion as flash, absent the write fatigue problems of flash. Trim functions on an SMR drive much as
    it does on a flash device, preemptively preparing new, empty blocks for prompt use by consolidating partly-used blocks accumulated during earlier writes.

    When something triggers a long period of sustained writes, like reconstructing a raid array, this overwhelms the preparatory consolidation and slows writes
    to a crawl. It's not that it doesn't work, rather that it works badly.

    I should emphasize that this summary is my own interpretation of a random selection of Internet research, and is therefore entirely suspect......


    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From David Higton@3:770/3 to bob prohaska on Sun Dec 13 22:37:26 2020
    In message <rr5vtr$21r$1@dont-email.me>
    bob prohaska <bp@www.zefox.net> wrote:

    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Sun, 13 Dec 2020 16:38:29 +0000, bob prohaska wrote:

    I attribute the acceptable performance to the drive being new, with 1
    TB capacity. Once it starts re-writing old sectors it'll likely slow
    much more.

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large
    scale data storage with minimal updating, i.e. not something I'd use
    for the (main? only?) storage volume for a Linux or Windows system and definitely not for a journalled fling system.

    Practically, SMR is not readily avoidable. It's denser and therefore
    cheaper than conventional perpendicular recording and has found its way, unbidden, to a wide range of sizes, speeds and brands. The drawback is
    that, like flash, data is written in relatively large blocks. Writes to an entirely unused block proceed without a delay. Changes to an
    already-written block require it be copied, edited and re-written in much
    the same fashion as flash, absent the write fatigue problems of flash. Trim functions on an SMR drive much as it does on a flash device, preemptively preparing new, empty blocks for prompt use by consolidating partly-used blocks accumulated during earlier writes.

    When something triggers a long period of sustained writes, like reconstructing a raid array, this overwhelms the preparatory consolidation and slows writes to a crawl. It's not that it doesn't work, rather that it works badly.

    I should emphasize that this summary is my own interpretation of a random selection of Internet research, and is therefore entirely suspect......

    I've drawn the same conclusions as you, from what I've read. With one
    small exception: I believe that, if you dig deeply enough into the manufacturer's specification, you can see whether a particular drive
    uses SMR, and therefore avoid it if you so wish.

    David

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to David Higton on Mon Dec 14 00:43:16 2020
    David Higton <dave@davehigton.me.uk> wrote:
    In message <rr5vtr$21r$1@dont-email.me>
    bob prohaska <bp@www.zefox.net> wrote:

    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Sun, 13 Dec 2020 16:38:29 +0000, bob prohaska wrote:

    I attribute the acceptable performance to the drive being new, with 1
    TB capacity. Once it starts re-writing old sectors it'll likely slow
    much more.

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large
    scale data storage with minimal updating, i.e. not something I'd use
    for the (main? only?) storage volume for a Linux or Windows system and
    definitely not for a journalled fling system.

    Practically, SMR is not readily avoidable. It's denser and therefore
    cheaper than conventional perpendicular recording and has found its way,
    unbidden, to a wide range of sizes, speeds and brands. The drawback is
    that, like flash, data is written in relatively large blocks. Writes to an >> entirely unused block proceed without a delay. Changes to an
    already-written block require it be copied, edited and re-written in much
    the same fashion as flash, absent the write fatigue problems of flash. Trim >> functions on an SMR drive much as it does on a flash device, preemptively
    preparing new, empty blocks for prompt use by consolidating partly-used
    blocks accumulated during earlier writes.

    When something triggers a long period of sustained writes, like
    reconstructing a raid array, this overwhelms the preparatory consolidation >> and slows writes to a crawl. It's not that it doesn't work, rather that it >> works badly.

    I should emphasize that this summary is my own interpretation of a random
    selection of Internet research, and is therefore entirely suspect......

    I've drawn the same conclusions as you, from what I've read. With one
    small exception: I believe that, if you dig deeply enough into the manufacturer's specification, you can see whether a particular drive
    uses SMR, and therefore avoid it if you so wish.

    Apparently that is a comparatively recent development. There were complaints that SMR was deployed without warning. In the case of my drive, specs at https://www.seagate.com/www-content/product-content/seagate-laptop-fam/barracud a_25/en-us/docs/100807728a.pdf
    the drive is advertised as PMR but also supports TRIM. AFAIK there's little point
    in having both. There is also no spec for write speed, only read. The combination
    is at least a little suspicious.

    Exactly what's going on is unclear. Certainly, it pays to check first.

    Thanks for writing!

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From druck@3:770/3 to Martin Gregorie on Mon Dec 14 09:15:10 2020
    On 13/12/2020 19:13, Martin Gregorie wrote:
    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity,
    WD SMR drives support TRIM.

    ---druck

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to druck on Mon Dec 14 12:09:30 2020
    On Mon, 14 Dec 2020 09:15:10 +0000, druck wrote:

    On 13/12/2020 19:13, Martin Gregorie wrote:
    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity,
    WD SMR drives support TRIM.

    Useful to know.

    Next question: how to find out whether a WD hard drive is plain old disk
    SMR.

    I bought a pair of 1GB WD Elements at the beginning of 2019 for use as
    weekly backups that are kept offline when not actually doing a backup.

    I'm using rsync to back up 4 computers (3 running 64 bit Fedora, the
    fourth is an early 512MB Rpi B) so all other things being equal, I'd
    expect to see backup activity to be pretty consistent for each machine,
    which is what I'm seeing: in no case have I seen the sort of slowdown
    which is apparently noticeable with SMR disks.

    So, my guess is that these are not SMR, but who knows: I haven't found
    any indication of drive technology in the so-called data sheet for for
    these drives on the WD website - just a not that WD feel free to mix and
    match drive type between production batches.

    Is there any other site that would know/admit what type of drive is in
    these WD Elements sealed units?


    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Martin Gregorie on Tue Dec 15 02:01:08 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Mon, 14 Dec 2020 09:15:10 +0000, druck wrote:

    On 13/12/2020 19:13, Martin Gregorie wrote:
    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity,
    WD SMR drives support TRIM.

    Useful to know.

    Next question: how to find out whether a WD hard drive is plain old disk
    SMR.

    [snip]

    Is there any other site that would know/admit what type of drive is in
    these WD Elements sealed units?



    It might help to check these: https://www.truenas.com/community/resources/list-of-known-smr-drives.141/ https://itigic.com/smr-hard-drive-this-is-the-list-of-models/ https://nascompares.com/2020/04/16/your-wd-red-nas-hard-drives-might-be-using-s mr-what-you-need-to-know/

    But, for my Seagate, I found two sources, both from Seagate, that seem
    to disagree. The first: https://www.seagate.com/internal-hard-drives/cmr-smr-list/
    implies all 2.5" Barracuda drives use SMR

    The second https://www.seagate.com/www-content/product-content/seagate-laptop-fam/barracud a_25/en-us/docs/100807728a.pdf
    reports "perpendicular magnetic recording", which implies not SMR.

    I don't know which to believe.

    If you find other references please post.

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Theo@3:770/3 to bob prohaska on Tue Dec 15 12:37:14 2020
    bob prohaska <bp@www.zefox.net> wrote:
    But, for my Seagate, I found two sources, both from Seagate, that seem
    to disagree. The first: https://www.seagate.com/internal-hard-drives/cmr-smr-list/
    implies all 2.5" Barracuda drives use SMR

    The second

    https://www.seagate.com/www-content/product-content/seagate-laptop-fam/barracud a_25/en-us/docs/100807728a.pdf
    reports "perpendicular magnetic recording", which implies not SMR.

    I think Seagate are specifically referring to drives currently on the market, not past models. It's also not unusual for manufacturers not to disclose
    about USB drives, only SATA drives. Previously SMR was only on very large drives (8+GB) but recently it's started creeping into smaller drives (to
    save costs, not that drive prices have come down much).

    I don't know which to believe.

    If you have the drive plugged in, run:

    smartctl -a /dev/sdX

    (may have to install smartmontools package)
    That should tell you the model number of the drive mechanism inside the USB enclosure. Then Google for that.

    (it is possible smartctl may need an additional flag if your USB enclosure needs special handling to pass SMART commands - see the help for some
    examples)

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From druck@3:770/3 to Theo on Tue Dec 15 12:51:47 2020
    On 15/12/2020 12:37, Theo wrote:
    I think Seagate are specifically referring to drives currently on the
    market,
    not past models. It's also not unusual for manufacturers not to disclose about USB drives, only SATA drives. Previously SMR was only on very large drives (8+GB) but recently it's started creeping into smaller drives (to
    save costs, not that drive prices have come down much).

    Hard drive prices will probably increase as volumes decrease due to
    SSDs. They will only make the larger and more expensive spinning rust
    drives, and anything marketed in smaller sizes is probably going to be a
    larger drive where one of the platters has failed QA.

    ---druck

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to bob prohaska on Tue Dec 15 12:46:09 2020
    On Tue, 15 Dec 2020 02:01:08 +0000, bob prohaska wrote:

    It might help to check these: https://www.truenas.com/community/resources/list-of-known-smr-drives.
    141/
    https://itigic.com/smr-hard-drive-this-is-the-list-of-models/ https://nascompares.com/2020/04/16/your-wd-red-nas-hard-drives-might-be-
    using-smr-what-you-need-to-know/

    Thanks for the links: most useful.

    Its interesting that the WD blurb on Elements portable USB drives
    basically says "the drive type inside is whatever we had in the stock bin
    when we did the production run", so either I got lucky, since mine seem
    to give fairly consistent backup times, or the current production policy
    was introduced after I got mine in early 2019.

    I don't know which to believe.

    My guess: the PHBs and bean counters have taken over, as in too many
    other companies, and are shitting on their customers, and probably staff
    too, because that way they can stuff more in their wallets.


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Martin Gregorie on Tue Dec 15 16:48:11 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:

    Its interesting that the WD blurb on Elements portable USB drives
    basically says "the drive type inside is whatever we had in the stock bin when we did the production run", so either I got lucky, since mine seem
    to give fairly consistent backup times, or the current production policy
    was introduced after I got mine in early 2019.


    AFAIK, SMR doesn't hurt performance until the drive starts re-writing previously-used sectors, rather like flash. If your drives haven't
    reached that point, they'll function roughly like CMR (also called PMR) devices. Given the capacity of SMR drives, it might make sense to just
    use them as approximately write-once devices.

    Still, I'd like to figure out how to enable TRIM, which brings me back
    to the issue of running the enclosure firmware updater, or determining
    that TRIM is already enabled on the enclosure. It seems clear that the
    disk and RaspiOS both support TRIM, it's just a matter of turning it on.

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Theo on Tue Dec 15 16:37:25 2020
    Theo <theom+news@chiark.greenend.org.uk> wrote:
    not past models. It's also not unusual for manufacturers not to disclose about USB drives, only SATA drives. Previously SMR was only on very large drives (8+GB) but recently it's started creeping into smaller drives (to
    save costs, not that drive prices have come down much).

    I don't know which to believe.

    If you have the drive plugged in, run:

    smartctl -a /dev/sdX

    (may have to install smartmontools package)
    That should tell you the model number of the drive mechanism inside the USB enclosure. Then Google for that.

    That doesn't help much. The drive model is ST1000LM048-2E7172
    The two Seagate documents still disagree. It's possible TRIM
    support was added pre-emptively, since firmware is free once
    written.

    Thanks for writing,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Scott Alfter@3:770/3 to bp@www.zefox.net on Tue Dec 15 18:24:08 2020
    In article <rr5vtr$21r$1@dont-email.me>,
    bob prohaska <bp@www.zefox.net> wrote:
    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Sun, 13 Dec 2020 16:38:29 +0000, bob prohaska wrote:

    I attribute the acceptable performance to the drive being new,
    with 1 TB capacity. Once it starts re-writing old sectors it'll likely
    slow much more.

    AFAIK trim isn't supposed to do anything useful to a hard drive
    regardless of speed or capacity, but I know nothing about SMR, except
    that an article I just read says its really only suitable for large scale
    data storage with minimal updating, i.e. not something I'd use for the
    (main? only?) storage volume for a Linux or Windows system and definitely
    not for a journalled fling system.

    Practically, SMR is not readily avoidable. It's denser and therefore cheaper >than conventional perpendicular recording and has found its way, unbidden, to >a wide range of sizes, speeds and brands.

    It shouldn't be in drives intended for NAS usage. The 8-TB Toshiba N300s I bought a couple months ago don't do SMR, and it looks like they offer capacities up to at least 14 TB. Look for "CMR" as the antonym of SMR.

    Looking at Toshiba's other drives, it appears the only ones that use SMR are their 2.5" drives. Seagate only uses it in 2.5" drives and their Barracuda
    and Archive drive families. Western Digital uses it in at least some 2.5" drives and some Blue and Red drives (what's troubling is that the Red drives are supposedly for NAS use, though all Red Pro drives and Red drives 8 TB and larger are CMR).

    It would seem that avoiding SMR isn't as difficult as it may have first appeared, though you are going to pay a bit more for drives that don't use
    it.

    _/_
    / v \ Scott Alfter (remove the obvious to send mail)
    (IIGS( https://alfter.us/ Top-posting!
    \_^_/ >What's the most annoying thing on Usenet?

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to bob prohaska on Tue Dec 15 19:22:57 2020
    On Tue, 15 Dec 2020 16:48:11 +0000, bob prohaska wrote:

    AFAIK, SMR doesn't hurt performance until the drive starts re-writing previously-used sectors, rather like flash. If your drives haven't
    reached that point, they'll function roughly like CMR (also called PMR) devices. Given the capacity of SMR drives, it might make sense to just
    use them as approximately write-once devices.

    I've no argument with that reasoning.

    But I suspect there are situations where SMR track rewrites have a
    greater throughput impact than that due to block remapping on SSD
    storage, simply because, while the way SSD drives remap blocks tends to distribute rewrites across the whole volume, if I've understood the
    process correctly, SMR rewrites tend to stay localised on or near the
    physical tracks occupied by the block being rewritten, so if a number of rewrites are done to physically adjacent data blocks, I can see a
    situation developing where te resulting series of track rewrites affect
    each other adversely, which could set off an avalanche of forced rewrites
    that really hammer throughput, not helped at all by the buffer tracks not
    being available to deal with unrelated writes and/or rewrites.

    Or something like that.

    As a result, if you've got an EXT4 or other journalling filesystem on the drive, particularly if the partitions are relatively full, you'll get the performance slowdowns a lot sooner, simply because the rate of rewrites
    will rise much faster than it ever does for cold data (transaction logs
    etc) being recorded in a non-journalling file system where rewrites
    hardly ever happen.

    Its somewhat unclear to me what exactly TRIM is meant to improve when
    used on an SMR drive: I can see that it would be a big help if it could defragment files etc, but surely that can't be done at the drive level
    since it implies some knowledge of the filing system's logical structure?


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Scott Alfter on Tue Dec 15 23:51:30 2020
    Scott Alfter <scott@alfter.diespammersdie.us> wrote:

    It shouldn't be in drives intended for NAS usage. The 8-TB Toshiba N300s I bought a couple months ago don't do SMR, and it looks like they offer capacities up to at least 14 TB. Look for "CMR" as the antonym of SMR.

    Looking at Toshiba's other drives, it appears the only ones that use SMR are their 2.5" drives. Seagate only uses it in 2.5" drives and their Barracuda and Archive drive families. Western Digital uses it in at least some 2.5" drives and some Blue and Red drives (what's troubling is that the Red drives are supposedly for NAS use, though all Red Pro drives and Red drives 8 TB
    and
    larger are CMR).

    It would seem that avoiding SMR isn't as difficult as it may have first appeared, though you are going to pay a bit more for drives that don't use it.

    It remains fairly difficult if I want a 2.5" drive rather than 3.5".
    Is there some special trick for finding them? By pure luck I found this: https://www.toshiba-storage.com/products/toshiba-internal-hard-drives-l200/

    which reports that these drives use CMR:
    HDWJ110UZSVA,
    HDWK105UZSVA,
    HDWJ105UZSVA

    Only the first is even listed on Amazon, with no sales nor reviews.
    It's particularly unhelpful that Amazon pads search results with
    unrelated products. An exact match search would help a lot.

    There are many online lists of SMR drives, it's not so easy to
    find non-SMR drives, especially in smaller sizes, for sale.

    If anybody has search terms or tips that help please post them.
    I'd like to stick with Amazon as the supplier.

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to bob prohaska on Wed Dec 16 00:50:42 2020
    On Tue, 15 Dec 2020 23:51:30 +0000, bob prohaska wrote:

    It remains fairly difficult if I want a 2.5" drive rather than 3.5".
    Is there some special trick for finding them? By pure luck I found
    this:
    https://www.toshiba-storage.com/products/toshiba-internal-hard-drives-
    l200/

    which reports that these drives use CMR:
    HDWJ110UZSVA,
    HDWK105UZSVA,
    HDWJ105UZSVA

    From the stuff you posted it appears that all WD 2.5" 500GB Blue and
    Black drives and 1GB Red drives are CMR.

    Similarly all WD 3.5" drives of 1TB or smaller are CMR and so are larger
    Red Pro, Black and Purple.

    That is for drives made in the first part of 2020 - after that its
    anybody's guess


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Martin Gregorie on Wed Dec 16 02:42:06 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Tue, 15 Dec 2020 23:51:30 +0000, bob prohaska wrote:

    It remains fairly difficult if I want a 2.5" drive rather than 3.5".
    Is there some special trick for finding them? By pure luck I found
    this:
    https://www.toshiba-storage.com/products/toshiba-internal-hard-drives-
    l200/

    which reports that these drives use CMR:
    HDWJ110UZSVA,
    HDWK105UZSVA,
    HDWJ105UZSVA

    From the stuff you posted it appears that all WD 2.5" 500GB Blue and
    Black drives and 1GB Red drives are CMR.

    Indeed, there do exist refurbs and old stock at 500 GB. Some of the new
    old stock is priced extravagantly, with neither reviews nor sales. No
    current, mainline products with clear specification that I can find.

    Similarly all WD 3.5" drives of 1TB or smaller are CMR and so are larger
    Red Pro, Black and Purple.

    It does appear that the best way to avoid SMR is to opt for 3.5" drives.
    Both selection and documentation are much better. It rather blows my
    "low power" goal out of the water, but I'm a niche buyer.

    That is for drives made in the first part of 2020 - after that its
    anybody's guess

    The trend to SMR is rather clear. I'd like to learn how to live with
    it, on the assumption that it's unavoidable for small, low power disks.
    It seems likely that documentation will improve as more people care.
    Perhaps SMR and CMR will become checkboxes on Amazon's product search 8-)

    Most of my concern over SMR was related to use as a swap device. With
    the advent of the 8GB Pi4 the swap issue seems to be gone. If TRIM
    can be made to work with an SMR mechanical disk there might not be a
    problem at all.

    Thanks to all for reading and replying!

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Theo@3:770/3 to bob prohaska on Wed Dec 16 11:44:23 2020
    bob prohaska <bp@www.zefox.net> wrote:
    That doesn't help much. The drive model is ST1000LM048-2E7172
    The two Seagate documents still disagree. It's possible TRIM
    support was added pre-emptively, since firmware is free once
    written.

    Googling indicates it's SMR: https://www.truenas.com/community/resources/list-of-known-smr-drives.141/

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Theo@3:770/3 to Martin Gregorie on Wed Dec 16 11:53:57 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:
    Its somewhat unclear to me what exactly TRIM is meant to improve when
    used on an SMR drive: I can see that it would be a big help if it could defragment files etc, but surely that can't be done at the drive level
    since it implies some knowledge of the filing system's logical structure?

    On SMR, writing is expensive because you have to rewrite the whole track
    (and overlapping ones I think). TRIM means the drive has a view of what
    data is valid and what isn't. That means the drive won't have to rewrite
    data that isn't valid. It can aggregate writes into empty tracks so that it minimises the amount of rewriting it has to do - if the drive is 'empty' it doesn't need to bother at all, just fill up the empty space.

    Like SSDs, it also means a more dynamic mapping of block addresses to
    physical location - rather than classical cylinder/head/sector addressing
    where there was a quasi-static mapping from block to location (unless you
    had sectors with errors), here that mapping gets permuted on a much more regular basis.

    That's for Drive-Managed SMR. For Host-Managed SMR the filesystem does
    this, being better placed to optimise the process.

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Theo on Wed Dec 16 15:31:44 2020
    Theo <theom+news@chiark.greenend.org.uk> wrote:
    bob prohaska <bp@www.zefox.net> wrote:
    That doesn't help much. The drive model is ST1000LM048-2E7172
    The two Seagate documents still disagree. It's possible TRIM
    support was added pre-emptively, since firmware is free once
    written.

    Googling indicates it's SMR: https://www.truenas.com/community/resources/list-of-known-smr-drives.141/


    Yes, and the product data sheet claims it's perpendicular: https://www.seagate.com/www-content/product-content/seagate-laptop-fam/barracud a_25/en-us/docs/100807728h.pdf

    One of the criticisms directed at manufacturers in general and WD in
    particular was a silent switch to SMR. After complaints, docs were
    updated to reflect the change.

    The gist is that published specs aren't necessarily a reliable guide. Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Ahem A Rivet's Shot@3:770/3 to bob prohaska on Wed Dec 16 21:33:07 2020
    On Wed, 16 Dec 2020 15:31:44 -0000 (UTC)
    bob prohaska <bp@www.zefox.net> wrote:

    The gist is that published specs aren't necessarily a reliable guide. Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    At that size either you use an SSD (NVMe for preference) or you're penny pinching.

    --
    Steve O'Hara-Smith | Directable Mirror Arrays C:\>WIN | A better way to focus the sun
    The computer obeys and wins. | licences available see
    You lose and Bill collects. | http://www.sohara.org/

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to Ahem A Rivet's Shot on Wed Dec 16 22:25:05 2020
    On Wed, 16 Dec 2020 21:33:07 +0000, Ahem A Rivet's Shot wrote:

    On Wed, 16 Dec 2020 15:31:44 -0000 (UTC)
    bob prohaska <bp@www.zefox.net> wrote:

    The gist is that published specs aren't necessarily a reliable guide.
    Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    At that size either you use an SSD (NVMe for preference) or you're penny pinching.

    Price difference between HDD and SSD are fairly close. eBuyer is flogging:
    - 2.5" WD Blue 500GB SATA for £37 (probably CMR)
    - Samsung 500GB SATA drives for £63.00
    or a PNY [never heard of em] 480GB SATA drive for £40.


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Ahem A Rivet's Shot on Thu Dec 17 00:42:26 2020
    Ahem A Rivet's Shot <steveo@eircom.net> wrote:
    On Wed, 16 Dec 2020 15:31:44 -0000 (UTC)
    bob prohaska <bp@www.zefox.net> wrote:

    The gist is that published specs aren't necessarily a reliable guide.
    Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    At that size either you use an SSD (NVMe for preference) or you're penny pinching.


    The latter.

    8-)

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to Martin Gregorie on Thu Dec 17 01:26:09 2020
    On 16/12/2020 22:25, Martin Gregorie wrote:
    On Wed, 16 Dec 2020 21:33:07 +0000, Ahem A Rivet's Shot wrote:

    On Wed, 16 Dec 2020 15:31:44 -0000 (UTC)
    bob prohaska <bp@www.zefox.net> wrote:

    The gist is that published specs aren't necessarily a reliable guide.
    Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    At that size either you use an SSD (NVMe for preference) or you're
    penny pinching.

    Price difference between HDD and SSD are fairly close. eBuyer is flogging:
    - 2.5" WD Blue 500GB SATA for £37 (probably CMR)
    - Samsung 500GB SATA drives for £63.00
    or a PNY [never heard of em] 480GB SATA drive for £40.


    Yes. I've run this desktop now on SSD for as long as a spinning rust
    disk used to run and its SMART errors are well in hand.

    Unless you want super high capacities, I see no point in spinning rust
    at all. I've 6GB of rust in my server, yes, but I would be happy to
    replace it with SSD when it starts to fail, if the price were similar.



    --
    Labour - a bunch of rich people convincing poor people to vote for rich
    people by telling poor people that "other" rich people are the reason
    they are poor.

    Peter Thompson

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to Martin Gregorie on Thu Dec 17 01:47:04 2020
    Martin Gregorie <martin@mydomain.invalid> wrote:
    On Wed, 16 Dec 2020 21:33:07 +0000, Ahem A Rivet's Shot wrote:

    On Wed, 16 Dec 2020 15:31:44 -0000 (UTC)
    bob prohaska <bp@www.zefox.net> wrote:

    The gist is that published specs aren't necessarily a reliable guide.
    Eventually it'll likely get clarified, but for now, in the 2.5" 1 TB
    class of drives, SMR is difficult to reliably avoid.

    At that size either you use an SSD (NVMe for preference) or you're
    penny pinching.

    Price difference between HDD and SSD are fairly close. eBuyer is flogging:
    - 2.5" WD Blue 500GB SATA for ?37 (probably CMR)
    - Samsung 500GB SATA drives for ?63.00
    or a PNY [never heard of em] 480GB SATA drive for ?40.

    It's tempting to guess all three are old stock and won't be available
    for long. Perhaps they'll become expensive specialty items, or simply
    go away. In any case I'd like to find a storage solution with a few
    features:

    Adequate capacity, say quarter to one TB
    Easy replacement availability
    Long(ish) lifespan, several years at 24/7 operation
    Power consumption at idle comparable to an idle Pi4
    Performance sufficient to keep up with the Pi4
    The latter two might be the most direct conflict.

    As evolution plays out it may well favor SSD. For now HDDs seem to
    be developing the same handicaps as SSDs. I think HDDs still win
    on write cycles and power consumption. Not sure how they compare for
    practical life span. Life span is a function of overprovisioning for
    SSD, if SSD costs keep dropping they might win on both counts.
    Last I checked SSDs were a little worse for power consumption, but
    that was months ago and I don't know where the trend is going.

    It's not clear where this goose chase will end... Perhaps at SSD.
    Perhaps at 3.5 inch HDD.

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to bob prohaska on Thu Dec 17 02:15:29 2020
    On 17/12/2020 01:47, bob prohaska wrote:
    Last I checked SSDs were a little worse for power consumption, but
    that was months ago and I don't know where the trend is going.

    That struck me as odd, so I googled.

    The balance of opinion is exactly the reverse. SSD uses up to 5 times
    *less* power?

    This spec https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-blue-ssd/data-sheet-wd-blue-3d-nan d-sata- ssd-2879-800092.pdf?_ga=2.57708201.28239759.1543588356-1527752628.1543588356

    gives operational power on a SSD of ~3-4 watts and idle power 56mw. In
    most applications due to the high read and write speed the operational
    times will be very short.

    https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-black-hdd/data-sheet-wd-black-pc-h ard-drives-2879-771434.pdf?_ga=2.57708201.28239759.1543588356-1527752628.154358 8356

    shows far higher figures for read write and idle...

    --
    The New Left are the people they warned you about.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Deloptes@3:770/3 to The Natural Philosopher on Thu Dec 17 13:32:17 2020
    The Natural Philosopher wrote:

    Yes. I've run this desktop now on SSD for as long as a spinning rust
    disk used to run and its SMART errors are well in hand.

    Unless you want super high capacities, I see no point in spinning rust
    at all. I've 6GB of rust in my server, yes, but I would be happy to
    replace it with SSD when it starts to fail, if the price were similar.

    +1 exactly my thoughts. I am thinking of replacing the disks for the build environment 2x1T with SSD - there it would really make sense, but price is still too high even if one calculates the power consumption delta.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Deloptes@3:770/3 to The Natural Philosopher on Thu Dec 17 13:47:22 2020
    The Natural Philosopher wrote:

    That struck me as odd, so I googled.

    The balance of opinion is exactly the reverse. SSD uses up to 5 times
    *less* power?

    This spec

    https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-blue-ssd/data-sheet-wd-blue-3d-nan d-sata-

    ssd-2879-800092.pdf?_ga=2.57708201.28239759.1543588356-1527752628.1543588356

    gives operational power on a SSD of ~3-4 watts and idle power 56mw. In
    most applications due to the high read and write speed the operational
    times will be very short.


    https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-black-hdd/data-sheet-wd-black-pc-h ard-drives-2879-771434.pdf?_ga=2.57708201.28239759.1543588356-1527752628.154358 8356

    shows far higher figures for read write and idle...


    Absolutely correct and at present all servers I have seen use SSD 4 or 6
    even some 8TB disks (like backup servers for example). I did check - those disks/models are not available on the consumer market (unfortunately).

    At the end new technologies will win the game and in couple of years we'll
    be talking the same, but may be about SSD and NVMe or NVMe or whatever
    comes next.

    As of my experience and a long research some years ago I use at home only
    WDC WD10EFRX-68xxxxx and WDC WD20EFRX-68xxxxx. The proved to be really
    good, I would say excellent.
    Some years ago when thinking of replacing some older disk I did a research
    on the 3, 4 and 6TB versions of same model - only negative experience and issues, so I preferred to stick to the two mentioned above.

    I find this discussion extremely interesting. Thank you all

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to The Natural Philosopher on Thu Dec 17 18:41:27 2020
    The Natural Philosopher <tnp@invalid.invalid> wrote:
    On 17/12/2020 01:47, bob prohaska wrote:
    Last I checked SSDs were a little worse for power consumption, but
    that was months ago and I don't know where the trend is going.

    This spec

    https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-blue-ssd/data-sheet-wd-blue-3d-nan d-sata-
    ssd-2879-800092.pdf?_ga=2.57708201.28239759.1543588356-1527752628.1543588356

    gives operational power on a SSD of ~3-4 watts and idle power 56mw. In
    most applications due to the high read and write speed the operational
    times will be very short.


    That spec sheet is truly impressive. The prices are still a little higher
    than mechanical drives at 1TB, maybe 2X, but much better than I expected. Sustained write powers close to 4W in an m.2 package do give some pause....





    https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/publi c/western-digital/product/internal-drives/wd-black-hdd/data-sheet-wd-black-pc-h ard-drives-2879-771434.pdf?_ga=2.57708201.28239759.1543588356-1527752628.154358 8356

    shows far higher figures for read write and idle...

    True, but a little unfair, those are 7200 RPM 3.5 inch drives.
    Still, it's implausible that a 2.5 inch 5400 RPM drive can
    come close to the figures for SSD unless the spindle stops.

    Oddly enough, this brings me back to the dilemma of finding an
    enclosure that interfaces to USB3 with support for UASP and TRIM.

    Thanks for rattling my cage, it looks like an SSD is worth a look.

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From druck@3:770/3 to bob prohaska on Thu Dec 17 18:35:38 2020
    On 17/12/2020 01:47, bob prohaska wrote:
    As evolution plays out it may well favor SSD.

    That's done and dusted,

    For now HDDs seem to
    be developing the same handicaps as SSDs. I think HDDs still win
    on write cycles and power consumption. Not sure how they compare for practical life span. Life span is a function of overprovisioning for
    SSD, if SSD costs keep dropping they might win on both counts.
    Last I checked SSDs were a little worse for power consumption, but
    that was months ago and I don't know where the trend is going.

    The problem I see ahead for SSDs is the move to QLC (4 bits per cell),
    at the cheaper end, which has an order of magnitude less life than TLC
    (3 bits per cell).

    Although this was said for the move from SLC (1 bit per cell) and MLC (2
    bits per cell) to TLC, but that has provided pretty rock solid over the
    last 6 or 7 years, with the use of advanced controllers, wear levelling
    an over provisioning.

    ---druck

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From bob prohaska@3:770/3 to druck on Thu Dec 17 20:32:35 2020
    druck <news@druck.org.uk> wrote:
    On 17/12/2020 01:47, bob prohaska wrote:
    As evolution plays out it may well favor SSD.

    That's done and dusted,

    For now HDDs seem to
    be developing the same handicaps as SSDs. I think HDDs still win
    on write cycles and power consumption. Not sure how they compare for
    practical life span. Life span is a function of overprovisioning for
    SSD, if SSD costs keep dropping they might win on both counts.
    Last I checked SSDs were a little worse for power consumption, but
    that was months ago and I don't know where the trend is going.

    The problem I see ahead for SSDs is the move to QLC (4 bits per cell),
    at the cheaper end, which has an order of magnitude less life than TLC
    (3 bits per cell).

    Although this was said for the move from SLC (1 bit per cell) and MLC (2
    bits per cell) to TLC, but that has provided pretty rock solid over the
    last 6 or 7 years, with the use of advanced controllers, wear levelling
    an over provisioning.


    It might be useful to re-frame the issue in terms of failure mode. If a
    machine fails gracefully, how long it's going to last becomes much less worrisome. If a storage device gives warning that it's running out of
    write capacity I might not be afraid of QLC vs lower-density options.

    If it just goes all bricklike, with no warning at all, it's a lot less attractive. Just the ability to test how much over-provisioning remains available would be a big help. SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Thanks for reading,

    bob prohaska

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to bob prohaska on Thu Dec 17 21:38:22 2020
    On Thu, 17 Dec 2020 20:32:35 +0000, bob prohaska wrote:

    It might be useful to re-frame the issue in terms of failure mode. If a machine fails gracefully, how long it's going to last becomes much less worrisome. If a storage device gives warning that it's running out of
    write capacity I might not be afraid of QLC vs lower-density options.

    If it just goes all bricklike, with no warning at all, it's a lot less attractive. Just the ability to test how much over-provisioning remains available would be a big help. SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Agree completely, which is why, so far I've avoided SSDs apart from one
    case - I have a SanDisk 128GB one installed in an old Lenovo R61i laptop
    that I'd had from new. After its hard drive died I was going to junk it
    because it turned out that the HDD interfacing electronics were incapable
    of supporting any HDD of more than 200GB - and at the time, 3 years ago,
    it was impossible to buy any HDD smaller than 320GB. So, I picked up the SanDisk, installed it threw 64 bit Fedora onto that and it all just
    worked. The machine is now by "backup laptop" and has been running 24/7
    running protein folding software since the start of the COVID lock-down
    in March. For desk-toppy stuff the machine is now pleasingly faster that
    it ever used to be, but for anything that needs grunt, lets just say the
    1.6Ghz Core Duo is less than sprightly. Not even a hint of a problem with
    the SSD though.

    That said, Unless you're a scrupulous backer-upper to offline drive(s)
    its probably worth paying a premium for your SSDs: I've heard that the
    cheapies do suddenly lie down and die, i.e. loose or corrupt data, while
    the better, more 'professionally' oriented units switch to read-only
    mode once they've accumulated enough faults to prevent further writes
    without causing data loss.

    =====
    Being paranoid about such things, I my laptops ans server all have smartd installed and configured to provide a weekly disk status report: I ran
    the disk in the Lenovo R61i into the ground and had the disk in my house
    server fail at almost the same time - both had around 50,000 hours on
    them according to smartd - and in both cases smartd gave me just enough
    warning to have replacement disks on the shelf when the live ones died -
    and I didn't loose ant data either!

    BTW, another benefit of using SSDs is that they accumulate runtime hours
    a lot slower than HDDs - with my usage pattern, smartd shows that both my
    main Laptop (active around 8-12 hours a day) and the house server (active
    24/7) add around 20-30 hours a week to their disk's runtime, while the
    R61i (active 24/7 doing protein folding) adds 1 hour (sometimes as much
    as 2 hours) to its SSD runtime per week. If this is a general pattern,
    and I think it may well be, then SSDs may have a longer clocktime life
    than an HDD handling a similar workload.

    This figures, since an HDD will tend to keep spinning after a burst of activity, to minimise startup delays and head load/unload cycles, while
    this stuff is not relevant for an SSD.

    Needless to say, I'm very curious to know if any of you have had a
    similar experience of the rate at which an HDD accumulates runtime hours
    vs an SSD.


    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Chris Green@3:770/3 to All on Thu Dec 17 22:24:36 2020
    I have had a mix of drives on many Ubuntu Linux desktops and Raspberry
    Pi over the last 15 to 20 years.

    In all that time I think I have had two disk drives (both spinning
    ones) fail.

    Disk drives are *amazingly* robust and reliable. For example my first
    serious backup NAS was a WD 'my book' with two 1Tb drives, this ran continuously as my backup system with daily backups sent to it for six
    or seven years. I only retired it because the disks filled up. I
    recently booted it to try and find some old files of my daughter's, it
    booted fine (and I found the files, more than ten years old).

    I have a Lenovo laptop which is SSD based and I've steadily migrated
    my desktop system to being SSD based. They're all carefully backed up
    so if the SSDs die I'll be OK but so far I've not had any SSDs fail,
    some must be quite a few years old now.

    The current backup system is a Pi with an external, spinning, 8Tb
    drive. This isn't very old yet so I've no data.

    --
    Chris Green
    ·

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to bob prohaska on Fri Dec 18 00:45:21 2020
    On 17/12/2020 20:32, bob prohaska wrote:
    SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Absolutely. It's mandatory more or less. It gives you error rates on all
    the things you need to worry about. This drive has been going a shade
    over 5 years of actual 'on' time as my linux desk top boot drive: data
    is held on a server so it doesn't get much action. But logs are written
    to this. So it has in fact more writes than reads! (9780 GB versus 5255GB)
    It still reports 95% of its useful life left.

    ============================================

    sudo smartctl -a /dev/sdb
    smartctl 6.2 2013-07-26 r3841 [x86_64-linux-3.19.0-32-generic] (local build) Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

    === START OF INFORMATION SECTION ===
    Model Family: SandForce Driven SSDs
    Device Model: KINGSTON SV300S37A120G
    Serial Number: 50026B774A09C471
    LU WWN Device Id: 5 0026b7 74a09c471
    Firmware Version: 580ABBF0
    User Capacity: 120,034,123,776 bytes [120 GB]
    Sector Size: 512 bytes logical/physical
    Rotation Rate: Solid State Device
    Device is: In smartctl database [for details use: -P show]
    ATA Version is: ATA8-ACS, ACS-2 T13/2015-D revision 3
    SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
    Local Time is: Fri Dec 18 00:31:42 2020 GMT
    SMART support is: Available - device has SMART capability.
    SMART support is: Enabled

    === START OF READ SMART DATA SECTION ===
    SMART overall-health self-assessment test result: PASSED

    General SMART Values:
    Offline data collection status: (0x02) Offline data collection activity
    was completed without error.
    Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed
    without error or no self-test has ever
    been run.
    Total time to complete Offline
    data collection: ( 0) seconds.
    Offline data collection
    capabilities: (0x7d) SMART execute Offline immediate.
    No Auto Offline data collection support.
    Abort Offline collection upon new
    command.
    Offline surface scan supported.
    Self-test supported.
    Conveyance Self-test supported.
    Selective Self-test supported.
    SMART capabilities: (0x0003) Saves SMART data before entering
    power-saving mode.
    Supports SMART auto save timer.
    Error logging capability: (0x01) Error logging supported.
    General Purpose Logging supported. Short self-test routine
    recommended polling time: ( 1) minutes.
    Extended self-test routine
    recommended polling time: ( 48) minutes.
    Conveyance self-test routine
    recommended polling time: ( 2) minutes.
    SCT capabilities: (0x0025) SCT Status supported.
    SCT Data Table supported.

    SMART Attributes Data Structure revision number: 10
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE
    UPDATED WHEN_FAILED RAW_VALUE
    1 Raw_Read_Error_Rate 0x0032 095 095 050 Old_age
    Always - 2/30119639
    5 Retired_Block_Count 0x0033 100 100 003 Pre-fail
    Always - 0
    9 Power_On_Hours_and_Msec 0x0032 047 047 000 Old_age
    Always - 47131h+15m+31.470s
    12 Power_Cycle_Count 0x0032 100 100 000 Old_age
    Always - 552
    171 Program_Fail_Count 0x000a 100 100 000 Old_age Always
    - 0
    172 Erase_Fail_Count 0x0032 100 100 000 Old_age Always
    - 0
    174 Unexpect_Power_Loss_Ct 0x0030 000 000 000 Old_age
    Offline - 102
    177 Wear_Range_Delta 0x0000 000 000 000 Old_age
    Offline - 96
    181 Program_Fail_Count 0x000a 100 100 000 Old_age Always
    - 0
    182 Erase_Fail_Count 0x0032 100 100 000 Old_age Always
    - 0
    187 Reported_Uncorrect 0x0012 100 100 000 Old_age Always
    - 0
    189 Airflow_Temperature_Cel 0x0000 029 045 000 Old_age
    Offline - 29 (0 235 0 45 0)
    194 Temperature_Celsius 0x0022 029 045 000 Old_age Always
    - 29 (0 235 0 45 0)
    195 ECC_Uncorr_Error_Count 0x001c 107 107 000 Old_age
    Offline - 2/30119639
    196 Reallocated_Event_Count 0x0033 100 100 003 Pre-fail Always
    - 0
    201 Unc_Soft_Read_Err_Rate 0x001c 107 107 000 Old_age
    Offline - 2/30119639
    204 Soft_ECC_Correct_Rate 0x001c 107 107 000 Old_age
    Offline - 2/30119639
    230 Life_Curve_Status 0x0013 100 100 000 Pre-fail Always
    - 100
    231 SSD_Life_Left 0x0013 095 095 010 Pre-fail Always
    - 1
    233 SandForce_Internal 0x0032 000 000 000 Old_age Always
    - 23531
    234 SandForce_Internal 0x0032 000 000 000 Old_age Always
    - 9780
    241 Lifetime_Writes_GiB 0x0032 000 000 000 Old_age Always
    - 9780
    242 Lifetime_Reads_GiB 0x0032 000 000 000 Old_age Always
    - 5255

    SMART Error Log not supported

    SMART Self-test log structure revision number 1
    Num Test_Description Status Remaining
    LifeTime(hours) LBA_of_first_error
    # 1 Extended offline Completed without error 00% 26355
    -
    # 2 Short offline Completed without error 00% 22020
    -

    SMART Selective self-test log data structure revision number 1
    SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
    1 0 0 Not_testing
    2 0 0 Not_testing
    3 0 0 Not_testing
    4 0 0 Not_testing
    5 0 0 Not_testing
    Selective self-test flags (0x0):
    After scanning selected spans, do NOT read-scan remainder of disk.
    If Selective self-test is pending on power-up, resume after 0 minute delay.


    --
    Of what good are dead warriors? … Warriors are those who desire battle
    more than peace. Those who seek battle despite peace. Those who thump
    their spears on the ground and talk of honor. Those who leap high the
    battle dance and dream of glory … The good of dead warriors, Mother, is
    that they are dead.
    Sheri S Tepper: The Awakeners.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to Chris Green on Fri Dec 18 00:52:17 2020
    On 17/12/2020 22:24, Chris Green wrote:
    I have had a mix of drives on many Ubuntu Linux desktops and Raspberry
    Pi over the last 15 to 20 years.

    In all that time I think I have had two disk drives (both spinning
    ones) fail.

    Disk drives are *amazingly* robust and reliable. For example my first serious backup NAS was a WD 'my book' with two 1Tb drives, this ran continuously as my backup system with daily backups sent to it for six
    or seven years. I only retired it because the disks filled up. I
    recently booted it to try and find some old files of my daughter's, it
    booted fine (and I found the files, more than ten years old).

    I have a Lenovo laptop which is SSD based and I've steadily migrated
    my desktop system to being SSD based. They're all carefully backed up
    so if the SSDs die I'll be OK but so far I've not had any SSDs fail,
    some must be quite a few years old now.

    The current backup system is a Pi with an external, spinning, 8Tb
    drive. This isn't very old yet so I've no data.

    I had one SSD go on me under warranty in my laptop. It didn't die dead,
    it just started giving control errors. SMART was used by the vendor to
    validate my claim that it was in fact dying


    The other SSD I have in this machine replaced a flaky drive about 6
    years ago. It is still faultless. 6 years is beyond what my (rusty)
    server drives normally do before being junked. I have an old server
    drive in this PC also, as the server got upgraded. SMART shows way more
    errors on it than the SSD.

    In my limited experience SSDS are ALREADY more long-lived than disks and
    more reliable. Even under fairly heavy usage. They are just expensive.....


    --
    "If you don’t read the news paper, you are un-informed. If you read the
    news paper, you are mis-informed."

    Mark Twain

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Ahem A Rivet's Shot@3:770/3 to The Natural Philosopher on Fri Dec 18 05:43:33 2020
    On Fri, 18 Dec 2020 00:52:17 +0000
    The Natural Philosopher <tnp@invalid.invalid> wrote:

    In my limited experience SSDS are ALREADY more long-lived than disks and
    more reliable. Even under fairly heavy usage. They are just expensive.....

    I'm inclined to agree. I use SSDs for boot discs in all my systems
    and haven't lost one yet (the oldest one in use doesn't even support TRIM).

    That being said I don't trust them (or anything else) unresevedly,
    my NAS uses refurbished 2TB 3.5" SAS drives[1] in four ZFS mirrors and all
    the boot discs are mirrored to zvols exported over iscsi from the NAS.

    [1] These are currently a reliable storage bargain because they were never
    used in high load environments (the 2.5" 15K rpm drives went there) and so spent their life mostly idle before being replaced due to age.

    --
    Steve O'Hara-Smith | Directable Mirror Arrays C:\>WIN | A better way to focus the sun
    The computer obeys and wins. | licences available see
    You lose and Bill collects. | http://www.sohara.org/

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Pancho@3:770/3 to The Natural Philosopher on Fri Dec 18 10:57:06 2020
    On 18/12/2020 00:45, The Natural Philosopher wrote:
    On 17/12/2020 20:32, bob prohaska wrote:
      SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Absolutely. It's mandatory more or less. It gives you error rates on all
    the things you need to worry about. This drive has been going a shade
    over 5 years of actual 'on' time as my linux desk top boot drive: data
    is held on a server so it doesn't get much action. But logs are written
    to this. So it has in fact more writes than reads! (9780 GB versus 5255GB)
    It still reports 95% of its useful life left.

    ============================================

    I've just tested my first SSD, which is still in use. An 11 year old
    Intel X25-E SSDs 32GB:

    Power_On_Hours 54141
    Media_Wearout_Indicator 98.

    Although to be fair I'm not sure all SSDs are as reliable. I did buy a
    number of OCZ SSDs (about 4), all of which failed catastrophically, I'm
    not sure what the wearout indicator was on them.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to Pancho on Fri Dec 18 12:20:12 2020
    On 18/12/2020 10:57, Pancho wrote:
    On 18/12/2020 00:45, The Natural Philosopher wrote:
    On 17/12/2020 20:32, bob prohaska wrote:
      SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Absolutely. It's mandatory more or less. It gives you error rates on
    all the things you need to worry about. This drive has been going a
    shade over 5 years of actual 'on' time as my linux desk top boot
    drive: data is held on a server so it doesn't get much action. But
    logs are written to this. So it has in fact more writes than reads!
    (9780 GB versus 5255GB)
    It still reports 95% of its useful life left.

    ============================================

    I've just tested my first SSD, which is still in use. An 11 year old
    Intel X25-E SSDs 32GB:

        Power_On_Hours 54141
        Media_Wearout_Indicator 98.

    Although to be fair I'm not sure all SSDs are as reliable. I did buy a
    number of OCZ SSDs (about 4), all of which failed catastrophically, I'm
    not sure what the wearout indicator was on them.

    I think the consensus seems to be that a reliable brand will these days
    outlast spinning rust, and given that unless you have a CPU/DRAM
    failure, that happens is blocks go bad and are mapped out which is a
    very graceful failure mode.

    So provided you check with SMART once a year you should not have
    *catastrophic* failure. My failure was pretty hard and happened in less
    than a year.



    --
    "Strange as it seems, no amount of learning can cure stupidity, and
    higher education positively fortifies it."

    - Stephen Vizinczey

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Pancho@3:770/3 to The Natural Philosopher on Fri Dec 18 13:14:59 2020
    On 18/12/2020 12:20, The Natural Philosopher wrote:
    On 18/12/2020 10:57, Pancho wrote:
    On 18/12/2020 00:45, The Natural Philosopher wrote:
    On 17/12/2020 20:32, bob prohaska wrote:
      SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Absolutely. It's mandatory more or less. It gives you error rates on
    all the things you need to worry about. This drive has been going a
    shade over 5 years of actual 'on' time as my linux desk top boot
    drive: data is held on a server so it doesn't get much action. But
    logs are written to this. So it has in fact more writes than reads!
    (9780 GB versus 5255GB)
    It still reports 95% of its useful life left.

    ============================================

    I've just tested my first SSD, which is still in use. An 11 year old
    Intel X25-E SSDs 32GB:

         Power_On_Hours 54141
         Media_Wearout_Indicator 98.

    Although to be fair I'm not sure all SSDs are as reliable. I did buy a
    number of OCZ SSDs (about 4), all of which failed catastrophically,
    I'm not sure what the wearout indicator was on them.

    I think the consensus seems to be that a reliable brand will these days outlast spinning rust, and given that unless you have a CPU/DRAM
    failure, that happens is blocks go bad and are mapped out which is a
    very graceful failure mode.

    So provided you check with SMART once a year you should not have *catastrophic* failure. My  failure was pretty hard and happened in less than a year.



    You are describing a graceful/designed failure mode. As I remember it,
    my OCZ failure mode was that the device just failed to be recognised by
    BIOS, i.e. not blocks wearing out gracefully. I don't think anything
    showed up on SMART. By the time these disks failed they had been
    relegated to bin-able laptop boot drives, no important data, so I didn't investigate. My assumption is that a component in the controller board
    failed. But the effect was a sudden total loss of all data on the disk.

    These OCZ drives were bought circa 2013. I've not had problems with any
    of my other SSDs Intel, Crucial, Kingston, Samsung.

    However, I think it is one of those questions were the diagnosis is
    irrelevant, we all know the correct treatment: good short term backups.

    I've using rsnapshot recently, which I have found great, simple enough
    for an incompetent like myself.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Jim Jackson@3:770/3 to Chris Green on Fri Dec 18 18:14:07 2020
    On 2020-12-17, Chris Green <cl@isbd.net> wrote:

    The current backup system is a Pi with an external, spinning, 8Tb
    drive. This isn't very old yet so I've no data.


    Is this a 2.5in or a 3.5in? If 3.5in what USB adapter do you use?

    cheers
    Jim

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Chris Elvidge@3:770/3 to Jim Jackson on Fri Dec 18 18:24:38 2020
    On 18/12/2020 06:14 pm, Jim Jackson wrote:
    On 2020-12-17, Chris Green <cl@isbd.net> wrote:

    The current backup system is a Pi with an external, spinning, 8Tb
    drive. This isn't very old yet so I've no data.


    Is this a 2.5in or a 3.5in? If 3.5in what USB adapter do you use?

    cheers
    Jim


    Mine's a 5TB USB3 Seagate Expansion Drive. Works to keep media files (on
    NTFS partition) and as backup drive for itself and 4 other Pis (on ext4 partition).

    --
    Chris Elvidge
    England

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Chris Green@3:770/3 to Jim Jackson on Fri Dec 18 18:53:59 2020
    Jim Jackson <jj@franjam.org.uk> wrote:
    On 2020-12-17, Chris Green <cl@isbd.net> wrote:

    The current backup system is a Pi with an external, spinning, 8Tb
    drive. This isn't very old yet so I've no data.


    Is this a 2.5in or a 3.5in? If 3.5in what USB adapter do you use?

    It's a "WD - Elements External Hard Drive - 8Tb", it cost £125 from
    Currys in September. Complete drive in box with USB interface etc.,
    it was cheaper than a bar drive of the same capacity!

    It's 3.5" I assume.

    So far it's worked well and I (quite) like it powering down when idle
    though I'm not sure that this is really better for long term
    reliability.

    --
    Chris Green
    ·

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to Pancho on Sat Dec 19 04:47:46 2020
    On 18/12/2020 13:14, Pancho wrote:
    On 18/12/2020 12:20, The Natural Philosopher wrote:
    On 18/12/2020 10:57, Pancho wrote:
    On 18/12/2020 00:45, The Natural Philosopher wrote:
    On 17/12/2020 20:32, bob prohaska wrote:
      SMART keeps some track of deterioration
    in mechanical drives, does it exist for SSDs?

    Absolutely. It's mandatory more or less. It gives you error rates on
    all the things you need to worry about. This drive has been going a
    shade over 5 years of actual 'on' time as my linux desk top boot
    drive: data is held on a server so it doesn't get much action. But
    logs are written to this. So it has in fact more writes than reads!
    (9780 GB versus 5255GB)
    It still reports 95% of its useful life left.

    ============================================

    I've just tested my first SSD, which is still in use. An 11 year old
    Intel X25-E SSDs 32GB:

         Power_On_Hours 54141
         Media_Wearout_Indicator 98.

    Although to be fair I'm not sure all SSDs are as reliable. I did buy
    a number of OCZ SSDs (about 4), all of which failed catastrophically,
    I'm not sure what the wearout indicator was on them.

    I think the consensus seems to be that a reliable brand will these
    days outlast spinning rust, and given that unless you have a CPU/DRAM
    failure, that happens is blocks go bad and are mapped out which is a
    very graceful failure mode.

    So provided you check with SMART once a year you should not have
    *catastrophic* failure. My  failure was pretty hard and happened in
    less than a year.



    You are describing a graceful/designed failure mode. As I remember it,
    my OCZ failure mode was that the device just failed to be recognised by
    BIOS, i.e. not blocks wearing out gracefully. I don't think anything
    showed up on SMART. By the time these disks failed they had been
    relegated to bin-able laptop boot drives, no important data, so I didn't investigate. My assumption is that a component in the controller board failed. But the effect was a sudden total loss of all data on the disk.

    Yes, that was very similar to my failure. but it happened slowly enough
    to enable me to get SMART readings which indicated some sort of failure
    to talk to the SATA bus rather than damage to the NAND flash.


    These OCZ drives were bought circa 2013. I've not had problems with any
    of my other SSDs Intel, Crucial, Kingston, Samsung.

    Mine failed around 2018 I think. It was a regular branded Kingston SSD
    Its been replaced with an (apparently) identical unit which is still
    working fine.

    The point I wanted to make, is, that ex of this sort of failure which
    isn't SSD specific, SSD technology now appears to be more reliable than spinning rust.


    However, I think it is one of those questions were the diagnosis is irrelevant, we all know the correct treatment: good short term backups.

    I've using rsnapshot recently, which I have found great, simple enough
    for an incompetent like myself.

    All my irreplaceable data is rsynced overnight. Handy when I
    accidentally delete something - last night's backup is still there.


    --
    Renewable energy: Expensive solutions that don't work to a problem that
    doesn't exist instituted by self legalising protection rackets that
    don't protect, masquerading as public servants who don't serve the public.

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Chris Green@3:770/3 to The Natural Philosopher on Sat Dec 19 09:31:42 2020
    The Natural Philosopher <tnp@invalid.invalid> wrote:

    I've using rsnapshot recently, which I have found great, simple enough
    for an incompetent like myself.

    All my irreplaceable data is rsynced overnight. Handy when I
    accidentally delete something - last night's backup is still there.

    I run incremental backups of /home and /etc, firstly I do hourly
    backups to a local (but separate) disk drive on my desktop machine,
    secondly their are daily incremental backups to the Pi + USB system
    which is out in the garage (quite a long way from the house).

    I used to use rsnapshot but then wrote my own incremental backup
    software using rsync's --link-dest option which sends the backups to
    an rsync server process running on the Pi. This makes the backups
    more secure because an intruder on the backed-up systems isn't able to
    (easily) get at the backups on the remote system. Since they're
    incremental backups they can't be overwritten remotely either.

    --
    Chris Green
    ·

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From Martin Gregorie@3:770/3 to The Natural Philosopher on Sat Dec 19 13:36:45 2020
    On Sat, 19 Dec 2020 04:47:46 +0000, The Natural Philosopher wrote:

    All my irreplaceable data is rsynced overnight. Handy when I
    accidentally delete something - last night's backup is still there.

    Try rsnapshot: its fast (uses rsync to make backups) and lets you have
    more than just the last backup version available. I have it set to make
    daily and keep 4 weekly backups, which means it keeps 7 daily backups, combining the dailys every week to make a new backup, which is kept for a month. as each 'backup' is simply a list of pointers to timestamped file copies, the rsnapshot backup set seems to be about twice the size of a
    single rsync backup and making the weekly snapshot takes twice as long to
    make as the daily one, i.e. 8 minutes compared with 4 minutes for the
    daily run and the complete set is 183GB.

    For comparison, when I previously used compressed gzip daily backups,
    these took 3.5 hours and I could only fit 4 daily backups on a 320 GB
    disk.



    --
    --
    Martin | martin at
    Gregorie | gregorie dot org

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
  • From The Natural Philosopher@3:770/3 to Martin Gregorie on Sat Dec 19 18:05:25 2020
    On 19/12/2020 13:36, Martin Gregorie wrote:
    On Sat, 19 Dec 2020 04:47:46 +0000, The Natural Philosopher wrote:

    All my irreplaceable data is rsynced overnight. Handy when I
    accidentally delete something - last night's backup is still there.

    Try rsnapshot: its fast (uses rsync to make backups) and lets you have
    more than just the last backup version available.

    To be honest, in the last 10 years while the system has been running, I
    have blessed it because two disks died in that time, but I have never
    cursed it because I needed some audit trail of changes. If I were
    writing software Id use sccs/rcs or equivalent anyway


    I have it set to make
    daily and keep 4 weekly backups, which means it keeps 7 daily backups, combining the dailys every week to make a new backup, which is kept for a month. as each 'backup' is simply a list of pointers to timestamped file copies, the rsnapshot backup set seems to be about twice the size of a
    single rsync backup and making the weekly snapshot takes twice as long to make as the daily one, i.e. 8 minutes compared with 4 minutes for the
    daily run and the complete set is 183GB.

    Too effin complex for me

    For comparison, when I previously used compressed gzip daily backups,
    these took 3.5 hours and I could only fit 4 daily backups on a 320 GB
    disk.

    When I set up this server back in the noughties, I looked at all the
    ways of backing up data, and concluded that a sodding big disk was way
    better than tapes or CDs or DVDS and so that is what I bought.

    It is simply a time delayed mirror. Because I am lazy it backs up
    EVERYTHING. Trying to work out what it didnt need to was more cost to me
    than the extra 100Mbytes of disk..

    As the system data size grows disks get replaced with bigger ones. And
    enormous rsyncs restart the whole thing...

    *shrug* its good enough for SOHO. I am not managing terabytes of other
    peoples data these days...





    --
    "First, find out who are the people you can not criticise. They are your oppressors."
    - George Orwell

    --- SoupGate-Win32 v1.05
    * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)