• Re: Slow format ?

    From GB@21:1/5 to Abandoned Trolley on Wed Apr 17 12:58:49 2024
    On 17/04/2024 12:51, Abandoned Trolley wrote:



    I am guessing that when formatting disk drives, whether they are
    spinning rust, SSD or USB memory sticks ... most people check the "quick Format" box and let the machine get on with it (Windows 11 in this case)


    Just out of curiosity, I put a 2TB USB 3.0 memory stick in my machine yesterday, and asked it to do a NTFS "non-quick" format.

    Its now been going for about 18 hours - and its somewhere between a
    quarter and a third of the way through. The little bar graph thing is updating, so I am fairly sure its not actually frozen.

    Is this anything remotely like normal ? - or do people simply never do
    this ?


    It sounds a bit slow, but not impossible. Supposing the write speed is
    20 Mbps, how many hours is that to fill up 2TB? I'll leave you to do
    the sums.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Abandoned Trolley@21:1/5 to All on Wed Apr 17 12:51:26 2024
    I am guessing that when formatting disk drives, whether they are
    spinning rust, SSD or USB memory sticks ... most people check the "quick Format" box and let the machine get on with it (Windows 11 in this case)


    Just out of curiosity, I put a 2TB USB 3.0 memory stick in my machine yesterday, and asked it to do a NTFS "non-quick" format.

    Its now been going for about 18 hours - and its somewhere between a
    quarter and a third of the way through. The little bar graph thing is
    updating, so I am fairly sure its not actually frozen.

    Is this anything remotely like normal ? - or do people simply never do
    this ?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andy Burns@21:1/5 to Abandoned Trolley on Wed Apr 17 13:09:54 2024
    Abandoned Trolley wrote:

    I put a 2TB USB 3.0 memory stick in my machine yesterday, and asked it
    to do a NTFS "non-quick" format.

    Its now been going for about 18 hours - and its somewhere between a
    quarter and a third of the way through. The little bar graph thing is updating, so I am fairly sure its not actually frozen.

    Is this anything remotely like normal ?

    Yep

    or do people simply never do this ?

    Well, maybe only once to see how long it takes ...

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Abandoned Trolley@21:1/5 to Jeff Gaines on Wed Apr 17 13:51:38 2024
    On 17/04/2024 13:23, Jeff Gaines wrote:
    On 17/04/2024 in message <uvod3t$1j73s$1@dont-email.me> Abandoned
    Trolley wrote:




    I am guessing that when formatting disk drives, whether they are
    spinning rust, SSD or USB memory sticks ... most people check the
    "quick Format" box and let the machine get on with it (Windows 11 in
    this case)


    Just out of curiosity, I put a 2TB USB 3.0 memory stick in my machine
    yesterday, and asked it to do a NTFS "non-quick" format.

    Its now been going for about 18 hours - and its somewhere between a
    quarter and a third of the way through. The little bar graph thing is
    updating, so I am fairly sure its not actually frozen.

    Is this anything remotely like normal ? - or do people simply never do
    this ?

    Wasn't it the only option for a Windows install once upon a time?



    I believe so - but ISTR that most Windows systems had a volume limit of
    2GB at the time ?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jeff Gaines@21:1/5 to All on Wed Apr 17 12:23:33 2024
    On 17/04/2024 in message <uvod3t$1j73s$1@dont-email.me> Abandoned Trolley wrote:




    I am guessing that when formatting disk drives, whether they are spinning >rust, SSD or USB memory sticks ... most people check the "quick Format"
    box and let the machine get on with it (Windows 11 in this case)


    Just out of curiosity, I put a 2TB USB 3.0 memory stick in my machine >yesterday, and asked it to do a NTFS "non-quick" format.

    Its now been going for about 18 hours - and its somewhere between a
    quarter and a third of the way through. The little bar graph thing is >updating, so I am fairly sure its not actually frozen.

    Is this anything remotely like normal ? - or do people simply never do
    this ?

    Wasn't it the only option for a Windows install once upon a time?

    --
    Jeff Gaines Dorset UK
    Remember, the Flat Earth Society has members all around the globe.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Philip Herlihy@21:1/5 to All on Thu Apr 18 10:56:43 2024
    In article <uvod3t$1j73s$1@dont-email.me>, Abandoned Trolley wrote...
    I am guessing that when formatting disk drives, whether they are
    spinning rust, SSD or USB memory sticks ... most people check the "quick Format" box and let the machine get on with it (Windows 11 in this case)



    I'll usually do a full format of a new disk. As I understand it, a quick format simply installs the filesystem (most of it empty). A full format also does a surface integrity check, which might involve (hidden) re-mapping of any bad sectors which are found. (When re-mapping becomes visible, that means the 'spare' sectors are used up, and the disk is on the way out.) When in use, I'll normaly use a SMART monitor (currently HDTune) to watch out for deterioration, and that has saved my bacon (that's data-bacon) many times over the years.

    --

    Phil, London

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Philip Herlihy@21:1/5 to All on Thu Apr 18 10:59:40 2024
    In article <MPG.408afeb312d23533989ac8@news.eternal-september.org>, Philip Herlihy wrote...
    I'll normaly use a SMART monitor (currently HDTune)


    Typo - HDTune is a free utility which *can* read SMART data. I actually use HDSentinel, which warns you proactively of any deterioration (recommended).

    --

    Phil, London

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Theo@21:1/5 to Philip Herlihy on Thu Apr 18 18:21:47 2024
    Philip Herlihy <PhillipHerlihy@slashdevnull.invalid> wrote:
    In article <uvod3t$1j73s$1@dont-email.me>, Abandoned Trolley wrote...
    I am guessing that when formatting disk drives, whether they are
    spinning rust, SSD or USB memory sticks ... most people check the "quick Format" box and let the machine get on with it (Windows 11 in this case)



    I'll usually do a full format of a new disk. As I understand it, a quick format simply installs the filesystem (most of it empty). A full format also does a surface integrity check, which might involve (hidden) re-mapping of any
    bad sectors which are found.

    That dialogue is very old. Originally 'format' meant lay down disk
    sectoring information, used to navigate the disk (putting the disc into a certain format of X sectors by Y tracks), which is what happens to a
    floppy. On a hard drive made later than 1980s, the sectoring information is not exposed to the OS and is internal to the drive. Thus 'format' hasn't
    done actual formatting for decades.

    There are two modes that have been relevant on HDD for the last 35 years:

    1. write just the partition information, leaving most data blocks holding
    old contents
    2. write the partition information and also wipe all blocks on the disc

    Windows calls #1 'quick format' and #2 'format', 1980s terminology.

    With modern SSDs there is no point doing #2, because a simple change of the encryption key (which all SSDs have internally) will scramble the contents
    of the disc so all private data is unreadable[*].

    [*] I'm not exactly sure how Windows implements that key changing process,
    but I think BIOS wiping the disc does it

    So you'd only really do the full data write if there was something wrong
    with the disc and you wanted to try to reuse it by clearing bad blocks, or perhaps if you wanted to sell it and to be extra sure it was wiped.

    For SSD it is actually counterproductive for a new drive because it it eats
    one of your limited flash write cycles. A random 1TB SSD has 240TBW, meaning you can write the whole drive 240 times before it dies. If you do a full format you now only have 239.

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Abandoned Trolley@21:1/5 to All on Fri Apr 19 07:59:01 2024
    For SSD it is actually counterproductive for a new drive because it it eats one of your limited flash write cycles. A random 1TB SSD has 240TBW, meaning you can write the whole drive 240 times before it dies. If you do a full format you now only have 239.

    Theo


    so ... the regular reading and writing of swap files in virtual memory
    systems is destroying SSDs all over the place ?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andy Burns@21:1/5 to All on Fri Apr 19 09:28:46 2024
    QWJhbmRvbmVkIFRyb2xsZXkgd3JvdGU6DQoNCj4gc2/CoCAuLi4gdGhlIHJlZ3VsYXIgcmVh ZGluZyBhbmQgd3JpdGluZyBvZiBzd2FwIGZpbGVzIGluIHZpcnR1YWwgbWVtb3J5IA0KPiBz eXN0ZW1zIGlzIGRlc3Ryb3lpbmcgU1NEcyBhbGwgb3ZlciB0aGUgcGxhY2UgPw0KDQpyZWFk aW5nIC0gbm90IHNvIG11Y2gsIGl0J3MgdGhlIHdyaXRpbmcgdGhhdCBodXJ0cywgdGhlc2Ug ZGF5cyBqdXN0IGJ1eSANClJBTSB0byBhdm9pZCBzd2FwcGluZyBpZiB0aGUgc3lzdGVtIGNh biB0YWtlIG1vcmUgLi4uDQoNCg==

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Theo@21:1/5 to Abandoned Trolley on Fri Apr 19 11:27:55 2024
    Abandoned Trolley <fred@fred-smith.co.uk> wrote:

    For SSD it is actually counterproductive for a new drive because it it eats one of your limited flash write cycles. A random 1TB SSD has 240TBW, meaning
    you can write the whole drive 240 times before it dies. If you do a full format you now only have 239.

    Theo


    so ... the regular reading and writing of swap files in virtual memory systems is destroying SSDs all over the place ?

    Yes, writing is causing wear. But if the SSD has 240TBW and your device has 8GB RAM, you'd need to write the whole RAM contents 30,000 times. If you
    are swapping 1GB it would be 240,000 times, etc. So it depends how much you are writing out and how frequently. Bearing in mind that for many SSDs
    writing 1GB would take a full second or thereabouts, most swapping is going
    to be much smaller writes.

    For those kind of machines one option is just to buy SSDs with more write cycles. Cheap consumer SSDs have a lot fewer cycles than more enterprise-y ones.

    But better to fit more RAM if you can.

    Theo

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jaimie Vandenbergh@21:1/5 to fred@fred-smith.co.uk on Fri Apr 19 10:36:40 2024
    On 19 Apr 2024 at 07:59:01 BST, "Abandoned Trolley"
    <fred@fred-smith.co.uk> wrote:


    For SSD it is actually counterproductive for a new drive because it it eats >> one of your limited flash write cycles. A random 1TB SSD has 240TBW, meaning >> you can write the whole drive 240 times before it dies. If you do a full
    format you now only have 239.

    Theo


    so ... the regular reading and writing of swap files in virtual memory systems is destroying SSDs all over the place ?

    Not enough to care about. The fear over limited write cycles was with
    the earliest tiny SSDs (like 20 or 60gig) with lower stability storage.

    These days eg a samsung 980 1TB is warrantied to 600TB of writes which
    is an awful lot of full formats at 60 hours each! Four years of them,
    and the warranty time limit on those 980s is five years... And that's a consumer grade SSD, not a fancy one.

    In normal use you'll write a few gig per day perhaps, and that 600TB
    total will outlast many spinning disks. At 50gig/day that's 30 years.

    Cheers - Jaimie
    --
    It does not do to leave a live dragon out of your calculations, if you live near him.
    -- J R R Tolkien

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From David@21:1/5 to Theo on Fri Apr 19 10:37:28 2024
    On Fri, 19 Apr 2024 11:27:55 +0100, Theo wrote:

    Abandoned Trolley <fred@fred-smith.co.uk> wrote:

    For SSD it is actually counterproductive for a new drive because it
    it eats one of your limited flash write cycles. A random 1TB SSD has
    240TBW, meaning you can write the whole drive 240 times before it
    dies. If you do a full format you now only have 239.

    Theo


    so ... the regular reading and writing of swap files in virtual memory
    systems is destroying SSDs all over the place ?

    Yes, writing is causing wear. But if the SSD has 240TBW and your device
    has 8GB RAM, you'd need to write the whole RAM contents 30,000 times.
    If you are swapping 1GB it would be 240,000 times, etc. So it depends
    how much you are writing out and how frequently. Bearing in mind that
    for many SSDs writing 1GB would take a full second or thereabouts, most swapping is going to be much smaller writes.

    For those kind of machines one option is just to buy SSDs with more
    write cycles. Cheap consumer SSDs have a lot fewer cycles than more enterprise-y ones.

    But better to fit more RAM if you can.

    Theo

    Just checking my understanding.

    Back in the spinning rust days you would allocated a small partition as
    SWAP.
    You might even position it on the disc to have the potential fastest
    access time for seeks.
    With SSDs blocks are allocated on a virtual rather than physical layout so
    a 10 GB SWAP space will not be continuously reusing contiguous blocks over
    a small area of the SSD.

    Yes to more RAM.

    I think.

    Cheers



    Dave R

    --
    AMD FX-6300 in GA-990X-Gaming SLI-CF running Windows 10 x64

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Abandoned Trolley@21:1/5 to All on Fri Apr 19 11:49:55 2024

    Back in the spinning rust days you would allocated a small partition as
    SWAP.
    You might even position it on the disc to have the potential fastest
    access time for seeks.
    With SSDs blocks are allocated on a virtual rather than physical layout so
    a 10 GB SWAP space will not be continuously reusing contiguous blocks over
    a small area of the SSD.

    Yes to more RAM.

    I think.

    Cheers



    Dave R



    I have done a number of Solaris installs on SPARC systems, and tailored
    the swap partition according to the memory - but I cant remember setting
    up any swap partition on any Windows system.

    I dont think too many people mess around with that sort of thing - but I
    guess theres nothing preventing it on spinning rust systems

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From David@21:1/5 to Abandoned Trolley on Fri Apr 19 12:45:00 2024
    On Fri, 19 Apr 2024 11:49:55 +0100, Abandoned Trolley wrote:


    Back in the spinning rust days you would allocated a small partition as
    SWAP.
    You might even position it on the disc to have the potential fastest
    access time for seeks.
    With SSDs blocks are allocated on a virtual rather than physical layout
    so a 10 GB SWAP space will not be continuously reusing contiguous
    blocks over a small area of the SSD.

    Yes to more RAM.

    I think.


    I have done a number of Solaris installs on SPARC systems, and tailored
    the swap partition according to the memory - but I cant remember setting
    up any swap partition on any Windows system.

    I dont think too many people mess around with that sort of thing - but I guess theres nothing preventing it on spinning rust systems

    Having come from a background where disc tuning was important (including
    SPARC) I used to do this on Windows.
    Create a specific SWAP partition on the disc.
    Sometimes create SWAP partitions on multiple discs to spread the load.

    All this is behind me now.
    I just close my eyes and let Windows get on with it.

    Cheers



    Dave R

    [P.S. remember going up from a 10 MB disc to a 20 MB disc and ruling the world?]

    --
    AMD FX-6300 in GA-990X-Gaming SLI-CF running Windows 10 x64

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jaimie Vandenbergh@21:1/5 to David on Fri Apr 19 12:36:31 2024
    On 19 Apr 2024 at 11:37:28 BST, "David" <wibble@btinternet.com> wrote:

    With SSDs blocks are allocated on a virtual rather than physical layout so
    a 10 GB SWAP space will not be continuously reusing contiguous blocks over
    a small area of the SSD.

    That's correct, it won't.

    But on a flash drive or SD, it might :) They have dumber controllers.

    Cheers - Jaimie
    --
    "You could say that Apple charges for incremental
    upgrades while Microsoft charges for excremental
    ones" -- Daniel James, uk.c.h

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andy Burns@21:1/5 to David on Fri Apr 19 18:07:51 2024
    David wrote:

    With SSDs blocks are allocated on a virtual rather than physical layout so
    a 10 GB SWAP space will not be continuously reusing contiguous blocks over
    a small area of the SSD.

    The contiguous (or otherwise) allocation of blocks doesn't matter for an
    SSD or NVMe device, its controller will have wear-levelling that ensures
    the writes get fairly shared across all block on the "disk"

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)