• Finding space occupied by files in Tandem

    From Shrikant Mitakari@21:1/5 to All on Fri Oct 29 06:21:23 2021
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Randall@21:1/5 to shrikant....@gmail.com on Fri Oct 29 12:23:57 2021
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !

    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Keith Dick@21:1/5 to Randall on Fri Oct 29 16:54:48 2021
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.

    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a file is
    attached to a subvolume.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Randall@21:1/5 to rkd...@gmail.com on Sat Oct 30 14:48:32 2021
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.

    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the directory's
    inode - unless they are mount points.

    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a file is
    attached to a subvolume.

    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Keith Dick@21:1/5 to Randall on Sat Oct 30 18:22:03 2021
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the directory's
    inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a file
    is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that reports
    on free space works on virtual NonStop systems, or some third thing?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Randall@21:1/5 to rkd...@gmail.com on Sun Oct 31 13:24:53 2021
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote:
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the directory's
    inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a file
    is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that reports
    on free space works on virtual NonStop systems, or some third thing?

    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look inside
    the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it mostly
    is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this will change in the
    future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Keith Dick@21:1/5 to Randall on Sun Oct 31 17:03:28 2021
    On Sunday, October 31, 2021 at 1:24:54 PM UTC-7, Randall wrote:
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote:
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the directory'
    s inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a
    file is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that
    reports on free space works on virtual NonStop systems, or some third thing?
    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look inside
    the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it mostly
    is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this will change in the
    future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    I don't understand most of what you wrote, probably because I have very little experience with using any kind of virtual machines.

    Let me ask this: Outside of DSAP, what effect does this have on other software that runs on the NonStop system? For example, I have some vague recollection that the sort package chooses where to put its scratch files by looking at the free space
    available on the different disk volumes. I think some of the SQL query executor does something similar. Do those pieces of software see enough information about free space so they make good choices?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Bill Honaker@21:1/5 to Keith Dick on Mon Nov 1 10:25:52 2021
    On Sun, 31 Oct 2021 17:03:28 -0700 (PDT), Keith Dick <rkdick@gmail.com> wrote:

    On Sunday, October 31, 2021 at 1:24:54 PM UTC-7, Randall wrote:
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote: >> > On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use. >> > > >
    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the directory'
    s inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a
    file is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that
    reports on free space works on virtual NonStop systems, or some third thing?
    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look
    inside the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it
    mostly is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this will
    change in the future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    I don't understand most of what you wrote, probably because I have very little experience with using any kind of virtual machines.

    Let me ask this: Outside of DSAP, what effect does this have on other software that runs on the NonStop system? For example, I have some vague recollection that the sort package chooses where to put its scratch files by looking at the free space
    available on the different disk volumes. I think some of the SQL query executor does something similar. Do those pieces of software see enough information about free space so they make good choices?

    The OP was asking about space usage, seemingly with concern a out files and discs that are reaching capacity.
    The lack of insight into the underlying fragementation of the files themselves is not unique to vNonStop, it also applies to usage of a SAN to host the volumes.

    I think that DSAP is the right tool for the OP based on his original question (see above).
    Bill

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Gustavo Martinez@21:1/5 to All on Mon Nov 1 12:00:36 2021
    El lunes, 1 de noviembre de 2021 a la(s) 12:25:53 UTC-3, Bill Honaker escribió:
    On Sun, 31 Oct 2021 17:03:28 -0700 (PDT), Keith Dick <rkd...@gmail.com> wrote:

    On Sunday, October 31, 2021 at 1:24:54 PM UTC-7, Randall wrote:
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote:
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the
    directory's inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of a
    file is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that
    reports on free space works on virtual NonStop systems, or some third thing?
    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look
    inside the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it
    mostly is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this will
    change in the future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    I don't understand most of what you wrote, probably because I have very little experience with using any kind of virtual machines.

    Let me ask this: Outside of DSAP, what effect does this have on other software that runs on the NonStop system? For example, I have some vague recollection that the sort package chooses where to put its scratch files by looking at the free space
    available on the different disk volumes. I think some of the SQL query executor does something similar. Do those pieces of software see enough information about free space so they make good choices?
    The OP was asking about space usage, seemingly with concern a out files and discs that are reaching capacity.
    The lack of insight into the underlying fragementation of the files themselves is not unique to vNonStop, it also applies to usage of a SAN to host the volumes.

    I think that DSAP is the right tool for the OP based on his original question (see above).
    Bill
    Hi all,

    You can also check Myinfo from https://www.greenhouse.de/freeware/guardian-freeware/

    Regards,
    Gustavo.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Keith Dick@21:1/5 to Gustavo Martinez on Mon Nov 1 22:25:22 2021
    On Monday, November 1, 2021 at 12:00:37 PM UTC-7, Gustavo Martinez wrote:
    El lunes, 1 de noviembre de 2021 a la(s) 12:25:53 UTC-3, Bill Honaker escribió:
    On Sun, 31 Oct 2021 17:03:28 -0700 (PDT), Keith Dick <rkd...@gmail.com> wrote:

    On Sunday, October 31, 2021 at 1:24:54 PM UTC-7, Randall wrote:
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote:
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote: >> > > > > On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the
    directory's inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part of
    a file is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that
    reports on free space works on virtual NonStop systems, or some third thing?
    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look
    inside the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it
    mostly is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this will
    change in the future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    I don't understand most of what you wrote, probably because I have very little experience with using any kind of virtual machines.

    Let me ask this: Outside of DSAP, what effect does this have on other software that runs on the NonStop system? For example, I have some vague recollection that the sort package chooses where to put its scratch files by looking at the free space
    available on the different disk volumes. I think some of the SQL query executor does something similar. Do those pieces of software see enough information about free space so they make good choices?
    The OP was asking about space usage, seemingly with concern a out files and discs that are reaching capacity.
    The lack of insight into the underlying fragementation of the files themselves is not unique to vNonStop, it also applies to usage of a SAN to host the volumes.

    I think that DSAP is the right tool for the OP based on his original question (see above).
    Bill
    Hi all,

    You can also check Myinfo from https://www.greenhouse.de/freeware/guardian-freeware/

    Regards,
    Gustavo.

    Well, Bill, the OP did ask about space available, too, so I'm not sure why you seem to be ruling out discussion of that.

    It is interesting that you mention that some of the same questions about managing free space apply to using a SAN for the disk volumes of a NonStop system. I have never heard anything about special considerations for disk volumes on SANs, probably
    because I have never been responsible for managing a NonStop system that used SANs for the disks.

    Do you know of a manual that explains the differences between managing disk space on volumes of a NonStop system that are traditional individual physical disks vs. managing space on volumes that are on a SAN or on a virtrual NonStop system? If so, I'd
    appreciate it if you could tell me which manual contains such explanations. If you don't know of a manual that explains the differences, could you give a very short explanation of what differences there are? (Just in a very few words if you don't have
    time to write a thorough explanation.)

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From j-marcus@pacbell.net@21:1/5 to All on Tue Nov 2 13:54:11 2021
    When you virtualize disk space, you usually relinquish the one-to-one relationship between the disk space that the guest operating system (i.e. NonStop) thinks it has access to and the amount of physical storage that sits behind the virtual disk.

    I think we are getting beyond the realm of specific NonStop implementation into the general area of storage virtualization. The NonStop documentation is assuming that you are already familiar with these computer science concepts. Perhaps it would help
    you to start with some research into the general topic. The following Wiki articles might be a good place to start:

    https://en.wikipedia.org/wiki/Virtual_disk_and_virtual_drive https://en.wikipedia.org/wiki/Storage_virtualization https://en.wikipedia.org/wiki/Software-defined_storage

    Jon Marcus

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Bill Honaker@21:1/5 to Keith Dick on Tue Nov 2 16:50:25 2021
    On Mon, 1 Nov 2021 22:25:22 -0700 (PDT), Keith Dick <rkdick@gmail.com> wrote:

    On Monday, November 1, 2021 at 12:00:37 PM UTC-7, Gustavo Martinez wrote:
    El lunes, 1 de noviembre de 2021 a la(s) 12:25:53 UTC-3, Bill Honaker escribió:
    On Sun, 31 Oct 2021 17:03:28 -0700 (PDT), Keith Dick <rkd...@gmail.com> wrote:

    On Sunday, October 31, 2021 at 1:24:54 PM UTC-7, Randall wrote:
    On Saturday, October 30, 2021 at 9:22:04 p.m. UTC-4, rkd...@gmail.com wrote:
    On Saturday, October 30, 2021 at 2:48:33 PM UTC-7, Randall wrote:
    On Friday, October 29, 2021 at 7:54:49 p.m. UTC-4, rkd...@gmail.com wrote:
    On Friday, October 29, 2021 at 12:23:58 PM UTC-7, Randall wrote: >> > >> > > > > On Friday, October 29, 2021 at 9:21:26 a.m. UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !
    DSAP provides a number of ways or reporting. You can get per-file, per subvolume, per user, per volume, by choosing the appropriate options.

    It is described in NTL pretty extensively in the Guardian Disk and Tape Utilities Reference Manual.

    Good luck,
    Randall
    Randall is correct that DSAP probably is the program you should use.

    Please note that available space is only tracked at the volume level. The idea of asking how much space is available in a subvolume is wrong, so do not expect to find anything in DSAP that would report about that.
    Good point. There is no concept of space allocation limits by subvolume. Subvolumes themselves to not take up any space themselves. Even directories in OSS and Linux are mostly virtual, except for minimal space that is used to define the
    directory's inode - unless they are mount points.
    DSAP can report how much space is used by all of the files in a subvolume, and how much of that space could be released by deallocating extents of files in the subvolume that have not yet been used, but no space that is not currently part
    of a file is attached to a subvolume.
    Don't forget that NONE of this applies directly on vNonStop where drives are virtualized off of underlying disks. SMF has its own stuff too, but we're getting way off topic now.

    This is what I meant, yes. Thanks for clarifying.
    Your comment that none of this applies to virtual NonStop systems makes me curious. I don't have any experience with virtual NonStop systems. Do you mean that DSAP cannot be used on virtual NonStop systems, or that none of the part of DSAP that
    reports on free space works on virtual NonStop systems, or some third thing?
    DSAP will report the amount of space used on the virtualized the disk, like $DATA01. However, you cannot tell, relative to the underlying hardware, how much space is used in reality. Docker is a bit different because root has the ability to look
    inside the Docker container to find out what is really going on. Fragmentation on the underlying hardware is invisible to DSAP, so the real use may be masked - unless the partition is managed as a contiguous block by the virtualization OS. I suspect it
    mostly is, but from experience, this is not an absolute. Speaking from a bit of frustration on our main CI/CD box, the 5 Ubuntu VMs share space out of the root partition of the Gentoo OS, so I really cannot tell where a particular file is located or how
    fragmented it might be, from the point of view of the VM itself. I have to drop into Gentoo to look at the allocations. Sure, this is different than the vNonStop recipe, but I have not yet seen the details and do not know whether this
    will
    change in the future. Basically, in vNonStop-land, you follow the VM rules, so the traditional NonStop view of disk subsystems is not the real picture of what is going on on the hardware. That was really my point.

    I don't understand most of what you wrote, probably because I have very little experience with using any kind of virtual machines.

    Let me ask this: Outside of DSAP, what effect does this have on other software that runs on the NonStop system? For example, I have some vague recollection that the sort package chooses where to put its scratch files by looking at the free space
    available on the different disk volumes. I think some of the SQL query executor does something similar. Do those pieces of software see enough information about free space so they make good choices?
    The OP was asking about space usage, seemingly with concern a out files and discs that are reaching capacity.
    The lack of insight into the underlying fragementation of the files themselves is not unique to vNonStop, it also applies to usage of a SAN to host the volumes.

    I think that DSAP is the right tool for the OP based on his original question (see above).
    Bill
    Hi all,

    You can also check Myinfo from https://www.greenhouse.de/freeware/guardian-freeware/

    Regards,
    Gustavo.

    Well, Bill, the OP did ask about space available, too, so I'm not sure why you seem to be ruling out discussion of that.

    It is interesting that you mention that some of the same questions about managing free space apply to using a SAN for the disk volumes of a NonStop system. I have never heard anything about special considerations for disk volumes on SANs, probably
    because I have never been responsible for managing a NonStop system that used SANs for the disks.

    Do you know of a manual that explains the differences between managing disk space on volumes of a NonStop system that are traditional individual physical disks vs. managing space on volumes that are on a SAN or on a virtrual NonStop system? If so, I'd
    appreciate it if you could tell me which manual contains such explanations. If you don't know of a manual that explains the differences, could you give a very short explanation of what differences there are? (Just in a very few words if you don't have
    time to write a thorough explanation.)

    Keith,

    The storage space used by the files, and overall on a per volume basis, are all correct from DSAP no matter what.

    The area that is different deals with extents and fragmentation.
    It still reports it correctly, but since the underlying data is completely virtualized (both in XP and in vNS), it's much less useful.

    My meaning was that, if using SAS disks, the Disk Process's belief of where the data lies is straightforward.
    If using Solid State drives, it's less so.
    But for either virtualized solution, there is no real correlation with what is assumed by the disk process and the underyling reality.

    I hope that is clearer.
    Bill

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Randall@21:1/5 to Bill Honaker on Wed Nov 3 11:52:33 2021
    On Tuesday, November 2, 2021 at 5:50:28 p.m. UTC-4, Bill Honaker wrote:
    But for either virtualized solution, there is no real correlation with what is assumed by the disk process and the underyling reality.

    That was actually my point (but you said it way better than I did). I was not sure what the OP really wanted to know - although the DSAP answer still is the most relevant to NonStop allocation even if it is sometimes not connected to the underlying
    reality.

    I guess it is top of mind because I am trying to work out my own vNS and also about to reformat VMWare off one of my servers and replacing it with Debian/KVM - but that's another story and OS - and expecting the disk allocations to radically change.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From wilsonjohna@gmail.com@21:1/5 to shrikant....@gmail.com on Mon Nov 15 05:13:20 2021
    On Friday, October 29, 2021 at 9:21:26 AM UTC-4, shrikant....@gmail.com wrote:
    Hi All,

    I wanted to check the space occupied by files (and how much is available) in each volume and subovolumes on a node. How can we do that? Which command and utility will be useful.

    Thank you !

    A quick way I have been checking for large files on a given disk, is to cross over to OSS and run the "du" command. If you have a lot of files on a disk, it will take a little bit of processing to return the results, but it is a quick and easy way I use
    frequently.

    For example, after starting OSH, this command will return the largest 50 files on the disk:
    du -a /G/DISK2 | sort -n -r | head -n 50

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)