Difference between revisions of "Grace:Filesystems and Files"
Tmarkhuang (talk | contribs) (→Transferring Files) |
(→Quotas & File Use) |
||
| Line 32: | Line 32: | ||
==Quotas & File Use== | ==Quotas & File Use== | ||
| − | A user can run the ''showquota'' home-wrapper command to display file usage on Grace. Below is a sample output of command ''showquota''. | + | A user can run the ''showquota'' home-wrapper command to display file usage on Grace. <!-- Below is a sample output of command ''showquota''. |
[NetID@grace1 ~]$ '''showquota''' | [NetID@grace1 ~]$ '''showquota''' | ||
Your current disk quotas are: | Your current disk quotas are: | ||
| Line 38: | Line 38: | ||
/home 12.75M 10G 120 10000 | /home 12.75M 10G 120 10000 | ||
/scratch 1.5M 1T 15 250000 | /scratch 1.5M 1T 15 250000 | ||
| + | --> | ||
==Transferring Files== | ==Transferring Files== | ||
Revision as of 10:30, 5 January 2021
File Systems, Quotas and File Transfers
Contents
File Space
Global file space on Grace is available on all compute and login nodes. It is organized in the two file systems showing in the table below. Access to the allocated file space is through the indicated directories that are setup automatically for every user.
| File System | Directory | Environment Variable | Storage Hardware | File Space Quota | File Counts Quota | Comments |
|---|---|---|---|---|---|---|
| Home | /home/$USER | $HOME | DDN | 10 GB | 10000 | Upon login, you will be situated in /home/$USER. The use of this area is for small-to-modest amount of processing. Its space and file count limits are not extensible. This area is backed up on a nightly basis. |
| Scratch | /scratch/user/$USER | $SCRATCH | DDN | 1 TB | 250000 | This is a high performance storage, intended to temporarily hold rather large files, and only for on-going processing that uses them. It is NOT backed up nor is it intended as long-term storage area. Please delete or move out of these area any files that are not frequently used. |
Quotas & File Use
A user can run the showquota home-wrapper command to display file usage on Grace.
Transferring Files
Data transfer utilites scp, sftp, and rsync are available Grace login nodes. All Grace login nodes have 10 Gigbit Ethernet connection to the intra-campus network. These are suitable for small-to-medium sized data transfers, as transfer could be interrupted by 60 minute CPU process time limit on the Grace login nodes. We suggest "rsync" which supports intermittent transfer. For transferring large amount of data to or from off campus, use Globus Connect with "TAMU grace-dtn1" or "TAMU grace-dtn2" as the endpoint.
For transferring files on Grace to/from a Windows machine, you can use MobaXterm or WinSCP. Please see instructions on using SFTP/SCP software with Duo. Use rclone to move data to/from cloud storage from the login nodes.
Please see file transfer wiki page for more details on choices of transfer software and answers to frequently asked questions.
