Difference between revisions of "Terra:Filesystems and Files"
(→Quotas & File Use) |
Tmarkhuang (talk | contribs) (→Transferring Files) |
||
Line 41: | Line 41: | ||
==Transferring Files== | ==Transferring Files== | ||
− | Data transfer utilites [[Ada:Fast Data Transfer#Data_transfer_using_scp|scp]], sftp, and [[Ada:Fast Data Transfer#Data_transfer_using_rsync|rsync]] are available Terra login nodes. All Terra login nodes have 1 Gigbit Ethernet connection to the intra-campus network. These are suitable for small-to-medium sized data transfers. | + | Data transfer utilites [[Ada:Fast Data Transfer#Data_transfer_using_scp|scp]], sftp, and [[Ada:Fast Data Transfer#Data_transfer_using_rsync|rsync]] are available Terra login nodes. All Terra login nodes have 1 Gigbit Ethernet connection to the intra-campus network. These are suitable for small-to-medium sized data transfers. For transferring large amount of data, use ''terra-ftn.hprc.tamu.edu'' as host name, or use [[SW:GlobusConnect|Globus Connect]] with "TAMU terra-ftn" as the endpoint. |
For transferring files on Terra to/from a Windows machine, please use [[HPRC:Access:Windows#WinSCP|WinSCP]]. | For transferring files on Terra to/from a Windows machine, please use [[HPRC:Access:Windows#WinSCP|WinSCP]]. | ||
[[Category:Terra]] | [[Category:Terra]] |
Revision as of 17:00, 15 December 2017
File Systems, Quotas and File Transfers
Contents
File Space
Global file space on Terra is available on all compute and login nodes. It is organized in the two file systems showing in the table below. Access to the allocated file space is through the indicated directories that are setup automatically for every user.
File System | Directory | Environment Variable | Storage Hardware | File Space Quota | File Counts Quota | Comments |
---|---|---|---|---|---|---|
Home | /home/$USER | $HOME | GSS26 | 10 GB | 10000 | Upon login, you will be situated in /home/$USER. The use of this area is for small-to-modest amount of processing. Its space and file count limits are not extensible. |
Scratch | /scratch/user/$USER | $SCRATCH | GSS26 | 1 TB | 50000 | This is a high performance storage, intended to temporarily hold rather large files, and only for on-going processing that uses them. It is NOT backed up nor is it intended as long-term storage area. Please delete or move out of these area any files that are not frequently used. |
Quotas & File Use
A user can run the showquota home-wrapper command to display file usage on Terra. Below is a sample output of command showquota.
[NetID@terra1 ~]$ showquota Your current disk quotas are: Disk Disk Usage Limit File Usage Limit /home 12.75M 10G 120 10000 /scratch 1.5M 1T 15 50000
Transferring Files
Data transfer utilites scp, sftp, and rsync are available Terra login nodes. All Terra login nodes have 1 Gigbit Ethernet connection to the intra-campus network. These are suitable for small-to-medium sized data transfers. For transferring large amount of data, use terra-ftn.hprc.tamu.edu as host name, or use Globus Connect with "TAMU terra-ftn" as the endpoint.
For transferring files on Terra to/from a Windows machine, please use WinSCP.