welcome: please sign in

The following 262 words could not be found in the dictionary of 7 words (including 7 LocalSpellingWords) and are highlighted below:
ability   about   access   admin   all   allows   also   an   And   and   any   are   as   assuming   At   at   attempts   available   aware   azr   Be   be   Because   because   Before   better   between   both   but   by   can   capable   careful   Category   change   chapter   clear   client   comfort   computer   consult   Contents   contents   Coop   copies   copying   coupled   credentials   cross   delete   describes   destination   details   different   directories   directory   disappeared   disk   display   do   does   each   edit   enable   enabled   enough   example   existing   explicitly   familiar   File   file   files   filesystems   filezilla   For   for   from   fs   ftp   further   give   great   group   groups   has   have   hcoop   Here   home   host   how   http   https   if   If   important   in   include   individual   install   installed   installing   intelligently   interested   into   is   it   It   its   just   kept   learn   like   listquota   local   logged   login   Ls   machine   Maildir   Make   man   manage   manipulate   Manual   many   may   Member   members   merge   moment   more   most   mounted   Mounting   name   need   net   never   no   non   normal   not   Note   now   Of   of   On   on   once   Open   options   or   order   other   our   over   overwrite   own   package   page   paths   percent   percentage   permission   picky   platform   please   port   portal   possible   present   progress   providing   quota   quotadisplay   Quotas   re   recommend   reject   remote   remotely   request   reside   right   rsync   run   scp   Scp   sec   See   sends   separate   server   servers   session   sf   Sftp   sftp   shell   should   since   slash   so   software   source   space   ssh   ssl   standard   start   subpage   suffice   sure   switch   synchronize   system   systems   Table   that   the   their   then   these   they   They   This   this   to   tools   trailing   transfer   transferring   transfers   trees   two   Unix   use   used   users   Using   using   utilized   verbose   very   volume   volumes   want   way   We   we   what   which   will   Windows   with   With   work   you   your   Zilla  

Clear message
Edit

MemberManual / TransferringFiles

This is the chapter of the MemberManual that describes how to transfer files to your home directory, which is kept in an AFS volume.

Contents

  1. Quotas
  2. Using rsync
  3. Using scp and sftp
  4. Using ftp
  5. Mounting AFS on your local system

Quotas

Make sure you are aware that your home directory and your ~/Maildir directory each reside on their own volume, and each has a separate quota. If you are logged into an HCoop machine, quotadisplay will display your used space and quota for all of your volumes.

Before copying files over, be sure that you have enough disk space in your quota using fs listquota ~/.

This will give you the name of your volume, available space (in KB), used space (in KB), the percentage of your volume used, and the percent of space used on AFS by all HCoop volumes.

If you need more space, please file a quota change request using the portal.

Using rsync

rsync, coupled with the ssh "shell", is capable of providing file transfers to our servers. rsync is a great way to intelligently synchronize files between computer systems.

Here is an example. It copies the contents of ~/Maildir from a different server to ssh.hcoop.net, assuming that it is run from the other server. It will overwrite any existing files in your HCoop AFS space which are also present on the local machine, but it will not delete files that have disappeared. 

rsync -azr -e ssh --no-g --progress --verbose ~/Maildir/ ssh.hcoop.net:Maildir/

Note the --no-g switch. This is important: AFS has no need for groups, since it has ACLs, and will reject attempts to change the group permission by non-admin users.

Be very careful to include the trailing slash on both the source and destination paths. rsync is very picky about that.

rsync has many different options available -- consult its man page for further details.

Using scp and sftp

If you are interested in transferring a file or directory just once, then rsync may not be what you want -- scp and sftp are better at transferring individual files or directories. They will not intelligently merge two directory trees like rsync does. See the scp and sftp subpage to learn how these tools may be utilized.

Using ftp

With SSL-enabled FTP, you may transfer files to the hcoop.net host on the standard port (21). On Unix, installing the ftp-ssl package should suffice. For Windows users, we recommend FileZilla. We do not enable normal (non-SSL) FTP, because it sends login credentials in the clear.

At the moment, you need to explicitly request the ability to use FTP, in order for it to work.

Mounting AFS on your local system

See the OpenAFS subpage to learn how to install the right client software so that you can manage files, edit files, and more, from the comfort of your own machine.

If you're not familiar with OpenAFS, it is a cross-platform software package that allows you to access and manipulate files remotely using most any software installed on your machine. AFS allows remote filesystems to be mounted as if they are local. Because of this, it is now possible that you will never need to start an ssh session just to manipulate files.

CategoryMemberManual

MemberManual/TransferringFiles (last edited 2014-03-04 05:04:30 by ClintonEbadi)