<?xml version="1.0" encoding="utf-8"?><!DOCTYPE article  PUBLIC '-//OASIS//DTD DocBook XML V4.4//EN'  'http://www.docbook.org/xml/4.4/docbookx.dtd'><article><articleinfo><title>MemberManual/TransferringFiles</title><revhistory><revision><revnumber>23</revnumber><date>2014-03-04 05:04:30</date><authorinitials>ClintonEbadi</authorinitials><revremark>mention quotacheck</revremark></revision><revision><revnumber>22</revnumber><date>2013-01-14 09:03:13</date><authorinitials>ClintonEbadi</authorinitials><revremark>update</revremark></revision><revision><revnumber>21</revnumber><date>2010-01-25 10:30:22</date><authorinitials>nc-71-50-140-208.dyn.embarqhsd.net</authorinitials><revremark>updated the units reported by fs listquota to match command's behaviour</revremark></revision><revision><revnumber>20</revnumber><date>2008-07-07 04:28:19</date><authorinitials>localhost</authorinitials><revremark>converted to 1.6 markup</revremark></revision><revision><revnumber>19</revnumber><date>2008-04-30 14:45:32</date><authorinitials>AdamChlipala</authorinitials><revremark>mire -&gt; ssh</revremark></revision><revision><revnumber>18</revnumber><date>2007-12-15 17:21:49</date><authorinitials>AdamChlipala</authorinitials><revremark>members2 -&gt; members</revremark></revision><revision><revnumber>17</revnumber><date>2007-11-12 16:17:27</date><authorinitials>MichaelOlson</authorinitials><revremark>For now, assume that we'll go with an FTP whitelist</revremark></revision><revision><revnumber>16</revnumber><date>2007-11-12 15:45:52</date><authorinitials>MichaelOlson</authorinitials><revremark>Add quotas section, since this is where people will encounter them</revremark></revision><revision><revnumber>15</revnumber><date>2007-11-10 05:11:05</date><authorinitials>RyanMikulovsky</authorinitials><revremark>Make the OpenAFS link more obvious.</revremark></revision><revision><revnumber>14</revnumber><date>2007-11-08 04:17:06</date><authorinitials>MichaelOlson</authorinitials><revremark>Do a once-over</revremark></revision><revision><revnumber>13</revnumber><date>2007-11-08 04:10:34</date><authorinitials>MichaelOlson</authorinitials><revremark>clarify wording of rsync explanation</revremark></revision><revision><revnumber>12</revnumber><date>2007-11-08 04:07:45</date><authorinitials>MichaelOlson</authorinitials><revremark>Mention trailing slash</revremark></revision><revision><revnumber>11</revnumber><date>2007-11-08 04:05:16</date><authorinitials>MichaelOlson</authorinitials><revremark>Revise rsync section</revremark></revision><revision><revnumber>10</revnumber><date>2007-11-05 06:28:05</date><authorinitials>RyanMikulovsky</authorinitials><revremark>enhancements to text</revremark></revision><revision><revnumber>9</revnumber><date>2007-11-05 03:57:12</date><authorinitials>RyanMikulovsky</authorinitials></revision><revision><revnumber>8</revnumber><date>2007-11-05 03:56:41</date><authorinitials>RyanMikulovsky</authorinitials><revremark>style, word tweaks</revremark></revision><revision><revnumber>7</revnumber><date>2007-11-05 03:43:39</date><authorinitials>RyanMikulovsky</authorinitials><revremark>--no-g with rsync</revremark></revision><revision><revnumber>6</revnumber><date>2007-11-05 03:23:55</date><authorinitials>RyanMikulovsky</authorinitials><revremark>style</revremark></revision><revision><revnumber>5</revnumber><date>2007-11-05 03:23:25</date><authorinitials>RyanMikulovsky</authorinitials><revremark>add FTP</revremark></revision><revision><revnumber>4</revnumber><date>2007-11-05 03:08:34</date><authorinitials>RyanMikulovsky</authorinitials><revremark>change a link..</revremark></revision><revision><revnumber>3</revnumber><date>2007-11-05 03:07:16</date><authorinitials>RyanMikulovsky</authorinitials><revremark>add content</revremark></revision><revision><revnumber>2</revnumber><date>2007-10-28 01:00:22</date><authorinitials>MichaelOlson</authorinitials><revremark>Promote headings</revremark></revision><revision><revnumber>1</revnumber><date>2007-10-25 00:11:48</date><authorinitials>MichaelOlson</authorinitials><revremark>Initial contents</revremark></revision></revhistory></articleinfo><para>This is the chapter of the <ulink url="https://wiki.hcoop.net/MemberManual/TransferringFiles/MemberManual#">MemberManual</ulink> that describes how to transfer files to your home directory, which is kept in an AFS volume. </para><section><title>Quotas</title><para>Make sure you are aware that your home directory and your <code>~/Maildir</code> directory each reside on their own volume, and each has a separate quota. If you are logged into an HCoop machine, <code>quotadisplay</code> will display your used space and quota for all of your volumes. </para><para>Before copying files over, be sure that you have enough disk space in your quota using <code>fs listquota ~/</code>. </para><para>This will give you the name of your volume, available space (in KB), used space (in KB), the percentage of your volume used, and the percent of space used on AFS by all HCoop volumes. </para><para>If you need more space, please file a <ulink url="https://members.hcoop.net/portal/quota">quota change request</ulink> using the portal. </para></section><section><title>Using rsync</title><para><code>rsync</code>, coupled with the ssh &quot;shell&quot;, is capable of providing file transfers to our servers.  <code>rsync</code> is a great way to intelligently synchronize files between computer systems. </para><para>Here is an example.  It copies the contents of <code>~/Maildir</code> from a different server to <code>ssh.hcoop.net</code>, assuming that it is run from the other server.  It will overwrite any existing files in your HCoop AFS space which are also present on the local machine, but it will not delete files that have disappeared. </para><screen><![CDATA[rsync -azr -e ssh --no-g --progress --verbose ~/Maildir/ ssh.hcoop.net:Maildir/]]></screen><para>Note the <code>--no-g</code> switch.  This is important: AFS has no need for groups, since it has ACLs, and will reject attempts to change the group permission by non-admin users. </para><para>Be very careful to include the trailing slash on both the source and destination paths.  <code>rsync</code> is very picky about that. </para><para><code>rsync</code> has many different options available -- consult its man page for further details. </para></section><section><title>Using scp and sftp</title><para>If you are interested in transferring a file or directory just once, then <code>rsync</code> may not be what you want -- <code>scp</code> and <code>sftp</code> are better at transferring individual files or directories.   They will not intelligently merge two directory trees like <code>rsync</code> does.  See the <ulink url="https://wiki.hcoop.net/MemberManual/TransferringFiles/MemberManual/TransferringFiles/ScpAndSftp#">scp and sftp</ulink> subpage to learn how these tools may be utilized. </para></section><section><title>Using ftp</title><para>With SSL-enabled FTP, you may transfer files to the <code>hcoop.net</code> host on the standard port (21).  On Unix, installing the <code>ftp-ssl</code> package should suffice.  For Windows users, we recommend <ulink url="http://filezilla.sf.net">FileZilla</ulink>.  We do not enable normal (non-SSL) FTP, because it sends login credentials in the clear. </para><para>At the moment, you need to explicitly <ulink url="https://members.hcoop.net/portal/sec">request the ability to use FTP</ulink>, in order for it to work. </para></section><section><title>Mounting AFS on your local system</title><para>See the <ulink url="https://wiki.hcoop.net/MemberManual/TransferringFiles/MemberManual/TransferringFiles/OpenAFS#">OpenAFS</ulink> subpage to learn how to install the right client software so that you can manage files, edit files, and more, from the comfort of your own machine. </para><para>If you're not familiar with OpenAFS, it is a cross-platform software package that allows you to access and manipulate files remotely using most any software installed on your machine.    AFS allows remote filesystems to be mounted as if they are local.  Because of this, it is now possible that you will never need to start an ssh session just to manipulate files. </para><!--rule (<hr>) is not applicable to DocBook--><para> <ulink url="https://wiki.hcoop.net/MemberManual/TransferringFiles/CategoryMemberManual#">CategoryMemberManual</ulink> </para></section></article>