welcome: please sign in

Diff for "MemberManual/TransferringFiles"

Differences between revisions 13 and 14
Revision 13 as of 2007-11-08 04:10:34
Size: 2402
Editor: MichaelOlson
Comment: clarify wording of rsync explanation
Revision 14 as of 2007-11-08 04:17:06
Size: 2391
Editor: MichaelOlson
Comment: Do a once-over
Deletions are marked like this. Additions are marked like this.
Line 22: Line 22:
If you are interested in transferring files independently, then `rsync` may not be what you want. `scp` and `sftp` are better at transferring random files, although `scp` does have a recursive option. But it will not intelligently merge two directory trees (and thus bandwidth is wasted). See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools may be utilized. If you are interested in transferring a file or directory just once, then `rsync` may not be what you want -- `scp` and `sftp` are better at transferring individual files or directories. They will not intelligently merge two directory trees like `rsync` does. See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools may be utilized.
Line 25: Line 25:
With SSL-enabled FTP, you may transfer files to the `hcoop.net` host on the standard port (21). On Unix, the `ftp-ssl` package should suffice. For Windows users, try [http://filezilla.sf.net FileZilla], or if necessary, [http://www.coreftp.com CoreFTP] (the LE edition is free). With SSL-enabled FTP, you may transfer files to the `hcoop.net` host on the standard port (21). On Unix, installing the `ftp-ssl` package should suffice.  For Windows users, we recommend [http://filezilla.sf.net FileZilla]. We do not enable normal (non-SSL) FTP, because it sends login credentials in the clear.
Line 28: Line 28:
OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any file management software. This is because the software allows remote filesystems to be mounted as if they are local. That said, it is possible that you will never need to start an ssh session just to manipulate files. See the [:/OpenAFS:OpenAFS] subpage to learn how to setup your HCoop share so that you can manage files, edit files, and more, from the comfort of your favorite local software. OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any file management software. AFS allows remote filesystems to be mounted as if they are local. Because of this, it is now possible that you will never need to start an ssh session just to manipulate files. See the [:/OpenAFS:OpenAFS] subpage to learn how to install the right client software so that you can manage files, edit files, and more, from the comfort of your own machine.

This is the chapter of the MemberManual that describes how to transfer files to your home directory, which is kept in an AFS volume.

TableOfContents

Using rsync

rsync, coupled with the ssh "shell", is capable of providing file transfers to our servers. rsync is a great way to intelligently synchronize files between computer systems.

Here is an example. It copies the contents of ~/Maildir from fyodor to mire, assuming that it is run from fyodor. It will overwrite any existing files on mire which are also present on fyodor, but it will not delete files which are present on mire and not fyodor.

rsync -azr -e ssh --no-g --progress --verbose ~/Maildir/ mire.hcoop.net:Maildir/

Note the --no-g switch. This is important: AFS has no need for groups, since it has ACLs, and will reject attempts to change the group permission by non-admin users.

Be very careful to include the trailing slash on both the source and destination paths. rsync is very picky about that.

rsync has many different options available -- consult its man page for further details.

Using scp and sftp

If you are interested in transferring a file or directory just once, then rsync may not be what you want -- scp and sftp are better at transferring individual files or directories. They will not intelligently merge two directory trees like rsync does. See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools may be utilized.

Using ftp

With SSL-enabled FTP, you may transfer files to the hcoop.net host on the standard port (21). On Unix, installing the ftp-ssl package should suffice. For Windows users, we recommend [http://filezilla.sf.net FileZilla]. We do not enable normal (non-SSL) FTP, because it sends login credentials in the clear.

Mounting AFS on your local system

OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any file management software. AFS allows remote filesystems to be mounted as if they are local. Because of this, it is now possible that you will never need to start an ssh session just to manipulate files. See the [:/OpenAFS:OpenAFS] subpage to learn how to install the right client software so that you can manage files, edit files, and more, from the comfort of your own machine.

MemberManual/TransferringFiles (last edited 2014-03-04 05:04:30 by ClintonEbadi)