welcome: please sign in

Diff for "MemberManual/TransferringFiles"

Differences between revisions 9 and 11 (spanning 2 versions)
Revision 9 as of 2007-11-05 03:57:12
Size: 1732
Comment:
Revision 11 as of 2007-11-08 04:05:16
Size: 2278
Editor: MichaelOlson
Comment: Revise rsync section
Deletions are marked like this. Additions are marked like this.
Line 8: Line 8:
`rsync`, coupled with the ssh "shell", is capable of providing file transfers to our servers. `rsync` is a great way to intelligently synchronize files between computer systems. In a nutshell, this command will do the job (but tailor it to your needs -- see the man page): `rsync`, coupled with the ssh "shell", is capable of providing file transfers to our servers. `rsync` is a great way to intelligently synchronize files between computer systems.

Here is an example.
It copies the contents of `~/Maildir` from fyodor to mire, assuming that it is run from fyodor. It will overwrite any existing files with the same name on both fyodor and mire, but it will not delete files which are present on mire and not fyodor.
Line 10: Line 12:
rsync -avz --no-g -e ssh ~/html/hcoop/ USER@hcoop.net:public_html rsync -azr -e ssh --no-g --progress --verbose ~/Maildir/ mire.hcoop.net:Maildir/
Line 13: Line 15:
Note the `--no-g` switch. This is important. For further explanation and other use cases, see the [:/rsync:rsync] subpage. Note the `--no-g` switch. This is important: AFS has no need for groups, since it has ACLs, and will reject attempts to change the group permission by non-admin users.

`rsync` has many different options available -- consult its man page for further details.
Line 16: Line 20:
If you are interested in transferring files independently, then `rsync` may not be what you want. `scp` and `sftp` are better at transferring random files, although `scp` does have a recursive option. But it will not intelligently merge two directory trees (and thus bandwidth is wasted). See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools can be utilized. If you are interested in transferring files independently, then `rsync` may not be what you want. `scp` and `sftp` are better at transferring random files, although `scp` does have a recursive option. But it will not intelligently merge two directory trees (and thus bandwidth is wasted). See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools may be utilized.
Line 19: Line 23:
With SSL-enabled enabled, you may transfer files to the `hcoop.net` host. On Unix, the `ftp-ssl` package should suffice. For Windows users, try [http://filezilla.sf.net FileZilla], or if necessary, [http://www.coreftp.com CoreFTP] (the LE edition is free). With SSL-enabled FTP, you may transfer files to the `hcoop.net` host on the standard port (21). On Unix, the `ftp-ssl` package should suffice. For Windows users, try [http://filezilla.sf.net FileZilla], or if necessary, [http://www.coreftp.com CoreFTP] (the LE edition is free).
Line 22: Line 26:
OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any desktop file management software. This is because the software allows remote filesystems to be mounted as if they are local. See the [:/OpenAFS:OpenAFS] subpage to learn how to setup your HCoop share. OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any file management software. This is because the software allows remote filesystems to be mounted as if they are local. That said, it is possible that you will never need to start an ssh session just to manipulate files. See the [:/OpenAFS:OpenAFS] subpage to learn how to setup your HCoop share so that you can manage files, edit files, and more, from the comfort of your favorite local software.

This is the chapter of the MemberManual that describes how to transfer files to your home directory, which is kept in an AFS volume.

TableOfContents

Using rsync

rsync, coupled with the ssh "shell", is capable of providing file transfers to our servers. rsync is a great way to intelligently synchronize files between computer systems.

Here is an example. It copies the contents of ~/Maildir from fyodor to mire, assuming that it is run from fyodor. It will overwrite any existing files with the same name on both fyodor and mire, but it will not delete files which are present on mire and not fyodor.

rsync -azr -e ssh --no-g --progress --verbose ~/Maildir/ mire.hcoop.net:Maildir/

Note the --no-g switch. This is important: AFS has no need for groups, since it has ACLs, and will reject attempts to change the group permission by non-admin users.

rsync has many different options available -- consult its man page for further details.

Using scp and sftp

If you are interested in transferring files independently, then rsync may not be what you want. scp and sftp are better at transferring random files, although scp does have a recursive option. But it will not intelligently merge two directory trees (and thus bandwidth is wasted). See the [:/ScpAndSftp:scp and sftp] subpage to learn how these tools may be utilized.

Using ftp

With SSL-enabled FTP, you may transfer files to the hcoop.net host on the standard port (21). On Unix, the ftp-ssl package should suffice. For Windows users, try [http://filezilla.sf.net FileZilla], or if necessary, [http://www.coreftp.com CoreFTP] (the LE edition is free).

Mounting AFS on your local system

OpenAFS is a cross-platform software package that allows you to access and manipulate files remotely using most any file management software. This is because the software allows remote filesystems to be mounted as if they are local. That said, it is possible that you will never need to start an ssh session just to manipulate files. See the [:/OpenAFS:OpenAFS] subpage to learn how to setup your HCoop share so that you can manage files, edit files, and more, from the comfort of your favorite local software.

MemberManual/TransferringFiles (last edited 2014-03-04 05:04:30 by ClintonEbadi)