Transferring data between facilities/devices
How to transfer data between facilities/devices effectively
There are many tools that can be used to transfer data between devices. WIN IT support the following:
- SSH - scp, sftp and rsync
- SMB File sharing
- OneDrive sharing
How to transfer files using secure transfer mechanisms including scp, sftp and rsync
Introduction
The SSH secure terminal tool also supports transferring files over a secure encrypted link. There are two mechanisms provided, Secure Copy (scp) and Secure File Transfer Protocol (sftp), the former is a scriptable one-off transfer of a file or folder, the latter an interactive session allowing you to up or download files and folders. You will typically need to use these tools to download MRI scans, transfer files to/from the WIN or BMRC clusters or collaborator's systems.
In addition to the command line tools (available on macOS, Linux and recent versions of Windows) there are various GUI applications that support the SFTP protocol. We recommend Cyberduck on macOS and Windows (OS App Store or https://cyberduck.io/) and FileZilla on Linux.
How to access FMRIB file servers over SMB
Introduction
The SMB remote file system access protocol is supported by all major OSes and provides access to your servers files as if they were locally available on your machine. We only allow access to this service from within the FMRIB network trusted networks, so you will need to connect to the FMRIB VPN to access from WiFi, remote locations and restricted FMRIB ethernet networks.
Details on how to connect for each OS are in this section.
How to copy files to/from S3 buckets on the OOD cluster
To transfer to/from Amazon Web Services S3 buckets the OOD cluster nodes include the command 'mount-s3', the official AWS tool.
To mount a bucket, you use the command:
mount-s3 <bucket> <path>
This would make bucketname available at .
Usage and Configuration
Where you need to change the default behavior (e.g. 'requester pays', allow deletion or overwrite, authentication etc) or need to be able to provide access credentials see the official documentation at:
https://github.com/awslabs/mountpoint-s3/blob/main/doc/CONFIGURATION.md