Setup You will need to install and configure the awscli package in order to access objects in S3.
Install the AWS CLI The AWS CLI is available through the pip installer:
If you have administrator privileges type
pip install awscli Otherwise use
pip install –user awscli The project is open source, so you can also download the source at https://github.com/aws/aws-cli
Rivanna Users have two options:
Load the awscli module:
module load awscli If you need a different version, install it in your user directory:
pip install –user awscli== Authenticate the CLI to Amazon Web Services Once the aws package is installed, you will need to configure it:
There are two main families of databases: Relational and NoSQL. Relational databases store information in an orderly, column, row, and table schema. They “relate” the tables together to present different views of the data. NoSQL databases are much less structured. This means they can store different data alongside each other – which makes things both easier to store but harder to query across. Relational Databases (RDBMS) Most users have at least heard of relational databases like:
MySQL / MariaDB PostgreSQL Microsoft SQL Server Oracle Relational databases operate on the concepts of tables, relations, indexes, SQL, CRUD operations, and joins.
Users can authenticate their SSH sessions using either a password or an ssh key. The instructions below describe how to create a key and use it for password-less authentication to your Linux instances.
About SSH Keys SSH keys are a pair of encrypted files that are meant to go together. One half of the pair is called the “private” key, and the other half is the “public” key. When users use the private key to connect to a server that is configured with the public key, the match can be verified and the user is signed in. Or, put it more simply, when data is encrypted using one half of the key, it can be decrypted using the other half.
Install the Globus CLI The Globus CLI is available through the pip installer:
If you have administrator privileges type
pip install globus-cli Otherwise use
pip install –user globus-cli The project is open source, so you can also download the source at https://github.com/globus/globus-cli
If you would like to use the CLI from Rivanna, please follow these directions below.
Authenticate using the Globus CLI Log in against your institutional authentication provider. In the case of UVA, we use NetBadge for signing in:
globus login This will open a page in your web browser where you select your institution and proceed to login:
Value and Project storage can be mapped to your Windows or Mac computer as a remote drive. If you are off Grounds you must be running a VPN, such as the UVA Anywhere or the More Secure VPN from ITS. We recommend the More Secure VPN if that is available to you.
Windows Open a File Explorer page. In Windows 10 first select This PC. This is not necessary for earlier versions of Windows. When you see the Computer tab, select that, then select Map Network Drive. When the dialog box appears, the default drive letter will be Z. You can change this to any other available letter if you wish.
Building Compiled Code Using Make Building and Running MPI Code Bioinformatics on Rivanna Custom Jupyter Kernels Loading Module in Jupyter Docker Images on Rivanna Adding packages to a container
General General tips and tricks for computational research.
General HowTos › Rivanna High Performance Computing platform
Rivanna HowTos › Ivy Secure Data Computing Platform
Ivy HowTos › Storage Research Data Storage & Transfer
Storage HowTos ›
