UVA Research Computing

Research Computing

Creating innovative solutions for researchers

/tag/storage

  • Globus Data Transfer

    Globus Data Transfer Is a simplified way to access and move your research data, across all systems, using any existing identity. Transfer data to and from systems such as: Laptops HPC clusters (Rivanna) Secure computing (Ivy) Lab / departmental storage Tape archives Cloud storage Off-campus resources (XSEDE, National Labs) Access them all using just a web browser. This can help you share research data with colleagues, co-investigators, or to move data back and forth between a lab workstation and Rivanna or your personal computer. Data stored at a different institution? At a supercomputing facility? All you need is your campus login.
  • Research Value Storage

    Overview Research Computing offers several budget options for storing non-sensitive research data. The Research Value Storage provides users with a solution for research data storage and collaboration. Members in the same group have access to a shared directory created by the team lead or PI. Group membership can be defined and managed through ITS MyGroups system. Value storage is mounted on the Rivanna HPC cluster and can also be accessed on a personal computer with an SMB mount, allowing for point-and-click file manipulation. If you are not a researcher, UVA ITS offers Academic Value storage for long-term storage of large scale data.
  • Non-Sensitive Data Storage

    /home /home is a free 50GB space provided to users of the Rivanna HPC system and is visible from the Rivanna login and compute nodes. /home is the default working directory when logging on to Rivanna. Users can also access their home directory at /home/$USER, where $USER is an individual’s UVa computing ID. /scratch /scratch is a Lustre high performance parallel filesystem accessible via the Rivanna login and compute nodes. All Rivanna HPC users are granted 10TB for free and can access this space within Rivanna at /scratch/$USER, where $USER is an individual’s UVa computing ID. The /scratch directory is not intended for long-term data storage.
  • Storage Request

    Name * E-mail * User ID * Affiliation * - Select - College of Arts & Sciences School of Data Science School of Engineering and Applied Sciences School of Medicine Darden School of Business UVA Health System Other Type of Request *   Create new storage share   Increase size of existing share   Decrease size of existing share   Retire existing share Storage Platform *   Project Storage ($60 /TB/year)   Value Storage ($45 /TB/year)   ZFS Storage ($30 /TB/year)   Ivy Central Storage ($45 /TB/year) Data Sensitivity *   Moderately sensitive / public   Highly Sensitive Space (TB) * Select an increment of 1TB.
  • HPC Storage

    There are a variety of options for storing large-scale research data at UVa. Non-sensitive data storage systems can be accessed from the Rivanna high performance computing system. .tg {border-collapse:collapse;border-spacing:0;border-color:#ccc;} .tg td{font-family:Arial, sans-serif;font-size:14px;padding:10px 5px;border-style:solid;border-width:0px;overflow:hidden;word-break:normal;border-color:#ccc;color:#333;background-color:#fff;} .tg th{font-family:Arial, sans-serif;font-size:14px;font-weight:normal;padding:10px 5px;border-style:solid;border-width:0px;overflow:hidden;word-break:normal;border-color:#ccc;color:#333;background-color:#f0f0f0;} .tg .tg-hy9w{background-color:#eceeef;border-color:inherit;vertical-align:top} .tg .tg-dc35{background-color:#f9f9f9;border-color:inherit;vertical-align:top} .tg .tg-0qmj{font-weight:bold;background-color:#eceeef;border-color:inherit;vertical-align:top} Non-Sensitive Data Storage Name Quota Price Data Protection Accessible from Best Practices /home 50GB Free 3-week snapshot Rivanna login and compute nodes /home is best used as a working directory when using Rivanna interactively. SLURM jobs run against /home will be slower than those run against /scratch. /scratch 10TB Free Data removed 90 days after last file modification timestamp Rivanna login and compute nodes /scratch is a high performance parallel filesystem that is suitable for large scale computational work.
  • Rivanna

    Rivanna is the University of Virginia’s High-Performance Computing (HPC) system. As a centralized resource it has hundreds of pre-installed software packages available for computational research across many disciplines. Currently the Rivanna supercomputer has over 8,000 cores and 8PB of various storage. All UVA faculty, staff, and postdoctoral associates are eligible to use Rivanna, or students when part of faculty research. The sections below contain important information for new and existing Rivanna users. Please read each carefully. New users are invited to attend one of our free orientation sessions (“Introduction to the HPC System”) held throughout the year during office hours or by appointment.
  • Pricing

    Below is a schedule of prices for Research Computing resources. Rivanna Allocations Type SU Limits Cost SU Lifetime Standard 100,000 per application; renewable up to 3x per year (400,000 total SUs) Free 12 months Deans’ Allocations None Free 12 months by default, negotiable Purchased None $0.015 (<1M SUs); $0.01 (=1M SUs) Forever Instructional 25,000 Free 2 weeks after last teaching session * GPU node charge rate is 2.0 SUs instead of 1.0. ** Non-UVA personnel are charged at a rate of $0.07/SU About Allocations
  • SLURM Job Manager

    Overview Rivanna is a multi-user, managed environment. It is divided into frontends, which are directly accessible by users, and compute nodes, which must be accessed through the resource manager. We use the Simple Linux Utility for Resource Management (SLURM), an open-source tool that performs cluster management and job scheduling for Linux clusters. Jobs are submitted to the resource manager, which queues them until the system is ready to run them. SLURM selects which jobs to run, when to run them, and how to place them on the compute node, according to a predetermined site policy meant to balance competing user needs and to maximize efficient use of cluster resources.
  • Research Data Storage

    There are a variety of options for storing large-scale research data at UVA. Non-sensitive data storage systems can be accessed from the Rivanna high performance computing system. Sensitive data can be stored and accessed within the Ivy secure computing environment. Information Technology Services (ITS) also provides multiple tiers of data storage for personal and non-research storage needs. .tg {border-collapse:collapse;border-spacing:0;border-color:#ccc;} .tg td{font-family:Arial, sans-serif;font-size:14px;padding:10px 5px;border-style:solid;border-width:0px;overflow:hidden;word-break:normal;border-color:#ccc;color:#333;background-color:#fff;} .tg th{font-family:Arial, sans-serif;font-size:14px;font-weight:normal;padding:10px 5px;border-style:solid;border-width:0px;overflow:hidden;word-break:normal;border-color:#ccc;color:#333;background-color:#f0f0f0;} .tg .tg-hy9w{background-color:#eceeef;border-color:inherit;vertical-align:top} .tg .tg-dc35{background-color:#f9f9f9;border-color:inherit;vertical-align:top} .tg .tg-0qmj{font-weight:bold;background-color:#eceeef;border-color:inherit;vertical-align:top} Non-Sensitive Data Storage Name Quota Price Data Protection Accessible from Best Practices Project Storage 1TB increments $60 /TB/yr 2 week snapshots Rivanna, NFS mount /projectis ideal for long-term storage of data to be accessed from Rivanna.
  • Sensitive Data Storage - Ivy

    Overview The Ivy secure computing environment meets both HIPAA- and CUI-compliance standards and is ideal for storing sensitive research data. Ivy offers several storage options to fit your research computing needs. Ivy Central Storage Ivy Central Storage (ICS) is a sensitive data parking zone and central storage pool with a capacity greater than 1PB. This storage space is available for researchers with highly sensitive data and can be mounted on an Ivy virtual machine (VM). For added security, files stored on ICS are read & write only. Executable files can be moved from ICS to VM storage. Researchers can request space on ICS by first requesting an Ivy account using the form on the CADRE website.
  • /project Storage

    Overview The /project file system provides users with a collaborative space for data storage and sharing. Members in the same group have access to a shared directory created by the team lead or PI. Group membership can be defined and managed through ITS MyGroups system. /project storage is mounted on the Rivanna HPC cluster and runs on a new scale-out NAS file system. How to request space in /project /project storage is available by request (via CADRE User Support page) for $90/TB/YR. When filling out the form, the PI can specify the size of the /project directory and the name of an existing or new MyGroup that can access this space.
  • Cloud Storage Solutions

    Amazon Web Services Tiered object storage Amazon S3 and Glacier offer cloud-based, affordable, unlimited capacity for storage from anywhere. Advanced features include scalability, lifecycle management, encryption, and sharing. S3 is ideal for static files that need to be retrieved from any location (PDFs, images, video, etc.). Glacier is archival storage, perfect for grant compliance that reqires data retention. How RC can help: Lower pricing - UVA has an Internet2 discount available for educational use. Contact us to create an account for you or your research project. Cost estimates - Cloud storage is not free. Consideration should be made to the size of your files and how often they will be retrieved.
  • Commercial Data Sharing and Archiving Solutions

    Box® Non-sensitive cloud storage UVA Box is a cloud-based storage and collaboration service that gives eligible members of the University community the ability to access, store, and share up to 1 TB of non-sensitive/moderately sensitive University files securely—anywhere, anytime, on any device. Read more DropBox®/Sookasa® Sensitive Data (PHI/PII) storage If you plan on storing sensitive data such as PHI or PII, UVA Health System offers a secure encrypted storage for Health System affiliated researchers, students, and staff. “DropBox Sookasa” is a free cloud-based service hosted on Dropbox that can be accessed over the internet on any device. Highly sensitive data such as a HIPAA compliant dataset or PHI/PII must be stored in a Sookasa folder.
  • User Guides

    High Performance Computing Standard and high security HPC to run your code, generally written in R, Python or shell scripts. Get Started › Secure Computing Secure virtual machines and interactive notebooks for processing HIPAA and other sensitive data. Get Started ›
    Storage Need large, or extremely large storage offsite or on grounds? Can you count in GB, TB, or PB? Learn more about storage options and pricing. Get Started ›
    Cloud Have an idea you’d like to test? Need an environment provisioned in short-order? We can help you build in the AWS cloud.

  • Mission

    Research Computing is a support team at the University of Virginia whose mission is to empower researchers to achieve more through the use of cutting-edge computational resources. We strive to create innovative solutions for researchers who need help solving complex optimization, parallelization, workflow, and data analysis issues. Our strategy is to build and maintain the University’s best computing platforms while educating the next generation of researchers on the power and utility of advanced computing.