How to Check your Quota

How to Purchase More Storage

Backup & Data Retention Policies

How to Request the Restore of Data

CCR provides a wide variety of options for researchers to store their data.  See below for a comparison of the various options.  If you are unsure what option works best for your group, please contact CCR Help.

1.  EMC Isilon Network-Attached Storage (NAS) - CCR provides a total of 3 PB of available disk storage to all the clusters in the Center for user home directories and group shared project directories.  This is an enterprise-level, highly redundant storage solution designed for 99% uptime.  All directories are backed up off-site nightly by UBIT

Home Directories:

  • Directories are available on the clusters and accessible from all compute nodes.
  • Default user quota is 5GB.
  • Backed up by UB's Central Computing Enterprise Infrastructure Services department

Home directory location:  /user/UBIT_username
Example: /user/ccrguest

Project Directories:

  • Additional disk space is available for research groups in the project directories.
  • Faculty interested in project disk space should contact the CCR help
  • The default project directory quota is 500GB.  The quota can be increased to 1TB without charge.
  • Backed up by UB's Central Computing Enterprise Infrastructure Services department
  • If you require more than 1TB of storage, additional space can be purchased at a rate of $643.52/TB:
    • This is an internal rate for internal UB users including academic, research, administrative, and auxiliary units whose originating source of funds is within or flows through the university.  This includes state, RF, UBF, and Faculty Student Association (FSA) funds
    • Internal users paying with funds other than those listed above are charged an additional fee to cover the fee UB charges CCR.  This makes the cost $739.67/TB
    • Faculty with joint positions at UB and Roswell can only qualify for the UB internal rate if they use UB funds to purchase the storage.
  • External user price: $1000/TB
  • This rate is good for the 5 year lifespan of the storage warranty (December 2020).  After this time, you must buy in to any new storage CCR upgrades to.

Projects directory location - depends on your affiliation:

  • /projects/academic/group_name - for all faculty of UB
  • /projects/industry/group_name - for all industry partners (could be project name, company name, or other group name - if you're not sure, ask CCR staff)
  • /projects/rpci  - for all Roswell Park affiliated users

2.  Global Scratch Space - IBM General Parallel File System (GPFS)

  • CCR provides 500TB of high performance global scratch space.
  • Accessible from all front end servers and compute nodes.
  • Available to all users for temporary use.  Just create yourself a directory in /gpfs/scratch
  • Designed for high speed, parallel computing, large datasets, with the fastest I/O at the Center
  • Data that has not been accessed in more than 30 days is subject to removal by an automated scrubber script.  Please remove all data promptly after your job completes.
  • There is NO backup of data in /gpfs/scratch
  • There is no guarantee of uptime

Global scratch location:  /gpfs/scratch

NOTE: It is an outright violation of University at Buffalo computing policy to attempt to circumvent this policy.  Anyone found attempting to modify file dates to get around the scrubber will have their data removed without notice and their account deactivated.  We actively monitor for this!

3.  Local Scratch Space:

  • All servers and compute nodes in all the clusters have local disk space (/scratch).
  • This scratch space is available to batch jobs running on the clusters.
  • Data on local scratch may be subject to removal as soon as the job completes
  • There is NO backup of data in /scratch.

4. Cloud storage:

  • Accessible only from cloud instances
  • Cost is $100/TB PER YEAR
  • There is NO backup of data for the research cloud
  • There is no guarantee of uptime or performance on cloud storage
  • Available only to research groups with active cloud subscriptions
  • More details about the cloud cost structure

Comparison of CCR Storage Options

Data Backup
Additional Notes
EMC Isilon NAS
Designed for 99% uptime
2 scheduled maintenance outages/year
Home directory (5GB): Free
Project directory (1TB): Free
Extra project space: $668/TB*
All CCR servers, cluster front-ends, and cluster nodes
Backups off-site daily by UBIT.  Data retained securely for 6 months
GPFS high-speed scratch
Volatile, no guarantee of uptime
Free for use while running jobs on the clusters
All cluster front-ends and cluster nodes; some servers
Short term data storage only.  Files over 3 weeks in age are automatically deleted daily
Local scratch directory
Volatile, no guarantee of uptime
Free; limited by space available on node/server which varies across nodes
Local disks on all servers and cluster nodes
Data may be subject to removal when jobs complete.  Users should copy all data from local disks at job end
Cloud storage
Redundant, fiber-connected Dell Equilogic storage system
2 scheduled maintenance outages/year
$100/TB PER*
Only accessible from your cloud instances
Data deleted if cloud subscription is not renewed

*Price for UB faculty groups.  For all others, please contact CCR Help for a quote