This problem has been resolved.
What happened? During scheduled electrical maintenance this morning in the CCR data center, the redundant power supplies on the Panasas storage fell offline on the majority of the storage blades rendering the system unavailable. After contacting Panasas technical support, it was confirmed we hit a bug in their system. Once the electrical work was completed, CCR's storage administrator applied a patch to Panasas to fix the bug we encountered and brought the system back online. We apologize for the inconvenience.
We're aware of issues with Panasas scratch and are working to resolve the problem. We apologize for the inconvenience
NOTE: Panasas has been unmounted from OnDemand as it was preventing logins from occurring. After the service is restored, we'll re-mount it on the OnDemand server.