Globally Accessible Data Environment

GLADE connectivity
This network graph shows the I/O connectivity between GLADE and computational resources at the NWSC. The small red cluster represents the GLADE storage resources, the blue connections represent the InfiniBand network, the yellow endpoints represent computational nodes, and the green endpoints are data analysis and visualization resources.

The GLobally Accessible Data Environment (GLADE) provides centralized high-performance file systems spanning supercomputing, data post-processing, data analysis, visualization, and HPC-based data transfer services. GLADE provides computation, analysis, and visualization work spaces common to all CISL HPC resources. Project space is allocated through NCAR's allocation panels, while scratch and user space is available to all users of NCAR HPC resources. GLADE also hosts data from NCAR’s Research Data Archive (RDA), NCAR’s Community Data Portal, and the Earth System Grid which curates CMIP5/AR5 data.

The goals for GLADE are focused on shifting data workflows from a process-based design to an information-based design. Through a globally accessible storage infrastructure, users now arrange their workflows to use stored data directly without first needing to move or copy it. Additional services like high-performance data transfer protocols enhance CISL's ability to bring computational data from other sites to NCAR for post-processing, analysis, and visualization.

In FY2012 we focused on finishing tools and processes for implementation on new GLADE hardware procured as part of the NWSC-1 RFP. Installation of hardware and initial configuration was completed at the NWSC, and pre-production testing was underway at end-FY2012. The complete transition from current GLADE resource at the Mesa Lab in Boulder to the NWSC in Cheyenne will take place in early FY2013. At that time, data-centric resources available to the NCAR user community will increase significantly.

This work supports CISL’s computing imperative for hardware cyberinfrastructure by provisioning storage and networking systems customized to support efficient workflows for the atmospheric and related sciences. Specifically, GLADE facilitates typical user workflows plus special efforts like supporting data flows for the IPCC AR5. GLADE also advanced CISL’s computing imperative for facilities by demonstrating high-performance data services that were critical for the next-generation resources that now operate at NWSC. By using GLADE-enabled workflows, users are well prepared for a smooth transition to NWSC’s new environment. GLADE equipment was purchased with NSF Special funds, and it is supported by NSF Core funds including CSL funding.

2012 CISL Annual Report