Priority 2: Developing and Providing Advanced Services and Tools

FODM Integration into EOL

Background

In FY2006, EOL completed the integration of the Field Operations and Data Management (FODM) group of the UOP Joint Office for Science Support (JOSS) into EOL. FODM brought significant computing infrastructure, both hardware and software, that required integration into EOLís environment. This was a major undertaking, requiring months of effort due to the long history of service provided by the group and the complicated legacy of data and web systems that had been built over the span of many years.

Progress

The first major accomplishment within this project was the creation of EMDAC (EOL Metadata Database And Cyber infrastructure). Researchers can use this web- and Java-based tool to easily access approximately 30 million data entries from experiments spanning 20 years by searching its contents, browsing quick-look products, and retrieving data files either via the Internet or via an offline media order, and database administrators can maintain the database just as easily. The JOSS/FODM metadata database, known as CODIAC, serves as the core of EMDAC. EOL staff developed a generator for THREDDS catalogs and worked with SCD to provide access to EMDAC datasets via the UCAR Community Data Portal (CDP). In 2007 EOL will continue to develop EMDAC, providing a next-generation user interface and enhancing the links between EMDAC and the CDP. We will develop tools to make it easier for EOL facilities to manage their datasets via EMDAC, and provide education on their use. To further improve its efficiency, stability and ease of use, we will incorporate EOLís Mass Store Retrieval tool into EMDAC.

Another key product integrated into the EOL infrastructure is the highly popular Field Catalog used in over two dozen projects to date. EOL's Field Catalog was initially developed by JOSS/FODM as a tool for collecting, organizing, and presenting reports and quick-look data products during the field phase of observational experiments. During 2006, Field Catalogs were deployed and supported for T-REX, MILAGRO, CuPIDO, and the summer WRF exercise.

Plans

In FY 2007 EOL plans to develop a single integrated codebase for the Field Catalog, providing a secure and robust platform for future projects. This will take advantage of the EMDAC infrastructure and will allow products from field experiments to be managed alongside completed datasets. EOL will provide additional ways of monitoring and retrieving products and reports from the Catalog, such as the Internet standard RSS (Really Simple Syndication) and Unidata'­s IDV (Integrated Data Viewer).

For Further Information

EOL Annual Report