Forgot your password?
Data Management Planning Workshop
Document Actions
Agenda • Report • Participants |
|
This workshop is part of a larger effort to move towards building data management infrastructure for the future Southeast Coastal Ocean Observing Regional Association (SECOORA). There are two main goals for this one-day workshop--an opportunity to discuss regional data management at a technical level and to plan the scope and content for a regional data management workshop to be held in the Spring 2006. Most of the day was spent discussing data management and data sharing practices. We'll have updates from recent technical workshops (MMI, OOSTech2005, QARTOD-III, OceanUS DMAC). Outcomes from these meetings as they pertain to the Southeast region. An upcoming data managers workshop to be held in Spring 2006 was planned. In addition, two technical tutorials were presented. |
Agenda
|
ReportRapporteur: Liz Williams This report is also available in the following formats: Adobe PDF • Open Document • Word DocumentTable of Contents: SEACOOS DMCC • NERRS/CDMO • SCDNR SEADESC • OMS Tech • FWRI • OOSTECH • MMI • QARTOD • OceanUS DMAC • Workshop • XML • GIS • Next Steps |
|
Aim: Kick-start discussions of regional data sharing and data quality to being development of crucial elements for a regional DM Plan. Goal: Planning to plan. Plan content for a regional data management workshop in Spring 2006 (Chapel Hill). Spring 2006 Workshop: Focus on data sharing and QA/QC of (but not limited to ocean currents. This blends everything: data sharing, aggregation, display, uncertainties, circulation models, fisheries, search and rescue. After Spring 2006: Publish two white papers. One on data sharing and one on QA/QC that will help to define specifics towards a regional DM Plan. Motives:
SEACOOS DMCC funded to participate in national workshops, host today’s planning workshop, host regional DMAC workshop, and write two white papers. Widening the SEACOOS DMCC circle A chance to have input or impact on regional data management strategies Overview of SEACOOS Dwayne Porter, USC, dporter@inlet.geol.sc.edu SEACOOS Goal: To significantly increase the quantity and quality of environmental information from the coastal ocean of the SE U.S. and make this readily available for a range of societal, scientific and educational applications. SEACOOS components: Observing subsystem, data management subsystem, products production and outreach Data Management Coordinating Committee (DMCC) SEACOOS DMCC achievements
Other ongoing SEACOOS issues
Data aggregation/visualization
Sara comments -
Dwayne comments –
Data dissemination
Obstacles/Issues
NERRS - The National Estuarine Research Reserve System Tammy Small NOAA NERR Centralized Data Management Office (CDOM) Was established in 1995 in support of the National Esturarine Research Reserve a nework of 26 reserves in 21 states and territories. CDMO priorities
Goal: promoting stewardship if the nation’s estuaries through science and education using a system of protected areas Presently, NERR is using Excel for data processing and database (EQWin) – generating metadata and submitting to clearinghouse – then uploaded in to a CDMO SQL database Web interface has query -> station location, data type, date boundaries – graphic ability and statistics. Recently switched map to Google Maps presentation Using ColdFusion (by MacroMedia) along with SQL for graphics presentations of queried data or real-time latest data. CMS for SWMP staff - Hidden web site for data collections – macros, manuals, tools, information sharing through forums, calendar on the front page has even calendar NERRS/CDMO IOOS activities
FGDC content compliant – but not FGDC format compliant. The Metadata translation effort uses Metadoor convert to XML – FGDC compliant metadata Opensource issues with NERRS - being addressed – they do have QA/QC documentation. SCDNR Offshore Fisheries Research and Monitoring Data George Sedberry, Jessica Stephen, Marine Resources Research Institute, Baruch SC Department of Natural Resources http://ekman.csc.noaa.gov/seageofish/viewer.html Utilization of ArcGIS for mapping. Online database covers original historical trawl surveys, plankton surveys and some historical hydrographic data from Cape Canaveral to North Carolina. It also includes spawning locations, drifter data, tagging data and vertical temperature profiles from vertical migration data. NOAA Southeastern U.S. Deep-Sea Corals Initiative SEADESC: The working Model –
Data Sharing and Observations Systems Steve Browdy – OMS Tech - steveb@omstech.com OMS Tech is a private company – scientific programming and analysis. Clients include: University of Miami, SeaKeepers International. Main Points Data Transmission and Control
Archival, Retrieval and Storage
Proprietary -> Cache - Intrasystems.com In one example, data acquisition devices that were being deployed had one acquiring module with many different sensors – transmission record was a solitary record, data record variations produced a need for other database records that kept track of changes. Issues:
AJAX – Asynchronous Java Script and XML – can give a rich client feel without having to write a client sided application. It may play a big role in making data dissemination available better so web pages can be changed piecemeal without having to reload the full page. Data QA/QC System should provide an infrastructure so that everyone can “plug� into. The idea is to submit data to the infrastructure “server� which provides the following:
You could use a standard code or utilizing a user specified algorithm. AJAX sites: Facilitating Data Management Kathleen O’Keife, FWC The Fish and Wildlife Research Institute (FWRI) (used to be the Marine Research Institute), Florida Fish and Wildlife Conservation FWRI Projects are using GIS for:
Internet Map Sites (visualization of data) Data Standards Committee developed standards Information Sharing – metadata Data sharing tools – portals, IMS,SVG,XML web services Data Integration tools – Oracle Discoverer, Metadata map server Utilizing SMMS – Spatial Meta-Data Management System GIS & Non-spatial scientific research projects require metadata at FWRI Metadata Cooridinator & staff in each section submit FGDC-compliant metadata Naming Convention – spent a lot of time figuring out how to name things so users can find it Geographic extent, precision, spatial reference Naming convention: What(&scale)_where_who_project_when_topology Archived Data – two oracle databases – just rastered data, the other is the rest Archive ArcSDE – media storage, digital archives Project Finder – Click anywhere on the map of Florida to see what projects we have ongoing in the area. Or slect project using query tool Summary of OOSTECH Oct 24-26, 2005, Baltimore "Web Services for Interoperable Ocean" Payne Seal and Jeremy Cothran http://twiki.sura.org/twiki/bin/view/Main/MinutesOOSTech2005 Dan Reed, gave the keynote speech. Key points:
Phil Bogden Key points: There is ocean observing, there is a need, need to strengthen community Goals: virtual organization new distributed labs, hazards planning, research-> observing systems. Web Services – Machine to Machine interaction designed to maintain platform and language independence. Technologies:
Trillion Grid – virtual data toolkit AJAX – covered in OOSTECH – google maps is a good demonstration of it Two methods of securing messages – secure pipe or a secure message layer Oostech Working Group to work with the DMAC steering committee Video Services presentations were videotaped – both morning and afternoon sessions – implementation of Salinity_slim Summary of Marine Metadata Initiative (MMI) Workshop "Advancing Domain Vocabularies", August 2005, Bolder, Co Vembu Subramanian, USF, vembu@marine.usf.edu The Marine Metadata Initiative
Originally based on GCMD, BODC and CF data standards. OWL files have been generated for over 40 existing vocabularies Workshop breakout groups initiated development of domain ontologies using VINE tool Demonstration of interoperable data access using metadata and vocabulary mapping ontology Tools:
Projects: The Tethys project demonstrates semantic mediation by developing an end-to-end process for finding data in distributed and heterogeneous repositories and making that data accessible. MMI has worked for about six months with various systems (such as AOSN, SSDS, and SEACOOS), developing an architecture and an implementation code to facilitate interoperability based on metadata and semantics mediation. To improve the system (and our own skills) we invite you to be part of Tethys. You will benefit by having hands-on experience in implementing SOAP web service, creating rich semantic metadata using RDF Dublin Core, and publishing the core vocabularies of your organization in ontologies in OWL. At the end we will have created an easily accessible portal to access distributed resources based on semantics. Summary of QARTOD-III Meeting, San Diego, CA Quality Assurance for Real-time Oceanographic Data Sara Haines, Jeremy Cothran, Vembu Subramanian Definitions of QA/QC:
Previous QARTOD goals accomplished:
QARTOD III Goals
QARTOD III Group breakouts
Summary from OceanUS DMAC meeting Dwayne Porter DMAC Steering Team Meeting Nov 01-03, 2005 Recently formed NFRA (National Federation of Regional Associations) http://www.usnfra.org/ Will agree upon and map out efforts between national and regional DMAC communities Identify core expert teams for the identified important technical issues:
Mission Now
SEACOOS Planning the Spring 2006 Workshop Data Sharing and Data Quality focused on Ocean Current Possible Dates: What: Data Sharing for an Operational System: ocean currents, one water quality parameter Who: Send in names and suggested agency participants to Sara Haines by Dec 15 Possible Attendees outside of SEACOOS include:
Suggested Content:
Potential User base:
Technical Tutorial – XML Processing Jeremy Cothran, USC, jcothran@asg.sc.edu Examples of XML processing and utility: Technical Tutorial – Maps and Products using MapServer, postGIS, ImageMagick and GMT Jeremy Cothran, USC, jcothran@asg.sc.edu Mapping Process:
Next Steps Sara Haines
|
Participants
|