ESS-DIVE

Deep Insight for Earth Science Data

CONTACT
  • DATA
    • SEARCH DATA
    • SUBMIT DATA
    • ACCESS DATA PORTALS
    • DATA PRESERVATION
    • DATA USE AND CITATION
    • TERMS OF USE
  • ABOUT
    • WHAT WE DO
    • TEAM
    • PARTNERSHIPS
    • PARTNER PROJECTS
    • FEATURES AND SERVICES
    • OPPORTUNITIES
  • GET STARTED
    • DATA SUBMISSION GUIDELINES
    • ESS-DIVE DOCUMENTATION
    • PROJECT CHECKLIST
    • PROPOSAL GUIDELINES
    • DATA REPORTING FORMATS
    • FAQs
  • LEARN MORE
    • NEWSROOM
    • WEBINAR LIBRARY
    • TRAINING EVENTS
    • TRAINING VIDEOS
    • PUBLICATIONS
    • ACRONYMS/GLOSSARY
  • STATUS
  • DATA
    • SEARCH DATA
    • SUBMIT DATA
    • ACCESS DATA PORTALS
    • DATA PRESERVATION
    • DATA USE AND CITATION
    • TERMS OF USE
  • ABOUT
    • WHAT WE DO
    • TEAM
    • PARTNERSHIPS
    • PARTNER PROJECTS
    • FEATURES AND SERVICES
    • OPPORTUNITIES
  • GET STARTED
    • DATA SUBMISSION GUIDELINES
    • ESS-DIVE DOCUMENTATION
    • PROJECT CHECKLIST
    • PROPOSAL GUIDELINES
    • DATA REPORTING FORMATS
    • FAQs
  • LEARN MORE
    • NEWSROOM
    • WEBINAR LIBRARY
    • TRAINING EVENTS
    • TRAINING VIDEOS
    • PUBLICATIONS
    • ACRONYMS/GLOSSARY
  • STATUS

ESS-DIVE Training Events

The Joint Cyberinfrastructure Working Groups and ESS-DIVE Annual Meetings will take place fully virtually on May 12th to 14th, 2026. Registration is required for this event. Please register here for the meeting Zoom details.

The theme this year will focus on “AI-Ready Data and Models”. This free and virtual event is a chance for modelers, data contributors and data users to join forces, fostering the exchange of valuable insights and expertise on BER data. Whether you are new to the BER program, CIWGs, and ESS-DIVE, or have been engaging for a while, this is your opportunity to learn about the latest updates and AI-approaches within our community, and help drive the future of BER data management, integration, and use.

Here’s what you can expect from this year’s meeting:

  • Remarks from BER program managers
  • Updates from ESS-DIVE and CIWGs activities;
  • Lightning session on AI-perspectives across BER and discussions on future direction for BER data use and preparation;
  • Facilitated discussions on agentic scientific workflows;
  • AI-Ready data curation with Reporting Formats;
  • Tutorials on how to curate, publish and use data on ESS-DIVE;
  • And more!

The detailed agenda for Day 2 and Day 3 will be updated before the annual meeting.

All times listed below are in Pacific Time zone.

Tuesday, May 12, 2026
Day 1
09:00AM
02:00PM

For a detailed agenda of the Day 1 (May 12) meeting, you can visit the Cyberinfrastructure Working Groups events page.

Wednesday, May 13, 2026
Day 2
09:00AM
10:00AM 

 

 

 

10:00AM
11:00AM
Opening Session

  • Welcome & Introductions
  • Remarks from BER
  • ESS-DIVE Roadmap for AI
  • ESS-DIVE Feature Updates
  • Q&A

AI-Ready Data Formats
Details to be added before the meeting

11:00AM
11:30PM
Break 
11:30AM
12:00PM 
Perspectives on AI-Ready data
Details to be added before the meeting
12:00PM
01:15PM 
AI for Data and Data for AI: Lightning Session
Details to be added before the meeting
01:15PM
02:00PM
Discussion: Where do we go from here?
Details to be added before the meeting
Thursday, May 14, 2026
Day 3
09:00AM
11:00AM
Curating Data for ESS-DIVE
Details to be added before the meeting
11:00AM 
11:30AM
Break
11:30AM
01:30PM
Afternoon Tutorials *Choose One

Submitting Data on ESS-DIVE
Details to be added before the meeting

Using Data with ESS-DIVE’s AI Assistant
Details to be added before the meeting

01:30PM
02:00PM
Workshop Wrap Up

DOE ESS CI and PI Meeting Training Sessions (April 2025)

The ESS-DIVE Team is looking forward to participating in the Environmental System Science (ESS) Cyberinfrastructure (CI) Working Group Annual Meeting (April 14th) and ESS PI Meeting April 15th-17th in Reston, VA. Charu Varadharajan, Shreyas Cholia, Joan Damerow, Madison Burrus, and Emily Nagamoto will be in person for the ESS CI and PI meetings and hope to see you.

Below are some ways that you can engage with ESS-DIVE at the CI and PI meetings:

ESS Cyberinfrastructure Meeting (April 14th, 2025)

ESS-DIVE Updates

Presenters: Charu Varadharajan and Shreyas Cholia, ESS-DIVE PIs; ESS-DIVE Partner Projects
Session Date and Time: Monday, April 14th; 9:30am to 10:30am EST / 6:30am to 7:30am PST
Location: Hyatt Regency Reston
Session Resources: Presentation Slides

ESS PI Meeting (April 15th – 17th, 2025)

ESS-DIVE Tutorial for Using Data

Session Name: Breakout Session I, Session D
Location:  Lake Anne
Presenter(s): Emily Nagamoto
Date and Time: Tuesday, April 15th; 11am EST / 8am PST
Session Resources: Tutorial Notebook and Presentation Slides

Abstract: The ESS-DIVE data repository has developed a suite of tools to support more advanced data discovery and facilitate the reuse of data for collaboration, synthesis, and innovation. These include web interface and programmatic search tools that enable researchers to find datasets that are scientifically relevant to their questions. This session is designed to empower data users to utilize discovery tools in an easy, reproducible workflow.

Agenda:

  • Overview: Bring your laptop and learn how to use ESS-DIVE’s tools to search and reuse public data on ESS-DIVE at this live, interactive tutorial session.
  • (1) Search for Data: Using the ESS-DIVE Webpage, Dataset API, and Deep Dive API.
  • (2) Explore inside Datasets: Using the APIs and start data analysis

Poster – ESS-DIVE: Advancing DOE ESS Data Management, Discovery, and Use

Presenter(s): Shreyas Cholia
Location: Grand Ballroom D-F, Poster Number 7
Date and Time: Tuesday, April 15 2pm EST / 11am PST
Resources: Poster PDF

The Art of Science Synthesis: Best Practices for Literature and Data Synthesis

Session Name: Breakout Session II, Session B
Location: Regency Ballroom A
Participant(s): Joan Damerow, Kim Ely (ESS-DIVE Partner Project)
Date and Time: Tuesday, April 15th; 4pm EST / 1pm PST

ESS-DIVE Tutorial for PIs and Data Managers

Session Name: Lunchtime Sessions, Session 1
Location: Grand Ballroom A
Presenter(s): Madison Burrus
Date and Time: Wednesday, April 16th; 12:30pm EST / 9:30am PST
Session Resources: Project Report Notebook and Presentation Slides

Abstract: The ESS-DIVE data repository has expanded features and resources to support Environmental System Science, such as project data management and sharing, tracking dataset statuses, streamlined publication management, reporting publication progress, and large data support. This session is designed for ESS PI’s and data managers to learn about the growing suite of features and resources that the ESS-DIVE data repository provides for data management, publication, and use. 

Agenda:

  • Overview of Key ESS-DIVE features for: (i) Data Archival & Publication, (ii) Project Data Management and Sharing, and (iii) Reporting progress to DOE.

Poster – ESS-DIVE Partner Projects: Making it Easier to Curate and Use High-Quality ESS Data

Presenter(s): Joan Damerow
Location: Grand Ballroom D-F, Poster Number 8
Date and Time:
Thursday, April 17 8:30am EST / 5:30am PST
Resources: Poster PDF


ESS-DIVE Annual Data Workshop 2024

ESS Data Integration and Use

The workshop theme focused on “ESS Data Integration and Use”. Our opening session featured ESS researchers who are integrating data across sources to answer new scientific questions; they shared their goals, data management approach, needs and challenges. We then held discussions and tutorial sessions open to a wide range of experience with ESS-DIVE. 

Here’s what we covered during the workshop: 

  • Updates from ESS-DIVE on new and planned features;
  • Presentations from ESS synthesis projects;
  • Discussions on new features and needs to enhance data discovery, and BER data integration;
  • Tutorials on how to publish and use data on ESS-DIVE;
  • Discussions on data curation needs and reporting format updates;
  • And more!

The two-day workshop took place on Thursday and Friday, November 14-15, 2024 9am – 2pm PST (12pm – 5pm EST).

You can request access to videos and presentations by contacting ess-dive support ([email protected]).

Thursday, November 14, 2024
09:00AM
10:15AM 

 

 

 

10:15AM
11:00AM
Opening Session

  • Welcome, introductions (Joan Damerow)
  • Remarks from BER ESS (BER Program Managers)
  • ESS-DIVE roadmap and vision (Charu Varadharajan)
  • ESS-DIVE feature updates (Shreyas Cholia)
  • BER Data Integration: Global Search (Kjiersten Fagnan, Joint Genome Institute)
  • Q&A

Data Management and Needs for ESS Synthesis Projects

  • Debjani Sihi, Emory University – Synthesis of soil respiration data across temperature extremes
  • Eric Slessarev, Yale University – Geochemical Basis for Soil Organic Matter Storage at the Global Scale
  • Amanda Cordeiro, University of Minnesota – Synthesis of existing tropical root data: disturbance effects on tropical forest carbon cycles via changes in belowground dynamics?
  • Philip Stoker, University of Arizona – Southwest Urban Integrated Field Laboratory (SW-IFL)
11:00AM
11:30PM
Break 
11:30AM
12:00PM 
Enhancing Data Discovery through Search Innovations
Fusion database overview, and planned search enhancements (Valerie Hendrix)
CurateGPT Overview and Demo (Harry Caufield)
12:00PM
1:00PM 
ESS Cyberinfrastructure Working Group (Danielle Christianson (LBNL), Terri Velliquette (ORNL))
Discussion on needs for ESS data discovery and use
1:00PM
2:00PM
BER Data Integration Discussion (Joan Damerow)
Use cases for BER ESS integration

 

Friday, November 15, 2024
09:00AM
11:00AM

 

 

Breakout Tutorials on How to Use ESS-DIVE *Choose One

Publishing Data on ESS-DIVE (Dylan O’Ryan)

  • Organizing and submitting datasets
  • Web Form: for data file upload less than 10GB
  • API, Globus, and Tier 2: for large, bulk and complex data upload
  • Formatting FLMD and CSV files

Using ESS-DIVE Data (Emily Nagamoto, Danielle Christianson)

  • Navigate dataset search using web portal and API
  • Search within files using Deep Dive API
  • Data integration using BASIN-3D
11:00AM 
11:30AM
Break
11:30AM 
1:30PM
Data Curation to Enable Reuse and Integration with Partner Projects

Meet the new ESS-DIVE Data Curation Support Partner (Kim Ely)
Discussion on needs for ESS data curation and synthesis ready data

ESS-DIVE Reporting Format Updates

  • Reporting formats overview and plans (Dylan O’Ryan, Joan Damerow)
  • Improving Advanced Terrestrial Simulator (ATS) model data managing and archiving standards (Zhi Li)
  • Harmonization and Usability of Hydrologic Monitoring and Soil, Sediment, and Water Chemistry Reporting Formats (Amy Goldman, Brieanne Forbes)
  • A Workflow and Reporting Format for Processing Environmental Sensor Data and Automated Generation of ESS-DIVE Compliant Metadata (Stephanie Pennington, Ben Bond-Lamberty)
01:30PM
02:00PM
Workshop Wrap Up & Future Directions

DOE ESS CI and PI Meeting Training Sessions (April 2024)

The ESS-DIVE Team is looking forward to participating in the Environmental System Science (ESS) Cyberinfrastructure (CI) Working Group Annual Meeting (April 15th) and ESS PI Meeting April 16th-17th in Reston, VA. Charu Varadharajan, Shreyas Cholia, Joan Damerow, Madison Burrus, and Emily Robles will all be there in person and hope to see you! For informal office hours and help desk, stop by the ESS-DIVE posters during the ESS PI meeting. Below are some ways that you can engage with ESS-DIVE at both meetings. Review our Blog Post on the CI and PI meetings to learn more about the sessions and presentations that we will be leading and participating in.

Below are the details on the training sessions ESS-DIVE is leading:

ESS-DIVE Updates / Planning Discussion

Presenters: Charu Varadharajan and Shreyas Cholia, ESS-DIVE PIs

Session Date and Time: Monday, April 15th; 9:30am to 10:30am EST / 6:30am to 7:30am PST

Presentation Slides

Hands-on Session: ESS-DIVE Data Reporting Formats

Presenters: Emily Robles, Senior Research Associate; Joan Damerow, Research Scientist

Session Date and Time: Monday, April 15th; 1:45pm – 3:15pm EST / 10:45am – 12:15pm PST

Presentation Slides

Hands-on Session: Accessing HPC resources with Jupyter notebooks

Presenter: Shreyas Cholia, ESS-DIVE PI

Session Date and Time: Monday, April 15th; 1:45pm – 3:15pm EST / 10:45am – 12:15pm PST

Breakouts: Round Robin over three key topics

Facilitator: Charu Varadharajan, ESS-DIVE PI

Date and Time: Monday, April 15th; 3:30pm to 5:00pm EST / 12:30pm to 2:00pm PST

Strategic Data Management to Advance Environmental Systems Science

Presenter: Joan Damerow, Research Scientist

Session Date and Time:Tuesday, April 16th; 11:15am – 12:45pm EST / 8:15am – 9:45am PST

Presentation Slides

ESS research often requires multidisciplinary science teams to understand and model multi-scale processes that involve heterogeneous data types. More and more data is being collected, with significant resources. As Elizabeth Wolkowich wrote in 2012: “an ecological dataset collected at a certain place and time represents an irreproducible set of observations, ecologists doing local, independent research possess, in their file cabinets and spreadsheets, a wealth of information about the natural world and how it is changing.“ Making data Findable, Accessible, Interoperable and Reproducible (FAIR) is not a controversial goal, but it takes intentional data management strategies to achieve this goal, particularly so in large team science projects. Furthermore, integrating datasets from different sources can unlock additional scientific returns on data collection efforts.

This breakout gathers perspectives from data providers, data users and data repositories on intentional data management to make data FAIR. We will collect feedback on technical and ESS needs for setting the course towards advancing environmental and biological data integration and reuse capabilities.

Lunchtime Breakout: ESS-DIVE Tutorial for PIs and Data Managers

Presenter: Madison Burrus, Computer Systems Engineer 

Session Date and Time:Wednesday, April 17th; 12:30pm – 1:30pm EST / 9:30am – 10:30am PST

Presentation Slides

The ESS-DIVE data repository has expanded features and resources to support Environmental System Science, such as project data management and sharing, reporting publication progress, large data support, and enhanced search. This session is designed for ESS PI’s and data managers to learn about the growing suite of features and resources that the ESS-DIVE data repository provides for data management, publication, and use.

Poster: ESS-DIVE Data Repository

Presenter: Shreyas Cholia, ESS-DIVE PI

Session Date and Time: Tuesday, April 16th; 4:00-5:30pm EST / 1:00-2:30pm PST; Poster #12

Poster PDF

Poster: ESS-DIVE: Enabling Integration Across ESS Datasets

Presenter: Joan Damerow, Research Scientist

Session Date and Time: Tuesday, April 16th; 4:00-5:30pm EST / 1:00-2:30pm PST; Poster #18

Poster PDF

Inclusive and Equitable Research: Best Practices and Lessons Learned

Participant: Charu Varadharajan, ESS-DIVE PI

Session Date and Time: Tuesday, April 16th; 5:30pm – 6:30pm EST / 2:30pm – 3:30pm PST


ESS-DIVE Open Data Workshop 2023

Unlocking Environmental Insights Through Open Data and Collaboration

Federal agencies in the United States are commemorating 2023 as the Year of Open Science. We were excited to be part of this celebration as we strive to assist you in making your ESS project data not only open but also easily discoverable and highly usable. During this workshop, we had:

  • Presentations from ESS members;
  • Tutorials on new and existing ESS-DIVE features;
  • Knowledge exchange on challenges and opportunities related to ESS data;
  • Collaborative paper opportunity on interdisciplinary project data management;
  • And more! 

The two-day workshop took place on Wednesday and Thursday, November 15-16, 2023 9am – 2pm PST (12pm – 5pm EST). 

You can request access to videos and presentations by contacting ess-dive support ([email protected]).

Wednesday, November 15, 2023
09:00AM
10:00AM 

 

 

10:00AM
11:00AM
Opening Session:

  • Welcome, introductions, logistics, collaborative paper (Joan Damerow)
  • Open data for BER ESS projects (BER program managers)
  • ESS-DIVE feature updates (Shreyas Cholia)
  • ESS-DIVE roadmap and vision (Charu Varadharajan)
  • Q&A

Project Data Management and Open Science: ESS researchers engaged with ESS-DIVE

  • William Mobley (UT Austin, Southeast Texas Urban IFL)
  • Terri Velliquette (ORNL, NGEE Arctic)
  • Tom Ruggles (ORNL, SPRUCE, TES-SFA)
  • Brieanne Forbes (PNNL, River Corridor SFA)
  • Kim Ely (BNL, UAS Reporting Format)
11:00AM
11:30PM
Break 
11:30AM
12:30PM 
Researcher-Led Discussion: Project Data Publishing Decisions to Support Open Environmental System Science (Amy Goldman, PNNL)
12:30PM
02:00PM 
Connecting Related Data for your Project (Joan Damerow)
BER unified data framework report conclusions (Pamela Weisenhorn)
Lightning presentations from EMSL (Jay Bardhan), JGI (Chuck Parker), NMDC (Chris Mungall), KBase (Elisha Wood-Charlson), ARM (Giri Prakash), and MSD-LIVE (Casey Burleyson). We will then discuss:

  • Science use cases and objectives for linking and exchanging information across BER
  • Submitting, finding and accessing project data across systems
  • Next steps for a collaborative paper

 

Thursday, November 16, 2023
09:00AM
11:00AM

 

 

Breakout Tutorials on How to Use ESS-DIVE *Choose One

Publishing Data on ESS-DIVE 

  • Organizing and submitting datasets
  • Web Form: for data file upload less than 10GB
  • API and Tier 2: for large, bulk and complex data upload

Managing Project Data on ESS-DIVE 

  • Manage team members and dataset permissions within your project (i.e. share datasets)
  • View and access project dataset collection with portals
  • Link existing ESS datasets
  • Discussion: Feedback on project management features

Finding and Accessing ESS-DIVE Data

  • Navigate dataset search using web portal and API
  • Search, download and use data
11:00AM 
11:30AM
Break
11:30AM 
1:30PM
Advanced Search and Data Integration Enabled by ESS-DIVE Reporting Formats
Enabling data validation and advanced search (Val Hendrix)
BASIN-3D Data Synthesis Demonstration (Danielle Christianson)
Curating High-Quality Datasets for your Project (Emily Robles)Reporting formats are data standards developed by ESS-DIVE and project partners to standardize metadata and data files of data types commonly collected by DOE ESS projects. These reporting formats will be used to enable synthesis across datasets on ESS-DIVE. To learn more, view the Reporting Formats page and our Reporting Formats Checklist.

  • Overview of ESS-DIVE reporting formats
  • How to describe and format files
  • Dataset and file review
  • Validation challenges
  • Plans and feedback for updating datasets and reporting formats
01:30PM
02:00PM
Workshop Wrap Up & Future Directions

You can request access to videos and presentations by contacting ess-dive support ([email protected]).


DOE ESS PI Meeting Training Sessions (May 2023)

The ESS-DIVE Team is looking forward to participating in the ESS PI Meeting on May 16th-17th. Deb Agarwal, Charu Varadharahan, Shreyas Cholia, Joan Damerow, and Emily Robles will all be in-person for the ESS PI meeting! For additional presentations that ESS-DIVE is giving, see our blog post on our activities at the Environmental System Science (ESS) Cyberinfrastructure (CI) Working Group Annual Meeting and ESS PI Meeting on May 15th and May 16th-17th.

On Tuesday, May 16, 2023 the ESS-DIVE team will present tutorials on: (1) Managing project data on ESS-DIVE and (2) Creating and publishing high-quality datasets. Here are more details on the two tutorials:

ESS-DIVE tutorials: Managing project data on ESS-DIVE

Presenter: Joan Damerow, Research Scientist

Session Date and Time: May 16th, 2023; 10:30 AM -12:30 PM ET / 7:30 AM – 9:30 AM PT

Presentation Slides

This session is designed for PI’s and data managers who want to learn how to manage project data on ESS-DIVE. We will first provide an overview of how ESS-DIVE can support a project’s data management needs. The tutorial will then walk through how to use ESS-DIVE features for project data management, including: (1) new features to assign project data managers and create teams, (2) sharing data permissions with project members for collaborative editing and review, (3) creating portals to showcase project data collections, and (4) linking ess-dive datasets to other repositories.

ESS-DIVE tutorials: Creating and publishing high-quality datasets

Presenter: Emily Robles, Senior Research Associate 

Session Date and Time: May 16th, 2023; 1:00 PM – 2:30 PM ET / 10:00 AM – 11:30 AM PT

Presentation Slides

Learn how to upload and publish data with ESS-DIVE as a new contributor in this hands-on training session. We will cover all of the basics needed to get started with publishing datasets, from important considerations for organizing data and accompanying metadata, to choosing an upload method for dataset submission, and requesting publication and following the dataset review process. Our hands-on activity walks through creating and submitting a dataset to ESS-DIVE’s sandbox using our online submission form. We will also discuss ways that researchers can improve the quality of their datasets by using ESS-DIVE’s data and metadata formats.


ESS-DIVE Annual Data Workshop 2022

Collaborative Data Management to Advance Environmental System Science

ESS-DIVE had their Annual Data Workshop on Collaborative Data Management to Advance Environmental System Science in November 2022. During this workshop, attendees learned about:

  • Publishing data for your BER ESS project;
  • ESS-DIVE features, data, and vision; 
  • How ESS researchers manage and publish project data, and discuss needs; 
  • How to use ESS-DIVE and features for collaborative data management; and
  • How to organize and curate high-quality datasets.

The two-day workshop took place on Wednesday and Thursday, November 9-10, 2022 from 9am – 2pm PST (12pm – 5pm EST).

You can request access to videos and presentations by contacting ess-dive support ([email protected]).

Wednesday, November 9, 2022
09:00AM
11:30AM 

(All times listed in PDT)

Opening Session: 

  • Welcome, introductions, logistics  (Deb Agarwal)
  • BER remarks on ESS program data management (Dan Stover, Jay Hnilo)
  • ESS-DIVE features  (Shreyas Cholia)
  • ESS-DIVE data and vision (Charu Varadharajan)
  • Engaging with ESS-DIVE on data management  (Joan Damerow)
  • Q&A

10 min break

ESS Project Data Presentations: ESS projects that have published many datasets in ESS-DIVE discuss their overall project data management approach, and how they create and publish datasets.  

  • Terri Velliquette (ORNL): NGEE-Arctic & Terrestrial Ecosystem Science SFA including the experiment Spruce and Peatland Responses Under Changing Environments (SPRUCE)
  • Gilberto Pastorello (LBNL): NGEE-Tropics
  • Amy Goldman (PNNL): Worldwide Hydrobiogeochemical Observation Network for Dynamic River Systems (WHONDRS)
  • Madison Burrus (LBNL): Watershed Function SFA
  • Will Rudisill (Boise State University): Model-Data Fusion to Examine Multiscale Dynamical Controls on Snow Cover and Critical Zone Moisture Inputs
  • Nicole Lau (UC Berkeley): Subalpine and Alpine Species Range Shifts with Change
  • Gil Bohrer (Ohio State University): Functional-type modeling approach and data-driven parameterization of methane emissions in wetland
11:30AM 
12:00PM
Break 
12:00PM 
02:00PM
Understanding Project Needs for Managing and Publishing Data* – Breakout Discussions     

ESS-DIVE team members will lead discussions on how we can address data management and publication needs. Topics include: project data management approaches, number of datasets produced by projects, challenges with publication, and successes.

*Attendees will be randomly assigned to a smaller breakout room

 

Thursday, November 10, 2022
09:00AM
10:30AM

 

 

 

 

10:40AM
11:30AM

 

 

ESS-DIVE How-To Tutorials (Choose one)** 

  • ESS-DIVE for Data Submitters (Emily Robles)
    • Organize and submit datasets
    • Online Form: for data file upload less than 10GB
    • API: for large, bulk and complex data upload
  • ESS-DIVE for Data Users (Madison Burrus)
    • Online Portal: dataset search and discovery
    • API: bulk download and search summary

10 min break

Managing Data on ESS-DIVE (Joan Damerow, Charu Varadharajan)

  • Portals, Dataset collaboration, and Project Spaces 
    • Manage team members and editing permissions 
    • View and access project dataset collection with portals
  • Link datasets to external data sources
11:30AM 
12:00PM
Break
12:00PM 
1:45PM
Organizing and Curating High-Quality Datasets 

  • Data organization and ESS-DIVE reporting formats
  • ESS researcher examples of curating datasets and workflows
    • Dylan O’Ryan (LBNL): Watershed Function SFA
    • Ricardo Eloy Alves (LBNL): LBNL TES SFA 
    • Brieanne Forbes (PNNL): WHONDRS 
    • Stephanie Pennington (PNNL): Coastal Observations, Mechanisms, and Predictions Across Systems and Scales (COMPASS)

Tutorial: Getting Started with ESS-DIVE Reporting Formats 

  • Choose which reporting formats to use and workflow
  • Describe, format, and use standardized data files
  • Q&A, Polls: Needs for adopting ESS-DIVE reporting formats
01:45PM
02:00PM
Workshop Wrap Up

**Attendees to choose their own breakout sessions in zoom.

You can request access to videos and presentations by contacting ess-dive support ([email protected]).


DOE ESS PI Meeting Training Sessions (May 2022)

ESS-DIVE presented training sessions at the annual Environmental System Science (ESS) Program Principal Investigators Meeting that began on Tuesday, May 24, 2022, and concluded on Thursday, May 26, 2022. The ESS-DIVE team presented at multiple sessions at this virtual meeting hosted by the U.S. Department of Energy. 

On Tuesday, May 24, 2022 the ESS-DIVE team presented the following hands-on data management trainings from 1:30 pm – 3:30 pm ET that will help you better understand and use various ESS-DIVE features for managing project data. Here are more details:

ESS-DIVE Overview [Presentation Slides]

Presenter: Charuleka Varadharajan and Team

Main room

Introduction to ESS-DIVE before breakout sessions.

New user bootcamp [Presentation Slides]

Presenter: Emily Robles

Breakout room A

Learn how to upload and publish data with ESS-DIVE as a new contributor in this hands-on training session. We will go over the process for publishing data on ESS-DIVE, from important considerations for organizing data and accompanying metadata, to requesting publication and following the dataset review process. We will also discuss how to utilize the ESS-DIVE main portal search features and download data.

Project data management [Presentation Slides]

Presenters: Charuleka Varadharajan and Madison Burrus

Breakout room B

This session is designed for PI’s and data managers who want to learn how to manage project data on ESS-DIVE. We will first provide an overview of how ESS-DIVE can support a project’s data management needs. We will then describe how projects can use ESS-DIVE features to curate and manage data including: (1) a package Service API for bulk programmatic dataset creation and editing (2) sharing datasets with project members for collaborative editing and review. (3) linking data on ESS-DIVE to related datasets on other public data repositories (4) portals to showcase data collections, and (5) an upcoming feature to manage project members and data. 

ESS-DIVE data formats [Presentation Slides / View Recording of Session]

Presenters: Robert Crystal-Ornelas and Dylan O’Ryan

Breakout room C 

In this session, we will discuss ways that researchers can make research data more reusable using ESS-DIVE’s 11 data and metadata reporting formats. These data formatting templates apply to many data types relevant to earth and environmental science research. They include general formats that apply to many data types (CSV files, file-level metadata, locations, samples, model data), and formats for specific data types (water and sediment chemistry, sensor-based hydrological monitoring, leaf-level gas exchange, soil respiration, and amplicon abundance). In this session, participants will apply the reporting formats to tabular data, and hear from researchers who are currently using reporting formats on their own environmental data and metadata.


ESS-DIVE Annual Data Workshop 2021

Jump-start and build your environmental data management and sharing for DOE ESS-funded projects.

Registration for this event is closed, thank you to everyone who joined us for the ESS-DIVE Annual Data Workshop. Workshop presentations and materials can be accessed through our 2021 workshop GitHub repository.

Join us for the ESS-DIVE Annual Data Workshop to start and build your DOE Environmental Systems Science (ESS) project data management and sharing efforts. During this workshop, you can expect to learn about:

  • DOE ESS project data management and review process; 
  • How to use ESS-DIVE and updates on features;
  • Standard reporting formats that make data more discoverable and usable;
  • How other ESS researchers manage and share data;
  • Other data-related topics important to DOE ESS.

The two-day workshop will take place on Monday and Tuesday, May 24-25, 2021 from 9am – 2pm PST (12pm – 5pm EST). While we encourage attending both days to gain the most value, feel free to join sessions that interest you.

How to Register: Complete this short form to register for the ESS-DIVE Annual Data Workshop. This event is free and open to all who will use the ESS-DIVE data repository, so please forward to your respective groups.

Please review our Attendee Instructions in preparation for the workshop.

Download a PDF version of our agenda.. Contact us at [email protected] for any questions or suggestions. 

Monday, May 24, 2021
09:00 AM-11:00 AM

(All times listed in PDT)

                                                                   

Opening Session:

Welcome, introductions, logistics (Joan Damerow)

BER EESS project data management and review (Justin Hnilo)

ESS-DIVE Demo video (Emily Robles)

ESS-DIVE Features overview and future directions (Charu Varadharajan)

Data management plan – what to expect from ESS-DIVE (Deb Agarwal)

ESS-DIVE data reporting formats and standards (Rob Crystal-Ornelas)

Q&A (Deb and Charu)

ESS Project Data Presentations:

Watershed Function SFA Field-Data Workflow (Zarine Kakalie, LBNL), Biogeochemistry of Actinides (Nancy Merino, LLNL), SPRUCE Whole Ecosystem Warming Experiment (Les Hook, ORNL), NEON Hyperspectral Ground Campaign (Katie Grant, Stanford/USC), Worldwide Hydrobiogeochemical Observation Network for Dynamic River Systems (WHONDRS; Amy Goldman, PNNL)

11:00 AM-12:00 PM

Break and Data Help:

Office Hour

12:00 PM-02:00 PM                                                                                                                                                                                                                                                      

Breakout Sessions on Data Management and Publication Challenges and Needs(Choose a session)*

  • National Lab Projects
  • University Projects

To start the breakout session, attendees will present a one-min/one-slide summary of project data and data management approach. This may include challenges moving data to ESS-DIVE, and any barriers encountered. The remainder of the session will be dedicated to discussion of your data management and publication challenges and needs.

 

 

*Attendees to choose their own breakout sessions in zoom.

Tuesday, May 25, 2021
 09:00 AM-09:30 AM

                                                                                

Ready to publish your data package? A discussion on what to include in a data package. (Zarine Kakalia)

Bring your use cases and get feedback on what to include and what repositories to publish different data.

9:30 AM-11:00 AM

Hands-on Tutorial for How to Use ESS-DIVE(Choose a tutorial)*

  • ESS-DIVE for Beginners: Data Submission, Search and Download using the Web User-Interface 

(Geared towards new users or those who have not uploaded data to ESS-DIVE)

  • ESS-DIVE for Advanced Users: Uploading Data to ESS-DIVE Programmatically, Portals Tutorial 

(Geared towards those who have uploaded data previously, and/or need to upload a large amount of data from a project)

11:00 AM-12:00 PM

Break and Data Help:

Office Hour

12:00 PM-01:00 PM

ESS Data Types (Choose a session)*

  • Large data and model data archiving
  • Sensor data and QA/QC
  • Sample tracking and analysis workflows, linking related sample data
01:00 PM-02:00 PM

How to Use ESS-DIVE Reporting Formats:

ESS-DIVE reporting format tutorial (Rob Crystal-Ornelas)

File-level and csv (Terri Velliquette)

Breakout Tutorials (Choose one or more tutorials)*

  • Model data (Madison Burrus)
  • Sample identifiers and metadata (Joan Damerow)
  • Water quality/soil samples (Kristin Boye)
  • Leaf-gas exchange (Kim Ely)
  • Continuous soil respiration (Ben Bond-Lamberty)
  • 16s amplicon sequencing (Pamela Weisenhorn)
  • Hydrologic monitoring (Amy Goldman)

*Attendees to choose their own breakout sessions in zoom.