JupyterCon 2023

Using Jupyter-notebooks to document and support climate and meteorology data
05-12, 11:00–11:30 (Europe/Paris), Gaston Berger

The study of climate and meteorology is underpinned by an ability to use large datasets, however handling these datasets has typically been the role of specialists in the field. Jupyter notebooks provide a novel approach to introducing large complex datasets to a non-specialist audience, where the boundaries between documentation and use-cases becomes fluid.

The Copernicus Climate Change Service (C3S) Climate Data Store (CDS) is an entry point to a broad spectrum of data related to climate and meteorology, from output produced by weather and climate models to observation data from satellites and weather stations. Even when strict data standards are followed, each dataset has its own peculiarities and pitfalls which require some degree of documentation support. Jupyter notebooks, provide the perfect complement to user-guides that typically accompany the datasets available in the CDS. The notebooks provide examples of how to access, download and explore the data, and provide a platform where the producers of the data can demonstrate the qualities of the data and applied use cases.

The C3S is embracing this concept and building a JupyterBook-based training material to support users of the datasets available in the CDS. Such a library will instigate greater use of climate and meteorology in sectoral fields (e.g. health, tourism and transport) and could be used as an educational resource in universities and schools. This library will feature directly in the JupyterHub-based online development environment that will be integrated into the modernised version of the CDS.

This session will present the training material we have produced, and the framework we have in place such that data producers are able to easily contribute to our growing library of content. We will demonstrate the importance of this material in providing data users the information required to make use of the data, and how this fits in the plans for modernising our online development environment. This session is aimed at people who may be interested in using the training material we have produced to gain experience handling climate, weather and observation data; and aimed at people who may want to construct a similar, community developed, training material resource.

The CDS is implemented by the European Centre for Medium-Range Weather Forecasts (ECMWF) on behalf of the European Commission.

I am currently an analyst for the Copernicus Climate Change Service (C3S) Climate Data Store (CDS) and have a history working in land surface modelling and earth observation. I am driven by the objective that we should all be able to have access to, and have the tools to amke use of, the data outputs from climate models and satellite observations. Historically, this has been the role of specialists, however as the world becomes significantly more computer literate we can make huge bounds in progress by enabling access to a wider audience.

The C3S is an EU project which aims to provides information to support adaptation and mitigation policies in response to a changing climate. The CDS is the vehicle for ensuring that the data products and tools created by specialists within C3S are made accessible and discoverable to a wider audience of users.

I am a Scientific Software Engineer at the European Centre for Medium Range Weather Forecasts, working on open-source scientific Python for climate data discovery, analysis and visualisation.